JP2005260357A - Image recorder/reproducer, recording/reproducing method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent occurrence of notches between the fields at an object part even if the video image of a moving object is subjected to non-interlace reproduction. <P>SOLUTION: An image pick-up section 100 generates the image signals of first and second fields by interlace scanning, and a fluctuation detecting section 102 detects fluctuation of its own device to output a detection signal. Based on the image signals generated from the image pick-up section 100 and the detection signal outputted from a fluctuation detecting section 102, the fluctuation detecting section 102 makes a decision whether photography is in progress by a predetermined photography technology or not. If photography is in progress by a predetermined photography technology, a field fluctuation calculating section 105 calculates a field fluctuation correction value for offsetting the fluctuation of an object of its own device generated between first and second photography time points based on the detection signal outputted from the fluctuation detecting section 102 and the object focal point information at the image pick-up section 100. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an image recording / reproducing apparatus, an image recording / reproducing method, and a program, and more particularly to an image recording / reproducing apparatus that converts an interlaced scanning video signal into non-interlaced recording and reproduction, and the image recording / reproducing apparatus. The present invention relates to an image recording / reproducing method and a program for causing a computer to execute the image recording / reproducing method.

  Television signals formatted according to major broadcast standards are interlaced scanning video signals. In an interlaced scanning video signal, an image frame is displayed as two interleaved fields. The first field contains the odd lines of the image frame and the second field contains the even lines of the image frame. A video signal formatted according to the NTSC standard has a 1/60 second field interval between consecutive fields.

  On the other hand, a progressive scan video signal, which is a non-interlaced scan video signal, performs horizontal scan from left to right and vertical scan from top to bottom without performing horizontal scan every other line. This is a signal obtained by performing sequentially, and can be converted into a signal by scanning once, so that it is used as a read signal of the image sensor CCD in a digital still camera for still image shooting.

  By the way, there are systems that convert interlaced scanning video signals to progressive scanning video signals. In such conversion systems, when two fields are displayed, the current line from the current field is converted to the true of the current line. Interpolating image lines for progressive frames has been done by continuously averaging the previous field line above and the previous field line directly below the current line (e.g., patents). Reference 1).

There is also a motion compensated predictive coding device that requests and captures interlaced images before and after temporally from a playback device, and performs motion compensation progressive conversion using these interlaced images (for example, patents). Reference 2).
JP 2000-036944 A (page 11, FIG. 1A, FIG. 1B, page 12, FIG. 1C) JP 2000-278642 A (5th page, FIG. 1)

  However, in the conventional system as shown in Patent Document 1, the line which interpolated the spatially delayed upper and lower adjacent lines and the current line is summed by a summing circuit one line before in time, and line interpolation is performed. As a result, there is a problem that interpolation cannot be performed for an image that moves by more than one line.

  Further, in the conventional motion compensation predictive coding apparatus as shown in Patent Document 2, since motion compensation progressive conversion detects and feeds back a motion vector, there is a delay, and when a subject image with motion is progressively reproduced. There is a problem that the object portion has jaggedness between the fields.

  The present invention has been made in view of such problems, and an image recording / reproducing apparatus that prevents jaggedness between fields in a subject portion even when non-interlaced reproduction of a moving subject image is performed, An object of the present invention is to provide an image recording / reproducing method and a program.

  In order to achieve the above object, according to the first aspect of the present invention, the image pickup means for generating the image signals of the first and second fields by interlace scanning and the detection signal by detecting the shake of the own apparatus. A shake detection unit that outputs, a determination unit that determines whether or not shooting is performed by a predetermined shooting method based on the image signal generated by the imaging unit and the detection signal output by the shake detection unit; When it is determined by the determining means that the image is being shot by the predetermined shooting method, the first field shooting time point and the second field shooting time are obtained from the detection signal output by the shake detecting means and the subject focus information in the image pickup means. A field fluctuation amount calculating means for calculating a field shake correction amount for canceling out the shake of the subject apparatus that occurred between the time of field shooting and the subject. Image recording apparatus is provided which is characterized in that.

  According to the invention described in claim 6, the imaging means for generating the image signals of the first and second fields by interlace scanning, the variable magnification imaging means for changing the angle of view according to the angle of view change command signal, A determination unit that determines whether or not an image is being shot by a predetermined shooting method based on an image signal generated by the image pickup unit and an angle-of-view change command signal input to the variable magnification shooting unit; and the determination unit When it is determined that the image is being shot by the predetermined shooting method, the zoom imaging means generated between the first field shooting time and the second field shooting time is determined from the zoom speed of the zoom shooting means. There is provided an image recording apparatus comprising: a field scaling amount calculating unit that calculates a field scaling correction amount for canceling out the change amount of the angle of view.

  According to the seventh aspect of the present invention, the imaging means for generating an image signal by interlace scanning, the angle of view control means for controlling the angle of view of the variable magnification optical system, and the image generated by the imaging means Based on the signal and the angle-of-view control state by the angle-of-view control means, determining means for determining whether or not shooting is being performed by a predetermined shooting method, and the angle-of-view control means is There is provided an image recording apparatus characterized by performing angle-of-view control in units of one frame when it is determined that shooting is being performed by a predetermined shooting method.

  According to the invention of claim 11, the image data of the first and second fields are acquired by interlace scanning, and the shooting time of the first field and the shooting time of the second field are obtained. A correction data acquisition unit that acquires, as sub-data, a field shake correction amount for canceling out the amount of shaking of the image recording apparatus with respect to the subject, and the correction data acquisition unit in a camera shake image extraction range for interlaced display A non-interlace correction unit that determines an image extraction range by adding the field shake correction amount acquired by the image extraction method, and an image extraction determined by the non-interlace correction unit from the image data acquired by the correction data acquisition unit. Image data located in a range is extracted, and a reproduction signal in which the amount of shaking of the image recording apparatus with respect to the subject is canceled Image reproducing apparatus is provided which is characterized by having a reproduction signal generating means for generating a.

  According to the twelfth aspect of the present invention, the image data of the first and second fields is acquired by interlace scanning, and the shooting time of the first field and the shooting time of the second field are obtained. A correction data acquisition unit that acquires, as sub-data, a field scaling correction amount for offsetting the angle of view that the image recording apparatus has zoomed with respect to the subject, and a field shake correction acquired by the correction data acquisition unit A non-interlace correction unit that determines an image extraction range based on the amount so that the field angle amounts in the first and second fields are the same, and the image data acquired by the correction data acquisition unit. The image data located in the image extraction range determined by the interlace correction means is extracted, and the image recording apparatus scales the subject. Image reproducing apparatus is provided which is characterized by having a reproduction signal generating means for generating a reproduction signal amount is canceled.

  Furthermore, an image recording method or an image reproduction method applied to the image recording apparatus or the image reproduction apparatus, respectively, and a program for causing a computer to execute the image recording method or the image reproduction method are provided.

  According to the image recording apparatus of the first aspect of the present invention, there is an effect that the jaggedness between fields does not occur in the subject portion even if the subject video during panning photographing obtained by interlace scanning is reproduced non-interlaced.

  According to the image recording apparatus of the sixth and seventh aspects of the present invention, even if the subject video image during zooming shooting obtained by interlace scanning is reproduced in a non-interlace manner, a double image between fields is not generated in the subject portion. effective.

  According to the image reproducing device of the present invention, even when the subject image is recorded by interlaced scanning that is panned, the non-interlaced reproduction does not cause jaggedness between fields in the subject portion. There is.

  According to the image reproducing device of the present invention, even if the subject image is recorded by interlaced scanning that has been zoomed, a double image between fields does not occur in the subject portion during non-interlaced reproduction. There is an effect.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram showing a configuration of an image recording / reproducing apparatus according to the first embodiment of the present invention. This image recording / reproducing apparatus is an apparatus capable of generating a video signal by interlace scanning and performing non-interlaced reproduction (progressive reproduction) of the video signal.

  In FIG. 1, reference numeral 100 denotes an image pickup unit, which includes a zoom lens device, a focus lens device, an optical camera shake correction device, and an image pickup device (not shown). 101 is a focus detection unit that detects the zoom state and focus state of the imaging unit 100, 102 is a vibration gyro, and a shake detection unit that detects the shaking of the imaging unit 100, and 103 is a panning or A panning determination unit that determines whether or not it is due to tilting, 104 is a shake correction control unit that controls the image acquisition range, 105 is a field fluctuation calculation unit, and the field fluctuation calculation unit 105 is shake detection. A shake correction control amount is calculated from the output of the unit 102 and the output of the focus detection unit 101.

  106 is an angle-of-view control unit that controls the angle of view according to the zoom state and image acquisition range, and 107 is a zooming determination unit that determines whether the angle-of-view control by the angle-of-view control unit 106 is zoom-in or zoom-out. Is a field scaling amount calculation unit that calculates a field scaling amount from the output of the focus detection unit 101.

  Reference numeral 109 denotes a correction metadata addition acquisition unit that adds the output of the field fluctuation amount calculation unit 105 and the output of the field scaling amount calculation unit 108 together with image information as correction metadata at the time of recording, and again together with the image information at the time of reproduction. get. Reference numeral 110 denotes a recording / playback unit, and 111 denotes a non-interlace correction unit. The non-interlace correction unit 111 uses the interlace signal output from the recording / playback unit 110 as correction data obtained from the correction metadata addition acquisition unit 109. Based on the above, the image is cut out and corrected to a non-interlaced signal. Reference numeral 112 denotes a non-interlace display, and reference numeral 113 denotes an interlace display.

  1 includes, for example, a central processing unit (CPU), a ROM (Read Only Memory) storing a program executed by the CPU, a RAM (Random Access Memory) used by the CPU for calculation, an input / output The components other than the imaging unit 100, the focus detection unit 101, the shake detection unit 102, the non-interlace display unit 112, the interlace display unit 113, and the recording / playback unit 110 shown in FIG. Each function realized by the CPU executing the program is shown.

  FIG. 2 is a flowchart illustrating a procedure of shake correction control processing performed by the image recording / playback apparatus for the optical camera shake correction apparatus included in the imaging unit 100.

  In addition, the optical camera shake correction device has a configuration disclosed in, for example, Japanese Patent Laid-Open No. 2-173625 (Japanese Patent No. 2801013) and Japanese Patent Laid-Open No. 6-82889, and in this embodiment, an optical type is described. Description of the configuration and control of the camera shake correction device itself will be omitted, and generation of the optical axis control target that is the main focus of the present embodiment will be described.

  In step S200 in FIG. 2, it is determined whether the panning determination unit 103 receives a gyro signal indicating the shaking of the imaging unit 100 from the shake detection unit 102, that is, whether the imaging unit 100 is shaking. The unit 103 makes the determination. If no gyro signal is input, the process proceeds to step S202. For example, when the image recording / reproducing apparatus is fixed to a tripod, the process proceeds to step S202. If there is a gyro signal input, the process proceeds to step S201.

  In step S202, since it is determined that the imaging unit 100 is not shaken, the shake correction control unit 104 that controls the image acquisition range without changing the current field shake amount maintains the current optical axis and performs optical image stabilization. Do not change the control target of the equipment.

  In step S201, the panning determination unit 103 compares the signal variation of the gyro signal input from the shake detection unit 102 with a predetermined range, and whether or not the signal variation is within the predetermined range, that is, the imaging unit 100 is at a constant speed. It is determined whether the camera is shaken in the case of panning or tilting, or the imaging unit 100 is shaken irregularly (camera shake state). If the signal fluctuation does not fall within the predetermined range, the process proceeds to step S214. If the signal fluctuation is within the predetermined range, the process proceeds to step S203.

  In step S203, the panning determination unit 103 compares the motion vector of the image input from the imaging unit 100 with a predetermined level, and determines whether the motion vector is greater than the predetermined level. If the motion vector is below a predetermined level, that is, if the subject is being tracked and the subject position does not change much with respect to the screen and the motion vector is small, the process proceeds to step S214. If the motion vector is greater than the predetermined level, the process proceeds to step S204.

  In step S204, the field fluctuation amount calculation unit 105 determines whether the currently obtained field is the B field. The image recording / reproducing apparatus performs interlace scanning to obtain two fields for one screen, and the first half of the two fields is the A field and the latter half is the B field. . If it is determined that the field is not the B field, the process proceeds to step S214. If the field is the B field, the process proceeds to step S205.

  In step S205, the field fluctuation amount calculation unit 105 determines whether or not the current timing is the head of the B field. If it is not the top of the B field, the process proceeds to step S211. If it is the top of the B field, the process proceeds to step S206.

  In step S206, the field fluctuation amount calculation unit 105 acquires zoom lens position information from the focus detection unit 101, and the process proceeds to step S207.

  In step S207, the field fluctuation amount calculation unit 105 acquires focus lens position information from the focus detection unit 101, and the process proceeds to step S208.

  In step S208, the field fluctuation amount calculation unit 105 calculates subject focus information from the zoom lens position information and the focus lens position information, and moves the process to step S209.

  In step S209, the field shake amount calculation unit 105 calculates the panning speed based on the gyro signal obtained from the shake detection unit 102, and the process proceeds to step S210.

  In step S210, the field fluctuation amount calculation unit 105 calculates a field blur optical axis correction value from the subject focus information and the panning speed, and the process proceeds to step S211. This field blur optical axis correction value indicates the deflection amount of the optical axis deflection performed to correct image blur between fields. The panning speed can be converted into the amount of optical axis deflection per field depending on the angle of view specification of the lens. This will be described with reference to FIG.

  FIG. 3 is a diagram illustrating a mutual positional relationship among the subject, the lens, and the image sensor, and is a diagram for explaining a relationship among the angle of view of the lens, the panning speed, and the optical axis.

In the optical camera shake correction device, camera shake correction is performed by deflecting the optical axis. Therefore, as shown in FIG. 3, the subject position is _PO with respect to the lens position P _L , and the focal length is wide-angle shooting. It is assumed that D _W and the position of the image sensor are P _W , while the focal length is D _T and the position of the image sensor is P _T in telephoto shooting. In wide-angle shooting, the field angle is W _A and the optical field angle is θ _W. The wide-angle side imaging, the panning speed in terms of the optical axis deflection amount of one field, if the correction angle is a [Delta] [theta] _1, the angle of view is corrected from W _A to W _B. However, W _A = W _B. Note that the focal length increases as the zoom ratio increases.

On the other hand, in telephoto shooting, the field angle is T _A and the optical field angle is θ _T. Since the image sensors have the same size S, the optical field angle θ becomes narrower as the focal length becomes telephoto. Therefore, in the telephoto side photographing, when the panning speed is converted into the optical axis deflection amount of one field and the correction angle is Δθ ₂ , the correction angle Δθ ₂ can be calculated based on the following formula (1).

Δθ ₂ = Δθ ₁ × (D _W / D _T ) (1)
In telephoto shooting, the angle of view is corrected from T _A to T _B. However, T _A = T _B.

  Returning to FIG. 2, in step S <b> 211, the shake correction control unit 104 calculates a shake optical axis correction value for interlaced display that does not perform field shake optical axis correction based on the gyro signal output from the shake detection unit 102. Then, the process proceeds to step S212.

  In step S212, the shake correction control unit 104 adds the field shake optical axis correction value calculated in step S210 to the camera shake optical axis correction value for interlaced display, and the process proceeds to step S213.

  In step S214, the shake correction control unit 104 calculates a camera shake optical axis correction value for which field shake optical axis correction is not performed based on the gyro signal output from the shake detection unit 102, and the process proceeds to step S213.

  In step S213, the shake correction control unit 104 uses the addition value calculated in step S212 or the camera shake optical axis correction value calculated in step S214, and the optical axis target of the optical camera shake correction device included in the imaging unit 100. Update the value. The optical camera shake correction apparatus of the imaging unit 100 applies servo control to the updated optical axis target value.

  As described above, by performing the shake correction control on the optical camera shake correction device included in the imaging unit 100, the following effects can be obtained.

  4A shows a conventional optical axis target value in the yaw direction in two fields (A, B) for one screen, and FIG. 4B shows a conventional field blur due to two fields. FIG. FIG. 5A is a diagram showing the optical axis target value in the yaw direction in the present embodiment in two fields (A, B), and FIG. 5B is the present embodiment with two fields. It is a figure which shows the field blurring in.

  That is, in the conventional camera shake correction for interlaced display, as shown in FIG. 4A, when panning photographing is performed, the optical axis target value in the yaw direction is constant, and therefore, as shown in FIG. In addition, field blur occurs between the A field and the B field. On the other hand, in the present embodiment, as shown in FIG. 5A, the amount of deviation of the B field is calculated from the focus information and the panning speed, and is added to the camera shake correction value for interlaced display. to correct. As a result, as shown in FIG. 5B, field blur can be canceled between the A field and the B field, and even if the subject video with movement is progressively reproduced as described above, There is an effect that no jaggedness is generated.

  In the present embodiment, the optical axis correction in the yaw direction has been described. However, if an optical axis correction mechanism in the pitch direction is provided, the optical axis correction can be similarly performed in the pitch direction. If the optical axis is corrected at the same time in the yaw direction and the pitch direction, it is possible to deal with field blur in any direction of 360 degrees.

[Second Embodiment]
Next, a second embodiment of the present invention will be described.

  Since the configuration of the second embodiment is basically the same as the configuration of the first embodiment, in the description of the second embodiment, the same parts as the configuration of the first embodiment are used. Are denoted by the same reference numerals, and the description of the first embodiment is used, and only different portions will be described.

  In the second embodiment, it is assumed that the imaging unit 100 includes an electronic correction type image stabilization device. For example, Japanese Patent Application Laid-Open No. 11-266390 discloses the configuration of the electronic correction type image stabilization device, and in the present embodiment, description of the configuration and control of the electronic correction type image stabilization device itself is omitted. Control target generation of the electronic correction type image stabilization device as the main component of the present embodiment will be described.

  FIG. 6 is a flowchart illustrating a procedure of shake correction control processing for the electronic correction type image stabilization device included in the imaging unit 100, which is executed by the image recording / playback device according to the second embodiment.

  In step S400, the panning determination unit 103 determines whether or not the gyro signal indicating the shaking of the imaging unit 100 is input from the shake detection unit 102 to the panning determination unit 103, that is, whether or not the imaging unit 100 is shaking. to decide. If no gyro signal is input, the process proceeds to step S402. For example, when the image recording / reproducing apparatus is fixed to a tripod, the process proceeds to step S402. If there is a gyro signal input, the process proceeds to step S401.

  In step S402, since it is determined that the imaging unit 100 is not shaken, the shake correction control unit 104 that controls the image acquisition range without changing the current field shake amount maintains the current image extraction position, and the image extraction method. The control target of the electronic correction type image stabilization device is not changed.

  In step S401, the panning determination unit 103 compares the signal variation of the gyro signal input from the shake detection unit 102 with a predetermined range, and whether or not the signal variation is within the predetermined range, that is, the imaging unit 100 is at a constant speed. It is determined whether the camera is shaken in the case of panning or tilting, or the imaging unit 100 is shaken irregularly (camera shake state). If the signal fluctuation does not fall within the predetermined range, the process proceeds to step S414. If the signal fluctuation is within the predetermined range, the process proceeds to step S403.

  In step S403, the panning determination unit 103 compares the motion vector of the image input from the imaging unit 100 with a predetermined level, and determines whether the motion vector is greater than the predetermined level. If the motion vector is below a predetermined level, that is, if the subject is being tracked and the subject position does not change much with respect to the screen and the motion vector is small, the process proceeds to step S414. If the motion vector is greater than the predetermined level, the process proceeds to step S404.

  In step S404, the field fluctuation amount calculation unit 105 determines whether or not the current timing is the head of the B field (second half field). If it is not the top of the B field, the process proceeds to step S405. If it is the top of the B field, the process proceeds to step S406.

  In step S406, the field fluctuation amount calculation unit 105 acquires zoom lens position information from the focus detection unit 101, and the process proceeds to step S407.

  In step S407, the field fluctuation amount calculation unit 105 acquires focus lens position information from the focus detection unit 101, and the process proceeds to step S408.

  In step S408, the field shake amount calculation unit 105 calculates subject focus information from the zoom lens position information and the focus lens position information, and moves the process to step S409.

  In step S409, the field shake amount calculation unit 105 calculates a panning speed based on the gyro signal obtained from the shake detection unit 102, and the process proceeds to step S410.

  In step S410, the field shake amount calculation unit 105 calculates a field blur image extraction correction value from the subject focus information and the panning speed, and the process proceeds to step S411. This field-blurred image extraction correction value indicates the amount of movement of image extraction position movement performed to correct image blur between fields. The panning speed can be converted into an image extraction position change amount per field depending on the angle of view specification of the lens and the size of the image sensor. This will be described with reference to FIG.

  FIG. 7 is a diagram illustrating a mutual positional relationship among a subject, a lens, and an image sensor, and is a diagram for explaining a relationship among a field angle of the lens, a panning speed, and an image extraction range.

That is, in the electronic correction image stabilization apparatus, a camera shake correction, since carried out by moving the image extracting position on the imaging element, as shown in FIG. 7, the object position P _O to the lens position P _L, imaging Assume that the element position is P ₁ and the subject distance is D. In wide-range extraction shooting, the angle of view is W _A , and the imaging element extraction range is A _W with respect to the imaging element size S. In extensive extraction shooting, the panning speed in terms of the image extraction position change amount of one field, when the position correction amount was .DELTA.L1, the angle of view is corrected from W _A to W _B. However, W _A = W _B. Note that the angle of view becomes narrower as the electronic zoom ratio increases.

On the other hand, in narrow range extraction shooting, the angle of view is T _A and the image sensor extraction range is _AT . Since the imaging element size S is the same for both wide-range extraction photography and narrow-range extraction photography, the extraction range A becomes narrower as the electronic zoom ratio becomes larger and the telephoto side becomes larger. Therefore, in the narrow range extraction photographing, when the panning speed is converted into the image extraction position change amount of one field and the position correction amount is ΔL ₂ , the position correction amount ΔL ₂ can be calculated based on the following equation (2).

ΔL ₂ = ΔL ₁ × (A _T / A _w ) (2)
In narrow range extraction photography, the angle of view is corrected from T _A to T _B. However, T _A = T _B.

  Returning to FIG. 6, in step S <b> 411, the field shake amount calculation unit 105 calculates a camera shake image extraction range for interlaced display without performing field shake image extraction correction based on the gyro signal output from the shake detection unit 102. Then, the process proceeds to step S412.

  In step S412, the field shake amount calculation unit 105 adds the field blur image extraction correction value calculated in step S410 to the camera shake image extraction range for interlaced display, and the process proceeds to step S413.

  In step S405, the field fluctuation amount calculation unit 105 determines whether or not the current timing is the head of the A field (first half field). If it is not the head of the A field, the shake correction control process is terminated, and if it is the head of the A field, the process proceeds to step S414.

  In step S414, the field shake amount calculation unit 105 calculates a camera shake image extraction range for which field blur image extraction correction is not performed based on the gyro signal output from the shake detection unit 102, and the process proceeds to step S413.

  In step S413, the shake correction control unit 104 uses the addition value calculated in step S412 or the camera shake image extraction range calculated in step S414 to perform electronic correction type image stabilization that is an image extraction method included in the imaging unit 100. Update the image extraction target value of the device. The electronic correction type image stabilization device of the imaging unit 100 extracts an image at the updated image extraction target value.

  As described above, by performing shake correction control on the electronic correction type image stabilization device included in the imaging unit 100, the following effects can be obtained.

  FIG. 8A shows a conventional image extraction position in the yaw (Y) direction and pitch (P) direction in two fields (A, B) for one screen, and FIG. FIG. 8C is a diagram showing a conventional image extraction range in a field, and FIG. 8C is a diagram showing conventional field blur due to two fields. FIG. 9A is a diagram showing image extraction positions in the yaw (Y) direction and pitch (P) direction in the present embodiment in two fields (A, B), and FIG. The figure which shows the image extraction range in this Embodiment in two fields, FIG.9 (C) is a figure which shows the field blurring in this Embodiment by two fields.

  In the conventional camera shake correction for interlaced display, as shown in FIGS. 8A and 8B, when panning shooting is performed, the image extraction positions in the yaw (Y) direction and the pitch (P) direction are constant, and Therefore, as shown in FIG. 8C, field blur occurs between the A field and the B field. On the other hand, in the present embodiment, as shown in FIG. 9A, the deviation amount of the B field is calculated from the focus information and the panning speed, and as shown in FIG. The image extraction position is corrected by adding to the camera shake correction value. As a result, as shown in FIG. 9C, field blur can be canceled between the A field and the B field, and even if the subject image with such movement is progressively reproduced, There is an effect that no jaggedness is generated.

[Third Embodiment]
Next, a third embodiment of the present invention will be described.

  Since the configuration of the third embodiment is basically the same as the configuration of the first embodiment, in the description of the third embodiment, the same parts as the configuration of the first embodiment are used. Are denoted by the same reference numerals, and the description of the first embodiment is used, and only different portions will be described.

  FIG. 10 is a flowchart illustrating the procedure of the angle-of-view control process for the zoom lens included in the imaging unit 100, which is executed by the image recording / playback apparatus according to the third embodiment.

  In step S600, the zooming determination unit 107 determines whether there is a key input from a zoom key (not shown) for driving the zoom lens. If there is no key input, the process proceeds to step S602. If there is a key input, the process proceeds to step S601.

  In step S602, since there is no key input, the angle-of-view control unit 106 maintains the current zoom lens drive target and maintains the current angle of view while keeping the zoom lens position fixed.

  In step S601, the zooming determination unit 107 compares the motion vector of the image input from the imaging unit 100 with a predetermined level, and determines whether the motion vector is greater than the predetermined level. If the motion vector is below a certain level, that is, if you are zooming in on a subject that is far away, or if you are zooming out on a subject that is approaching, and the subject magnification does not change much relative to the screen Moves the process to step S604. On the other hand, if the motion vector is greater than the predetermined level, the process proceeds to step S603.

  In step S603, the field scaling amount calculation unit 108 determines whether or not the current timing is the head of the A field (first half field). If it is not the head of the A field, the process proceeds to step S606. If it is at the head of the A field, the process proceeds to step S605.

  In step S604, similarly to the conventional zoom shooting, the view angle control unit 106 switches the zoom magnification target value according to the zoom speed at the head of each field as shown in FIG. End the control process.

  In step S605, the field scaling amount calculation unit 108 acquires the zoom speed from the angle of view control unit 106, and sets the zoom lens driving target to the target magnification of the A field corresponding to one frame elapsed from the previous A field. Switch to complete the angle of view control process.

  In step S606, the field scaling amount calculation unit 108 determines whether or not the current timing is the head of the B field (second half field). If it is not the head of the B field, the angle-of-view control process ends. If it is at the head of the B field, the process proceeds to step S607.

  In step S607, the field scaling amount calculation unit 108 fixes the zoom lens position, and the view angle control unit 106 maintains the current zoom lens drive target, maintains the current view angle, and performs the view angle control process. Finish.

  As described above, by performing the angle of view control on the zoom lens included in the imaging unit 100, the following effects can be obtained.

  11A shows a conventional zoom magnification target value in two fields (A, B) for one screen, and FIG. 11B shows a conventional image shift in two fields. . FIG. 12A shows the zoom magnification target value in the present embodiment in two fields (A, B), and FIG. 12B shows the image in the present embodiment in two fields. It is a figure which shows deviation | shift.

  In the conventional interlaced display zoom drive, as shown in FIG. 11A, the zoom magnification target value is set when zooming is performed. Therefore, as shown in FIG. 11B, the A field and the B field are set. An image shift occurs between On the other hand, in this embodiment, as shown in FIG. 12A, the zoom magnification target value of the B field is corrected to match the A field. As a result, as shown in FIG. 12B, the image shift between the A field and the B field can be eliminated, and even if the subject image being zoomed is progressively reproduced in this manner, There is an effect that image shift does not occur.

  In this embodiment, zooming in from the wide-angle side to the telephoto side direction is taken as an example in FIGS. 11 and 12, but the angle of view is similarly applied to zoom-out from the telephoto side to the wide-angle side direction. Control processing can be executed.

[Fourth Embodiment]
Next, a fourth embodiment of the present invention will be described.

  Since the configuration of the fourth embodiment is basically the same as the configuration of the first embodiment, in the description of the fourth embodiment, the same parts as the configuration of the first embodiment are used. Are denoted by the same reference numerals, and the description of the first embodiment is used, and only different portions will be described.

  FIG. 13 is a flowchart illustrating a procedure of an image cut-out area control process performed on the image sensor included in the imaging unit 100, which is executed by the image recording / playback apparatus according to the fourth embodiment. In the fourth embodiment, the imaging unit 100 is provided with an electronic zoom function in addition to the optical zoom lens.

  In step S800, the zooming determination unit 107 determines whether there is a key input from a zoom key (not shown) for driving the zoom lens. If there is no key input, the process proceeds to step S802. If there is a key input, the process proceeds to step S801.

  In step S802, since there is no key input, the angle-of-view control unit 106 maintains the current image angle while maintaining the control target of the current image cut-out area with the zoom magnification fixed.

  In step S801, the zooming determination unit 107 compares the motion vector of the image input from the imaging unit 100 with a predetermined level, and determines whether the motion vector is greater than the predetermined level. If the motion vector is below a certain level, that is, if you are zooming in on a subject that is far away, or if you are zooming out on a subject that is approaching, and the subject magnification does not change much relative to the screen Moves the process to step S804. On the other hand, if the motion vector is greater than the predetermined level, the process proceeds to step S803.

  In step S803, the field scaling amount calculation unit 108 determines whether or not the current timing is the head of the A field (first half field). If it is not the head of the A field, the process proceeds to step S806. If it is at the head of the A field, the process proceeds to step S805.

  In step S804, as in the conventional zoom shooting, the angle-of-view control unit 106 switches the image cut-out area target value according to the zoom speed at the head of each field as shown in FIG. Finish the cutting area control process.

  In step S805, the field scaling amount calculation unit 108 acquires the zoom speed from the angle-of-view control unit 106, and sets the target value to the image cut-out area of the A field corresponding to one frame elapsed from the previous A field. After switching, the control process of the image cut-out area is completed.

  In step S806, the field scaling amount calculation unit 108 determines whether or not the current timing is the head of the B field (second half field). If it is not the head of the B field, the control process of the image cut-out area is finished. If it is at the head of the B field, the process proceeds to step S807.

  In step S807, the field scaling amount calculation unit 108 fixes the zoom magnification, and the angle-of-view control unit 106 switches to a zoom lens control target that maintains the current image cut-out area. This completes the control process.

  As described above, the following effects can be obtained by performing the image cut-out area control for the image pickup device included in the image pickup unit 100.

  FIG. 14A shows a conventional zoom magnification target value in the zoom-in direction in two fields (A, B) for one screen, and FIG. 14B shows conventional image cropping in two fields. FIG. 14C is a diagram showing an area, FIG. 14C is a diagram showing a conventional image shift in two fields, and FIG. 14D is a diagram showing a conventional zoom magnification target value in the zoom-out direction in two fields. is there. FIG. 15A shows the zoom magnification target value in the present embodiment in the zoom-in direction in two fields (A, B), and FIG. 15B shows the present embodiment in two fields. FIG. 15C is a diagram showing an image image cut-out area in the form, FIG. 15C is a diagram showing image shift in the present embodiment in two fields, and FIG. 15D is a zoom-out direction in two fields. It is a figure which shows the zoom magnification target value in this Embodiment.

  In the conventional interlaced display zoom drive, as shown in FIG. 14A, when zooming is performed in the zoom-in direction, the zoom magnification target value is set. Therefore, as shown in FIG. Since the image cut-out area sequentially changes and the zoom ratio changes, an image shift occurs between the A field and the B field as shown in FIG. Note that, as shown in FIG. 14D, the same phenomenon occurs even when zooming shooting is performed in the zoom-out direction.

  On the other hand, in this embodiment, as shown in FIG. 15A, the zoom magnification target value in the B field is corrected so as to match the A field. That is, as shown in FIG. 15B, the image cut-out area in the A field and the image cut-out area in the B field are made the same. As a result, as shown in FIG. 15C, the image shift between the A field and the B field can be eliminated, and even if the subject image being zoomed is progressively reproduced as described above, There is an effect that image shift does not occur.

  As shown in FIG. 15D, even when zooming is performed in the zoom-out direction, the A field and the B field are similarly corrected by correcting the zoom field target value of the B field to match the A field. Can be eliminated.

[Fifth Embodiment]
Next, a fifth embodiment of the present invention will be described.

  Since the configuration of the fifth embodiment is basically the same as the configuration of the first embodiment, the description of the fifth embodiment is the same as the configuration of the first embodiment. Are denoted by the same reference numerals, and the description of the first embodiment is used, and only different portions will be described.

  In the fifth embodiment, when a panned image is recorded, a deviation of the B field (second half field) with respect to the A field (first half field) is recorded as metadata, and an image extraction range for interlaced display during reproduction is recorded. Is corrected so that field blur between the A field and the B field is canceled out.

  FIG. 16 is a flowchart showing a recording process procedure for recording the field fluctuation amount together with the image information, which is executed by the image recording / reproducing apparatus according to the fifth embodiment.

  In step S900, the panning determination unit 103 determines whether or not the gyro signal indicating the shaking of the imaging unit 100 is input from the shake detection unit 102 to the panning determination unit 103, that is, whether or not the imaging unit 100 is shaking. to decide. If no gyro signal is input, the recording process is terminated. If there is a gyro signal input, the process proceeds to step S901.

  In step S901, the panning determination unit 103 compares the signal variation of the gyro signal input from the shake detection unit 102 with a predetermined range, and whether the signal variation is within the predetermined range, that is, the imaging unit 100 is at a constant speed. It is determined whether the camera is shaken in the case of panning or tilting, or whether the imaging unit 100 is shaking irregularly. If the signal fluctuation does not fall within the predetermined range, the recording process is finished. If the signal fluctuation is within the predetermined range, the process proceeds to step S902.

  In step S902, the panning determination unit 103 compares the motion vector of the image input from the imaging unit 100 with a predetermined level, and determines whether the motion vector is greater than the predetermined level. If the motion vector is below a predetermined level, that is, if the subject is being tracked and the subject position does not change much with respect to the screen and the motion vector is small, the recording process ends. If the motion vector is greater than the predetermined level, the process proceeds to step S903.

  In step S903, the field fluctuation amount calculation unit 105 determines whether or not the current timing is the head of the B field (second half field). If it is not the head of the B field, the process proceeds to step S905. If it is the head of the B field, the process proceeds to step S904.

  In step S904, the field fluctuation amount calculation unit 105 acquires zoom lens position information from the focus detection unit 101, and the process proceeds to step S906.

  In step S906, the field fluctuation amount calculation unit 105 acquires focus lens position information from the focus detection unit 101, and the process proceeds to step S907.

  In step S907, the field fluctuation amount calculation unit 105 calculates subject focus information from the zoom lens position information and the focus lens position information, and moves the process to step S908.

  In step S908, the field shake amount calculation unit 105 calculates a panning speed based on the gyro signal obtained from the shake detection unit 102, and the process proceeds to step S909.

  In step S909, the field fluctuation amount calculation unit 105 calculates a field blur image extraction correction value from the subject focus information and the panning speed, and the correction metadata addition acquisition unit 109 creates field blur image extraction correction metadata, The process moves to step S910. This field blur image extraction correction value indicates the amount of image extraction position movement for correcting image blur between fields by moving the image extraction position during reproduction.

  In step S910, based on the gyro signal obtained from the shake detection unit 102, the field shake amount calculation unit 105 calculates a camera shake image extraction range for interlaced display that is not subjected to field shake image extraction correction, and adds correction metadata. The acquisition unit 109 creates camera shake image extraction range metadata and moves the process to step S911.

  In step S911, the correction metadata addition acquisition unit 109 updates the field blurred image extraction correction metadata, and the process proceeds to step S912.

  In step S905, the field fluctuation amount calculation unit 105 determines whether or not the current timing is the head of the A field (first half field). If it is not the head of the A field, the process proceeds to step S914. If it is the head of the A field, the process proceeds to step S913.

  In step S913, the field shake amount calculation unit 105 calculates a camera shake image extraction range for interlaced display that does not perform field shake image extraction correction based on the gyro signal output from the shake detection unit 102, and the correction metadata. The additional acquisition unit 109 updates the camera shake image extraction range metadata and moves the process to step S912.

  In step S912, the correction metadata addition acquisition unit 109 updates the hand-blurred image extraction range metadata for interlaced display that is not subjected to field-blurred image extraction correction, and the process proceeds to step S914.

  In step S914, the recording / reproducing unit 110 records the camera shake image extraction range metadata and the field blur image extraction correction metadata together with the image information.

  FIG. 17 is a flowchart showing the procedure of a reproduction correction process that is performed by the image recording / reproducing apparatus according to the fifth embodiment and reproduces the field fluctuation amount together with the image information to correct the field blur.

  In step S1000, the non-interlace correction unit 111 determines whether non-interlace output is selected as the output of the recording / playback unit 110. If interlaced output is selected, the reproduction correction process is terminated. If non-interlaced output has been selected, the process proceeds to step S1001.

  In step S1001, the non-interlace correction unit 111 determines whether or not the current timing of the reproduced image is the head of the B field. If it is not at the head of the B field, the process proceeds to step S1003. If it is at the head of the B field, the process proceeds to step S1002.

  In step S1002, the correction metadata addition acquisition unit 109 acquires camera shake image extraction range metadata from the recording / playback unit 110, and moves the process to step S1004.

  In step S1004, the corrected metadata addition acquisition unit 109 determines whether data is written in the camera shake image extraction range metadata. If it is not written, the reproduction correction process is finished. If written, the process proceeds to step S1005.

  In step S1005, the correction metadata addition acquisition unit 109 acquires field-blurred image extraction correction metadata from the recording / playback unit 110, and the process proceeds to step S1006.

  In step S1006, the correction metadata addition acquisition unit 109 determines whether data is written in the field blurred image extraction correction metadata. If not written, the process proceeds to step S1008. If written, the process proceeds to step S1007.

  In step S1007, the non-interlace correction unit 111 sets the range obtained by adding the field blur image extraction correction value to the camera shake image extraction range for interlaced display as the image extraction range, and the process proceeds to step S1009. Transfer.

  In step S1008, the non-interlace correction unit 111 sets the camera shake image extraction range for interlaced display as the image extraction range, and moves the process to step S1009.

  In step S1003, the non-interlace correction unit 111 determines whether or not the current timing of the reproduced image is the head of the A field. If it is not at the head of the A field, the reproduction correction process is terminated. If it is at the top of the A field, the process proceeds to step S1010.

  In step S1010, the correction metadata addition acquisition unit 109 acquires camera shake image extraction range metadata from the recording / playback unit 110, and moves the process to step S1011.

  In step S1011, the corrected metadata addition acquisition unit 109 determines whether data is written in the camera shake image extraction range metadata. If it is not written, the reproduction correction process is finished. If written, the process proceeds to step S1012.

  In step S1012, the non-interlace correction unit 111 sets the camera shake image extraction range for interlaced display as the image extraction range, and the process proceeds to step S1009.

  In step S1009, the non-interlace correction unit 111 updates the image extraction range to be reproduced to the image extraction range set in any of steps S1007, S1008, and S1012.

  The following effects can be obtained by executing the recording process and the reproduction correction process in the fifth embodiment described above. In the following description, FIGS. 8 and 9 referred to in the second embodiment are used.

  In the conventional image extraction correction for interlaced display, as shown in FIGS. 8A and 8B, the image extraction position is constant when the panned image is reproduced, and therefore FIG. As shown in FIG. 4, field blur occurs between the A field and the B field. On the other hand, in the present embodiment, the deviation amount of the B field as shown in FIG. 9A is recorded as metadata at the time of recording and is displayed as interlaced as shown in FIG. 9B at the time of reproduction. The position of the image extraction range is further corrected. As a result, as shown in FIG. 9 (C), the non-interlace display unit 112 can cancel the field blur between the A field and the B field, and the moving subject image is recorded in an interlaced manner. Thus, even if progressive playback is selected in an image recording / playback apparatus that performs interlace playback during playback, there is an effect that no jaggedness occurs between fields in the subject portion.

[Sixth Embodiment]
Next, a sixth embodiment of the present invention will be described.

  Since the configuration of the sixth embodiment is basically the same as the configuration of the first embodiment, in the description of the sixth embodiment, the same parts as the configuration of the first embodiment are used. Are denoted by the same reference numerals, and the description of the first embodiment is used, and only different portions will be described.

  In the sixth embodiment, when recording a zoomed image, the field magnification is recorded as metadata, and field blur is corrected using the field magnification during reproduction.

  FIG. 18 is a flowchart showing a procedure of a recording process for recording the field scaling amount together with the image information, which is executed by the image recording / reproducing apparatus in the sixth embodiment.

  In step S1100, the zooming determination unit 107 determines whether there is a key input from a zoom key (not shown). If there is no key input, the recording process ends. If there is a key input, the process proceeds to step S1101.

  In step S1101, the field scaling amount calculation unit 108 determines whether or not the current timing is the head of the A field (first half field). If it is not at the head of the A field, the process proceeds to step S1105. If it is at the top of the A field, the process proceeds to step S1102.

  In step S1102, the field scaling amount calculation unit 108 acquires the zoom magnification from the angle-of-view control unit 106, and the correction metadata addition acquisition unit 109 creates the zoom magnification metadata of the A field, and the process proceeds to step S1103. Transfer.

  In step S1103, the field scaling amount calculation unit 108 acquires the zoom magnification from the angle-of-view control unit 106, and the correction metadata addition acquisition unit 109 creates zoom magnification metadata for the B field, and the process proceeds to step S1104. Transfer.

  In step S1104, the correction metadata addition acquisition unit 109 updates the zoom magnification metadata, and the process proceeds to step S1105.

  In step S1105, the recording / reproducing unit 110 records A field zoom magnification metadata and B field zoom magnification metadata together with image information.

  FIG. 19 is a flowchart showing the procedure of a reproduction correction process that is performed by the image recording / reproducing apparatus according to the sixth embodiment to reproduce the field scaling amount together with the image information to correct the field blur.

  In step S1200, the non-interlace correction unit 111 determines whether a non-interlace output is selected as the output of the recording / playback unit 110. If interlaced output is selected, the reproduction correction process is terminated. If non-interlaced output is selected, the process proceeds to step S1201.

  In step S1201, the non-interlace correction unit 111 determines whether or not the current timing of the reproduced image is the head of the A field. If it is not the head of the A field, the process proceeds to step S1205. If it is at the top of the A field, the process proceeds to step S1202.

  In step S1202, the correction metadata addition acquisition unit 109 acquires A field zoom magnification metadata from the recording / playback unit 110, and the process proceeds to step S1203.

  In step S1203, the correction metadata addition acquisition unit 109 acquires B field zoom magnification metadata from the recording / playback unit 110, and the process proceeds to step S1204.

  In step S1204, the corrected metadata addition acquisition unit 109 determines whether or not the zoom rate is different between the A field and the B field. When the zoom rate is the same, the reproduction correction process is finished. If the zoom rates are different, the process proceeds to step S1205.

  In step S1205, the non-interlace correction unit 111 determines whether the zoom is zoom-in from the wide-angle side to the telephoto side or the reverse zoom-out. If the zoom-in is from the wide-angle side to the telephoto side, the process proceeds to step S1206. If not, the process proceeds to step S1207.

  In step S1206, the non-interlace correction unit 111 determines whether or not the current timing of the reproduced image is the head of the A field. If it is not at the head of the A field, the process proceeds to step S1029. If it is at the head of the field, the process proceeds to step S1208.

  In step S1208, the non-interlace correction unit 111 changes the image extraction range so that the zoom magnification of the A field image becomes the same as the zoom magnification of the subsequent B field image.

  In step S1209, the non-interlace correction unit 111 determines whether or not the current timing of the reproduced image is the head of the B field. If it is not at the head of the B field, the reproduction correction process is terminated. If it is at the head of the B field, the process proceeds to step S1210.

  In step S1210, the non-interlace correction unit 111 fixes the image extraction range with the zoom magnification of the B field image.

  In step S1207, the non-interlace correction unit 111 determines whether or not the current timing of the reproduced image is the head of the A field. If it is not the head of the A field, the process proceeds to step S1212. If it is at the top of the A field, the process proceeds to step S1211.

  In step S1211, the non-interlace correction unit 111 fixes the image extraction range at the zoom magnification of the A field image.

  In step S <b> 1212, the non-interlace correction unit 111 determines whether the current timing of the reproduced image is the head of the B field. If it is not at the head of the B field, the reproduction correction process is terminated. If it is at the head of the B field, the process proceeds to step S1213.

  In step S1213, the non-interlace correction unit 111 changes the image extraction range so that the zoom magnification of the B field image is the same as the zoom magnification of the previous A field image.

  The following effects are obtained by executing the recording process and the reproduction correction process in the sixth embodiment described above.

  FIG. 20A is a diagram showing a zoom magnification target value at the time of conventional interlace recording in the zoom-in direction in two fields (A, B) for one screen, and FIG. 20B is a diagram in two fields. FIG. 20C is a diagram showing an image extraction area at the time of conventional interlace recording in the zoom-in direction, and FIG. 20C is a diagram showing an image shift at the time of conventional interlace recording in two fields. FIG. 21A is a diagram showing a zoom magnification target value at the time of conventional interlace recording in the zoom-out direction in two fields, and FIG. 21B is a diagram showing a conventional interface in the zoom-out direction in two fields. It is a figure which shows the image extraction area at the time of a race recording.

  On the other hand, FIG. 22A shows a zoom magnification target value at the time of non-interlaced reproduction in the present embodiment in the zoom-in direction in two fields (A, B), and FIG. FIG. 22C is a diagram showing an image extraction area at the time of non-interlaced reproduction in the present embodiment in the zoom-in direction in the field, and FIG. FIG. FIG. 23A is a diagram showing a zoom magnification target value at the time of non-interlaced reproduction in this embodiment in the zoom-out direction in two fields, and FIG. 23B is a zoom-out direction in two fields. It is a figure which shows the image extraction area at the time of the non-interlace reproduction | regeneration in this Embodiment.

  When zooming is performed in the zoom-in direction with the conventional zoom drive for interlaced display, if the zoom magnification is changed as shown in FIG. 20A and an image is recorded as shown in FIG. As shown in C), an image in which an image shift has occurred between the A field and the B field is reproduced on the interlace display unit 113. Note that, as shown in FIGS. 21A and 21B, the same phenomenon occurs even when zooming is performed in the zoom-out direction.

  On the other hand, in this embodiment, as shown in FIG. 22A, correction is performed so that the zoom magnifications of the A field and the B field are equal. That is, as shown in FIG. 22 (B), image extraction enlargement is performed on the A field side, and as a result, as shown in FIG. 22 (C), an image shift between the A field and the B field occurs. The canceled image is reproduced on the non-interlace display 112. In such an image recording / reproducing apparatus that interlaces and records a subject video with a change in the angle of view and reproduces it at the time of playback, even if progressive playback is selected, an image shift between fields does not occur in the subject portion. There is.

  As shown in FIGS. 23A and 23B, even when zooming is performed in the zoom-out direction, correction is performed so that the zoom magnifications of the A field and the B field are equalized, and the image extraction is enlarged on the B field side. By doing so, the image shift between the A field and the B field can be similarly eliminated.

[Other Embodiments]
The object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and a computer (or CPU, MPU, etc.) of the system or apparatus. Is also achieved by reading and executing the program code stored in the storage medium.

  In this case, the program code itself read from the storage medium realizes the novel function of the present invention, and the storage medium and program storing the program code constitute the present invention.

  The storage medium for supplying the program code is, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW. DVD + RW, magnetic tape, nonvolatile memory card, ROM, etc. can be used.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (Operating System) running on the computer based on the instruction of the program code. Includes a case where the functions of the above-described embodiments are realized by performing part or all of the actual processing.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. This includes the case where the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

1 is a block diagram showing a configuration of an image recording / reproducing apparatus according to a first embodiment of the present invention. It is a flowchart which shows the procedure of the shake correction control process with respect to the optical camera-shake correction apparatus contained in an imaging part performed with an image recording / reproducing apparatus. It is a figure which shows the mutual positional relationship of a to-be-photographed object, a lens, and an image pick-up element. (A) is a figure which shows the conventional optical axis target value of the yaw direction in two fields with respect to one screen, (B) is a figure which shows the conventional field blur by two fields. FIG. 5A is a diagram showing the optical axis target value in the yaw direction in the present embodiment in two fields, and FIG. 5B is a diagram showing field blur in the present embodiment due to two fields. 10 is a flowchart illustrating a procedure of shake correction control processing for an electronic correction type image stabilization device included in an imaging unit, which is executed by the image recording / playback device according to the second embodiment. It is a figure which shows the mutual positional relationship of a to-be-photographed object, a lens, and an image pick-up element. (A) is a figure which shows the image extraction position of the conventional yaw (Y) direction and pitch (P) direction in two fields with respect to one screen, (B) shows the conventional image extraction range in two fields. FIG. 2C is a diagram showing a conventional field blur due to two fields. (A) is a figure which shows the image extraction position of the yaw (Y) direction and pitch (P) direction in this Embodiment in two fields, (B) is an image in this Embodiment in two fields. The figure which shows an extraction range, (C) is a figure which shows the field blurring in this Embodiment by two fields. It is a flowchart which shows the procedure of the view angle control process with respect to the zoom lens contained in an imaging part performed with the image recording / reproducing apparatus in 3rd Embodiment. (A) is a figure which shows the conventional zoom magnification target value in two fields with respect to one screen, (B) is a figure which shows the conventional image shift in two fields. (A) is a figure which shows the zoom magnification target value in this Embodiment in two fields, (B) is a figure which shows the image shift | offset | difference in this Embodiment in two fields. 16 is a flowchart illustrating a procedure of an image cut-out area control process performed on an image sensor included in an imaging unit, which is executed by the image recording / playback apparatus according to the fourth embodiment. (A) is a diagram showing a conventional zoom magnification target value in the zoom-in direction in two fields for one screen, (B) is a diagram showing a conventional image cut-out area in two fields, and (C) is a diagram. FIG. 4D is a diagram showing a conventional image shift in two fields, and FIG. 4D is a diagram showing a conventional zoom magnification target value in the zoom-out direction in two fields. (A) is a figure which shows the zoom magnification target value in this Embodiment in the zoom-in direction in two fields, (B) is a figure which shows the image image cutting-out area in this Embodiment in two fields (C) is a figure which shows the image shift | offset | difference in this Embodiment in two fields, (D) is a figure which shows the zoom magnification target value in this Embodiment in the zoom out direction in two fields. is there. It is a flowchart which shows the procedure of the recording process which records the amount of field fluctuations with image information performed with the image recording / reproducing apparatus in 5th Embodiment. It is a flowchart which shows the procedure of the reproduction | regeneration correction | amendment process performed with the image recording / reproducing apparatus in 5th Embodiment which reproduce | regenerates the amount of field fluctuations with image information, and correct | amends field blur. It is a flowchart which shows the procedure of the recording process which records the field magnification amount with image information performed with the image recording / reproducing apparatus in 6th Embodiment. It is a flowchart which shows the procedure of the reproduction | regeneration correction | amendment process performed with the image recording / reproducing apparatus in 6th Embodiment which reproduce | regenerates field magnification amount with image information, and correct | amends field blur. (A) is a figure which shows the zoom magnification target value at the time of the conventional interlace recording in the zoom-in direction in two fields with respect to one screen, (B) is the conventional interlace recording in the zoom-in direction in two fields. The figure which shows the image extraction area at the time, (C) is a figure which shows the image shift | offset | difference at the time of the conventional interlace recording in two fields. (A) is a diagram showing a zoom magnification target value at the time of conventional interlace recording in the zoom-out direction in two fields, and (B) is a graph at the time of conventional interlace recording in the zoom-out direction in two fields. It is a figure which shows an image extraction area. (A) is a figure which shows the zoom magnification target value at the time of non-interlace reproduction in this embodiment in the zoom-in direction in two fields, and (B) is in this embodiment in the zoom-in direction in two fields. The figure which shows the image extraction area at the time of non-interlace reproduction, (C) is a figure which shows the image shift | offset | difference at the time of non-interlace reproduction in this Embodiment in two fields. (A) is a figure which shows the zoom magnification target value at the time of non-interlace reproduction in this embodiment in the zoom-out direction in two fields, and (B) is the present embodiment in the zoom-out direction in two fields. It is a figure which shows the image extraction area at the time of the non-interlace reproduction | regeneration in a form.

Explanation of symbols

100 Imaging unit (imaging means, variable magnification imaging means)
101 focus detection unit 102 shake detection unit (shake detection means)
103 Panning determination unit (determination means)
104 shake correction control unit 105 field fluctuation calculation unit (field fluctuation calculation means)
106 View angle control unit 107 Zooming determination unit (determination means)
108 Field scaling amount calculation unit (Field scaling amount calculation means)
109 Correction metadata addition acquisition unit (correction data acquisition means)
110 Recording / playback unit 111 Non-interlace correction unit (non-interlace correction means)
112 Non-interlaced display (reproduction signal generating means)
113 Interlace display

Claims (22)

Imaging means for generating first and second field image signals by interlace scanning;
Shake detection means for detecting the shake of the device itself and outputting a detection signal;
A determination unit that determines whether or not shooting is performed by a predetermined shooting method based on the image signal generated by the imaging unit and the detection signal output by the shake detection unit;
When it is determined by the determining means that the image is being shot by the predetermined shooting method, the first field shooting time point and the second field shooting time are obtained from the detection signal output by the shake detecting means and the subject focus information in the image pickup means. An image recording apparatus comprising: field fluctuation amount calculating means for calculating a field shake correction amount for canceling out a shake of the subject apparatus with respect to a subject that occurs between the time of field shooting.   The image recording apparatus according to claim 1, wherein the predetermined photographing method is panning photographing. An optical shake correction unit that corrects a shake of a captured image due to a shake of the own device by deflecting an optical axis of the imaging unit;
Driving means for driving the optical shake correction means using a value obtained by adding the field shake correction amount calculated by the field shake amount calculation means to the camera shake correction value for interlaced display;
2. The image recording according to claim 1, further comprising recording means for recording an image signal generated by the imaging means when the optical shake correction means driven by the driving means is operating. apparatus. An electronic shake correction unit that corrects a shake of a captured image due to a shake of the own device by selecting a range in which an image is to be output from an imaging area of the imaging unit;
A drive unit that causes the electronic shake correction unit to perform correction using a range obtained by adding a field shake correction amount calculated by the field shake amount calculation unit to a camera shake image extraction range for interlaced display;
The image recording according to claim 1, further comprising: a recording unit that records an image signal generated by the imaging unit when the electronic shake correcting unit driven by the driving unit is operating. apparatus.   2. The image processing apparatus according to claim 1, further comprising correction data adding means for recording the image information and recording the field shake correction amount calculated by the field fluctuation amount calculation means as sub-data for shake cancellation at the time of image reproduction. The image recording apparatus according to 1. Imaging means for generating first and second field image signals by interlace scanning;
Zooming means for changing the angle of view according to the angle-of-view change command signal;
A determination unit that determines whether or not shooting is being performed by a predetermined shooting method based on an image signal generated by the imaging unit and an angle-of-view change command signal input to the variable magnification shooting unit;
When it is determined by the determining means that the image is being shot by the predetermined shooting method, the change occurring between the first field shooting time and the second field shooting time is determined from the zoom speed of the zoom shooting means. An image recording apparatus comprising: a field scaling amount calculation unit that calculates a field scaling correction amount for canceling a change amount of the angle of view by the magnification imaging unit. Imaging means for generating an image signal by interlace scanning;
An angle-of-view control means for controlling the angle of view of the variable magnification optical system;
Determination means for determining whether or not photographing by a predetermined photographing technique is performed based on the image signal generated by the imaging means and the angle of view control state by the angle of view control means;
The image recording apparatus according to claim 1, wherein the angle-of-view control means performs angle-of-view control in units of one frame when it is determined by the determining means that the predetermined photographing technique is being performed.   8. The image recording apparatus according to claim 6, wherein the predetermined photographing method is zooming photographing. An angle-of-view control means for changing a magnification by selecting a range to output an image from an imaging area of the imaging means;
Driving means for operating the angle-of-view control means using the field magnification correction amount calculated by the field magnification amount calculating means;
The image recording apparatus according to claim 6, further comprising: a recording unit that records an image signal generated by the imaging unit when the angle of view control unit driven by the driving unit is operating. apparatus.   The image processing apparatus further comprises correction data adding means for recording image information and recording the field scaling correction amount calculated by the field scaling amount calculating means as sub-data for scaling cancellation at the time of image reproduction. The image recording apparatus according to claim 6. Image data of the first and second fields is acquired by interlace scanning, and the image recording apparatus shakes with respect to the subject between the shooting time of the first field and the shooting time of the second field. Correction data acquisition means for acquiring a field shake correction amount for offsetting the amount as sub data;
A non-interlace correction unit that determines an image extraction range by adding a field shake correction amount acquired by the correction data acquisition unit to a camera shake image extraction range for interlaced display;
Image data located in the image extraction range determined by the non-interlace correction means is extracted from the image data acquired by the correction data acquisition means, and the amount of shaking of the image recording apparatus with respect to the subject cancels out. And a reproduction signal generating means for generating the reproduced signal. Image data of the first and second fields is acquired by interlace scanning, and the image recording device scales the subject between the shooting time of the first field and the shooting time of the second field. Correction data acquisition means for acquiring, as sub-data, a field scaling correction amount for offsetting the angle of view
Non-interlace correction means for determining an image extraction range based on the field shake correction amount acquired by the correction data acquisition means so that the field angle amounts in the first and second fields are the same;
An image angle obtained by extracting image data located in an image extraction range determined by the non-interlace correction unit from the image data acquired by the correction data acquisition unit, and the image recording apparatus scaling the object. And a reproduction signal generating means for generating a reproduction signal in which the amount is canceled out. An imaging step of generating image signals of the first and second fields by interlace scanning;
A shake detection step of detecting a shake of the device itself and outputting a detection signal;
A determination step of determining whether or not shooting by a predetermined shooting technique is performed based on the image signal generated by the shooting step and the detection signal output by the shake detection step;
When it is determined by the determination step that the image is being shot by the predetermined shooting method, the first field shooting time point and the second field shooting time are obtained from the detection signal output by the shake detection step and the subject focus information in the shooting step. An image recording method comprising: a field fluctuation amount calculating step for calculating a field shake correction amount for canceling out a shake of the subject apparatus with respect to a subject generated between the time of field shooting. An imaging step of generating image signals of the first and second fields by interlace scanning;
A variable magnification shooting step for changing the angle of view in accordance with the angle-of-view change command signal;
A determination step of determining whether or not shooting by a predetermined shooting method is performed based on the image signal generated in the shooting step and the view angle change command signal used in the zoom shooting step;
When it is determined by the determination step that the image is being shot by the predetermined shooting method, the angle generated between the first field shooting time point and the second field shooting time point is determined from the view angle changing speed by the variable magnification shooting step. An image recording method comprising: a field scaling amount calculation step for calculating a field scaling correction amount for canceling a change amount of the angle of view in the scaling imaging step. An imaging step of generating an image signal by interlace scanning;
An angle-of-view control step for controlling the angle of view of the variable magnification optical system;
A determination step of determining whether or not shooting by a predetermined shooting method is performed based on the image signal generated by the shooting step and the view angle control state by the view angle control step;
The image recording method according to claim 1, wherein the angle-of-view control step performs angle-of-view control for each frame when it is determined by the determining step that the image is being shot by the predetermined shooting method. Image data of the first and second fields is acquired by interlace scanning, and the image recording apparatus shakes with respect to the subject between the shooting time of the first field and the shooting time of the second field. A correction data acquisition step of acquiring, as sub data, a field shake correction amount for offsetting the amount;
A non-interlace correction step of determining an image extraction range by adding the field shake correction amount acquired by the correction data acquisition step to a camera shake image extraction range for interlaced display;
Image data located in the image extraction range determined by the non-interlace correction step is extracted from the image data acquired by the correction data acquisition step, and the amount of shaking of the image recording apparatus with respect to the subject cancels out. And a reproduction signal generation step of generating the reproduced signal. Image data of the first and second fields is acquired by interlace scanning, and the image recording device scales the subject between the shooting time of the first field and the shooting time of the second field. A correction data acquisition step for acquiring, as sub data, a field scaling correction amount for canceling the angle of view that has been made,
A non-interlace correction step of determining an image extraction range based on the field shake correction amount acquired in the correction data acquisition step so that the angle of view in the first and second fields is the same;
An image angle obtained by extracting image data located in the image extraction range determined by the non-interlace correction step from the image data acquired by the correction data acquisition step, and the image recording apparatus scaling the object. And a reproduction signal generation step of generating a reproduction signal in which the amount is canceled out. An imaging step of generating image signals of the first and second fields by interlace scanning;
A shake detection step of detecting a shake of the device itself and outputting a detection signal;
A determination step of determining whether or not shooting by a predetermined shooting technique is performed based on the image signal generated by the shooting step and the detection signal output by the shake detection step;
When it is determined by the determination step that the image is being shot by the predetermined shooting method, the first field shooting time point and the second field shooting time are obtained from the detection signal output by the shake detection step and the subject focus information in the shooting step. A computer-executable program, comprising: a field fluctuation amount calculating step for calculating a field shake correction amount for canceling out a shake of the subject apparatus with respect to a subject generated between the time of field shooting. An imaging step of generating image signals of the first and second fields by interlace scanning;
A variable magnification shooting step for changing the angle of view in accordance with the angle-of-view change command signal;
A determination step of determining whether or not shooting by a predetermined shooting method is performed based on the image signal generated in the shooting step and the view angle change command signal used in the zoom shooting step;
When it is determined by the determination step that the image is being shot by the predetermined shooting method, the angle generated between the first field shooting time point and the second field shooting time point is determined from the view angle changing speed by the variable magnification shooting step. A computer-executable program comprising: a field scaling amount calculation step for calculating a field scaling correction amount for canceling a change amount of a field angle due to a scaling imaging step. An imaging step of generating an image signal by interlace scanning;
An angle-of-view control step for controlling the angle of view of the variable magnification optical system;
A determination step of determining whether or not shooting by a predetermined shooting method is performed based on the image signal generated by the shooting step and the view angle control state by the view angle control step;
The computer-executable program characterized in that the angle-of-view control step performs angle-of-view control in units of one frame when it is determined in the determining step that shooting is being performed by the predetermined shooting method. Image data of the first and second fields is acquired by interlace scanning, and the image recording apparatus shakes with respect to the subject between the shooting time of the first field and the shooting time of the second field. A correction data acquisition step of acquiring, as sub data, a field shake correction amount for offsetting the amount;
A non-interlace correction step of determining an image extraction range by adding the field shake correction amount acquired by the correction data acquisition step to a camera shake image extraction range for interlaced display;
Image data located in the image extraction range determined by the non-interlace correction step is extracted from the image data acquired by the correction data acquisition step, and the amount of shaking of the image recording apparatus with respect to the subject cancels out. A computer-executable program comprising: a reproduction signal generation step for generating a reproduced signal. Image data of the first and second fields is acquired by interlace scanning, and the image recording device scales the subject between the shooting time of the first field and the shooting time of the second field. A correction data acquisition step for acquiring, as sub data, a field scaling correction amount for canceling the angle of view that has been made,
A non-interlace correction step of determining an image extraction range based on the field shake correction amount acquired in the correction data acquisition step so that the angle of view in the first and second fields is the same;
An image angle obtained by extracting image data located in the image extraction range determined by the non-interlace correction step from the image data acquired by the correction data acquisition step, and the image recording apparatus scaling the object. A computer-executable program comprising: a reproduction signal generation step for generating a reproduction signal in which the amount is canceled out.

Images