KR20170009809A - An imaging photographing device and an imaging photographing method using an video editing - Google Patents

Abstract

As a preferred embodiment of the present invention, an image editing method includes a step of selecting a target in an input moving image and recognizing the position of the selected target; a step of determining a correction position of the target in a corrected moving image formed by editing the input moving image; and a step of changing the position of the target in the input moving image to the correction position of the target in the corrected moving image by translating or rotating an image photographing device which has photographed the input moving image to reset the position or orientation of the image photographing device which has photographed the input moving image. So, a user can freely correct a 3D input moving image.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image capturing device and an image capturing method,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to an image photographing apparatus and an image photographing method for performing image editing.

The existing video editing technology is classified into two-dimensional analysis-based technique and three-dimensional analysis-based technique.

The technique based on the two-dimensional analysis includes a step of estimating motion, a step of setting a camera path through estimated motion, and a step of generating an image according to a camera movement path. In the motion estimation step, motion is measured by interpreting the photographed image as a two-dimensional motion model. In an actual camera, an image in which a three-dimensional space is projected as a two-dimensional image is obtained, but a two-dimensional motion model can not accurately model an actual three-dimensional motion.

Video editing techniques based on three - dimensional analysis reconstruct three - dimensional spatial information and camera position information from two - dimensional images using motion structure analysis techniques in general. A new camera position is defined using the reconstructed information, and image information at a new position is synthesized.

KR 0474352

The present invention discloses an image editing method capable of correcting a three-dimensional input moving image in a form desired by a user.

In addition, the present invention discloses an image editing method for providing a screen similar to an actual motion perceived by a human eye while correcting camera motion and shake accurately and rapidly.

As a preferred embodiment of the present invention, an image editing method includes: selecting a target in an input moving image and determining a position of the selected target; Determining a correction position of the target in a correction moving image in which the input moving image is edited; And

Correcting the position of the target in the input moving image to the correction position of the target in the corrected moving image by resetting the position or orientation of the image capturing apparatus that has photographed the input moving image to the one in which the translational movement or the rotational movement is performed; Wherein the image editing method comprises the steps of:

Preferably, the correction position of the target is determined as any fixed coordinates in the corrected moving image. In this case, the fixed coordinates are the center coordinates of the display for displaying the corrected moving picture.

In another preferred embodiment of the present invention, the correction position of the target is determined to move along a predetermined trajectory.

In another preferred embodiment of the present invention, the correction position of the target is determined as a position set by a user.

As a preferred embodiment of the present invention, a computer readable recording medium on which a program for implementing the image editing method of the present invention is recorded is disclosed.

The image editing method of the present invention has an effect of providing a screen similar to an actual motion perceived by a human eye while correcting camera movement and shake at an accurate and rapid speed.

1 is a block diagram illustrating an internal configuration of a video photographing apparatus for performing video editing according to an embodiment of the present invention.
Figs. 2 to 3 show an example in which the target position adjustment section determines the correction position of the target.
4 is a flowchart illustrating a method of editing an image in a video photographing apparatus according to an embodiment of the present invention.
5 shows another example of determining a correction position of a target in a target position adjustment unit of a video image pickup apparatus according to a preferred embodiment of the present invention.

1 is a block diagram illustrating an internal configuration of a video photographing apparatus for performing video editing according to an embodiment of the present invention.

The image capturing apparatus 100 includes a target position tracking unit 110, a target position adjusting unit 120, and an editing unit 130. The editing unit 130 includes a translating moving unit 132 and a rotating moving unit 134. [

As a preferred embodiment of the present invention, the image capturing apparatus 100 may be a computer, a mobile phone, a smart phone, a tablet PC, a notebook, a camcorder, a network camera, a handheld device, Includes all installed devices.

As a preferred embodiment of the present invention, the image capturing apparatus 100 performing image editing selects a target within a specific frame of an input moving image through the target position tracking unit 110, and grasps the position of the selected target. For example, the position Pa (n) of the target selected in the n-th frame is grasped.

The target position adjustment unit 120 determines a correction position in which the target is positioned within a specific frame of the corrected moving image corresponding to a specific frame of the input moving image in the corrected moving image edited by the input moving image. As a preferred embodiment of the present invention, a specific frame in a corrected moving image corresponding to a specific frame in the input moving image can be selected using a frame sequence. In this case, the correction position can be expressed by Pb (n). FIGS. 2 to 3 show an example in which the target position adjustment unit 120 determines the correction position of the target.

In a preferred embodiment of the present invention, the correction position may be any fixed coordinate in the correction moving image. Referring to FIG. 2, the target position tracking unit (FIGS. 1 and 110) grasps the position Pa (n) 212 of the specific target S210 selected in the specific frame 210 of the input moving image. The target position adjustment unit 120 determines the correction position Pb (n) 222 of the specific target S220 in the specific frame 220 in the corrected moving image corresponding to the specific target S210 in the specific frame of the input moving image do. In this case, the correction position Pb (n) 222 may be any fixed position in the correction moving image. For example, it may be the center position of the corrected moving image.

Thereafter, the editing unit 130 virtually translates or rotates the position of the image capturing apparatus that has captured the input moving image, thereby resetting the position or orientation of the image capturing apparatus that has captured the input moving image. The function of the editing unit 130 can be implemented by a DSP (Digital Signal Processing) unit or a control unit of the image capturing apparatus, or by downloading an application or installing software. You can also download applications or install software from remote servers or terminals.

In a preferred embodiment, when the position of t1 time of the video image photographing apparatus that implements the input moving image is (x1, y1, z1) (Fig. 5, 510), the editing unit 130 determines in order to give the same effect as the translational movement or the rotational movement of the position x2, y2, z2 (Fig. 5, 520) of the time t1, 5, 510) is reset to the virtual correction position (x2, y2, z2) (Fig. 5, 520). In this case, the physical position of the image pickup apparatus may not actually be changed. Thus, the image capturing apparatus 100 can generate a corrected moving image (FIG. 5, 530) by fitting the input moving image.

As a preferred embodiment of the present invention, the editing unit (see FIG. 1 and FIG. 130) may be configured such that the relative orientation between the camera orientation directions of the frames in the input moving picture and the frames in the corrected moving picture corresponding thereto, The corrected moving image can be outputted by compensating the camera motion using only the motion.

As a preferred embodiment of the present invention, the editing unit (see FIG. 1 and FIG. 130) uses the relative movement of the camera position of the specific frame in the input moving image and the frames in the corrected moving image corresponding thereto, It is possible to output an edited corrected moving image by compensating the motion.

As a preferred embodiment of the present invention, the editing unit (see FIG. 1 and FIG. 130) may be configured such that the relative orientation between the camera orientation directions of the frames in the input moving picture and the frames in the corrected moving picture corresponding thereto, It is possible to output an edited corrected moving image by compensating the camera movement using both the movement and the relative movement of the camera position.

FIG. 3 shows an embodiment in which a path of a specific target is determined in a corrected moving image according to a preferred embodiment of the present invention.

The target position tracking unit (FIGS. 1 and 110) can select a specific target in a specific frame in the input moving image and track the movement path of the selected specific target in the subsequent frames. The method of tracking the movement path of a specific target may employ a tracking algorithm that can be readily used by those skilled in the art.

Referring to FIG. 3, the target position tracking unit (FIGS. 1 and 110) can track the movement path S311 of the specific target S310.

The target position adjuster (FIGS. 1 and 120) can determine the movement path of a specific target in the corrected moving image by editing the input moving image. Referring to FIG. 3, the target position adjuster (FIGS. 1 and 120) can determine the movement path Pb (n) (S321) in the input moving image.

In this case, the moving path Pb (n) (S321) in the corrected moving image may be determined by the user, by using a position and a moving path extracted from other moving images, by using various types of trajectories or functions, This is possible. 3 (a) shows a moving path S311 of a specific target S310 in the input moving picture, and Fig. 3 (b) shows a moving path Pb (n) (S321) changed in the corrected moving picture. FIG. 3B shows a corrected moving picture. It is difficult to show a change in the background depending on time due to the limitation of writing, but it is possible to change the background to correspond to the movement path Pb (n) (S321) It should be noted.

In one preferred embodiment, a moving path of an object may be extracted from a previously captured movie to determine a moving path S321 on which a specific target in the moving image to be moved may be moved.

In another preferred embodiment, when the movement of the watch is to be modeled, the movement of the watch may be represented by a physical expression, and then the trajectory of the watch may be determined as the movement path Pb (n) (S321).

In another preferred embodiment, the trajectory can be represented by Pb (n) = (n, 0) in order to slowly express the target moving in the x-axis direction. In this case, n represents a frame index.

As another preferred embodiment, the expression Pb (n) = (k sin (f * n), 0) may be used to express the target shaking in the left and right direction. Where n is the frame index, k is the amplitude, and f is the period.

When the position or movement route of the specific target in the input moving image is extracted using the above method and the position or movement route of the specific target in the corrected moving image is determined, the editing unit (FIG. 1, 130) Changes the position or orientation of the device, and outputs the corrected moving image. That is, the position and / or orientation of the image capturing apparatus that captures the input moving image is corrected to the position and / or orientation required when capturing a specific position in the corrected moving image, thereby outputting the corrected moving image.

In a preferred embodiment of the present invention, the position and / or orientation of the image capturing apparatus that photographs each frame with respect to a frame after a specific frame of the input moving image is referred to as a specific position of a specific target in a frame within the corrected moving image corresponding to each frame Correct the position and / or orientation required when shooting. This allows you to track a specific target within a video and correct the trajectory of the specific target tracked.

As a preferred embodiment of the present invention, the image editing method can be utilized also in a graphics technique of a screen. Given a three-dimensional model, images can be synthesized at desired locations. At this time, it is possible to use the above technique when determining the position of the camera.

As a preferred embodiment of the present invention, the image editing method can also be utilized in a video stabilization technique. When a shake occurs in the input moving image, the corrected moving image in which the shake of the movement route of the specific target is removed can be edited. In this case, it is possible to stabilize the shaking by determining the movement path of the specific target from which the shake is removed in the corrected moving image.

4 is a flowchart illustrating a method of editing an image in a video photographing apparatus according to an embodiment of the present invention.

The image capturing apparatus selects a target within the captured input moving image and determines the position of the selected target (S410). The correction position of the target is determined in a corrected moving image obtained by editing the input moving image (S420). In a preferred embodiment of the present invention, the order of steps S410 and S420 may be changed or the two steps may be performed at the same time.

Thereafter, the position or orientation of the image capturing apparatus that captures the input moving image is reset by translating or rotating the image capturing apparatus having captured the input moving image (S430). In operation S440, the position of the target in the input moving image is corrected to the corrected position of the target in the corrected moving image by using the position or orientation information of the re-set image capturing apparatus.

As a preferred embodiment of the present invention, the image editing method may also employ both a two-dimensional image analysis technique and a three-dimensional image analysis technique. Since the three-dimensional technique is implemented by predicting the difference in the direction of the line of sight between the images on the basis of the two-dimensional analysis technique and adjusting the orientation direction of the camera for each frame according to the camera movement path instead of the simple parallel movement of the camera position, It is possible to output a video having almost no distortion to the video signal.

The above-described embodiments of the present invention can be embodied in a general-purpose digital computer that can be embodied as a program that can be executed in a computer and operates the program using a computer-readable recording medium. The computer-readable recording medium includes a storage medium such as a magnetic storage medium (e.g., ROM, floppy disk, hard disk, etc.), optical reading medium (e.g., CD ROM,

The present invention has been described with reference to the preferred embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

Claims (9)

Selecting a target within an input moving image and determining a position of the selected target;
Determining a correction position of the target in a correction moving image in which the input moving image is edited; And
Correcting the position of the target in the input moving image to the correction position of the target in the corrected moving image by resetting the position or orientation of the image capturing apparatus that has photographed the input moving image to the one in which the translational movement or the rotational movement is performed; Including,
In this case, the corrected moving image is a reconstructed three-dimensional spatial information and camera position information from the two-dimensional image using the motion structure analysis technique, and the reconstructed moving image is a reconstructed image obtained by using the reconstructed three- Wherein the image editing method comprises: The method of claim 1, wherein the correction position of the target
Wherein the fixed image is determined as any fixed coordinate in the corrected moving image. 3. The method of claim 2, wherein the fixed coordinates are
And the center coordinates of the display for displaying the corrected moving picture. The method of claim 1, wherein the correction position of the target
Wherein the moving image is determined to move along a predetermined trajectory. The method of claim 1, wherein the correction position of the target
And the position determined by the user is determined as the position set by the user. 2. The method of claim 1, wherein the correcting comprises:
Wherein the correction is performed by performing only translational movement of the image photographing apparatus while the position of the image photographing apparatus is fixed. 2. The method of claim 1, wherein the correcting comprises:
Wherein the correction is performed by performing only the rotational movement of the image photographing apparatus while the angle of the image photographing apparatus is fixed. 2. The method of claim 1, wherein the correcting comprises:
Wherein the position of the target in the input moving image is tracked and the position of the target tracked in the input moving image is corrected to the target position of the target in the moving image. The image editing method of claim 1, wherein the input moving image is corrected by correcting the shaking of the input moving image.

Images