KR101725932B1 - An imaging photographing device and an imaging photographing method using an video editing - Google Patents
An imaging photographing device and an imaging photographing method using an video editing Download PDFInfo
- Publication number
- KR101725932B1 KR101725932B1 KR1020150101993A KR20150101993A KR101725932B1 KR 101725932 B1 KR101725932 B1 KR 101725932B1 KR 1020150101993 A KR1020150101993 A KR 1020150101993A KR 20150101993 A KR20150101993 A KR 20150101993A KR 101725932 B1 KR101725932 B1 KR 101725932B1
- Authority
- KR
- South Korea
- Prior art keywords
- moving image
- target
- image
- corrected
- delete delete
- Prior art date
Links
Images
Classifications
-
- H04N5/23216—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Television Signal Processing For Recording (AREA)
- Studio Devices (AREA)
Abstract
As a preferred embodiment of the present invention, an image editing method includes: selecting a target in an input moving image and determining a position of the selected target; Determining a correction position of the target in a correction moving image in which the input moving image is edited; And a controller for setting a position of a target in the input moving image to a position of the target in the corrected moving image by resetting the position or orientation of the moving image photographing apparatus that picked up the input moving image by translating or rotating the moving image photographing apparatus, And correcting the corrected position to a corrected position of the second lens.
Description
BACKGROUND OF THE
The existing video editing technology is classified into two-dimensional analysis-based technique and three-dimensional analysis-based technique.
The technique based on the two-dimensional analysis includes a step of estimating motion, a step of setting a camera path through estimated motion, and a step of generating an image according to a camera movement path. In the motion estimation step, motion is measured by interpreting the photographed image as a two-dimensional motion model. In an actual camera, an image in which a three-dimensional space is projected as a two-dimensional image is obtained, but a two-dimensional motion model can not accurately model an actual three-dimensional motion.
Video editing techniques based on three - dimensional analysis reconstruct three - dimensional spatial information and camera position information from two - dimensional images using motion structure analysis techniques in general. A new camera position is defined using the reconstructed information, and image information at a new position is synthesized.
The present invention discloses an image editing method capable of correcting a three-dimensional input moving image in a form desired by a user.
In addition, the present invention discloses an image editing method for providing a screen similar to an actual motion perceived by a human eye while correcting camera motion and shake accurately and rapidly.
As a preferred embodiment of the present invention, an image editing method includes: selecting a target in an input moving image and determining a position of the selected target; Determining a correction position of the target in a correction moving image in which the input moving image is edited; And
Correcting the position of the target in the input moving image to the correction position of the target in the corrected moving image by resetting the position or orientation of the image capturing apparatus that has photographed the input moving image to the one in which the translational movement or the rotational movement is performed; Wherein the image editing method comprises the steps of:
Preferably, the correction position of the target is determined as any fixed coordinates in the corrected moving image. In this case, the fixed coordinates are the center coordinates of the display for displaying the corrected moving picture.
In another preferred embodiment of the present invention, the correction position of the target is determined to move along a predetermined trajectory.
In another preferred embodiment of the present invention, the correction position of the target is determined as a position set by a user.
As a preferred embodiment of the present invention, a computer readable recording medium on which a program for implementing the image editing method of the present invention is recorded is disclosed.
The image editing method of the present invention has an effect of providing a screen similar to an actual motion perceived by a human eye while correcting camera movement and shake at an accurate and rapid speed.
1 is a block diagram illustrating an internal configuration of a video photographing apparatus for performing video editing according to an embodiment of the present invention.
Figs. 2 to 3 show an example in which the target position adjustment section determines the correction position of the target.
4 is a flowchart illustrating a method of editing an image in a video photographing apparatus according to an embodiment of the present invention.
5 shows another example of determining a correction position of a target in a target position adjustment unit of a video image pickup apparatus according to a preferred embodiment of the present invention.
1 is a block diagram illustrating an internal configuration of a video photographing apparatus for performing video editing according to an embodiment of the present invention.
The
As a preferred embodiment of the present invention, the
As a preferred embodiment of the present invention, the
The target
In a preferred embodiment of the present invention, the correction position may be any fixed coordinate in the correction moving image. Referring to FIG. 2, the target position tracking unit (FIGS. 1 and 110) grasps the position Pa (n) 212 of the specific target S210 selected in the
Thereafter, the
In a preferred embodiment, when the position of t1 time of the video image photographing apparatus that implements the input moving image is (x1, y1, z1) (Fig. 5, 510), the
As a preferred embodiment of the present invention, the editing unit (see FIG. 1 and FIG. 130) may be configured such that the relative orientation between the camera orientation directions of the frames in the input moving picture and the frames in the corrected moving picture corresponding thereto, The corrected moving image can be outputted by compensating the camera motion using only the motion.
As a preferred embodiment of the present invention, the editing unit (see FIG. 1 and FIG. 130) uses the relative movement of the camera position of the specific frame in the input moving image and the frames in the corrected moving image corresponding thereto, It is possible to output an edited corrected moving image by compensating the motion.
As a preferred embodiment of the present invention, the editing unit (see FIG. 1 and FIG. 130) may be configured such that the relative orientation between the camera orientation directions of the frames in the input moving picture and the frames in the corrected moving picture corresponding thereto, It is possible to output an edited corrected moving image by compensating the camera movement using both the movement and the relative movement of the camera position.
FIG. 3 shows an embodiment in which a path of a specific target is determined in a corrected moving image according to a preferred embodiment of the present invention.
The target position tracking unit (FIGS. 1 and 110) can select a specific target in a specific frame in the input moving image and track the movement path of the selected specific target in the subsequent frames. The method of tracking the movement path of a specific target may employ a tracking algorithm that can be readily used by those skilled in the art.
Referring to FIG. 3, the target position tracking unit (FIGS. 1 and 110) can track the movement path S311 of the specific target S310.
The target position adjuster (FIGS. 1 and 120) can determine the movement path of a specific target in the corrected moving image by editing the input moving image. Referring to FIG. 3, the target position adjuster (FIGS. 1 and 120) can determine the movement path Pb (n) (S321) in the input moving image.
In this case, the moving path Pb (n) (S321) in the corrected moving image may be determined by the user, by using a position and a moving path extracted from other moving images, by using various types of trajectories or functions, This is possible. 3 (a) shows a moving path S311 of a specific target S310 in the input moving picture, and Fig. 3 (b) shows a moving path Pb (n) (S321) changed in the corrected moving picture. FIG. 3B shows a corrected moving picture. It is difficult to show a change in the background depending on time due to the limitation of writing, but it is possible to change the background to correspond to the movement path Pb (n) (S321) It should be noted.
In one preferred embodiment, a moving path of an object may be extracted from a previously captured movie to determine a moving path S321 on which a specific target in the moving image to be moved may be moved.
In another preferred embodiment, when the movement of the watch is to be modeled, the movement of the watch may be represented by a physical expression, and then the trajectory of the watch may be determined as the movement path Pb (n) (S321).
In another preferred embodiment, the trajectory can be represented by Pb (n) = (n, 0) in order to slowly express the target moving in the x-axis direction. In this case, n represents a frame index.
As another preferred embodiment, the expression Pb (n) = (k sin (f * n), 0) may be used to express the target shaking in the left and right direction. Where n is the frame index, k is the amplitude, and f is the period.
When the position or movement route of the specific target in the input moving image is extracted using the above method and the position or movement route of the specific target in the corrected moving image is determined, the editing unit (FIG. 1, 130) Changes the position or orientation of the device, and outputs the corrected moving image. That is, the position and / or orientation of the image capturing apparatus that captures the input moving image is corrected to the position and / or orientation required when capturing a specific position in the corrected moving image, thereby outputting the corrected moving image.
In a preferred embodiment of the present invention, the position and / or orientation of the image capturing apparatus that photographs each frame with respect to a frame after a specific frame of the input moving image is referred to as a specific position of a specific target in a frame within the corrected moving image corresponding to each frame Correct the position and / or orientation required when shooting. This allows you to track a specific target within a video and correct the trajectory of the specific target tracked.
As a preferred embodiment of the present invention, the image editing method can be utilized also in a graphics technique of a screen. Given a three-dimensional model, images can be synthesized at desired locations. At this time, it is possible to use the above technique when determining the position of the camera.
As a preferred embodiment of the present invention, the image editing method can also be utilized in a video stabilization technique. When a shake occurs in the input moving image, the corrected moving image in which the shake of the movement route of the specific target is removed can be edited. In this case, it is possible to stabilize the shaking by determining the movement path of the specific target from which the shake is removed in the corrected moving image.
4 is a flowchart illustrating a method of editing an image in a video photographing apparatus according to an embodiment of the present invention.
The image capturing apparatus selects a target within the captured input moving image and determines the position of the selected target (S410). The correction position of the target is determined in a corrected moving image obtained by editing the input moving image (S420). In a preferred embodiment of the present invention, the order of steps S410 and S420 may be changed or the two steps may be performed at the same time.
Thereafter, the position or orientation of the image capturing apparatus that captures the input moving image is reset by translating or rotating the image capturing apparatus having captured the input moving image (S430). In operation S440, the position of the target in the input moving image is corrected to the corrected position of the target in the corrected moving image by using the position or orientation information of the re-set image capturing apparatus.
As a preferred embodiment of the present invention, the image editing method may also employ both a two-dimensional image analysis technique and a three-dimensional image analysis technique. Since the three-dimensional technique is implemented by predicting the difference in the direction of the line of sight between the images on the basis of the two-dimensional analysis technique and adjusting the orientation direction of the camera for each frame according to the camera movement path instead of the simple parallel movement of the camera position, It is possible to output a video having almost no distortion to the video signal.
The above-described embodiments of the present invention can be embodied in a general-purpose digital computer that can be embodied as a program that can be executed in a computer and operates the program using a computer-readable recording medium. The computer-readable recording medium includes a storage medium such as a magnetic storage medium (e.g., ROM, floppy disk, hard disk, etc.), optical reading medium (e.g., CD ROM,
The present invention has been described with reference to the preferred embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.
Claims (11)
Determining a correction position of the target in a correction moving image in which the input moving image is edited; And
And correcting the position of the target in the input moving image to the correction position of the target in the corrected moving image by resetting the position or orientation of the image capturing apparatus that has photographed the input moving image to that of translational movement and rotational movement; Including,
In this case, the corrected moving image is a reconstructed three-dimensional spatial information and camera position information from the two-dimensional image using the motion structure analysis technique, and the reconstructed moving image is a reconstructed image obtained by using the reconstructed three- Wherein the image editing method comprises:
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150101993A KR101725932B1 (en) | 2015-07-17 | 2015-07-17 | An imaging photographing device and an imaging photographing method using an video editing |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150101993A KR101725932B1 (en) | 2015-07-17 | 2015-07-17 | An imaging photographing device and an imaging photographing method using an video editing |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020160181431A Division KR101741150B1 (en) | 2016-12-28 | 2016-12-28 | An imaging photographing device and an imaging photographing method using an video editing |
Publications (2)
Publication Number | Publication Date |
---|---|
KR20170009654A KR20170009654A (en) | 2017-01-25 |
KR101725932B1 true KR101725932B1 (en) | 2017-04-12 |
Family
ID=57991216
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150101993A KR101725932B1 (en) | 2015-07-17 | 2015-07-17 | An imaging photographing device and an imaging photographing method using an video editing |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101725932B1 (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001283259A (en) | 2000-03-31 | 2001-10-12 | Sega Corp | Image processor, game device and image processing method |
JP2004248249A (en) | 2003-01-21 | 2004-09-02 | Sony Corp | Imaging apparatus |
JP2006165600A (en) | 2004-12-02 | 2006-06-22 | Fuji Photo Film Co Ltd | Photographing apparatus |
JP2006251930A (en) | 2005-03-08 | 2006-09-21 | Kohei Nishino | Character conversion apparatus, program for information processor, received content display method, and received content display system |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100474352B1 (en) | 2001-05-14 | 2005-03-08 | 주식회사 페이스쓰리디 | System and method for acquiring a 3D face digital data from 2D photograph |
-
2015
- 2015-07-17 KR KR1020150101993A patent/KR101725932B1/en active IP Right Grant
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001283259A (en) | 2000-03-31 | 2001-10-12 | Sega Corp | Image processor, game device and image processing method |
JP2004248249A (en) | 2003-01-21 | 2004-09-02 | Sony Corp | Imaging apparatus |
JP2006165600A (en) | 2004-12-02 | 2006-06-22 | Fuji Photo Film Co Ltd | Photographing apparatus |
JP2006251930A (en) | 2005-03-08 | 2006-09-21 | Kohei Nishino | Character conversion apparatus, program for information processor, received content display method, and received content display system |
Also Published As
Publication number | Publication date |
---|---|
KR20170009654A (en) | 2017-01-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6937809B2 (en) | Systems and methods for stabilizing digital video through constraint-based rotational smoothing | |
CN111133747B (en) | Method and device for stabilizing video | |
US10600157B2 (en) | Motion blur simulation | |
US10789765B2 (en) | Three-dimensional reconstruction method | |
JP5744217B2 (en) | Method and system for processing video for stabilization and retargeting | |
CN110322542B (en) | Reconstructing views of a real world 3D scene | |
CN109644231B (en) | Method, system, and medium providing improved video stability for mobile devices | |
US11102413B2 (en) | Camera area locking | |
JP5725953B2 (en) | Imaging apparatus, control method therefor, and information processing apparatus | |
US20170374256A1 (en) | Method and apparatus for rolling shutter compensation | |
US10586378B2 (en) | Stabilizing image sequences based on camera rotation and focal length parameters | |
JP6319972B2 (en) | Image processing apparatus, imaging apparatus, image processing method, and program | |
JP2016063248A (en) | Image processing device and image processing method | |
US10911677B1 (en) | Multi-camera video stabilization techniques | |
KR101741150B1 (en) | An imaging photographing device and an imaging photographing method using an video editing | |
CN112073632A (en) | Image processing method, apparatus and storage medium | |
EP2980752B1 (en) | Image processing device, image processing system, image processing method, and image processing program | |
KR101725932B1 (en) | An imaging photographing device and an imaging photographing method using an video editing | |
WO2018195892A1 (en) | Method and apparatus for adding three-dimensional stereoscopic watermark, and terminal | |
US11792511B2 (en) | Camera system utilizing auxiliary image sensors | |
EP4036858A1 (en) | Volumetric imaging | |
WO2018173183A1 (en) | Optical device control apparatus, optical device control method, and optical device control program | |
KR102561903B1 (en) | AI-based XR content service method using cloud server | |
US20240037793A1 (en) | Systems, methods, and apparatus for piggyback camera calibration | |
JP2023070220A (en) | Camera operation simulation device and program thereof, and camera image generation device and program thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E90F | Notification of reason for final refusal | ||
A107 | Divisional application of patent | ||
E701 | Decision to grant or registration of patent right | ||
GRNT | Written decision to grant |