KR101563822B1 - Method and Device for Editing Moving Picture - Google Patents

Abstract

Disclosed are a method and an apparatus for editing a moving image, which is tough on a change in color for each frame and provides a rapid editing speed for a high-resolution moving image. The disclosed method for editing moving images comprises the steps of: receiving a first stroke for an editing region and a second stroke for a non-editing region from a present frame of the moving image; generating first color information for the color contained in the present frame region selected according to each of the first and the second stroke; and using the first color information to select the editing region and the non-editing region in a frame next to the present frame.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and a device for editing moving pictures,

The present invention relates to a moving image editing method and apparatus, and more particularly, to a moving image editing method and apparatus that is robust against inter-frame color variation and provides a fast editing speed even in a high-resolution moving image.

2. Description of the Related Art Recently, as the demand for multimedia information has increased rapidly, various technologies related to editing, searching, objectification, etc. of multimedia contents (e.g., moving pictures) have been widely developed.

The editing process for a moving picture is usually performed in two stages. The first step is to select and separate the position of the object, and the second step is to input the object information.

The first step (step of selecting and separating object positions) is a step of selecting a position and an area with respect to a semantic object required in the input moving image. These locations and areas must contain information that changes continuously over the time the object appears.

In the second step (inputting object information), a meaningful object is extracted according to the intention of the editor, and a metadata (e.g., metadata such as other video data, other audio data, Data, etc.) can be connected in real time.

The first step is the step of consuming the most effort, time, and cost of the video editing steps described above. Typically, a user must select and detect an object to be edited for each video frame. Particularly, in a device that mounts a relatively small display such as a mobile device and does not have a separate input device, video editing is more difficult.

The present invention provides a moving picture editing method and apparatus, and more particularly, to provide a moving picture editing method and apparatus for allowing a user to easily edit a moving picture with only a small interaction between a user and a device.

According to an embodiment of the present invention, there is provided a method of controlling a moving picture, the method comprising: receiving a first stroke for an editing area and a second stroke for a non-editing area in a current frame of a moving picture; Generating first color information on a color included in an area of the current frame selected in accordance with the first and second strokes, respectively; And selecting the editing area and the non-editing area in the next frame of the current frame using the first color information.

According to another aspect of the present invention, there is provided a method of reproducing moving picture data, comprising the steps of: receiving an editing area and a non-editing area of a current frame of a moving picture; Generating color information for each of the editing area and the non-editing area; And selecting the editing area and the non-editing area in the next frame of the current frame using the color information.

According to still another aspect of the present invention, there is provided an image processing apparatus including: an interface unit receiving a first stroke for an edit region in a current frame of a moving image and a second stroke for a non-edit region; An information generating unit for generating color information on a color included in the current frame selected according to the first and second strokes; And an area selection unit for selecting an editing area and a non-editing area in the next frame of the current frame using the color information.

According to the present invention, it is possible to easily edit a moving image by extracting an editing area based on color information of an area selected by a user's interaction operation, and performing editing, and provides a robust effect on color change between frames .

Further, according to the present invention, by using color difference information having a small amount of information, it is possible to provide a high processing speed even in a high-resolution moving image.

1 is a diagram for explaining a concept of a moving picture editing method according to an embodiment of the present invention.
2 is a view for explaining a moving picture editing apparatus according to an embodiment of the present invention.
3 is a diagram for explaining a moving picture editing method according to an embodiment of the present invention.
4 is a diagram illustrating color information generated in a moving image editing method according to an exemplary embodiment of the present invention.
FIG. 5 is a diagram illustrating a portion of a moving image edited by a moving image editing method according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

The present invention provides a method and apparatus for allowing a user to easily edit a moving image or a video image. The present invention can select a region to be edited by a user in a current frame among the frames constituting a moving image or a video through a simple operation such as a stroke or a scribble operation , And extracts the editing area based on the color information of the area selected by the user's interaction operation. Also, by using the color information generated in the current frame in the next frame, even if the user designates an area to be edited through interaction only with respect to the current frame, the editing area can be extracted from the entire moving image, So that a desired visual effect can be given.

The hardware aspects described herein may be interpreted in terms of a process. Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram for explaining a concept of a moving picture editing method according to an embodiment of the present invention.

The image shown in Fig. 1 is an image representing a current frame of a moving image to be edited by the user. The user can input a first stroke (green line) for the editing area and a second stroke (blue line) for the non-editing area in the current frame of the movie. The stroke input by the user for the edit region or the non-edit region may be plural.

The colors included in the current frame region selected in accordance with the first stroke are yellow or green, and the colors included in the current frame region selected in the second stroke are white or blue. The present invention analyzes the colors included in the area selected by the stroke of the current frame, and selects the editing area and the non-editing area based on the analyzed color information.

Accordingly, when the current frame shown in FIG. 1 is divided into three regions, i.e., sky, grassland, and rabbit, according to the present invention, the green-colored grassland is selected as the editing region, and the white or blue- Can be selected.

The present invention uses color information included in an area selected by a stroke inputted in a current frame when selecting an editing area and a non-editing area in the next frame of the current frame, so that the editing area and the non- Can be selected. In the moving picture composed of a plurality of frames, the color information of the current frame is also used in the next frame to select the editing area and the non-editing area. Thus, in a simple stroke input to the current frame, Can be selected.

When a user designates an effect desired for the editing area, for example, when changing the color, if the effect is specified, the moving picture of the color of the editing area may be reproduced.

2 is a view for explaining a moving picture editing apparatus according to an embodiment of the present invention.

2, the moving picture editing apparatus 200 according to the present invention includes an interface unit 201, an information generating unit 203, and an area selecting unit 205. [ The moving picture editing apparatus 200 according to the present invention may be a user terminal such as a mobile device included in the user terminal or including a display device.

The interface unit 201 receives an editing area and a non-editing area for the current frame of the moving image. The interface unit 201 can receive an edit region and a non-edit region through a stroke from the user. That is, the interface unit 201 can receive the first stroke for the editing area and the second stroke for the non-editing area in the current frame of the moving picture. The interface unit 201 may be, for example, a display device for recognizing a touch input, and may display a moving picture to be edited.

The information generation unit 203 generates first color information on a color included in an area of the current frame selected according to the first and second strokes. The information generating unit 203 may generate color information indicating a color included in the current frame area selected in accordance with the first stroke and color information indicating a color included in the current frame area selected according to the second stroke, And generates color information indicating a color.

Here, the color information may be color information generated in the YCbCr space, and may be information including color difference information (Cb, Cr). That is, the information generating unit 203 can generate color information in the form of color difference information instead of RGB, and the color difference information can be processed faster because the information amount is very small compared with the RGB information.

The area selection unit 205 selects the editing area and the non-editing area in the next frame of the current frame by using the color information. That is, the area selection unit 205 selects the area of the next frame including the color included in the current frame area selected in accordance with the first stroke as the editing area in the next frame. The area of the next frame including the color included in the current frame area selected in accordance with the second stroke is selected as the non-editing area in the next frame.

On the other hand, since a color that does not exist in the current frame may exist in the next frame, the region selection unit 205 compares the color of the next frame with the first color information and determines whether the new color included in the next frame is more than a predetermined similarity degree . The region selection unit 205 may update the first color information by reflecting the new color of the next frame and may generate the second color information according to the determination result. Then, the area selection unit 205 can select the editing area and the non-editing area using the second color information.

That is, a new color of the next frame similar to the color of the first stroke is selected as the editing area, and a new color of the next frame not similar to the color of the second stroke can be selected as the non-editing area.

As described above, according to the present invention, the color information of the current frame can be utilized in the next frame to select an editing area and edit the moving picture, and a strong effect on the color change between frames is provided do. Further, according to the present invention, by using color difference information having a small amount of information, it is possible to provide a high processing speed even in a high-resolution moving image.

3 is a diagram for explaining a moving picture editing method according to an embodiment of the present invention. The dynamic spiritual editing method of FIG. 3 may be performed in the moving image editing apparatus 200 of FIG. 2 as an embodiment.

The video editing apparatus receives the editing area and the non-editing area for the current frame of the moving image (S301), that is, receives the input. The moving image editing apparatus can receive the editing area and the non-editing area through the user's stroke, and can receive the first stroke for the editing area and the second stroke for the non-editing area in the current frame of the moving image. The first stroke and the second stroke are strokes in the form of a line, and the area need not be specified in the form of a closed curve.

The video editing apparatus generates color information for each of the editing area and the non-editing area (S303). In other words, the color information generating unit 140 generates color information on a color included in the current frame region selected according to the first and second strokes. The color information may include color difference information (Cb, Cr) as color information generated in the YCbCr space.

The moving image editing apparatus selects the editing area and the non-editing area in the next frame using the color information (S305). That is, the moving image editing apparatus selects an area of the color included in the current frame area selected in accordance with the first stroke in the next frame as an editing area, and selects a color area included in the current frame area selected in accordance with the second stroke in the next frame Select as non-editing area. Further, the moving picture editing apparatus can use the color information to select the editing area and the non-editing area in the current frame.

On the other hand, since a color that does not exist in the current frame may exist in the next frame, the moving image editing apparatus compares the color of the next frame with the color information, and determines whether the new color included in the next frame is equal to or greater than a predetermined similarity. According to the determination result, the color information is updated by reflecting the new color of the next frame, and the editing area and the non-editing area can be selected using the updated color information.

For example, the moving image editing apparatus compares the Cb and Cr values of the next frame pixel with the Cb and Cr values of the current frame editing region, and judges that the Cb and Cr values are similar when the difference is within a preset value. At this time, the moving picture editing apparatus can determine the similarity of colors by expressing the difference of the Cb and Cr values with probability. Equation (1) is a probability model for determining the similarity between the color of the current frame and the color of the next frame, and can be transformed into an energy function form according to the Gibbs distribution as shown in Equation (2).

는 t번째 프레임 영상을 나타낸다.

는 에너지 함수 변환을 위한 값이며,

는 t번째 프레임에서 유사도 판단 대상 픽셀을 나타낸다. 그리고

는

과 대응되며, 다음 프레임 영상의 색상과 유사성 판단 대상 픽셀의 유사도를 나타낸다.

는

와 대응되며, 현재 프레임과 다음 프레임의 픽셀 간 유사도를 나타내며, YCbCr 공간에서 생성되는 현재 프레임의 색상 정보가 이용될 수 있다.Here, t represents the next frame, t-1 represents the current frame,

Represents a t-th frame image.

Is a value for energy function conversion,

Represents a pixel to be subjected to similarity determination in the t-th frame. And

The

And indicates the similarity of the color of the next frame image and the pixel to be judged similarity.

The

And represents the similarity between pixels of the current frame and the next frame, and color information of the current frame generated in the YCbCr space can be used.

Further, the expression (2) can be transformed into the expression (5) by the expression (3) and the expression (4).

는 유사도 판단 대상 픽셀과 주변 픽셀의 유사도를 나타내는 행렬이며,

는

과 대응된다.

는

값을 대각 행렬(diagonal matrix)로 변환한 값이다.here,

Is a matrix indicating the degree of similarity between pixels to be subjected to similarity determination and neighboring pixels,

The

.

The

Value is a value converted into a diagonal matrix.

가 다음 프레임에서의 편집 영역이 될 수 있으며, [수학식 6]과 같이 표현될 수 있다.If the value of [Equation 5] is the minimum

Can be an editing area in the next frame, and can be expressed as [Equation 6].

FIG. 4 is a diagram illustrating color information generated in a moving image editing method according to an embodiment of the present invention, and FIG. 5 is a diagram illustrating a portion of moving images edited by a moving image editing method according to an embodiment of the present invention.

FIG. 4 shows color information of the current frame illustrated in FIG. 1. In FIG. 4, the horizontal axis represents Cb and the vertical axis represents Cr. The green portion indicates color information included in the current frame region selected by the first stroke, and the blue portion indicates color information included in the current frame region selected by the second stroke. The color information shown in Fig. 4 can be updated in the next frame.

The color of the next frame similar to the color contained in the current frame region selected by the first stroke is included in the blue portion of Fig. 4, and the color of the next frame, which is similar to the color included in the current frame region selected by the second stroke, 4, the color information can be updated.

5 is an edit area (green stroke) in the current frame shown in Fig. 1, that is, an image in which the color of the meadow area is changed, and is the next frame of the current frame. That is, FIG. 5 shows the next frame in which the hue corresponding to the green region in FIG. 4 is changed.

The above-described technical features may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, the present invention has been described with reference to particular embodiments, such as specific elements, and specific embodiments and drawings. However, it should be understood that the present invention is not limited to the above- And various modifications and changes may be made thereto by those skilled in the art to which the present invention pertains. Accordingly, the spirit of the present invention should not be construed as being limited to the embodiments described, and all of the equivalents or equivalents of the claims, as well as the following claims, belong to the scope of the present invention .

Claims (11)

In a video editing method,
Receiving a first stroke for an editing area and a second stroke for a non-editing area in a current frame of the moving picture;
Generating first color information on a color included in an area of the current frame selected in accordance with the first and second strokes, respectively; And
Selecting the editing area and the non-editing area in the next frame of the current frame using the first color information,
Wherein the step of selecting the editing area and the non-
Comparing the color of the next frame with the first color information to determine whether a new color of the next frame is equal to or greater than a predetermined degree of similarity;
Updating the first color information by reflecting the new color and generating second color information according to the determination result; And
Selecting the editing area and the non-editing area using the second color information,
Wherein the first stroke and the second stroke are strokes in the form of a line instead of a closed curve
How to edit a movie.
delete The method according to claim 1,
The first color information
Color information generated in YCbCr space
How to edit a movie.
delete The method according to claim 1,
Wherein the step of selecting the editing area and the non-
In the next frame, an area of a color included in the area of the current frame selected in accordance with the first stroke is selected as the editing area
How to edit a movie.
delete delete delete delete delete A video editing apparatus comprising:
An interface for receiving a first stroke for an editing area and a second stroke for a non-editing area in a current frame of the moving picture;
An information generating unit for generating first color information on a color included in an area of the current frame selected according to the first and second strokes; And
And an area selection unit for selecting an editing area and a non-editing area in the next frame of the current frame using the first color information and the second color information,
The region selection unit
The first color information is updated by comparing the color of the next frame with the first color information to determine whether a new color of the next frame is equal to or greater than a predetermined similarity degree, And generating the second color information, selecting the editing area and the non-editing area using the second color information,
Wherein the first stroke and the second stroke are strokes in the form of a line instead of a closed curve
Video editing device.

Images