KR101388668B1 - Conversion device for two dimensional image to three dimensional image, method thereof and recordable medium storing the method - Google Patents

Abstract

The present invention relates to an image converting apparatus and method for converting a 2D image into a 3D image, and a recording medium thereof. The image converting apparatus according to the present invention extracts object information for extracting information of a selected object from a 2D image. part; A user input unit which receives depth information by moving the position of the selected two-dimensional object in the Z-axis direction; A grid setting unit for displaying a position having the same value in the Z-axis direction in a grid; And displaying the two-dimensional image in a three-dimensional space and controlling the grid setting unit to display a grid in the Z-axis direction of the two-dimensional image. When the object is moved in the Z-axis direction through the user input unit, the object is And an image controller configured to recognize depth information of the object based on the located grid. This allows the user to input depth information by arranging the selected objects in the two-dimensional image in the three-dimensional space, and display a grid representing the same position in the Z-axis direction of the three-dimensional space to provide an intuitive working environment for the user. It can be provided for easy editing, and detailed editing results can be obtained regardless of the user's skill.

Description

Image converting apparatus and method for converting two-dimensional image into three-dimensional image and recording medium therefor {CONVERSION DEVICE FOR TWO

The present invention relates to an image converting apparatus and method for converting a 2D image into a 3D image and a recording medium thereof. More particularly, the present invention relates to an object of a 2D image in order to convert a 2D image into a 3D image. If you want to input the depth information, you can input the depth information by arranging the selected object in the two-dimensional image in the three-dimensional space, and by displaying a grid representing the same position in the Z-axis direction of the three-dimensional space, An image conversion apparatus and method for converting two-dimensional images into three-dimensional images, which provides an intuitive working environment for easy editing and obtains detailed editing results regardless of the user's skill and the recording medium thereof. It is about.

As interest in 3D stereoscopic images increases, various methods for generating stereoscopic images are being developed. Among the methods of generating a stereoscopic image, there is a method of converting a two-dimensional video image into a three-dimensional stereoscopic image. When a two-dimensional video image is converted into a three-dimensional image, it is possible to utilize the already-created video content, and it is possible to obtain a three-dimensional image without using a separate photographing device.

In order to convert a 2D plane image into a 3D stereoscopic image, it is necessary to generate a left image and a right image having different parallax information from a 2D plane image. Thus, depth map is generated by giving depth information to objects displayed on the 2D plane image, and a left and right image are generated based on the depth map to generate a 2D plane image. It is converted to 3D stereoscopic image. As a result, the quality of the 3D stereoscopic image is highly dependent on the accuracy of the depth map.

Meanwhile, a depth map may be generated by calculating pixel values of a 2D image or measuring a motion vector to automatically generate a depth map, and by directly inputting depth information of a 2D object. There is a manual creation method.

The automatic generation method has the advantage of reducing the work speed, but there are technical limitations in generating high quality 3D stereoscopic images.

On the other hand, in the case of the manual generation method, it is possible to generate a relatively high quality 3D stereoscopic image, but there is a problem that the work time or the quality of the result may vary greatly according to the skill of the operator.

Korean Patent Publication No. 2011-0099526 A method of converting a plane image into a stereoscopic image

The present invention has been made to solve the above-described problems, the present invention relates to an image conversion apparatus and method for converting a two-dimensional image to a three-dimensional image, and a recording medium thereof, and more particularly to the two-dimensional image 3 When the user wants to input the depth information to the object of the 2D image to convert it to the 2D image, the object selected in the 2D image is arranged in the 3D space so that the depth information can be input and the Z axis direction of the 3D space Displays a grid that represents the same depth, and provides a intuitive working environment for the user to easily edit and obtain a detailed edit result regardless of the user's skill. To provide an image converting apparatus and method for converting the same, and a recording medium therefor, The.

According to an aspect of the present invention for achieving the above object, an object information extraction unit for extracting information of a selected object in a two-dimensional image; A user input unit which receives depth information by moving the position of the selected two-dimensional object in the Z-axis direction; A grid setting unit for displaying a position having the same value in the Z-axis direction in a grid; And displaying the two-dimensional image in a three-dimensional space and controlling the grid setting unit to display a grid in the Z-axis direction of the two-dimensional image. When the object is moved in the Z-axis direction through the user input unit, the object is Provided is an image conversion apparatus including an image control unit recognizing depth information of the object based on a located grid.

Here, the grid setting unit, the grid interval setting unit for adjusting the grid spacing; A graphic setting unit for graphic setting of the grid; And an activation and deactivation setting unit for setting whether to display the grid.

The apparatus may further include a depth map generator configured to generate a depth map based on the depth information.

In addition, a three-dimensional image is generated based on the depth map and generates a three-dimensional image by generating a left image and a right image having different disparity information and combining a left image and a right image having different disparity information. The image rendering unit may further include.

The apparatus may further include a depth information recognizing unit recognizing depth information of the object based on a Z axis value of the object.

On the other hand, according to another aspect of the present invention for achieving the above object, the step of displaying a two-dimensional image input for three-dimensional transformation in a three-dimensional space; Displaying a grid representing the same depth value in the Z-axis direction of the 2D image according to a user's selection; Moving and displaying a position of the selected two-dimensional object in a Z-axis direction according to the user's selection; And extracting information of the selected object from the 2D image and recognizing depth information of the object based on a grid in which the object is located.

The method may further include setting at least one of whether the grid is displayed, a grid interval, and a graphic setting of the grid.

The method may further include generating a depth map based on the recognized depth information.

The method may further include generating a left image and a right image having different parallax information with respect to the 2D image based on the depth map; The method may further include generating a 3D image by combining the left image and the right image.

The method may further include recognizing depth information of the object based on a Z axis value of the object.

On the other hand, according to another aspect of the present invention for achieving the above object, displaying a two-dimensional image input for the three-dimensional transformation in a three-dimensional space; Displaying a grid representing the same depth value in the Z-axis direction of the 2D image according to a user's selection; Moving and displaying a position of the selected two-dimensional object in a Z-axis direction according to the user's selection; And extracting information of the selected object from the two-dimensional image, and recognizing depth information of the object based on a grid on which the object is located. Medium is provided.

As described above, an apparatus and method for converting a 2D image into a 3D image according to the present invention and a recording medium thereof include a depth of a user's depth in an object of the 2D image in order to convert the 2D image into a 3D image. In order to input information, the object selected in the 2D image is arranged in a 3D space so that depth information can be input, thereby providing an intuitive work environment and easily editing.

In addition, by displaying a grid showing the same position in the Z-axis direction of the three-dimensional space, it is possible to obtain a detailed edit result regardless of the skill of the user performing the editing operation, the quality of the converted three-dimensional image There is an effect to improve.

1 is a control block diagram of an image conversion apparatus for converting a 2D image into a 3D image according to an embodiment of the present invention;
2 is a control block diagram of the grid setting unit of FIG. 1;
3 is a flowchart of an image conversion method for converting a 2D image into a 3D image according to an embodiment of the present invention;
4 is a display state diagram of a work screen of an image conversion apparatus according to an embodiment of the present invention;
5 is a working state diagram of an image conversion apparatus according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description with reference to the accompanying drawings, the same or corresponding components will be denoted by the same reference numerals, and redundant description thereof will be omitted.

1 is a control block diagram of an image conversion apparatus 100 for converting a 2D image into a 3D image according to an exemplary embodiment of the present invention. The image conversion apparatus 100 according to an embodiment of the present invention provides a graphic interface for a user to set depth information on an input 2D image, and generates a depth map according to the user's input. Model dimensional images.

As shown in FIG. 1, the image conversion apparatus 100 according to the present invention may include an image control unit 110, a 3D image rendering unit 120, a user input unit 130, a display unit 140, and an object information extraction unit ( 150, a depth information recognizing unit 160, a depth map generating unit 170, and a grid setting unit 200.

The object information extracting unit 150 receives information of an object to which depth information is provided in the input 2D image. The object information may include identification information, xy coordinates, etc. of the object selected in the 2D image. In a 2D image, an object may be automatically selected by the user by directly selecting the area or by using image recognition functions such as edge detection technology, or may be selected in parallel with automatic and manual operations.

The display 140 displays a series of work processes, input results, processing results, etc. for inputting depth information for converting the input 2D image and the image to the user. The display 140 displays the input two-dimensional image on the xy plane and displays grids with a predetermined interval in the Z-axis direction.

The user input unit 130 provides a user interface for selecting and controlling a function of the image conversion apparatus and transmits a user input to the image control unit 110. The user may input depth information by selecting a predetermined object in the 2D image through the user input unit 130. The user can input the Z value of the object, that is, depth information, by selecting the object with the mouse cursor and moving it to a desired position.

The depth information recognizing unit 160 extracts depth information of the corresponding object according to the Z value of the object. The selected object in the two-dimensional image is positioned at a predetermined Z point in the three-dimensional space according to the user's selection. The depth information recognizing unit 160 may recognize depth information of the corresponding object by using the Z value of the object.

The depth map generator 170 generates a depth map based on the depth information of the object input by the user.

The grid setting unit 200 displays a grid displaying points having the same Z value in the Z-axis direction of the three-dimensional space displayed on the display unit 140. Thus, when the user selects a specific object and moves the object in the Z-axis direction to input depth information, the user can accurately set the position of the object to be moved by checking the depth of each object through the grid. . For example, if you want to set the same depth to more than one object, you can arrange each object on the same grid line.

The 3D image rendering unit 120 converts the input 2D image into a 3D image by using a depth map generated by the depth map generator 170. The 3D image rendering unit 120 generates a left image and a right image having different disparity information by using a depth map, and combines the left image and the right image having different disparity information to generate a 3D image. Create

The image control unit 110 selects a specific object with respect to the 2D image input to the image conversion apparatus 100 and moves the object in the Z-axis direction to input depth information in the same depth area in the Z-axis direction. The grid setting unit 200 is controlled to display a grid that displays. When the arrangement of the objects is completed according to the user's selection, the image controller 110 uses the object information extractor 150, the depth information recognizer 160, and the depth map generator 170 to determine the depth map of the 2D image. Create a depth map.

The image controller 110 generates a 3D image by controlling the 3D image rendering unit 120 using the generated depth map and displays the 3D image on the display 140.

Meanwhile, when the depth information is set in the object of the 2D image, the grid setting unit 200 displaying the grid in the Z-axis direction in the 3D space may be configured as shown in FIG. 2.

2 is a control block diagram of the grid setting unit 200 according to an embodiment of the present invention, and includes a grid interval setting unit 210, a graphic setting unit 220, and an activation / deactivation setting unit 230.

The grid interval setting unit 210 may set the interval of the grid displayed in the three-dimensional space according to the user's selection. The user can adjust the grid spacing so that the grid spacing is displayed wide or narrow depending on the size of the object to be edited or the arrangement of the objects.

The graphic setting unit 220 may change graphic settings such as color, thickness, line type, etc. of the grid displayed in the 3D space according to a user's selection. The user may adjust the graphic setting to display the grid more clearly according to the color of the image to be edited, the color of each individual object, or the position of the objects.

 The activation / deactivation setting unit 230 may display or hide the grid according to the user's selection.

According to this configuration, the user can select and use the intervals, graphics, activation of the grid, etc. according to the characteristics of the 2D image being worked on and personal preferences. Accordingly, the user can easily perform an editing operation for providing depth information to the 2D image.

3 is a flowchart of an image conversion method for converting a 2D image into a 3D image according to an exemplary embodiment of the present invention.

When the 2D image is input to the image conversion apparatus 100 (S110), the image controller 110 displays the 2D image on the XY plane of the 3D space and controls the grid setting unit 200 to control the grid in the Z axis direction. To display (S120).

The object information extracting unit 150 extracts and stores the information of the selected object from the 2D image (S130). In this case, the object may be directly selected by the user through the user input unit 130 or automatically selected by a method such as edge detection, or may be selected in parallel with automatic and manual techniques.

The user inputs depth information by moving the position of the object through the user input unit 130. The depth information extractor 150 detects object information of the corresponding object based on the grid in which the object is located (S140).

The depth map generator 170 generates a depth map of the input 2D image based on the detected depth information (S150).

The 3D image rendering unit 120 receives a depth map under the control of the image controller 110 and converts the 2D image into a 3D image (S160). The 3D image rendering unit 120 generates a left image and a right image having different disparity information by using a depth map, and combines the left image and the right image having different disparity information to generate a 3D image. Can be generated.

As described above, when the user selects a specific object and moves the object in the Z-axis direction to input depth information, the present invention enables to check the depth of each object through the grid. Thus, the user can easily and accurately set the position of the object to be moved and obtain a detailed depth map regardless of the user's skill.

The above-described method may further include displaying a two-dimensional image input for three-dimensional transformation in a three-dimensional space, displaying a grid having the same depth value in the Z-axis direction of the two-dimensional image according to a user's selection, Moving and displaying the location of the 2D object in the Z-axis direction according to a user's selection, extracting information of the selected object from the 2D image, and recognizing depth information of the object based on a grid in which the object is located; An image conversion method control method may be provided in the form of a recording medium recorded by a program and readable by the electronic device.

The operation of the image conversion apparatus 100 according to an embodiment of the present invention will be described with reference to FIGS. 4 and 5. 4 is a state diagram of a work screen of the image conversion apparatus 100 according to an exemplary embodiment of the present invention, and FIG. 5 is a state diagram of the image conversion apparatus 100 of FIG. 4.

As shown in FIG. 4 and FIG. 5, the display 140 displays a two-dimensional image on the xy plane and displays grids with a predetermined interval in the Z-axis direction.

The user can select the object A in the 2D image and move it in the Z-axis direction to the position of the object B. Accordingly, the object B has the depth information Z '.

On the other hand, when the object C is selected in the 2D image and the depth information is to be set for the user, the user can easily set the depth information using the grid.

If the object C is to be set to have the same depth as the object A, the user may move the object C on the same grid as the object depth information Z '.

Similarly, when setting the depth of the object C to be larger or smaller than the object A, detailed editing is possible by moving the object C up or down Z 'based on Z'.

As described above, when a user wants to input depth information into an object of a 2D image in order to convert the 2D image into a 3D image, the depth information may be input by arranging objects selected in the 2D image in 3D space. This provides an intuitive working environment for easy editing.

In addition, by displaying a grid showing the same position in the Z-axis direction of the three-dimensional space, it is possible to obtain a detailed edit result regardless of the skill of the user performing the editing operation, the quality of the converted three-dimensional image Can improve.

Thus, those skilled in the art will appreciate that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the embodiments described above are to be considered in all respects only as illustrative and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

According to the present invention, when a user wants to input depth information into an object of a 2D image in order to convert a 2D image into a 3D image, the object selected from the 2D image may be arranged in a 3D space to input depth information. In addition, by displaying a grid showing the same depth in the Z-axis direction of the three-dimensional space, it provides an intuitive working environment for the user to easily edit and obtain detailed editing results regardless of the user's skill. The present invention can be used to provide an image converting apparatus and method for converting a 2D image into a 3D image and a recording medium thereof.

100: image conversion apparatus 110: image control unit
120: 3D image rendering unit 130: user input unit
140: display unit 150: object information extraction unit
160: depth information recognition unit 170: depth map generation unit
200: grid setting unit 210: grid interval setting unit
220: graphic setting unit 230: enable / disable setting unit

Claims (11)

An object information extracting unit extracting information of the selected object from the 2D image;
A user input unit which receives depth information by moving the position of the selected two-dimensional object in the Z-axis direction;
A grid setting unit for displaying a position having the same value in the Z-axis direction in a grid; And
The grid setting unit is controlled to display the 2D image in a 3D space and to display a grid in the Z axis direction of the 2D image. When the object is moved in the Z axis direction through the user input unit, the object is located. An image control unit recognizing depth information of the object based on a grid;
The grid setting unit,
A grid spacing setting unit for adjusting grid spacing;
A graphic setting unit for graphic setting of the grid; And
And an activation and deactivation setting unit configured to set whether to display the grid.
delete The method of claim 1,
And a depth map generator configured to generate a depth map based on the depth information. The method of claim 3,
3D image rendering for generating a 3D image by generating a left image and a right image having different disparity information with respect to the 2D image based on the depth map, and combining a left image and a right image having different disparity information The video conversion device further comprises a unit. The method of claim 1,
And a depth information recognizing unit recognizing depth information of the object based on a Z axis value of the object. Displaying a two-dimensional image input for three-dimensional conversion in a three-dimensional space;
Displaying a grid representing the same depth value in the Z-axis direction of the 2D image according to a user's selection;
Moving and displaying a position of the selected two-dimensional object in a Z-axis direction according to the user's selection; And
Extracting information of the selected object from the 2D image and recognizing depth information of the object based on a grid in which the object is located;
And setting at least one of whether the grid is displayed, a grid interval, and a graphic setting of the grid.
delete The method according to claim 6,
And generating a depth map based on the recognized depth information. 9. The method of claim 8,
Generating a left image and a right image having different parallax information with respect to the 2D image based on the depth map;
And combining the left image and the right image to generate a 3D image. The method according to claim 6,
And recognizing depth information of the object based on a Z axis value of the object. Displaying a two-dimensional image input for three-dimensional transformation in a three-dimensional space; Displaying a grid representing the same depth value in the Z-axis direction of the 2D image according to a user's selection; Moving and displaying a position of the selected two-dimensional object in a Z-axis direction according to the user's selection; And extracting information of the selected object from the 2D image and recognizing depth information of the object based on a grid on which the object is located, and setting the visibility of the grid, grid spacing, and graphic setting of the grid. The recording medium further comprising the step of receiving at least one of the image recording method recorded by the program and readable by the electronic device.

Images