KR101157049B1 - 3d image manufacturing method and system - Google Patents

Abstract

The present invention relates to a three-dimensional image production method,
In the 3D image production method for converting a 2D digital image into a 3D digital image,
You can set a specific area consisting of circles or ellipses in the plane frame of 2D digital image.
Is the first step,
Converting the set area to have a value of (x, y, z) to create a (x, y, z) digital image frame having a positive feeling;
a third step of acquiring a new left eye digital image frame and a right eye digital image frame by photographing with two left eye computer cameras and a right eye computer camera having binocular disparity in the (x, y, z) digital video frame;
Then, if there is a protruding effect, magnification correction is performed according to the viewing angle, and the fourth step of acquiring the final (x, y, z) left eye and right eye digital image frames;
If there is the retraction effect, reduction correction is performed, and thereafter, a fifth step of acquiring the final (x, y, z) left and right digital image frames;
And a control unit.

Description

3D IMAGE MANUFACTURING SYSTEM {3D IMAGE MANUFACTURING METHOD AND SYSTEM}

The present invention relates to a three-dimensional image production system, and more particularly, to correct spatial distortion and reduction of spatial depth and three-dimensional effect generated according to viewing angles and correction of image distortion caused by granting and three-dimensional spatial depth and stereoscopic feeling in two-dimensional digital images. It relates to a three-dimensional digital image production system.

First, a description will be given of the spatial depth and three-dimensional volume when converting a 2D image to a 3D image.

Currently, two methods are mainly used to make two-dimensional digital images into three-dimensional digital images. The first method is to arrange the frames of the 2D digital image sequentially into the left eye image and the right eye image (see FIG. 1) .The first frame of the 2D digital image is the first frame of the left eye image and the second of the 2D digital image. The frame is arranged as frame 1 of the right eye image, frame 3 of the 2D digital image, frame 2 of the left eye image, and frame 4 of the 2D digital image. Such a structure has a disadvantage in that stereoscopicization is difficult when the object of the 2D digital image is stationary or the movement becomes more than a certain speed (see FIG. 2).

The second method is to arrange one frame of the 2D digital image into the left eye image and the right eye image, and there is a method in which the left eye image frame and the right eye image frame are binocular parallax for each frame (see FIG. 3). There is a disadvantage that the three-dimensional sense (especially three-dimensional volume) does not appear because it is only moved by parallax (see FIG. 4), and even though the moving object is separated into graphics by arranging the separated object by binocular parallax, Since the image itself divided into graphics is 2D and the object image disposed in the left eye image or the object image disposed in the right eye image is the same image (see FIG. 5), it is difficult to form a three-dimensional volume.

Synthesizing 3D modeled data on a graphically separated object image and rendering it as a left and right eye image is almost identical to the method of mapping 3D modeling to 3D modeling using computer graphics from the beginning. Since only the source data for mapping uses 2D graphics separated from 2D images, there is no difference from making 3D images through the existing manual process, and thus there is an economic disadvantage that the time and cost are not greatly reduced.

The fundamental reason for this drawback is that when a three-dimensional object is photographed with the left eye camera and the right eye camera, the image frame photographed by the left eye camera and the image frame photographed by the right eye camera are one object due to different angles of the stereoscopic images. In this case, the object photographed on the left eye image is different from the object photographed on the right eye image (see FIG. 6) .As a result of this difference, a stereoscopic sense of closeness to reality can be felt.However, when two left eye images are created with two-dimensional images, the left eye image is essentially Since the information such as the shape and color of the screen image of the screen and the right eye image is inevitably the same (see FIG. 7), two binocular disparity is secured even if two images with binocular disparity are secured, namely, a left eye image and a right eye image. It is fundamentally different from the amount of feeling felt in the images taken by the two cameras. Therefore, the images taken by two cameras can secure a feeling similar to the reality, but even if the two-dimensional image taken by one camera is converted to the image having two binocular disparities, the three-dimensional image taken by two cameras There was a problem that such a feeling can not be secured.

An object of the present invention has been proposed to improve the problems in the prior art as described above,

To provide a three-dimensional image production method and system that can give a spatial depth and three-dimensional volume when converting a two-dimensional digital image to a three-dimensional digital image.

Still another object of the present invention is to provide a system for correcting the protrusion and retraction effects generated according to the positional arrangement of the left eye image and the right eye image, and distortion of the reduced image and the enlarged image.

It is still another object of the present invention to provide an expansion system according to a reduction in depth and three-dimensional feelings generated according to a viewing angle formed between a display on which a 3D digital image is projected and a viewing position.

In the three-dimensional image production system for converting a two-dimensional digital image to a three-dimensional digital image according to a preferred embodiment of the present invention for achieving the above object,

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

CPU to control the whole device,

3D conversion program storage unit for converting the 2D image to 3D under the control of the CPU,

General video input device for inputting general video,

A display device for displaying an image according to an image output request signal through an input / output device;

Left-eye image input device for recording (x, y, z) digital video frame to make left-eye image,

Right-eye image input device to shoot (x, y, z) digital video frame to make right-eye image,

And a storage device for storing the left eye image and the right eye image, respectively.

The 3D conversion program storage unit

Judgment retraction effect determination processing unit for processing distortion correction by judging whether the protrusion retraction effect,

Formula 1 distortion correction that corrects distortion with automatic conversion by applying Formula 1 to the set area,

Formula 2 distortion correction for correcting distortion by automatic conversion by applying Formula 2 to the set area, and

Provided is a three-dimensional image production system comprising a 3D image expansion unit for extending a 3D image.

Preferably, the formula 1 distortion correction intersects the (x, y, z) region in the region with the (x, y, z) value according to the change of the angle intersecting in the (x, y, z) digital image frame. It is characterized by correcting the distortion by automatic conversion by applying the expansion formula in proportion to the angle.

Also preferably,

Equation 2 distortion correction is characterized by correcting the distortion by the automatic conversion to reduce the overall size of the left eye digital image frame and the right eye digital image frame in the same proportion in proportion to the placement interval.

As described above, according to the three-dimensional image production system according to the present invention, the two-dimensional digital image is given a spatial depth and three-dimensional feeling close to the three-dimensional digital image taken by two cameras secured binocular disparity, protrude and retreat It has the effect of correcting the distortion generated from the effect and minimizing the reduction of the stereoscopic effect generated according to the viewing angle, and at the same time, it is possible to produce a 3D digital image conversion at low cost in a short time.

1 to 7 are diagrams showing embodiments of a method of making a 2D digital image into a 3D digital image according to the prior art.
8 is a diagram schematically illustrating a technique applied to a 3D image production method according to the present invention.
9 is a view showing a viewing angle between the stereoscopic screen and the eye of the viewer.
10 to 12 are diagrams showing an example of a digital image frame having a sense of feeling in the three-dimensional image production method according to the present invention.
FIG. 13 is a diagram illustrating a process of acquiring a left eye and right eye digital image frame in a method of manufacturing a 3D image according to the present invention.
14 is a view showing a process of converting a digital image frame into a semi-cylindrical method in the three-dimensional image production method according to the present invention.
FIG. 15 is a diagram illustrating a process of obtaining a coordinate region of an object for each frame in the method of manufacturing a 3D image according to the present invention.
16 is a view showing an example of the configuration of a three-dimensional image production system applied to the three-dimensional image production method according to the present invention.
17 is a process diagram of a three-dimensional transformation program sequentially showing an example of a process of the three-dimensional image production method according to the present invention.

Hereinafter, a method and system for manufacturing a 3D image according to the present invention will be described in detail with reference to the accompanying drawings.

The present invention provides spatial depth and three-dimensional impression when converting a two-dimensional digital image into a three-dimensional digital image, and protrudes and retracts effects generated according to the positional arrangement of the left and right eye images, and the reduced and enlarged images generated accordingly. It is a technology that compensates for the reduction of spatial depth and three-dimensional impression according to the distortion correction of the image and the viewing angle generated between the size of the medium on which the 3D image is projected and the viewer's vision.

Hereinafter, image distortion correction according to positions of the left eye image and the right eye image will be described.

When the left and right eye images are intersected, the left and right eye images are reduced and protruded while crossing the left and right eye images. 8).

Accordingly, when extrude and retreat, the size of the object image of each frame of the existing 2D digital image and the image of the object when converted into the 3D digital image are different.

Correction of the reduction of stereoscopic effect according to the viewing angle generated between the size of the medium on which the 3D image is projected and the viewer's vision

In the case of a 3D digital image, the stereoscopic feeling is well felt in a certain viewing angle range depending on the angle between the eye of the viewer and the stereoscopic screen or the stereoscopic display, that is, the viewing angle (see FIG. 9) according to the stereoscopic screen or the stereoscopic display size. In general, stereoscopic consulates have a seating angle of 20 ° ± 10 ° viewing angle, the general viewing angle of the viewer is 16 ° ± 5 ° for TV, and about 13 ° ± 4 ° for mobile screen. If it becomes smaller, the depth and stereoscopic feelings are relatively inferior. Therefore, when converting and producing a 3D digital image mounted on a medium with a small viewing angle, the depth and stereoscopic feelings must be expanded to feel a certain level of depth and stereoscopic feelings.

When converting a 2D digital image into a 3D digital image, the spatial depth and three-dimensional volume

① From the plane frame of 2D digital image with only (x, y) value to be converted into 3D digital image, it is a circle or ellipse set to give a visual or three-dimensional effect based on the main object located in the center, that is, actor or object. Set zones,

(X, y, z) Digital image frame in which the set area is transformed to have a value of (x, y, z) so that the object, that is, the main actor or the objects, protrudes and has a positive feeling (see FIGS. 10 to 12). After making

③ Place two left-eye computer cameras and right-eye computer cameras with binocular disparity in the (x, y, z) digital video frame and shoot them with both computer cameras to obtain a new left-eye digital video frame and right-eye digital video frame (Fig. 13).

Protruding and retracting effects caused by the positional arrangement of the left eye digital video frame and the right eye digital video frame, and distortion correction methods for the reduced and enlarged images.

④ Expand in proportion to the angle crossing the (x, y, z) region in the region with (x, y, z) value according to the change of the angle crossing in the (x, y, z) digital video frame ( Equation 1 )and

⑤ Place two left-eye computer cameras and right-eye computer cameras with binocular disparity in the extended (x, y, z) digital video frame, and shoot with both computer cameras to acquire new left-eye digital video frame and right-eye digital video frame.

⑥ The area with (x, y, z) in the left eye digital video frame and the right eye digital video frame is proportional to the intersection angle between the left eye digital video frame and the right eye digital video frame. Expand the (x, y, z) region proportionally.

The arrangement of the left eye digital video frame and the right eye digital video frame that do not intersect extends as the distance increases.

⑦ Reduce the overall size of the left eye digital video frame and the right eye digital video frame by the same ratio in proportion to the placement interval ( Equation 2 ).

As an extension method by reducing the depth and three-dimensional feelings generated by the viewing angle formed between the display where the 3D digital image is projected and the viewing position.

⑧ Convert the (x, y, z) digital video frame into a semi-cylindrical shape (see Fig. 14)

⑨ Place two left-eye computer cameras and right-eye computer cameras with binocular disparity and shoot with both computer cameras to create a new left-eye digital video frame and a right-eye digital video frame.

처리 In the process of the section from the frame where the same object of the basic digital image (x, y) starts to the frame where the object ends, the section ① finds the number of the start frame and the last frame and the position coordinate value of the object of the start frame. Find the difference between x and y of the position coordinate value of the object of the last frame and divide it by the number of frames to obtain the (x, y) area of the object for each frame (see Fig. 15). Obtain the (x, y, z) value by calculating z value, and repeat the process of ② ~ ⑨ to find the left eye digital video frame and right eye digital video frame for each section.

The formula applied in FIG. 15 is as follows.

Object moving section (x, y) S = object1 (x, y)-object N (x, y)

Frame number S = object N frame order-object1 frame order

Object moving distance per frame L = Object moving range (x, y) S / number of frames S

Application system configuration is as shown in FIG. Referring to FIG. 16, the 3D image production system includes a CPU 10 for controlling the apparatus as a whole.

3D conversion program storage unit 20 for converting 2D video to 3D under the control of the CPU (10),

General video input device 30 for inputting a general video,

A display device 40 for displaying an image according to an image output request signal through an input / output device (not shown),

Left eye image input device 72 for photographing a (x, y, z) digital image frame to make a left eye image,

Right eye image input device (74) for photographing (x, y, z) digital video frames to make a right eye image,

And a storage device 50 for storing the images captured by the left eye image input device 72 and the right eye image input device 74 in the left eye image unit 52 and the right eye image unit 54, respectively.

The 3D conversion program storage unit 20

Judgment retraction effect determination processing unit 21 for processing the distortion correction by determining whether the protrusion retraction effect,

It is proportional to the angle crossing the (x, y, z) area in the area with (x, y, z) value according to the change of the angle intersecting the formula 1 ((x, y, z) digital video frame in the set area. Equation 1 distortion correction (22) to correct the distortion by automatic conversion by applying the expansion ( Equation 1 )

Equation 2 distortion correction that corrects distortion by automatic conversion by applying Formula 2 ( Equation 2 ) to reduce the overall size of the left eye digital video frame and the right eye digital video frame by the same ratio in the set area. 23), and

3D image expansion unit 24, which extends the 3D image.

On the other hand, Formula 1 performed by the formula 1 distortion correction (22) is

As the expansion ratio formula, the following process is applied, and the expansion ratio according to the crossing rate is applied to Table 1.

Crossing distance A = x position value of (x, y, z) digital left image frame object-x position value of (x, y, z) digital right image frame object

Screen width B = (x, y, z) digital video frame + cross distance A

Crossing rate C% = (intersection distance A / width B) x 100

% Crossover Magnification  1%-up to 3%  10/9 3%-up to 5%  10/8 5%-up to 8%  10/7 8%-up to 10%  10/6 over 10  10/5

On the other hand, the formula 2 performed by the formula 2 distortion correction 23 is

As the expansion ratio formula, the following process is applied, and the reduction ratio according to the crossing rate is applied in Table 2.

Intersection distance A = x position value of (x, y, z) digital right image frame object-x position value of (x, y, z) digital left eye image frame object

Screen width B = (x, y, z) digital video frame + cross distance A

Crossing rate C% = (intersection distance A / width B) x 100

% Crossover Reduction  1%-up to 3%  9/10 3%-up to 5%  8/10 5%-up to 8%  7/10 8%-up to 10%  7/10 over 10  5/10

Referring to FIG. 17,

When converting a 2D digital image into a 3D digital image, the spatial depth and three-dimensional volume

In the plane frame of 2D digital image with only (x, y) value to be converted to 3D digital image, it is composed of circle or ellipse set to give a visual or three-dimensional effect based on the main object located in the center, that is, actor or object. Set the area (S2, S4),

Subsequently, non-linear transformation is performed on the set area to have a value of (x, y, z) to create a (x, y, z) digital image frame (S6) in which objects in the corresponding area, that is, the main actors or objects, are protruding. after

Then, two left-eye computer cameras and a right-eye computer camera having binocular disparity are placed on the (x, y, z) digital video frame and photographed with both computer cameras to acquire a new left-eye digital video frame and a right-eye digital video frame ( S8, S10).

Then, if there is a protrusion effect (S12), the enlarged correction according to the viewing angle is performed (S13), and the final (x, y, z) left and right eye digital image frames are obtained (S16).

If there is no protrusion effect in step S12, it is determined whether there is a retraction effect in step S14. If there is a retraction effect in step S14, reduction correction is performed (S15), and then the final (x, y, z) left and right eye digital image frames are acquired (S16).

Thereafter, the last frame in which the specific object is located in the basic digital image (x, y) is set (S18).

Subsequently, the set area formula (Formula 1 and Formula 2 described above) is applied to obtain the final (x, y, z) left and right eye digital image interval frames by automatic conversion (S20).

If it is the end of the basic digital image (x, y) (S22) ends.

10: CPU
20: 3D conversion program storage unit
21: judging retraction effect determination processing unit
22: Formula 1 Distortion Compensation
23: Formula 2 Distortion Compensation
24: 3D image expansion unit
30: general video input device
40: display device
50: storage
72: left eye image input device (camera)
74: right eye image input device (camera)

Claims (9)

delete delete delete delete delete delete In the three-dimensional image production system for converting a two-dimensional digital image into a three-dimensional digital image,
CPU to control the whole device,
3D conversion program storage unit for converting the 2D image to 3D under the control of the CPU,
General video input device for inputting general video,
A display device for displaying an image according to an image output request signal through an input / output device;
Left-eye image input device for recording (x, y, z) digital video frame to make left-eye image,
Right-eye image input device to shoot (x, y, z) digital video frame to make right-eye image,
And a storage device for storing the left eye image input unit and the right eye image input unit, respectively, to store images captured by the left eye image unit and the right eye image unit, respectively.
The 3D conversion program storage unit
Judgment retraction effect determination processing unit for processing distortion correction by judging whether the protrusion retraction effect,
Formula 1 distortion correction that corrects distortion with automatic conversion by applying Formula 1 to the set area,
Formula 2 distortion correction for correcting distortion by automatic conversion by applying Formula 2 to the set area, and
Characterized in that it comprises a 3D image expansion unit for extending the 3D image,

Formula 1 is
Crossing distance A = x position value of (x, y, z) digital left image frame object-x position value of (x, y, z) digital right image frame object
Screen width B = (x, y, z) digital video frame + cross distance A
Crossing rate C% = (intersection distance A / width B) x 100 % Crossover Magnification 1%-up to 3% 10/9 3%-up to 5% 10/8 5%-8% 10/7 8%-up to 10% 10/6 over 10 10/5


Formula 2 is
Intersection distance A = x position value of (x, y, z) digital right image frame object-x position value of (x, y, z) digital left eye image frame object
Screen width B = (x, y, z) digital video frame + cross distance A
Crossing rate C% = (intersection distance A / width B) x 100 % Crossover Reduction 1%-up to 3% 9/10 3%-up to 5% 8/10 5%-8% 7/10 8%-up to 10% 7/10 over 10 5/10

3D image production system, characterized in that. The method of claim 7, wherein
Equation 1 distortion correction is proportional to the angle crossing the (x, y, z) region in the (x, y, z) region according to the change of the angle crossing in the (x, y, z) digital image frame. 3D image production system, characterized in that to correct the distortion by automatic conversion by applying an extended formula. The method of claim 7, wherein
Equation 2 distortion correction unit is characterized in that for correcting the distortion by the automatic conversion to reduce the overall size of the left eye digital image frame and the right eye digital image frame in proportion to the batch interval.

Images