KR20140003741A - Method for manufacturing 3d contents and apparatus for thereof - Google Patents

Abstract

The present invention relates to a method and an apparatus for producing three-dimensional content. The method for producing three-dimensional content according to the present invention comprises the following steps of: receiving user selection for content about object and background sources provided by a source DB and providing the selected content on a screen; disposing a virtual reference camera which photographs the content and a virtual-viewpoint object corresponding to the viewpoint of the reference camera on the screen; receiving decisions about locations of the reference camera and viewpoint object; placing multiple auxiliary cameras having the same viewpoint on both sides of the reference camera; and producing three-dimensional content by rendering images photographed by the reference camera and auxiliary cameras. According to the method and apparatus for producing three-dimensional content, a non-expert can easily produce glass-free three-dimensional content, which is lively and whose quality is greater than a certain level, by including the steps of: setting locations of a reference camera and a viewpoint related to an object; automatically placing multiple auxiliary cameras having the same viewpoint on both sides of the reference camera; and rendering images photographed by each camera.

Description

Method and apparatus for producing stereoscopic content

The present invention relates to a method and apparatus for producing stereoscopic contents, and more particularly, to a method and apparatus for producing stereoscopic contents, which enables a general user to easily produce 3D stereoscopic content with a certain degree of vivid auto glasses.

In general, three-dimensional image technology refers to a technology that reproduces a two-dimensional plane image with a feeling similar to a three-dimensional three-dimensional image to make it appear to be in a three-dimensional space. This stereoscopic image is fundamentally based on the fact that humans have two eyes.

Currently, 3D content authoring technology is usefully used to author stereoscopic images. In the binocular method of 3D content authoring technology, an object is created in a three-dimensional virtual space to author content, and then two left and right screens are set by combining two virtual cameras and each camera, and the display device is synthesized. High speed output through the user can feel a three-dimensional effect through special glasses.

Glasses-free 3D content authoring does not require the wearing of special equipment such as glasses. The auto glasses method authors contents by considering at least eight or more multiple cameras, viewpoints, distances to objects, and the like, and then outputs them on a 3D display device by synthesizing multiple screens, and at a predetermined interval on the front of the display device. A special barrier (ex, Parallax Barrier, and Lenticular Lens) in which fine screens are arranged is attached. Is disclosed in.

Such stereoscopic content reproduction related technologies are being continuously developed and commercialized by each institution and company. While the production of binocular 3D stereoscopic movies is particularly active in the field of video industry, the spread of various glasses-free 3D stereoscopic contents that can maximize the advantages of 3D images is insufficient.

In addition, there are a variety of binocular and autostereoscopic 3D stereoscopic content display output technologies, but 3D stereoscopic content authoring software and system for general users are very lacking, and in particular, there are no autonomous 3D stereoscopic content authoring tools. It is true.

In the case of existing stereoscopic content authoring tools, from the viewpoint of general users who do not have much experience in authoring, the authoring method is complicated and requires professional learning, and there is a problem that a long authoring time is required for each content authoring.

That is, in the past, a single image creation and editing authoring tool (ex, Photoshop, Illustrator) and a 3D object authoring tool (ex, 3ds Max, You need to create and edit objects and cameras using Maya. In addition, the output generated from each authoring tool is a complex process of final synthesis and editing through video editing tools (ex, Premiere, Vegas) to complete the production of 3D stereoscopic content.

Accordingly, 3D stereoscopic content authoring system incorporating authoring support technologies such as related graphics, camera, motion, sound, and video output, so that non-professional users can easily create and utilize live glasses-free 3D stereoscopic contents with a certain quality or higher. Multi-camera setup skills are required.

It is an object of the present invention to provide a method and apparatus for producing stereoscopic contents, which enables a general user to easily produce stereoscopic images.

The present invention provides a method of selecting a content related to an object and a background source provided by a source DB from a user and providing the selected content on a screen, a virtual reference camera for capturing the content, and a viewpoint position of the reference camera. Arranging virtual viewpoints corresponding to the screens, receiving a position of the reference camera and a position of the viewpoint, and a plurality of auxiliary cameras having the same viewpoint as the reference camera. And arranging the left and right directions in the left and right directions, and rendering the captured images by the reference camera and the auxiliary cameras to produce stereoscopic content.

Here, in the step of setting the position of the viewpoint, the position of the viewpoint may be set such that the viewpoint of the reference camera is located in front of or behind the object.

The stereoscopic content producing method may further include setting a distance between the reference camera and a plurality of cameras including the auxiliary camera after arranging the plurality of auxiliary cameras in the left and right directions of the reference camera. can do.

The setting of the interval between the cameras may include displaying the images captured by the plurality of cameras on the screen as a split screen, and then setting the interval value between the plurality of cameras in pixel units. Stereoscopic content rendered in correspondence with the may be provided on the screen.

The 3D content production method may further include adjusting a distance between the reference camera and a plurality of cameras including the auxiliary camera in consideration of the resolution and size of the screen.

The present invention provides a content providing unit which selects content related to an object and a background source provided from a source DB from a user and provides the selected content on a screen, a virtual reference camera for photographing the content, and the reference camera. A placement unit for arranging virtual viewpoints corresponding to the viewpoint locations of the cameras, a positioning unit configured to set the position of the reference camera and the position of the viewpoint, and a plurality of views having the same viewpoint as the reference camera; Provided is a three-dimensional content production apparatus including a camera array for arranging auxiliary cameras in the left and right directions of the reference camera, and a rendering unit for rendering three-dimensional content by rendering the captured images by the reference camera and the auxiliary cameras.

Here, the position setting unit may receive the position of the viewpoint so that the viewpoint of the reference camera is located in front of or behind the object.

The apparatus for producing stereoscopic content may further include an interval setting unit configured to set an interval between a plurality of cameras including the reference camera and the auxiliary camera.

Here, the interval setting unit displays the images captured by the plurality of cameras on the screen as a split screen, and then receives an interval value between the plurality of cameras in pixel units, and is rendered corresponding to the set interval. Stereoscopic content may be provided on the screen.

The stereoscopic content production method may further include a gap controller configured to adjust a gap between the reference camera and a plurality of cameras including the auxiliary camera in consideration of the resolution and size of the screen.

According to the method and apparatus for producing 3D content according to the present invention, a process of setting a position of a reference camera and a viewpoint to an object, a process of automatically arranging a plurality of auxiliary cameras having the same viewpoint as the reference camera to the left and right of the reference camera, and Including the rendering process of the captured images of each camera, even the general user can easily produce live glasses-free 3D stereoscopic content with a certain quality or more.

1 is a block diagram of an apparatus for producing stereoscopic content according to an embodiment of the present invention.
2 is a flowchart of a method of producing stereoscopic content using FIG. 1.
3 is a screen configuration diagram illustrating the step S210 of FIG.
4 is a screen configuration diagram illustrating the steps S220 to S230 of FIG. 2.
5 is a screen configuration diagram illustrating the step S240 of FIG.
6 is a conceptual diagram of stereoscopic content completed according to FIG. 2.
7 and 8 are screen configuration diagrams illustrating an operation S250 of FIG. 2.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention.

1 is a block diagram of an apparatus for producing stereoscopic content according to an embodiment of the present invention. The stereoscopic content producing apparatus 100 includes a content providing unit 110, a placement unit 120, a positioning unit 130, a camera arranging unit 140, an interval setting unit 150, an interval adjusting unit 160, The renderer 170 includes a source DB 180.

The content providing unit 110 is a part for selecting content related to an object and a background source provided from the source DB 180 from a user and providing the selected content on a screen.

The placement unit 120 arranges a virtual reference camera for capturing the content and a virtual viewpoint object corresponding to the viewpoint position of the reference camera, respectively, on the screen. In this embodiment, the virtual viewpoint is using a flag model.

The position setting unit 130 is a portion for receiving the position of the reference camera and the position of the viewpoint from the user. Here, the position of the viewpoint object is adjusted such that the viewpoint of the reference camera is located in front of or behind the object.

The camera arranging unit 140 arranges a plurality of auxiliary cameras having the same viewpoint as the reference camera in a straight line in the left and right directions of the reference camera, respectively.

The interval setting unit 150 receives a distance between a reference camera and a plurality of cameras including auxiliary cameras from a user.

The gap adjusting unit 160 automatically adjusts a gap between the reference camera and a plurality of cameras including the auxiliary cameras in consideration of the resolution and size of the screen.

The renderer 170 renders 3D content by rendering captured images of the reference camera and the auxiliary cameras.

2 is a flowchart of a method of producing stereoscopic content using FIG. 1. Hereinafter, a method for producing stereoscopic content according to an embodiment of the present invention will be described in detail.

First, the content providing unit 110 receives a content related to an object provided from the source DB 180 and a background source from a user, and provides the selected content on the screen (S210). This step S210 corresponds to a process of creating and modifying objects and background source resources to be expressed in three dimensions.

3 is a screen configuration diagram illustrating the step S210 of FIG. In step S210, the content providing unit 110 receives a source such as a target object (eg, person) and a background to be expressed in three dimensions from the object list L provided by the source DB 180, from the user, and displays the source on the screen. Create

In addition, the content providing unit 110 includes an object correction unit 20 that enables modification of an object by receiving detailed modifications such as sizes, positions, and rotations of the objects. The content provided in the step S210 can be arranged and edited in the screen center 10. In addition, the menus at the top of the screen can be used to control effects such as motion, sound, frames, and shadows, and to configure cameras for 3D stereoscopic visualization.

That is, after the step S210, the virtual reference camera for capturing the content and the virtual viewpoint corresponding to the position of the target point of the reference camera are respectively disposed on the screen by the placement unit 120. Provided by (S220). In the present embodiment, a virtual camera and a virtual viewpoint may be disposed and manipulated so that a general user may easily author stereoscopic content.

4 is a screen configuration diagram illustrating the steps S220 to S230 of FIG. 2. The virtual reference camera 30 and the virtual viewpoint 40 are represented by a camera and a flag model in the center of the screen, respectively.

After the step S220, the position setting unit 130 receives the position of the reference camera 30 and the position of the viewpoint object 40 from the user (S230). For example, in FIG. 4, the position of the reference camera 30 or the position of the viewpoint 40 may be set through a mouse operation, or may be set through information input (eg, coordinate input) on the setting menu 50. have. In step S230, the individual positions of the reference camera 30 and the viewpoint 40 may be finely adjusted.

In FIG. 4, the guide line of the reference camera 30 represented by a yellow line means a screen currently photographed by the reference camera 30, that is, a screen of content to be rendered. The existing timeline-based camera setting function works while only looking at the final content screen to be rendered, but in the present embodiment, editing is performed by visualizing not only the rendering target screen but also the camera 30 and the viewpoint 40 of the camera by coordinates. Free In addition, in this embodiment, the position movement path point of the camera can be displayed as a list of details, the movement path can be edited through partial selection, and the camera movement time can be set and previewed.

When the position of the viewpoint object 40 is set in step S230, the position of the viewpoint object 40 may be set such that the viewpoint of the reference camera 30 is located in front of or behind the object. This makes it possible to adjust the three-dimensional feeling and the sense of distance by placing the camera's viewpoint in front of or behind the object with respect to the reference camera. For example, as shown in FIG. 4, when the viewpoint portion of the reference camera, which is the position of the viewpoint 40, is located behind the object, that is, the position of the person, the three-dimensional appearance may be emphasized to make the person appear more protruding forward. On the contrary, when the camera's point of view is in front of the object, the three-dimensional effect may be emphasized so that a person may go further behind.

Thereafter, the camera arrangement unit 140 collectively arranges the plurality of auxiliary cameras 60 having the same viewpoint as the reference camera 30 in parallel in the left and right directions of the reference camera 30, respectively (S240).

5 is a screen configuration diagram illustrating the step S240 of FIG. That is, in step S240, four auxiliary cameras 60 are automatically generated on the left and right sides of the reference camera 30 facing the object from the center. The viewpoints of the auxiliary cameras 60 coincide with the reference camera 30. In the automatic arrangement of the camera 60, the distance between the cameras may be arranged within 6 cm, which is the binocular parallax spacing of the general person.

Next, an interval between a plurality of cameras including the reference camera 30 and the auxiliary cameras 60 is set (S250). According to the distance between such cameras, stereoscopic sensitivity can be adjusted.

Thereafter, the rendering unit 170 renders captured images by the plurality of cameras to produce stereoscopic content (S260). In the rendering process, the quality of stereoscopic content is inspected by examining the degree of superposition and composition of images captured by a plurality of cameras, and the interval adjustment between the cameras is repeated, and the depth of the object and the background depth of the target object to be expressed in stereoscopic form. Optimize the senses and remove afterimages.

6 is a conceptual diagram of stereoscopic content completed according to FIG. 2. 6 is a drawing produced to help understand the principle of stereoscopic content completed through autostereoscopic 3D stereoscopic content authoring and multiple camera arrangement and setting according to an embodiment of the present invention. It can be seen that the human character placed in front of the red flag-shaped camera point of view is more prominent and expressed in three-dimensional sense.

Hereinafter, a process of setting an interval between cameras for producing stereoscopic content will be described.

The interval setting unit 150 displays images captured by the plurality of cameras (ex, nine) as a plurality of divided screens (ex, nine divided screens) on the screen to confirm the viewpoint of each camera. When the distance value between the plurality of cameras is set (input) in units of pixels through a separate input window from the user, the rendered stereoscopic content corresponding to the set interval is provided in the form of a preview (preview) on the screen. . Accordingly, the rendering result according to the camera spacing can be checked immediately.

In addition, in the present embodiment, in step S250, the positional relationship between the camera (particularly, the reference camera) and the viewpoint may be collectively adjusted in units of pixels through a separate input window in addition to the distance between the cameras. This may be included in the configuration of the interval setting unit. Here, when the distance between the camera point of view and the target object is increased or the distance between each camera is increased, stereoscopic sensitivity is increased but eye fatigue and dizziness may increase depending on the degree.

7 and 8 are screen configuration diagrams illustrating an operation S250 of FIG. 2. First, FIG. 7 is a content rendering screen in which screens photographed from the viewpoints of nine cameras are reduced and arranged.

In the present embodiment, a multi-view split preview function is possible in which a conversion result can be confirmed in advance without having to go through a video file conversion operation that takes a long time as in the conventional art.

In this regard, FIG. 8 is a rendered preview screen of the split screen according to FIG. 7, which shows two rendering results when the cameras have the same viewpoint but different distances between the cameras. Looking at the two results synthesized by the rendering, it can be seen that the afterimage is more severe than the right content in the left three-dimensional content.

That is, in the present embodiment, through the multi-view split preview, the intervals of the nine cameras can be simultaneously adjusted in units of pixels using the arrow up and down buttons on the keyboard to check the result in advance.

In addition, the present embodiment may automatically adjust the distance between the plurality of cameras in consideration of the resolution and size of the screen. This uses the spacing adjuster 160. That is, the distance between cameras may be automatically adjusted according to the size or resolution of the display device (ex, monitor) on which the 3D stereoscopic content is to be reproduced, and the position of the camera viewpoint may be automatically adjusted in proportion to the camera interval.

The final output 3D content rendering video can be checked directly on the display device that can watch 3D stereoscopic content without glasses.In order to support Full HD resolution, the rendering screen of the content is 1920 pixels horizontally and 9080 pixels vertically. High resolution output is possible.

According to the present invention as described above, the process of setting the position of the reference camera and the viewpoint to the object, the process of automatically arranging a plurality of auxiliary cameras having the same viewpoint as the reference camera to the left and right of the reference camera and the captured image of each camera Including the rendering process, the general user can also easily create a vivid glasses-free 3D stereoscopic content of a certain quality or more. In addition, the present invention can easily control the three-dimensional and depth (distance) with respect to the three-dimensional content by adjusting the distance between the camera and the positional relationship of the viewpoint to the object.

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

100: stereoscopic content production device
110: content providing unit 120: deployment unit
130: position setting unit 140: camera arrangement unit
150: gap setting unit 160: gap adjusting unit
170: renderer 180: source DB

Claims (10)

Selecting contents related to an object and a background source provided from a source DB from a user and providing the selected contents on a screen;
Disposing a virtual reference camera for capturing the content and a virtual viewpoint corresponding to the viewpoint position of the reference camera, respectively on the screen;
Receiving a position of the reference camera and a position of the viewpoint object;
Arranging a plurality of auxiliary cameras having the same viewpoint as the reference camera in left and right directions of the reference camera; And
And producing stereoscopic content by rendering captured images of the reference camera and the auxiliary cameras. The method according to claim 1,
Receiving the position of the viewpoint is set,
3. The method of claim 3, wherein the viewpoint object is set such that the viewpoint of the reference camera is located in front of or behind the object. The method according to claim 1,
After arranging the plurality of auxiliary cameras in the left and right directions of the reference camera, respectively,
And setting a gap between the reference camera and a plurality of cameras including the auxiliary camera. The method according to claim 3,
The step of setting the interval between the cameras,
When the images captured by the plurality of cameras are displayed on the screen as a split screen, and the interval value between the plurality of cameras is set in pixel units, stereoscopic content rendered in correspondence to the set interval is displayed on the screen. Providing stereoscopic content production method. The method according to claim 1,
And adjusting a distance between the reference camera and a plurality of cameras including the auxiliary camera in consideration of the resolution and the size of the screen. A content providing unit which selects content related to an object and a background source provided from a source DB from a user and provides the selected content on a screen;
A disposition unit for disposing a virtual reference camera photographing the contents and a virtual viewpoint object corresponding to a viewpoint position of the reference camera;
A position setting unit configured to receive a position of the reference camera and a position of the viewpoint object;
A camera arrangement unit for arranging a plurality of auxiliary cameras having the same viewpoint as the reference camera in the left and right directions of the reference camera; And
And a rendering unit configured to render stereoscopic images by rendering the captured images of the reference camera and the auxiliary cameras. The method of claim 6,
Wherein the position setting unit comprises:
And a stereoscopic content producing device configured to set the position of the viewpoint such that the viewpoint of the reference camera is located in front of or behind the object. The method of claim 6,
And a gap setting unit configured to receive a gap between the reference camera and a plurality of cameras including the auxiliary camera. The method according to claim 8,
The interval setting unit,
When the images captured by the plurality of cameras are displayed on the screen as a split screen, and the interval value between the plurality of cameras is set in pixel units, stereoscopic content rendered in correspondence to the set interval is displayed on the screen. Providing stereoscopic content production device. The method of claim 6,
And a gap controller configured to adjust a gap between the reference camera and a plurality of cameras including the auxiliary camera in consideration of the resolution and the size of the screen.

Images