KR20150044585A - Method for rendering image and Image outputting device thereof - Google Patents

Abstract

The present invention discloses a 3D image rendering method and an image output device thereof. The present 3D screen rendering method includes the steps of: loading a 3D screen; analyzing the loaded 3D screen to generate a rendering map displaying a first area to be rendered by using a first rendering method and a second area to be rendered by using a second rendering method; rendering the first area using the first rendering method and the second area using the second rendering method with the rendering map; and combining the rendering results of the first and second areas to output the combined result as the 3D screen.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-

The present invention relates to a three-dimensional image rendering method and a video output apparatus using the same, and more particularly, to a three-dimensional image rendering method for performing rendering using a plurality of rendering methods by analyzing a three-dimensional image and a video output apparatus using the same will be.

There is a basic rasterization rendering method as a conventional rendering method for generating a three-dimensional image. In order to improve the rendering speed, a performance enhancement technique using dedicated computation of the GPU (Graphic processing unit) is used. Ray tracing rendering methods exist for global illumination rendering as another conventional rendering method for generating three-dimensional images. As another method for generating a three-dimensional image, there is a method of generating a three-dimensional image by applying a separate post-processing to an image area after the rendering process.

However, when rendering a three-dimensional image using a rasterization rendering method, there is a problem that a staircase effect occurs and a realistic three-dimensional image can not be provided. In the case of rendering a three-dimensional image using a ray tracing rendering method, There is a problem that a considerable operation has to be processed for rendering depending on the number of view rays.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and it is an object of the present invention to provide a 3D rendering method capable of dividing a rendering region by analyzing a 3D screen, A video rendering method and a video output apparatus using the same.

According to an aspect of the present invention, there is provided a method of rendering a three-dimensional image, the method comprising: loading a three-dimensional image; analyzing the loaded three- And generating a rendering map representing a second area rendered by the second rendering method; Rendering the first region with the first rendering method using the rendering map and rendering the second region with the second rendering method; And combining the rendering result of the first area and the rendering result of the second area to output the three-dimensional screen.

The first rendering method may be a ray tracing method, and the second rendering method may be a rasterization method.

In addition, the generating may include: projecting an object included in the 3D screen into a two-dimensional space; And determining an area where reflection and refraction exist in the projected two-dimensional screen as the first area and a remaining area of the projected two-dimensional screen as a second area.

The generating may include detecting an edge region and an edge region of a shadow among the projected two-dimensional images using a shadow mapping method; And determining an edge region and a shadow edge region of the detected object as the first region.

The detecting step may divide the two-dimensional image into a plurality of tiles and determine whether the edge areas of the divided tiles are shadow areas or illumination areas to detect edge areas of the shadows. have.

If the corner area of the divided tile includes both the shadow area and the illumination area, the detecting step determines that the edge area of the shadow is included in the tile, In the case of a shadow area or an illumination area, the tile is further divided to judge again whether the corner area of the tiles further divided is a shadow area or an illumination area to judge whether or not the edge area of the shadow is included in the divided tile can do.

In addition, the rendering may render the first area and the second area in parallel using different hardware.

According to another aspect of the present invention, there is provided a video output apparatus including: a loading unit for loading a 3D screen; A rendering map generation unit for generating a rendering map representing a first area rendered by the first rendering method and a second area rendered by the second rendering method by analyzing the loaded three-dimensional screen; A rendering unit rendering the first area using the rendering map in the first rendering method and rendering the second area in the second rendering scheme; A synthesizer for synthesizing a rendering result of the first area and a rendering result of the second area to generate a three-dimensional screen; And an output unit outputting the combined three-dimensional image.

The first rendering method may be a ray tracing method, and the second rendering method may be a rasterization method.

The rendering map generator may project an object included in the three-dimensional screen into a two-dimensional space, determine an area where reflection and refraction exist in the projected two-dimensional screen as the first area, The remaining area of the two-dimensional screen can be determined as the second area.

The rendering map generator detects an edge area and an edge area of an object of the projected two-dimensional screen using a shadow mapping method, and detects an edge area of the object and an edge area of the shadow using the first Area can be determined.

The rendering map generation unit may divide the two-dimensional image into a plurality of tiles and determine whether the edge areas of the divided tiles are shadow areas or illumination areas to detect edge areas of the shadows. have.

If the edge area of the divided tile includes both the shadow area and the illumination area, the rendering map generator determines that the edge area of the shadow is included in the tile, and if the edge area of the divided tile is all In the case of a shadow area or an illumination area, the tile is further divided to judge again whether the corner area of the tiles further divided is a shadow area or an illumination area to judge whether or not the edge area of the shadow is included in the divided tile can do.

The rendering unit may include a first rendering unit that performs rendering of the first area and a second rendering unit that performs rendering of the second area, and the first rendering unit and the second rendering unit may be parallel So that the 3D image can be rendered.

According to various embodiments of the present invention as described above, it is possible to reproduce realistic image characteristics by combining a plurality of rendering methods, and greatly reduce the amount of calculation accordingly. This contributes to the reduction of the memory bandwidth required and further reduces the consumption current, making it easier to apply in future mobile environments.

1 is a block diagram showing a configuration of a video output apparatus according to an embodiment of the present invention;
FIG. 2 is a diagram for explaining a method for searching shadow edge regions according to an embodiment of the present invention; FIG.
FIG. 3 illustrates a rendering map representing a rendering method, according to an embodiment of the present invention; FIG.
4A is a diagram illustrating a result of rendering a three-dimensional image using a conventional ray tracing rendering method,
FIG. 4B is a diagram illustrating a result of rendering a three-dimensional image using a plurality of rendering methods according to an exemplary embodiment of the present invention;
5 is a flowchart illustrating a 3D image rendering method according to an exemplary embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings. 1 is a block diagram showing a configuration of a video output apparatus 100 according to an embodiment of the present invention. 1, the video output apparatus 100 includes a loading unit 110, a rendering map generating unit 120, a rendering unit 130, a composing unit 140, and an output unit 150. The image output apparatus 100 according to an exemplary embodiment of the present invention may be a smart phone. However, the image output apparatus 100 may be implemented by various image output apparatuses such as a tablet PC, a notebook PC, a desktop PC, a PDA, .

The loading unit 110 loads data on the input three-dimensional image. At this time, the three-dimensional screen may be a pre-stored background screen, but it may be another three-dimensional screen only as an example. For example, the three-dimensional screen may be a three-dimensional image received from an external device, such as a server.

The rendering map generation unit 120 analyzes the loaded three-dimensional screen and generates a rendering map indicating a different rendering method for each area. Specifically, the rendering map generation unit 120 may generate a rendering map representing a first area rendered by the first rendering method and a second area rendered by the second rendering method.

In this case, the first rendering method may be a ray tracing rendering method, and the second rendering method may be a rasterization rendering method. In the ray tracing rendering method, a path of light is calculated for each pixel of a screen, and a brightness of a pixel is used to generate a screen. The advantage of the ray tracing rendering method is that it can produce a clean and natural image, and the disadvantage is that it requires extensive computation. The rasterization rendering method converts a vector or contour data into a corresponding pixel pattern image to generate a screen. The advantage of the rasterization rendering method is that it may be possible to perform a fast rendering operation, and the disadvantage is that it is impossible to express realistic light, and an unnatural rendering result such as a staircase effect can be output.

More specifically, the rendering map generation unit 120 projects an object included in the three-dimensional screen into a two-dimensional space. Then, the rendering map generation unit 120 determines a region in which the reflection and refraction exist in the projected two-dimensional screen as a first region to be rendered by the ray tracing rendering method, and the remaining region of the projected two- It can be determined as the second area in which the rendering is performed by the rasterization rendering method.

In addition, when the object edge region or the shadow edge region is rendered by the rasterization rendering method even if the reflection and refraction regions are not present, there is a problem that a stairing effect occurs in the edge region. Accordingly, the rendering map generation unit 120 detects an edge area of an object and an edge area of a shadow among the projected two-dimensional screen using a shadow mapping method, and detects an edge area and an edge area of the shadow, Area can be determined.

In this case, when the edge is searched by the shadow mapping method, since it is necessary to perform inspection for the rendering resolution, there is a problem that the inspection time is required to be large in the high resolution image. Accordingly, the rendering map generation unit 120 can search the shadow edge area using the tile structure. This will be described with reference to FIG.

First, the rendering map generation unit 120 divides the entire image into a plurality of tiles. At this time, the plurality of tiles may be in a rectangular shape including at least one pixel.

The rendering map generation unit 120 determines whether all the corner areas of the divided tiles are an illumination area or a shadow area.

2 (c) and FIG. 2 (d)), when a different kind of area is included in the corner area of the tile, that is, when the illumination area and the shadow area are mixed in the corner area of the tile, It can be judged that the edge region of the shadow is included in the tile.

However, as shown in FIG. 2A, if the corner areas of the tile are all the illumination areas or the edge areas of the tiles are all the shadow areas, as shown in FIG. 2B), the rendering map generator 120 ) May further divide the tiles to determine whether the corner areas of the additional sub tiles are in the illumination area or the shadow area.

If the edge areas of the sub tiles further divided are all the illumination areas as shown in a) of Fig. 2, or both are shadow areas as shown in b) of Fig. 2, the rendering map generation part 120 It can be determined that the edge region of the shadow is not included in the tile.

However, as shown in FIGS. 2 e) to 2 h), when a different kind of area is included in the corner area of the additional subtitle tile, that is, when the shadow area and the lighting area The rendering map generation unit 120 can determine that the edge region of the shadow is included in the tile.

In the embodiment described with reference to FIG. 2, the determination of the edge region of the shadow is described. However, the edge region of the object may be detected by the method as shown in FIG.

1, if it is determined that the edge region of the shadow or the edge region of the object is included in the tile, the rendering map generation unit 120 generates a tile including an edge region of the shadow or an edge region of the object It can be determined as the first area.

Through the above-described method, the rendering map generation unit 120 can generate a rendering map divided into a first area and a second area. For example, as shown in FIG. 3, the rendering map generation unit 120 may generate a rendering map including a first area classified into gray and a second area divided into black.

The area classification of the generated rendering map is determined according to the detail level of the rendering map, and the resolution of the area can be determined in units of tiles or pixels according to the resolution of the rendering map.

The rendering unit 130 renders the three-dimensional image into a different rendering method for each region using the rendering map generated by the rendering map generation unit 120.

In particular, as shown in FIG. 1, the rendering unit 130 may include a first rendering unit 131 for rendering a first area and a second rendering unit 133 for rendering a second area . In this case, the first rendering unit 131 may render a first area using a ray tracing rendering method, which is a first rendering method, and the second rendering unit 132 may perform a rendering operation using a second rendering method The rendering operation can be performed using the rasterization rendering method. That is, the rendering unit 130 may perform the rendering operation in parallel using the different hardware in the first area and the second area. For example, the first rendering unit 131 may perform a rendering operation of the first area using a graphic processing unit or a hardware dedicated to ray tracing rendering using a ray tracing rendering method, and the second rendering unit 131 May render a second area with a rasterization rendering scheme to a central processing unit or other graphics processing unit.

At this time, the rendering unit 130 may match the formula of the rasterization shading scheme with the formula of the ray tracing shading scheme, so that the region difference may not be displayed even if the rendering result is synthesized in two ways.

The composing unit 140 may synthesize the results rendered by the two rendering methods to generate a three-dimensional screen. Specifically, the rendering result for the first area rendered by the first rendering unit 131 is output to the memory on the frame buffer (framebuffer), and the rendering for the second area rendered by the second rendering unit 133 When the result is output to the memory on the frame buffer, the composing unit 140 may synthesize the rendering result for the first area and the rendering result for the second area to generate a three-dimensional image.

The synthesis unit 140 can use an operation specific to the frame buffer for efficient synthesis and can perform a post-processing operation on the final generated three-dimensional screen, if necessary.

The output unit 150 outputs the synthesized three-dimensional image. At this time, the output unit 150 may be implemented as an output device such as a display, but it may be implemented in a printing device such as a printer, and the like only as an example.

As described above, by performing the rendering operation using the ray tracing rendering method and the rasterization rendering method for each region, the image output apparatus 100 can render the realistic three-dimensional image at an earlier time.

In particular, FIG. 4A is a view showing a result of rendering a three-dimensional screen by a conventional ray-tracing rendering method, FIG. 4B is a view illustrating a result of rendering a three-dimensional screen by a plurality of rendering methods according to an embodiment of the present invention FIG. Referring to FIGS. 4A and 4B, even when a three-dimensional image is output using a plurality of rendering methods as in the present invention, quality similar to a result of rendering a three-dimensional image using only a ray tracing rendering method can be provided, It is possible to perform a rendering operation faster than a 3D scene rendering using only a ray tracing rendering method.

In addition, when rendered with the rasterization rendering method, it is possible to eliminate the staircase phenomenon that may occur at the edge of the shadow or at the edge of the object.

Hereinafter, a three-dimensional image rendering method of the image output apparatus 100 will be described with reference to FIG.

5 is a flowchart illustrating a 3D image rendering method according to an exemplary embodiment of the present invention.

First, the video output apparatus 100 loads a three-dimensional screen (S510). At this time, the image output apparatus 100 can load data of a previously stored three-dimensional image as a background image, but it is only an embodiment and can load a three-dimensional image received from the outside.

Then, the video output apparatus 100 analyzes the three-dimensional screen to generate a rendering map (S520). Specifically, the video output apparatus 100 may generate a rendering map representing a first area rendered by the first rendering method and a second area rendered by the second rendering method by analyzing the 3D screen. In this case, the first rendering method may be a ray tracing rendering method, and the second rendering method may be a rasterization rendering method. Particularly, the image output apparatus 100 can determine a first area as an area including refraction and reflection, an edge area of an object and an edge area of a shadow as a second area, and generate a rendering map have. The specific method of generating the rendering map has been described with reference to FIG. 1 to FIG. 3, and a duplicate description will be omitted.

Then, the video output apparatus 100 performs a rendering operation by a different rendering method for each region using the rendering map (S530). Specifically, the video output apparatus 100 may render the first region of the three-dimensional image by the first rendering method, and render the second region of the three-dimensional image by the second rendering method. At this time, the video output apparatus 100 may render the first region and the second region of the three-dimensional image in parallel using different hardware.

Then, the video output apparatus 100 synthesizes the rendering results (S540). Specifically, the image output apparatus 100 may combine the rendering result of the first region of the three-dimensional image and the rendering result of the second region of the three-dimensional image.

Then, the video output apparatus 100 outputs the synthesized three-dimensional screen (S550). At this time, the video output apparatus 100 can output a three-dimensional screen using a video display device such as a display, and output a three-dimensional screen using a video printing apparatus such as a printer.

With the above-described three-dimensional image rendering method, the image output apparatus 100 can combine a plurality of rendering methods to reproduce realistic image characteristics, and greatly reduce a calculation amount for a rendering operation. It also contributes to the reduction of memory bandwidth and further reduces the consumption current, making it easier to apply in future mobile environments. In addition, a plurality of hardware may render the first area and the second area in parallel, thereby rendering the rendering operation at a higher speed than the conventional sequential rendering method. In addition, when a rendering operation is performed using the rasterization rendering method, it is possible to eliminate a staircase phenomenon that may occur.

In addition, the 3D image rendering method according to various embodiments described above may be implemented as a program and provided to a display device.

Specifically, the method includes: loading a three-dimensional screen; Analyzing the loaded three-dimensional screen to generate a rendering map representing a first area rendered by the first rendering method and a second area rendered by the second rendering method; Rendering the first region with the first rendering method using the rendering map and rendering the second region with the second rendering method; A non-transitory computer readable medium storing a program including a rendering result of the first area and a rendering result of the second area to output the three-dimensional screen.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

110: loading unit 120: map generating unit
130: rendering unit 140: synthesizing unit
150:

Claims (14)

Loading a three-dimensional screen;
Analyzing the loaded three-dimensional screen to generate a rendering map representing a first area rendered by the first rendering method and a second area rendered by the second rendering method;
Rendering the first region with the first rendering method using the rendering map and rendering the second region with the second rendering method;
And outputting the three-dimensional image by combining the rendering result of the first area and the rendering result of the second area. The method according to claim 1,
The first rendering method is a ray tracing method,
Wherein the second rendering method is a rasterization method. 3. The method of claim 2,
Wherein the generating comprises:
Projecting an object included in the three-dimensional screen into a two-dimensional space; And
Determining a region where reflection and refraction exist in the projected two-dimensional image as the first region, and determining a remaining region of the projected two-dimensional image as a second region. The method of claim 3,
Wherein the generating comprises:
Detecting an edge region of an object and an edge region of a shadow among the projected two-dimensional screen using a shadow mapping method; And
And determining an edge region and a shadow edge region of the detected object as the first region. 5. The method of claim 4,
Wherein the detecting comprises:
Dimensional image is divided into a plurality of tiles and an edge area of a shadow is detected by determining whether all the corner areas of the divided tiles are a shadow area or an illumination area, . 6. The method of claim 5,
Wherein the detecting comprises:
If the corner area of the divided tile includes both the shadow area and the illumination area, it is determined that the edge area of the shadow is included in the tile, and if the edge area of the divided tile is the shadow area or the illumination area, And determining whether or not the edge region of the tile further divided is the shadow region or the illumination region to determine whether the edge region of the shadow is included in the divided tile. Rendering method. The method according to claim 1,
Wherein the rendering comprises:
Wherein the first region and the second region are rendered in parallel using different hardware. A loading unit for loading a three-dimensional screen;
A rendering map generation unit for generating a rendering map representing a first area rendered by the first rendering method and a second area rendered by the second rendering method by analyzing the loaded three-dimensional screen;
A rendering unit rendering the first area using the rendering map in the first rendering method and rendering the second area in the second rendering scheme;
A synthesizer for synthesizing a rendering result of the first area and a rendering result of the second area to generate a three-dimensional screen; And
And an output unit for outputting the synthesized three-dimensional image. 9. The method of claim 8,
The first rendering method is a ray tracing method,
Wherein the second rendering method is a rasterization method. 10. The method of claim 9,
The rendering map generation unit may generate,
Dimensional space, the method comprising the steps of: projecting an object included in the three-dimensional screen into a two-dimensional space; determining an area where reflection and refraction exist in the projected two-dimensional screen as the first area; 2 region. ≪ / RTI > 11. The method of claim 10,
The rendering map generation unit may generate,
An edge area of an object and an edge area of a shadow among the projected two-dimensional screen are detected using a shadow mapping method and an edge area of the detected object and an edge area of a shadow are determined as the first area. Video output device. 12. The method of claim 11,
The rendering map generation unit may generate,
Wherein the edge detecting unit detects the edge region of the shadow by dividing the two-dimensional image into a plurality of tiles and determining whether all the edge regions of the divided tiles are shadow regions or illumination regions. 13. The method of claim 12,
The rendering map generation unit may generate,
If the corner area of the divided tile includes both the shadow area and the illumination area, it is determined that the edge area of the shadow is included in the tile, and if the edge area of the divided tile is the shadow area or the illumination area, Further comprising determining whether an edge area of a tile further divided by the tile is included in a shadow area or an illumination area to determine whether the edge area of the shadow is included in the divided tile, . 9. The method of claim 8,
The rendering unit may include:
A first rendering unit that performs rendering on the first area, and a second rendering unit that performs rendering on the second area,
Wherein the first rendering unit and the second rendering unit render a three-dimensional image in parallel.

Images