KR101819564B1 - System and method for displaying 3d image - Google Patents

Abstract

The present invention relates to a 3D image display system which comprises: a profile information providing unit configured to provide profile information in which hardware features of a 3D image display device are defined; and a 3D image reproducing unit configured to collect the hardware feature information of the 3D image display device from the profile information providing unit and render image content in accordance with the profile information.

Description

TECHNICAL FIELD [0001] The present invention relates to a 3D image display system,

The present invention relates to a 3D image display system and method for automatically providing contents conforming to the hardware characteristics of a 3D image display such as a hyperlink.

With the development of wired / wireless broadband communication technology, demand for high quality realistic video contents is increasing. In the past, 3D TVs using time differences of binoculars were not widely used because of the inconvenience of wearing glasses and lack of contents. The three-dimensional imaging technology proposed as an alternative to solve the problem of such a spectacular three-dimensional display is called an auto-stereoscopic display. That is, the multi-view image capable of expressing the motion parallax is greatly improved in the aspect of the user's convenience in the 3D stereoscopic image representation method which does not require glasses.

Multi-view Three-dimensional display uses a time-multiplexing or a space-multiplexing technique to place a finite number of three-dimensional viewpoint images in space, And provides a three-dimensional image with motion time difference information. Such a no-view multi-view three-dimensional display can use a parallax barrier, a lenticular lens, or a circle light source for the time difference separation.

Among the currently commercialized 3D products, the non-eye-point 3D point-and-point 3D display is designed such that the viewing interval is generally larger than the observer pupil size. However, such multi-view 3D displays can cause fatigue to observers in terms of human factors. In this multi-view 3D display, the observer's feeling of fatigue can be reduced by making the viewpoint interval smaller than the observer pupil size and making the monocular convergence position equal to the binocular convergence position. This new concept of display is called Super-Multi view 3D display. In particular, a multi-view 3D display having a viewpoint interval that is equal to or smaller than a viewpoint interval corresponding to the observer pupil size is also referred to as a high-density multi-view 3D display (HD-MV3D).

Recently, there has been an increase in 3D display of no - eye - point and point - of - view points, and methods for supplying contents that can be used in these devices are required.

However, the multi-viewpoint or multi-viewpoint 3D display differs in the method of rendering the multi-viewpoint image according to the resolution, the number of viewpoints, and the multiplexing method between each viewpoint. Therefore, in the present technology, a 3D scene is formed according to the type, method, and detailed setting of the multi-viewpoint or multi-viewpoint video display of the multi-viewpoint or multi-viewpoint video content, It is difficult to supply and receive multi-point content, and it is also difficult for the user to use multi-point or multi-point content corresponding to the detailed specifications of the multi-point display or multi-point display.

Korean Patent Publication No. 10-2016-0062671 Korean Patent Publication No. 10-2015-0108149

It is an object of the present invention to provide a 3D image display system and method which can easily provide contents for many fragmented multi-viewpoint or multi-viewpoint displays.

According to an aspect of the present invention, there is provided a profile information providing apparatus for providing profile information defining hardware characteristics of a 3D image display apparatus. And a 3D image display unit for collecting hardware property information of the 3D image display device from the profile information providing unit and rendering the image content according to the profile information.

Preferably, the profile information may include a number of horizontal pixels, a number of vertical pixels, a number of viewpoints, and an index map of the 3D image display device. In this case, the index map is viewpoint information arranged in each subpixel of the 3D image display device.

Preferably, the profile information may include a number of horizontal pixels, a number of vertical pixels, a number of viewpoints, a horizontal length, a vertical length, an interval between viewports, and a distance between a display and an observer in the 3D image display device.

Preferably, the 3D image playback unit includes: a rendering context initialization unit that performs initialization required for rendering using the profile information; A renderer and shader setting section; A camera setting unit for setting a camera position of each viewpoint for rendering a scene of each viewpoint represented by the 3D image display; A buffer initialization unit for setting and initializing a buffer for storing a result of rendering an image at each viewpoint used in the shader; A content loading unit for reading the content to be played by the 3D image display; And a rendering unit for rendering the image content.

At this time, the rendering context initialization unit includes setting the number of pixels for rendering an image at each viewpoint. The renderer setting of the renderer and shader setting unit includes adding a light source and setting a viewport.

Preferably, the profile information providing unit is connected to the 3D image display device, and the 3D image reproducing unit is connected to the content provider to receive the image content.

Preferably, the image content is a non-eyeglass multi-view video content or a super multi-view video content.

According to another aspect of the present invention, there is provided a 3D image display device including: a display profile; Initializing a rendering context using the profile information; Setting a renderer and a shader; Setting a camera position of each viewpoint for rendering a scene of each viewpoint number represented by the 3D image display; Setting and initializing a buffer for storing a result of rendering an image at each viewpoint used in the shader; Loading the content to be played by the 3D video display; And rendering the image content.

Preferably, the profile information may include a number of horizontal pixels, a number of vertical pixels, a number of viewpoints, and an index map of the 3D image display device. Here, the index map is viewpoint information arranged in each subpixel of the 3D image display device.

Preferably, the profile information includes a number of horizontal pixels, a number of vertical pixels, a number of viewpoints, a horizontal length, a vertical length, an interval between viewports, and a distance between a display and an observer in the 3D image display device.

Preferably, the initializing of the rendering context includes setting a number of pixels for rendering an image at each viewpoint.

Preferably, the renderer setting of the step of setting the renderer and shader includes adding a light source and setting a viewport.

Preferably, the image content is a non-eyeglass multi-view video content or a super multi-view video content.

According to the present invention, it is possible to easily generate and provide multi-viewpoint or multi-viewpoint 3D contents regardless of various multi-viewpoints or multi-viewpoint displays that are fragmented according to physical characteristics and methods.

Also, there is an effect that a user of a multi-viewpoint or multi-viewpoint image display can easily consume multi-viewpoint or multi-viewpoint image contents without grasping the physical characteristics of the display.

Also, there is an effect that the multi-viewpoint or multi-viewpoint multi-view display method can be reproduced from a single content without specifying the multi-viewpoint or multi-viewpoint image display in one way.

1 is a block diagram of a 3D image display system according to a preferred embodiment of the present invention.
FIG. 2 is a block diagram for explaining the 3D image display system of FIG. 1 more specifically.
3 is an exemplary view of a table including profile information of a 3D image display device.
4 is an illustration of an index map.
5 is an illustration of display profile information.
FIG. 6 is a block diagram for explaining the 3D image reproducing unit shown in FIG. 2 in detail.
7 is a flowchart illustrating a 3D image display method according to a preferred embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will be more apparent from the following detailed description taken in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification. "And / or" include each and every combination of one or more of the mentioned items.

Although the first, second, etc. are used to describe various elements, components and / or sections, it is needless to say that these elements, components and / or sections are not limited by these terms. These terms are only used to distinguish one element, element or section from another element, element or section. Therefore, it goes without saying that the first element, the first element or the first section mentioned below may be the second element, the second element or the second section within the technical spirit of the present invention.

Also, in each step, the identification code (e.g., a, b, c, etc.) is used for convenience of explanation, and the identification code does not describe the order of each step, Unless the order is described, it may happen differently from the stated order. That is, each step may occur in the same order as described, may be performed substantially concurrently, or may be performed in reverse order.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. It is noted that the terms "comprises" and / or "comprising" used in the specification are intended to be inclusive in a manner similar to the components, steps, operations, and / Or additions.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs. Also, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The following terms are defined in consideration of the functions in the embodiments of the present invention, which may vary depending on the intention of the user, the intention or the custom of the operator. Therefore, the definition should be based on the contents throughout this specification.

1 is a block diagram of a 3D image display system according to a preferred embodiment of the present invention.

Referring to FIG. 1, a 3D image display system 130 is connected to a display device 110 and a content provider 120. The display device 110 is a device for displaying a 3D image, and includes a non-eyeglass type multi-viewpoint or multi-viewpoint display device. In addition, the display device 110 may be implemented using a parallax barrier, a lenticular lens, or a circular light source for parallax separation.

The display device 110 provides profile information including the hardware characteristics of the display device 110 to the 3D image display system 130 and provides the profile information including the hardware characteristics of the display device 110 to the multi- And the like.

The content provider 120 provides the content to be displayed through the display device 110 to the 3D image display system 130. Preferably, the content provider 120 can store and manage the content. The content includes a 3D image content in a non-eyeglass mode such as a multi-point or a multi-view point.

The 3D image display system 130 receives a profile from the display device 110 and receives content from the content provider 120, and generates an image suitable for the profile. In addition, the 3D image display system 130 provides the generated image to the display device 110 so that the image is displayed from the display device 110. For example, the 3D image display system 130 may be implemented as a server networked with the display device 110 and the content provider 120, as part of the display device 110, or as a display device 110 Or may be implemented as a device to be attached.

FIG. 2 is a block diagram for explaining the 3D image display system of FIG. 1 more specifically.

Referring to FIG. 2, the 3D image display system 130 may include a profile information providing unit 210 and a 3D image reproducing unit 220.

The profile information providing unit 210 receives profile information including the hardware characteristics of the display device 110 from the display device 110. [ That is, the profile information providing unit 210 may be provided with information on whether the display apparatus 110 corresponds to a multi-viewpoint display apparatus, a multi-view 3D display apparatus, or a general display apparatus.

The 3D image reproducing unit 220 reproduces an image according to the profile information using the content provided from the content provider 120. [ That is, the 3D image reproducing unit 220 collects hardware property information of the 3D image display device from the profile information providing unit 210, and renders the image contents according to the profile information. Here, the 3D image reproducing unit 220 automatically generates the content so that it can be reproduced by any display device regardless of the hardware characteristics of the display device.

More specifically, an example of information included in the hardware profile information of the 3D image display device is shown in FIG. Referring to the table of FIG. 3, profile information in which hardware characteristics of the 3D image display device are defined includes screen width, screen height, number of viewpoints, PhysicalWidth, physicalHeight, an offset between adjacent viewports of the image, a distance between the display and the observer, and an index map. Here, an example of the index map is as shown in Fig. 4, which indicates the time point at which each subpixel is displayed.

In one embodiment, the profile information in which the hardware characteristics of the 3D image display device are defined may include a variable value of an equation obtained by modifying the information of the index map instead of the index map in the table of FIG. 3, Can be as follows.

[Formula] curViewIndex = int (mod (xOffsetAboutScreenCoord * (Fc.s) + cOffsetAboutRGB * float (i) + yOffsetAboutScreenCoord * Fc.t + startViewIndex, viewCount));

The display 110 profile information may be, for example, as shown in FIG. 5, and a combination of FIG. 5 and [Formula] may be substituted for the index map of the display device. The profile of FIG. 5 is an example of a 30 inch, 40 viewpoint, non-eye-hardened, multi-view display.

Specifically, the viewCount in FIG. 5 is the number of viewpoints that can be represented by the second multi-viewpoint display device, and shows an example of 40 viewpoints in the example of FIG.

The monitorResolution in FIG. 5 represents the physical pixel number of the second multi-view display device. An example of FIG. 5 shows an example of 2560 horizontal pixels and 1600 vertical pixels.

The viewOffsetRotate of FIG. 5 represents the array angles of the R, G, and B subpixels used to conserve the reduction in the number of pixels of the image at each viewpoint of the second multi-viewpoint display device. 5 shows an example in which the angle of the array in which the R, G, and B subpixels are formed is expressed in proportion to the distance in the x-axis direction and the distance in the y-axis direction.

The viewFocalLength in FIG. 5 represents the distance of the center of rotation of each view image provided by the second multi-view display device. In the example of Fig. 5, an example in which the distance of the center of rotation is expressed as a reciprocal number is shown.

The xOffsetAboutScreenCoord in FIG. 5 represents a difference in index value between physical adjacent pixels in the horizontal direction indicated by the pixel of the second multi-view display device. In the example of FIG. 5, there is shown an example in which the pixel is expressed by the difference of the index value increasing from left to right.

The yOffsetAboutScreenCoord in Fig. 5 represents the difference in the index value between the physical adjacent pixels indicated by the pixel of the second multi-viewpoint display device. In the example of FIG. 5, there is shown an example in which the pixel is expressed by the difference of the index value increasing as the pixel moves down.

The cOffsetAboutRGB in FIG. 5 represents the difference in index value between the physical subpixels in the horizontal direction indicated by the pixels of the second multi-view display device. In the example of FIG. 5, an example is shown in which the pixel is expressed by the difference of the index value in units of subpixels increasing from left to right.

The startViewIndex in Fig. 5 indicates the start point indicated by the pixel of the second multi-view point display device. FIG. 5 illustrates an example of an index value of a time point represented by the first left subpixel of the super high point display device.

It is possible to substitute the index map of the super multi-point display device by combining the equations in FIG. For example, by combining the equations from the display profile of FIG. 5 to calculate the index values of all physical subpixels of the hypergrowth display device, the same information as the index map of FIG. 4 can be generated.

Thus, the profile information in which the hardware characteristics of the 3D image display device are defined includes at least the number of horizontal pixels, the number of vertical pixels, the number of viewpoints, and the index map in one embodiment, or in at least one embodiment, Number of views, number of viewpoints, width, length, distance between viewpoints, and distance between display and observer.

Next, the 3D image playback unit will be described in detail with reference to FIG. FIG. 6 is a block diagram for explaining the 3D image reproducing unit shown in FIG. 2 in detail.

6, the 3D image reproducing unit includes a rendering context initialization unit 221, a renderer and shader setting unit 222, a camera setting unit 223, a buffer initialization unit 224, a content loading unit 225, Section 226. In this embodiment,

The rendering context initialization unit 221 performs initialization necessary for rendering using information including the number of viewpoints provided in the display profile and the number of horizontal and vertical pixels. The initialization includes setting of the number of pixels for rendering an image at each viewpoint.

The renderer and shader setting unit 222 sets the renderer and the shader. In the renderer settings, add a light source and set the viewport. The viewport uses the resolution (horizontal and vertical pixels) of the screen provided by the display profile, the physical screen size (width, height), and the optimal viewing distance to determine the view angle and distance Setting. The light source addition can add a light source for rendering three-dimensional content in the same manner as a general three-dimensional graphics rendering pipeline. In the shader setting, in addition to the basic shader setting for rendering general three-dimensional content, a multi-point or multi-point shader for multiplexing multi-viewpoint or multi-viewpoint images can be set. The re-point or second re-point shader renders a scene of the number of times represented by the re-point or second re-point display, stores it in the buffer, Set the shader to calculate the information.

The camera setting unit 223 sets the camera position of each viewpoint for rendering a scene of each viewpoint number represented by the multi-viewpoint or multi-viewpoint display.

The buffer initialization unit 224 sets and initializes a buffer for storing the result of rendering the image at each viewpoint used in the multi-viewpoint or multi-viewpoint shader.

The content loading section 225 reads the content to be reproduced from the content provider 120 by the multi-point or multi-point display.

The rendering unit 226 renders the image content.

Hereinafter, a 3D image display method according to a preferred embodiment of the present invention will be described. 7 is a flowchart illustrating a 3D image display method according to a preferred embodiment of the present invention.

For example, referring to FIG. 7, the display profile is read (S710) and a rendering context is initialized (S720).

Next, a renderer and a shader are set (S730). In the renderer settings, add a light source and set the viewport. In the shader setting, in addition to the basic shader setting for rendering general three-dimensional content, a super-multi-point shader for multiplexing the super-multi-view image can be set.

Next, the camera is set (S740). In the camera setting step, the camera position of each viewpoint for rendering a scene of each viewpoint number represented by the super multi-view display is set.

Next, the buffer is initialized (S750). In the buffer initialization step, a buffer for storing a scene rendering result of an image at each viewpoint used in the super-detail point shader is set and initialized.

Next, the content is loaded (S760). In the content loading phase, the 3D display reads the content to be played. Then, rendering is started with the read contents (S770).

The present invention is more effective when applied to a multi-point or multi-multi-point content providing system connected to an Internet service, and in providing contents of a virtual reality service using Internet broadcasting, wired / wireless communication, And is effective in providing contents.

Meanwhile, the information processing method according to an embodiment of the present invention can also be implemented as computer-readable code on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

For example, the computer-readable recording medium includes a ROM, a RAM, a CD-ROM, a magnetic tape, a hard disk, a floppy disk, a removable storage device, a nonvolatile memory, , And optical data storage devices.

In addition, the computer readable recording medium may be distributed and executed in a computer system connected to a computer communication network, and may be stored and executed as a code readable in a distributed manner.

Although a preferred embodiment of a multi-viewpoint or super multi-view image display system and an information processing method capable of easily providing contents for a multi-viewpoint or multi-viewpoint display according to the present invention has been described, It is to be understood that the invention is not limited thereto and that various changes and modifications may be made within the scope of the appended claims, the detailed description of the invention, and the accompanying drawings.

110: display device
120: Content provider
130: 3D image display system
210: Profile information provider
220: 3D image playback unit
221: rendering context initialization unit
222: Renderer and shader setting section
223: Camera setting section
224: buffer initialization unit
225: Content loading section
226:

Claims (16)

A profile information providing unit for providing profile information defining hardware characteristics of the 3D image display device; And
And a 3D image reproducing unit for collecting hardware property information of the 3D image display device from the profile information providing unit and rendering the image content according to the profile information,
Wherein the 3D image playback unit includes: a rendering context initialization unit that performs initialization necessary for rendering using the profile information; A renderer and shader setting section; A camera setting unit for setting a camera position of each viewpoint for rendering a scene of each viewpoint represented by the 3D image display; A buffer initialization unit for setting and initializing a buffer for storing a result of rendering an image at each viewpoint used in the shader; A content loading unit for reading the content to be played by the 3D image display; And a rendering unit for rendering the image content.
2. The method according to claim 1,
A number of vertical pixels, a number of viewpoints, and an index map of the 3D image display device.
3. The 3D image display system of claim 2, wherein the index map is point-in-time information disposed in each sub-pixel of the 3D image display device.
2. The method according to claim 1,
Wherein the 3D image display device includes a number of horizontal pixels, a number of vertical pixels, a number of viewpoints, a horizontal length, a vertical length, an interval between viewpoints, and a distance between a display and an observer.
delete The method according to claim 1,
Wherein the rendering context initialization unit includes a number of pixels for rendering an image at each viewpoint.
The method according to claim 1,
Wherein the renderer configuration of the renderer and shader configuration includes adding a light source and setting a viewport.
The method according to claim 1,
Wherein the profile information providing unit is connected to the 3D image display device,
Wherein the 3D image reproducing unit is connected to a content provider and receives image contents.
The method according to claim 1,
Wherein the image content is a non-eyeglass multi-view video content or a super multi-view video content.
Reading a display profile that is hardware property information of the 3D image display device;
Initializing a rendering context using the profile information;
Setting a renderer and a shader;
Setting a camera position of each viewpoint for rendering a scene of each viewpoint number represented by the 3D image display;
Setting and initializing a buffer for storing a result of rendering an image at each viewpoint used in the shader;
Loading the content to be played by the 3D video display; And
And rendering the image content.
11. The method according to claim 10,
A number of vertical pixels, a number of viewpoints, and an index map of the 3D image display device.
12. The 3D image display method of claim 11, wherein the index map is point-in-time information arranged in each sub-pixel of the 3D image display device.
11. The method according to claim 10,
Wherein the 3D image display device includes a horizontal pixel number, a vertical pixel number, a viewpoint number, a horizontal length, a vertical length, an interval between viewpoints, and a distance between a display and an observer.
11. The method of claim 10,
Wherein the initializing the rendering context comprises setting a number of pixels for rendering an image at each viewpoint.
11. The method of claim 10,
Wherein the renderer setting of the step of setting the renderer and shader comprises adding a light source and setting a viewport.
11. The method of claim 10,
Wherein the image content is a non-eyeglass multi-view video content or a super multi-view video content.

Images