KR20190001896A - Appartus and method for displaying hierarchical depth image in virtual realilty - Google Patents

Abstract

According to an embodiment of the present invention, an apparatus for displaying a hierarchical depth image in virtual reality (VR) comprises: an input unit for receiving a two-dimensional (2D) image and a space image photographed by fitting in a no-parallax point; a virtual space acquisition unit for generating a three-dimensional (3D) virtual space from the space image; a hierarchical depth image acquisition unit for dividing objects in the 2D image according to a depth range and acquiring a hierarchical depth image hierarchizing the divided objects according to a depth order; and a 3D projection unit for hierarchizing and projecting each of the divided objects of the hierarchical depth image in the 3D virtual space according to the depth order.

Description

[0001] APPARATUS AND METHOD FOR DISPLAYING HIERARCHICAL DEPTH IMAGE IN VIRTUAL REALILTY [0002]

The present invention relates to an apparatus and a method for displaying a depth-layer image in a VR capable of expressing a 2D image in a VR in depth and depth.

The stereoscopic image display device is divided into a binocular stereoscopic technique and an auto stereoscopic technique.

The biggest challenge for the market activation of stereoscopic display devices is solving 3D content problem which is absolutely insufficient. A method of using a plurality of cameras of two or more stereo cameras as a method for directly acquiring 3D contents, and a method of using a depth camera for acquiring depth information with an image are known.

Such a method requires a large acquisition cost and can not secure sufficient 3D contents in a short time. There is a method of converting existing 2D contents into 3D contents as a method of solving content acquisition time with a small acquisition cost arising from a method of acquiring 3D contents directly.

This method is inexpensive and can solve the problem of securing 3D contents in a short time, but there are many problems compared to a method in which the stereoscopic effect of 3D image acquires 3D contents directly.

Patent Document 10-2004-0022100 (Mar.

It is an object of the present invention to provide an apparatus and method for displaying a depth layer image in a VR that acquires and imparts a hierarchical depth between objects in a 2D image to process a 2D image into a depth map image.

In addition, the present invention can realize realistic VR depth images by photographing 2D objects and virtual space with no parallax points, acquiring depth information in various ways, and accurately arranging 2D objects in a virtual space, The present invention provides a depth image display apparatus and method in a VR capable of implementing a depth layer image in a VR.

According to an aspect of the present invention, there is provided an apparatus for displaying depth images in a VR, the apparatus comprising: an input unit for inputting a 2D image and a spatial image photographed in accordance with a no parallax point; A virtual space acquiring unit for creating a 3D virtual space from the spatial image; A depth layer image acquisition unit for dividing objects in the 2D image according to a depth range and acquiring a depth layer image obtained by layering the divided objects in a depth order; And a 3D projection unit for layering and projecting each of the divided objects of the depth hierarchy image in a depth order in the 3D virtual space.

Preferably, the 3D projection unit projects each divided object of the depth layer image in accordance with a viewpoint of the 3D virtual space, scales each divided object of the depth layer image according to a depth range, So that the boundaries of the objects coincide with each other when viewed from the viewpoint of the 3D virtual space.

Preferably, the 3D projection unit may perform anti-aliasing processing on a boundary of each divided object of the depth hierarchy image.

Preferably, the depth layer image obtaining unit may divide the 2D image into a plurality of regions based on brightness values of the regions in the 2D image, and then, using the correlation between the brightness values of the divided regions, Can be obtained.

Preferably, the depth layer image obtaining unit divides the 2D image into a plurality of areas based on the brightness values of the areas in the 2D image, and then determines a binding force between the pixels based on the color similarity and the pixel distance of the divided area After the calculation, the object hierarchy image can be obtained by grouping pixels having high bonding strength.

Preferably, the depth layer image obtaining unit may divide the 2D image into a plurality of areas based on brightness values of the areas in the 2D image, determine a ranking based on the surrounding brightness values between the divided areas, The object layer image can be acquired by giving depth information to each of the divided regions according to the depth information.

Preferably, the depth layer image obtaining unit determines a relative surrounding brightness value between the divided regions using the contrast sensitivity function, and calculates a relative brightness value based on the relative brightness value between the divided regions based on the relative surrounding brightness value Can be determined.

Preferably, the 2D image includes depth information, and the depth layer image obtaining unit divides the objects in the 2D image into a plurality of regions according to a depth range with depth information included in the 2D image, Can be obtained.

According to an aspect of the present invention, there is provided a method of displaying a depth layer image in a VR, the method including: (a) receiving a 2D image and a spatial image photographed in accordance with a no parallax point; (b) creating a 3D virtual space from the spatial image; (c) dividing the objects in the 2D image according to a depth range, and obtaining a depth layer image obtained by layering the divided objects in a depth order; And (d) layering and segmenting each of the divided objects of the depth hierarchy image in the depth order in the 3D virtual space.

The solution of the above-mentioned problems does not list all the features of the present invention. Various means for solving the problems of the present invention can be understood in detail with reference to specific embodiments of the following detailed description.

Accordingly, an apparatus and a method for displaying a depth layer image in a VR according to an embodiment of the present invention can adjust a depth and a size of a 2D image projected in a 3D virtual space according to an observation point of a user, , The depth and size of each object in the 2D image can be adjusted according to the change of the observation point of the user, so that the spatial stereoscopic effect and perspective of the 2D image can be expressed realistically.

Accordingly, the advantage of the above-described advantage is that the three-dimensional image and the vividness can be infused to the webtoon and the photographs in the virtual 3D space deployed in the VR device.

1 is a block diagram of an apparatus for displaying a depth layer image in a VR according to an embodiment of the present invention.
FIG. 2 is a block diagram showing the depth layer image obtaining unit shown in FIG. 1 in more detail.
3 is a method flow diagram illustrating a depth layer image display method according to an embodiment of the present invention.
FIG. 4 is a flowchart illustrating the depth layer image generation process shown in FIG. 3 in more detail.
5 is an exemplary view illustrating an example of stitching a spatial image in a virtual space image portion.
6 (a) and 6 (b) are diagrams illustrating an example of extracting a boundary portion of an object image.
7 is an exemplary diagram illustrating a process of layering object images.
FIG. 8 is an exemplary diagram illustrating an example in which the depth and size of object images are corrected according to a distance change between a viewing point of the user and a depth layer image.
Figs. 9 to 10 are diagrams illustrating an example in which a depth layer image obtained using the apparatus shown in Fig. 1 is executed in VR space.
11 is a diagram illustrating an exemplary computing environment in which one or more embodiments disclosed herein may be implemented.

Various embodiments and / or aspects are now described with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more aspects. However, it will also be appreciated by those of ordinary skill in the art that such aspect (s) may be practiced without these specific details. The following description and the annexed drawings set forth in detail certain illustrative aspects of one or more aspects. It is to be understood, however, that such aspects are illustrative and that some of the various ways of practicing various aspects of the principles of various aspects may be utilized, and that the description set forth is intended to include all such aspects and their equivalents.

In addition, various aspects and features will be presented by a system that may include multiple devices, components and / or modules, and so forth. It should be understood that the various systems may include additional devices, components and / or modules, etc., and / or may not include all of the devices, components, modules, etc. discussed in connection with the drawings Must be understood and understood.

As used herein, the terms "an embodiment," "an embodiment," " an embodiment, "" an embodiment ", etc. are intended to indicate that any aspect or design described is better or worse than other aspects or designs. . As used herein, the terms 'component,' 'module,' 'system,' 'interface,' and the like generally refer to a computer-related entity and include, for example, hardware, It can mean software.

In addition, the term "or" is intended to mean " exclusive or " That is, it is intended to mean one of the natural inclusive substitutions "X uses A or B ", unless otherwise specified or unclear in context. That is, X uses A; X uses B; Or when X uses both A and B, "X uses A or B" can be applied to either of these cases. It should also be understood that the term "and / or" as used herein refers to and includes all possible combinations of one or more of the listed related items.

It is also to be understood that the term " comprises "and / or" comprising " means that the feature and / or component is present, but does not exclude the presence or addition of one or more other features, components and / It should be understood that it does not. Also, unless the context clearly dictates otherwise or to the contrary, the singular forms in this specification and claims should generally be construed to mean "one or more. &Quot; In addition, the terms "client "," user ", and "user ", as used herein, are often used interchangeably. In addition, the terms "component " and" element ", as used herein, are also often used interchangeably.

Hereinafter, an apparatus and method for displaying a hierarchical depth image in a VR according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram of an apparatus for displaying a depth layer image in a VR according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating the depth layer image obtaining unit shown in FIG. 1 in more detail.

1 and 2, a depth image display apparatus 100 according to an embodiment of the present invention includes an input unit 200, a depth layer image acquiring unit 300, a 3D virtual space acquiring unit 400, a 3D And a projection unit 500.

The input unit 200 receives a 2D image and a spatial image obtained by a photographing device such as an electronic device, and the 2D image and the spatial image are images captured in accordance with a No Parallax Point. Here, the spatial image refers to a background image on which a 2D image is arranged, which is a basis for creating a 3D virtual space. A 2D image is a target image placed in a 3D virtual space, which means an image of a person, an animal, or an object. For example, assuming that one person is in a room, a person's image becomes a 2D image, and the surrounding image of the room becomes a spatial image.

The virtual space acquiring unit 400 generates a 3D virtual space from the spatial image input through the input unit 200.

At this time, the 3D virtual space may be created by i) one image photographed by 360 3D camera, or ii) a spatial image photographed by 360 3D cameras arranged in a plurality of left / processing, and then creating a 3D virtual space, a sphere projection, or iii) stitching an image taken with a fisheye lens. However, the spatial image that is the basis of the 3D virtual space and the 2D image described above must be photographed in accordance with the no parallax point.

 The equirectangular format used here is one way to create a sphere projection, and in stiching processing, various projection methods may be selectively used to create a sphere projection .

Here, referring to FIG. 5 illustrating an example of stitching a spatial image in the virtual space obtaining unit 400, the spatial image may be displayed as a plurality of divided images through stiching processing .

For reference, the number of images required for the stitching process may vary depending on the lens.

2, the depth layer image obtaining unit 300 divides objects in the 2D image in the 2D image input from the input unit 200 according to the depth range, and divides the divided objects in a depth order Acquisition (production) of depth layer images.

The manner of acquiring the depth layer image may vary.

First, after inputting a 2D image including depth information, objects in the input 2D image are divided according to a depth range, and a depth layer image obtained by layering the divided objects in a depth order can be obtained. When capturing an object, depth information can be acquired from each region of the object in the captured image and stored together with the image. When a 2D image including the depth information is input, the depth information included in the 2D image is used It is easy to acquire a depth layer image.

ii) When a 2D image that does not include depth information is input, the boundary of the objects in the 2D image is extracted based on the brightness value of each area in the 2D image of the 2D image, Thus, depth layer images can be acquired by layering the depths between objects.

iii) Then, the 2D image can be manually divided into a plurality of regions according to the depth range, and then the depth layer image can be obtained by directly inputting the depths of the respective regions.

In the present invention, a depth layer image refers to an image obtained by dividing a depth into a plurality of ranges, dividing an area of a 2D image according to a depth range, and then dividing the divided areas in a depth order. In addition to the above three methods, the depth layer image can be acquired in a different manner. Therefore, in the present invention, the divided area using any method acquires a layered depth layer image according to the depth order, As shown in FIG.

The depth layer image obtaining unit 300 may include an object extracting unit 310, a layering unit 320, an image rendering unit 330, and a depth layer image producing unit 340.

The object extracting unit 310 divides objects in the 2D image into a plurality of regions according to a depth range.

When the 2D image includes depth information, the object extracting unit 310 may divide each area in the 2D image according to the depth range step. For example, when divided into three depth range steps, the object extraction unit 310 may divide the 2D image into a plurality of groups by grouping the points having one depth depth, two depth depth, and three depth depths, respectively. Steps in this depth range may be suitably determined to be two or more. In FIG. 7, the depth range is determined in five steps. However, the present invention is not limited thereto and may be determined to be an appropriate number of steps.

On the other hand, if depth information is not included in the 2D image, the object extracting unit 310 may divide the objects in the 2D image according to the depth range using the color component value of each pixel in the 2D image.

For example, after the 2D image is divided into a plurality of regions, the object extracting unit 310 extracts object boundaries using the correlation between the brightness values of the divided regions, and then extracts object images corresponding to the extracted object boundaries (See FIG. 6).

For reference, an edge component of an image is a part in which a color component value (R, G, B) of a pixel is abruptly changed, and can be calculated by a local cost value. 6 (a) is an example of extracting the entire boundary of the object image, and FIG. 6 (b) is an example of extracting the boundary of the object region from the object image.

In another example, the object extracting unit 310 may calculate the binding force between pixels based on the color similarity and the pixel distance of the divided region, then extract the object boundaries by grouping the pixels having high binding power and then use the extracted object boundary You can extract object images.

The 'color similarity' represents a degree of similarity of color values of two contrasting pixels in the pixel pair, and the 'distance between pixels' represents a relative distance between two pixels for obtaining a binding force.

Next, the layering unit 320 layers the plurality of divided regions (objects) according to the depth order, as shown in FIG.

When the depth information is included in the 2D image, the layering unit 320 may layer a plurality of objects divided according to the depth range according to the depth order.

On the other hand, if the depth information is not included in the 2D image, the layering unit 320 determines a ranking according to the surrounding brightness values between the object images extracted using the object boundary, Information can be given.

For reference, the arbitrary depth information may be given automatically or manually (an operator's input value).

The depth information may be converted into distance information for moving the object image in the Z-axis direction in the image rendering unit 330 described later. A more detailed description will be given later.

Here, the layering unit 320 may determine a relative ambient brightness value between the object images using the contrast sensitivity function, and determine a ranking (layering) according to the ambient brightness values of the object images based on the relative ambient brightness value .

For example, referring to FIG. 7, when there are twelve object images m1 to m12 in the 2D image, the relative ambient brightness values of the twelve object images m1 to m12 are determined.

As a result of the determination, the surrounding brightness values of the twelve object images are divided into the first group m4, m5, m6, m7, m12, the second group m2, m3, m8, m10, m11, . For example, if the surrounding brightness values are lower in the order of the first group, the second group, and the third group, the first group m2, m3, m8, m10, and m11 are selected in the first order and the second group m2 , m3, m8, m10, m11) may be selected in the second order, and the third group may be selected in the third order.

In addition, the layering unit 320 gives the depth information ? Z according to the magnitude of the relative ambient brightness value? C.

For example, if the relative ambient brightness value of the object images belonging to the first group is DELTA C1, the relative ambient brightness value of the object images belonging to the second group is DELTA C3, the relative ambient brightness value Assuming that the △ C7, relative to the first group, the object image of the second group △ C3 - △ depth information (△ Z1) corresponding to C1 is given, the object images of the third group are the △ C7 - △ It is assigned the depth information (△ Z2) corresponding to C3, wherein the depth information may be a value shifted the distance, which will be described later.

Next, the image rendering unit 330 performs a rendering operation so that the divided objects are layered in the Z-axis direction in the 3D mapping space according to the depth order.

In addition, the image rendering unit 330 renders the object images to be layered in the Z-axis direction in the three-dimensional mapping space according to the rank according to the surrounding brightness value of the object image and the arbitrary depth information ( ? Z) rendering can be performed.

Here, the depth information (△ Z) may be the information for representing the distance value to be shifted in the Z-axis direction.

The depth layer image production unit 340 acquires a depth layer image including object images rendered in the image rendering unit 330.

Next, the 3D projection unit 500 functions to project each divided object of the depth layer image in the 3D virtual space generated by the virtual space acquisition unit 400 according to the depth order.

At this time, the 3D projection unit 500 projects each divided object of the depth layer image in accordance with the viewpoint of the 3D virtual space, scales each divided object of the depth layer image according to the depth range, Can be projected so as to coincide with each other when viewed from the viewpoint of the 3D virtual space.

For this, the 3D projection unit 500 may scale the depth between the objects and the size of the objects according to the distance change or distance between the observation point of the user and the depth layer image, after detecting the observation point of the user.

In addition, the 3D projection unit 500 may anti-alias the boundary of each divided object of the depth layer image according to the depth information, or may adjust the transparency of each of the object images to be projected.

Therefore, a 3D virtual space and a depth layer image, which is a 2D image, can be stereoscopically expressed on the VR.

For example, referring to FIG. 8 illustrating an example in which the depth and size of object images are scaled according to a change in distance between an observer's viewpoint and a depth layer image, if the distance between the observation point of the user and the depth layer image approaches d2 to d2 , 3D projection portion 500 is the depth of the object image in the hierarchical image adapted to the depth information (△ Z) and a layer order of magnitude of (m1, m2, m3, m4 , m8, m9, m10, m11).

At this time, the depth information ? Z of the object image and the correction value of the size may be proportional to the difference ? D between d1 and d2, and the depth information ? Z between the layer and the layer may have different values .

For example, when the distance between the observation point of the user and the depth layer image is d1, it is assumed that the depth information between the first layer and the second layer is DELTA Z1 and the depth information between the second layer and the third layer is DELTA Z2 .

Then, when the distance between the observation point of the user and the depth layer image becomes shorter by? D, the depth information between the first layer and the second layer is corrected to? Z1? Z3 and the depth information between the second layer and the third layer Is corrected to? Z2? Z4. In addition, the size of the image of the object in the layer is reduced by the correction rate of the depth information.

Also, if the distance between the observation point of the user and the depth layer image is shortened by? D, the size of object images located in the first layer may be relatively large.

Through the above-described correction process, the user can experience the perspective and stereoscopic effect corresponding to the observation point, and can sense the principal and the stereoscopic effect which vary according to the observation point of the user.

Figs. 9 to 10 are diagrams illustrating an example in which a depth layer image obtained using the apparatus shown in Fig. 1 is executed in VR space.

9 to 10, the depth layer image acquired by the depth image display apparatus 100 according to an embodiment of the present invention is not a three-dimensional image but a depth image for each divided object image in the 2D image, So that the 2D image at the viewpoint of the observer can be an image showing spatial spatial sensation and perspective sensation.

That is, instead of processing a 3D image using a plurality of 2D images, the depth layer image may be divided into a divided region of a 2D image according to a change of a user's view using only one 2D image, Are arranged in the order of the depth range and projected in the 3D virtual space, thereby expressing the three-dimensional object and perspective.

Meanwhile, the depth layer image generated by the depth image display apparatus 100 according to an embodiment of the present invention can be implemented in a stereoscopic image display apparatus (VR apparatus) of a spectacle type or a non-spectacle type.

The display device of the deep hierarchy image display device 100 includes a liquid crystal display (LCD), a field emission display (FED), a plasma display panel (PDP), and an organic light emitting diode A flat panel display device such as an electroluminescence device (EL) such as an organic light emitting diode (OLED) or an electrophoresis (EPD) device.

In addition, the depth image display apparatus 100 according to an embodiment of the present invention can be operated in conjunction with a VR (Virtual Reality) apparatus to implement a depth layer image in a virtual three-dimensional space.

In addition, the depth image display apparatus 100 according to an embodiment of the present invention can be performed in a user terminal, and the user terminal can include a notebook, a desktop, a laptop, and the like. In addition, as a wireless communication device in which portability and mobility are ensured, a wireless communication device such as a PCS (Personal Communication System), a GSM (Global System for Mobile communications), a PDC (Personal Digital Cellular), a PHS (Personal Handyphone System) (International Mobile Telecommunication) -2000, Code Division Multiple Access (CDMA) -2000, W-Code Division Multiple Access (W-CDMA), Wibro (Wireless Broadband Internet) terminals, smart phones, smartpads, , A tablet PC (Tablet PC), and the like.

3 is a method flow diagram illustrating a depth layer image display method according to an embodiment of the present invention. The depth layer image display method according to an embodiment of the present invention is substantially the same invention as the method performed in the depth layer image display apparatus of the present invention described above, so that a duplicate description will be omitted.

Referring to FIG. 3, a depth layer image display method (S700) according to an embodiment of the present invention receives a 2D image and a spatial image photographed in accordance with a no parallax point in an input unit 200, The unit 400 creates a 3D virtual space from the spatial image (S710). Thereafter, the depth layer image obtaining unit 300 divides the objects in the 2D image according to the depth range, and obtains a depth layer image obtained by layering the divided objects in the depth order (S720).

Next, in the 3D projection unit 500, each divided object of the depth hierarchy image in the 3D virtual space is layered and projected in depth order (S730).

4 is a flowchart illustrating a step of acquiring a depth layer image in the case where depth information is not included in a 2D image.

Referring to FIG. 4, a method 500 for acquiring a depth layer image (S720) first inputs a 2D image to the depth layer image acquiring unit 300 (S721) The boundary between the pixels is calculated based on the color similarity degree and the pixel distance of the divided region or the like, and then groups of pixels having high bonding strength are grouped After extracting the object boundary, object images are extracted using the extracted object boundary (S722).

After ranking the object images extracted by the layering unit 320 of the depth layer image obtaining unit 300 according to the surrounding brightness values, arbitrary depth information is given according to the ranking (S723).

Here, the layering unit 320 may determine a relative ambient brightness value between the object images using the contrast sensitivity function, and determine a ranking (layering) according to the ambient brightness values of the object images based on the relative ambient brightness value .

For example, referring to FIG. 7, when there are twelve object images m1 to m12 in the 2D image, the relative ambient brightness values of the twelve object images m1 to m12 are determined.

As a result of the determination, the surrounding brightness values of the twelve object images are divided into the first group m4, m5, m6, m7, m12, the second group m2, m3, m8, m10, m11, . For example, if the surrounding brightness values are lower in the order of the first group, the second group, and the third group, the first group m2, m3, m8, m10, and m11 are selected in the first order and the second group m2 , m3, m8, m10, m11) may be selected in the second order, and the third group may be selected in the third order.

In addition, the layering unit 320 gives the depth information ? Z according to the magnitude of the relative ambient brightness value? C.

For example, if the relative ambient brightness value of the object images belonging to the first group is DELTA C1, the relative ambient brightness value of the object images belonging to the second group is DELTA C3, the relative ambient brightness value Assuming that the △ C7, relative to the first group, the object image of the second group △ C3 - △ depth information (△ Z1) corresponding to C1 is given, the object images of the third group are the △ C7 - △ It is assigned the depth information (△ Z2) corresponding to C3, wherein the depth information may be a value shifted the distance, which will be described later.

Next, the image rendering unit 330 renders the object images to be layered in the Z-axis direction in the three-dimensional mapping space according to the rank according to the surrounding brightness value of the object image and the arbitrary depth information ( ? Z) a rendering process S724 is performed.

The depth layer image production unit 340 generates (acquires) a depth layer image including object images rendered by the image rendering unit 330 (S725).

Next, in step S730, the 3D projection unit 500 detects the user's observation point and scales the depth between the objects and the size of the objects according to the distance change between the observation point of the user and the depth layer image .

In step S730, the 3D projection unit 500 may anti-alias the boundary of each object according to the depth information or adjust the transparency of each of the object images.

Referring to FIG. 8 illustrating an example in which the depth and size of object images are corrected according to the distance between the user viewpoint and the depth layer image, when the distance between the user's viewpoint and the depth layer image approaches d1 to d2 , 3D projection portion 500 is the depth of the object image in the hierarchical image adapted to the depth information (△ Z) and a layer order of magnitude of (m1, m2, m3, m4 , m8, m9, m10, m11).

At this time, the depth information ? Z of the object image and the correction value of the size may be proportional to the difference ? D between d1 and d2, and the depth information ? Z between the layer and the layer may have different values .

For example, when the distance between the observation point of the user and the depth layer image is d1, it is assumed that the depth information between the first layer and the second layer is DELTA Z1 and the depth information between the second layer and the third layer is DELTA Z2 .

Then, when the distance between the observation point of the user and the depth layer image becomes shorter by? D, the depth information between the first layer and the second layer is corrected to? Z1? Z3 and the depth information between the second layer and the third layer Is corrected to? Z2? Z4. In addition, the size of the image of the object in the layer is reduced by the correction rate of the depth information.

Also, if the distance between the user viewpoint and the depth layer image is shortened by? D, the size of object images located in the first layer can be relatively large.

Through the above-described scaling process, the user can experience spatial spatial sensibility and perspective of the depth layer image according to the change of the viewing point of the user and / or the observation point of the user.

Accordingly, an apparatus and a method for displaying a depth layer image in a VR according to an embodiment of the present invention can adjust a depth and a size of a 2D image projected in a 3D virtual space according to an observation point of a user, , The depth and size of each object in the 2D image can be adjusted according to the change of the observation point of the user, so that the spatial stereoscopic effect and perspective of the 2D image can be expressed realistically.

Accordingly, the advantage of the above-described advantage is that the three-dimensional image and the vividness can be infused to the webtoon and the photographs in the virtual 3D space deployed in the VR device.

FIG. 11 is a diagram illustrating an exemplary computing environment in which one or more embodiments disclosed herein may be implemented, and is illustrative of a system 1000 including a computing device 1100 configured to implement one or more of the above- / RTI > For example, the computing device 1100 may be a personal computer, a server computer, a handheld or laptop device, a mobile device (mobile phone, PDA, media player, etc.), a multiprocessor system, a consumer electronics device, A distributed computing environment including any of the above-described systems or devices, and the like.

The computing device 1100 may include at least one processing unit 1110 and memory 1120. [ The processing unit 1110 may include, for example, a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, an application specific integrated circuit (ASIC), a field programmable gate array And may have a plurality of cores.

The memory 1120 can be a volatile memory (e.g., RAM, etc.), a non-volatile memory (e.g., ROM, flash memory, etc.) or a combination thereof. In addition, the computing device 1100 may include additional storage 1130. Storage 1130 includes, but is not limited to, magnetic storage, optical storage, and the like. The storage 1130 may store computer readable instructions for implementing one or more embodiments as disclosed herein, and other computer readable instructions for implementing an operating system, application programs, and the like. The computer readable instructions stored in storage 1130 may be loaded into memory 1120 for execution by processing unit 1110. In addition, computing device 1100 may include input device (s) 1140 and output device (s) 1150.

Here, input device (s) 1140 may include, for example, a keyboard, a mouse, a pen, a voice input device, a touch input device, an infrared camera, a video input device, or any other input device. Also, output device (s) 1150 can include, for example, one or more displays, speakers, printers, or any other output device. In addition, computing device 1100 may use an input device or output device included in another computing device as input device (s) 1140 or output device (s) 1150. [ The computing device 1100 may also include communication connection (s) 1160 that allow the computing device 1100 to communicate with other devices (e.g., computing device 1300).

(S) 1160 may include a modem, a network interface card (NIC), an integrated network interface, a radio frequency transmitter / receiver, an infrared port, a USB connection or other Interface. Also, the communication connection (s) 1160 may include a wired connection or a wireless connection. Each component of the computing device 1100 described above may be connected by various interconnects (e.g., peripheral component interconnect (PCI), USB, firmware (IEEE 1394), optical bus architecture, etc.) And may be interconnected by the network 1200. As used herein, the terms "component," "system," and the like generally refer to a computer-related entity, which is hardware, a combination of hardware and software, software, or software in execution.

For example, an element may be, but is not limited to being, a processor, an object, an executable, an executable thread, a program and / or a computer running on a processor. For example, both the application running on the controller and the controller may be components. One or more components may reside within a process and / or thread of execution, and the components may be localized on one computer and distributed among two or more computers.

The present invention is not limited to the above-described embodiments and the accompanying drawings. It will be apparent to those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

100: depth layer image display device in VR
200: Input unit
300: depth layer image acquiring unit
310:
320:
330: image rendering unit
340: Depth layer image production section
400: 3D virtual space acquiring unit
500: 3D projection unit

Claims (16)

An input unit for receiving a 2D image and a spatial image photographed in accordance with a no parallax point;
A virtual space acquiring unit for creating a 3D virtual space from the spatial image;
A depth layer image acquisition unit for dividing objects in the 2D image according to a depth range and acquiring a depth layer image obtained by layering the divided objects in a depth order; And
And a 3D projection unit for layering and projecting each of the divided objects of the depth hierarchy image in a depth order in the 3D virtual space.
The 3D projection apparatus according to claim 1,
Wherein each of the divided objects in the depth hierarchy image is projected in conformity with the viewpoint of the 3D virtual space, and each boundary of the divided objects is scaled according to the depth range, And projecting the images so as to coincide with each other when viewed from the viewpoint.
3. The 3D projection apparatus according to claim 1 or 2,
Wherein the boundary layer of each of the divided objects of the depth hierarchy image is anti-aliased and projected.
The apparatus of claim 1, wherein the depth-
Wherein the 2D image is divided into a plurality of regions based on brightness values of the regions in the 2D image and then the object layer image is obtained using the correlation between brightness values of the divided regions. Depth hierarchy image display.
The apparatus of claim 1, wherein the depth-
After dividing the 2D image into a plurality of regions based on the brightness values of the regions in the 2D image, the binding forces between the pixels are calculated based on the color similarity degree and the pixel distance of the divided regions, And acquiring the object hierarchy image in the VR.
The apparatus of claim 1, wherein the depth-
After dividing the 2D image into a plurality of regions based on brightness values of the regions in the 2D image, determining a ranking according to the surrounding brightness values between the divided regions, and giving depth information to each divided region To obtain the object hierarchy image. ≪ Desc / Clms Page number 20 >
7. The apparatus of claim 6, wherein the depth-
Determining a relative ambient brightness value between the divided regions using the contrast sensitivity function and determining a ranking based on the surrounding brightness values between the divided regions based on the relative ambient brightness value, Depth hierarchy image display.
2. The method of claim 1, wherein the 2D image includes depth information,
Wherein the depth layer image obtaining unit comprises:
And the object layer image is obtained by dividing the objects in the 2D image into a plurality of regions according to a depth range with depth information included in the 2D image.
(a) receiving a 2D image and a spatial image photographed in accordance with a no parallax point;
(b) creating a 3D virtual space from the spatial image;
(c) dividing the objects in the 2D image according to a depth range, and obtaining a depth layer image obtained by layering the divided objects in a depth order; And
(d) layering and projecting each of the divided objects of the depth hierarchy image in a depth order in the 3D virtual space.
10. The method of claim 9, wherein step (d)
Wherein each of the divided objects in the depth hierarchy image is projected in conformity with the viewpoint of the 3D virtual space, and each boundary of the divided objects is scaled according to the depth range, Wherein the projections are projected so as to coincide with each other when viewed from the viewpoint.
11. The method of claim 9 or 10, wherein step (d)
Wherein the boundary layer of each of the divided objects of the depth layer image is anti-aliased and projected.
10. The method of claim 9, wherein step (c)
Wherein the 2D image is divided into a plurality of regions based on brightness values of the regions in the 2D image and then the object layer image is obtained using the correlation between brightness values of the divided regions. How to display depth hierarchy images.
10. The method of claim 9, wherein step (c)
After dividing the 2D image into a plurality of regions based on the brightness values of the regions in the 2D image, the binding forces between the pixels are calculated based on the color similarity degree and the pixel distance of the divided regions, And obtaining the object hierarchy image in the VR.
10. The method of claim 9, wherein step (c)
After dividing the 2D image into a plurality of regions based on brightness values of the regions in the 2D image, determining a ranking according to the surrounding brightness values between the divided regions, and giving depth information to each divided region To obtain the object hierarchy image. ≪ Desc / Clms Page number 20 >
15. The method of claim 14, wherein step (c)
Determining a relative ambient brightness value between the divided regions using the contrast sensitivity function and determining a ranking based on the surrounding brightness values between the divided regions based on the relative ambient brightness value, How to display depth hierarchy images.
10. The method of claim 9, wherein the 2D image comprises depth information,
The step (c)
And dividing the objects in the 2D image into a plurality of regions according to a depth range by using the depth information included in the 2D image to obtain the object layer image.

Images