WO2014175600A1

WO2014175600A1 - Computer-executable three-dimensional content display method, three-dimensional content display apparatus for performing same, and recording medium for saving same

Info

Publication number: WO2014175600A1
Application number: PCT/KR2014/003364
Authority: WO
Inventors: 차승헌; 박경호; 한경희
Original assignee: 주식회사 실리콘아츠
Priority date: 2013-04-24
Filing date: 2014-04-17
Publication date: 2014-10-30
Also published as: KR20140127041A; KR101474552B1

Abstract

The present invention relates to: a computer-executable three-dimensional (3D) content display technology; a computer-executable 3D content display method for realistically expressing a 3D content object by performing 3D rendering on the 3D content object; a 3D content display apparatus for performing the same; and a recording medium for saving the same.

Description

Computer executable 3D content display method, 3D content display device performing the same, and a recording medium storing the same

The present invention relates to a computer executable 3D content display technology, and more particularly, to a computer executable 3D content display method that realistically expresses a 3D content object by performing 3D rendering on the 3D content object, It relates to a three-dimensional content display device for performing this and a recording medium storing the same.

In general, 3D rendering is the process of applying colors, textures, and shadows to a model created on the basis of 3D computer graphics, framing with camera angles, shading through light to create the final rendered image.

Korean Laid-Open Patent Publication No. 10-2011-0038203 discloses a three-dimensional stereoscopic user interface space utilization method for displaying notification information on a three-dimensional stereoscopic user interface such as a polyhedron. The user interface space utilization technology may generate a space for displaying at least one of information such as text notification, schedule notification, status display, or announcement in a polyhedron frame having one or more content menus disposed on each side.

Korean Patent No. 10-0352169 discloses a method and system for rendering a virtual three-dimensional graphic display that couples components in a user environment to a three-dimensional graphic display of a data processing system. Such rendering techniques can make three-dimensional graphic images more realistic by combining reflective images from the user environment into a virtual three-dimensional graphics environment.

When providing 3D content, the computer cannot render the 3D content realistically by using a method of rendering the 3D content as a 2D image and displaying it on the screen.

An embodiment of the present invention is to provide a computer-implemented three-dimensional content display method for performing a three-dimensional rendering of the three-dimensional content object to realistically represent the three-dimensional content object.

An embodiment of the present invention is to provide a computer-implemented three-dimensional content display method for performing three-dimensional rendering in accordance with a user input or current environment information.

An embodiment of the present invention is to provide a computer-implemented three-dimensional content display method for performing three-dimensional rendering based on at least one of reflectance, refractive index and shadow for the three-dimensional content.

Among the embodiments, the computer executable 3D content display method may include generating a computer displayable screen including at least one user response object, wherein at least some of the at least one user response object is reflected through a 3D rendering operation. At least one of the at least one user response object, detecting a user response object that should receive a user input or a given environmental information input, and detecting the user response through the three-dimensional rendering operation. Rendering the object again.

In one embodiment, generating the computer displayable screen further comprises determining three-dimensional content that can be replaced by a user and detecting at least one user-responsive object receptor in the determined three-dimensional content. It may include.

The generating of the computer displayable screen may include: detecting the at least one user response object receptor and the at least one when the at least one user response object is associated with the at least one user response object receptor detected by the user. The method may further include re-rendering at least one of the user response objects.

In an embodiment, the detecting of the user response object may include detecting a user event including at least one of a gaze, a touch, a click, a voice, and a gesture of the user, and analyzing the detected user event to analyze the corresponding user response object. Determining may be further included.

The detecting of the user response object may include determining a corresponding user response object by recognizing that the gaze of the user stays in the at least one user response object for a preset time or more.

In an embodiment, the detecting of the user response object may include obtaining an environment event including at least one of a current time, a current weather, a current location, an event of a specific application, and a state of the computer, and the obtained environment event. The method may further include determining a corresponding user response object by analyzing.

The detecting of the user response object may include determining a position of a light source of the computer displayable screen according to the obtained current time. The detecting of the user response object may include determining transmittance, reflectance, or shadow for at least a portion of the at least one user response object associated with the battery state based on a battery state of the computer. It may include a step.

In one embodiment, re-rendering the detected user response object may include determining a rendering area associated with the detected user response object.

Re-rendering the detected user response object may include reflecting at least one of reflectance, refractive index, and shadow of the at least one user response object based on the user input or the currently given environment information input. .

Re-rendering the detected user response object may include reflecting at least one of a depth of field and a bokeh effect effect on the re-rendered at least one response object. .

In one or more embodiments, the computer-implemented 3D content display apparatus may include a screen generation unit that generates a computer displayable screen including at least one user response object. At least some of the at least one user response object may perform a 3D rendering operation. Represented by at least one of reflection, refraction, and shadow through the user response object detector for detecting a user response object that needs to receive a user input or a given environment information input among the at least one user response object, and the 3D rendering operation. And a user response object renderer for re-rendering the detected user response object.

In an embodiment, the user response object detector may detect a user event including at least one of a gaze, a touch, a click, a voice, and a gesture of the user, and analyze the user event to determine the corresponding user response object.

The user response object detector may determine the user response object by acquiring an environment event including at least one of a current time, a current weather, a current location, an event of a specific application, and a state of the corresponding computer, and analyzing the environment event.

Among the embodiments, a computer executable three dimensional content display recording medium, comprising: a computer executable three dimensional content display recording medium storing a computer program for providing a three dimensional content display performed on a computer executable three dimensional content display device; Generating a computer displayable screen including at least one user response object, at least some of the at least one user response object being represented by at least one of reflection, refraction and shadow through a three-dimensional rendering operation; And a function of detecting a user response object that must receive a user input or a given environment information input among user response objects, and a function of re-rendering the detected user response object through the 3D rendering operation.

The computer-implemented three-dimensional content display method according to an embodiment of the present invention can realistically express the three-dimensional content object by performing three-dimensional rendering on the three-dimensional content object.

The computer-implemented 3D content display method according to an embodiment of the present invention may perform 3D rendering according to a user's input or current environment information.

The computer-implemented 3D content display method according to an embodiment of the present invention may perform 3D rendering based on at least one of reflectance, refractive index, and shadow for the 3D content.

1 is a block diagram illustrating a computer-implemented three-dimensional content display device according to an embodiment of the present invention.

FIG. 2 is a flowchart illustrating a 3D content display process performed in the computer executable 3D content display apparatus of FIG. 1.

FIG. 3 is a diagram illustrating a rendering screen of 3D content performed in the computer executable 3D content display apparatus of FIG. 1.

FIG. 4 is a diagram illustrating a view conversion screen performed in the computer-implemented 3D content display apparatus of FIG. 1.

FIG. 5 is a diagram illustrating a rendering screen according to a battery state performed in the computer executable 3D content display apparatus of FIG. 1.

FIG. 6 is a diagram illustrating a rendering screen according to a light source performed in the computer-implementable 3D content display apparatus of FIG. 1.

FIG. 7 is a diagram illustrating a rendering screen according to a special effect performed in the computer-implementable 3D content display apparatus of FIG. 1.

Description of the present invention is only an embodiment for structural or functional description, the scope of the present invention should not be construed as limited by the embodiments described in the text. That is, since the embodiments may be variously modified and may have various forms, the scope of the present invention should be understood to include equivalents capable of realizing the technical idea. In addition, the objects or effects presented in the present invention does not mean that a specific embodiment should include all or only such effects, the scope of the present invention should not be understood as being limited thereby.

On the other hand, the meaning of the terms described in the present application should be understood as follows.

Terms such as "first" and "second" are intended to distinguish one component from another component, and the scope of rights should not be limited by these terms. For example, the first component may be named a second component, and similarly, the second component may also be named a first component.

The term “and / or” should be understood to include all combinations that can be suggested from one or more related items. For example, the meaning of “first item, second item and / or third item” may be given from two or more of the first, second or third items as well as the first, second or third items. Any combination of the possible items.

When a component is referred to as being "connected" to another component, it should be understood that there may be other components in between, although it may be directly connected to the other component. On the other hand, when a component is referred to as being "directly connected" to another component, it should be understood that there is no other component in between. On the other hand, other expressions describing the relationship between the components, such as "between" and "immediately between" or "neighboring to" and "directly neighboring to", should be interpreted as well.

Singular expressions should be understood to include plural expressions unless the context clearly indicates otherwise, and terms such as "comprise" or "have" refer to a feature, number, step, operation, component, part, or feature thereof. It is to be understood that the combination is intended to be present and does not exclude in advance the possibility of the presence or addition of one or more other features or numbers, steps, operations, components, parts or combinations thereof.

In each step, an identification code (e.g., a, b, c, etc.) is used for convenience of description, and the identification code does not describe the order of the steps, and each step clearly indicates a specific order in context. Unless stated otherwise, they may occur out of the order noted. That is, each step may occur in the same order as specified, may be performed substantially simultaneously, or may be performed in the reverse order.

The present invention can be embodied as computer readable code on a computer readable recording medium, and the computer readable recording medium includes all kinds of recording devices in which data can be read by a computer system. . Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and are also implemented in the form of a carrier wave (for example, transmission over the Internet). It also includes. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

All terms used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. Generally, the terms defined in the dictionary used are to be interpreted to coincide with the meanings in the context of the related art, and should not be interpreted as having ideal or excessively formal meanings unless clearly defined in the present application.

Referring to FIG. 1, the computer-implemented 3D content display apparatus 100 may include a screen generator 110, a user response object detector 120, a user response object renderer 130, and a controller 140.

The screen generator 110 generates a computer displayable screen including at least one user response object. Here, the screen generator 110 may express at least some of the at least one user response object with at least one of a reflectance, a refractive index, and a shadow through a 3D rendering operation.

In one embodiment, the screen generation unit 110 may determine at least one user response object receptor in the three-dimensional content by determining the three-dimensional content that can be replaced by the user. If the at least one user response object is associated with the at least one user response object receptor detected by the user, the screen generator 110 may re-render at least one of the at least one user response object receptor and the at least one user response object. Can be. For example, referring to FIG. 3, the screen generation unit 110 detects at least one user response object receptor 301 and associates the user response receptor 301 with the user response object (one user response object receptor). Associate only one user response object with 301) and reflect at least one of reflection 302, refraction 303, and shadow 304 to the user response receptor 301 and the user response object as shown in (b). Can be re-rendered. Here, (a) corresponds to a screen showing a plurality of three-dimensional content that is not reflected, refraction, and shadow, (b) is a screen showing a plurality of three-dimensional content that reflects at least one of reflection, refraction and shadow It may correspond to.

The user response object detector 120 detects a user response object that needs to receive a user input or currently given environment information input among at least one user response object.

In an embodiment, the user response object detector 120 may detect a user event including at least one of a gaze, a touch, a click, a voice, and a gesture of the user, and analyze the user event to determine the corresponding user response object. For example, when the user response object detector 120 recognizes that the user's gaze (eye movement) stays in at least one user response object for a preset time (for example, 1.5 seconds) or more, the user response object is detected. You can decide. For another example, when the user response object detector 120 recognizes a preset voice (eg, a voice for a user response object including mail, phone, text, video, and album) from the user, the user response object detector 120 detects the corresponding user response object. You can decide. Here, the voice may be preset and stored from the user.

Referring to FIG. 4, the user response object detector 120 may detect at least one user response object according to a view change of a screen according to a user's touch or drag. Here, (a) corresponds to the base screen, (b) corresponds to the screen moved according to the user's drag, and (c) corresponds to the screen zoomed out according to the user's drag. In this case, (d) may correspond to a zoom-in screen according to a user drag.

In another embodiment, the user response object detector 120 obtains an environment event including at least one of a current time, a current weather, a current location, an event of a specific application, and a state of a corresponding computer, and analyzes the environment event to analyze the corresponding user. You can determine the response object.

Referring to FIG. 5, the user response object detector 120 may determine a location of a light source of a computer displayable screen according to a current time. For example, the user response object detector 120 may determine the variable of the light source 501b so that the light source 501a reflected on the upper right side of the screen is reflected on the upper left side of the screen as time passes, and determines the

light source

501a and 501b. The

shadows

502a and 502b of the watch object may be determined by reflecting positions of the

light sources

501a and 501b in the associated watch object. Here, the user response object detector 120 may receive time information from the GPS.

Referring to FIG. 6, the user response object detector 120 may include at least one of reflectance, refractive index, and shadow required for a 3D rendering operation on at least some of at least one user response object associated with a battery state based on a battery state of a corresponding computer. One variable can be determined. Here, when the battery is in the fully charged state 601a, the user response object detector 120 determines that the reflectance and shadow of the fish object 602a associated with the battery state are increased and the refractive index is decreased, and the battery is slightly consumed ( 601b) determines that the reflectance and shadow of the fish object 602b associated with the battery state is reduced (battery is less than fully charged) and the refractive index is increased (battery is more than fully charged) and the battery is near discharged (601c). ), The variable can be determined such that the reflectance and shadow of the fish object 602c associated with the battery state is reduced (reduced slightly from the battery) and the refractive index is increased (more than the battery is slightly consumed).

The user response object detector 120 may receive current weather information through a predetermined network Uniform Resource Locator (URL).

The user response object renderer 130 renders the user response object detected through the 3D rendering operation again.

In one embodiment, the user response object rendering unit 130 may determine a rendering area associated with the detected user response object. For example, the user response object renderer 130 may generate a dithering pattern for the rendering area by determining a rendering area associated with the user response object detected by the user response object detector 120. The user response object renderer 130 may perform rendering again on the rendering region detected through the generated dithering pattern.

The user response object renderer 130 may re-render the at least one user response object by reflecting at least one of the reflectance, the refractive index, and the shadow of the at least one user response object based on the user input or the currently given environment information input. .

In one embodiment, the user response object rendering unit 130 may re-render the corresponding user response object by reflecting the variables of reflectance, refractive index, and shadow of the at least one user response object determined by the user response object detector 120. .

The user response object renderer 130 may re-render at least one user response object by reflecting at least one of a depth of field and a bokeh effect for the at least one response object that is re-rendered. have.

In one embodiment, the user response object rendering unit 130 reflects variables of depth value, bokeh effect, and light-shaft for at least one user response object rendered by reflecting reflectance, refractive index, and shadow. To render the corresponding user response object. For example, referring to FIG. 7, the user response object rendering unit 130 may apply a depth value to at least one user response object to implement a perspective of the corresponding user response object, and apply it to at least one user response object. By applying the effect, a natural combination between the screen and the corresponding user response object may be realized, and a light shaft may be applied to at least one user response object to implement the highlighting effect of the corresponding user response object. Here, (a) corresponds to the screen on which the three-dimensional rendering is performed on the user response object, (b) corresponds to the screen on which the three-dimensional rendering and the depth value are applied to the user response object, and (c) the user response object. This corresponds to the screen to which the 3D rendering, the depth value and the bokeh effect are applied, and (d) may correspond to the screen to which the 3D rendering, the depth value and the light shaft are applied to the user response object.

The controller 140 controls the overall operation of the computer-implemented 3D content display apparatus 100 and controls the flow between the screen generator 110, the user response object detector 120, and the user response object renderer 130. You can control the data flow.

Referring to FIG. 2, the screen generation unit 110 generates a computer displayable screen including at least one user response object (step S201).

According to an embodiment, the screen generator 110 may express at least some of the at least one user response object by using at least one of a reflectance, a refractive index, and a shadow through a 3D rendering operation. Here, the screen generating unit 110 determines the three-dimensional content that can be replaced by the user to detect at least one user response object receptor in the three-dimensional content and at least one user to the at least one user response object receptor When the response object is associated, at least one of the at least one user response object receptor and the at least one user response object may be re-rendered.

The user response object detection unit 120 detects a user response object that needs to receive a user input or currently given environment information input from among at least one user response object (step S202).

In an embodiment, the user response object detector 120 may detect a user event including at least one of a gaze, a touch, a click, a voice, and a gesture of the user, and analyze the user event to determine the corresponding user response object.

The user response object rendering unit 130 renders the user response object detected through the 3D rendering operation again (step S203).

In one embodiment, the user response object rendering unit 130 reflects at least one user response object by reflecting at least one of reflectance, refractive index, and shadow of the at least one user response object based on a user input or a given environment information input. Can be re-rendered.

In one embodiment, the user response object rendering unit 130 reflects at least one of a depth of field and a bokeh effect on at least one response object that is re-rendered to reflect at least one user response object. Can be re-rendered.

Although described above with reference to the preferred embodiment of the present application, those skilled in the art various modifications and changes to the present application without departing from the spirit and scope of the invention described in the claims below I can understand that you can.

Claims

Generating a computer displayable screen including at least one user response object, at least some of the at least one user response object being represented by at least one of reflection, refraction and shadow through a three dimensional rendering operation;

Detecting a user response object from which the user input or the currently given environment information input should be received from the at least one user response object; And

And re-rendering the detected user response object through the three-dimensional rendering operation.
The method of claim 1, wherein generating the computer displayable screen includes:

Determining three-dimensional content that can be replaced by a user; And

Detecting at least one user response object receptor in the determined three-dimensional content.
The method of claim 2, wherein generating the computer displayable screen includes:

Re-rendering at least one of the detected at least one user response object receptor and the at least one user response object when the at least one user response object is associated with the detected at least one user response object receptor by the user. The computer-implemented three-dimensional content display method further comprising the step.
The method of claim 1, wherein the detecting of the user response object comprises:

Detecting a user event including at least one of a gaze, a touch, a click, a voice, and a gesture of the user; And

And analyzing the detected user event to determine a corresponding user response object.
The method of claim 4, wherein the detecting of the user response object comprises:

And recognizing that the gaze of the user stays in the at least one user response object for a predetermined time or more and determining the corresponding user response object.
The method of claim 1, wherein the detecting of the user response object comprises:

Obtaining an environmental event including at least one of a current time, a current weather, a current location, an event of a specific application, and a state of the computer; And

And analyzing the acquired environment event to determine a corresponding user response object.
The method of claim 6, wherein the detecting of the user response object comprises:

And determining a position of a light source of the computer displayable screen according to the obtained current time.
The method of claim 6, wherein the detecting of the user response object comprises:

Determining at least one of reflectance, refractive index, and shadow for the three-dimensional rendering operation for at least a portion of the at least one user response object associated with the battery state based on the battery state of the computer. A computer executable three-dimensional content display method.
The method of claim 1, wherein the re-rendering of the detected user response object comprises:

Determining a rendering area associated with the detected user response object.
The method of claim 9, wherein re-rendering the detected user response object comprises:

And reflecting at least one of a reflectance, a refractive index, and a shadow of the at least one user response object based on the user input or the currently given environmental information input.
The method of claim 10, wherein re-rendering the detected user response object comprises:

And reflecting at least one of a depth of field and a bokeh effect on the re-rendered at least one response object.
A screen generator for generating a computer displayable screen including at least one user response object, at least some of the at least one user response object being represented by at least one of reflection, refraction, and shadow through a 3D rendering operation;

A user response object detector configured to detect a user response object that should receive a user input or currently given environment information input among the at least one user response object; And

And a user response object rendering unit configured to re-render the detected user response object through the 3D rendering operation.
The method of claim 12, wherein the user response object detector

And detecting a user event including at least one of a gaze, a touch, a click, a voice, and a gesture of the user, and analyzing the user event to determine a corresponding user response object.
The method of claim 12, wherein the user response object detector

A computer-executable 3-dimensional method characterized by acquiring an environmental event including at least one of a current time, a current weather, a current location, an event of a specific application, and a state of the computer, and analyzing the environmental event to determine a corresponding user response object. Content display device.
A computer executable 3D content display recording medium storing a computer program for providing a 3D content display performed on a computer executable 3D content display apparatus,

Generating a computer displayable screen including at least one user response object, at least some of the at least one user response object being represented by at least one of reflection, refraction, and shadow through a three-dimensional rendering operation;

Detecting a user response object from among the at least one user response object that needs to receive a user input or a given environment information input; And

And a function of re-rendering the detected user response object through the three-dimensional rendering operation.