KR20180122869A - Method and apparatus for processing 3 dimensional image - Google Patents

Abstract

The present invention provides a method for processing a three-dimensional (3D) image with respect to a changed viewpoint and a device thereof. The present invention receives an input changing the viewpoint of a 3D image in order to process the 3D image with respect to the changed viewpoint, determines a target viewpoint based on a current viewpoint and an input signal, generates the 3D image of the target viewpoint, determines a visual effect corresponding to the current viewpoint and the target viewpoint, outputs the visual effect and outputs the 3D image of the target viewpoint.

Description

METHOD AND APPARATUS FOR PROCESSING 3 DIMENSIONAL IMAGE < RTI ID = 0.0 >

TECHNICAL FIELD [0002] The present invention relates to a technique for providing a three-dimensional image, and more particularly, to a method and apparatus for changing a viewpoint of an output three-dimensional image.

The 3D (Dimensional: D) display is a display that provides a feeling of life and a sense of reality by adding depth information to an existing two-dimensional mono image to allow the user to feel an audiovisual stereoscopic effect. The 3D image can be implemented using two images, and the 2D image signals differently recognized by the user's eyes are combined in the brain, so that the user feels stereoscopic feeling.

With the development of 3D display, 3D display is spreading widely, and users watching 3D images can feel nausea. The ear has a vestibular function that not only hears the sound but also balances and equilibrates the body. The vestibular system of the ear is closely related to the vision, and if the nerve stimulation of both vestibular vestibular systems is not balanced, unconscious eye movement And you feel dizzy as if your body or surroundings are swirling. Therefore, users who watch 3D images can feel motion sickness if their vestibular functions do not follow the speed of 3D images moving fast in front of their eyes.

Korean Patent Laid-Open No. 10-2015-0091653 (published on Aug. 12, 2015) discloses a user-viewable image processing apparatus. The present invention discloses a video game system including a sensor unit for generating motion data by detecting a change in a user's viewpoint, a communication interface unit for receiving an image package containing video data from a media server, There is disclosed a virtual camera posture conversion section for converting the posture of a virtual camera arranged so as to correspond to a viewpoint change of a user by using a scene constituting section constituting a scene for video data and motion data.

One embodiment can provide a three-dimensional image processing apparatus and method.

One embodiment can provide an apparatus and method for outputting a three-dimensional image in which a viewpoint is converted based on an input signal.

A 3D image processing method performed by a 3D image processing apparatus for processing a 3D (Dimensional: D) image according to an aspect includes receiving an input signal for changing a viewpoint of a 3D image to be output through a display Determining a target time point based on the current time point and the input signal, generating a 3D image of the target time point, determining a visual effect corresponding to the current time point and the target time point, And outputting the 3D image of the target time point when the output of the visual effect is ended.

The input signal for changing the viewpoint may be an input signal for changing the position of the viewpoint or an input signal for changing the viewpoint direction.

The position of the viewpoint may include a first person view, a third person view, a shoulder view, and a back view.

The visual effect may be an image output to convert the 3D image of the current time to the 3D image of the target time.

The visual effect may be an image that fades out the 3D image at the current time point and then fades in the 3D image at the target time point.

Wherein the determining the visual effect comprises: determining a duration of the visual effect corresponding to the current viewpoint and the target viewpoint; and determining the visual effect corresponding to the current viewpoint and the target viewpoint And a step of determining the number

The step of determining the duration of the visual effect may include determining the duration based on the current time when the input signal is a signal changing the direction of the viewpoint.

The 3D image processing method may further include determining a user interface (UI) corresponding to the target viewpoint, and further outputting the UI on the 3D image of the target viewpoint.

The 3D image processing method may further comprise setting an animation set representing a motion of an object corresponding to the target time point, the object being located in the 3D image of the target time point, And can be controlled by a control signal received from a controller.

The 3D image processing method may further comprise setting a speed at which the object moves in correspondence with the target time point for each direction of motion.

Wherein determining the target time point comprises: identifying an Identification (ID) of a controller that transmits the input signal; determining a command of the input signal based on the identifier; And determining the target time point based on the time point and the command.

The 3D image processing method includes receiving information on a direction of a user's gaze from a device tracking a user's head direction and setting a direction of the user's gaze to the current time point .

The device for tracking the user's head direction may be a wearable device.

The 3D image processing method may further include determining whether the platform of the 3D processing apparatus is a virtual reality platform or a non-virtual reality platform, Generating the 3D image of the target viewpoint may include generating a 3D image of the target viewpoint based on a determined platform and a visual field and focus corresponding to the target viewpoint.

According to another aspect, an apparatus for processing a 3D (Dimensional: D) image includes a memory in which a program for processing a 3D image is recorded, and a processor for executing the program, Receiving an input signal for changing a viewpoint of a 3D image to be rendered, determining a target time point based on a current time point and the input signal, generating a 3D image of the target time point, And outputting the 3D image of the target time point when the output of the visual effect is finished.

The input signal for changing the viewpoint may be an input signal for changing the position of the viewpoint or an input signal for changing the viewpoint direction.

The position of the viewpoint may include a first person view, a third person view, a shoulder view, and a back view.

The visual effect may be an image output to convert the 3D image of the current time to the 3D image of the target time.

The visual effect may be an image that fades out the 3D image at the current time point and then fades in the 3D image at the target time point.

Wherein the determining the visual effect comprises: determining a duration of the visual effect corresponding to the current viewpoint and the target viewpoint; and determining the visual effect corresponding to the current viewpoint and the target viewpoint And a step of determining the number

The step of determining the duration of the visual effect may include determining the duration based on the current time when the input signal is a signal changing the direction of the viewpoint.

The program may further include changing a layout of a user interface (UI) corresponding to the target time point, and the UI may be additionally output on the 3D image of the target time point.

Wherein the program further comprises the step of setting an animation set representing the motion of the object to correspond to the target time point, the object being located in the 3D image of the target time, As shown in FIG.

The program may further comprise setting a speed at which the object moves in correspondence with the target time point for each direction of motion.

Wherein determining the target time point comprises: identifying an Identification (ID) of a controller that transmits the input signal; determining a command of the input signal based on the identifier; And determining the target time point based on the time point and the command.

The program further includes the step of receiving information on the direction of the user's gaze from an apparatus for tracking the user's head direction and setting the direction of the user's gaze to the current time point .

The device for tracking the user's head direction may be a wearable device.

The program may further include determining whether the platform of the 3D image processing apparatus is a virtual reality platform or a non-virtual reality platform, The step of generating an image may include generating a 3D image of the target viewpoint based on a determined platform and a visual field and focus corresponding to the target viewpoint.

According to another aspect of the present invention, a 3D (Dimensional: D) image processing application executed by a data processing apparatus is a program for causing the data processing apparatus to display a viewpoint of a 3D- The method comprising the steps of: receiving an input signal for changing a target time point, determining a target time point based on a current time point and the input signal, generating a 3D image of the target time point, Outputting the visual effect, and outputting the 3D image of the target time point when the output of the visual effect is ended.

A three-dimensional image processing apparatus and method are provided.

There is provided an apparatus and method for outputting a three-dimensional image in which a viewpoint is converted based on an input signal.

FIG. 1 shows views of a game image according to an example.
2 is a block diagram of a three-dimensional image processing apparatus according to an exemplary embodiment of the present invention.
3 is a flowchart of a three-dimensional image processing method according to an embodiment.
4 is a flowchart of a method of determining a platform of a 3D image processing apparatus according to an exemplary embodiment.
5 shows a method of changing the direction of the viewpoint according to an example.
6 is a flow chart of a method for determining a target time point according to an example.
7 is a flow chart of a method for determining a visual effect in accordance with an example.
8 is a flowchart of a method of outputting a user interface according to an example.
9 is a flowchart of a method of determining an animation set representing the motion of an object according to an example and setting a moving speed of the object.
Figure 10 shows an animation set according to an example.
FIG. 11 shows the movement of the object changed according to the direction of the user's gaze in one example.
12 is a flowchart of a method of setting a current time according to an example.

In the following, embodiments will be described in detail with reference to the accompanying drawings. However, the scope of the patent application is not limited or limited by these embodiments. Like reference symbols in the drawings denote like elements.

Various modifications may be made to the embodiments described below. It is to be understood that the embodiments described below are not intended to limit the embodiments, but include all modifications, equivalents, and alternatives to them.

The terms used in the examples are used only to illustrate specific embodiments and are not intended to limit the embodiments. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, the terms "comprises" or "having" and the like refer to the presence of stated features, integers, steps, operations, elements, components, or combinations thereof, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this embodiment belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

In the following description of the present invention with reference to the accompanying drawings, the same components are denoted by the same reference numerals regardless of the reference numerals, and redundant explanations thereof will be omitted. In the following description of the embodiments, a detailed description of related arts will be omitted if it is determined that the gist of the embodiments may be unnecessarily blurred.

FIG. 1 shows views of a game image according to an example.

A 3D (Dimensional: D) image may be a scene exposed at a viewpoint of the viewpoint based on a specific viewpoint in a virtual graphic environment modeled or manufactured in 3D. For example, if the content is a game centered on the user's character, the 3D image may be a game image provided to the user. The viewpoint can be understood as a position and a direction of a camera in a virtual graphic environment for generating a 3D image.

When the user of the game controls the movement of the character to progress the game, the game image can be provided around the character. The game image can be provided at various points in time. The game can provide the user with various viewpoints, and the user can select one of the various viewpoints to play the game. Camera variables for each viewpoint can be created at the game production stage to provide the viewer with various viewpoints. The game can provide a game image to a user at a specific time using a camera variable for a desired time point.

The viewpoint may include the position of the viewpoint and the direction of the viewpoint. For example, the game may include a first person view 110, a shoulder view 120, a back view 130, and a third person view 140, To the user. The user can select one of the provided points and proceed to the game, and can change to another point during the game. The viewpoint change between the first person viewpoint 110, the shoulder viewpoint 120, the isochronous viewpoint 130, and the third person viewpoint 140 may be to change the position of the viewpoint

When a user performs a virtual reality game through a 3D image, a user viewing a 3D image can feel motion sickness. In particular, if a 3D image is provided at the first person viewpoint 110, the user may feel more motion sickness than at other points in time 120, 130 and 140. The user can adjust the degree of motion sickness by changing the position of the viewpoint of the 3D image.

The game can provide a game image whose viewpoint has been changed by changing the direction of the viewpoint at the same viewpoint position. For example, the user can change the direction of the viewpoint of the game image outputted by changing the direction of the character of the game using the controller.

The 3D image is continuously generated along the direction of the changed time point, and when the 3D image is provided to the user, the user can feel motion sickness. In order to prevent motion sickness, a method may be employed in which only a 3D image corresponding to the target time point at which the rotation is completed is generated, and the 3D image is provided to the user without generating the 3D image successively. The user may not feel distant if only the 3D image corresponding to the target time point at which the rotation is completed is provided to the user.

When the time is changed, the game image can be generated and output so as to correspond to the changed time. A user interface (UI) is determined so as to correspond to the changed time point, and the game mode can be changed according to the determined UI.

Hereinafter, an image processing method for changing the viewpoint of an image will be described in detail with reference to FIGS. 2 to 12. FIG.

2 is a block diagram of a three-dimensional image processing apparatus according to an exemplary embodiment of the present invention.

The 3D image processing apparatus 200 includes a communication unit 210, a processor 220, and a memory 230. For example, the 3D image processing apparatus 200 may be an apparatus for processing data.

The communication unit 210 is connected to the processor 220 and the memory 230 to transmit and receive data. The communication unit 210 may be connected to another external device to transmit / receive data. Hereinafter, the expression " transmit / receive " A may indicate transmission / reception of " information or data representing A ".

The communication unit 210 may be implemented as a circuitry in the 3D image processing apparatus 200. For example, the communication unit 210 may include an internal bus and an internal bus. As another example, the communication unit 210 may be an element for connecting the 3D image processing apparatus 200 to an external apparatus. The communication unit 210 may be an interface. The communication unit 210 can receive data from an external device and transmit data to the processor 220 and the memory 230. [

The processor 220 processes the data received by the communication unit 210 and the data stored in the memory 230. &Quot; Processor " may be a data processing device embodied in hardware having circuitry having a physical structure for performing desired operations. For example, the desired actions may include code or instructions included in the program. For example, a data processing apparatus embodied in hardware may be a microprocessor, a central processing unit, a processor core, a multi-core processor, a multiprocessor, , An application-specific integrated circuit (ASIC), and a field programmable gate array (FPGA).

The processor 220 executes computer readable code (e.g., software) stored in a memory (e.g., memory 230) and instructions triggered by the processor 220.

The memory 230 stores data received by the communication unit 210 and data processed by the processor 220. [ For example, the memory 230 may store a program. The stored program may be a set of syntaxes executable by the processor 220 that are coded to process the 3D image.

According to an aspect, the memory 230 may include one or more volatile memory, non-volatile memory and random access memory (RAM), flash memory, hard disk drive, and optical disk drive.

The memory 230 stores a set of instructions (e.g., software) for operating the 3D image processing apparatus 200. The instruction set for operating the 3D image processing apparatus 200 is executed by the processor 220. [

The communication unit 210, the processor 220, and the memory 230 will be described in detail below with reference to Figs. 3 to 12.

3 is a flowchart of a three-dimensional image processing method according to an embodiment.

The following steps 310-360 are performed by the 3D processing apparatus 200 described above with reference to FIG.

In step 310, the communication unit 210 receives an input signal for changing the viewpoint of the 3D image to be generated.

The change of the viewpoint may be to change the position of the viewpoint or change the direction of the viewpoint. The input signal for changing the viewpoint may be an input signal for changing the position of the viewpoint or an input signal for changing the viewpoint direction. The position of the viewpoint may include a first person view, a third person view, a shoulder view, and an isochron view. The direction of the viewpoint may be the direction of view.

For example, the communication unit 210 may receive an input signal from a controller operated by a user. The controller may include a controller, a joystick and a joypad of a mouse, a keyboard and a game console, and is not limited to the disclosed embodiments. The user can generate a signal for changing the viewpoint of the 3D image by operating the button or the stick of the controller.

According to an aspect, a 3D image may be a 3D rendered scene of a scene at a specific point in a virtual graphic environment modeled in 3D. According to another aspect, the 3D image may be a stereoscopic image. A stereoscopic image may be provided for each of the left eye and right eye of the user. The 3D processing apparatus 200 can generate a stereoscopic image by generating a 3D image for each of the left eye and the right eye.

At step 320, the processor 220 determines the target time point based on the current time point and the input signal. The current time point may be the time point of the currently output 3D image.

According to one aspect, the input signal may be an input that alters the position of the viewpoint. When a content providing a virtual graphic environment modeled in 3D provides a first person view, a third person view, a shoulder view, and an isochronous viewpoint, the position of the current viewpoint may be determined as the target viewpoint. The change order is determined in the order of the first person, the third person, the shoulder, and the backward point, and if the current position is the shoulder point, the backward point can be determined as the target point. The change order of the viewpoints can be preset by the user. The third person view may include a top view, a quarter view, and a side view.

According to another aspect, the input signal may be an input that changes the direction of the viewpoint. For example, if the direction of the current point of view is 10 degrees to the right with respect to the north and the input signal is a signal that rotates 45 degrees to the right, the direction of the target point of view may be determined to be 55 degrees to the right with respect to the north .

At step 330, the processor 220 generates a 3D image of the target time point. Processor 220 may generate a 3D image corresponding to the field of view of the target viewpoint. For example, the processor 220 may adjust the degree to which the 3D image generated by using the predetermined value at the determined target time point is shaken up and down. When the 3D image moves up and down, the user can feel motion sickness. Therefore, it is possible to adjust the degree of shaking of the 3D image by customizing the user.

At step 340, the processor 220 determines a visual effect corresponding to the current and target time points. The visual effect may be an image output to convert the 3D image of the current viewpoint to the 3D image of the target viewpoint. Visual effects allow users to feel less motion sickness.

According to an aspect of the present invention, when the position of the current viewpoint and the position of the target viewpoint are different, the visual effect fades out the 3D image of the current viewpoint and then fades in the 3D image of the target viewpoint. Can be video. In other words, when the input signal is a signal that changes the position of the viewpoint, the visual effect can be determined to be an image of fade-out and fade-in.

According to another aspect, in the case of an input signal changing the direction of the viewpoint, the visual effect may be determined differently depending on the position of the current viewpoint. For example, if the current position is at the first person or shoulder point, there may be no visual effect. As another example, when the current position of the current viewpoint is the isochronance, the visual effect can be determined to be an image of fade-out and fade-in.

A method for determining a visual effect will be described in detail below with reference to Fig.

At step 350, the processor 220 outputs the determined visual effect. For example, visual effects may be images of fade-out and fade-in. As another example, there may be no visual effect. As another example, even if the duration of the visual effect is determined to be zero, it can be regarded as having no visual effect. If there is no visual effect, the following step 360 may be performed immediately.

In step 360, the processor 220 outputs a 3D image of the target time point. The user can receive the 3D image whose viewpoint has been changed.

When the position of the viewpoint is changed, it can be changed to correspond to the position of the point of time at which the user interface (UI) and the movement of the object appearing in the 3D image are changed. The additional operation after the viewpoint is changed will be described in detail with reference to Figs. 8 to 11 below.

4 is a flowchart of a method of determining a platform of a 3D image processing apparatus according to an exemplary embodiment.

The following steps 410 to 430 may be performed before step 310 described above with reference to FIG. 3 is performed.

At step 410 the processor 220 determines whether the platform of the 3D processing device 200 is a Virtual Reality platform or a Non-Virtual Reality platform. In another example, the processor 220 may determine whether the content providing the 3D image supports the VR platform.

In step 420, the processor 220 determines the platform of the 3D processing apparatus 200 or the platform of the content as a VR platform. If the platform is determined to be a VR platform, the steps 310 to 360 described above with reference to FIG. 3 may be performed based on the VR platform.

For example, camera resources related to the VR platform may be included in a resource of a content providing a 3D image. The processor 220 may obtain camera information regarding the VR platform from resources of the content. The resources of the content may include camera information related to the VR platform and camera information related to the non-VR platform, respectively. The camera information about the VR platform may include a camera unique identifier (ID) for each viewpoint. The processor 220 may set a camera ID corresponding to the determined target time point.

Step 330, described above with reference to FIG. 3, may include generating a 3D image of the target viewpoint based on the determined platform and a visual field and focus corresponding to the target viewpoint. The processor 220 may adjust the camera scale of the VR platform to provide a view and focus corresponding to the target time. The camera scale may be the scale of the output 3D image. For example, in the case of the first person or the shoulder point, the 3D image of the actual focus and field of view can be provided, thereby reducing the nausea of the user. As another example, in the case of the third person view or the isochron view, 3D images of the focus and the view corresponding to the distance ratio with the output object are provided, thereby reducing the nausea of the user. The 3D view of the third person and the back view can be enlarged so that the user can see the entire scene well. If the 3D image output for a moving object follows the object too slowly or shakes up and down, the user may feel motion sickness.

If it is determined to be a VR platform, steps 1210 and 1220 described below with reference to FIG. 12 can be additionally performed. Details of steps 1210 and 1220 will be described later with reference to FIG. 12 below.

In step 430, the processor 220 determines the platform of the 3D processing apparatus 200 or the platform of the content as the Non-VR platform. If the platform is determined to be a Non-VR platform, steps 310 to 360 may be performed based on the Non-VR platform. For example, the resource of the content providing the 3D image may include camera information related to the non-VR platform. Processor 220 may obtain camera information regarding the Non-VR platform from the resources of the content. The camera information about the non-VR platform may include a camera ID for each viewpoint. The processor 220 may set a camera ID corresponding to the determined target time point.

Even if the platform of the 3D processing apparatus 200 is determined to be a non-VR platform, the above-described step 330 includes the step of generating a 3D image of the target time point based on the determined platform and the view and focus corresponding to the target time point can do. The detailed description of the field of view and focus corresponding to the determined platform and target time point is similar to that described in step 420 and will be omitted below.

5 shows a method of changing the direction of the viewpoint according to an example.

Objects 512 may be located within a virtual graphical environment modeled in 3D. The object 512 may be a character of the user. The direction 514 of the viewpoint of the object 512 at the current point in time 510 may be 0 degrees relative to the north. The field of view 516 of the object 512 can be determined about the direction 514 of the viewpoint. For example, if the position of the viewpoint is the first person or the shoulder view, then the view 516 of the object 512 may correspond to the current 3D image being output.

According to one aspect, the direction 514 of the viewpoint may correspond to the direction of the user ' s line of sight received from the device tracking the head direction of the user. For example, when the user changes the direction of the line of sight, the direction of the start point 514 may change in real time so as to correspond to the direction of the user's line of sight. The direction of the viewpoint corresponding to the user's gaze, which is determined when the input signal is received, can be determined as the viewpoint direction 514. The device for tracking the user's head direction may be a wearable device. For example, the tracking device may be a head mounted display (HMD).

The viewpoint can be changed based on the input signal. The view direction of the object 512 can be changed from the view direction 514 to the view direction 524 when the input signal is a signal for changing the view direction. The direction 524 of the viewpoint may be the target viewpoint 520. [ The direction 524 of the viewpoint of the object 512 at the target viewpoint 520 is the direction in which the predetermined angle 530 in the viewpoint direction 514 is rotated. The preset angle 530 can be set by the user. The user can adjust the value of the angle in consideration of the 3D image adaptability of the user. According to the embodiment, the left-turning angle and the right-turning angle may be set differently. The view 526 of the object 512 about the direction 524 of the viewpoint can be determined. For example, if the position of the viewpoint is the first person viewpoint, the field of view 526 of the object 512 may correspond to the 3D image to be output.

6 is a flow chart of a method for determining a target time point according to an example.

Step 320 described above with reference to FIG. 3 may include the following steps 610 - 630.

In step 610, the processor 220 identifies the ID of the controller that is sending the input signal. For example, when the controller 220 and the 3D image processing apparatus 200 are connected, the processor 220 can identify the ID by receiving the ID from the controller.

In step 620, the processor 220 determines a command of the input signal based on the ID. For example, the command may be a command to change the position of the viewpoint or a command to change the direction of the viewpoint.

According to one aspect, a user can personalize the operation of the controller. For example, the user can adjust the functions of the buttons of the controller to their convenience. Through the personalization of the controller, different commands can be transmitted for different controllers even in the case of the same button. The processor 220 can determine which command the input signal transmitted by the controller is by identifying the ID.

At step 630, the processor 220 determines a target time point based on the current time point and the command. For example, the processor 220 may change the position of the current time point if the command is a command to change the position of the time point. The position of the target time point can be determined according to the order of change at the time point set for the identified controller.

7 is a flow chart of a method for determining a visual effect in accordance with an example.

The above-described step 340 with reference to FIG. 3 may include the following steps 710 and 720.

At step 710, the processor 220 determines the duration of the visual effect corresponding to the current and target time points. For example, if the position of the current viewpoint and the position of the target viewpoint are the same, and the direction of the viewpoint is different, the duration of the visual effect may be determined to be zero. When the duration of the visual effect is zero, the 3D image of the target time point can be output immediately when the input signal is received. In another example, if the position of the current viewpoint and the position of the target viewpoint are iso-viewpoints, and the direction of the viewpoint is different, the duration of the visual effect may be determined to be the first predetermined time. As another example, if the position of the current viewpoint and the position of the target viewpoint are different, the duration of the visual effect may be determined as the second predetermined time.

According to one aspect, the processor 220 may determine the duration based on the current time when the input signal is a signal that changes the direction of the viewpoint. For example, if the position of the current point of view is the first person or the shoulder point, the duration may be determined to be zero. As another example, if the current point of time is the isochronous point, the duration may be determined as a preset time. The predetermined time for the isochronism may be a short time. The preset time for the isochronous point can be adjusted by the user.

In step 720, the processor 220 determines the visual effect corresponding to the current and target time points. For example, when the position of the current viewpoint and the position of the target viewpoint are different, the visual effect may be determined to be an image of fade-out and fade-in.

8 is a flowchart of a method of outputting a user interface according to an example.

After step 320 described above with reference to Figure 3 is performed, the following steps 810 and 820 may be performed.

At step 810, the processor 220 determines a UI corresponding to the target time point. For example, when the position of the current point of view is different from the position of the target point of view, the UI for manipulating the 3D image or for moving the content may be different from each other.

In step 820, the processor 220 additionally outputs the determined UI on the 3D image of the target time point. For example, the UI may be output at a predetermined position corresponding to the target time point.

9 is a flowchart of a method of determining an animation set representing the motion of an object according to an example and setting a moving speed of the object.

After step 320 described above with reference to Figure 3 is performed, the following steps 910 and 920 may be performed. Steps 910 and 920 may be performed in parallel.

At step 910, the processor 220 determines an animation set that represents the motion of the object to correspond to the target time. The object is located in the 3D image of the target time point, and the movement of the object can be controlled by the control signal received from the controller.

 For example, the object may be a character of the game. For each position of the target time point, the animation set may be preset. The processor 220 may determine a preset animation set for the target viewpoint. For example, the animation set may include eight-way animations in which the object moves at the corresponding target time. Each animation can have an ID. Processor 220 may set the corresponding ID to the corresponding motion. The animation set will be described in detail with reference to FIG. 10 below.

In step 920, the processor 220 sets the speed at which the object moves to correspond to the target time point for each direction of motion. For example, the processor 220 may set the velocity for each direction of movement of the object corresponding to the target time. The speed of the forward movement can be set faster than the speed of the backward movement.

The moving direction of the object with respect to the motion control signal can be changed according to the changed position. The direction of movement of the object with respect to the viewpoint change will be described in detail with reference to FIGS. 10 and 11. FIG. 10 shows an animation set according to an example.

The 3D image shown may be an iso-view or an output image at a third-person viewpoint. The object 1010 may be output in an image at an isochronous or third person view. When the viewpoint of the 3D image is the iso-viewpoint or the third-viewpoint viewpoint, the moving direction of the object 1010 in the virtual graphic environment may not be affected by the direction of the user's gaze. When the viewpoint of the 3D image is the iso-viewpoint or the third-person viewpoint, the generated 3D image may be a scene corresponding to the direction of the user's gaze in the virtual graphic environment, and the movement of the object 1010 may be controlled Signal. For example, even when the user changes the line of sight around the object 1010 in the left direction and the right direction and inputs the right movement button of the controller, the object 1010 can display the 3D image in the right side .

The direction 1020 of the viewpoint of the object 1010 may be north. The first animation 1031 may be output when the object 1010 moves in the view direction 1020. [ When the object 1010 moves northeast, the second animation 1032 may be output. When the object 1010 moves east, a third animation 1033 may be output. When the object 1010 moves southeast, a fourth animation 1034 may be output. A fifth animation 1035 may be output if the object 1010 moves south. The sixth animation 1036 may be output when the object 1010 moves southwest. The seventh animation 1037 may be output when the object 1010 moves to the west. When the object 1010 moves northwest, an eighth animation 1038 may be output. The object set for the third person viewpoint may include the first animation 1031 to the eighth animation 1038. [

FIG. 11 shows the movement of the object changed according to the direction of the user's gaze in one example.

The generated 3D image may be a first person view or an output image at a shoulder view. The moving direction 1135 of the object 1110 in the virtual graphical environment 1100 can be influenced by the direction 1120 and 1140 of the user's gaze when the viewpoint of the 3D image is the first person or the shoulder point have. When the viewpoint of the 3D image is the first person view or the shoulder view, the generated 3D images 1130 and 1150 may be scenes corresponding to the directions 1120 and 1140 of the user's gaze on the basis of the object 1110.

The object 1110 located within the virtual graphical environment 1100 may be directed in a virtual direction corresponding to the direction 1120 of the user's gaze. For example, if the direction of the user's line of sight is frontal, the object 1100 may point north in the virtual graphical environment 1100. The virtual direction corresponding to the direction 1120 of the user's gaze can be changed according to the initial setting. For example, the direction of the object 1100 in the virtual graphical environment 1100 may be set to the north, even if the direction 1120 of the actual user's gaze is on the right side with respect to the front. The above matching can be changed by setting.

When the object 1110 is oriented to the north and the user inputs the upward movement button, the object is moved toward the north, and the 3D image 1130 is generated for the scene in the direction in which the object moves. In the middle of the above movement, the user still inputs the upward movement button, but the direction 1140 of the user's gaze can be changed to the right 45 degrees with respect to the front face. When the direction 1140 of the user's gaze is changed, the object 1100 moves toward the right 45 degrees toward the north, i.e., toward the northeast. If the direction of the user's line of sight is continuously changed from the front to the right 45 degrees, the object 1135 may represent the movement of the curve 1135. The curvature of the curve 1135 increases as the direction of the user's gaze changes abruptly.

12 is a flowchart of a method of setting a current time according to an example.

The following steps 1210 and 1220 may be performed before step 310, described above with reference to FIG. 3, is performed.

In step 1210, the communication unit 210 receives information on the direction of the user ' s line of sight from the device that tracks the head direction of the user. For example, when the tracking apparatus is an HMD, the HMD can sense directions of six axes based on the HMD. The HMD can measure the absolute position and orientation of the head.

At step 1220, the processor 220 sets the direction of the line of sight to the current point of view based on information about the direction of the user's line of sight. For example, the direction of the line of sight can be set to the direction of the viewpoint. When the head direction of the user wearing the HMD rotates 30 degrees to the right, the direction of the current view point of the outputted 3D image can also be rotated 30 degrees to the right. In other words, the processor 220 can adjust the current time point in real time by tracking the head movement of the user.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Although the embodiments have been described with reference to the drawings, various technical modifications and variations may be applied to those skilled in the art. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

200: 3D image processing device
210:
220: Processor
230: Memory

Claims (30)

A 3D image processing apparatus for processing a three-dimensional (D)
Receiving an input signal for changing a viewpoint of a 3D image to be output through a display;
Determining a target time point based on a current time point and the input signal;
Generating a 3D image of the target time point;
Determining a visual effect corresponding to the current viewpoint and the target viewpoint;
Outputting the visual effect; And
Outputting the 3D image of the target time point when the output of the visual effect is finished
/ RTI >
3D image processing method.
The method according to claim 1,
The input signal for changing the viewpoint is,
Which is an input signal for changing the position of the viewpoint or an input signal for changing the direction of the viewpoint,
3D image processing method.
3. The method of claim 2,
The position of the viewpoint may include a first person view, a third person view, a shoulder view, and a back view.
3D image processing method.
The method according to claim 1,
Wherein the visual effect is a video output for switching from the current 3D view to the 3D view of the target view,
3D image processing method.
5. The method of claim 4,
Wherein the visual effect is a video that fades out the 3D image at the current time point and then fades in the 3D image at the target time point,
3D image processing method.
The method according to claim 1,
The step of determining the visual effect comprises:
Determining a duration of the visual effect corresponding to the current viewpoint and the target viewpoint; And
Determining the visual effect corresponding to the current viewpoint and the target viewpoint
/ RTI >
3D image processing method.
The method according to claim 6,
Wherein determining the duration of the visual effect comprises:
Determining the duration based on the current time if the input signal is a signal changing direction of the viewpoint,
/ RTI >
3D image processing method.
The method according to claim 1,
Determining a user interface (UI) corresponding to the target time point; And
Further outputting the UI on the 3D image at the target time point
Further comprising:
3D image processing method.
The method according to claim 1,
Setting an animation set representing the motion of the object to correspond to the target time point
Further comprising:
The object is located within the 3D image of the target time point,
Wherein the movement of the object is controlled by a control signal received from a controller,
3D image processing method.
10. The method of claim 9,
Setting a speed at which the object moves so as to correspond to the target time point for each direction of motion
≪ / RTI >
3D image processing method.
The method according to claim 1,
Wherein the step of determining the target time point comprises:
Identifying an identification (ID) of a controller that transmits the input signal;
Determining a command of the input signal based on the identifier; And
Determining the target time point based on the current time point and the command
/ RTI >
3D image processing method.
The method according to claim 1,
Receiving information on the direction of the user's gaze from a device that tracks the head direction of the user; And
Setting the direction of the user's gaze to the current time point
≪ / RTI >
3D image processing method.
13. The method of claim 12,
An apparatus for tracking a user's head direction comprises:
A wearable device,
3D image processing method.
The method according to claim 1,
Determining whether the platform of the 3D processing apparatus is a virtual reality platform or a non-virtual reality platform
Further comprising:
Wherein the step of generating the 3D image of the target time point comprises:
Generating a 3D image of the target viewpoint based on a determined platform and a visual field and focus corresponding to the target viewpoint;
/ RTI >
3D image processing method.
A computer-readable recording medium containing a program for performing the method of any one of claims 1 to 14.
An apparatus for processing a three-dimensional (D)
A memory in which a program for processing a 3D image is recorded; And
The processor
Lt; / RTI >
The program includes:
Receiving an input signal for changing a viewpoint of a 3D image to be output through a display;
Determining a target time point based on a current time point and the input signal;
Generating a 3D image of the target time point;
Determining a visual effect corresponding to the current viewpoint and the target viewpoint;
Outputting the visual effect; And
Outputting the 3D image of the target time point when the output of the visual effect is finished
Lt; / RTI >
3D image processing device.
17. The method of claim 16,
The input signal for changing the viewpoint is,
Which is an input signal for changing the position of the viewpoint or an input signal for changing the direction of the viewpoint,
3D image processing device.
18. The method of claim 17,
The position of the viewpoint may include a first person view, a third person view, a shoulder view, and a back view.
3D image processing device.
17. The method of claim 16,
Wherein the visual effect is a video output for switching from the current 3D view to the 3D view of the target view,
3D image processing device.
20. The method of claim 19,
Wherein the visual effect is a video that fades out the 3D image at the current time point and then fades in the 3D image at the target time point,
3D image processing device.
17. The method of claim 16,
The step of determining the visual effect comprises:
Determining a duration of the visual effect corresponding to the current viewpoint and the target viewpoint; And
Determining the visual effect corresponding to the current viewpoint and the target viewpoint
/ RTI >
3D image processing device.
22. The method of claim 21,
Wherein determining the duration of the visual effect comprises:
Determining the duration based on the current time if the input signal is a signal changing direction of the viewpoint,
/ RTI >
3D image processing device.
17. The method of claim 16,
The program includes:
A step of changing a layout of a user interface (UI) corresponding to the target time point
Lt; / RTI >
Wherein the UI is further output on a 3D image of the target time point,
3D image processing device.
17. The method of claim 16,
The program includes:
Setting an animation set representing the motion of the object to correspond to the target time point
Lt; / RTI >
The object is located within the 3D image of the target time,
Wherein the movement of the object is controlled by a control signal received from a controller,
3D image processing device.
25. The method of claim 24,
The program includes:
Setting a speed at which the object moves so as to correspond to the target time point for each direction of motion
Lt; / RTI >
3D image processing method.
17. The method of claim 16,
Wherein the step of determining the target time point comprises:
Identifying an identification (ID) of a controller that transmits the input signal;
Determining a command of the input signal based on the identifier; And
Determining the target time point based on the current time point and the command
/ RTI >
3D image processing device.
17. The method of claim 16,
The program includes:
Receiving information on the direction of the user's gaze from a device that tracks the head direction of the user; And
Setting the direction of the user's gaze to the current time point
Lt; / RTI >
3D image processing device.
28. The method of claim 27,
An apparatus for tracking a user's head direction comprises:
A wearable device,
3D image processing device.
17. The method of claim 16,
The program includes:
Determining whether the platform of the 3D image processing apparatus is a virtual reality platform or a non-virtual reality platform,
Lt; / RTI >
Wherein the step of generating the 3D image of the target time point comprises:
Generating a 3D image of the target viewpoint based on a determined platform and a visual field and focus corresponding to the target viewpoint;
/ RTI >
3D image processing device.
In a three-dimensional (D: D) image processing application executed by a data processing apparatus,
The data processing apparatus comprising:
Receiving an input signal for changing a viewpoint of a three-dimensional (D) image to be output through a display;
Determining a target time point based on a current time point and the input signal;
Generating a 3D image of the target time point;
Determining a visual effect corresponding to the current viewpoint and the target viewpoint;
Outputting the visual effect; And
Outputting the 3D image of the target time point when the output of the visual effect is finished
The data processing apparatus comprising:
3D image processing application.

Images