KR101162703B1 - Method, terminal and computer-readable recording medium for remote control on the basis of 3d virtual space - Google Patents

Abstract

The present invention provides a method for performing remote control based on a three-dimensional virtual space, comprising: (a) a three-dimensional virtual including a remote control area, which is an area for processing user input for remote control of a remote computer, as an object; Receiving an environment, (b) when the remote control region is activated, causing a vertex operation to be performed based on a specific vertex in the remote control region, and (c) referring to a result of the vertex operation, By allowing the contents of the actual screen of the computer to be mapped in the remote control area, if the first point in the remote control area is pointed, the second point in the actual screen of the remote computer is displayed in a pointed state and the actual of the remote computer When the second point in the screen is pointed, the first point in the remote control area is pointing. Disclosed is a method comprising the step of being displayed. According to the present invention, a vertex operation and a rotation operation may be applied to a remote control area in a 3D virtual space so that the contents of the actual screen of the remote computer can be efficiently mapped onto the remote control area.

Description

METHOOD, TERMINAL AND COMPUTER-READABLE RECORDING MEDIUM FOR REMOTE CONTROL ON THE BASIS OF 3D VIRTUAL SPACE}

The present invention relates to a method, a terminal device and a computer readable recording medium for remotely controlling a remote computer based on a three-dimensional virtual space. More specifically, the present invention by applying a vertex operation and / or a rotation operation to any point in the remote control area displayed in the three-dimensional virtual space, the contents appearing on the actual screen of the computer of the remote location to the three-dimensional virtual space A method, a terminal device and a computer readable recording medium for enabling accurate mapping within a remote control area of an image and thereby allowing for efficient remote control in two directions.

As the information society develops, a remote computer control technology for easily controlling an arbitrary computer from a computer existing in another place is being developed. In this case, the remote control may be performed through a peripheral input device such as a keyboard or a mouse connected to a computer that performs this, and the result may be confirmed through an output device such as a monitor. According to such a remote computer control technology, there is an advantage that can easily process information remotely in a place independently from the computer that is the target of the remote control.

However, according to the conventional remote computer control technology, there has been a tendency to perform only a function of simple remote control between computers, and to implement a limited implementation focusing only on the utilization inside the remote control. Therefore, in displaying the graphic object related to the actual screen of the remote computer that is the target of the remote control on the computer performing the remote control, the remote control object is displayed in the three-dimensional virtual environment unfolded based on the camera view information of the user. It was not easy to implement reasonably mapping by applying various operations and implement remote control effectively. In particular, when an object changes in three dimensions, the object for remote control is based on two dimensions compared to the process of maintaining information on the object and utilizing the object based on it, so it has a slightly different coordinate system and processing method. However, there was a limit in changing three-dimensional to a two-dimensional coordinate system.

Accordingly, the present invention has been made to solve the above problems of the prior art, and applies a vertex operation and / or rotation operation to the remote control region existing in the three-dimensional virtual space and based on this remote computer ( An object of the present invention is to efficiently perform remote control by efficiently mapping contents of a screen of a terminal device to be remotely controlled onto the remote control area.

In addition, the present invention is to make the remote control more vividly by changing the appearance of the remote control area by properly reflecting the change of the user's viewpoint (for example, the virtual camera view) in the three-dimensional virtual space another object There is this.

In addition, the present invention has another object to enable collaborative interaction between people using remote control, so that it can be extended to fields such as business meetings and e-learning.

Representative configurations of the present invention for achieving the above object of the present invention are as follows.

According to an aspect of the present invention, in a method for performing remote control based on a three-dimensional virtual space, (a) a remote control area, which is an area for processing user input for remote control to a remote computer, is used as an object. Receiving an included three-dimensional virtual environment, (b) when the remote control area is activated, performing a vertex operation based on a specific vertex in the remote control area, and (c) referring to the result of the vertex operation In this case, the contents of the actual screen of the remote computer are mapped in the remote control area so that when the first point in the remote control area is pointed, the second point in the actual screen of the remote computer is displayed in a pointed state. The first point in the remote control area if the second point in the actual screen of the remote computer is pointing The method comprising that a display with a pointing state is provided.

According to another aspect of the present invention, in a terminal device for performing a remote control based on a three-dimensional virtual space, a remote control area which is an area for inputting a user input for remote control to a remote computer is included as an object. A user interface providing unit for receiving a 3D virtual environment, checking whether the remote control area is activated, and allowing the contents of an actual screen of the remote computer to be mapped into the remote control area, and the user interface providing unit. When it is detected that the remote control area is activated, vertex calculation is performed based on a specific vertex in the remote control area, and the contents of the actual screen of the remote computer are mapped by the user interface provider in the remote control area. Vertex to refer to the vertex operation result A terminal apparatus including a divider is provided.

In addition, there is provided another method, system, and computer readable recording medium for recording a computer program for carrying out the method for implementing the present invention.

According to the present invention, by applying a vertex operation and a rotation operation to the remote control area in the three-dimensional virtual space to effectively map the contents of the actual screen of the remote computer on the remote control area, 3 Make remote control of dimensional virtual space more usable than 2D remote control.

In addition, according to the present invention, in the three-dimensional virtual space provided through the screen of the terminal device, based on the information on the point where the gaze derived from the concept of the virtual camera view looking at this crosses the remote control area; By performing the control, even if the remote control object is placed at any position and at any angle in the three-dimensional virtual space, the remote control is possible as long as the remote control screen can be viewed as the camera view.

1 is a view showing a schematic configuration of an entire system according to an embodiment of the present invention.
2 is a diagram illustrating in detail the internal configuration of the 3D client 200 according to an embodiment of the present invention.
3 is a diagram illustrating a part of a vertex calculation process for a remote control area according to an embodiment of the present invention.
4 is a diagram illustrating a rotation calculation process for a remote control area according to an embodiment of the present invention.
5 is a diagram illustrating an actual screen of a computer of the RD server 400 according to an embodiment of the present invention.
6 is a diagram exemplarily illustrating a remote control area displayed on a screen of the 3D client 200 according to an exemplary embodiment of the present invention.
7 is a diagram illustrating an example in which contents of an actual screen of a remote computer are mapped to a remote control area displayed on a screen of the 3D client 200 according to an exemplary embodiment of the present invention.
8 is a flowchart illustrating a vertex calculation process according to an embodiment of the present invention.

DETAILED DESCRIPTION The following detailed description of the invention refers to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description, therefore, is not to be taken in a limiting sense, and the scope of the present invention, if properly described, is defined only by the appended claims, along with the full range of equivalents to which such claims are entitled. In the drawings, like reference numerals refer to the same or similar functions throughout the several aspects, and length, area, thickness, and the like may be exaggerated for convenience.

DETAILED DESCRIPTION Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present invention.

[Preferred Embodiments of the Invention]

Configuration of the entire system

1 is a diagram illustrating a schematic configuration of an entire system for remotely controlling an object based on a three-dimensional virtual space according to an embodiment of the present invention.

1, the entire system according to an embodiment of the present invention is a communication network 100, 3D client 200, 3D virtual server 300 and RD server 400 (Remote Desktop Server: remote computer, remote terminal Concept that includes a device).

First, the communication network 100 according to an embodiment of the present invention may be configured regardless of communication aspects such as wired and wireless. For example, Local Area Network (LAN), Metropolitan Area Network (MAN), Wide Area Network (WAN), Fiber To The Home, Fiber To The Premises (FTTH) It may be configured with a variety of communication networks. Preferably, the communication network 100 in the present invention may be a known Internet network.

Next, the 3D client 200 according to an embodiment of the present invention performs communication with the 3D virtual server 300 and the RD server 400, which will be described later, to receive a 3D world environment and a remote control service. You can do that. In addition, the 3D client 200 may request the 3D virtual server 300 to provide a 3D virtual environment by using an input means such as a mouse and a keyboard attached thereto, and access the RD server 400 to access the 3D client 200. This information may be transmitted to the RD server 400 so that the events generated at the RD server 400 can be reproduced intact in the RD server 400. Here, the number of 3D clients 200 may be singular or plural, and in the case of a plurality of 3D clients 200, the events generated in the 3D client 200 and the state reproduced in the RD server 400 may be at least some of the plurality of 3D clients 200. Will be shared between them.

In addition, when the 3D client 200 is provided with the 3D virtual environment from the 3D virtual server 300, a so-called remote control area (that is, an actual screen of the computer of the RD server 400 to be described later) is displayed in the 3D virtual environment. Area to be mapped) may be included as one virtual object.

In addition, the 3D client 200 calculates an object vertex for the remote control area so that the remote screen of the RD server 400 can be accurately mapped onto the remote control area on the screen of the 3D client 200. And Rotation Calculation on Object. In this case, the rotation operation may be performed based on the result of the vertex operation.

In addition, the 3D client 200 may further include a dedicated browser (not shown) program capable of displaying a 3D virtual space and a remote control area.

A more detailed description of the 3D client 200 will be described later with reference to FIG. 2.

Next, the 3D virtual server 300 according to an embodiment of the present invention may perform a function of providing a 3D virtual space on the screen of the 3D client 200.

The 3D virtual server 300 may communicate with the 3D client 200 and may provide a 3D virtual space to the 3D client 200 according to a request of the 3D client 200. At this time, the 3D virtual server 300 stores the personal information for each user of the 3D client 200, so that the user can perform the authentication process when the user accesses the 3D virtual server 300, the end of the authentication process Different 3D virtual spaces may be provided for each 3D client 200.

Finally, when the RD server 400 according to an embodiment of the present invention approaches from the 3D client 200, the RD server 400 can perform authentication for the purpose of maintaining security, and the authentication from the 3D client 200 passes successfully. This allows the 3D client 200 to access the RD server 400 and the RD server 400 begins to map the actual screen of its computer onto the remote control area on the screen of the 3D client 200. do. Meanwhile, all events occurring on the remote control area of the 3D client 200 may also be supported to be reproduced on the screen of the computer of the RD server 400 as it is. Here, the RD server 400 may also be singular or plural, and in the case of a plurality of RD servers 400, a state reproduced by the RD server 400 and events generated in the 3D client 200 may be between at least some of the plurality of RD servers 400. Will be shared from.

Meanwhile, the 3D client 200 and the RD server 400 may be digital devices, and may be configured by an industrial server or a personal computer. Examples of personal computers include desktop computers, notebook computers, workstations, PDAs, web pads, mobile phones, and the like. In addition to the above illustrated, any computing device having a computing capability with a memory means and a microprocessor can be adopted as a digital device constituting the 3D client 200 and the RD server 400 according to the present invention. .

Configuration of 3D Client 200

In the following detailed description, the internal configuration and functions of each component of the 3D client 200 performing important functions will be described.

2 is a diagram illustrating in detail the internal configuration of the 3D client 200 according to an embodiment of the present invention.

Referring to FIG. 2, the 3D client 200 according to an exemplary embodiment of the present invention may include a user interface providing unit 210, a vertex calculating unit 220, a rotation calculating unit 230, a communication unit 240, and a controller 250. It may be configured to include.

The user interface providing unit 210, the vertex calculating unit 220, the rotation calculating unit 230, the communication unit 240, and the control unit 250 included in the 3D client 200 include at least some of the 3D client 200. And program modules in communication with the. Such program modules may be included in the 3D client 200 in the form of operating systems, application modules, and other program modules, and may be physically stored on various known storage devices. In addition, these program modules may be stored in a remote storage device that can communicate with the 3D client 200. On the other hand, such program modules include, but are not limited to, routines, subroutines, programs, objects, components, data structures, etc. that perform particular tasks or execute particular abstract data types, described below, in accordance with the present invention.

The user interface providing unit 210 according to an embodiment of the present invention may allow the 3D client 200 to communicate with the 3D virtual server 300 and the RD server 400 such as a mouse and a keyboard of the 3D client 200. It is possible to provide an input means such as a user and request the 3D virtual server 300 to provide a 3D virtual environment according to the user's input, and the events generated in the 3D client 200 by connecting to the RD server 400 are RD. The information may be transmitted to the RD server 400 so that the server 400 can reproduce the information as it is.

In addition, the user interface providing unit 210 may allow a predetermined remote control area to be displayed on the screen of the 3D client 200 when the 3D virtual environment is provided from the 3D virtual server 300. Through this, the contents of the actual screen of the computer of the RD server 400 may be mapped, and through this, the remote control may be made.

In addition, the user interface providing unit 210 may display a virtual environment on the screen of the 3D client 200 with reference to a virtual camera view that may be controlled by a user's mouse or keyboard operation (for example, at an angle). And when the virtual gaze extended from the camera view is determined to intersect on the remote control area displayed on the screen of the 3D client 200, the operation is performed in the remote control mode. . However, in this state, the remote control mode may be activated in earnest when the mouse pointer is positioned on the remote control area without allowing remote control to be immediately performed.

In addition, the user interface providing unit 210 may receive a virtual environment in which an avatar such as a virtual person appears on the screen of the 3D client 200 from the 3D virtual server 300 or the like and display the virtual environment. If the user adjusts the keyboard or the mouse, the user can enjoy a visual effect such that the avatar is being adjusted. This is because the operation signal of the keyboard or mouse by the user is transmitted to the 3D virtual server 300. In the common virtual environment, when the updated avatar status is received by the user interface providing unit 210, the avatar's location and motion are deformed, so that the user can be provided with a visual effect such as the avatar being manipulated. will be. Here, the user may enjoy a visual effect as if such an avatar remotely controls the contents of the actual screen of the RD server 400 through the remote control area of the 3D client 200 in the virtual environment.

Here, the user interface providing unit 210 may handle an input by a mouse or a keyboard made by a user as follows.

Specifically, the event by the mouse may operate based on the position of the mouse pointer. If the mouse pointer is not located on the remote control area of the 3D client 200, the mouse pointer may control the avatar, and the mouse pointer If is located on the remote control area can control the remote control area and not the avatar.

In addition, the user interface providing unit 210 may be operated in conjunction with the mouse pointer to the event by the keyboard, for example, the keyboard may control the avatar if the mouse pointer is not located on the remote control area, When the mouse pointer is located on the remote control area, the keyboard may control to input letters or the like on an actual screen on the RD server 400 corresponding to the remote control area.

Meanwhile, when accessing the RD server 400 for remote control, the user interface providing unit 210 may provide a user interface for asking whether authentication passes for security purposes. If the user successfully passes the authentication, the 3D client 200 can access the RD server 400 so that the RD server 400 displays the actual screen of the remote computer that the user includes in the screen of the 3D client 200. Support on the remote control area of the device. Meanwhile, the user interface providing unit 210 transmits all events occurring on the remote control area of the 3D client 200 to the RD server 400 so that they can still be reproduced on the screen of the computer of the RD server 400. Function can be performed.

Meanwhile, according to an exemplary embodiment of the present invention, the user interface providing unit 210 may be provided with the help of the vertex calculating unit 220 and / or the rotation calculating unit 230 to be described later. The 3D client 200 can be displayed to be efficiently mapped onto the remote control area on the screen.

When the vertex calculating unit 220 according to an embodiment of the present invention detects that the remote control mode is activated, the vertex calculating unit 220 first moves a vertex located in the center of the remote control area to the lower left end point in the remote control area. It can perform a function to wait for input.

In addition, when the position of the mouse pointing by the user is detected in the remote control area displayed on the screen of the 3D client 200, the vertex calculating unit 220 calculates the coordinate value of the point to be referred to as the global coordinate system. It can be converted based on the local coordinate system set based on the inside of the remote control area. Thereafter, a relative position value with respect to the pointing point may be calculated based on the size of the entire area of the remote control region, and the actual screen of the RD server 400 may be provided by providing the relative position value to the RD server 400. It may be possible to determine which relative point on the screen the corresponding pointing point is to be displayed.

Specifically, referring to FIG. 3, a remote control area displayed on the screen of the 3D client 200 is shown. The appearance of the remote control area shown in FIG. 3 is a state where the screen is observed by the aforementioned virtual camera view. In this case, it is possible to determine in which area on the screen of the 3D client 200 the gaze extended from the camera view intersects. In this case, when the crossing area corresponds to the remote control area, the aforementioned remote control mode Will be entered. At this time, the vertex calculator 220 moves the vertex O located in the center of the remote control area to the lower left end point O 'to facilitate the operation, and then transmits the position of the mouse or the like. To make the module work. In this way, the vertex is moved to the lower left end point O ', and the lower left end point O' is mapped to match the lower left end point of the actual screen of the RD server 400 to facilitate the operation. do. An example in which a specific point in the remote control area is mapped and displayed with a specific point on the actual screen of the RD server 400 will be described in detail later with reference to FIG. 8.

On the other hand, when the remote control region is rotated by the movement of the camera view of the user, the function of the vertex calculation module alone is not sufficient. Specifically, the rotation operation unit 230 is a state in which the remote control area is rotated by a predetermined angle in order to express the view of the remote control area by the oblique camera view on the screen of the 3D client 200. Can be displayed. For example, referring to FIG. 4, when the remote control area rotates, an additional rotation operation is needed in addition to the vertex operation. Accordingly, a new vertex (O`) moved by the vertex operation, that is, the lower left endpoint Equation 1 using the following rotation matrix may be used to match the lower left end point O ″ of the remote control region rotated at a predetermined angle.

[Equation 1]

Next, the communication unit 240 according to an embodiment of the present invention has a function of allowing the user interface providing unit 210, the vertex calculating unit 220, the rotation calculating unit 230 and the like to communicate with an external device. Do this.

Finally, the control unit 250 according to an embodiment of the present invention performs a function of controlling the flow of data between the user interface providing unit 210, the vertex calculating unit 220, the rotation calculating unit 230 and the communication unit 240. do. That is, the controller 250 according to the present invention controls the flow of data from the outside or between each component of the 3D client 200, thereby providing a user interface providing unit 210, a vertex calculating unit 220, and a rotation calculating unit ( 230 and control unit 240 to perform a unique function, respectively.

In order to better understand the 3D client 200 described above, the following application examples are disclosed.

FIG. 5 is a diagram exemplarily illustrating contents displayed on an actual screen of the RD server 400 according to an exemplary embodiment.

6 is a diagram illustrating an example in which the user interface providing unit 210 displays a remote control area on a screen of the 3D client 200 according to an embodiment of the present invention.

FIG. 7 is a diagram exemplarily illustrating a case in which content displayed on an actual screen of the RD server 400 is displayed on a remote control area displayed on a screen of the 3D client 200 according to an exemplary embodiment of the present invention. . Here, in order to display the content displayed on the actual screen of the RD server 400 on the remote control area displayed on the screen of the 3D client 200, the process of FIG. 8 to be described below may be performed with reference. There will be. In the following description, the coordinates of each point will be exemplarily described.

Referring to the flowchart of FIG. 8, an operation of moving the vertex of the remote control area to the lower left end point O may be performed (S1). For reference, the calculated coordinates of the end point O are assumed to be O (123.789814, 153.376099, 21.09880), where the coordinate values correspond to numerical values by the global coordinate system with reference to the virtual camera view.

Subsequently, a coordinate value by a global coordinate system at an arbitrary point P where mouse pointing is made on the remote control area is calculated (S2). For reference, it is assumed that the calculated coordinates of the point P are P (127.745483, 157.015246, 24.737951).

Next, the coordinate value by the local coordinate system of the point P is calculated | required (S3). Here, the coordinate value by the local coordinate system of the point P is the difference between the coordinate value by the global coordinate system of the end point O from the coordinate value by the global coordinate system of the point P, and in this case, the local coordinate system of the point P The coordinate value by is calculated as (3.955673, 3.639147). For reference, the coordinate values for the z axis, which are not necessary coordinates, are removed from the global coordinate system to the local coordinate system.

Subsequently, the coordinate values (x, y) = (3.955673, 3.639147) by the local coordinate system of the point P are displayed in the x-axis and y-axis directions of the remote control area itself displayed on the screen of the 3D client 200. By dividing by the magnitude value, a relative ratio value in the x-axis direction and a relative ratio value in the y-axis direction may be obtained (S4). That is, in this case, for example, (x-axis direction relative ratio value, y-axis direction relative ratio value) = (0.574405, 0.267606) can be obtained.

Subsequently, the x-axis direction relative ratio value and the y-axis direction relative ratio value may be provided to the RD server 400 (S5).

Subsequently, based on the x-axis relative ratio value and the y-axis relative ratio value, an arbitrary point P at which the mouse pointing is performed on the remote control area displayed on the screen of the 3D client 200 is determined by the RD server 400. In operation S6, a process of calculating which point is displayed on the actual screen of the computer may be performed. Here, when the size value of the actual screen of the RD server 400 is (x-axis direction size, y-axis direction size) = (1680, 1050), on the remote control area displayed on the screen of the 3D client 200 When calculating a point P on which the mouse pointing is made on the actual screen of the computer of the RD server 400, the x-axis coordinate value is 1680 (WIDTH) * 0.574405 (X ratio) = 965, y It can be seen that the axis coordinate value is 1050 (HEIGHT) * 0.267606 (Y ratio) = 280.

Subsequently, it corresponds to an arbitrary point P on the remote control area displayed on the screen of the 3D client 200 at the position of the X and Y coordinate values calculated above on the actual screen of the computer of the RD server 400. The point may be displayed (S7).

In the present specification, an example of moving the vertex on the remote control area to the lower left end point in the remote control area has been described mainly. However, the present invention is not limited thereto, and a modification of moving the vertex on any specific point may be assumed. On the other hand, the embodiments according to the present invention can be implemented in the form of program instructions that can be executed by various computer components and recorded on a computer readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the computer-readable recording medium may be those specially designed and configured for the present invention, or may be known and available to those skilled in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs, DVDs, and magneto-optical media such as floptical disks. media), and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the process according to the invention, and vice versa.

Although the present invention has been described by specific embodiments such as specific components and the like, but the embodiments and the drawings are provided to assist in a more general understanding of the present invention, the present invention is not limited to the above embodiments. For those skilled in the art, various modifications and variations can be made from these descriptions.

Therefore, the spirit of the present invention should not be construed as being limited to the above-described embodiments, and all of the equivalents or equivalents of the claims, as well as the following claims, I will say.

100: Network
200: 3D client
300: 3D virtual server
400: RD Server

Claims (17)

In the method for performing a remote control based on the three-dimensional virtual space,
(a) receiving a three-dimensional virtual environment including a remote control area, which is an area for processing user input for remote control of a remote computer, as an object,
(b) when the remote control region is activated, causing a vertex operation to be performed based on a specific vertex in the remote control region, and
(c) by referring to the vertex arithmetic result, the contents of the actual screen of the remote computer are mapped into the remote control area so that a second point in the actual screen of the remote computer is pointed when a first point in the remote control area is pointed. Causing the point to be displayed in a pointed state and causing the first point in the remote control area to be displayed in a pointed state if the second point in the actual screen of the remote computer is pointed;
The step (b)
(b1) moving the particular vertex in the remote control area to a specific location in the remote control area, and
(b2) matching a specific position in the remote control area with a specific position on an actual screen of the remote computer. The method of claim 1,
The step (a)
And the gaze extending from the virtual camera view that can be adjusted by the user so that the three-dimensional virtual environment is displayed as it is observed when looking along the gaze. The method of claim 2,
The step (a)
The 3D virtual environment is provided including a predetermined avatar, and when a manipulation signal for the avatar is input by the user, a state of the avatar updated with new positions and actions is received from the predetermined 3D virtual server. A method in which an avatar can be provided with a visual effect such as being manipulated. The method of claim 2,
The step (b)
And activate the remote control area when a line of sight extending from the virtual camera view intersects on the remote control area. The method of claim 4, wherein
Activating the remote control area when a line of sight extending from the virtual camera view intersects on the remote control area and a mouse pointer by the user is positioned on the remote control area. The method of claim 2,
The step (b)
And when the position of the virtual camera view is moved, a rotation operation is additionally performed to show an effect that the remote control area is displayed in a rotated state. The method of claim 6,
In step (c),
And the contents of the actual screen of the remote computer are mapped into the remote control area with reference to the vertex operation result and the rotation operation result. delete The method of claim 1,
The step (b)
(b3) calculate a coordinate value of the first point in the remote control area and the coordinate value of the specific vertex according to a global coordinate system with reference to a virtual camera view, and refer to the local coordinate system in the remote control area with reference thereto. Calculating a coordinate value of the first point, and
(b4) The relative ratio of the x-axis direction and the y-axis direction of the first point with reference to the coordinate value of the first point according to the local coordinate system and the information on the x-axis and y-axis direction sizes of the remote control area. Steps to get the value
≪ / RTI > 10. The method of claim 9,
In step (c),
The second point on the actual screen of the remote computer is determined by referring to the x-axis and y-axis relative ratio values of the first point and information on the x-axis and y-axis direction sizes of the actual screen of the remote computer. Determining. In the terminal device for performing a remote control based on the three-dimensional virtual space,
A 3D virtual environment including a remote control area, which is an area for inputting a user input for remote control of a remote computer, is provided as an object, checks whether the remote control area is activated, and displays the actual screen of the remote computer. A user interface provider for allowing contents to be mapped in the remote control area, and
When it is detected that the remote control area is activated by the user interface providing unit, a vertex operation is performed based on a specific vertex in the remote control area, and the contents of the actual screen of the remote computer are displayed by the user interface providing unit. A vertex calculation unit configured to refer to the vertex calculation result in a map within a remote control area,
The vertex calculation unit,
And move the specific vertex in the remote control area to a specific location in the remote control area, and match the specific location in the remote control area with a specific location on the actual screen of the remote computer. The method of claim 11,
Rotation to additionally perform a rotation operation based on the specific vertex to show the effect that the remote control area is displayed when the position of the camera view virtually watching the 3D virtual environment is displayed. Calculator
Terminal device further comprising. The method of claim 12,
The user interface providing unit,
And a content of an actual screen of the remote computer is mapped into the remote control area with reference to the vertex operation result and the rotation operation result. delete The method of claim 11,
The vertex calculation unit,
The coordinate value of the first point in the remote control area and the coordinate value of the specific vertex are calculated according to the global coordinate system with reference to the virtual camera view, and with reference to the first point according to the local coordinate system in the remote control area. A coordinate value of the first point according to the local coordinate system and referring to information on the size of the x-axis and y-axis directions of the remote control region and the size of the x-axis direction and y of the first point And obtaining an axial relative ratio value. 16. The method of claim 15,
The user interface providing unit,
The second point on the actual screen of the remote computer is referred to with reference to the x-axis and y-axis relative ratio values of the first point and information on the x-axis and y-axis direction sizes of the actual screen of the remote computer. And determine the point matched with the first point. A computer readable recording medium having recorded thereon a computer program for executing the method according to claim 1.

Images