KR101591057B1 - Remote control method and system for synchronization - Google Patents

Abstract

A remote control method and system for synchronization are disclosed. A remote control method according to an embodiment of the present invention includes a step of remotely connecting a remote control device with a control target terminal, acquiring environment information including a terminal status of a control target terminal from a connected control target terminal, A step of synchronizing the virtual control target terminal with the actual control target terminal by reflecting the environment information to the virtual control target terminal, and outputting the synchronized virtual control target terminal to the screen.

Description

[0001] The present invention relates to a remote control method and system for synchronization,

The present invention relates to a remote control technique, and more particularly, to a synchronization technique for remote control.

A remote control device connected to a network is referred to as a remote control technology, which is connected to a control target terminal located at a remote location so that the control target terminal can be controlled as if it is its own terminal. In the case of a remote control service, for example, a necessary service is a consultation service, a service consumer is a customer who desires a consultation, and a service provider is an agent, the agent displays a screen of a control target terminal virtually created in the remote control device So that the control target terminal of the customer can be remotely controlled. However, it is not easy to accurately grasp the current state of the control target terminal by only the screen content and the set value of the control target terminal. In this case, there is a fear that the request of the control target terminal user may not be properly handled.

According to one embodiment, a remote control system and method are provided that can accurately and real-time monitor the state of a control target terminal for remote control of a control target terminal.

A method for remote control of a control target terminal by a remote control device according to an embodiment includes remote control device connected to a control target terminal remotely and environment information including the terminal status of the control target terminal from a connected control target terminal Synchronizing the virtual control target terminal with the actual control target terminal by reflecting the obtained environment information to the virtual control target terminal, and outputting the synchronized virtual control target terminal to the screen do.

In the step of acquiring the environment information, the remote control device transmits environmental information including at least one of acceleration information, speed information, direction information, position information, and illumination information of the control target terminal sensed through the sensor provided in the control target terminal It can be received individually or in combination from the control target terminal.

The step of synchronizing according to an embodiment includes a step of post-processing and correcting the environment information of the obtained control target terminal, a step of converting the corrected data into data usable in the remote control device, And a step of simulating the environment information of the actual control target terminal that has been data-processed to the generated virtual control target terminal, and rendering the simulation result.

The step of generating a virtual object according to an exemplary embodiment includes the steps of acquiring terminal information of a control target terminal, acquiring three-dimensional model data and texture data of a control target terminal using the obtained terminal information, , And generating virtual objects by mapping the obtained three-dimensional model data and texture data.

In the simulating step, the remote control device measures the attitude and azimuth angle of the control target terminal by using the environment information obtained through the control target terminal, estimates the speed, the position and the illuminance, .

In the simulating step, the remote controller estimates the outdoor illuminance information using the position information obtained from the control target terminal, the weather state and the time zone information obtained at the terminal position obtained from the external server, It is possible to simulate the illuminance state of the control target terminal by comparing the illuminance values sensed from the terminal and reflect it to the virtual control target terminal.

The remote control method according to a further embodiment includes acquiring supplementary environment information from an external server with the obtained environment information and synchronizing the acquired supplementary environment information with a virtual control target terminal.

A remote control system according to another embodiment includes a control target terminal that acquires environment information including its own terminal status through a sensor, and a control unit that is connected to the control target terminal remotely to receive environment information of the control target terminal, To the virtual control target terminal to synchronize the virtual control target terminal with the actual control target terminal and output the synchronized virtual control target terminal to the screen.

A control target terminal according to an exemplary embodiment of the present invention includes a sensor for sensing environment information of a control target terminal, a terminal control unit for packetizing environmental information sensed through a sensor, and a controller for communicating with the remote control apparatus, And transmits the environment information to the remote control device.

The terminal control unit transmits the location information to the remote control device through the terminal communication unit if the detected location information is valid, acquires the location information of the network device capable of communicating with the control target terminal, Device.

A remote control apparatus according to an embodiment of the present invention includes a device communication unit that is connected to a control target terminal and receives environment information from a control target terminal and a virtual communication unit that reflects the environment information received through the device communication unit to a virtual control target terminal, A device control unit for synchronizing the control target terminal with an actual control target terminal, and a device input / output unit for outputting a virtual control target terminal synchronized through the device control unit to a screen.

The device control unit according to an embodiment includes a data processing unit for post-processing and correcting the environment information of the control target terminal received through the device communication unit and converting the corrected data into data usable in the remote control apparatus, And a physical engine for generating simulation data by reflecting the environmental information of the control target terminal, which is data-processed through the data processing unit, with respect to the generated virtual object, and rendering the simulation result.

The physical engine can be simulated by measuring the attitude and azimuth of the control target terminal using the environment information obtained through the control target terminal, estimating the speed, the position and the illuminance, and reflecting it on the virtual control target terminal.

The physical engine estimates the outdoor illuminance information using the position information obtained from the control target terminal, the weather state and the time zone information obtained from the external server, and outputs the estimated outdoor illuminance information and the illuminance value The illuminance state of the control target terminal can be estimated, and the simulation can be performed by reflecting it on the virtual control target terminal.

The device communication unit according to an embodiment requests and obtains the additional environment information from the external server with the acquired environment information, and the device control unit reflects the additional environment information acquired through the device communication unit to the virtual control target terminal to synchronize have.

According to an embodiment, when the remote control device remotely controls the control target terminal, the current state of the control target terminal can be accurately monitored in real time. That is, as the actual control target terminal is synchronized with the virtual control target terminal to be displayed on the screen of the remote control device using the environment information sensed through the sensor of the control target terminal, the current status of the control target terminal is immediately displayed on the screen . The user of the remote control device can accurately monitor the state of the control target terminal displayed on the screen, thereby efficiently providing the remote control service.

1 is a reference view showing a screen of a remote control apparatus according to an embodiment of the present invention;
2 is a configuration diagram of a remote control system according to an embodiment of the present invention;
FIG. 3 is a detailed configuration diagram of the control target terminal of FIG. 2 according to an embodiment of the present invention;
FIG. 4 is a detailed configuration diagram of the remote control device of FIG. 2 according to an embodiment of the present invention;
FIG. 5 is a detailed configuration diagram of the device control unit of FIG. 4 according to an embodiment of the present invention;
FIG. 6 is a reference diagram showing a structure diagram and parameter information of a GPS sensor packet according to an embodiment of the present invention;
FIG. 7 is a reference diagram showing the structure and parameter information of a packet of a gyro sensor and an acceleration sensor according to an embodiment of the present invention,
FIG. 8 is a reference view showing parameter information of a light intensity sensor packet according to an embodiment of the present invention;
9 is a flowchart illustrating a remote control method according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In addition, the terms described below are defined in consideration of the functions of the present invention, which may vary depending on the intention of the user, the operator, or the custom. Therefore, the definition should be based on the contents throughout this specification.

1 is a reference view showing a screen of a remote control apparatus according to an embodiment of the present invention.

Referring to FIG. 1, a remote control device 12 provides a remote control service to a control target terminal 10 located at a remote location. At this time, the control target terminal 10 can be remotely controlled through the remote control device 12. [ The current state and operations of the control target terminal 10 are directly reflected on the screen of the remote control device 12 according to the embodiment. That is, when the control target terminal 10 transmits the environment information sensed through the sensor provided in the control target terminal 10 to the remote control device 12 in real time, the remote control device 12 transmits the received environment information The state of the control target terminal 10 can be immediately displayed on the screen. The environmental information may be any information that can be sensed by the sensor, such as acceleration information, speed information, direction information, position information, and illumination information of the control target terminal 10. [

1, when the control target terminal 10 is a smartphone, the screen of the remote control device 12 displays a screen (not shown) of the control target terminal 10 A screen 112 for confirming the degree of inclination of the control target terminal 10 and a screen 114 for confirming the position of the control target terminal 10 are output together. In this case, when the remote control device 12 remotely controls the control target terminal 10, the current state of the control target terminal 10 can be accurately monitored in real time, thereby effectively providing the remote control service .

As another example of the remote control service, the agent can remotely control the customer's control target terminal 10 while viewing the screen of the control target terminal virtually created in the remote control device 12 at the request of the customer. In this case, when the control target terminal 10 is a washing machine, the level of the washing machine detected by using the gyro sensor of the washing machine is displayed on the screen of the remote control device 12 in real time, It can accurately grasp and take action accordingly.

2 is a configuration diagram of a remote control system according to an embodiment of the present invention.

2, the remote control system 1 includes a control target terminal 10, a remote control device 12, and a remote control server 14.

The control target terminal 10 located at a remote location may be a things device, for example, a household appliance such as a refrigerator, a washing machine, a microwave oven, an air conditioner, a TV, or an electronic device. The object device can be any smart device that can be connected to a network, and real-time data can be exchanged over the Internet using a sensor mounted on the object device using the Internet of things (IoT) technology. The control target terminal 10 may be a desktop, a notebook, or the like. The control target terminal 10 may be a mobile terminal that can be carried by a user, for example, a cellular phone, a cellular phone, a smart phone, a smart pad, or the like. The control target terminal 10 can be connected to the remote control server 12 by being connected to the remote control server 14. [

The remote control device 12 is a device for remotely controlling the control target terminal 10 and may be connected to the remote control server 14 via a network for remote control. The remote control device 12 may include a user interface such as a keyboard, a monitor, and a mouse for operating the control target terminal 10. [ The number of the remote control devices 12 may be plural.

The remote control server (14) supports remote control of the remote control device (12). When the remote control server 14 according to an embodiment connects the remote control device 12 and the control target terminal 10, the remote control device 12 can remotely control the connected control target terminal 10. The connection process between the remote control device 12 and the control target terminal 10 will now be described. First, the control target terminal 10 accesses to the remote control server 14 via the program installed in the control target terminal 10 via authentication using an ID and a password. The control target terminal 10 connected to the remote control server 14 registers the IP information of the control target terminal 10 in the remote control list of the remote control server 14 and waits. The remote control device 12 accesses the remote control server 14 via authentication via a remote control program. The remote control device 12 connected to the remote control server 14 receives the remote control list from the remote control server 14. At this time, when the remote control server 14 selects one of the remote control lists from the user, the remote control server 14 is connected to the control target terminal 10 by using the IP information of the selected control target terminal 10. The remote control device 12 can remotely control the connected control target terminal 10 when the control target terminal 10 is connected.

The remote control device 12 performs the remote control of the control target terminal 10 so that the actual control target terminal 10 and the remote control device 12 are controlled so that the state of the control target terminal 10 can be accurately monitored. And synchronizes the virtual control target terminals output on the screen. To this end, the control target terminal 10 acquires environment information including its own terminal status through a sensor provided in the control target terminal 10. [ The remote control device 12 connected to the control target terminal 10 receives environmental information from the control target terminal 10. [ The virtual control target terminal is synchronized with the actual control target terminal 10 by reflecting the received environment information to the virtual control target terminal. The synchronized virtual control target terminal is output to the screen of the remote control device 12. [ Accordingly, the user of the remote control device 12 can accurately monitor the current state of the control target terminal 10 in real time.

3 is a detailed configuration diagram of the control target terminal of FIG. 2 according to an embodiment of the present invention.

2 and 3, the control target terminal 10 includes a sensor 100, a terminal control unit 102, a terminal communication unit 104, a terminal input / output unit 106, and a terminal storage unit 108.

The sensor 100 is provided in the control target terminal 10 and detects environmental information of the control target terminal 10. [ The environment information may be acceleration information, speed information, direction information, position information, illumination information, and the like of the control target terminal 10. The sensor 100 may be, for example, an acceleration sensor, a gyro sensor, a geomagnetic sensor, a GPS sensor, an illuminance sensor, an ultrasonic sensor, an optical sensor, a displacement sensor, and the like.

The terminal control unit 102 controls the components constituting the control target terminal 10. That is, the terminal control unit 102 controls the terminal communication unit 104, the terminal input / output unit 106, and the terminal storage unit 108. The terminal control unit 102 processes the environment information sensed by the sensor 100 according to an embodiment of the present invention. Packet processing of the terminal control unit 102 will be described later in detail with reference to FIGS. 6 to 8. FIG.

The terminal communication unit 104 communicates with the remote control device 12. The terminal communication unit 104 can transmit the environment information processed by the terminal control unit 102 to the remote control device 12. [ A program for operating the terminal control unit 102 may be stored in the terminal storage unit 108 and data input and output through the terminal input and output unit 106 may be temporarily stored.

The terminal control unit 102 according to an exemplary embodiment determines whether the location information detected through the sensor 100 is valid. At this time, if valid, it transmits valid position information to the remote control device 12 through the terminal communication unit 104. When the control target terminal 10 is not valid, the location information of the base station located close to the network device capable of communicating with the control target terminal 10, for example, the control target terminal 10 is obtained and transmitted to the remote control device 12 . Accordingly, it is possible to provide accurate position information of the control target terminal 10, and even if it is difficult to provide accurate position information, it is possible to provide approximate position information.

4 is a detailed configuration diagram of the remote control apparatus of FIG. 2 according to an embodiment of the present invention.

2 and 4, the remote control device 12 includes a device control unit 122, a device communication unit 124, a device input / output unit 126, and a device storage unit 128.

The device communication unit 124 communicates with the control target terminal 10. The device communication unit 124 can receive environmental information of the control target terminal 10 from the control target terminal 10. [ The device control unit 122 controls the components constituting the remote control device 12. [ That is, the device control unit 122 controls the device communication unit 124, the device input / output unit 126, and the device storage unit 128.

The device control unit 122 according to an embodiment reflects the environment information received through the device communication unit 124 to the virtual control target terminal to synchronize the virtual control target terminal with the actual control target terminal 10. [ A control target terminal in the form of a virtual object is a virtual control target terminal 10, and may be a three-dimensional (3D) object. The detailed configuration of the device control unit 122 will be described in detail with reference to FIG. 5 to be described later.

The device control unit 122 according to an embodiment performs synchronization using not only the environment information obtained from the control target terminal 10 but also the additional environment information obtained from the external server through the device communication unit 124. [ To this end, the device control unit 122 requests and receives the additional environment information from the control target terminal 10 via the device communication unit 124, to the external server. The environment information obtained from the control target terminal 10 and the additional environmental information obtained from the external server are reflected on the virtual control target terminal to be displayed on the screen of the remote control device 12 and are synchronized.

For example, the device control unit 122 requests and obtains the weather state and time zone information at the corresponding location from an external weather station server based on the location information obtained from the control target terminal 10 by the device communication unit 124 . Then, the weather condition and the time zone information at the corresponding position are confirmed, and the movement speed is confirmed by calculating the change of the position value. Then, the control unit 10 acquires the illuminance value of the control target terminal 10 from the illuminance sensor of the control target terminal 10, correlates the obtained illuminance value with the corresponding position information, Estimates the outdoor illuminance and reflects it to the virtual control target terminal.

The device input / output unit 126 outputs a virtual control target terminal synchronized via the device control unit 122 to the screen. Then, a user command is input from the user and the processing result is displayed on the screen. The device input / output unit 126 may move the camera viewpoint of the view to the virtual control target terminal displayed on the screen, and may control and output the camera viewpoint so that the user can view the viewpoint in a desired direction. A program for the operation of the device control unit 122 may be stored in the device storage unit 128 and data input and output through the device input / output unit 126 may be temporarily stored.

5 is a detailed configuration diagram of the device control unit of FIG. 4 according to an embodiment of the present invention.

2, 4 and 5, the device control unit 122 includes a data processing unit 1220 and a physical engine 1222. [

The data processing unit 1220 post-processes and corrects the environment information of the control target terminal 10 received via the device communication unit 124. [ For example, the data processor 1220 filters environment information by using a digital low pass filter and removes drift of environment information by using an estimation compensator. The data processing unit 1220 converts the corrected data into data usable in the remote control apparatus 12. For example, the display unit scale of the rendering view of the remote control device 12 and the corrected environment information are converted into a metric system.

The physical engine 1222 generates a virtual object in the form of a virtual object and simulates the generated virtual object by reflecting environmental information of the controlled object terminal 10 processed through the data processing unit 1220 Renders the simulation results. To this end, the physical engine 1222 may include a physical simulation unit 1224 for creating and simulating a virtual object, and a rendering unit 1226 for rendering the simulation result. At this time, the motion of the virtual object is determined through simulation, and the virtual object whose motion is determined can be visually expressed through rendering.

The physical engine 1222 according to an embodiment generates a control object terminal in the form of a virtual object. To create the virtual object, the physical engine 1222 acquires the terminal information of the controlled terminal 10. Then, the 3D model data and the texture data for the control target terminal 10 are obtained using the obtained terminal information. Then, the obtained three-dimensional model data and texture data are mapped to create a virtual object.

For example, assuming that the control target terminal 10 is a smart phone and is operated under the Android operating system (OS), the virtual object is created using the device build model SDK provided by the Android OS, And obtains the model number of the terminal 10. Then, the acquired model number is transferred to the device model data server, and the three-dimensional model data and the texture data of the model are transmitted from the device model data server. The three-dimensional model data is, for example, data modeled according to the actual size of the model in the 1 unit / 1 cm standard. The texture data may be a photographic image in all directions (front, back, left, right, top, bottom) of the corresponding product. The photographic image may be in the form of a PNG image format (Alpha Channel). Then, the virtual object is generated by mapping the three-dimensional model data and the texture data.

The physical engine 1222 according to an embodiment reflects the environment information of the control target terminal 10 processed through the data processing unit 1220 with respect to the virtual object, and simulates the environment information to render the simulation result. Physics engine 1222 may be, for example, a DirectX engine or an OpenGL 3D engine. DirectX is Microsoft's 3D rendering language, and OpenGL 3D engine is Silicon Graphics's 3D rendering language.

The physical engine 1222 according to an embodiment applies an Attitude Heading Reference System (AHRS) algorithm to simulate a virtual object. The AHRS algorithm is an algorithm capable of attitude and azimuth measurement, velocity and position estimation. The physical engine 1222 measures the attitude and azimuth of the control target terminal 10 using the environment information acquired through the control target terminal 10 And estimates velocity, position, and illumination. The measured and estimated information is reflected on a virtual control target terminal to be displayed on the screen of the remote control device 12 and is simulated.

The physical engine 1222 according to an embodiment reflects environment information obtained from the control target terminal 10 and additional environment information obtained from an external server to a virtual control target terminal for simulation. For example, the outdoor illuminance information is estimated using the location information obtained from the control target terminal 10 and the weather information and the time zone information at the position of the control target terminal 10 obtained from the external server. At this time, the external server may be a meteorological office server. Then, the physics engine 1222 compares the estimated outdoor illuminance information with the illuminance value sensed from the control target terminal 10, and estimates the illuminance state of the control target terminal 10. Then, the estimated illuminance state is reflected on the virtual control target terminal of the remote control device 12 and is simulated.

6 is a reference diagram showing a structure diagram and parameter information of a GPS sensor packet according to an embodiment of the present invention.

2 and 6, the control target terminal 10 according to an exemplary embodiment of the present invention performs packet processing of position information sensed by the GPS sensor of the control target terminal 10 and transmits GPS sensor packets through TCP To the remote control device 12 using the protocol. The GPS sensor packet may consist of a bit (STX), a length, a type, an NMEA (National Marine Electronics Association) data, and a bit (ETX) indicating the start, as shown in FIG.

FIG. 7 is a reference diagram showing the structure and parameter information of a packet of a gyro sensor and an acceleration sensor according to an embodiment of the present invention. Referring to FIG.

2 and 7, a control target terminal 10 according to an exemplary embodiment of the present invention performs packet processing of direction and acceleration information detected through a gyro sensor and an acceleration sensor of a control target terminal 10, To the remote control device 12 using a transmission protocol such as RTP. The gyro and acceleration sensor packet includes a bit indicating the start (STX), a length, a type, sensing value data in the X axis, Y axis, and Z axis, and a bit ETX).

FIG. 8 is a reference view showing parameter information of a light intensity sensor packet according to an embodiment of the present invention. FIG.

2 and 8, the control target terminal 10 according to an exemplary embodiment of the present invention performs packet processing of the illumination information detected through the illumination sensor of the control target terminal 10, To the remote control device 12 using the protocol. As shown in FIG. 8, the light intensity sensor packet may be composed of a bit STX, a length, a type, a sub type, an illuminance value data, and a bit ETX indicating termination have.

9 is a flowchart illustrating a remote control method according to an embodiment of the present invention.

Referring to FIGS. 2 and 9, the remote control device 12 is connected to the controlled terminal 10 remotely (900).

Then, the remote control device 12 acquires environment information including the terminal status of the control target terminal 10 from the connected control target terminal 10 (910). At this time, the remote control device 12 includes at least one of acceleration information, velocity information, direction information, position information, and illumination information of the control target terminal 10 sensed through the sensor provided in the control target terminal 10 The environment information can be received from the control target terminal 10 individually or in combination.

Subsequently, the remote control device 12 reflects the environment information obtained from the control target terminal 10 to the virtual control target terminal, synchronizes the virtual control target terminal with the actual control target terminal, And outputs the terminal to the screen.

Specifically, the remote control device 12 post-processes and corrects the obtained environment information of the control target terminal 10, and converts the corrected data into data usable in the remote control device 12 (920).

Then, the remote control device 12 generates a control object terminal in the form of a virtual object (930). In the virtual object creation step 930, the remote control device 12 according to the embodiment acquires the terminal information of the control target terminal 10 and acquires the terminal information of the control target terminal 10 using the acquired terminal information Dimensional model data and texture data. Then, the obtained three-dimensional model data and texture data are mapped to create a virtual object.

Then, the remote control device 12 simulates 940 the environment information of the actual control target terminal 10 processed by the virtual object type control target terminal and renders the simulation result (950).

For example, the remote control device 12 measures the attitude and azimuth angle of the control target terminal 10 using the environment information acquired through the control target terminal 10, estimates the velocity, the position and the illuminance, The virtual control target terminal is reflected and simulated. For example, the remote control device 12 may use the weather information and the time zone information obtained from the control target terminal 10 and the control target terminal 10 obtained from the external server, . The illuminance of the control target terminal 10 is estimated by comparing the estimated outdoor illuminance information with the illuminance value sensed from the control target terminal 10, and the illuminance is reflected on the virtual control target terminal for simulation.

The remote control device 12 according to the embodiment obtains the additional environment information from the external server with the environment information obtained from the control target terminal 10. [ At this time, the obtained additional environment information can be reflected to the virtual control target terminal and can be synchronized. When acquiring the additional environment information, the remote control device 12 acquires the weather status and time zone information at the corresponding location with the location information of the control target terminal 10 sensed by the sensor of the control target terminal 10, Can be obtained.

As described above, when the remote control device 12 remotely controls the control target terminal 10, it is possible to accurately monitor the current state of the control target terminal 10 in real time, thereby effectively providing a remote control service have.

The embodiments of the present invention have been described above. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

1: remote control system 10: control target terminal
12: remote control device 14: remote control server
100: Sensor 102:
104: terminal communication unit 106: terminal input /
108: terminal storage unit 122:
124: Device communication unit 126: Device input / output unit
128: Device storage unit 1220: Data processing unit
1222: Physical engine 1224: Physical simulation part
1226:

Claims (15)

The remote control device is remotely connected to the control target terminal;
Acquiring environment information including a terminal status of a control target terminal from a connected control target terminal;
Processing the environment information of the obtained control target terminal by post-processing, and converting the corrected data into data usable in the remote control device;
Generating the control object terminal in the form of a virtual object;
Simulating the generated virtual control target terminal by reflecting environmental information of the actually controlled target terminal that has been data processed; And
Rendering the simulation result and outputting it to a screen;
The remote control method comprising: The method of claim 1, wherein the obtaining of the environment information comprises:
Environment information including at least one of acceleration information, speed information, direction information, position information, and illumination information of a control target terminal sensed through a sensor provided in the control target terminal, is received individually or in combination from the control target terminal The remote control method comprising: delete The method of claim 1, wherein the step of generating
Acquiring terminal information of a control target terminal;
Acquiring three-dimensional model data and texture data for the control target terminal using the acquired terminal information; And
Generating virtual objects by mapping the obtained three-dimensional model data and texture data;
The remote control method comprising: 2. The method of claim 1, wherein the step of simulating
A remote control method in which a posture and an azimuth of the control target terminal are measured using environmental information obtained through the control target terminal, and a speed, a position, and a roughness are estimated, . 2. The method of claim 1, wherein the step of simulating
Estimating the outdoor illuminance information using the position information obtained from the control target terminal, the weather state and the time zone information obtained from the external server, and comparing the estimated outdoor illuminance information and the illuminance value detected from the control target terminal And estimating an illuminance state of the control target terminal by comparing the received control target terminal with a virtual control target terminal, and simulating the illuminated control target terminal by reflecting the illuminated state. The remote control device is remotely connected to the control target terminal;
Acquiring environment information including a terminal status of a control target terminal from a connected control target terminal;
Acquiring additional environment information from an external server with the acquired environment information;
Synchronizing the virtual control target terminal with the actual control target terminal by reflecting the obtained environment information and the additional environment information to the virtual control target terminal; And
Outputting a synchronized virtual control target terminal to a screen;
The remote control method comprising: A control target terminal for acquiring environment information including a terminal status through a sensor; And
The virtual control target terminal is remotely connected to the control target terminal, receives the environment information of the control target terminal, reflects the received environment information to the virtual control target terminal, synchronizes the virtual control target terminal with the actual control target terminal, A remote control device for outputting a control target terminal to a screen; / RTI >
The control target terminal
A sensor for sensing environmental information of the control target terminal;
A terminal control unit for packetizing environmental information sensed by the sensor; And
A terminal communication unit for communicating with the remote control device and communicating environment information packet-processed by the terminal control unit to the remote control device;
The remote control system comprising: delete 9. The apparatus of claim 8, wherein the terminal control unit
If the location information sensed by the sensor is valid, transmits location information to the remote control device via the terminal communication unit, acquires location information of a network device capable of communicating with the control target terminal if the location information is not valid, To the remote control device. 9. The remote control device according to claim 8,
A device communication unit connected to the control target terminal for communication and receiving environment information from the control target terminal;
A device control unit for reflecting environment information received through the device communication unit to a virtual control target terminal to synchronize a virtual control target terminal with an actual control target terminal; And
A device input / output unit for outputting a virtual control target terminal synchronized through the device control unit to a screen;
The remote control system comprising: 12. The apparatus of claim 11, wherein the device control unit
A data processing unit for post-processing and correcting the environment information of the control target terminal received through the device communication unit and converting the corrected data into data usable in the remote control device; And
A physical engine for generating a control target terminal in the form of a virtual object, simulating the environment information of the control target terminal data-processed through the data processing unit with respect to the generated virtual object, and rendering the simulation result;
The remote control system comprising: 13. The system of claim 12, wherein the physics engine
Wherein the remote control system performs simulation by measuring the attitude and azimuth of the control target terminal using the environment information obtained through the control target terminal, estimating the speed, the position and the illuminance, . 13. The system of claim 12, wherein the physics engine
Estimating the outdoor illuminance information using the position information obtained from the control target terminal, the weather state and the time zone information obtained from the external server, and comparing the estimated outdoor illuminance information and the illuminance value detected from the control target terminal And estimates the illuminance state of the control target terminal and simulates the illumination control target terminal by reflecting it to the virtual control target terminal. 12. The method of claim 11,
The device communication unit requests and obtains the additional environment information from the external server with the acquired environment information,
Wherein the device control unit reflects the additional environment information acquired through the device communication unit to the virtual control target terminal and synchronizes them.

Images