KR101671641B1 - System and method for performing a remote control using a vr device - Google Patents
System and method for performing a remote control using a vr device Download PDFInfo
- Publication number
- KR101671641B1 KR101671641B1 KR1020150114898A KR20150114898A KR101671641B1 KR 101671641 B1 KR101671641 B1 KR 101671641B1 KR 1020150114898 A KR1020150114898 A KR 1020150114898A KR 20150114898 A KR20150114898 A KR 20150114898A KR 101671641 B1 KR101671641 B1 KR 101671641B1
- Authority
- KR
- South Korea
- Prior art keywords
- remote control
- camera
- image
- control unit
- microphone
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 230000002159 abnormal effect Effects 0.000 claims abstract description 18
- 238000004891 communication Methods 0.000 claims description 18
- 238000001514 detection method Methods 0.000 claims 5
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 2
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/02—Control of position or course in two dimensions
- G05D1/0202—Control of position or course in two dimensions specially adapted to aircraft
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/0011—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot associated with a remote control arrangement
- G05D1/0038—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot associated with a remote control arrangement by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/0088—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours
-
- H02J7/025—
Abstract
According to an exemplary embodiment of the present invention, there is provided a method of remotely controlling a remote controller, comprising: compressing multimedia data received from a camera and a microphone of a remote control; and outputting a VR image by decoding the compressed multimedia data; Controlling the remote controller according to an instruction to perform the remote control as the remote control is performed from the pilot based on the VR image; And operating the remote controller based on a predetermined remote control situation as an abnormal operation is detected on the remote control body.
Description
The following description relates to a remote control technique, and relates to a remote control system and method using a VR device.
Unmanned airplanes have been used for military purposes such as the air force, and recently the range of applications for photographic, personal hobbies, and courier services has been increasing. Pilots can steer the drones from the cockpit located inside the building with the unmanned airplane. At this time, the pilot of the unmanned airplane can control the unmanned airplane based on the image transmitted from the camera of the unmanned airplane by determining the situation of the pilot.
Such a conventional unmanned airplane performs remote control through a general LCD screen such as a monitor that receives images from an unmanned airplane. However, remote pilot pilots can take turns turning their heads to look at other places, which can lead to an accident that can be lost. In addition, since the camera of the remote control body is controlled based on the button of the controller, there is an inconvenience in terms of UX.
Korean Patent Laid-Open No. 10-2013-0067796 discloses an apparatus and a method for remote controlling an unmanned mobile object using a virtual world.
A remote control system according to an embodiment proposes a method of controlling a remote control body using a VR device.
According to one embodiment, a method of remotely controlling a remote control comprises: compressing a multimedia data received from a camera and a microphone of a remote control and outputting the VR image by decoding the compressed multimedia data; Controlling the remote controller according to an instruction to perform the remote control as the remote control is performed from the pilot based on the VR image; And operating the remote controller based on a predetermined remote control situation as an abnormal operation is detected on the remote control body.
According to one aspect, the remote control method further includes providing the VR mode and the general mode to be selected based on the use environment of the remote control body, and when an error occurs in the remote control body, Lt; / RTI >
According to another aspect of the present invention, the step of providing the VR mode and the general mode to be selected based on the use environment of the remote control body may include a step in which the camera and the microphone enter the power saving mode when the normal mode is selected, And entering a dormant state.
According to another aspect of the present invention, there is provided a method of compressing multimedia data received from a camera and a microphone of a remote controller and outputting a VR image by decoding the compressed multimedia data, And moving the camera of the steerable body to provide a VR image corresponding to the moved position.
According to another aspect of the present invention, there is provided a method of compressing multimedia data received from a camera and a microphone of a remote control and outputting a VR image by decoding the compressed multimedia data, And establishing a separate communication path with respect to the VR image, so that the streaming of the VR image is reproduced without delay.
According to another aspect of the present invention, the step of operating the remote control unit based on a predetermined remote control state when an abnormal operation is detected on the remote control unit may be performed when the operation of the camera and the microphone of the remote control unit is abnormally performed Or if the communication with the camera and the microphone of the remote control body is cut off, storing the movement route and moving the stored route backward.
According to another aspect of the present invention, the step of operating the remote control unit based on a preset remote control condition as an abnormal operation is detected on the remote control unit may include: And providing the wireless charging and moving to a location of a preset charging station.
According to an embodiment, a system for remotely controlling a remote controller includes a VR image output unit for compressing multimedia data received from a camera and a microphone of a remote control unit, and outputting a VR image by decoding the compressed multimedia data, ; A control unit for controlling the remote controller according to a command to perform the remote control according to the remote control being performed from the pilot based on the VR image; And a processor for operating the remote controller based on a predetermined remote control situation as an abnormal operation is detected on the remote controller.
According to one aspect of the present invention, the remote control system further includes a selection unit for selecting a VR mode and a normal mode based on the use environment of the remote control unit, and when an error occurs in the remote control unit, Lt; / RTI >
According to another aspect of the present invention, the selection unit may select the normal mode so that the camera and the microphone enter the power saving mode and the error correction unit enters the dormant state.
According to another aspect of the present invention, the VR image output unit may move the camera of the remote controller according to the movement of the pilot, and may provide the VR image corresponding to the moved position.
According to another aspect of the present invention, the output unit of the VR image may establish a separate communication path for the VR image received from the remote controller, so that the streaming of the VR image may be reproduced without delay.
According to another aspect of the present invention, the processing unit stores the movement route when the operation of the camera and the microphone of the remote control body is abnormal, or when the communication with the camera and the microphone of the remote control body is broken, Can be moved backward.
According to another aspect of the present invention, the processing unit may incorporate a wireless charging function as the battery of the remote control body is discharged, and may provide the wireless charging and move to a predetermined charging station position.
The remote control system according to one embodiment can provide a user friendly system that can easily adapt to a first-time user using a VR device.
The remote control system according to one embodiment can contribute not only to an expensive remote control body such as an unmanned airplane but also to a leisure industry in which a camera and a microphone are installed in an RC car, a quad copter,
1 is a diagram for explaining an outline operation of a remote control system according to an embodiment.
2 is a diagram for explaining operations of a remote control system and a remote control unit according to an embodiment.
3 is a block diagram illustrating a configuration of a remote control system according to an embodiment.
4 is a diagram for explaining control of a remote controller in a remote control system according to an embodiment.
5 is a flowchart illustrating a remote control method of a remote control system according to an embodiment.
Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.
1 is a diagram for explaining an outline operation of a remote control system according to an embodiment.
The
Network 110 may be a medium used to provide communication links between data processing systems, computers, servers, and various devices. The
The
The
The
2 is a diagram for explaining operations of a remote control system and a remote control unit according to an embodiment.
The remote control system can be remotely controlled through data transmission / reception between the
The
The
In the case of error correction of the
When the camera of the
3 is a block diagram illustrating a configuration of a remote control system according to an embodiment.
The
The VR
The
The
A selector (not shown) may be provided to select the VR mode and the normal mode based on the usage environment of the remote control. The selection unit can execute the error correction mode as an error occurs in the remote control unit. As the selection unit is selected in the normal mode, the camera and the microphone enter the power saving mode and the error correction unit can enter the sleep state.
4 is a diagram for explaining control of a remote controller in a remote control system according to an embodiment.
Compresses the multimedia data received from the camera and the microphone of the
The remote control system may provide for selecting the VR mode and the normal mode based on the usage environment of the
The remote control system can operate the
The remote control system can incorporate a wireless charging function as the battery of the
The remote control system may establish a separate communication path for the VR image received from the
5 is a flowchart illustrating a remote control method of a remote control system according to an embodiment.
The remote control method can be performed by a remote control system, and the remote control system will be described with reference to FIG. 1 to FIG.
In
In
In
The remote control system according to an exemplary embodiment provides a more user-friendly remote control system, so that even a first person can easily adapt to the system.
The remote control system according to an exemplary embodiment can be remotely operated by installing a camera and a microphone on an RC car, a quad copter, a car, etc., in addition to an expensive pilot such as an unmanned airplane.
The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA) , A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.
The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.
The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.
Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.
Claims (14)
Compressing multimedia data received from a camera and a microphone of a remote control and outputting a VR image by decoding the compressed multimedia data;
Controlling the remote controller according to an instruction to perform the remote control as the remote control is performed from the pilot based on the VR image;
Providing a VR mode and a normal mode to be selected based on the use environment of the remote control body, or executing an error correction mode as an error occurs in the remote control body; And
Operating the remote control unit based on a predetermined remote control situation as an abnormal operation is detected on the remote control unit
Lt; / RTI >
The method according to claim 1, wherein the operation of the remote control unit based on a preset remote control condition upon detection of an abnormal operation on the remote control unit comprises:
When the operation of the camera and the microphone of the remote control unit is abnormally performed or when the communication with the camera and the microphone of the remote control unit is broken, the movement path is stored to move the stored path backward, A step of providing a wireless charging function with the built-in wireless charging function as the battery is discharged and moving the wireless charging device to a preset charging station position
Wherein the remote control remote control method comprises:
Wherein the step of providing for selecting the VR mode and the normal mode based on the use environment of the remote control body comprises:
When the normal mode is selected, the camera and the microphone enter the power save mode, and the error correction unit enters the sleep state
Wherein the remote control remote control method comprises:
Wherein the step of compressing the multimedia data received from the camera and the microphone of the remote controller and outputting the VR image by decoding the compressed multimedia data comprises:
A camera of the remote control body is moved according to the detection of the movement of the pilot, and a VR image corresponding to the moved position is provided
Wherein the remote control remote control method comprises:
Wherein the step of compressing the multimedia data received from the camera and the microphone of the remote controller and outputting the VR image by decoding the compressed multimedia data comprises:
A separate communication path is established for the VR image received from the remote control, and the streaming of the VR image is reproduced without a delay
Wherein the remote control remote control method comprises:
The method according to claim 1, wherein the operation of the remote control unit based on a preset remote control condition upon detection of an abnormal operation on the remote control unit comprises:
When the operation of the camera and the microphone of the remote control unit is abnormal or when the communication with the camera and the microphone of the remote control unit is broken, the movement path is stored and the stored path is moved backward
Wherein the remote control remote control method comprises:
The method according to claim 1, wherein the operation of the remote control unit based on a preset remote control condition upon detection of an abnormal operation on the remote control unit comprises:
A step of providing a wireless charging function as the battery of the remote control body is discharged and providing the wireless charging and moving to a position of a predetermined charging station
Wherein the remote control remote control method comprises:
A VR image output unit for compressing multimedia data received from a camera and a microphone of a remote control unit and outputting a VR image by decoding the compressed multimedia data;
A control unit for controlling the remote controller according to a command to perform the remote control according to the remote control being performed from the pilot based on the VR image;
A selection unit for providing a VR mode and a normal mode to be selected based on the use environment of the remote control unit or an error correction mode being executed as an error occurs in the remote control unit; And
And a processor for operating the remote control unit based on a predetermined remote control state when an abnormal operation is detected on the remote control body
Wherein,
When the operation of the camera and the microphone of the remote control unit is abnormally performed or when the communication with the camera and the microphone of the remote control unit is broken, the movement path is stored to move the stored path backward, As the battery is discharged, a wireless charging function is built in to provide the wireless charging and to move the wireless charging function to a preset charging station position
Wherein the remote control remote control system comprises:
Wherein the selection unit comprises:
When the normal mode is selected, the camera and the microphone enter the power saving mode and the error correction unit enters the dormant state
The remote control remote control system comprising:
The VR image output unit includes:
The camera of the remote control body is moved according to the detection of the movement of the pilot, and the VR image corresponding to the moved position is provided
The remote control remote control system comprising:
The VR image output unit,
A separate communication path is established with respect to the VR image received from the remote control so that the streaming of the VR image is reproduced without delay
The remote control remote control system comprising:
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150114898A KR101671641B1 (en) | 2015-08-13 | 2015-08-13 | System and method for performing a remote control using a vr device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150114898A KR101671641B1 (en) | 2015-08-13 | 2015-08-13 | System and method for performing a remote control using a vr device |
Publications (1)
Publication Number | Publication Date |
---|---|
KR101671641B1 true KR101671641B1 (en) | 2016-11-01 |
Family
ID=57484919
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150114898A KR101671641B1 (en) | 2015-08-13 | 2015-08-13 | System and method for performing a remote control using a vr device |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101671641B1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20180128606A (en) | 2017-05-24 | 2018-12-04 | (주)루쏘팩토리 | Moving virtual reality experience system |
CN110083161A (en) * | 2019-05-16 | 2019-08-02 | 广州文远知行科技有限公司 | Long-range adapting method, device, equipment and the storage medium of pilotless automobile |
KR20200108530A (en) | 2019-03-05 | 2020-09-21 | 조동욱 | Method for generating zone map to apprehend the location of unnanned remote control car and control system of unmanned remote control car |
US11173605B2 (en) | 2018-02-26 | 2021-11-16 | dogugonggan Co., Ltd. | Method of controlling mobile robot, apparatus for supporting the method, and delivery system using mobile robot |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR980010587A (en) * | 1996-07-20 | 1998-04-30 | 구자홍 | Power saving control method of digital camera |
-
2015
- 2015-08-13 KR KR1020150114898A patent/KR101671641B1/en active IP Right Grant
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR980010587A (en) * | 1996-07-20 | 1998-04-30 | 구자홍 | Power saving control method of digital camera |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20180128606A (en) | 2017-05-24 | 2018-12-04 | (주)루쏘팩토리 | Moving virtual reality experience system |
US11173605B2 (en) | 2018-02-26 | 2021-11-16 | dogugonggan Co., Ltd. | Method of controlling mobile robot, apparatus for supporting the method, and delivery system using mobile robot |
US11845188B2 (en) | 2018-02-26 | 2023-12-19 | dogugonggan Co., Ltd. | Method of controlling mobile robot, apparatus for supporting the method, and delivery system using mobile robot |
KR20200108530A (en) | 2019-03-05 | 2020-09-21 | 조동욱 | Method for generating zone map to apprehend the location of unnanned remote control car and control system of unmanned remote control car |
CN110083161A (en) * | 2019-05-16 | 2019-08-02 | 广州文远知行科技有限公司 | Long-range adapting method, device, equipment and the storage medium of pilotless automobile |
CN110083161B (en) * | 2019-05-16 | 2022-07-05 | 广州文远知行科技有限公司 | Remote take-over method, device, equipment and storage medium for unmanned vehicle |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101671641B1 (en) | System and method for performing a remote control using a vr device | |
EP3397554B1 (en) | System and method for utilization of multiple-camera network to capture static and/or motion scenes | |
JP6279097B2 (en) | Control method and device for drone based on headless mode | |
JP6774597B2 (en) | Unmanned mobile device, takeover method, program | |
KR101978967B1 (en) | Device of recognizing predetermined gesture based on a direction of input gesture and method thereof | |
JP7317234B2 (en) | System and method for unmanned aerial system communication | |
EP3522542B1 (en) | Switching between multidirectional and limited viewport video content | |
WO2018120198A1 (en) | Image processing method and device, unmanned aerial vehicle and receiving end | |
US20200244970A1 (en) | Video processing method, device, aerial vehicle, system, and storage medium | |
JP5979960B2 (en) | Control device, control method and program | |
US9727055B2 (en) | System and method for video processing and presentation | |
CN106054915A (en) | Unmanned aerial vehicle control method and unmanned aerial vehicle control device | |
US10583563B2 (en) | Methods and systems for advanced communications in robotic systems | |
JP6525291B2 (en) | Location management apparatus, location management method, and program | |
CN108924520B (en) | Transmission control method, device, controller, shooting equipment and aircraft | |
WO2019100249A1 (en) | Method of controlling gimbal, gimbal, and unmanned aerial vehicle | |
US20230341851A1 (en) | Remote Operation of Robotic Systems | |
KR101818232B1 (en) | Apparatus for controlling emergency, drone having the same and method for controlling drone having the same | |
US11275390B2 (en) | Control system and method for drone with remote controller | |
CN105245837A (en) | Battle game control method, device and system based on unmanned aerial vehicle | |
US20190077509A1 (en) | Method of far-end control for unmanned aerial vehicle | |
CN110226144B (en) | Virtual reality remote valet parking | |
US11575832B2 (en) | Imaging device, camera-mounted drone, mode control method, and program | |
WO2019241970A1 (en) | Unmanned aerial vehicle speaker control method and device | |
JP2019064349A (en) | System, and control method, program of the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
E701 | Decision to grant or registration of patent right | ||
GRNT | Written decision to grant | ||
FPAY | Annual fee payment |
Payment date: 20191001 Year of fee payment: 4 |