KR101673927B1

KR101673927B1 - Remote control system and method for vehicle

Info

Publication number: KR101673927B1
Application number: KR1020150136682A
Authority: KR
Inventors: 이수원; 하지훈; 박진수; 채화정; 양해명; 이승호
Original assignee: 숭실대학교산학협력단
Priority date: 2015-09-25
Filing date: 2015-09-25
Publication date: 2016-11-08

Abstract

The present invention provides a remote car control system and a control method thereof, to enable a user of a remote control car to feel like driving a real car. More specifically, a method to control a car remote control system includes a camera and a car having a lamp capable of adjusting the intensity of illumination, and a virtual reality (VR) device connected to the car wirelessly to output an image captured in the camera to a user. The VR device includes a pupil detection sensor capable of checking the size of a pupil, and checks the size of the pupil with the pupil detection sensor to generate lamp control information depending on the size of the pupil. The car receives the lamp control information from the VR device to control the intensity of illumination of a lamp.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a remote control system,

The present invention relates to an automobile remote control system and a control method thereof, and more particularly, to an automobile remote control system and a control method thereof that provide a first-person perspective to a user by using a VR device interlocked with a radio- have.

The R / C car has a shape similar to a real car and has a steering device, an accelerator, a stop device, and the like as in a real car. The R / C car is controlled by an analog remote controller, . These R / C automobiles usually develop into hobbies mainly by the clubs, and a lot of people are gathering and putting R / C cars on model tracks and enjoying racing by controlling their remote controls.

A remote control unit for controlling an R / C car is a remote control unit that normally operates a very small type of handle while holding a button to drive the car remotely by moving the joystick or the like attached to the remote control to the front or rear, To control the direction. However, the above remote controller has a complaint that it is necessary to carry out the operation by pressing the drive switch and the steering wheel in order to change the direction, and also it is difficult to intuitively change the direction, Respectively. Thus, the remote control including the pedal including the accelerator and the brake and the steering wheel having the same shape as the actual vehicle handle was applied to the R / C vehicle, thereby improving the feeling of driving the actual vehicle.

In recent years, research on display related to R / C automobiles has been carried out, and studies for more realistic operation of R / C automobiles are underway.

One aspect of the present invention provides a car remote control system and a control method thereof, in which a user of an R / C car can feel a sense of being realistic and driving an actual car using an R / C car and a VR device including a camera .

A control method of an automobile remote control system according to an embodiment of the present invention includes a car and a VR device connected wirelessly with the car and outputting an image photographed by the camera to a user Wherein the VR device includes a pupil detection sensor capable of detecting a size of a pupil, and the pupil detection sensor detects a size of the pupil, and controls the illumination control information according to the size of the pupil, And the automobile can receive illumination light control information from the VR device and control the illuminance of the illumination lamp.

Wherein the illumination light control information includes illumination level information, wherein generating the illumination light control information comprises: verifying the size of the pupil of the user; comparing the size of the identified pupil with a size of a predetermined reference pupil; And the illumination lamp may operate a level corresponding to the illumination level information.

The size of the reference pupil may include a size of the initial pupil of the user and a size of the reference pupil based on the size of the initial pupil.

The camera may include an illuminance sensor capable of measuring the illuminance. The checking of the size of the pupil may include adjusting the brightness of the VR device according to the illuminance measured by the illuminance sensor, And determining the size of the pupil of the pupil.

The VR device stores the predetermined operation pattern information of the user in advance. When the user performs the same operation as the operation pattern information, the VR device displays the position of the vehicle, which is a control operation matched with the operation pattern information, And outputting a map indicating the distance of the VR device.

The predetermined operation pattern information may include an operation pattern in which the user turns his or her head in the vertical upward direction in the forward looking state.

The predetermined operation pattern information includes angular velocity information and motion distance information, and the user performing the same operation as the motion pattern information may be one that compares the motion of the user with the angular velocity information and the motion distance information have.

The automobile remote control system according to an embodiment of the present invention includes an automobile having a camera and an illuminance adjustable illumination lamp and a VR device connected to the automobile in a wireless manner to output a video image taken by the camera to a user, A control system comprising: a VR device including a pupil detection sensor capable of detecting a size of a pupil, generating a light control information according to a size of the pupil by detecting the pupil size with the pupil detection sensor, And an automobile that receives the illumination light control information and controls illumination of the illumination light.

The illumination control information may include illuminance level information generated according to the size of the user's pupil, a size of the identified pupil, and a predetermined reference pupil size.

According to one aspect of the present invention, an image photographed by a camera of an R / C car is output from a VR device to a first person view so that a user can feel a sense of driving an actual car when the user controls the R / C car So as to provide a car remote control system and a control method thereof applicable to a simulated driving practice, an entertainment apparatus or an R / C car toy.

1 is a block diagram illustrating an automobile remote control system according to an embodiment of the present invention.
FIG. 2 is a perspective view showing the controller shown in FIG. 1. FIG.
3 is a plan view showing the radio controlled car shown in Fig.
4 is a perspective view showing the VR apparatus shown in FIG.
5 is a conceptual diagram of an output screen of a VR device according to an embodiment of the present invention.
FIG. 6 is a conceptual diagram illustrating changes in a pupil of a person due to light according to an embodiment of the present invention.
FIG. 7 is a view showing an angle change of a VR device according to an operation for outputting a map according to an embodiment of the present invention. FIG.
8 is a diagram showing a map output to a display device according to an embodiment of the present invention.
9 is a control block diagram of the controller shown in Fig.
10 is a control block diagram of the radio controlled car shown in Fig.
11 is a control block diagram of the camera shown in Fig.
12 is a control block diagram of the VR apparatus shown in FIG.
13 is a flowchart of an illumination lamp control according to an embodiment of the present invention.
14 is a flowchart of a map output control process according to an embodiment of the present invention.

The following detailed description of the invention refers to the accompanying drawings, which illustrate, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is to be limited only by the appended claims, along with the full scope of equivalents to which such claims are entitled, if properly explained. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the drawings.

FIG. 2 is a perspective view showing a controller shown in FIG. 1, and FIG. 3 is a schematic view of a radio remote control system shown in FIG. 1, And FIG. 4 is a perspective view showing the VR device shown in FIG. 1. As shown in FIG.

1 to 4, an automobile remote control system and a control method thereof 1 according to an embodiment of the present invention includes a controller 100, a radio control car 200, a camera 300, and a VR device 400 ).

The controller 100 can exchange information with the radio-controlled automobile 200 through wireless communication. The wireless communication used in this case may be short range wireless communication, internet, network communication, and mobile communication network. It may be NFC, Bluetooth, which is used for local communication wireless communication. The controller 100 can control the operation of the radio navigation vehicle 200 using wireless communication. The control of the operation of the radio navigation vehicle 200 may be that the user transmits the operation information inputted by using the controller 100 to the radio navigation car 200 through the wireless communication.

The controller 100 may include a steering wheel 101, a pedal 104, and a controller control device 107 in order to input operation information for controlling the radio controlled car 200.

The steering wheel 101 may receive information on the direction in which the radio navigation vehicle 200 moves from the user and may include a handle 103, a rotary shaft 102, and a steering wheel control device 108. The handle 103 may be formed in a circular ring shape so as to resemble a model of a steering wheel of an actual automobile, and may be a ring shape of a polygonal shape, a ring shape of a polygonal shape having a broken upper end, and the like. The grip 103 may be connected to one side of the rotation shaft 102 that allows the handle 103 to rotate and the other side of the rotation shaft 102 may be connected to the handle control device 108. [ The rotating shaft 102 can rotate about the central axis in the same direction when the user rotates the handle 103 and transmit the rotating direction to the handle control device 108. [ The handle control device 108 can convert the rotation direction transmitted from the rotation shaft 102 into an electrical signal and transmit the electrical signal to the controller control device 107. The electric signal may be transmitted to the controller control device 107 through wired or wireless communication.

Another handle 101 according to another embodiment may include a handle 103 and a handle control device 108. The handle 103 may be provided by a user using a motion sensor installed on the handle to rotate the handle 103 Converts the direction information into an electrical signal, and transmits the input direction information to the handle control device 108 using wireless communication.

The pedal 104 may receive driving or pause information from the user and may include an accelerator 105 and a brake 106. [ The accelerator 105 can generate a driving signal when the user applies pressure to the accelerator 105 and can transmit the generated signal to the controller controller 107. [ The brake 106 may generate a stop signal when the user applies a pressure to the brake 106 and may transmit the generated signal to the controller control device 107. [

The controller controller 107 can receive the operation information that the radio controlled car 200 inputted by the user from the steering wheel 101 and the pedal 104 moves. The controller controller 107 can transmit the received operation information to the radio-controlled automobile 200. The transmitting of the operation information to the radio navigation car 200 may be by using wireless communication.

The radio-controlled automobile 200 can exchange information with the controller 100 and the VR device 400 through wireless communication. At this time, the wireless communication can use the short-range communication, the Internet, and the mobile communication network. In addition, the radio-controlled automobile 200 may include an Arduino for wireless communication, and may perform wireless communication using HC-06, XBEE or the like, which is linked to Arduino.

The radio-controlled car 200 can receive the operation information transmitted from the controller 100 and can control the operation of the radio-controlled car 200 according to the received operation information. In order to control this operation, the radio-controlled automobile 200 may include a driving device, a steering device, and a stop device. The driving device may include a motor for transmitting power, and may be electrically connected to an acceleration chip capable of receiving operational information regarding driving. The steering apparatus may include a gear train designed to determine the direction, a power shaft connected to the gear train, and a wheel connected to the power shaft, and may be electrically connected to a steering chip capable of receiving operational information about the direction have. The stop device may include a brake device for stopping the movement of the wheel and may be electrically connected to a stop chip capable of receiving operational information about the stop.

The radio controlled car 200 according to an embodiment of the present invention may include an illumination lamp 201 installed toward the front of the radio controlled car 200. In accordance with the illumination control information transmitted from the VR device 400, The lighting lamp 201 can be controlled. At this time, the illumination lamp 201 may adjust the illumination intensity, and the illumination intensity may be adjusted in accordance with the illumination light control information transmitted from the VR device 400. The illumination intensity can be adjusted to at least three steps, including an unlighted stage. The luminaire control information may include illumination level information, and the illumination lamp 201 may operate a level corresponding to the illumination level information.

The radio controlled car 200 may also include a fuel gauge, a speedometer, a battery, and the like.

The camera 300 may be installed in the radio-controlled car 200. The location where the camera 300 is installed may be the upper, left side, right side, or front side of the radio control car 200. The photographed image taken by the camera 300 may be a first-person view image or may be a photographed image of the front of the radio-controlled car 200. The photographed image may be transmitted to the VR apparatus 400 to be provided to the user . The delivery of the photographed image to the VR device 400 is performed using wireless communication, and the wireless communication that can be used may be a local communication or a network communication technique.

The camera 300 may receive camera operation control information from the VR device 400 through wireless communication. At this time, the camera operation control information may include camera rotation information, camera enlargement information, and the like. When receiving the camera operation control information, the camera 300 can rotate according to the camera rotation information included in the camera operation control information. When the camera 300 rotates, the angle of the image taken by the camera 300 may be changed according to the rotation, and the camera 300 may transmit the taken image at the changed angle to the VR 400. The rotation of the camera 300 may be a rotation plate formed at a position where the radio-controlled car 200 and the camera 300 are in contact with each other, and a motor for rotating the rotation plate. The rotating plate motor connected to the rotating plate can operate according to the camera operation control information. The rotating plate may be fixed to the camera 300, so that the camera 300 can rotate in the same manner as the rotating plate. The turntable may be rotating left and right as well as up and down.

The camera 300 according to another embodiment of the present invention may include an illuminance sensor 301 and the camera 300 can measure the external illuminance of the radio navigation vehicle 200 through the illuminance sensor 301 , And transmit the measured illumination information to the VR apparatus 400. The illuminance sensor 301 may be an illuminance sensor 301 built in the camera 300.

The illuminance sensor 301 according to another embodiment may have an illuminance sensor 301 formed outside the camera 300 and can measure the external illuminance of the radio-controlled automobile 200 through the illuminance sensor 301 have.

The camera 300 may have a zoom function programmed inside the camera 300, and may operate the zoom according to the camera zoom information transmitted from the VR device 400. The camera magnification information may include zoom in and zoom out trial signals. When the camera 300 receives the zoom-in test signal, the camera 300 zooms in the image of the camera 300 and transmits the zoomed image to the VR 400. On the other hand, when the camera receives the zoom-out execution signal, the camera zooms out the image of the camera 300, and transmits the zoomed-out image to the VR device 400.

The camera 300 according to another embodiment of the present invention may include illumination, and the illumination operation information may be received from the VR device 400 to operate the illumination.

The VR device 400 can exchange information with the radio-controlled car 200 and the camera 300 through wireless communication. The VR device 400 may output the photographed image transmitted from the camera 300 and provide the photographed image to the user. At this time, the photographed image to be outputted may be a first-person view image. The VR device 400 may include a display device 401 and a support stand 402.

The display device 401 may output the photographed image transmitted from the camera 300 and provide the photographed image to the user. The display device 401 may be a device using a CRT, an LCD, an OLED, an LED, or the like. The display device 401 can output the captured image to the left and right sides of the center of the display device 401 by making two images. At this time, the left and right images may be outputting the same image. The display device 401 according to another aspect may be a device that corrects the photographed image in consideration of the visual field viewed along the left and right eyes of the user. At this time, the correction of the photographed image may be performed by measuring the distance between the left eye and the right eye, determining the area to be output from the photographed image by the measured distance, and outputting the image of the determined area.

The display device 401 may be in a curved shape instead of a flat surface. The photographed image output according to the curved shape can be corrected. This can be explained in detail with reference to FIG. Referring to FIG. 5, an image photographed by the camera 300 may be stored in the form of 401a. When the photographed image in the form of 401a is output to the display device 401 in a flat state without bending, a different problem does not occur. However, when the bent image is outputted to the display device 401 in a bent form, Video is output. This can correct the image in the form of 401c according to the degree of bending and output it to the display device 401, thereby outputting the image without distortion.

The support bracket 402 may allow the VR device 400 to be secured to the user's face. Although the support base 402 is formed in the form of a spectacle leg, the support base 402 according to another embodiment of the present invention may be formed of various types of supports 402 such as a hair band type, a helmet type, and the like.

The VR device 400 according to an embodiment of the present invention may include a mounting groove 403 in which a smart device can be mounted. The mounting groove 403 is a groove having a size into which the smart device can be inserted, and the size thereof may vary according to the use. The mounting groove 403 may be formed to penetrate the inside of the VR device 400. In some cases, the mounting groove 403 may be attached to the outside of the VR device 400 or may be formed outside the VR device 400 . At this time, the VR device 400 can exchange information with the smart device through wireless or wire communication. In this case, the VR device 400 outputs information transmitted from the smart device to the display device 401 . At this time, the smart device may include a motion detection sensor 404 that can detect movement of the user.

The VR device 400 according to another embodiment of the present invention can exchange information with a smart device through wireless communication. At this time, the smart device can act as a server and can exchange information with the camera 300 through wireless communication. The information exchanged between the VR device 400 and the smart device may include motion information of the user, photographed image photographed by the camera 300, and illuminance information.

The VR device 400 according to another embodiment of the present invention may include a mounting groove 403 to which a smart device can be mounted and a user can receive a photographed image of the camera 300 through a display of the smart device .

The VR device 400 may include a pupil detection sensor 405 that can detect the pupil size. The VR device 400 can detect the pupil size of the user using the pupil detection sensor 405 and generate the light control information according to the detected pupil size. The light control information may be different depending on the number of intensity of the light that can be controlled by the light.

For example, when the intensity of illumination that can be adjusted by the illumination lamp is three levels, the illumination lamp control information can generate three levels of signals. At this time, the first level is the state in which the illumination is not turned on, and the higher the step, the more the illumination is counted. Generating the illumination control information according to the detected pupil size may be to generate higher level illumination control information as the size of the pupil is larger.

Detecting the size of the pupil can be explained with reference to FIG. Referring to FIG. 6, the pupil A represents the pupil shape when the eyes are exposed in a bright place, and the pupil B represents the pupil shape when the eyes are exposed in a dark place. The pupil detection sensor 405 may detect the black portion of the pupils A and B and measure the width of the black portion. That is, the size of the pupil can be detected by measuring the size or the width of the black portion of the pupils A and B. [

The illumination light control information is generated according to the pupil size according to an embodiment of the present invention. The size of the user's pupil is checked, the size of the identified pupil is compared with the size of the predetermined reference pupil, May be to generate level information. At this time, the size of the reference pupil may include the size of the user's initial pupil, and the size of the reference pupil may be determined based on the size of the initial pupil. The size of the initial pupil may be to measure the pupil size of the user in a slightly dark state. The size of the reference pupil can be determined by arbitrarily setting the ratio or numerical value determined by the user, and by determining the size of the reference pupil by adding or subtracting the ratio or the numerical value from the size of the reference pupil. For example, if the predetermined ratio of the user is set to 30%, the size of the initial pupil of the user who is the reference is determined as the first reference, and the pupil that is 30% larger than the first reference is the second reference.

The illumination light control information is generated according to the pupil size according to an exemplary embodiment of the present invention. The illumination light control information is generated by verifying the width of the pupil and the pupil of the user, calculating the ratio of the pupil width of the user to the width of the verified user, It is possible to generate the illumination level information according to the comparison of the ratio of the pupil width of the user who has been pre-stored and the ratio of the pre-stored reference pupil. The ratio of the reference pupil may be a ratio arbitrarily set by the user in the pupil width of the user.

The determined lighting control information can be transmitted to the radio-controlled car 200.

The VR device 400 according to an embodiment of the present invention reflects illuminance information received from the camera 300 before detecting the size of the pupil by the pupil detection sensor 405, Lt; RTI ID = 0.0 > and / or < / RTI > Adjusting the illumination value of the display device 401 by reflecting the illuminance information is performed by comparing the illuminance information transmitted from the camera 300 with a predetermined luminosity level by the illuminance value, and the higher the illuminance of the received illuminance information is, The brightness level of the step may be determined and the brightness value of the display device 401 may be adjusted according to the determined brightness level to expose the user to a brightness similar to the actual environment.

The VR device 400 according to an embodiment of the present invention may include a motion detection sensor 404. The motion detection sensor 404 may be an acceleration sensor, a tilt sensor, a geomagnetic sensor, a position recognition sensor, a gyro sensor, or the like. The present invention can be a motion detection sensor 404 using a gyro sensor that measures a value of an angle of rotation of an object in a unit time with respect to an axis and informs the value by a numerical value. Motion can be detected. Detecting the movement of the user may be by sensing rotation of the user's head and movement of the user's head.

The VR device 400 may generate the motion information of the camera 300 according to the movement of the user and may transmit the motion information generated by the camera 300 when the motion detection sensor 404 detects the motion of the user. For example, when the user rotates the face to the left, the VR device 400 can sense the rotation of the user through the motion detection sensor 404 and generate the camera operation control information corresponding to the detected rotation. The VR device 400 can sense the rotation of the user through the motion detection sensor 404 when the user rotates his / her face to the right, and generate the camera operation control information corresponding to the detected rotation. In addition, when the user moves his / her face forward or backward, the VR device 400 can sense the movement through the motion detection sensor 404 and generate the camera zooming operation information corresponding to the detected movement, And transmit the generated information to the camera 300.

The VR device 400 according to an exemplary embodiment of the present invention can sense a user's specific motion through the motion detection sensor 404. When the user's specific motion is detected, A map 406 indicating the position and distance of the VR device 400 can be output. At this time, the specific movement of the user may be that the user rotates the head in the vertical upward direction in the forward looking state, and this is a diagram showing the angle change of the VR device 400 according to the operation for outputting the map 406 7.

Referring to FIG. 7, C indicates that the user is facing the user's face and steering the radio-controlled car 200, D indicates that the user is facing forward toward the map 406, And the face is moved vertically upward. When the user moves his / her head to output the map 406 to the VR device 400, the center of the user's head is set as the origin, the value in the X-axis is decelerated and the value in the Z- And the angle is?. The VR device 400 can measure the magnitude of θ and the time while the θ is moved and measure the angular velocity at which the user moves the VR device 400. The VR device 400 compares the measured angular velocity and the rotation direction with the output angular velocity information of the map 406 stored in advance, and when the measured angular velocity matches the output angular velocity information of the map 406, And can output the map 406 to the device 401. [ At this time, the measured angular velocity and the pre-stored map 406 output angular velocity information may be compared with each other in order to prevent malfunction. For example, when moving at an angular velocity sufficient to output the map 406, the measured rotational movement distance is compared with pre-stored map 406 output movement distance information, and the measured rotational movement distance is compared with the map 406 ) Output moving distance information, the map 406 may be output to the VR device 400, and if not, the motion information of the user may be transmitted to the camera. The output angular velocity information of the map 406 can be changed according to the user's setting.

On the other hand, the map 406 can be output to the display device 401, and the output map 406 can be explained with reference to FIG.

Referring to FIG. 8, the map 406 may be output to the left display device 401 and the right display device 401 in the same manner. The map 406 may be expressed numerically as a speed, a position of a car, have. The map 406 may be indicative of the location of the automobile 200 using a pre-input map. The map 406 according to another embodiment may represent the location of the user and the location of the car 200 by a point and may indicate the distance to the car 200. [ The location of the automobile 200 may be indicated using GPS.

9 is a control block diagram of the controller shown in Fig.

9, the controller 100 according to an embodiment of the present invention may include a controller communication unit 110, a controller memory unit 120, a controller input unit 130, and a controller control unit 140.

The controller communication unit 110 can transmit information to the radio controlled car 200. [ The controller communication unit 110 transmits information to the radio-controlled car 200 by using various communication means such as a wireless network, a wireless Internet, and a local area network. The information transmitted from the controller communication unit 110 to the radio navigation vehicle 200 may include operation information input by the user using the controller 100. [

The controller memory unit 120 may store necessary programs and information of the controller 100. [ The controller memory unit 120 may store a program for operating the controller controller 140 and may temporarily store operation information of the radio-controlled automobile 200 received from the user.

The controller input unit 130 may receive operation information of the radio navigation car 200 from a user. The controller input unit 130 may include a handle unit 131 and a pedal unit 132 to receive operation information of the radio navigation vehicle 200 from a user.

The handle portion 131 may receive operation information related to the direction of the radio navigation car 200 from the user. More specifically, the handle portion 131 may receive operation information and operation size information related to the direction of the radio-controlled vehicle 200 from a user. The handle portion 131 receives information input by the user through the handle 101 and measures the direction in which the handle 103 of the handle 101 rotates and the extent to which the handle 103 is rotated, (140).

The pedal unit 132 may receive driving information of the radio-controlled car 200 from a user. More specifically, the pedal unit 132 can receive driving or stop information of the radio-controlled car 200 from a user. The pedal unit 132 may receive information input by the user through the pedal 104. The accelerator 105 may receive the driving information and the brake 106 may receive the pause information. At this time, the accelerator 105 and the brake 106 measure the pressure applied by the user and can transmit the measurement information to the controller controller 140.

The controller control unit 140 can control the overall operation of the controller. The controller control unit 140 can transmit the operation information of the radio control car 200 received from the controller input unit 130 to the radio control car 200 through the controller communication unit 110. [ The controller controller 140 transmits the operation information of the radio-controlled car 200 received from the controller input unit 130 to the radio-controlled car 200 in the direction in which the handle 103 transmitted from the controller input unit 130 rotates Generates operating information on the basis of the degree-of-measurement information on which the knob 103 is rotated, and uses the pressure measured by the accelerator 105 and the brake 106 Generating the determination information by determining the degree of the acceleration and the degree of the braking, and transmitting the generated information to the radio navigation car 200.

10 is a control block diagram of the radio controlled car shown in Fig.

10, the radio-controlled automobile 200 according to the embodiment of the present invention includes a radio-controlled car communication unit 210, a radio-controlled car power supply unit 220, a radio-controlled car operation unit 230, And a control unit 240.

The radio controlled car communication unit 210 can receive information from the controller 100 and the VR apparatus 400. [ The radio-controlled mobile communication unit 210 may receive information from the controller 100 and the VR apparatus 400 by using various communication means such as a wireless network, a wireless Internet, and a local area network. The information received from the controller 100 by the radio controlled car communication unit 210 may include the operation information input by the user using the controller 100 and the radio controlled car communication unit 210 may transmit the operation information from the VR apparatus 400 Receiving the information may be illumination control information.

The radio-controlled automobile power supply unit 220 can supply power necessary for operation of each component under the control of the radio-controlled automobile controller 240. [ The radio controlled automobile power supply unit 220 may be a battery-based supply system, and in some cases, may use environmentally-friendly energy such as solar heat.

The radio control automobile operation unit 230 can receive the operation information and the light control information input by the user using the controller 100 from the radio control automobile communication unit 210. The radio-controlled automobile operation unit 230 can operate the radio-controlled automobile 200 according to the received information. The radio controlled car operating unit 230 may include a driving unit 231 and an illuminating unit 232 to operate the radio controlled car 200 according to the received information.

When the driving unit 231 receives the operation information of the radio navigation car 200, the driving unit 231 can operate the radio navigation car 200 according to the operation information. More specifically, the driving unit 231 converts the operation signal related to the direction into power through the steering chip, and applies the converted power to the radio-controlled automobile 200 through the steering apparatus. The driving unit 231 converts an operation signal related to driving through the acceleration chip into power, and applies the converted power to the radio-controlled automobile 200 through the driving unit. Further, the driving unit 231 converts the operation signal related to the stop to the power through the stop chip, and applies the converted power to the radio-controlled car 200 through the stop device. At this time, the steering apparatus, the driving apparatus, and the stop apparatus can apply the operation size and the operation intensity to the radio navigation vehicle 200 according to the operation size and the operation intensity information included in the operation signal.

When the illumination unit 232 receives illumination light control information from the radio-controlled automobile communication unit 210, it can adjust the illumination light according to the illumination light control information. The illuminating unit 232 can operate the illumination in at least three or more stages and can operate the illuminating lamp of the step transmitted from the illuminating lamp control information. The lower the level of illumination is, the lower it is, and the higher the level of illumination, the higher the level of illumination.

The radio-controlled car control unit 240 can control the overall operation of the radio-controlled car 200. The radio navigation car controller 240 may control the operation information of the radio navigation car 200 transmitted from the controller 100 and the VR device 400 to be transmitted to the radio navigation car operating unit 230. [

11 is a control block diagram of the camera shown in Fig.

Referring to FIG. 11, the camera 300 may include a camera communication unit 310, a camera power supply unit 320, a camera input unit 330, a camera operation unit 340, and a camera control unit 350.

The camera communication unit 310 can exchange information with the VR device 400 through wireless communication. The information transmitted from the camera communication unit 310 to the VR device 400 may include a photographed image and illuminance information photographed by the camera input unit 330. The information received from the VR device 400 to the camera communication unit 310 may include camera operation information.

The camera power supply unit 320 can supply the power required for the operation of each component by the camera control unit 350. The camera power supply unit 320 may be a battery-based supply system, and in some cases, may use an eco-friendly energy such as solar heat. The camera power supply unit 320 according to another embodiment may receive power from the radio controlled automobile power supply unit 220. [

The camera input unit 330 can photograph a photographed image to be transmitted to the VR apparatus 400. [ The camera input unit 330 can photograph the front of the radio-controlled car 200 through the camera 300 and generate a photographed image. Also, the camera input unit 330 can measure the external illuminance of the radio-controlled car 200 through the illuminance sensor 301 installed inside or outside the camera, and generate illuminance information.

The camera operation unit 340 may operate the camera 300 according to the camera operation control information transmitted from the VR device 400. [ The camera operation unit 340 may include a rotating plate and a rotating plate motor for operating the camera 300. The camera operation unit 340 may operate the camera 300 and the camera 300 in accordance with the camera operation control information.

The camera control unit 350 can control the overall operation of the camera. The camera control unit 350 may control the camera operation unit 340 to transmit the camera operation control information to the controller communication unit 110 and may transmit the information generated by the camera input unit 330 to the camera communication unit 310 To the VR device 400. [

12 is a control block diagram of the VR apparatus shown in FIG.

Referring to FIG. 12, the VR apparatus 400 includes a VR apparatus communication unit 410. A VR device memory unit 420, a VR device output unit 430, a VR device sensor unit 440, and a VR device control unit 450.

The VR device communication unit 410 can exchange information with the radio-controlled car 200 and the camera 300 through wireless communication. The VR device communication unit 410 may transmit the lighting control information to the radio control car 200. The VR device communication unit 410 receives the photographed image and illumination information from the camera 300, It is possible to transmit the operation information to the camera 300.

The VR device memory unit 420 may store necessary programs and information of the VR device 400. [ The VR device memory unit 420 may store a program for operating the VR device controller 450 and may temporarily store motion information of the user detected through the motion sensor 404. [

The VR device output unit 430 may output the photographed image transmitted from the camera 300 and provide it to the user. In order to output the photographed image, the VR device output unit 430 may include a display. The VR device output unit 430 according to another embodiment may be a display of a smart device mounted on the VR device 400. [ The output image can be a first-person shot image, and the same image can be output on the left and right sides based on the center of the display.

The VR device sensor unit 440 can detect movement of the user's head and generate information according to the movement, and can confirm the size of the user's pupil and generate information according to the size of the user's pupil. The generated information may be transmitted to the VR device controller 450. In order to perform this operation, the VR device sensor unit 440 may include a motion detection sensor 404 and a pupil detection sensor 405.

The motion detection sensor 404 can detect movement of the user's head. The motion detection sensor 404 may be an acceleration sensor, a tilt sensor, a geomagnetic sensor, a position recognition sensor, a gyro sensor, or the like. When the user's head moves forward or backward or rotates in the left or right direction, the motion detection sensor 404 may generate rotation information by measuring an angular velocity including information on a movement distance and a rotation direction. The generated information may be transmitted to the VR device controller 450.

The pupil detection sensor 405 can measure the size of the user's pupil and generate pupil size information. The pupil detection sensor 405 may measure the pupil size using a camera. The generated pupil size information may be transmitted to the VR device controller 450.

The VR device controller 450 can control the overall operation of the VR device 400. The VR device control unit 450 may control the VR device communication unit 410 to transmit the captured image to the VR device output unit 430 and provide the captured image to the user. The VR device controller 450 can generate the camera operation control information or the map output information using the rotation information and the motion information transmitted from the VR device sensor unit 440. Also, the VR device controller 450 can control the pupil detection sensor 405 to measure the pupil of the user, and generate the light control information according to the measured pupil size. The generated lighting control information may be transmitted to the radio-controlled automobile 200 through the VR device communication unit 410.

The VR device control unit 450 may include a determination unit 451 to generate camera operation control information, illumination control information, or map output information.

The determination unit 451 may generate the camera operation control information including the rotation direction information of the camera 300 and the rotation information including the angular velocity through the rotation information transmitted from the VR device sensor unit 440. [ At this time, when the determination unit 451 determines that the rotation information is a specific motion predetermined by the user, it may generate the map output information instead of the camera operation control information. The specific movement pre-specified by the user may be to move the face of the user facing the front face upwards in the vertical up direction. The determination unit 451 determines the rotation information as a specific motion that is predetermined by the user by comparing the rotation information with the map output angular velocity information and the map output movement distance information stored in advance in the VR device memory unit 420 .

The determination unit 451 may generate the illumination control information according to the pupil size of the user through the pupil size information transmitted from the VR device sensor unit 440. The illumination light control information may be generated by comparing pupil size information and illumination level information by pupil width. The determination unit 451 according to another embodiment may adjust the illumination value of the display device 401 by reflecting illumination information received from the camera 300 before detecting the size of the pupil by the pupil detection sensor 405 .

FIG. 13 is a flowchart of an illumination control process according to an embodiment of the present invention, and FIG. 14 is a flowchart of a map output control process according to an embodiment of the present invention.

An illumination control method according to an embodiment of the present invention will be described with reference to FIG.

First, the camera 300 can measure the external illuminance using the illuminance sensor 301 inside the camera 300. (510) The measured illuminance is transmitted to the VR apparatus 400, The VR device 400 may adjust the brightness of the user's pupil after the brightness is adjusted by using a pupil detection sensor (not shown) (520) The VR apparatus 400 may generate the light control information based on the measured pupil size and transmit it to the radio navigation car 200, and the radio navigation car 200 may transmit The illuminance level of the illumination lamp can be adjusted according to the received illumination lamp control information. (525)

A map output control method according to an embodiment of the present invention will be described with reference to FIG.

First, the VR device 400 may sense an operation pattern of the user's head using the motion detection sensor 404. (610) The VR device 400 determines whether the user's head performs the same operation as the previously stored operation pattern The VR device 400 may output the map 406 to the display 401 and the user may output the map 406 in operation 620. If the user has been previously stored The VR device 400 may transmit the motion information of the user's head to the camera 300 and the camera 300 may operate the camera 300 according to the motion information (625)

As such, the automobile remote control system and its control method (1) can be implemented in the form of program instructions that can be executed through various computer components and recorded on a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, and the like, alone or in combination.

The program instructions recorded on the computer-readable recording medium may be ones that are specially designed and configured for the present invention and are known and available to those skilled in the art of computer software.

Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like.

Examples of program instructions include machine language code such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules for performing the processing according to the present invention, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. It will be possible.

1: Automobile remote control system
100: controller
200: Radio-controlled cars
300: camera
400: VR device

Claims

A control method of an automobile remote control system including a car equipped with a camera and an illumination lamp capable of adjusting the illuminance, and a VR device connected to the automobile in a wireless manner and outputting an image photographed by the camera to the user,
The VR apparatus includes a pupil detection sensor capable of detecting the size of a pupil. The pupil detection sensor detects the size of the pupil, generates light control information according to the size of the pupil, When the user performs the same operation as the operation pattern information, outputs a map indicating the position of the vehicle or the distance between the vehicle and the VR device, which is a control operation matched with the operation pattern information ,
Wherein the automobile receives the illumination light control information from the VR device and controls illumination of the illumination light.

The method according to claim 1,
The illumination control information includes illumination level information,
The generating of the light control information includes:
Comparing the size of the identified pupil with a size of a predetermined reference pupil to generate illuminance level information according to the difference,
Wherein the illumination lamp operates a level corresponding to the illumination level information.

Claim 3 has been abandoned due to the setting registration fee.

3. The method of claim 2,
The size of the reference pupil may be,
Wherein the size of the reference pupil is determined based on the size of the initial pupil including the size of the initial pupil of the user.

Claim 4 has been abandoned due to the setting registration fee.

3. The method of claim 2,
The camera includes an illuminance sensor capable of measuring illuminance,
Confirming the size of the pupil of the user,
Further comprising adjusting the brightness of the VR device according to the illuminance measured by the illuminance sensor and determining the size of the user's pupil changed according to the adjusted brightness.

delete

The method according to claim 1,
Wherein the predetermined operation pattern information comprises:
And controlling the user to move his or her head in the vertical upward direction in a forward-looking state.

The method according to claim 1,
Wherein the predetermined motion pattern information includes angular velocity information and motion distance information,
The user performs the same operation as the operation pattern information,
And compares the motion of the user with the angular velocity information and motion distance information.

A vehicle remote control system, comprising: an automobile having a camera and an illuminance adjustable light source; and a VR device wirelessly connected to the automobile to output a video image taken by the camera to the user,
A VR device including a pupil detection sensor capable of detecting a size of a pupil and generating light control information according to a size of the pupil by detecting the pupil size with the pupil detection sensor;
And an automobile that receives the illumination light control information from the VR device and controls illumination of the illumination light,
The VR apparatus includes:
Storing the predetermined operation pattern information of the user in advance,
Further comprising outputting a map indicating the position of the vehicle or the distance between the vehicle and the VR device, which is a control operation matched with the operation pattern information, when the user performs the same operation as the operation pattern information, Control system.

9. The method of claim 8,
The illumination light control information includes:
The size of the pupil of the user is checked, the size of the detected pupil is compared with the size of the predetermined reference pupil, the generated illumination level information is generated according to the difference,
The above-
And operates the level corresponding to the illumination level information.

Claim 10 has been abandoned due to the setting registration fee.

10. The method of claim 9,
The size of the reference pupil may be,
Wherein the size of the reference pupil is determined based on the size of the initial pupil, including the size of the user's initial pupil.

Claim 11 has been abandoned due to the set registration fee.

10. The method of claim 9,
The camera includes an illuminance sensor capable of measuring illuminance,
Confirming the size of the pupil of the user,
Further comprising adjusting the brightness of the VR device according to the illuminance measured by the illuminance sensor and determining the size of the user's pupil changed according to the adjusted brightness.

delete

9. The method of claim 8,
Wherein the predetermined operation pattern information comprises:
And an operation pattern in which the user rotates the head in the vertical upward direction in the forward-looking state.

9. The method of claim 8,
Wherein the predetermined motion pattern information includes angular velocity information and motion distance information,
The user performs the same operation as the operation pattern information,
And compares the motion of the user with the angular velocity information and motion distance information.