KR101892238B1 - System and method for remote simulating vehicles using head mounted displa - Google Patents

System and method for remote simulating vehicles using head mounted displa Download PDF

Info

Publication number
KR101892238B1
KR101892238B1 KR1020160007600A KR20160007600A KR101892238B1 KR 101892238 B1 KR101892238 B1 KR 101892238B1 KR 1020160007600 A KR1020160007600 A KR 1020160007600A KR 20160007600 A KR20160007600 A KR 20160007600A KR 101892238 B1 KR101892238 B1 KR 101892238B1
Authority
KR
South Korea
Prior art keywords
image
user
panel
hand
operation panel
Prior art date
Application number
KR1020160007600A
Other languages
Korean (ko)
Other versions
KR20160095614A (en
Inventor
이지선
류제규
Original Assignee
(주)이노시뮬레이션
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)이노시뮬레이션 filed Critical (주)이노시뮬레이션
Publication of KR20160095614A publication Critical patent/KR20160095614A/en
Application granted granted Critical
Publication of KR101892238B1 publication Critical patent/KR101892238B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00—Simulators for teaching or training purposes
    • G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Abstract

The present invention relates to a simulation system using HMD and a control method thereof, and more particularly, to a head mound display (HMD) including an image display unit for displaying a virtual environment image including a virtual operation panel; A camera for photographing a user's hand gesture performed on a blue screen; A photographed image analyzing unit for recognizing the user's hand movements in the image photographed by the camera and judging the position of the user's hand and the user's input to the virtual operation panel with respect to the virtual operation panel; A virtual environment image generation unit for generating a panel image by synthesizing the hand image of the user with the image of the virtual operation panel and generating a traveling image by performing simulation according to the user input; And a display unit for displaying the virtual environment image displayed on the head mount display by generating the panel image synthesized by the hand image of the user and the running image simulated according to the hand operation of the user according to the hand operation of the user input by the camera And a control unit for controlling the control unit. Thus, according to the simulation system using the HDM and the control method thereof, the simulation environment can be implemented by accessing the operation panel even using the HMD which obscures the driver's view.

Description

Technical Field [0001] The present invention relates to a simulation system using HMD,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a simulation system using a head mounted display (HMD) and a control method thereof, and more particularly, to a simulation system using a head mounted display The present invention relates to a simulation system using an HMD that can be simulated and a control method thereof.

Generally, user convenience is greatly increased due to development of transportation means such as automobiles, airplanes and trains. However, in order to drive or operate these means of transportation, it is necessary to train drivers who are subjected to certain tests.

Especially, in the case of airplanes or trains, it is possible to transport a large number of passengers. In case of an untrained accident, a large number of casualties may occur. Therefore, driver training requires more advanced training than that of a general car.

Accordingly, a variety of training programs for training unskilled driving trainees are provided, and simulation apparatuses capable of simulating driving environments without actually hovering on automobiles, airplanes, and trains are proposed.

Since these simulation devices can simulate the actual operating environment as much as possible, education effects for driving trainees are excellent, and in recent years, simulation devices have been increasingly used in various fields.

1 is a diagram showing a conventional simulation system.

Referring to FIG. 1, the conventional simulation system 10 includes a display unit 1 on which front and background images are displayed at the time of operation, and an operation panel (instrument panel) 5 for controlling the driving and vehicle driving conditions by the driver.

In the operation panel 5, the same environment as that of an operation panel of an automobile, a train, or an airplane, which is an object of actual simulation, is created, and an operation for actual operation control can be practiced.

The display unit 1 displays the surrounding environment shown by the driver in actual operation.

In the simulation system 10, when the driver operates the operation panel 5 corresponding to the surrounding environment displayed on the display unit 1, the simulation system 10 simulates the change of the surrounding environment according to the changed driving conditions, 1). Accordingly, the user can obtain an experience similar to that during actual operation through the change of the speed feeling and the distance feeling of the screen displayed on the display unit 10. [

The conventional simulation system 10 displays only one environment change in one display unit 1 in order to realize an operating environment close to an actual situation. Therefore, there is a limitation in realizing a simulation environment capable of securing a wide viewing angle of the driver.

However, if the number of displays increases, the production cost and the maintenance cost of the simulation system increase, and the installation space as much as the display provided must be ensured .

In addition, when a plurality of display units are used, it is difficult to realize a natural image by the bezel between each display unit. Also, since the images rasterized and outputted to the display unit 1 have no stereoscopic effect, .

To solve this problem, a simulation system using an HMD (Head Mounted Display) that can be worn by a user like a goggle has been proposed.

However, the simulation system using the HMD has a problem in that when the HMD is worn to view the virtual environment, the operation panel can not be confirmed because it hides the entire view of the user.

Korean Patent No. 10-1279869: Image display device and method of flight simulator using head mounted display

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and provides a simulation system and a control method thereof using an HMD that can implement a simulation environment by accessing an operation panel even using an HMD that obscures the driver's vision. .

According to an aspect of the present invention, there is provided a head mound display (HMD) including a video display unit for displaying a virtual environment image including a virtual operation panel; A camera for photographing a user's hand gesture performed on a screen of a specific color; A photographed image analyzing unit for recognizing the user's hand movements in the image photographed by the camera and judging the position of the user's hand and the user's input to the virtual operation panel with respect to the virtual operation panel; A virtual environment image generation unit for generating a panel image by synthesizing the hand image of the user with the image of the virtual operation panel and generating a traveling image by performing simulation according to the user input; And a display unit for displaying the virtual environment image displayed on the head mount display by generating the panel image synthesized by the hand image of the user and the running image simulated according to the hand operation of the user according to the hand operation of the user input by the camera And a control unit for controlling the HMD.

Here, the HMD may include a user sensing sensor for sensing the movement of the user, and the controller may provide the virtual environment image corresponding to the viewer's line of sight according to the sensing result of the user sensing sensor.

The captured image analyzing unit may determine a user input to the virtual operation panel by determining a button or a lever selected on the virtual operation panel by the position of the user's hand and the hand operation of the user.

The virtual environment image generating unit may include a panel image generating unit for generating a panel image by synthesizing the hand image of the user with the image of the virtual operation panel; A running image generating unit for generating a running image by simulation according to the user input; An image synthesizer for synthesizing the panel image and the running image to generate a virtual environment image; . ≪ / RTI >

Here, the image combining unit may generate the virtual environment image such that the traveling image is displayed on the upper side of the image display unit of the HMD, and the panel image is displayed on the lower side.

 According to another aspect of the present invention, there is provided a method of displaying a virtual environment image, the method comprising: displaying a virtual environment image including a virtual operation panel on a head mound display (HMD); Capturing a user's hand gesture performed on the virtual operation panel on a screen of a specific color; Recognizing the hand operation of the user in the image photographed by the camera, and determining the position of the user's hand and the user's input to the virtual operation panel with respect to the virtual operation panel; Generating a panel image by synthesizing the hand image of the user with the image of the virtual operation panel and generating a traveling environment image by simulating the panel image by the user input; And displaying the virtual environment image on the HMD. A method of controlling a simulation system using an HMD is provided.

The method may further include sensing movement of the user; The step of displaying the virtual environment image on the HMD may include displaying a virtual environment image corresponding to the user's gaze according to the movement of the user.

The step of recognizing the user's hand movements in the image photographed by the camera and judging the position of the user's hand and the user's input to the virtual operation panel with respect to the virtual operation panel, And judging a button or a lever selected on the virtual operation panel by the hand operation of the user and judging a user input to the virtual operation panel.

 The step of generating a panel image by synthesizing the hand image of the user with the image of the virtual operation panel and generating a driving image by simulating the panel image by the user input, Generating a panel image by synthesizing the user's hand image with the image; Generating a traveling image by performing simulation according to the user input; And generating a virtual environment image by synthesizing the panel image and the running image.

The generating of the virtual environment image by combining the panel image and the running image may include generating the virtual environment image such that the traveling image is displayed on the upper side of the image display unit of the HMD and the panel image is displayed on the lower side Step < / RTI >

According to the simulation system and control method using the HDM of the present invention, the simulation environment can be implemented by accessing the operation panel even by using the HMD which obscures the driver's view.

1 is a view for explaining a conventional simulation apparatus.
2 is a use state diagram of a simulation system using an HMD according to an embodiment of the present invention.
3 is a control block diagram of a simulation system using an HMD according to an embodiment of the present invention.
4 is a control block diagram of the virtual environment image generating unit of FIG.
5 is a control flowchart of a simulation system using an HMD according to an embodiment of the present invention.
FIGS. 6 to 8 are diagrams illustrating simulation screens of the present invention. FIG.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description with reference to the accompanying drawings, the same or corresponding components will be denoted by the same reference numerals, and redundant description thereof will be omitted.

2 is a use state diagram of a simulation system 100 using an HMD (Head Mounted Display) according to an embodiment of the present invention.

The simulation system 100 using the HMD of the present invention includes an HMD 150 for displaying a driving image at the time of driving, a panel image for driving operation, and a camera 130 for photographing a hand motion of a user controlling driving conditions , And a screen 120 of a specific color to enhance the perception of the hand gesture.

A technology called Chroma Key is used as a technique to synthesize two images. If there are two images, it is possible to remove a narrow range of colors from one of the images or to make a transparent image, The technology is also known as color key, color separation overlay, green screen or blue screen.

Hereinafter, a description will be given using a blue screen which is used when an image is synthesized using chroma key technology.

The blue screen 120 is for realizing a virtual operation panel, and is installed at a position where the user can experience a control by the user on the main body B provided with a seating portion for seating the user. That is, the user is provided at the position where the actual operation panel of the automobile, the train, or the airplane to be simulated is installed by the user, and the user reaches the same position as the operation panel for operating the various operation buttons or levers of the operation panel Respectively.

The camera 130 is installed in the main body B or the HMD 150 to photograph the blue screen 120 area. Accordingly, the user can photograph the hand operation that moves or moves the hand on the blue screen 120 in order to control the operation panel.

The HMD 150 is mounted on the head of a user to display a virtual environment image. The virtual disparity image includes a virtual panel image and a running image at the time of operation. Here, the image of the hand of the user photographed by the camera 130 is reflected on the panel image, so that the user can feel the reality that the user operates the actual operation panel.

According to this configuration, the simulation system 100 using the HMD 150 of the present invention can display the panel image provided through the HMD 150 and display the hand operation of the user performing the operation operation on the blue screen 120 to the camera 130 And provides a hand image of a user who operates the panel to the HMD 150, so that it is possible to provide the same realistic feeling as that of operating the actual panel. Further, it is possible to recognize the input of the panel selected by the user by recognizing the photographed operation of the user, and to feedback the user through the HMD 150 with the running image simulated according to the panel input of the user.

3 is a control block diagram of the simulation system 100 using the HMD according to the embodiment of the present invention.

The simulation system 100 using the HMD includes a camera 130 for photographing a user's hand movements performed on the blue screen 120, a user detection sensor 151 for detecting movement of the user, A virtual environment image generating unit 170 for generating a virtual environment image including a moving image according to a user input and a panel image in which a user's hand image is synthesized, A generating unit 200, and an image display unit 152 provided in the HMD 150 to display a virtual environment image.

The camera 130 is installed in the main body B or the HMD 150 to photograph the area of the blue screen 120 and deliver the photographed image to the control unit 110. The camera 130 may photograph a hand gesture that the user moves or moves his / her hand in order to control the operation panel on the blue screen 120. [

The user sensing sensor 151 provided in the HMD 150 senses the user's movement. The user detection sensor 151 can detect the position, direction, rotation, tilt, movement speed, direction of the user's gaze, etc. of the user's head wearing the HMD 150. Accordingly, the control unit 110 can display an image in accordance with both eyes according to the movement of the user.

The image display unit 152 included in the HMD 150 displays a virtual environment image provided by the control unit 110. [ As the image display unit 152, an LED display, an LCD display, or the like may be applied, and more preferably, a stereo type display may be used to display stereoscopic images.

The photographed image analysis unit 170 analyzes the hand motion image of the user photographed through the camera 130 and recognizes the position and the motion of the hand. The photographed image analysis unit 170 recognizes the user's hand from the captured image and determines the position and operation of the user's hand on the virtual operation panel. The photographed image analysis unit 170 determines the button or lever of the panel selected by the position and operation of the user's hand according to the analysis result, and transmits the determination result to the control unit 110.

The virtual environment image generation unit 200 generates a virtual environment image by reflecting the position of the user's hand determined by the photographed image analysis unit 170 and the user's panel input and outputs the generated virtual environment image to the HMD 150 And provides it to the video display unit 152. The virtual environment image generation unit 200 provides a user's hand image for operating the operation panel reflecting the position and operation of the user's hand on the virtual operation panel according to the determination result of the captured image analysis unit 170. [ In addition, the virtual environment image generating unit 200 generates a running image by performing simulation according to the panel input selected by the user's operation. The configuration of the virtual environment image generating unit 200 will be described in detail with reference to FIG.

4, the virtual environment image generation unit 200 includes a panel image generation unit 210 that generates a virtual operation panel image, a traveling image generation unit 220 that generates a traveling image, a panel image and a traveling image And an image signal processing unit 240 for processing the generated virtual environment image into a video signal that can be displayed on the image display unit 152. [

The panel image generating unit 210 generates a hand image of a user manipulating the panel by synthesizing a hand image of a user photographed by the camera 130 on a virtual operation panel being simulated by the user in real time.

The running image generating unit 220 generates a running image by simulating the change of the surrounding environment according to the driving condition. The running image generating unit 220 generates a running image by simulating a panel input selected according to a result of analyzing a hand image of a user.

The image synthesis unit 230 synthesizes the panel image and the traveling image to generate a virtual environment image that can maximally simulate the actual operating environment. Accordingly, the user can manipulate the driving conditions based on the virtual environment image, and obtain the experience similar to that during the actual operation by changing the speed feeling and the distance feeling of the traveling image.

The image signal processing unit 240 converts the virtual environment image synthesized by the image synthesizing unit 230 into a digital signal that can be displayed on the image display unit 152 to generate a video signal.

The control unit 110 provides the image display unit 152 of the HMD 150 with the image signal generated by the virtual environment image generating unit 200 to provide a simulation screen.

5 is a control flowchart of the simulation system 100 using the HMD 150 according to the embodiment of the present invention.

The user can use the simulation system 100 by mounting the HMD 150 on the head and sitting on a sitting part provided on the main body B. [ When the simulation system 100 is started and the simulation starts (S110), the control unit 110 controls the image display unit 152 of the HMD 150 to display the virtual environment image as shown in FIG. 6 (S120) . When the user turns his / her head and sees his or her side, the user detection sensor 151 senses it and determines the direction of the user's gaze. The controller 110 controls the virtual environment image generation unit 200 to generate a virtual An environment image can be generated and displayed on the image display unit 152. [ Referring to FIG. 6, the virtual environment image may include an image of a virtual operation panel VP and a running image SD at the time of operation. The virtual operation panel VP can be displayed in the same manner as the actual operation panel of the automobile, the train or the airplane to be simulated. Thus, the user can perform a hand operation for operating the virtual operation panel VP on the blue screen 120. [

The control unit 110 controls the camera 130 to photograph a hand gesture for moving or moving a hand on the blue screen 120 in order to control the operation panel VP at step S130.

The control unit 110 provides an image of the hand of the user photographed by the camera 130 to the photographed image analysis unit 170 to recognize the hand motion of the user at step S140. The photographed image analysis unit 170 recognizes the user's hand from the sensed image, determines the operation of the user's hand on the virtual operation panel VP, and transmits the operation to the control unit 110. [

The control unit 110 combines the image of the user's hand with the image of the virtual operation panel VP through the virtual environment image generation unit 200 and displays the combined image on the image display unit 152 at step S150. Thus, the user can feel the same realistic feeling as if he / she is manipulating an actual panel.

When the user takes a manual operation for panel operation, the photographed image analysis unit 170 judges the button or lever of the panel selected by the position and operation of the user's hand on the virtual operation panel VP, 110). Accordingly, the controller 110 can recognize the panel input of the user (S160).

The control unit 110 simulates the traveling image through the virtual environment image generating unit 200 according to the user's panel input in step S170 and displays the simulation result on the image display unit 152 in step S180.

According to this configuration, the simulation system 100 using the HMD 150 of the present invention can display the panel image provided through the HMD 150 and display the hand operation of the user performing the operation operation on the blue screen 120 to the camera 130 And provides a hand image of a user who operates the panel to the HMD 150, so that it is possible to provide the same realistic feeling as that of operating the actual panel. Further, it is possible to recognize the input of the panel selected by the user by recognizing the photographed operation of the user, and to feedback the user through the HMD 150 with the running image simulated according to the panel input of the user.

FIG. 7 is a diagram illustrating a simulation screen according to an embodiment of the present invention, illustrating a screen displayed in step S150 in which a hand image of a user is displayed in combination with a panel image.

The user can view the panel image provided through the HMD 150 and perform an operation operation on the blue screen 120. [ Thus, the camera 130 can photograph a hand gesture that the user moves or moves his / her hand to control the operation panel on the blue screen 120.

The virtual environment image generating unit 200 synthesizes the manually operated image of the photographed user with the image of the virtual operation panel VP in real time. Accordingly, the image of the hand of the user photographed by the camera 130 is reflected on the image of the operation panel VP displayed on the HMD 150, so that the user can feel the same realistic feeling as operating the actual operation panel.

FIG. 8 is a view illustrating a simulation screen of the present invention, and illustrates a simulation screen displayed on the HMD 150 according to a user's operation.

A traveling screen SD and a virtual operation panel VP corresponding to the direction of the user's gaze can be displayed on the video display unit 152 of the HMD 150. [ The virtual operation panel VP can be displayed in the same manner as the actual operation panel of the automobile, the train or the airplane to be simulated. Thus, the user can perform a hand operation for operating the virtual operation panel VP on the blue screen 120. [

When the user performs an operation operation on the blue screen 120 using the virtual operation panel VP, the hand image of the user manipulating the panel on the HMD 150 is captured by the camera 130, .

Further, it is possible to determine the input of the panel selected by the user by recognizing the hand gesture of the photographed user, and to feedback the user through the HMD 150 with the driving screen SD simulated according to the input of the user's panel.

Accordingly, the user grasps his or her hands operating the operation panel on a virtual operation panel VP in real time, and visually confirms the traveling screen SD according to the panel operation, thereby realizing the same realistic feeling as operating the actual panel I can feel it.

 It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the embodiments described above are to be considered in all respects only as illustrative and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: simulation system 110:
120: blue screen 130: camera
150: HMD (Head Mounted Display) 151: User detection sensor
152: video display unit 170:
200: virtual environment image generation unit 210: panel image generation unit
220: running image generating unit 230:
240: a video signal processor

Claims (10)

A head mounted display (HMD) including a video display unit for displaying a virtual environment image including a virtual operation panel;
A camera for photographing a user's hand gesture performed on a screen of a specific color;
A photographed image analyzing unit for recognizing the user's hand movements in the image photographed by the camera and judging the position of the user's hand and the user's input to the virtual operation panel with respect to the virtual operation panel;
A virtual environment image generation unit for generating a panel image by synthesizing the hand image of the user in real time on the image of the virtual operation panel to generate a panel image and generating a traveling image by simulation according to the user input; And
A controller for controlling the display unit to display the virtual environment image on the head-mounted display, the panel image synthesized by the user's hand image inputted by the camera and the traveling image simulated according to the user's hand operation, ;
/ RTI >
Wherein the captured image analyzing unit determines a user input to the virtual operation panel by determining a button or a lever selected on the virtual operation panel by the position of the user's hand and the hand operation of the user,
Wherein the virtual environment image generating unit generates the virtual environment image such that the traveling image is displayed on the upper side of the image display unit of the HMD and the panel image is displayed on the lower side of the HMD.
The method according to claim 1,
Wherein the HMD includes a user detection sensor for detecting movement of the user,
Wherein the control unit provides the virtual environment image corresponding to the user's gaze according to the detection result of the user detection sensor.
delete The method according to claim 1,
The virtual environment image generation unit may generate,
A panel image generating unit for generating a panel image by synthesizing the hand image of the user with the image of the virtual operation panel;
A running image generating unit for generating a running image by simulation according to the user input; And
An image synthesizer for synthesizing the panel image and the traveling image to generate a virtual environment image;
Wherein the HMD-based simulation system comprises:
delete Displaying a virtual environment image including a virtual operation panel on a head mount display (HMD);
Capturing a user's hand gesture performed on the virtual operation panel on a screen of a specific color;
Determining a user's hand position and a user's input to the virtual operation panel with respect to the virtual operation panel by recognizing the user's hand gesture from the captured image in the step of photographing the user's hand gesture;
Generating a panel image by synthesizing the hand image of the user in real time with the image of the virtual operation panel and generating a virtual environment image by generating a driving image by performing simulation according to the user input; And
And displaying the virtual environment image on the HMD,
Wherein the step of recognizing the position of the user's hand with respect to the virtual operation panel and the user's input to the virtual operation panel by recognizing the user's hand gesture from the photographed image comprises: Judging a button or a lever selected on the virtual operation panel by the user and determining a user input to the virtual operation panel,
Wherein the step of generating the virtual environment image by combining the panel image and the running image comprises generating the virtual environment image such that the traveling image is displayed at the top of the image display unit of the HMD and the panel image is displayed at the bottom of the image display unit A method for controlling a simulation system using an HMD.
The method according to claim 6,
Further comprising sensing movement of the user;
The step of displaying the virtual environment image on the HMD includes:
And displaying a virtual environment image corresponding to the user's gaze in accordance with the movement of the user.
delete The method according to claim 6,
Generating a virtual environment image by generating a panel image by synthesizing the hand image of the user with the image of the virtual operation panel and generating a traveling image by performing simulation according to the user input,
Generating a panel image by synthesizing the hand image of the user with the image of the virtual operation panel;
Generating a traveling image by performing simulation according to the user input; And
And generating a virtual environment image by synthesizing the panel image and the running image.
delete
KR1020160007600A 2015-02-03 2016-01-21 System and method for remote simulating vehicles using head mounted displa KR101892238B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR20150016860 2015-02-03
KR1020150016860 2015-02-03

Publications (2)

Publication Number Publication Date
KR20160095614A KR20160095614A (en) 2016-08-11
KR101892238B1 true KR101892238B1 (en) 2018-09-28

Family

ID=56714252

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020160007600A KR101892238B1 (en) 2015-02-03 2016-01-21 System and method for remote simulating vehicles using head mounted displa

Country Status (1)

Country Link
KR (1) KR101892238B1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101917434B1 (en) * 2016-12-05 2018-11-09 주식회사 포스코 Furnace process virtual reality training system
WO2021132906A1 (en) * 2019-12-24 2021-07-01 (주)제이티시스템 Vehicle control simulation apparatus

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000002856A (en) * 1998-02-25 2000-01-07 Semiconductor Energy Lab Co Ltd Information processor
JP2010145860A (en) * 2008-12-19 2010-07-01 Brother Ind Ltd Head mount display
KR101279869B1 (en) * 2012-03-23 2013-06-28 국방과학연구소 Apparatus and method for displaying flight simulator image using head mounted display

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000002856A (en) * 1998-02-25 2000-01-07 Semiconductor Energy Lab Co Ltd Information processor
JP2010145860A (en) * 2008-12-19 2010-07-01 Brother Ind Ltd Head mount display
KR101279869B1 (en) * 2012-03-23 2013-06-28 국방과학연구소 Apparatus and method for displaying flight simulator image using head mounted display

Also Published As

Publication number Publication date
KR20160095614A (en) 2016-08-11

Similar Documents

Publication Publication Date Title
US11181739B2 (en) Method for operating a mobile virtual reality system in a motor vehicle, and mobile virtual reality system
CN101379455B (en) Input device and its method
JP4356763B2 (en) Operating device
KR101279869B1 (en) Apparatus and method for displaying flight simulator image using head mounted display
US20060114171A1 (en) Windowed immersive environment for virtual reality simulators
KR102097180B1 (en) Training simulator and method for special vehicles using argmented reality technology
KR20120044461A (en) The simulated training apparatus and method using mixed reality
KR102188313B1 (en) Multi-model flight training simulator using VR
CN109643219A (en) Method for being interacted with the picture material presented in display equipment in the car
WO2018100377A1 (en) Multi-dimensional display
KR20170131111A (en) Multi-vehicle simulator applying ar device
US20150378155A1 (en) Method for operating virtual reality glasses and system with virtual reality glasses
KR101892238B1 (en) System and method for remote simulating vehicles using head mounted displa
JP2017081456A (en) Display device and display method
Lauber et al. In-your-face, yet unseen? improving head-stabilized warnings to reduce reaction time
US10565799B2 (en) Automatic cockpit identification and augmented image placement
KR20200058872A (en) Immersive Flight Simulator Image System with HMD-based Chroma Key Technology
KR101772431B1 (en) driving simulation systems by HMD and chroma key
KR20210008503A (en) Rear view method and apparatus using augmented reality camera
JP6719119B2 (en) Image display device and computer program
JP2013167732A (en) Display, screen and image conversion apparatus
EP3534241B1 (en) Method, apparatus, systems, computer programs for enabling mediated reality
WO2020031949A1 (en) Information processing device, information processing system, information processing method, and computer program
JP2020012968A (en) Video display system for simulator
KR20170009304A (en) Apparatus for simulating aviation

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E90F Notification of reason for final refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant