KR101493614B1 - Ship Navigation Simulator and Design Method by using Augmented Reality Technology and Virtual Bridge System - Google Patents

Abstract

The present invention relates to a ship navigation simulator, wherein a bridge (cockpit) of an actual ship is virtually realized based on the augmented reality technique, and a ship can be controlled in virtual reality using the same. The ship navigation simulator comprises: a control computer (10) for determining a scenario for simulation, calculating a ship movement to be transferred to an image realization computer (20), and controlling the operations of a display device (40) and augmented reality glasses (30) by communicating with the image realization computer (20); an image realization computer (20) connected with the control computer (10) and generating simulation image data by combining ship shape data and sea sector shape data with ship movement data received from the control computer (10) to be transferred to the display device (40); augmented reality glasses connected with the image realization computer (20) and displaying three-dimensional virtual bridge images based on virtual bridge image data received from the image realization computer (20); and a display device (40) connected with the image realization computer (20) and displaying three-dimensional simulation images based on simulation image data received from image realization computer (20).

Description

Technical Field [0001] The present invention relates to a ship navigation simulator using augmented reality technology based virtual mission system, and a ship navigation simulator using the same,

The present invention relates to a ship operation simulator that virtually implements a bridge (cockpit) of an actual ship based on the augmented reality technology and manages the ship in a virtual reality using the virtual bridge.

The existing ship navigation simulator (Fig. 1) is used for training and training of crew, and for evaluation of port and route design. It is used for the ship model similar to actual ship, actual or simulated navigation equipment installed in it, It consists of the navigation area which is virtually realized through the image, the three dimensional shape of the charity, the three dimensional shape of the encountered lane, the port, the lighthouse, the buoy, the bridge, and the quay.

However, the conventional ship navigation simulator has to be equipped with a bridge model and other navigation equipment, so it is very complicated and difficult to install because it is composed of various network equipment, complex cables, and various display devices. In addition, the existing ship navigation simulator is composed of various expensive equipments including the cost for installing the real navigation equipment, and thus the price is very high, so the sales market is extremely limited.

Ship maneuvering simulator system applying real-time ship operation data (Patent Application No. 10-2010-0109334)

SUMMARY OF THE INVENTION The present invention has been proposed in order to solve the above-mentioned problems, and it is an object of the present invention to provide a navigation system capable of virtually implementing a ship's mission (cockpit) And to provide a ship operation simulator which is small in cost but low in cost.

In order to accomplish the above object, the present invention provides a method for controlling a display device and augmented reality glasses by controlling the operation of a display device and augmented reality glasses through communication with the image reproducing computer while determining scenarios for simulation, computer; A simulation image data which is connected to the control computer and is combined with the ship shape data and the sea shape data on the ship movement data transmitted from the control computer is generated and transmitted to the display device and the virtual bridge image data is transmitted to the augmented reality glasses An image reproducing computer for converting user movement data received from the augmented reality glasses into digital commands and transmitting the same to the control computer; A virtual bridge image of a three-dimensional shape is displayed on the basis of the virtual bridge image data transmitted from the image reproducing computer and connected to the image reproducing computer, and user movement data which senses the user's movement at the time of ship control is transmitted to the image reproducing computer Augmented reality glasses and; And a display device connected to the image reproducing computer and configured to display a simulation image of a three-dimensional shape based on the simulation image data received from the image reproducing computer, the navigation simulator using the virtual bridge system based on the augmented reality technology do.

In the present invention, the augmented reality glasses include a depth camera for sensing movement of a user's hand at the time of ship operation and an operation sensor for sensing movement of the augmented reality glasses, and include movement of a user's hand and movement of the augmented reality glasses And transmits the user motion data to the image reproducing computer.

In the present invention, the control computer is a control software that defines scenarios such as ship, sea area, sea condition, initial position, and other ship arrangement, and controls data transmission for simulation implementation; A ship motion characteristic software for generating ship motion data in which the ship's acceleration, velocity and coordinates are calculated in real time by solving a ship's steering equation, and transmitting the ship motion data to the image representation computer through the control software; A scenario database for storing a scenario and delivering the scenario defined by the control software to the control software in a simulation implementation; A sea area characteristic database storing data of the sea area specified in the scenario and recording data such as a lighthouse, a pier, a quay wall, and a water depth on the basis of the sea level of the sea area of the target area, And a ship movement database for storing performance data of a controller such as a ship's steering gear, a propeller, a thruster, and an anchor, and transmitting the performance data to the ship movement characteristic software.

In the present invention, the image reproducing computer receives the ship motion data from the control software, receives the ship shape data and the sea shape data from the ship shape database and the sea shape database, generates simulation image data combining the ship shape data and the sea shape data, 3D graphics software delivered to the equipment; A ship shape database for storing ship shape data in three dimensions and delivering the ship shape data to the 3D graphic software in a simulation implementation; A sea area shape database storing three-dimensional sea area shape data and transmitting the sea area shape data to the three-dimensional graphic software in a simulation implementation; Virtual mission software for generating virtual mission image data designated on the scenario and delivering the virtual mission image data to the augmented reality glasses; The user's movement data and the movement of the augmented reality glasses are analyzed by receiving the user's movement data from the augmented reality glasses and the movement of the user's hands is corrected based on the movement of the augmented reality glasses, And converting the motion of the digital camera into a digital command and transmitting the digital command to the control software.

In the present invention, the digital command includes a command related to steering and engine control.

In the present invention, the control software transfers the digital command to the ship motion characteristic software, and the ship motion characteristic software reflects the digital command in the ship motion data.

In the present invention, the control software transfers instrument panel information to the virtual bridge software, and the virtual bridge software reflects the instrument panel information on the virtual bridge image data.

In the present invention, the virtual bridge software receives the data on the motion of the augmented reality glasses from the augmented reality glasses and corrects the coordinates, so that the virtualized bridge is fixed in the space regardless of the motion of the augmented reality glasses .

The present invention also relates to a control computer, a control computer comprising a control software, a ship motion characteristic software, a scenario database, a sea characteristic database and a ship motion characteristic database, a three-dimensional graphics software and a ship shape database, A method for implementing a simulation using a ship navigation simulator including a video reproducing computer including a video reproducing computer, an augmented reality glasses, and a display device, the control software comprising a scenario Or receiving a scenario stored in advance from the scenario database; Recording the data such as a lighthouse, a bridge, a quay wall, and a water depth on the basis of the sea of the target sea area designated in the scenario, and transmitting the data to the ship motion characteristic software; Transmitting the performance data of a controller such as a ship's steering gear, a propeller, a thruster, and an anchor to the ship motion characteristic software; Wherein the ship motion characteristic software solves the steering equation of the ship to generate ship motion data in which the ship's acceleration, velocity, and coordinates are calculated in real time, and transmits the ship motion data to the 3D graphic software through the control software ; Transmitting the ship shape data having the three-dimensional shape of the ship shape database to the three-dimensional graphic software; Transmitting three-dimensional sea area shape data of the sea area shape database to the three-dimensional graphic software; Generating a simulation image data by combining the ship motion data, the ship shape data, and the sea shape data, and transmitting the simulation image data to the display device; Displaying a simulation image of a three-dimensional shape based on the simulation image data; The virtual bridge software generates virtual bridge image data designated on the scenario and transmits the virtual bridge image data to the augmented reality glasses; And displaying the virtual bridge image of the three-dimensional shape based on the virtual bridge image data, wherein the augmented reality glasses display the virtual bridge image of the three-dimensional shape.

In the present invention, the augmented reality glasses generate user movement data including the movement of the user's hand sensed by the depth camera and the movement of the augmented reality glasses sensed by the motion sensor when the user controls the ship, ; The image recognition software analyzes movement of the user's hand and movement of the augmented reality glasses from the user's movement data and corrects movement of the user's hands based on the movement of the augmented reality glasses, Converting the motion into a digital command and transmitting the command to the marine propulsion software through the control software; The ship motion characteristic software reflects the digital command to solve the ship's steering equation of the ship to generate ship motion data in which the ship's acceleration, velocity and coordinates are calculated in real time, and the ship motion data is transmitted to the three- To the graphics software.

The ship navigation simulator according to the present invention is expected to have a great demand in shipping companies, schools, or ship training because it is convenient to install and move and has a small installation space and low cost. It is also possible to conduct simulation tests on board before entering the harbor with the possibility of training, which can be very helpful for safe navigation of the ship. In addition, it is possible to implement and arrange various navigation equipments in augmented reality, so it is useful for various performance tests and it is possible to construct the same bridge as actual vessel, so it can be used for education and training purposes when it is provided to each ship.

1 shows a conventional ship navigation simulator.
2 shows a configuration of a ship navigation simulator according to the present invention.
3 is a functional block diagram of a ship navigation simulator according to the present invention.
4 is a conceptual diagram of a virtual bridge according to the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used to designate the same or similar components throughout the drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

2 shows a configuration of a ship navigation simulator according to the present invention.

The present invention is directed to providing a ship navigation simulator that is convenient to move and has a small installation space and at low cost. The present invention provides a ship navigation simulator including a control computer (10), an image reproducing computer (20) An augmented reality glasses 30 and a display device 40. [

The existing ship navigation simulator's navigation (cockpit) is generally similar to the actual ship such as display equipment that displays the shape of the sea area and ship in three dimensions, steering wheel, engine telegraph, radar, communication equipment, electronic chart, compass, It is very complicated due to the data cables and wires that connect these navigation devices to the computer. It is very difficult to move and install, but it is very expensive to build.

Accordingly, in the present invention, a virtual mission is built in the augmented reality instead of the mission of the existing ship navigation simulator (Fig. 4). According to the virtual missions built in the Augmented Reality, various navigation equipment can be arranged and replaced freely, and realistic simulation can be performed by displaying the bridge of various ships almost similar to the actual ship. In addition, in the conventional ship navigation simulator, the controllers, such as the steering wheel, the engine telegraph, and various instrument panels occupy a lot of space. In the present invention, the installation space of the ship navigation simulator is minimized by virtually arranging them in the augmented reality.

The control computer 10 determines a scenario for simulation and calculates the ship motion and transmits the calculated movement to the image reproducing computer 20 while communicating with the image reproducing computer 20 to determine whether the augmented reality glasses 30 and the display device 40 It controls the operation.

The image reproducing computer 20 generates simulation image data combining the ship shape data and the sea shape data with the ship motion data received from the control computer 10 and transmits the generated simulation image data to the display device 40 while the augmented reality glasses 30, And converts the user movement data received from the augmented reality glasses 30 into digital commands and transmits the converted data to the control computer 10.

The control computer 10 and the image reproduction computer 20 are connected by a network. The control computer 10 requires a monitor but the image reproduction computer 20 does not require a separate monitor. This is because the image reproducing computer 20 displays a simulation image through the augmented reality glasses 30 and the display device 40 as described later. The control computer 10 and the image reproducing computer 20 can use either a desktop computer or a notebook computer. However, it is preferable to use a notebook computer to increase the convenience of movement and installation and reduce the weight.

The augmented reality glasses 30 are connected to the image reproduction computer 20 by wire or wirelessly. The augmented reality glasses 30 are mounted on a user's head and display a virtual bridge implemented as an augmented reality through a translucent lens directly in front of the user . The augmented reality glasses 30 display a virtual bridge image of a three-dimensional shape on the basis of the virtual bridge image data transmitted from the image reproducing computer 20, and display user movement data, To the reproduction computer (20).

In this regard, the augmented reality glasses 30 have built-in depth cameras and motion sensors, and the depth camera is used to control the movements of the user's hand during the navigation of the vessel (which means that the user can navigate the virtual bridge, And the movement sensor detects the movement of the augmented reality glasses 30 when the vessel is steered (the moment when the user steers the vessel) The movement of the user's hand sensed by the depth camera and the movement of the augmented reality glasses 30 detected by the motion sensor are detected. And the movement of the glasses 30. As described above, the image reproduction computer 20 generates a digital command from the user movement data using the image recognition technology, and transmits the digital command to the control computer 10 so that the user's manipulation behavior can be immediately reflected in the simulation (More details will be described later).

The display device 40 may be a beam projector, a screen, a large monitor, or the like, and may be connected to the image reproducing computer 20 in a wired or wireless manner. The display device 40 functions to display a simulation image of a three-dimensional shape based on the simulation image data received from the image reproduction computer 20.

3 is a functional block diagram of a ship navigation simulator according to the present invention.

As shown in FIG. 3, the control computer 10 and the image reproducing computer 20 are connected to each other via a network, and the simulation is implemented through a process of mutual communication. In this case, the augmented reality glasses 30 and the display device 40 communicate with the control computer 10 through the image reproducing computer 20 (Fig. 2).

Meanwhile, the control computer 10 and the image reproducing computer 20 have various software and databases for performing their respective functions, and the simulation is implemented by transferring data between the software and the databases.

First, the functions of the software and databases provided in the control computer 10 will be described. The control computer 10 includes control software 11, ship motion characteristic software 12, a scenario database 13, a sea characteristic database 14 and a ship motion characteristic database 15.

The control software 11 is a top-level software for controlling the simulation by the ship navigation simulator according to the present invention. The control software 11 defines scenarios such as a ship, a sea area, an initial position, And data transfer between the databases (data transfer).

The ship motion characteristic software 12 solves the steering motion equation of the ship to be simulated and generates ship motion data in which the acceleration, velocity and coordinates of the ship are calculated in real time, and transmits it to the image reproducing computer 20 through the control software 11 Function.

The scenario database 13 is a database for storing a scenario to be simulated. The scenario database 13 stores scenarios set by the control software 11 at the time of simulation implementation. When the scenarios are used, the scenarios are transmitted to the control software 11 Function. The scenario database 13 plays a role of accepting a predetermined scenario in training using a ship operation simulator and performing a simulation.

The sea area characteristic database 14 is a database that stores the sea area characteristics specified in the scenario to be simulated. The simulator implements the simulation to record data such as a lighthouse, a pier, a quay wall, (12), the ship motion characteristic software (12) functions to take into account impacts of collision and water depth in calculating acceleration, speed, coordinates and the like of the ship.

The ship movement characteristic database 15 is a database for storing performance data of a controller such as a steerer, a propeller, a thruster, and an anchor of a ship. In the simulation implementation, the performance data is transmitted to the ship motion characteristic software 12, The characteristic software 12 functions to reflect the acceleration, the speed, and the coordinates of the ship.

Next, functions of the software and databases provided in the image reproducing computer 20 will be described. The image reproducing computer 20 is provided with three-dimensional graphic software 21, a ship shape database 22, a sea shape database 23, image recognition software 24 and virtual bridge software 25.

The 3D graphic software 21 receives the ship motion data from the control software 11 and receives the ship shape data and the sea shape data from the ship shape database 22 and the sea shape database 23, And transmits the generated information to the display device 40. Then, the display device 40 displays a simulation image of a three-dimensional shape based on the simulation image data. Therefore, in the simulation image of the display device 40, the ship and the sea are depicted in three dimensions, and the ship is expressed in the state of actual operation after the acceleration, the speed, and the coordinates are calculated in real time.

The ship shape database 22 is a database for storing three-dimensional ship shape data. The ship shape database 22 functions to transmit the ship shape data designated in the scenario to be simulated to the 3D graphic software 21 in the simulation implementation.

The sea area shape database 23 is a database for storing three-dimensional sea area shape data, and transmits the sea area shape data specified in the scenario to be simulated to the 3D graphic software 21 in the simulation implementation.

The image recognition software 24 receives the user's movement data from the augmented reality glasses 30 and analyzes the movement of the user's hands and the augmented reality glasses 30, After the motion is corrected, the motion of the user's hand is converted into a digital command using the image recognition technology and the function is transferred to the control software 11.

The image recognition technology used in the present invention is a technique for digitizing a movement of a user's hand sensed by a depth camera. If the augmented reality glasses 30 move at this time, the movement of the user's hand can not be tracked in the spatial fixed coordinate system. Accordingly, the movement of the user's hand is corrected based on the movement of the augmented reality glasses 30 sensed by the motion sensor to track movement of the user's hand in the space-fixed coordinate system, and the tracked result is converted into a digital command. The digital command thus generated is transmitted to the ship motion characteristic software 12 via the control software 11 so that the ship motion characteristic software 12 reflects the contents of the digital command to the ship motion data generation. In this case, the digital command consists of commands relating to steering and engine control (as described above, the movement of the user's hand in the present invention means that the user manipulates the navigation equipment such as the virtual mission bridge and the engine telegraph built in the augmented reality And refers to the movement of the hand at the moment of maneuvering the ship).

The virtual bridge software 25 generates the virtual bridge image data designated on the scenario and transmits the virtual bridge image data to the augmented reality glasses 30. [ Since the virtual bridge is fixed in the space irrespective of the motion of the augmented reality glasses 30, the virtual bridge software 25 can acquire the movement of the augmented reality glasses 30 from the motion sensor of the augmented reality glasses 30 Data is received and the coordinate is corrected so that the virtual bridge is fixed in the space regardless of the motion of the augmented reality glasses 30. [

Hereinafter, the process of implementing the ship navigation simulation according to the present invention will be described in detail with reference to FIG.

First, the control software 11 establishes scenarios such as ship, sea area, sea condition, initial position, and other ship arrangement for simulation implementation, or receives a scenario stored in advance from the scenario database 13.

Next, the sea characteristic database 14 records data such as a lighthouse, a pier, a quay wall, and a water depth on the basis of the sea chart of the target sea area designated on the scenario, transfers the data to the ship motion characteristic software 12, 15 transmits the performance data of the controller such as the ship's steering gear, propeller, thruster, and anchor to the ship motion characteristic software 12.

Next, the ship motion characteristic software 12 solves the steering motion equation of the ship to generate ship motion data in which the acceleration, speed and coordinates of the ship are calculated in real time, and transmits it to the 3D graphics software 21 ).

Next, the ship shape database 22 transmits the three-dimensional ship shape data to the three-dimensional graphic software 21, and the sea shape database 23 supplies the three-dimensional sea shape data to the three-dimensional graphic software 21 ).

Next, the 3D graphic software 21 generates simulation image data combining the ship motion data, the ship shape data, and the sea shape data, and transmits the generated simulation image data to the display device 40.

Next, the display device 40 displays a simulation image of a three-dimensional shape based on the simulation image data.

Next, the virtual bridge software 25 generates the virtual bridge image data designated on the scenario and transfers it to the augmented reality glasses 30.

Finally, the augmented reality glasses 30 display a virtual bridge image of a three-dimensional shape based on the virtual bridge image data. Therefore, a virtual bridge image of the augmented reality glasses 30 is implemented in a superimposed state on the simulation image of the display device 40 in front of the user's eyes. In this case, the control software 11 transmits the instrument panel information showing the ship's acceleration, speed, coordinates, etc. to the virtual mission software 25, and the virtual mission software 25 reflects the instrument panel information on the virtual mission image data Therefore, an instrument panel image showing real-time acceleration, speed, coordinates, etc. of the ship is displayed together with the user's eyes.

Through the above process, the ship navigation simulation is implemented. The user performs simulations in the form of manipulating the ship by manipulating the controller of the mission bridge and the engine telegraph, which are virtually implemented, using the augmented reality glasses 30 do. In this regard, the process of reflecting the movement of the user's hand manipulating the steering wheel of the virtual bridge and the engine telegraph is reflected in the simulation as follows.

First, the augmented reality glasses 30 generate user's athletic data including the movement of the user's hand sensed by the depth camera and the motion of the augmented reality glasses 30 sensed by the motion sensor when the user controls the ship, 24).

Next, the image recognition software 24 analyzes the motion of the user's hand and the motion of the augmented reality glasses 30 from the user's motion data, and corrects the movement of the user's hands based on the motion of the augmented reality glasses 30 The motion of the user's hand is converted into a digital command using the image recognition technology and transmitted to the ship motion characteristic software 12 through the control software 11. [

Finally, the ship motion characteristic software 12 reflects the digital command to solve ship maneuvering equations of the ship, generates vessel movement data in which the ship's acceleration, velocity, and coordinates are calculated in real time, 11 to the image reproducing computer 20. [

Therefore, the user performs the simulation by controlling the navigation devices in the same way as the actual ship in the virtual bridge. If the user "operates the steering wheel by 5 degrees in the port direction" (movement of the user's hand) The augmented reality glasses 30 transmit the movement of the user's hands to the image recognition software 24 of the image reproduction computer 20. [ Then, the image recognition software 24 converts the movement of the user's hand into a digital command using the image recognition technology, and transfers the converted digital command to the control software 11. The control software 11 then transmits these digital commands to the ship propulsion software 12. Then, the ship motion characteristic software 12 calculates the acceleration, velocity, and coordinates of the ship in real time by solving the ship steering equation of the state in which the ship moves 5 degrees in the direction of the ship in the direction of the command as the contents of the command. And transmits it to the 3D graphics software 21 through the control software 11. Then, the 3D graphic software 21 generates the ship simulation image data in the state of 5 degrees in the port direction and transmits the image data to the display device 40. Then, the display device 40 newly displays the navigation status of the ship which is changed in accordance with the steering command.

As described above, the ship navigation simulator according to the present invention is expected to have a great demand in shipping companies, schools, or on-board training because it is convenient to install and move, and has a small installation space and low cost. And it is also possible to carry out ship training at any time, so that it is possible to carry out mock test in advance before entering the port, which can be very helpful for safe navigation of the ship. In addition, it is possible to implement and arrange various navigation equipments in augmented reality, so it is useful for various performance tests and it is possible to construct the same bridge as actual vessel, so it can be used for education and training purposes when it is provided to each ship.

It will be apparent to those skilled in the art that various modifications, substitutions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims. will be. Therefore, the embodiments disclosed in the present invention and the accompanying drawings are intended to illustrate and not to limit the technical spirit of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments and accompanying drawings. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

10: Control computer 11: Control software
12: Ship movement characteristic software 13: Scenario database
14: sea area characteristic database 15: ship movement characteristic database
20: Image reproduction computer 21: 3D graphic software
22: Ship shape database 23: Sea shape database
24: Image Recognition Software 25: Virtual Mission Software
30: Augmented Reality Glasses 40: Display Equipment

Claims (12)

A scenario for simulation is defined and the ship motion is calculated and transmitted to the image reproduction computer 20 and the operation of the display device 40 and the augmented reality glasses 30 is controlled through communication with the image reproduction computer 20 A computer 10;
Generates simulated image data that is connected to the control computer 10 and combines the ship shape data and the sea shape data with the ship motion data received from the control computer 10 and transmits the generated simulation image data to the display device 40, An image reproducing computer 20 for transmitting virtual bridge image data to the glasses 30, converting user movement data received from the augmented reality glasses 30 into digital commands and transmitting the data to the control computer 10;
A virtual bridge image of a three-dimensional shape connected to the image reproducing computer 20 and based on the virtual bridge image data received from the image reproducing computer 20 is displayed, and user movement data, An augmented reality glasses 30 for transmitting the augmented reality glasses 20 to the image reproduction computer 20;
A display device (40) connected to the image reproducing computer (20) and displaying a three - dimensional simulation image based on the simulation image data received from the image reproducing computer (20);
A ship navigation simulator using augmented reality technology based virtual bridge system. The method according to claim 1,
Wherein the control computer (10) and the image reproducing computer (20) are composed of a notebook or a desktop. The method according to claim 1,
The augmented reality glasses 30 include a depth camera for sensing the movement of the user's hand and a motion sensor for sensing the movement of the augmented reality glasses 30, And transmits the generated user movement data to the image reproducing computer 20. The simulator of the ship navigation system using the virtual reality bridge system based on the augmented reality technology. The method according to claim 1,
The control computer (10)
Control software (11) that controls the delivery of data for simulation implementation, defining scenarios such as ship, sea area, maritime conditions, initial location, and line deployment;
A vessel movement data which is obtained by calculating the ship's acceleration equation, velocity and coordinates in real time by solving the ship's steering equation of the ship and transmitting the ship's movement data to the image reproduction computer 20 through the control software 11, Characteristic software 12;
A scenario database (13) for storing a scenario and delivering the scenario defined by the control software (11) to the control software (11) when a simulation is implemented;
A sea area characteristic database 14 for storing the sea area characteristics specified in the scenario and recording data such as a lighthouse, a pier, a quay wall, and a water depth on the basis of the sea level of the target sea area and transmitting the data to the ship movement characteristic software 12;
A ship movement characteristic database 15 for storing performance data of a controller such as a steering gear, a propeller, a thruster, and an anchor of the ship and transmitting the performance data to the ship movement characteristic software 12;
And a navigation simulator using the virtual bridge system based on the augmented reality technology. The method of claim 4,
The image reproduction computer (20)
Receives the ship motion data from the control software 11, receives the ship shape data and the sea shape data from the ship shape database 22 and the sea shape database 23, generates simulation image data combining the ship shape data and the sea shape data, Dimensional graphic software (21);
A ship shape database (22) for storing the ship shape data in three dimensions and delivering the ship shape data to the 3D graphic software (21) upon simulation implementation;
A sea area shape database 23 for storing the sea area shape data in three dimensions and delivering the sea area shape data to the 3D graphic software 21 in a simulation implementation;
Virtual mission software (25) for generating virtual bridge image data designated on the scenario and transmitting the virtual bridge image data to the augmented reality glasses (30);
The user's movement data and the motion of the augmented reality glasses 30 are analyzed by receiving the user's movement data from the augmented reality glasses 30 and the movement of the user's hands is corrected based on the movement of the augmented reality glasses 30 An image recognition software 24 for converting the movement of the user's hand into a digital command using the image recognition technology and transmitting the converted digital command to the control software 11;
And a navigation simulator using the virtual bridge system based on the augmented reality technology. The method of claim 5,
Wherein the digital command includes steering and engine control related commands. The method of claim 5,
The virtual bridge software 25 receives data on the motion of the augmented reality glasses 30 from the augmented reality glasses 30 and corrects the coordinates so that the virtual bridge is not affected by the motion of the augmented reality glasses 30 Wherein the virtual navigation system is fixed to a space by using a virtual navigation system based on augmented reality technology. A control computer 10 composed of a control software 11, a ship motion characteristic software 12, a scenario database 13, a sea characteristic database 14 and a ship motion characteristic database 15, An image reproducing computer 20 composed of a ship shape database 22, a sea shape database 23, virtual bridge software 25 and image recognition software 24, an augmented reality glasses 30, a display device 40 A method for implementing a simulation using a ship operation simulator,
The control software 11 may determine a scenario such as a ship, a sea area, a sea condition, an initial position, a line arrangement for a simulation implementation, or receive a scenario stored in advance from the scenario database 13;
Recording the data such as a lighthouse, a bridge, a quay wall, and a water depth on the basis of the sea of the target sea area designated on the scenario, and transmitting the recorded data to the ship motion characteristic software 12;
Transmitting the performance data of a controller such as a ship's steering gear, a propeller, a thruster, and an anchor to the ship motion characteristic software (12);
The ship motion characteristic software 12 solves the steering equation of the ship to generate ship motion data in which the acceleration, speed and coordinates of the ship are calculated in real time, and the ship motion data is transmitted through the control software 11 to the three- To the graphics software (21);
Transmitting the three-dimensional ship shape data to the ship shape database (22) to the three-dimensional graphic software (21);
Transmitting the three-dimensional sea area shape data to the three-dimensional graphic software (21) by the sea area shape database (23);
The 3D graphic software 21 generates simulation image data combining the ship movement data, the ship shape data, and the sea shape data and transmits the generated simulation image data to the display device 40;
The display device (40) displaying a simulation image of a three-dimensional shape based on the simulation image data;
The virtual bridge software 25 generates virtual bridge image data designated on the scenario and transmits the created virtual bridge image data to the augmented reality glasses 30;
Displaying the virtual bridge image of the three-dimensional shape based on the virtual bridge image data;
Wherein the method comprises the steps of: The method of claim 8,
The augmented reality glasses 30 may generate user athletic data including the movement of the user's hand sensed by the depth camera and the motion of the augmented reality glasses 30 sensed by the motion sensor when the user controls the ship, (24);
The image recognition software 24 analyzes the movement of the user's hand and the movement of the augmented reality glasses 30 from the user's movement data and corrects the movement of the user's hands based on the movement of the augmented reality glasses 30 Converting the movement of the user's hand into a digital command using the image recognition technology and transmitting the digital command to the ship motion characteristic software 12 through the control software 11;
The ship motion characteristic software 12 reflects the digital command word and solves the steering equation of the ship to generate ship motion data in which the acceleration, speed and coordinates of the ship are calculated in real time, and the ship motion data is transmitted to the control software 11 To the three-dimensional graphics software (21) through the display device (20);
Further comprising the steps of: The method of claim 9,
Wherein the digital command comprises steering and engine control related commands. The method of claim 8,
The control software (11) passes instrument panel information to the virtual bridge software (25), and the virtual bridge software (25) reflects the instrument panel information on the virtual bridge image data . The method of claim 8,
The virtual bridge software 25 receives data on the motion of the augmented reality glasses 30 from the augmented reality glasses 30 and corrects the coordinates so that the virtual bridge is not affected by the motion of the augmented reality glasses 30 Wherein the first portion is fixed to the space.

Images