KR102249156B1 - Sailing assistance device using augmented reality image - Google Patents

Abstract

The present invention relates to a sailing assistance device using an augmented reality image, which comprises: a communication unit which receives automatic identification system (AIS) data from an AIS; a control unit which determines a first ship information of a first ship with a user riding and a second ship information of a second ship placed near the first ship based on the AIS data, and receives a sailing video made by photographing the outside of the first ship from a camera module, thereby generating an augmented reality sailing video; an augmented reality video generation unit which generates a first augmented reality image on the second ship based on the first ship information and the second ship information; and a video display unit which displays the augmented reality sailing video. The first ship information includes the GPS coordinates, speed, and moving direction of the first ship. The second ship information includes the GPS coordinates, speed, and moving direction of the second ship. The control unit analyzes the sailing video, and overlaps the first augmented image on the position of the second ship in the sailing video, thereby generating the augmented reality sailing video. The present invention aims to provide a sailing assistance device using an augmented reality image, which is able to effectively help a sailor sail in a safe manner.

Description

Navigation assistance device using augmented reality image {SAILING ASSISTANCE DEVICE USING AUGMENTED REALITY IMAGE}

The present invention relates to a navigation aid device using an augmented reality image.

According to domestic and foreign shipping academic papers, operation errors accounted for 82.8% of the total causes of maritime accidents, and 96.9% of them were due to negligence of vigilance or inadequacy of shipbuilding. In particular, according to the JNPR paper, it is judged that a lot of information on advanced navigation equipment displayed on the 2D screen is causing difficulty in decision-making by navigators. For example, in the Singapore Strait, hundreds of ships and land targets are detected at a time, and since the navigator checks the 2D radar screen and then looks forward, it takes a lot of time to compare and analyze the ship and the surrounding environment.

Unlike automobiles and aircraft, ships have a long pick-up distance of 1 to 2 km, so intuitive and quick decision-making is very important. In the case of ships that cost tens of billions of dollars per ship, one accident is directly connected to the problem of compensation exceeding trillions. To prevent this, shipping companies are using billions of won of navigational equipment. All the data extracted from the navigation equipment are collected in VDR (Ship Data Recorder) and AIS (Ship Identification Device), and the data that flows into it has a limitation of 2D data, so it makes quick judgments like a narrow strait where a large number of ships are concentrated. Even in this necessary situation, the navigator spends a lot of time analyzing the data.

In addition, in bad weather conditions such as nighttime operation, heavy rain, sea, etc., the visibility distance of a sailor who operates a ship decreases rapidly, but even in this case, there is a difficulty in that the sailor must analyze only 2D data to operate.

A technical problem to be achieved by the present invention is to provide a navigation aid device that displays an augmented reality image of other ships and surrounding environments adjacent to a running ship.

A navigation aid device using an augmented reality image according to an embodiment of the present invention includes a communication unit that receives AIS data from an automatic identification system, and a first ship on which a user is boarded based on the AIS data. 1 It determines the ship information, the second ship information of the second ship disposed in a position adjacent to the first ship, and generates an augmented reality voyage image by receiving a voyage image photographing the outside of the first ship from a camera module. A control unit, an augmented reality image generation unit that generates the second ship as a first augmented reality image based on the first ship information and the second ship information, and an image display unit that displays the augmented reality navigation image, , The first ship information includes GPS coordinates, speed, and moving direction of the first ship, and the second ship information includes GPS coordinates, speed, and moving direction of the second ship, and the control unit The augmented reality navigation image may be generated by analyzing the navigation image and superimposing the first augmented reality image on the position of the second ship in the navigation image.

According to an embodiment, the controller receives the photographing orientation from the camera module to determine the orientation of the navigation image, determines the GPS coordinates of the first ship based on the first ship information, and GPS coordinates may be set in the navigation image based on GPS coordinates.

According to an embodiment, the control unit divides the navigation image into a plurality of areas, determines a distance between each area corresponding to an angle formed by the camera module and the sea level, and determines the distance between the areas and the determined distance and the direction. Correspondingly, GPS coordinates may be set in each of the areas.

According to an embodiment, the control unit selects a first area having GPS coordinates matching the GPS coordinates of the second ship among the areas, and superimposes the first augmented reality image on the first area to perform the augmentation. Real voyage images can be created.

According to an embodiment, the communication unit receives ECDIS data from an electronic chart display and information system, and the control unit determines environmental information of the surrounding environment based on the ECDIS data, and the augmented reality image The generation unit generates the surrounding environment as a second augmented reality image based on the environment information, and the controller analyzes the navigation image and superimposes the second augmented reality image on the location of the surrounding environment in the navigation image. Augmented reality navigation images can be created.

According to an embodiment, the control unit analyzes the first and second ship information at a first time point, and when maintaining the movement path and speed of each ship, the control unit is less than a first reference distance to the first ship after the first time point. As a result, the second ship to be adjacent may be selected, and the selected second ship may be determined as a collision risk ship.

According to an embodiment, the control unit may display only the first augmented reality image of a second ship selected as a collision risk ship among the plurality of second ships by superimposing on the navigation image.

According to an embodiment, the control unit may implement the rest of the plurality of second ships as identification symbols and display them on the augmented reality navigation image.

A navigation aid device using an augmented reality image according to another embodiment of the present invention includes a communication unit receiving radar data from a ship radar, and first ship information of a first ship on which a user is boarded, and the first ship based on the radar data. 1 A control unit that determines second ship information of a second ship disposed in a position adjacent to the ship, receives a voyage image photographed outside of the first ship from a camera module, and generates an augmented reality voyage image, and the first An augmented reality image generation unit for generating the second ship as a first augmented reality image based on ship information and the second ship information, and an image display unit for displaying the augmented reality navigation image, wherein the first ship information Includes the GPS coordinates, speed, and movement direction of the first ship, the second ship information includes the GPS coordinates, speed, and movement direction of the second ship, and the control unit analyzes the navigation image The augmented reality navigation image may be generated by superimposing the first augmented reality image on the position of the second ship in the navigation image.

According to the navigation assistance device according to an embodiment of the present invention, even when it is difficult to identify a target due to poor quality of an image photographed at sea, an augmented reality image is generated using data provided from the automatic ship identification system and the electronic chart information system. And, by recognizing the augmented reality image, it can effectively help the safe navigation of the navigator.

1 is a diagram of a navigation assistance system according to an embodiment of the present invention.
2 is a schematic block diagram of a navigation aid according to an embodiment of the present invention.
3A to 3C are views showing an augmented reality navigation image displayed by a navigation aid device according to an embodiment of the present invention.
4 is a conceptual diagram illustrating an operation of a navigation aid device according to another embodiment of the present invention.
5 is a conceptual diagram illustrating an operation of a navigation aid device according to another embodiment of the present invention.
6 is a view of a navigation assistance system according to another embodiment of the present invention.

Specific structural or functional descriptions of the embodiments according to the concept of the present invention disclosed in the present specification are exemplified only for the purpose of describing the embodiments according to the concept of the present invention, and the embodiments according to the concept of the present invention are It may be implemented in various forms and is not limited to the embodiments described herein. In the embodiments described herein, a'module' or'unit' means a functional part that performs at least one function or operation, and may be implemented as hardware or software, or a combination of hardware and software.

1 is a diagram of a navigational assistance system according to an embodiment of the present invention, and FIG. 2 is a schematic block diagram of a navigational assistance device according to an embodiment of the present invention.

Referring to FIG. 1, a navigation assistance system 10 according to an embodiment of the present invention includes an automatic ship identification system 100, an electronic chart information system 200, and a navigation assistance device 300.

The automatic identification system (AIS) 100 is a device that automatically informs the surroundings of the position, speed, and movement direction of the ship, and may provide AIS data to the navigation assistance device 300. The AIS data includes first ship information of the first ship SH1 on which the user is boarded and second ship information of the second ship SH2 disposed in a position adjacent to the first ship SH1. The first ship information includes GPS coordinates, speed, and movement direction of the first ship SH1, and the second ship information includes GPS coordinates, speed, and movement direction of the second ship SH2. A plurality of second ships SH2 may be located in a position adjacent to the first ship SH1, and in this case, the AIS data may include all of the second ship information of the plurality of second ships SH2.

The Electronic Chart Display and Information System (ECDIS; 200) displays real-time location information of ships and supports navigation so that navigators can plan and monitor routes and utilize additional information related to navigation. It is a navigational information system. The electronic chart information system 200 stores ECDIS data including all chart information related to the voyage of the first ship (SH1) such as coastline, fillet ship, water depth, route signs (lighthouse, light buoy), dangerous goods, and route, etc. ) Can be provided. For example, the ECDIS data may include coastline information, seafloor topography, water depth, and the like of an area surrounding the first ship SH1.

The navigation assistance device 300 may generate an augmented reality navigation image (IM) based on a navigation image photographed outside of the first ship (SH1). First, the navigation assistance device 300 is a ship automatic identification system 100 ) From the AIS data and ECDIS data is received, the second ship (SH2) and the surrounding environment (EN) can be implemented as an augmented reality image. And, the navigation assistance device 300 analyzes the navigation image and generates an augmented reality navigation image (IM) in which an augmented reality image is superimposed on each of the position of the second ship (SH2) and the position of the surrounding environment (EN) in the navigation image. can do.

According to an embodiment, the navigation assistance device 300 may generate an augmented reality navigation image by implementing only the second ship SH2 as an augmented reality image.

Since the augmented reality navigation image displayed by the navigation assistance device 300 is an augmented reality image of ships, reefs, coastlines, and dangerous objects on an actual photographing screen photographed outside of the first ship SH1, heavy rain, sea fog, etc. Even if it is difficult to discern the object in the navigation image due to the like, the navigator can recognize the object through the AR image.

According to an embodiment, the navigation assistance device 300 includes a personal computer (PC), a smart phone, a tablet PC, a mobile internet device (MID), an internet tablet, and an Internet of Things (IoT). things) a device, an Internet of everything (IoE) device, a desktop computer, a laptop computer, a workstation computer, a Wireless Broadband Internet (Wibro) terminal, and a Personal Digital Assistant (PDA). However, it is not limited thereto.

Referring to FIG. 2, the navigation assistance device 300 according to an embodiment of the present invention includes a camera module 310, a communication unit 320, a control unit 330, an augmented reality image generation unit 340, and an image display unit 350. ) Can be included.

The camera module 310 may generate a navigation image by photographing the outside of the first ship SH1, and when photographing a navigation image, the photographing direction may be included in the navigation image. For example, when the camera module 310 is photographed while facing the south-south direction, the photographing direction may be recorded in the south-south direction and included in the navigation image.

In addition, the camera module 310 may determine an angle made with the sea level and include it in the navigation image. For example, when the camera module 310 is photographed while being inclined to the sea level by 30°, the navigation image may include an angle value of 30°.

Meanwhile, in FIG. 2, the camera module 310 is shown as an internal configuration of the navigation aid 300, but the camera module 310 is implemented as a separate device from the navigation aid 300, so that the navigation aid 300 It may also be a configuration that provides a navigational image to. For example, the camera module 310 may be a camera device installed on the first ship SH1.

The communication unit 320 may be connected to the ship automatic identification system 100 and the electronic chart information system 200 through wired or wireless communication to receive AIS data and ECDIS data.

According to an embodiment, the communication unit 320 not only wireless Internet communication such as WLAN (Wireless LAN), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), WiFi, etc., but also Bluetooth Short-range communication technologies such as (Bluetooth), RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra Wideband), ZigBee, etc. may be used, so the communication method is not limited to any one communication method. .

The control unit 330 analyzes the AIS data to determine the GPS coordinates of the first ship SH1, the location, the direction of movement (course), the speed, the length, width, shape, and depth of the ship. Information and second ship information regarding GPS coordinates, position, movement direction, speed, ship length, width, shape, etc. of the second ship (SH2) are determined, and the ECDIS data is analyzed to determine the coastline, water depth, submarine topography, and wind direction. , It is possible to determine environmental information of the surrounding environment (EN) about wind speed, tidal speed, and wave height.

The control unit 330 receives a navigation image photographed from the outside of the first ship SH1 from the camera module 310, and superimposes the augmented reality image generated by the augmented reality image generation unit 340 on the navigation image to provide augmented reality. You can create a navigation image (IM).

The controller 330 may determine the GPS coordinates of the first ship SH1 based on the first ship information, and may set the GPS coordinates in the navigation image based on the photographing direction received from the camera module 310.

For example, when the GPS coordinates of the first ship SH1 are 35.092539 and 130.379864, and the photographing direction is determined to be south, the longitude of the GPS coordinates of the navigation image includes a value less than 35.092539.

In addition, the control unit 330 may divide the navigation image into a plurality of areas, and may individually determine a distance from each area corresponding to an angle made by each area between the camera module and the sea level. In addition, the control unit 330 may set GPS coordinates in each region based on a distance and a photographing direction in which each region is separated from the first ship SH1. Here, when a plurality of GPS coordinates are included in one area, the intermediate GPS coordinates among the GPS coordinates may be set as the representative GPS coordinates of the corresponding area.

The control unit 330 may select a first area having GPS coordinates matching the GPS coordinates of the second ship SH2 among the divided areas based on the second ship information, and on the first area in the navigation image. An augmented reality navigation image may be generated by overlapping the augmented reality image of the second ship SH2.

In addition, the control unit 330 may select a second area having GPS coordinates matching the GPS coordinates of the surrounding environment among the divided areas based on the environment information, and enhance the surrounding environment on the second area in the navigation image. Augmented reality navigation images can be created by overlapping reality images.

Depending on the embodiment, the control unit 330 may determine the possibility of collision between the first and second ships SH1 and SH2 based on the first and second ship information. It is possible to determine the possibility of a collision in the future according to the movement of the first and second ships SH1 and SH2 as well as the possibility of a collision at a point of view 1').

That is, when the first and second ships SH1 and SH2 each maintain the current speed and movement path after the first point in time, the control unit 330 may collide between the first and second ships SH1 and SH2. Can be predicted. Here, the possibility of collision includes not only a case of direct collision, but also a case where the second ship SH2 is adjacent to the first ship SH1 by less than a first reference distance.

The controller 330 may select the second ship SH2 to be adjacent to the first ship SH1 less than the first reference distance after the first point in time, and determine this as a collision risk ship.

For example, on June 15, 2020, at 14:00 (the first time point), the first ship SH1 running along the first direction at a speed of 10 knots, and the second ship SH1 running along the second direction at a speed of 5 knots. When determining the possibility of a collision between the ships SH2, the controller 330 may determine not only the possibility of a collision at the first time point SH1, but also the possibility of a collision after the first time point. That is, after the first point in time, the control unit 330 allows the first ship SH1 to travel along the first direction at a speed of 10 knots, and the second ship SH2 to travel along the second direction at a speed of 5 knots. Assuming that, the possibility of collision after the first point in time can be determined.

If the first reference distance is 3M and the control unit 330 predicts that the distance between the first ship SH1 and the second ship SH2 will be within 3M after the first point in time, the first and second By predicting that the ships SH1 and SH2 will collide with each other, the second ship SH2 may be determined as a collision risk ship.

The control unit 330 may determine the possibility of collision between the first ship (SH1) and the second ship (SH2) for each reference period, but the reference period corresponding to the distance between the first ship (SH1) and the second ship (SH2) It is also possible to judge the possibility of collision with a shorter period.

According to an embodiment, the control unit 330 may determine that the first distance between the first ship SH1 and the closest ship among the plurality of second ships SH2 and the first ship SH1 at the first time point is 2 If the distance is greater than the reference distance, the collision risk vessel may be determined by analyzing the first and second vessel information at each reference period.

On the other hand, when the first distance between the ship closest to the first ship SH1 and the first ship SH1 at a first time point is less than the second reference distance, the first distance is the second reference distance. As it becomes smaller, the collision risk ship may be determined by analyzing the first and second ship information at a shorter period than the reference period.

For example, when the second reference distance is 1 km and the reference period is 5 seconds, when the second ship SH2 closest to the first time point is located at a distance of 3 km, the control unit 330 reviews the possibility of collision every 5 seconds. The ships at risk of collision can be determined.

On the other hand, if the second reference distance is 1km and the reference period is 5 seconds, and the second ship SH2 closest to the first time point is located at a distance of 800m, the control unit 330 reviews the possibility of collision every 3 seconds. The ships at risk of collision can be determined.

The control unit displays only the augmented reality image of the second ship selected as a collision risk ship among the plurality of second ships (SH2) by superimposing and displaying the second ship on the voyage image, and the remaining second ships are implemented as identification symbols to display the augmented reality voyage image. Can be displayed.

The augmented reality image generation unit 340 generates an augmented reality navigation image that implements the second ship (SH2) and the surrounding environment (EN) as augmented reality images based on the first ship information, the second ship information, and the environment information. can do.

Since the first and second ship information includes information on the type, length, and width of each of the first and second ships SH1 and SH2, the augmented reality image generator 340 2 Using the ship information, the second ship SH2 can be implemented as an augmented reality image. In addition, since the environmental information includes information on the coastline and the surrounding terrain, the augmented reality image generation unit 340 may implement the surrounding environment EN as an augmented reality image using the environmental information.

According to an embodiment, the augmented reality image generator 340 may implement only a collision risk ship among the plurality of second ships SH2 as an augmented reality image. That is, when a plurality of second ships SH2 adjacent to the first ship SH1 exist, the augmented reality image generator 340 does not implement all the second ships SH2 as augmented reality images, but the first Only ships at risk of collision with the ship SH1 can be implemented as an augmented reality image.

In addition, the augmented reality image generation unit 340 may implement the remaining ships of the plurality of second ships SH2, other than the crash-risk ships, as an identification symbol, but the user displays the second ship SH2 marked with the identification symbol. If desired, the augmented reality image generation unit 340 may implement the second ship SH2 as an augmented reality image in response to the user's control.

The image display unit 350 may display an augmented reality navigation image (IM) to the navigator. The image display unit 350 includes an organic light emitting display panel, a liquid crystal display panel, and It may be implemented as a plasma display panel or the like, but is not limited thereto.

In addition, the image display unit 350 may include a touch screen, and may receive a touch, gesture, proximity, or hovering input using an electronic pen or a part of the user's body.

3A to 3C are views showing an augmented reality navigation image displayed by a navigation aid device according to an embodiment of the present invention.

Referring to FIG. 3A, sailing including a first ship SH1 on which a user of the navigation assistance device 300 is aboard, and second ships SH2a and SH2b sailing at a position adjacent to the first ship SH1 The image IMA is shown.

Here, the navigation image (IMa) refers to an image captured by the camera module 310 embedded in the navigation assistance device 300, but is not limited thereto, and by a camera device fixed and installed on the first ship SH1. It may be a photographed image. In addition, in FIG. 3A, it is indicated that the first ship SH1 is included in the navigation image IMA, but this may or may not be included in the navigation image IMA according to the photographing direction of the navigation assistance device 300.

The navigation assistance device 300 may determine the orientation of the navigation image IMA by determining the photographing orientation during photographing, and determine an angle formed by the camera module of the navigation assistance device 300 with the sea level. For example, the navigation assistance device 300 may determine an angle formed by a line perpendicular to the lens surface of the camera module 310 and the sea level.

Referring to FIG. 3B, a navigation image IMb photographing the outside of the first ship SH1 in a situation where the visibility distance is very short due to night operation, a state full of sea traffic, heavy rain, etc. of the navigation aid device 300 is shown. Has been.

In clear weather with a long line of sight, the navigation aid 300 can capture a navigational image of the external environment with clear image quality, but in a situation where the line of sight is very short due to night operation, a state full of sea fog, heavy rain, etc. 300 can not properly shoot the external environment. Therefore, even if the second ship (SH2) is actually located around the first ship (SH1) and there is a reef, the navigation image (IMb) does not include the second ship (SH2) and the surrounding environment (EN). I can.

Referring to FIG. 3C, the navigation assistance device 300 may display an augmented reality navigation image (IMc) by superimposing an augmented reality image on the navigation image. In the augmented reality navigation image Imc, the second ships SH2a and sh2b may be overlapped and displayed in correspondence with each ship position.

Therefore, even if the image quality of the captured sailing image is not good, and the second ships SH2a and sh2b and the surrounding environment EN are not displayed, the navigation assistance device 300 superimposes and displays the increased smoke image on the sailing image. The user may be able to recognize the location of the second ships SH2a and sh2b and the surrounding environment EN.

4 is a conceptual diagram illustrating an operation of a navigation aid device according to another embodiment of the present invention.

Referring to FIG. 4, the drone DR according to another embodiment of the present invention may fly over the first ship SH1 with the camera module 310 ′. The camera module 310 ′ may generate a navigation image by photographing the outside of the first ship SH1, such as the second ship SH2, the surrounding environment EN, and the like from above the first ship SH1.

The drone DR may perform wireless communication with the navigation assistance device 300 located in the first ship SH1 to transmit a navigation image captured by the camera module 310', but is not limited thereto and the camera module 310 ') It is also possible to transmit the directly photographed navigation image by performing wireless communication with the navigation assistance device 300.

The drone DR may perform a flight operation in response to a control signal received from the navigation assistance device 300 through wireless communication. That is, the drone DR can control flight altitude, flight speed, flight direction, horizontal rotation movement, etc. in response to the control signal, and the camera module 310' provided in the drone DR is a drone DR. The photographing direction and the photographing range may be changed in response to the movement of the camera.

Depending on the embodiment, the drone DR includes a separate GPS module, and the GPS coordinates of the drone DR can be measured in real time and provided to the navigation assistance device 300, and the navigation assistance device 300 In consideration of the GPS coordinates of the drone DR and the GPS coordinates of the first ship SH1, GPS coordinates may be set in the navigation image based on the GPS coordinates of the first ship SH1.

5 is a conceptual diagram illustrating an operation of a navigation aid device according to another embodiment of the present invention.

Referring to FIG. 5, while photographing a navigation image, the navigation assistance device 300 may determine a distance and azimuth in which each region in the navigation image is separated from the first ship SH1.

If the camera module 310 of the navigation assistance device 300 photographs the sea between the first point PO1 and the second point PO2, the top of the navigation image IMb is the first point PO1 An image of is included, and the lowermost portion may include an image of the second point PO2.

The navigation aid 300 may separately include a gyro sensor, an acceleration sensor, and the like, so that the angle θ at the third point POX where the line perpendicular to the lens surface of the camera module 310 meets the sea level can be calculated. I can. In addition, since the navigation assistance device 300 can calculate the height (l) from the sea level based on the first ship information, the distance (x) to the third point (POX) can be calculated by Equation 1 below. .

In addition, the navigation assistance device 300 may calculate the distance to the remaining points based on the distance x to the third point POX. In this case, the navigation assistance device 300 may calculate the distance to the first and second points PO1 and PO2 in correspondence with the wide angle of the camera module 300.

If the marine image IMb is divided into a plurality of regions, the navigation assistance device 300 may calculate the center distance of each region corresponding to the image ratio and set a representative distance of each region.

6 is a view of a navigation assistance system according to another embodiment of the present invention.

6, the navigation assistance system 10' according to another embodiment of the present invention includes an automatic ship identification system 100, an electronic chart information system 200, a ship radar 400, and a navigation assistance device ( 300).

The ship automatic identification system 100 may provide AIS data to the navigation aids 300. The AIS data includes first ship information of the first ship SH1 on which the user is boarded and second ship information of the second ship SH2 disposed in a position adjacent to the first ship SH1. The first ship information includes the speed and movement direction of the first ship SH1, and the second ship information includes the speed and movement direction of the second ship SH2.

The electronic chart information system 200 stores ECDIS data including all chart information related to the voyage of the first ship (SH1) such as coastline, fillet ship, water depth, route signs (lighthouse, light buoy), dangerous goods, and route, etc. ) Can be provided. For example, the ECDIS data may include coastline information, seafloor topography, water depth, and the like of an area surrounding the first ship SH1.

The marine radar 400 may generate radar data and provide it to the navigation assistance device 300. The radar data includes first ship information of the first ship SH1 on which the user is boarded and adjacent to the first ship SH1. It may include the second ship information of the second ship (SH2) arranged at the location. The first ship information includes the speed and movement direction of the first ship SH1, and the second ship information includes the speed and movement direction of the second ship SH2.

The navigation assistance device 300 implements the second ship (SH2) as an augmented reality image using AIS data and radar data, and the augmented reality navigation in which the surrounding environment (EN) is implemented as an augmented reality image using ECDIS data. It is possible to create an image (IM).

Although the embodiments of the present invention have been described above, it is understood that those of ordinary skill in the art to which the present invention pertains can perform various modifications without departing from the scope of the claims of the present invention.

100: ship automatic identification system
200: electronic chart information system
300: user terminal
400: marine radar

Claims (9)

A communication unit for receiving AIS data from an automatic identification system;
Based on the AIS data, the first ship information of the first ship on which the user is boarded, the second ship information of the second ship disposed in a position adjacent to the first ship is determined, and the outside of the first ship from the camera module A control unit for receiving a navigation image photographed and generating an augmented reality navigation image;
An augmented reality image generator for generating the second ship as a first augmented reality image based on the first ship information and the second ship information; And
Including an image display for displaying the augmented reality navigation image,
The first ship information includes GPS coordinates, speed, and movement direction of the first ship, and the second ship information includes GPS coordinates, speed, and movement direction of the second ship,
The control unit analyzes the navigation image and superimposes the first augmented reality image on the position of the second ship in the navigation image to generate the augmented reality navigation image,
The control unit receives the photographing orientation from the camera module, determines the orientation of the navigation image, determines the GPS coordinates of the first ship based on the first ship information, and determines the GPS coordinates of the first ship based on the GPS coordinates of the first ship. Set GPS coordinates in the navigation image,
The control unit divides the navigation image into a plurality of areas, determines a distance of each area corresponding to an angle formed by each area with the camera module and sea level, and determines the distance of each area in response to the determined distance and the direction. Navigation aids using augmented reality images to set GPS coordinates in. delete delete The method of claim 1,
The control unit selects a first area having GPS coordinates matching the GPS coordinates of the second ship among the areas, and generates the augmented reality navigation image by superimposing the first augmented reality image on the first area. Navigation aids using an augmented reality image. The method of claim 1,
The communication unit receives ECDIS data from an Electronic Chart Display and Information System,
The control unit determines environmental information of the surrounding environment based on the ECDIS data,
The augmented reality image generation unit generates the surrounding environment as a second augmented reality image based on the environment information,
The control unit analyzes the navigation image and superimposes the second augmented reality image on the location of the surrounding environment in the navigation image to generate the augmented reality navigation image. The method of claim 1,
The control unit analyzes the first and second ship information at a first time point, and when maintaining the movement path and speed of each ship, the control unit is configured to be adjacent to the first ship by less than a first reference distance after the first time point. 2 Navigation aids using an augmented reality image that selects a ship and determines the selected second ship as a collision risk ship. The method of claim 6,
The control unit is a navigation aid using an augmented reality image that displays only the first augmented reality image of a second ship selected as a collision risk ship among the plurality of second ships by superimposing on the sailing image. The method of claim 7,
The control unit is a navigation assistance device using an augmented reality image that is displayed on the augmented reality navigation image by implementing the rest of the plurality of second ships as identification symbols. A communication unit for receiving radar data from a ship radar;
Based on the radar data, the first ship information of the first ship on which the user is boarded, the second ship information of the second ship disposed in a position adjacent to the first ship is determined, and the outside of the first ship from the camera module A control unit for receiving a navigation image photographed and generating an augmented reality navigation image;
An augmented reality image generator for generating the second ship as a first augmented reality image based on the first ship information and the second ship information; And
Including an image display for displaying the augmented reality navigation image,
The first ship information includes GPS coordinates, speed, and movement direction of the first ship, and the second ship information includes GPS coordinates, speed, and movement direction of the second ship,
The control unit analyzes the navigation image and superimposes the first augmented reality image on the position of the second ship in the navigation image to generate the augmented reality navigation image,
The control unit receives the photographing orientation from the camera module, determines the orientation of the navigation image, determines the GPS coordinates of the first ship based on the first ship information, and determines the GPS coordinates of the first ship based on the GPS coordinates of the first ship. Set GPS coordinates in the navigation image,
The control unit divides the navigation image into a plurality of areas, determines a distance of each area corresponding to an angle formed by each area with the camera module and sea level, and determines the distance of each area in response to the determined distance and the direction. Navigation aids using augmented reality images to set GPS coordinates in.

Images