KR101076240B1 - Device and method for an air defense situation awareness using augmented reality - Google Patents

Abstract

The air defense electric field situation providing apparatus using augmented reality according to the present invention comprises: an image acquisition unit for photographing an external real image and providing real image information; A position measuring unit measuring position information; An electronic map generator for providing an electronic map corresponding to the position information provided by the position measuring unit; A tactical information processor for providing tactical information about the enemy and allies corresponding to the actual image; An input unit for receiving a user command; An actual image provided by the image acquisition unit, an electronic map provided by the electronic map generation unit, tactical information provided from at least one of the tactical information processing unit and the input unit, and a user for receiving a command from an operator An augmented reality generating unit generating a tactical information image in which interface symbols overlap each other in a hierarchical structure; And a display unit for displaying the tactical information image.

Description

Device and method for providing air defense battlefield situation using augmented reality {a device and method for an air defense situation awareness using augmented reality}

The present invention relates to an apparatus and method for providing an air defense battlefield situation, and more particularly, to an apparatus and a method capable of improving an operator's operational performance by providing various tactical information on one display screen.

The future war is changing from a platform-based battlefield by unit weapon system to a network-driven operational environment in which all weapon systems share and co-operate with the information required by relevant units and personnel through technical connectivity and interoperability.

In a network-based operating environment, sensors and command control systems share situational awareness through the network and perform precise strikes, thereby maximizing warfare capability.At this time, tactical data link (TDL) is used as a communication means for command control between weapon systems. Tactical Data Links are used, and real-time tactical data links are required to perform a series of operations against enemy threats.

The air defense automation system integrates the data collected from the sensor radar network and takes necessary tactical measures. It consists of radar, fire control system and interlock system, data link processor (DLP), central processing computer to process input data, and exhibition console to display processed results and take appropriate tactical action. The system also includes wired and wireless voice communication equipment for voice communication.

The air defense automation system receives raw data (raw data) from sensor systems such as radar and electronic support measures (ESM), and target data processed by missile fire control equipment (eg AN / TSQ-73). It also directs weapons control commands and exchanges target information with similar tactical data systems, such as the adjacent air defense automation systems, AWACS (Airborne Warning and Control System), and Naval Tactical Data System (NTDS).

Standardized tactical data links include TADIL-A (Link-11), TADIL-B (TActical Digital Information Link-B), JTIDS (Joint Tactical Information Distribution System), and ATDL (Army Tactical Data Link).

In the conventional air defense automation system, the battlefield situation information (for example, friendly information, enemy information, situation map, various mission orders and situation report, etc.) is displayed through the tactical data link based on the electronic map to the operator at the present time. Provide tactical information. In the system equipped with the image acquisition device, there is a separate device for processing and displaying the acquired image and providing the corresponding information to the operator.

However, according to the conventional method of providing battlefield information, the battlefield situation can be recognized only through the electronic map and radar in the air defense combat situation, so that the operator should be aware of it and perform the mission. Due to limitations, there is a problem that loss and distortion of the battlefield information occurs. In addition, since a large number of display equipment, such as a display equipment for displaying an electronic map and a display equipment for displaying a camera acquired image, must exist separately, it takes up a lot of space for the system, thereby increasing the system installation cost. Rather, moving objects such as tanks, armored vehicles or vehicles have a problem that there is a limited space in the installation of the system due to the narrow internal space.

An object of the present invention for solving the above problems is to provide an apparatus and method that can improve the speed and accuracy of operator recognition of the battlefield situation.

In addition, another object of the present invention is to provide an apparatus and method that can improve the convenience of the operator's decision-making and combat situation information input.

Still another object of the present invention is to provide an apparatus and a method capable of reducing a system installation space.

The air defense electric field situation providing apparatus using augmented reality according to the present invention for achieving the above object, the image acquisition unit for providing the actual image information by taking a real image from the outside; A position measuring unit measuring position information; An electronic map generator for providing an electronic map corresponding to the position information provided by the position measuring unit; A tactical information processor for providing tactical information about the enemy and allies corresponding to the actual image; An input unit for receiving a user command; An actual image provided by the image acquisition unit, an electronic map provided by the electronic map generation unit, tactical information provided from at least one of the tactical information processing unit and the input unit, and a user for receiving a command from an operator An augmented reality generating unit generating a tactical information image in which interface symbols overlap each other in a hierarchical structure; And a display unit for displaying the tactical information image.

The tactical information image includes an acquired image layer on which the actual image is arranged, an electronic map layer on which the electronic map is arranged, a battlefield situation layer on which information on enemy and subordinates are arranged, and information on the current position, orientation, and time. The state information layer in which is arranged and the command tool layer in which user interface symbols for receiving a command from an operator are arranged may overlap each other in an upper and lower hierarchical form.

Further, information on the current position, orientation, and time of the status information layer is arranged at an upper end of the display unit, and the user interface symbols of the command tool layer are arranged at a lower end of the display unit, and at the center of the display unit. It may be formed so that information about the enemy and allies in the battlefield situation layer is arranged.

The apparatus may further include a motion sensor unit configured to receive motion information of the image acquisition unit, and the augmented reality generator may be configured to determine a field of view (FOV) area of the image acquisition unit according to the motion information.

The apparatus may further include a data link processing unit which receives the tactical information through the tactical data link and provides the tactical information to the tactical information processing unit.

In addition, the display unit may display the enemy, allies, and unidentified tracks using different symbols, and may provide different functions according to the number of clicks or dragging of each symbol.

In addition, the air defense electric field situation providing method using augmented reality according to the present invention for achieving the above object, the step of measuring the position information of the image acquisition unit using a position measuring unit; Photographing an external real image using the image acquisition unit to provide real image information; Providing an electronic map corresponding to the location information provided by the location measuring unit; Providing tactical information about the enemy and allies corresponding to the actual image; Generating a tactical information image in which an actual image provided by the image acquisition unit, the electronic map, the tactical information, and user interface symbols for receiving a command from an operator are superimposed on each other in a hierarchical structure; And displaying the tactical information image on a display unit.

According to the present invention, a tactical information image in which an electronic map corresponding to an actual image acquired through a camera and various tactical information on enemy / ally / unidentified tracks, as well as an object capable of inputting an operator command, are superimposed in an upper and lower hierarchical structure. By providing the system, the system operator can increase the speed and accuracy of the recognition of the battlefield situation, thereby improving the operational capability.

In addition, according to the present invention, there is an advantage that it is possible to improve the convenience of decision-making and combat situation information input of the system operator through the tactical information image of the multi-layer structure.

In addition, another object of the present invention is to display the tactical information image of the multi-layer structure through one display and to receive the operator's command through it, compared to the devices that require a plurality of display devices and input devices in the prior art Thus, there is an advantage that can be easily installed in a narrow space, such as tanks, armored vehicles or vehicles.

1 is a block diagram of the air defense electric field situation providing apparatus using augmented reality according to the present invention.
2 is a diagram showing a hierarchical structure of the augmented reality tactical screen according to the present invention.
Figure 3 is a view showing an example of the augmented reality tactical screen displayed on the display unit in accordance with the present invention.
4 is a diagram illustrating an example of operator input processing according to the present invention;
5 is a view illustrating a process of generating an augmented reality tactical screen according to the present invention.
6 is a view illustrating a detailed generation process of the augmented reality tactical screen according to the present invention.
7 is a view for explaining a virtual three-dimensional space to create augmented reality tactical screen according to the present invention.
8 is a view showing the relationship of each parameter for the track display position in the field of view (FOV) upon creation of augmented reality tactical screen according to the present invention.
9 is a view illustrating a process of an operator inputting an operator command through a display device according to the present invention.
10 is a diagram showing an example of an operator input processing area in a tactical screen according to the present invention;
11 is a view showing an example of the execution function according to the operator input for each object property on the tactical screen according to the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description and the annexed drawings, detailed descriptions of well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention will be omitted.

1 is a block diagram of the air defense electric field situation providing apparatus using augmented reality according to the present invention.

1, the air defense electric field situation providing apparatus 100 using augmented reality according to the present invention is an image acquisition unit 101, a motion sensor unit 102, a position measuring unit 103, a communication terminal 104, It includes a tactical information processing unit 111, electronic map generation unit 112, augmented reality generating unit 113, a data link processing unit 114, a display unit 121 and an input unit 122. The device 100 may be installed in a moving body such as, for example, a tank, an armored vehicle, a vehicle, or the like, and may also be fixedly installed in a field unit and a command center.

The image acquisition unit 101 provides actual image information such as a still image or a moving image of an external real subject obtained by an image sensor. The image acquisition unit 101 may include a camera such as a charged coupled device (CCD), an electro-optical (EO) sensor, an infrared (IR) sensor, a synthetic aperture radar (SAR), a sensor, a radar, and the like. As such, the image acquisition unit 101 photographs a real image outside the apparatus 100 and provides the augmented reality generator 113 with real image information about the captured real image.

The motion sensor unit 102 receives the motion information of the image acquisition unit 101. The motion sensor unit 102 may include a G-sensor, a geomagnetic sensor, and the like. The motion information received by the motion sensor unit 102 is provided to the augmented reality generator 113.

The position measuring unit 103 measures current position information of the device 100. For example, when the device 100 is installed in a tank, the current location information may be information about the current location of the tank. The position measuring unit 103 may be formed of a Global Positioning System (GPS), an Inertial Navigation System (INS), or the like. The current position information measured by the position measuring unit 103 is provided to the tactical information processing unit 111, the augmented reality generating unit 113, and the electronic map generating unit 112.

The tactical information processing unit 111 processes and stores various tactical information and performs system management. The tactical information may include information transmitted and received through the tactical data link and operator input information. The tactical information may include, for example, information about enemy and friendly tracks, information about unidentified tracks, information related to a specific tactic, command command, and information about unit status of all tactical data systems. It may include. Here, the track may include information about the air vehicle tracked through the radar and information about enemy and allies provided through the tactical data link. The tactical information may be transmitted and received from the tactical data link through the data link processing unit 114 or may be input from an operator through the input unit 122. The tactical information processing unit 111 provides the tactical information to the augmented reality generating unit 113 and the electronic map generating unit 112.

The electronic map generation unit 112 generates an electronic map corresponding to the position measured by the position measuring unit 103, and generates visual information in which the tactic information is superimposed on the electronic map. The electronic map information and the tactical information may be stored in advance in the electronic map generation unit 112 or may be provided through the communication terminal 104. The vision information generated by the electronic map generator 112 is provided to the augmented reality generator 112. The electronic map may be a battlefield situation chart prepared in advance in the mission planning. The vision information may include battlefield information. The battlefield situation information may include symbols indicating positions of the enemy and allies and distinguishing the enemy and allies.

The augmented reality generating unit 113 is a real image according to the real image information received from the image acquisition unit 101, the electronic map provided by the electronic information generation unit 112 and the tactical information processing unit ( 111 generates a fusion image, ie, a virtual tactical information image, in which the tactical information provided by 111 is fused with each other. The augmented reality generator 113 may overlay the vision information and the tactical information provided from the electronic map generator 112 in an upper and lower hierarchical structure to generate the fusion image. In addition, the augmented reality generating unit 113 receives the actual image from the image acquisition unit 110, receives the map information from the electronic map generation unit 112, the tactical information provided by the tactical information processing unit 111 The fusion image may be generated by overlaying the received actual image, map information, and tactical information in the form of a hierarchical structure. The fusion image generated by the augmented reality generator 113 is provided to the display 121.

The data link processor 114 processes tactical information transmitted and received with other systems through a tactical data link. The tactical information processed through the data link processor 114 is provided to the tactical information processor 111. As the tactical data link, not only standardized TADIL-A (Link-11), TADIL-B (TActical Digital Information Link-B), JTIDS (Joint Tactical Information Distribution System), ATDL (Army Tactical Data Link), but also other networks Includes all datalinks that establish a command control system through

The communication terminal 104 transmits and receives tactical information with other systems through the tactical data link. That is, the communication terminal 104 can transmit and receive tactic information not only with the system to which the apparatus 100 belongs, but with other systems through the tactical data link. The communication terminal 101 may be a radio or a dedicated terminal for data link communication.

The display unit 121 receives from the augmented reality generating unit 113 a fusion image, that is, a virtual tactical information image, generated by overlaying an actual image, map information, and tactical information in the form of an upper and lower hierarchical structure according to the present invention. To display. Accordingly, the display unit 121 may display augmented reality image information using the virtual tactical information image. The display unit 121 may include a monitor, a helmet mounted display (HMD), a head up display (HUD), and the like.

The input device 122 may allow an operator to input an operator command and data the operator command. The input device 122 may include a keyboard, a mouse, a touch screen, a microphone, and the like. When the input device 122 is formed of a touch screen, the input device 122 is overlapped and arranged on the display 121, whereby the operator touches an object displayed on the display 121. You can enter a command.

2 is a diagram illustrating a hierarchical structure of the augmented reality tactical screen according to the present invention. 3 is an example of an augmented reality tactical screen displayed on the display unit according to the present invention, and shows an augmented reality image (AR image) formed by combining a real image and a tactical information image.

2 and 3, the augmented reality tactical screen according to the present invention is a configuration of the screen displayed on the display unit 121, the lower image acquisition layer for the actual image obtained through the image acquisition unit 101 at the bottom The 210 is arranged, and the battlefield situation layer 220, the electronic map layer 230, the state information layer 240, and the command tool layer 250 are sequentially arranged on the acquired image layer 210. . Each of the layers 210 to 250 is configured as a separate layer, and each layer includes objects suitable for each visual purpose. As described above, the basic hierarchical structures 210 to 250 having the multi-layer are formed by the tactical information processing unit 111, and the information on the basic multi-layer structures 210 to 250 is provided to the augmented reality generating unit 113. Then, the augmented reality generating unit 113 forms a final tactical information image by forming tactical information, an electronic map, a user interface symbol, etc. corresponding to each layer in the basic multilayer structure 210 to 250.

In detail, the image acquisition layer 210 includes an actual image 211 obtained by the image acquisition unit 101. A field of view (FOV) is determined according to camera characteristics (eg, sensor area, magnification, angle of view, etc.) of the image acquisition unit 102 and the actual image captured by the image acquisition unit 102 is determined. The coordinates of the four corner portions may be determined by the field of view (FOV).

The battlefield situation layer 220 is displayed in the form of a circular symbol 221 at the position of a track existing in the field of view (FOV) among the tactical information processed by the tactical information processing unit 111, and also selected by the operator. Accordingly, the basic information 222 and the detailed information 223 of the corresponding track are displayed. The basic information 222 may include information on a track number, speed, azimuth, type, classification of enemy and allies (IFF), location, and altitude of a corresponding track. The detailed information 223 may include information regarding affiliation, occupant, weapon status, engagement situation, and the like.

The electronic map layer 230 may include an electronic map, and the electronic map may include the context diagram 231 and the battlefield situation information 232. The situation diagram 231 shows the situation diagram created during the mission planning. The battlefield situation information 232 is a symbol for recognizing the position of the enemy and friendly forces. 3 illustrates an example in which the battlefield situation information 232 about the enemy is displayed in the situation chart 231.

The self state information layer 240 includes the current location 241, the LOS orientation 242, the current time 243, mission information and other details of the device 100.

The current position 241 is coordinates of measuring the position of the device 100 measured by the position measuring unit 103. The LOS is the LOS orientation of the camera measured by the motion sensor 102. The current time is the current system time of the device 110. The mission information is mission related information (for example, a range of engagement, a reconnaissance range, etc.) assigned to the operator of the apparatus 100. Other status information may include information about armed status and system status.

In the command tool layer 250, user interface (UI) symbols 251 for controlling various commands are formed. The command tool layer 250 may be configured to display a message provided over a datalink.

4 shows an example of operator input processing according to the present invention.

As shown in (a) of FIG. 4, the display unit 121 according to the present invention displays an AR image formed by combining a real image and a tactical information image. In the augmented reality image, a plurality of different circular symbols 221 are displayed at positions of enemy, friendly, and unidentified tracks existing in the field of view (FOV) of the image acquisition unit 101 of the real image. Enemy, friendly and unidentified tracks can be distinguished from each other in the tactical information video.

In FIG. 4, the case where the display unit 121 is formed of a touch screen is described as an example. Therefore, an operator may input an operator command by touching the display unit 121.

Accordingly, when the operator touches any one of the plurality of circular symbol objects formed on the display 121 (that is, when one object is clicked), a function corresponding to the touched symbol object is performed. Referring to FIG. 4B, information corresponding to the touched symbol object is displayed on the display 121. As such, when an operator makes an input, a function corresponding to an identifier ID of the displayed tactical information object is performed.

5 is a view illustrating a process of generating an augmented reality tactical screen according to the present invention.

Referring to FIG. 5, first, in order to form an augmented reality tactical screen according to the present invention, the augmented reality generating unit 113 calculates a camera position of the image acquisition unit 101 (310) and a field of view according to the camera posture information. Compute (FOV) (320). After that, the augmented reality generator 113 filters a track existing in the real image captured by the image acquisition unit 101 (330), and calculates a track presentation position in the FOV (340). ). In operation 350, the symbol is displayed at the mapped track position. Steps 310 to 350 are repeated periodically, a detailed process will be described below with reference to FIG.

6 is a diagram illustrating a detailed generation process of the augmented reality tactical screen according to the present invention.

Referring to FIG. 6, the augmented reality tactical screen generating process according to the present invention will be described in more detail. First, the augmented reality generating unit 113 receives position information from the position measuring unit 103 (311), and an electronic map. After receiving the altitude information (DTED: Digital Terrain Elevation Data) of the current position from the generation unit 112 (312), the camera installation position coordinates of the image acquisition unit 101 is calculated (313). Here, steps 311 to 313 correspond to the detailed steps of step 310 of FIG. 5.

Subsequently, the augmented reality generating unit 113 loads an angle of view, magnification, sensor area, and focus position value according to the camera characteristic (321), and receives the motion information of the camera from the motion sensor unit 102 ( In operation 323, line of sight (LOS) based on camera motion information is calculated (323). In addition, the augmented reality generator 113 calculates a coordinate expression of a field of view (FOV) boundary line according to the camera focus position and line of sight (LOS) information (324), and generates a field of view (FOV) according to the calculated field of view (FOV) boundary line coordinate equation. ) Is calculated (325). Here, steps 321 to 325 correspond to the detailed steps of step 320 of FIG. 5.

When the field of view (FOV) range is calculated as described above, the image acquisition unit 101 photographs an external real image corresponding to the field of view (FOV) and provides the image to the augmented reality generating unit 113, and augmented reality generating unit In operation 331, a field of view (FOV) is provided to the tactical information processing unit 111.

Then, the tactical information processing unit 111 loads all tracks including enemy and friendly tracks stored in the tactical information processing unit 111 (332), and the field of view (FOV) area of the actual image among the loaded tracks. Extracting the track existing in the and provides the basic information and detailed information of the track to the augmented reality generator 113 (333). Here, steps 331 to 333 correspond to the detailed steps of step 330 of FIG. 5.

Then, the augmented reality generator 113 calculates a linear equation between the camera focus position and the extracted track position (341), calculates an intersection point between the linear equation and the camera sensor (342), and calculates the symbol object for the track. The visual position (X, Y) is calculated (333). Here, steps 341 to 343 correspond to the detailed steps of step 340 of FIG. 5.

Then, the augmented reality generating unit 113 loads the track basic information (351) and generates objects of different symbols depending on whether the track is "enemy", "ally" or "unidentified". (352). In step 352, the augmented reality generating unit 113 receives an electronic map corresponding to the location information provided by the location measuring unit 103 from the electronic map generating unit 112, and the electronic map and the enemy group / ally friendly. Creates a tactical information image in which a symbol object for an unidentified track and user interface symbols for receiving a command from an operator are superimposed on each other in a hierarchical structure. Subsequently, the object of the symbol corresponding to the presentation position (X, Y) corresponding to the extracted track and the tactical information image are displayed on the display 121 (353). Here, steps 351 to 353 correspond to the detailed steps of step 350 of FIG. 5.

FIG. 7 is a diagram illustrating a virtual three-dimensional space for generating an augmented reality tactical screen according to the present invention, and is used when performing step 330 of FIGS. 5 and 6.

In step 332, a virtual three-dimensional space as shown in FIG. 7 is generated, and then the positions of all tracks are converted into relative coordinates with respect to the reference point (○). Here, the reference point ○ is an installation point of the position measuring unit 103. And R _l , R _h , R _w and n, l, m are constant values previously defined as the operating range of the system. T1, T2, and T3 are positions of tracks stored in the tactical information processing unit 111. In FIG. 7, only positions T1, T2, and T3 for three tracks are displayed, but a larger number of tracks and positions may be displayed.

FIG. 8 illustrates the relationship of each parameter for the track presentation position in the field of view (FOV) during generation of the augmented reality tactical screen according to the present invention, and is used when performing step 340 of FIGS. 5 and 6.

In FIG. 8, ○ (0, 0, 0) represents a coordinate of the position measuring unit 103 as a reference point.

F (x _f , y _f , z _f ) indicates the position of the camera focus of the image acquisition unit 101.

T (x _t , y _t , z _t ) represents the position of the track and is expressed in three-dimensional coordinates taking into account the surface of the earth.

S (x _s , y _s , z _s ) is a straight line connecting F (x _f , y _f , z _f ) and T (x _t , y _t , z _t ) and the sensor plane of the image acquisition unit 101. It shows the intersection of (Sensor Plane). After converting the intersection point to the (Xd, Yd) coordinates of the sensor plane, a symbol-shaped object is created based on this to display a symbol on the screen.

R _tf is a linear distance between the track plane and F (x _f , y _f , z _f ), and may be calculated using camera motion information of the image acquisition unit 101.

R _df is the linear distance (ie focal length) between the sensor plane and F (x _f , y _f , z _f ) and uses the camera characteristics (LOS, magnification, angle of view) of the image acquisition unit 101. Can be calculated.

9 is a diagram illustrating a process of an operator inputting an operator command through a display device according to the present invention.

Referring to FIG. 9, the operator displays the real image, the electronic map, the tactical information, and the tactical information image in which the user interface symbols are superimposed on the screen of the display unit 121 according to the present invention. When a command for touching a specific position of the display unit 121 is input, the tactical information processing unit 111 identifies the selected position (410). Herein, a process of inputting an operator command will be described using an example in which the display unit 121 is formed as a touch screen, but an operator selects a specific position of the display unit 121 using the input unit 122. Even when this is input, the tactical information processing unit 111 may recognize an operator command.

The tactical information processor 111 determines whether a specific object exists at a location touched by the operator on the display 121 (420). As a result of the determination in step 420, if a specific object exists in the touched position, it is determined that the specific object is selected, and the type of the specific object is identified.

Subsequently, the tactical information processing unit 111 identifies an execution function of the selected specific object (430).

In addition, the tactical information processing unit 111 identifies the operator's input type with respect to the selected specific object (440). Then, the tactic information processing unit 111 identifies the object and the operator input selected by the operator to perform a function for each object and operator input. The function of the object performed as described above may be reflected on the tactical information image by the augmented reality generator 113 and displayed on the display 121. For example, the type of the object, the execution function of the object, and the operator's input type to the object are shown in FIG. 11.

As such, when the type of the selected specific object, the execution function, and the input type of the operator are identified, the tactical information processing unit 111 performs a function corresponding to the input of the operator (450).

10 shows an example of an operator input processing area in the tactical screen according to the present invention. 11 shows an example of an execution function according to operator input for each object property on the tactical screen according to the present invention.

In FIG. 10, objects A1, A2, A3, and A4 for inputting an operator command are formed at the lower left of the screen of the display unit 121, and objects B1, B2, B3, which represent tracks of enemy forces are formed in the left center. B4) is formed, an object C representing an unidentified track is formed in the right center part, and objects D1, D2, and D3 representing a friendly track are formed in the lower right part.

As shown in FIG. 11, the object A1 is a message button, and when an operator clicks on the object A1 once, the object A1 opens the received message received through the external tactical data link. Click once to give the operator the ability to send a message to the other party. Here, the term 'click' refers to an operation in which an operator's command for a specific position is input on the display unit 121. When the display unit 121 is formed as a touch screen, the term 'click' refers to an operation on the display unit 121. It refers to the operation of touching the position, it is used in the same meaning below.

The object A2 is an electronic map button. When the track A is clicked once when no track is selected on the screen of the display unit 121, the object A2 performs the entire map view function. Displays a mini map centered on the track.

Object A3 is a setting button that provides a system setting execution function when clicked once.

The object A4 is a magnetic information button. When the object A4 is clicked once, the object A4 shows magnetic detailed state information of the device 100.

The object B1 is an object indicating that there is an enemy track symbol. When the object is clicked once, the object B1 shows the basic information of the enemy track, and when the object is clicked twice, the object B1 shows a predetermined track menu for the enemy track.

The object B2 is an object related to the enemy track basic information window. When the user clicks on it once, the object B2 shows the next basic information about the enemy track through the basic information window. do.

Object B3 is a track-centered minimap window, where a single click moves a rectangular minimap around that point, a second click terminates the minimap, and there is a drag input within the minimap window. Panning the minimap, and having a drag input at an edge of the rectangular minimap window, enlarges or reduces the minimap window area.

The object C1 is an object indicating that there is an unidentified track symbol, and when it is clicked once, basic object information about the unidentified track is displayed, and when it is clicked twice, the object C1 displays a predetermined menu for the unidentified track.

The object D1 is an object indicating that there is a friendly track symbol, and when the first click is clicked, the object D1 shows basic information of the friendly track.

Object D2 is an object related to the friendly track basic information window, and when it is clicked once, the basic information window shows the next basic information about the friendly track, and when clicked twice, the basic information window is closed. do.

Object D3 is an object related to the friendly track detail window. When the user clicks on it once, the detailed information window of the friendly track is displayed through the detail information window. When the object is clicked twice, the object detail window is closed. do.

The anti-aircraft battlefield providing method using augmented reality according to the present invention can be implemented as computer-readable codes on a computer-readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also include those implemented in the form of carrier waves such as transmission over the Internet. The computer readable recording medium may also be distributed over a networked computer system so that computer readable code is stored and executed in a distributed manner.

Although the technical spirit of the present invention has been described in detail according to the above-described preferred embodiment, it should be noted that the above-described embodiment is for the purpose of description and not of limitation. In addition, those skilled in the art will understand that various embodiments are possible within the scope of the technical idea of the present invention.

100: device 101 of the present invention: image acquisition unit
102: motion sensor unit 103: position measuring unit
104: communication terminal 111: tactical information processing unit
112: electronic map generation unit 113: augmented reality generation unit
114: data link processing unit 121: display unit
122: input unit 122

Claims (9)

An image acquisition unit which photographs an external real image and provides real image information;
A position measuring unit measuring position information;
An electronic map generator for providing an electronic map corresponding to the position information provided by the position measuring unit;
A tactical information processor for providing tactical information about the enemy and allies corresponding to the actual image;
An input unit for receiving a user command;
An actual image provided by the image acquisition unit, an electronic map provided by the electronic map generation unit, tactical information provided from at least one of the tactical information processing unit and the input unit, and a user for receiving a command from an operator An augmented reality generating unit generating a tactical information image in which interface symbols overlap each other in a hierarchical structure; And
It includes a display unit for displaying the tactical information image,
The tactical information video,
An acquisition image layer in which the actual image is arranged;
Battlefield situations where information about the enemy and friendly forces is arranged;
An electronic map layer on which the electronic map is arranged;
A status information layer in which information about the current position, azimuth, and time is arranged;
Apparatus for providing an air defense battlefield situation using augmented reality, characterized in that the user interface symbols for receiving a command from the operator is superimposed in the order of the command tool layer arranged.
delete The method of claim 1,
On the upper end of the display unit information about the current position, orientation, time of the status information layer is arranged,
The user interface symbols of the command tool layer are arranged at the bottom of the display unit,
The air defense battlefield situation providing apparatus using augmented reality, characterized in that the central portion of the display unit information on the enemy and allies of the battlefield situation layer is arranged.
The method of claim 1,
Further comprising a motion sensor unit for receiving the motion information of the image acquisition unit,
The augmented reality generating unit air defense electric field situation providing apparatus using augmented reality, characterized in that for determining the field of view (FOV) region of the image acquisition unit according to the motion information.
The method of claim 1,
Receiving the tactical information through a tactical data link, the air defense electric field situation providing apparatus using augmented reality further comprises a data link processing unit for providing the tactical information to the tactical information processing unit.
The method of claim 1,
The display unit displays an enemy, an ally, and an unidentified track using different symbols, and provides different functions according to the number of clicks or dragging of each symbol. Provision device.
Measuring position information of the image acquisition unit by using the position measurement unit;
Photographing an external real image using the image acquisition unit to provide real image information;
Providing an electronic map corresponding to the location information provided by the location measuring unit;
Providing tactical information about the enemy and allies corresponding to the actual image;
Generating a tactical information image in which an actual image provided by the image acquisition unit, the electronic map, the tactical information, and user interface symbols for receiving a command from an operator are superimposed on each other in a hierarchical structure; And
Displaying the tactic information image on a display unit;
The tactical information video,
An acquisition image layer in which the actual image is arranged;
An electronic map layer on which the electronic map is arranged;
Battlefield situations where information about the enemy and friendly forces is arranged;
A status information layer in which information about the current position, azimuth, and time is arranged;
Method for providing an air defense battlefield using augmented reality, characterized in that the user interface symbols for receiving a command from the operator is superimposed in the order of the command tool layer arranged.
delete The method of claim 7, wherein
On the upper end of the display unit information about the current position, orientation, time of the status information layer is arranged,
The user interface symbols of the command tool layer are arranged at the bottom of the display unit,
Method of providing an air defense battlefield situation using augmented reality, characterized in that the central portion of the display unit is arranged information on the enemy and allies of the battlefield situation layer.

Images