CZ307427B6 - A method of displaying tactical data from military command and control systems and their presentation in three dimensions and connection for its implementation - Google Patents

Abstract

A method of displaying tactical data from military command and control systems and their presentation in three dimensions whose essence is characterized by the fact that, after starting the system of the new presentation layer (9) with virtual reality elements, initialization of the data stored in the terrain database generator (25), initialization of the virtual reality graphic engine block (20) and initialization of virtual reality resources take place, whereupon, in the second step, generating a 3D representation of military units in the form of tags based on information from the block (2) of the operational tactical command and control system takes place. It is then followed by predicting the direction of motion of the units with the subsequent application of aggregation filters and generating tags from a digital map data file (26), this information is subsequently processed by an input layer (28) which processes the 2D information from the system and applies aggregation filters with motion prediction in order to suppress the indefiniteness of the occupied area by the unit when converting the tags into a 3D dimension. In the third step, information from data gloves (23) and the tracking device (24) is retrieved, and based on this information, in the fourth step, a 3D view of the area of interest is calculated, in which the 3D representation of the units is inserted, which is then displayed in selected imaging systems, wherein the second, third and fourth steps occur in a cycle until the system is shut down.

Description

Technical field

The invention relates to a method for displaying tactical data from military command and control systems and presenting them in three dimensions.

BACKGROUND OF THE INVENTION

Command and control systems provide the commander with information on the current state of the battlefield.

The maps show individual combat means such as tank, infantry fighting vehicle, armored personnel carrier, or units (teams, platoon, company, battalion, brigade, volume). The maps are presented in the form of a classic map in two dimensions, or there are systems for displaying the real situation on the battlefield in three dimensions. The uncertainty of tactical data is caused by the method used to collect information about units in command and control systems.

So far, the operator has only obtained information about the state of the area of interest using the presentation layer in two dimensions. For communication, the operator used only classic input devices, such as a mouse and keyboard (which resulted in a slow interaction between the operator and the system). Also the overall resolution of the displayed space was given by the display capability of the output devices, ie CRT or LCD monitors.

The original presentation layer provides standard functions known from the Geographic Information Systems (GIS), ie reducing, enlarging or shifting the current position above the map, which is more or less interactive.

The 4D-GIS technology described in US Patent Application No. US 2009087029 A1 employs a GIS-based algorithm to determine the position of a moving target through a terrain image obtained from a moving target indication sensor or a small unmanned aircraft (UAV) photo with a digital map from GIS. The predicted motion of the target is estimated using the Advanced Kaman Filter (EKF). In order to improve the prediction of the moving target trajectory, a fuzzy logic algorithm is used by synthesizing GIS data and based on target statistics, tactics and other previous experience and derived information to obtain the most likely direction of target movement relative to the nature of the terrain and predicted intent.

The mixed reality presentation system described in US Patent Application Publication No. US 2010/026714 A1 utilizes the principle where a display composite unit sends a composition of a physical space and virtual space image to a display unit. The display composite unit calculates the change information half the difference between the display time of the physical space and the estimated time of the complete generation of virtual space. This change information and the obtained position and orientation information are transmitted to the image processing apparatus. The position visibility line prediction unit updates the previous change information using the received change information and the calculated estimated time of complete generation of both spaces, thus also the time difference between the two calculations, while predicting the position and orientation in view after the complete calculated generation of both spaces. The virtual space generated based on the predicted location and orientation with respect to the assumed space generation time is transmitted to the VHMD.

The hitherto known three-dimensional presentation of map data does not address the way the units are displayed according to the actual area on which they are located. Only the tactical mark is always displayed as a two-dimensional tactical symbol, or a three-dimensional cube, at a position that is delivered to the command and control system by means of a formalized message from the commander of the degree, or

Using the Global Positioning System (GPS), which detects the position of the combat means of the unit.

SUMMARY OF THE INVENTION

SUMMARY OF THE INVENTION The object of the invention is to propose a new way of displaying tactical data from military command and control systems and presenting them in three dimensions that would compensate for the uncertainty of tactical data using new methods of displaying real terrain and units.

The above-mentioned shortcomings are eliminated by the way of displaying tactical data from military command and control systems and their presentation in three dimensions, which is based on the fact that when the new presentation layer system with virtual reality elements is started, the data stored in the terrain generator database, initialization of the application for the virtual reality engine and then the virtual reality resources initialization, then the second step will generate a 3D presentation of military units in the form of tags based on information from the block of operational tactical command and control application of aggregation filters and generating tags from an application with a database for digital map data, this information is subsequently processed by the input layer, which processes 2D information from the system and applies Motion prediction filters based on the recorded history of position reports of the units to suppress uncertainties in the conversion of markers to 3D dimension, then in the third step the information about the position of the fingers from the data gloves and head display to the trekking device, in step 4, calculates a 3D view of the area of interest, in which a 3D presentation of units is inserted, which is then displayed in selected display systems, with the second, third and fourth steps running in a cycle until system shutdown and then a new presentation layer and the existing presentation layer works in parallel.

The very essence of the invention is to display a tactical situation on a 3D real terrain presentation with 3D unit presentation based on command and control system data with the possibility of output to several devices (head display or LCD system or projection or stereoscopic projection). using virtual reality (trekking equipment and data gloves), while the system works in real time and is used to control combat (not a simulator, although it can still be used).

In order to provide a 3D representation of tactical data with maximum utilization of the existing system, it is advantageous for the new virtual reality presentation layer to include an application with virtual reality graphics engine software that is connected to the block of virtual reality hardware input layer via bidirectional data bus. output layers of virtual reality hardware, which is further connected via unidirectional data buses to the head display block, the LCD monitor system block and finally to the projection system block. A data glove block and a trekking block are connected to the block of the virtual reality hadware entry layer via bidirectional data buses. The terrain database generator block is connected to the virtual reality graphics engine block via bidirectional data buses, which is then connected to a digital map file via a unidirectional data bus, and three-dimensional data models are connected to the virtual reality engine block. to the new presentation layer equipped with virtual reality elements is connected through the input layer block via bidirectional bus block of operational tactical command and control system and bitmap generator block according to the standard APP-6A, which is attached to the file with graphic design of military symbols according to standard APP-6a .

To enable visualization of visualized tactical data in 3D, the system is equipped with a head or LCD display system or a projection system with classical or stereoscopic projection.

-2GB 307427 B6

The advantage of the new presentation layer is that it is based on the experience of working with virtual reality resources (VR) in the area of modeling and simulation. In this area, CoR resources are a common and proven technology for years. Head mounted display (HMD), glove data and trekking equipment are used both for individual training and for higher level exercises. Knowledge of VR technologies has opened a new path for command and control. The basic idea is to give the commander as much information as possible about the battlefield. The level of assurance is being increased significantly by using VR means. The head display is displayed in a high resolution of the current situation, while the commander has the opportunity to move the virtual battlefield with only head movements. E.g. turning left means projecting a visual battlefield from the adjacent left side of the area of interest. The master also has a data glove for communication with the new presentation layer. Performs zooming in and out using predefined gestures. The movement of the data glove and the head display is sensed by the trekking device.

The new presentation layer, when incorporated into the existing command and control system, offers a new means of improving the commander's decision-making process at the brigade level.

The new Virtual Reality Presentation Layer (PVVR) solution offers connectivity to output devices such as Head Mounted Displays (HMD) or LCD or conventional or stereoscopic projection systems. The head display shows the situation in the area of interest depending on the position of the head in the space and its rotation. The composite LCD monitor system allows you to display the area of interest in high definition. If 3 LCD monitors are used, the new presentation layer can display resolutions up to 3840 * 1024. This resolution can be changed according to specific requirements. The last variant of the new PVVR output is the use of a projection system. The projection system can be used in a variant with direct or antero-posterior projection. For both types, synchronized projectors that compose the resulting image can be used for higher resolution. The resulting image can then be projected onto the assembled projection screens in the form of the top of the hexagon, or onto a spherical surface. The choice of a suitable variant depends primarily on the amount of free space. Another type of projection is stereoscopic projection. This is a spatial image generated for both the left and right eye and projected onto a screen with a special projector. The commander, with the help of special glasses, watches the picture on the canvas with a spatial perception (similar to the 3D cinema).

A new presentation layer with virtual reality features allows you to view the area of interest in 3D with a different way of displaying the resulting image.

The advantages of the new presentation layer are:

Application of aggregation filters with prediction of the movement of units (described in the Application Example of the invention) in the input layer.

• Generate a 3D presentation of units along with 3D data on combat capability, speed of movement and fuel status based on aggregation filters from the input layer.

• View 3D tactical situations based on virtual reality data (trekking equipment and data gloves).

• Display of the resulting image in a head visualization system and in a projection system with stereoscopic projection.

Nor is it negligible that the system displays real-time tactical battlefield information based on user information and system information.

- 3 GB 307427 B6

Clarification of drawings

The way of displaying tactical data from military command and control systems and their presentation in three dimensions and their connection to its implementation will be explained in more detail by means of drawings, in which Fig. 1 shows arrangement of new presentation layer and its incorporation into operational tactical command and control system. Fig. 2 shows the layout of the new presentation layer and its incorporation into the Operational Tactical Command and Control System at the application level; Fig. 3 illustrates the global presentation layer architecture with virtual reality elements of the Operational Tactical Command and Control System; Fig. 5 shows a unit consisting of three subordinate units, Fig. 6 shows a unit consisting of 5 subordinate combat means, Fig. 7 shows a unit consisting of subordinate units and its own position, Fig. 8 shows a unit Fig. 9 shows a unit consisting of subordinate units, subordinate combat means and its own position, and Fig. 10 shows a unit with 3D indicators of combat capability, speed of movement and fuel status, and Fig. 11 shows a diagram of how the new presentation system works layers with virtual reality elements.

DETAILED DESCRIPTION OF THE INVENTION

An exemplary embodiment of a method of displaying tactical data from military command and control systems and presenting them in three dimensions will be described below. Generally, the unit is displayed as a transparent spatial object (block, cube, etc.) The size of the spatial object is determined according to the following conditions:

1. The position of the unit is entered by its commander

The size of the spatial object of the unit is given by tactical tables, for example according to Vševojsk-1-4 from 1997 and according to the design of Vševojsk-1-3 from 2002. The premises are divided for attack and defense, according to the following tables:

Attack Team Platoon Company Banner 100 m x 100 m 400 m x 200 m 1 km x 500m 3 km x 1 km Defense Team Platoon Company Banner 150m x 150m 500 m x 300 m 2 km x 1.5 km 6 km x 5 km

The rotation of the object in space is given by the prediction of the movement of the unit, see Fig. 4. The prediction of the movement is based on the history of position messages of the given unit.

2. The position of the unit is entered based on the position of the command vehicle (by GPS)

The size of the spatial object of the unit is determined in the same way as in point 1. The rotation of the object in space is determined by the prediction of the movement of the unit.

3. Slave unit positions are specified

The size of each unit is given according to the previous tables. According to the positions of the slave units, the spatial objects of the slave units are calculated and the envelope box is constructed, which is constructed from the maximum and minimum values in the direction of the local X and Y axes, see Fig. 5. child units.

-4GB 307427 B6

4. The positions of subordinate combat means are entered

The position of the combat device is given by the GPS system - that is, avoiding uncertainties arising in determining the unit space according to the specified subordinate units.

The overall spatial object is thus created as a enveloping spatial polygon, whose peaks form the positions of the subordinate combat means, see Fig. 6.

5. Slave unit positions and custom unit positions are specified

The position of the unit itself is known - the spatial object is determined in the same way as in point 1 a

2. Subsequently, the spaces of the slave units are calculated according to the above tables and the envelope box is constructed, which is constructed from the maximum and minimum values in the direction of local X and Y axes, where there are still marginal points of the slave units, or , see Fig. 7. This procedure obtains the maximum and minimum values in the X and Y axes, vertices and edges of the slave units and the unit itself.

6. The positions of subordinate combat means and positions of subordinate units are entered

Calculate the packing box according to point 3 for all slave units. This block begins to deform into a spatial polygon, whose peaks are formed either by the edges of the original block or by the positions of subordinate combat means that are located outside the original block, see Fig. 8.

7. The positions of the subordinate combat means, the position of the subordinate units and the position of its own units

The envelope box is calculated for the unit itself and the subordinate units according to point 5. This box begins to deform into a spatial polygon whose peaks are formed by the edges of the original box or by the positions of the subordinate combat means outside the original box, see Fig. 9 .

The overall algorithm can thus generally be described as follows:

If the position of the combat medium is specified, this position must be included in the calculation of the packaging object.

If a unit position is specified, the boundary of that unit is included in the wrapping object.

The position of combat means is included in the calculation of the envelope object only if the distance of the combat means and the boundary of the spatial object is less than the set value of constant D. (Constant D is calculated as half of the width occupied by the unit according to the above tables). If the distance of the combat medium is greater than a constant, it is in terms of command and control at a higher command level for this unit irrelevant.

Furthermore, a tactical symbol according to the current standard used in NATO along with the unit designation (currently APP6-a) is applied to this semi-transparent spatial object on all sides of the spatial object.

For better clarity, a vertical line is created from the center of the spatial object on which the tactical symbol is placed in two-dimensional form according to the current standard (APP6-A) together with the unit designation. This two-dimensional billboard is constantly rotated towards the viewer for readability.

-5GB 307427 B6

Figure 10 shows a unit that occupies a particular space and in this case is a semitransparent block. Other information that is also displayed - are parameters combat capability, speed of movement, fuel status. This information is retrieved from the command and control system. Their presentation is in the form of a spatial bar graph and express the state of the given quantity in percent. The maximum value, 100%, corresponds to a column that reaches the lower limit of a two-dimensional tactical billboard.

The circuitry for performing the method described above is shown in Figures 1 to 3. The circuitry in this embodiment illustrates the arrangement of the new presentation layer 9 with virtual reality elements and its incorporation into block 2 of the operational-tactical command and control system. FIG. 1 illustrates the layout of the main command site 1, which includes a two-dimensional presentation layer representation block 5 that includes a cathode ray tube monitor block 6, an LCD monitor block 7, and a two-dimensional presentation layer projection block 8. An existing presentation layer 4 is connected via a data bus to block 5 of the representation of the two-dimensional presentation layer, to which a block 2 of the operational tactical command and control system is connected via a double-sided bus. a tactical command and control system connected via the data bus to a new virtual reality presentation layer 9 which is connected via a data bus to a three-dimensional projection block 10 comprising a head display block 11, an LCD monitor system block 12 or a projection stereoscopic system 13.

The detailed arrangement of the operational-tactical command and control block 2 with the interconnection of the new presentation layer 9 with the virtual reality elements with the existing presentation layer 4 is shown in Fig. 2. The operational-tactical command and control block 2 in this embodiment comprises an application 14 tactical tasks and software application 15 to illustrate the situation on the battlefield, which are connected via a data bus with a dream presentation layer 9 provided with virtual reality elements. Further, block 2 of the operational tactical command and control system includes application 16 with formalized document creation software, application 17 with electronic methodology creation software, application 18 with management software and application 19 with management software, wherein the block 10 of the three-dimensional projection representation is interconnected. and block 2 of the representation of the two-dimensional presentation layer is provided through application 14 of operational-tactical task software and application 15 of software to represent situations on the battlefield that are integrated into block 2 of the operational-tactical command and control system.

The global architecture of the new presentation layer 9 with virtual reality elements of the operational tactical command and control system is shown in Fig. 3. The arrangement of the architecture of the new presentation layer 9 provided with virtual reality elements in this embodiment includes application 20 with virtual reality graphics engine software that is connected via bidirectional data buses to both virtual reality input layer block 21 and virtual hardware exit layer layer 22 reality, which is further connected via unidirectional data buses, on the one hand to the head display H, on the other hand a system of 12 LCD monitors or on the other hand a projection stereoscopic system 13. Further to block 21 In addition, an application 25 with terrain database generating software 25 is connected to the virtual reality graphic engine software application 20 via bidirectional data buses, which is further connected to the application via a unidirectional data bus. 26 with a database for digital maps. To the application 20, the virtual reality graphics engine software, the application 27 with the data model software in three dimensions is connected via a one-way bus. The new presentation layer 9 provided with virtual reality elements is further connected via the input layer 28 via a bidirectional bus with a block 2 of the operational tactical command and control system and with application 29 with bitmap generation software according to APP-6a which is connected to application 30 with database graphic form of military symbols according to APP-6a standard.

The engagement function designed to display tactical data from military command and control systems and present them in three dimensions is as follows.

-6GB 307427 B6

Provide the user (commander) with real-time information on the location of the units, the size of the area in which they are located and the status of the units in relation to the three-dimensional presentation of the terrain of the area of interest. This information is provided in real time from the existing command and control system, and through the new presentation layer 9 functions, this information is provided in a clearer form allowing a quick and intuitive understanding of the entire tactical situation presented.

With their movements and gestures, users determine their position and direction of movement over a three-dimensional model of the actual landscape where a military operation and information aggregation takes place. The existing command and control system reads the data of the operating units and for the application of aggregation filters are converted to a three-dimensional presentation and together with the 3D terrain model are displayed to the user on the selected output device.

Industrial applicability

The method of displaying tactical data from military command and control systems can be used to convey information about the current state of the battlefield to its users.

Claims (3)

Method for displaying tactical data from military command and control systems and their presentation in three dimensions, characterized in that after starting the new presentation layer system (9) with virtual reality elements, the first step of initializing the reading of data stored in the generator (25) ) terrain database, initialization of the application (20) with the software for the virtual reality engine and then the initialization of virtual reality means, then the second step will generate 3D presentation of military units in the form of tags based on information from block (2) operational tactical command and control system followed by prediction of the direction of movement of units followed by application of aggregation filters and generation of tags from application (26) with database for digital map data, this information is subsequently processed by input layer (28), which processes 2D information from the system and applies by reducing motion based on the recorded history of position reports of the units in order to suppress uncertainties when converting the symbols to the 3D dimension, then in the third step the finger position information is loaded from the data gloves (23) and the head display (11) to the treking device (24); whereupon based on this information, in a fourth step, a 3D view of the area of interest is calculated, in which a 3D presentation of units is inserted, which is then displayed in selected display systems, with the second, third and fourth steps the new presentation layer (9) thus created with the virtual reality elements and the existing presentation layer (4) work in parallel. The system for performing the method of claim 1, wherein the main command point (1) is a two-dimensional presentation layer representation block (5) and a three-dimensional projection representation block (10), wherein the two-dimensional presentation layer representation block (5) comprises a block (6) with cathode ray tube monitors, a block (7) with LCD monitors and a block (8) of two-dimensional or stereoscopic projections, wherein the two-dimensional presentation layer representation block (5) is connected via an data bus to an existing presentation layer (4); an operational tactical command and control block (2) is connected via a two-sided I / O bus to which a new virtual reality presentation layer (9) is connected via a data bus connected to a three-dimensional representation block (10) via a data bus a projection, wherein the operational tactical command and control block (2) comprises an application Operational tactical task software (14) and Battlefield application software (15) that are connected via a data bus to a new -7EN 307427 B6 presentation layer (9) provided with virtual reality elements, while applications (16) with formalized document creation software, applications (17) with electronic methodology creation software, applications (18) with management and application software (19) the management software is connected via a two-way I / O data bus to an existing presentation layer (4), wherein the connection of the existing presentation layer (4) and the new presentation layer (9) provided with virtual reality elements is realized through the operational tactical system block (2) command and control, wherein the new virtual reality presentation layer (9) comprises an application (20) with virtual reality graphics engine software connected to the input layer block (21) and the block (22) via bidirectional data buses. output layers of virtual reality hardware, which is further connected via a unidirectional data bus per block (10) representation of a three-dimensional projection, wherein data gloves (23) and a trekking device (24) are connected to the virtual reality input layer block (21) via bidirectional data buses, and a graphics engine software (20) to the application (20) virtual reality via bidirectional data buses are connected applications (25) with terrain database generating software, which is further connected via a unidirectional data bus to an application (26) with a database of digital map data and to application (20) with software for virtual graphics engine real estate is connected via a one-way bus with applications (27) with database for data models in three dimensions, while the new presentation layer (9) equipped with elements of virtual reality is further connected via input layer (28) via bidirectional bus of operational-tactical system command and control and application (29) with softwa re for generating APP-6A bitmaps, which is connected to an application (30) with a database with a graphic representation of APP-6a military symbols. System according to claim 2, characterized in that the three-dimensional projection display block (10) is designed as a head display (11) or an LCD display system (12) or a conventional or stereoscopic projection projection system (13).