EP1913326A1

EP1913326A1 - Gunnery training device using a weapon

Info

Publication number: EP1913326A1
Application number: EP06794318A
Authority: EP
Inventors: Valentin Lefevre; Laurent Chabin; Emmanuel Marin
Original assignee: Total Immersion
Current assignee: GDI SIMULATION
Priority date: 2005-08-09
Filing date: 2006-08-09
Publication date: 2008-04-23
Also published as: WO2007017599A1; FR2889736A3; US20090305198A1; FR2889736A1

Abstract

The invention relates to a gunnery training device using a weapon (1), said device being characterised in that it comprises video capturing means (5) for capturing the field of vision, angular capturing means for detecting angles defining the position of insertion of the synthesis images, processing means (21, 22) for inserting, in real-time, synthesis images into the captured field of vision, and means for visualising (6) the captured field of vision containing said at least one inserted synthesis image.

Description

DEVICE FOR DRIVING TlR FROM AN ARMY

The present invention relates to a device for training firing from a weapon allowing a user to train in a real context but with the insertion of virtual objects in the field of vision.

The invention more specifically relates to a firing training device or a firing simulator, in particular from a real weapon in a real context.

Shooting training used by the military in particular involves the use of non-real weapons in a context as real as possible. The training is made from different types of weapons, for example: rifle, tank, missile launcher.

The systems for practicing shooting practice are today mainly carried out with non-real weapons dedicated specifically to training. The reproduction of weapons tries to perfectly respect the dimensions, the mass and the ergonomics of the real system.

However, although weapons are as close to real weapons as possible, these weapons are still reproductions and may be different from actual weapons.

The systems also use certain imaging techniques to model a visual environment of the battlefield, including synthetic sets in which are present targets also in computer graphics.

These systems have a low level of realism since the sets are modeled in synthetic imaging. In addition, preparing a training scene is expensive. In addition, the training scene must be completely remodeled in a realistic way (with geometry, textures and materials) if the training ground is different.

In addition, these systems only work in a room, that is to say far from real conditions. In view of the foregoing, it would therefore be interesting to be able to make a training device in shooting from real weapons as well as in a real context in which the position of the weapon can vary, as well as the place and the time of appearance of the target virtual objects while avoiding at least some of the disadvantages mentioned above.

The present invention aims first and foremost to provide a device for training firing from a weapon, characterized in that the device comprises:

video capture means capable of capturing an angular field targeted by the weapon,

means for measuring angles capable of determining at least one angle representative of the position of the weapon,

processing means capable of inserting, in real time, at least one synthetic image into the captured field, according to the position information received from said angle measuring means, and

means for displaying the captured field containing said at least one inserted synthetic image.

The device according to the invention makes it possible to perform firing training in real conditions, that is to say on a real theater of operations. To do this, real interaction is created, in real time, between a weapon and a real context on the one hand, and virtual objects representing targets, fixed or moving, on the other hand.

The virtual targets are able to be positioned by means of the measurements obtained by the means for measuring angles.

According to a particular embodiment, the device comprises control means, in real time, able to control the processing means for the insertion of synthetic images.

According to one particular characteristic, the weapon is a real weapon.

According to this characteristic, the training can be performed from a real weapon, the training is all the more real and less expensive because does not require creation of a false weapon. According to a particular embodiment, the weapon comprising sighting means, the driving device comprises optical adaptation means adapted to allow the visualization of an image in the sighting means from the display means of the field of captured vision containing inserted synthetic images.

According to one particular characteristic, the position information received from said angle measuring means is heading and pitch.

According to another particular characteristic, the device further comprises driving means adapted to drive, in real time, the processing means capable of inserting synthetic images.

According to one particular characteristic, the device comprises locating means capable of determining the position of the video capture means in the reference mark of a three-dimensional synthetic field, the synthetic field being a model corresponding to at least one element of the field. angular captured.

According to this characteristic, the synthetic field comprises geometry information for determining the location of the capture means, so that the subsequent insertion of the synthesis images is carried out quickly and in an adjusted manner.

According to one embodiment, the locating means comprise means for matching, in real time, points of the synthetic field with corresponding points in the captured angular field.

According to another embodiment, the device comprises means for setting the synthetic field on the captured angular field.

According to a particular characteristic, the device comprises a location receiver able to locate the device, in particular a GPS.

According to another particular characteristic, the device comprises image analysis means able to increase the accuracy of the measurements made by the angle measuring means.

Other aspects and advantages of the present invention will appear more clearly on reading the description which follows, this description being given solely by way of nonlimiting example and with reference to the appended drawings, in which:

- Figure 1 shows schematically a shooting training device according to the invention;

FIG. 2 illustrates a hardware architecture of the firing training device according to a first embodiment according to the invention;

FIG. 3 illustrates a hardware architecture of the firing training device according to a second embodiment according to the invention;

FIG. 4 is a hardware or software architecture of the firing training device according to the first embodiment illustrated in FIG. 2; and

FIG. 5 is a hardware or software architecture of the firing training device according to the second embodiment illustrated in FIG. 3.

The description of the invention is made from a real weapon, for example a rifle, as shown in Figure 1. However, the implementation can be performed on any type of weapon, real or not.

As illustrated in Figure 1, a real weapon 1 includes a barrel 2, a viewfinder 3 and possibly a tripod 4, so as to carry the weapon. However, depending on the weapon, the tripod is not always necessary.

The viewfinder 3 is in particular an optical system mounted on the barrel, so that the optical axis is almost coincident with the axis of the barrel. The parallax, that is the apparent angular displacement of a body observed from two different points, is negligible.

To make a firing training device from a real weapon, it is rigidly fixed video capture means 5, including a high-definition video camera. The optical axis of the camera is almost confused with the axis of the barrel; parallax is negligible. In this way, the camera is able to acquire a video stream corresponding to the view of the shooter. The video capture means are capable of capturing an angular field targeted by the weapon. In addition, the weapon comprises viewing means 6. These viewing means allow the shooter to see a sharp image, for example through the viewfinder 3. They include for example a video monitor 7 and an optical matching unit 8 The video monitor is small so that it can be adapted to the weapon. In addition, to get as real a rendering as possible, the video monitor is high definition.

It is also possible to add to the weapon means for measuring angles, also called motion sensors or angular sensors based on different technologies, for example an inertial unit, laser positioning, optical encoders, monitoring by analysis of image also called tracking in Anglo-Saxon terminology.

A motion sensor allows in particular to know the orientation of the weapon, for example in the case of a weapon on a tripod.

The motion sensor also makes it possible to indicate the position and the orientation of the weapon, for example in the case of a weapon free of its movements, in particular in the case of a missile launcher positioned on the shoulder of the shooter.

In order to perform a shooting training, the video from the video capture means is modified in real time, so as to add to the real scenes virtual targets that the shooter must reach.

To do this, a hardware architecture of the training device shooting is now described with reference to Figure 2. This architecture is used in particular when the weapon is equipped with a motion sensor having a good accuracy.

This architecture comprises video capture means 5, in particular a high-definition camera and viewing means 6 enabling the shooter to visualize the real landscape augmented with virtual targets.

In addition, the augmented real landscape can include visual effects, including the addition of virtual elements to the landscape. Thus, it is allowed to add virtual buildings, to hide the vision when leaving the stroke. For example, an opaque smoke is simulated at the moment of firing and becomes clearer with time.

The hardware architecture comprises a first processing means 21 called the shooter's processing means, capable of generating the augmented video images of virtual objects constituting the marksmanship targets and a second processing means 22 called the processing means of the shooter. instructor, able to control the appearance of virtual targets on video images.

The video sensor 5 is connected to the processing means of the shooter 21 via a converter 23 of the component output HD-YUV to the HD-SDI ("High Definition Serial Digital Interface" in English terminology), especially in 16/9 format. The signal converting HD-SDI is then sent to the HD-SDI input 24 of the shooter processing means 21.

YUV is an analog video interface that physically separates three luminance (Y), the chrominance component 1 (U) and the chrominance component 2 (V) physically to three conductors to connect a video source to a processing means.

The architecture is also based on a firing button 25 present on the weapon. This button is connected to an input / output port 26 of the processing means of the shooter 21. The port can be in particular the serial port, the parallel port, the USB port, the analog input on a PCI card ("Peripheral Component Interconnect "in English terminology).

The motion sensor 9 added to the weapon as shown in FIG. 1 is also connected to an input / output port 26 of the shooter's processing means 21.

The shooter processing means 21 is equipped with an audio output 27 making it possible to connect loudspeakers 28 and a video output 29.

The audio output 27 is intended to reproduce the sound effects caused by firing, explosions, destruction of virtual targets, etc.

The video output 29 is connected to the display means 6 mounted on the weapon so as to display in the viewfinder of the weapon the real landscape, corresponding to the angular field targeted by the shooter's weapon, augmented by virtual targets and visual effects.

The video output is in particular UXGA format ("Ultra eXtended Graphics Array" in English terminology).

According to one embodiment, the video output 29 is connected to a video splitter 30. This splitter can, in this way, duplicate the video signal to the display means 6 mounted on the weapon and to a recorder 32, in particular by means of a video recorder. intermediate of a converter 33, able to convert the images, for example in UXGA format in PAL or NTSC format to allow the recording of video images by the recorder 32.

The recorder 32 is notably a DVD recorder including a hard disk. This recorder makes it possible, on the one hand, to memorize the video images seen by the shooter and, on the other hand, to make it possible to replay the shooting sequences during the evaluation or debriefing phase.

The video splitter 30 may also duplicate the video signal to an instructor's monitor 34 to allow the instructor to view the shooter's images.

The instructor processing means 22 comprises a video output 35, in particular in the UXGA format, connected to a screen 34, in particular via a video switch 36. By means of this switch, the screen of the instructor 34 allows visualization of either the shooter's field of view augmented with the virtual targets, or the man-machine interface of the instructor station generated by the instructor processing means 22.

The shooter processing means 21 and the instructor processing means 22 may be connected together via, in particular, an Ethernet concentrator 37.

The data corresponding to the virtual objects to be inserted in the video corresponding to the real training landscape are stored, for example in a database, either on the processing means of the shooter 21, or on the instructor processing means 22. .

It is also connected to the instructor processing means 22 a mouse or joystick-type joystick via an input / output port, especially via the USB port ("Universal Serial Bus" in English terminology).

According to an alternative embodiment, it is now described with reference to FIG. 3, a hardware architecture of the firing training device comprising image analysis means. This architecture is used in particular when the weapon is equipped with a motion sensor that does not have good accuracy.

The hardware architecture illustrated in FIG. 3 is equivalent to the hardware architecture illustrated in FIG. 2, except that a specific image analysis means 40 has been added.

The means illustrated in FIG. 3 already present in FIG. 2 and described above bear the same identifier.

According to this architecture, the motion sensor 9 is no longer connected to the processing means of the shooter 21, but to the image analysis means 40 via input / output ports 41 of the analysis means 40.

Indeed, in this way, the motion sensor indicates approximately the orientation (heading, pitch) of the video capture means 5 in the real environment. From this information and the image from the video capture means, the image analysis means 40 refines the heading and pitch values.

Thus, the image analysis increases the accuracy of the orientation of the video capture means, the orientation being constituted by values in (heading, pitch).

According to a particular embodiment, the values (heading, pitch) are refined by matching points of interest contained in the video image from the video capture means, with predetermined points of interest of the global panorama.

The time required for image analysis to determine the orientation is optimized by the rough knowledge of the (heading, pitch) values sent by the imperfect motion sensor.

In addition, the video sensor 5 is also connected to the image analysis means 40 via the video input 42 of the image analysis means 40. The image analysis means 40 is connected to the various processing means, in particular to the processing means of the shooter 21 and to the processing means of the instructor 22, via a network, for example the Ethernet network.

This image analysis means 40, according to this variant embodiment, is dedicated to the sending via the network of orientation information (heading, pitching) of the video capture means to the shooter processing means 21.

This information is generated, in particular by means of two data streams, namely the flow of data coming from the motion sensor 9 and the data flow coming from an image analysis algorithm.

It is now described the software architecture for the implementation of the firing system in accordance with the invention, with reference to Figure 4.

This software architecture is presented with reference to the hardware architecture illustrated in Figure 2.

According to this implementation, the shooter processing means 21 is equipped with augmented reality processing means 45, in particular with the FUSION software of TOTAL IMMERSION.

Augmented reality consists of mixing synthetic images, also called virtual objects with real images from the video capture means 5.

The augmented reality processing means realizes the addition of virtual objects in a video and the visualization resulting from this addition in real time, thus generating augmented reality videos in real time.

To do this, the shooter processing means 21 mixes synthetic images and real images in real time, that is to say operates the processing at a video frame rate of 50 frames per second or 60 frames. per second according to the standard video capture means.

The shooter processing means 21, in addition to containing an augmented reality processing software, comprises various software modules for processing the shooting training system. One of the modules consists of a fire management module 44 able to manage the recovery of the support on the firing button by the shooter.

A second module consists in determining in real time the trajectory of the firing 47. To do this, this module calculates, in real time, the coordinates of the projectile, in particular the coordinates in X, Y and Z, the heading, the pitch and the roll. .

Depending also on the type of weapon, it is possible that the aiming axis of the shooter influences the trajectory of the missile, particularly in the case of guided missiles.

A third module collects data from the motion sensor 48. These data are a function of the type of sensor and are, for example, the pitch and pitch torque, or all the heading, pitch and roll data, or the X coordinates. Y and Z and course, pitch and roll.

As for the instructor processing means 22, a control module 49, also called exercise management module, is present to control in particular the passage of virtual targets in real time on the display means of the weapon.

This module is used to instruct a shooter (missile, tank, or any other weapon) under the guidance of an instructor.

To do this, the instructor controls by means of a man / machine interface and a joystick, the virtual targets to be inserted in the video acquired by the capture means 5 and presented to the shooter.

Thus, these instructions are, according to one embodiment, transmitted to the processing means of the shooter 21 so that the latter makes, by the augmented reality processing software 41, the incrustation of virtual targets in the acquired video.

In addition, the instructor can control the symbology, that is to say the reticle also called the aiming aid. Indeed, the instructor can manipulate symbols that appear in the shooter's viewing screen. In this way, he can guide the shooter, for example, by showing him a target he has not seen in the landscape or asking him to aim at a certain point of the landscape.

A communication interface between the shooter processing means 21 and the instructor processing means 22 makes it possible to manage the communications. Indeed, for each virtual target to be inserted, the instructor processing means 22 is transmitted by means of the firer 21 processing the coordinates of the target, in particular by providing the following information: the coordinates X, Y and Z, the heading, pitch and roll and, for each type of symbology, the coordinates of the screen namely the coordinates in X and Y.

According to an alternative embodiment, it is now described with reference to FIG. 5, a software architecture related to the implementation of the firing training system comprising image analysis means. This architecture is used in particular when the weapon is equipped with a motion sensor that does not have good accuracy.

The software architecture illustrated in FIG. 5 is equivalent to the software architecture illustrated in FIG. 4, except that a specific image analysis module is installed on the image analysis means 40, in accordance with FIG. hardware architecture illustrated in Figure 3.

The modules illustrated in FIG. 5 already present in FIG. 4 and described above bear the same identifier.

According to this implementation, the shooter processing means 21 no longer receives the data directly. from the motion sensor 9, but has a data receiving module from the image analysis means 40, via a communication interface between the shooter processing means and the analysis means images.

The image analysis means 40 receives, on the one hand, the data coming from the motion sensor 9 and, on the other hand, the video stream coming from the video sensor 5. The image analysis module analyzing the received video stream with the data received from the motion sensor to determine the heading and pitch values of the weapon. The result of this analysis is issued, in real time, by means of processing the shooter 21 via the network.-

A communication interface between the shooter processing means 21 and the image analysis means 40 makes it possible to manage the communications. Indeed, by means of this interface, the data relating to the position of the camera is transmitted, in particular by providing the following information: heading and pitch or heading, pitch and roll or X, Y and Z coordinates , course, pitch and roll.

In these different embodiments, the shooter processing means 21 refreshes the images transmitted to the display means 6 at a frequency compatible with the video capture means 5 and the display means 6, namely 50 Hz in the case of European standard video capture means and 60 Hz in the case of an American standard video capture means. It should be noted that the display means must operate at the same frequency as the video sensor.

Regarding the pointing of the visually induced weapon, the latter visually induces a misalignment of the video landscape and the targets and the missile.

The precision of the calibration of the virtual targets in the captured real landscape is a function of the precision of the motion capture method, in particular according to the analysis or not of images.

Regarding the resolution of high-definition video capture, it should be noted that the HD-SDI 16/9 standard includes 1920 pixels by 1080 interlaced lines and that the angular field targeted by the shooter's weapon is circular and that the resolution Useful video inside the circular field is 1080 pixels by 1080 interlaced lines.

Similarly, when viewing on the instructor screen of the angular field targeted by the gun of the shooter, the screen is for example 4/3, a resolution of 1440 pixels by 1080 lines.

For these reasons, the video resolution used for the resolution of the display must be resized. In addition, by means of the bilinear texture filtering of the shooter processing means 21, the video image can be resized without any visual artefact, i.e. without rasterization of the video image.

This resizing is performed for the display of the actual landscape augmented with virtual targets in the viewing means 6. In addition, it can be used for display of the augmented landscape on the instructor's screen. In this case, the resizing is performed to a format of 1280 pixels by 1024 lines in SXGA mode, ie to 1600 pixels by 1200 lines in UXGA mode.

The viewing means 6 are in particular a small monitor; indeed, the latter must be light and compact. Technologies that can be used are: LCD miniature, LCOS, DLP, OLED.

The display means impose a certain display resolution. Thus, the graphics card of the shooter processing means is configured for these special display means. For example, the display is 1280 pixels by 1024 lines or 1600 pixels by 1200 lines.

From this display information is now described how to determine the distance at which the target is detected, recognized and identified by the shooter. It should be noted that a target is detected when we see a target move but it is not recognized. For example, a tank is identified in the distance but the type of tank is not recognized. An identified target is called when it is well identified.

Detection, recognition and identification criteria according to two types of screen resolution are now described.

In the first case, when the display has a resolution of 1280 pixels by 1024 lines and a field of view of 8.5 degrees (corresponding to 1024 lines), a target is detected on a video line, the target is recognized when it is present on 3 video lines and it is identified when it is present on 5 lines.

According to this example, for a target with a height of 2 meters, the following results are obtained: the detection of a target takes place on a target at a distance greater than 6 km, the reconnaissance of the target is carried out at 4600 meters and the identification is made at 2760 meters.

In a second case, when the display has a resolution of 1600 pixels by 1200 lines and a field of view of 8.5 degrees (corresponding to 1200 lines), a target is detected on a video line, the target is recognized when it is present on 3 video lines and it is identified when it is present on 5 lines.

According to this example, for a target height of 2 meters, we have the following results: the detection of a target takes place on a target at a distance greater than 6 km, the recognition of the target is carried out at 5390 meters and the identification is made at 3200 meters.

As indicated above, the augmented reality processing means adds to a real landscape captured moving virtual targets or immobile in real time. Indeed, virtual targets can move in the actual landscape captured by the video sensor.

For example, char or helicopter type targets may move in the captured landscape.

It is also possible to add visual effects such as the animation of the rotor of a helicopter.

The instructor, by the instructor processing means 22, can choose in particular two types of displacement for each target.

A first mode is to move the target according to a list of waypoints, the waypoints are editable during the exercise by the instructor. This mode of displacement is called "waypoint" mode.

To do this, the instructor processing means 22 comprises means for entering and modifying the passage points, in particular by means of the joystick.

To enter or change target points, the instructor can get a view of the scene. From the controller, for example, the instructor can add, delete, or modify a waypoint. The waypoints appear numbered on the instructor's screen. The crossing points for land vehicles are associated with terrain relief. The crossing points for the aerial vehicles have an altitude adjustable by the instructor.

The trajectory of the virtual target along the waypoints is calculated by the augmented reality processing means by linear interpolation.

According to one embodiment, there are 16 crossing points per virtual target.

A second mode of displacement is to move the target by driving with the controller 38 by the instructor. This mode of displacement is called "joystick" mode.

It should be noted that very often, the view of the shooter has a field of vision too narrow to select the points of passage.

Thus, the instructor processing means is equipped with an augmented reality processing means, in particular the TOTAL IMMERSION FUSION software configured specifically for entering and modifying the crossing points, as well as the joystick management.

To enter or change the target waypoints, the instructor has a top view of the scene. With the help of the keyboard and mouse, the instructor can add, delete or modify a waypoint. The waypoints appear numbered on the screen.

Regarding the crossing points for land vehicles, they are associated with terrain relief. While the crossing points for aerial vehicles are associated with an adjustable altitude by the instructor.

The augmented reality processing means makes it possible to manage the switching from the "waypoint" mode to the "joystick" mode. To do this, the virtual target starts from its current position.

When switching from "joystick" mode to "waypoint" mode, the virtual target repositioned itself on the first waypoint defined by the instructor.

From the position and orientation data of the virtual targets defined by the instructor, the latter are transmitted in real time from the medium instructor processing 22 by means of processing the shooter 21 equipped with the augmented reality processing means for their processing in real time for display on the display module of the shooter during training.

In addition, targets may appear as not destroyed or destroyed. For example, the augmented reality processing means may add the immovable carcass of a tank destroyed by the shooter.

However, managing the destruction of a target by the augmented reality processing means can take many forms.

For example, in the case of the destruction of a tank, when the target is reached by the shooter during training, the augmented reality processing means adds to the actual landscape the explosion of the tank then displays the carcass of the tank .

In the case of the destruction of a helicopter, when the target is reached by the shooter during training, the augmented reality processing means adds to the real landscape the explosion of the helicopter, then the helicopter disappears.

However, three explosion effects of the virtual target can be implemented by the augmented reality processing means. It is, first of all, the explosion following the impact of the shooting on the ground or on a piece of the scenery, then, the explosion of the virtual target following the impact of the shooting on a virtual target aerial, finally, the explosion of the virtual target following the impact of the shot on a virtual target terrestrial.

The augmented reality processing means manages each explosion by a virtual object of the "bilboard" type in which a cut texture is played. However, it is a specific video depending on the type of impact.

A virtual object of type "bilboard" is a synthesis object composed of the following elements: a rectangle of zero thickness and a texture applied on this rectangle. The rectangle is positioned on the floor in front of the camera. The applied texture can be a dynamic texture from a film stored on the hard disk. For example, in the case of an explosion, one has a movie "explosion", which is found in this rectangle. In addition, the edges of the rectangle are not seen, the latter being transparent.

However, in the case of an impact on the ground or on an element of the actual landscape, for example a house, the landscape may not be visually modified.

During a training shot by a shooter, the distance d1 of the shot relative to the terrain in the landscape is determined, that is to say the point of the ground in the axis of the shot. Then, we determine the distance d (N) of the shot with respect to the virtual target N.

According to a simplified embodiment, the distance d (N) is the distance between the center of gravity of the shot and the center of gravity of the target.

After calculating these distances, an explosion effect display algorithm includes a first test to determine if the distance d1 firing from the terrain in the landscape is less than a threshold distance. If this is the case, then we determine the X, Y and Z coordinates of the impact of the firing and we trigger the addition and display of the explosion following the impact of the shooting on the ground.

It is also determined whether the distance d (N) of the shot relative to the virtual target N is less than a threshold distance. If this is the case, then we determine the X, Y and Z coordinates of the impact of the shot and we trigger the addition and display of the explosion following the impact of the shot on the virtual target and then the display of the virtual target N destroyed.

In the case of a missile-type missile, the latter is materialized by a 3D virtual object mainly seen from the rear. In addition, to simulate the smoke of the missile, M circular "bilboard" objects are displayed which have been applied with the alpha and transparency parameters management, in order to obtain a realistic smoke trail.

The missile display may be delayed a few milliseconds after receiving the firing information so as to simulate the missile's time out of the barrel of the weapon.

It should be noted that the trajectory of the missile is memorized in order to be able to position the M objects of "bilboard" type along the trajectory. For the management of virtual targets and ground impacts, it is necessary to have virtual objects in memory, in particular, within a database, the ground, that is to say the soil and buildings .

When using the firing training device, it is necessary to install the weapon on the real ground and proceed, before the beginning of the exercise, the registration of the synthetic field in relation to the real terrain.

To do this, a location tool makes it possible, by means of a pairing of points, to extract the position of the video sensor in the reference point of the synthetic field. Thus, it is possible to wedge the real ground with the field of synthesis. This pairing consists of associating points of the synthetic field with their equivalent in the captured video.

From a few paired points, the location tool determines the position of the video sensor in the reference of the synthetic field, the synthetic field being a three-dimensional modeling of the real terrain.

This technology allows the instructor to install the system anywhere in a theater in a reasonable amount of time, including three-dimensional modeling of the theater.

According to a particular embodiment, a GPS receiver ("Global Positioning System" in English terminology) can be associated with the weapon so that it can be located on the real ground.

The GPS receiver then sends the various positioning coordinates of the weapon on the real terrain.

Once this information received by the location tool, it is possible to locate the video sensor, including two ways.

According to a first embodiment, virtual points are associated with real points of the video stream, captured as previously described.

According to a second embodiment, the ground of synthesis is angularly staggered, in particular by means of a joystick. The synthetic field is then displayed in transparency on the video image to allow calibration.

The augmented reality processing means is also able to process the occultation. Indeed, at the moment of the departure of the blow, an object of the type Circular "bilboard" and texture is displayed on the screen. During the move away, the transparency coefficient is changed from an opaque aspect to a transparent aspect. The position of the "bilboard" type object is coupled to the position of the missile to obtain a more realistic occultation effect.

In addition, the augmented reality processing means may display a targeting reticle. This can be controlled to make it appear or disappear and change its position on the viewing screen.

In addition, the augmented reality processing means may allow additional information to be added to the aim, for example by means of a chevron. This information can also be controlled to make it appear or disappear and adjust its position on the viewing screen according to the X and Y coordinates.

The shooter processing means 21 includes loudspeakers for reproducing also the sound effects induced by the shot.

For this purpose, on receipt of a firing information, the shooter processing means 21 activates a sound representing the start of the shot, in particular by launching an audio file of ".wav" type. Similarly, if the shot reaches the ground, a landscape element or a virtual target, a sound file is activated to represent the sound of the impact.

As illustrated in Figure 2 and 3, the hardware architecture may be provided with a recorder, including a DVD recorder with hard disk, so as to record the contents of the view of the shooter.

Thus, the replay of the shooting exercise is possible by performing a replay of the video film stored by the recorder.

The presence of a hard disk on the recorder allows the replay without obligation to burn the shooting exercise on a support.

Likewise, it is possible to record the positioning and orientation information of the targets, the missile positioning and orientation information, and the positioning and aiming information of the weapon. Thus, at the end of the shooting training exercise, the information is available to analyze the exercise, in particular by means of an exercise analysis software module. The firing training system as previously described, can be used in different contexts.

Indeed, it is possible to use the indoor shooting training system. In this case, the system is placed in front of a model of a landscape in which virtual targets are added by the augmented reality processing means. The model must first be modeled.

In addition, it is possible to use the shooting training system on real terrain. To do this, it is necessary to have modeled a synthetic field, the latter corresponding to the real terrain.

By way of illustration, the processing means of the shooter 21 may be an individual computer having the following characteristics:

- Pentium IV processor, 3 Ghz, including the Windows XP Pro operating system, service pack 2,

- 1 GB RAM or RAM and 80 GB hard drive,

- motherboard with PCI-X and PCI-Express bus.

- DeckLink HD acquisition card.

- Nvidia GeForceθ (6800 GT) or ATI Radeon X800XT graphics card.

The video capture means 5 are, for example, a high-definition camera of the Sony HDR-FX1 type. The converter 23 of the HD-YUV component output to the HD-SDI standard is in particular an AJA HD 1OA converter. The UXGA video splitter 30 is for example the Komelec MSV1004 splitter. The video switch 36 is in particular a Comprehensive Video HRS-2x1-SVA / 2x1 VGA / UXGA High Resolution Vertical Switcher switch. The converter 33 is for example the Folsom ViewMax converter. Finally, the recorder 32 is a Philips HDRW 720 DVD recorder having an 80 GB hard drive.

Claims

A device for firing from a weapon, characterized in that the device comprises:

2. Drive device according to claim 1, characterized in that the device comprises control means, in real time, able to control the processing means for the insertion of synthetic images.

3. Training device according to any one of the preceding claims, characterized in that the weapon is a real weapon.

4. Training device according to any one of the preceding claims, characterized in that the weapon comprising sighting means, the driving device comprises optical adaptation means adapted to allow viewing of an image in the aiming means from the visualization means of the captured field of view containing the inserted synthetic images.

5. Drive device according to any one of the preceding claims, characterized in that the position information received from said angle measuring means is heading and pitching.

6. Training device according to any one of the preceding claims, characterized in that the device further comprises, control means adapted to control, in real time, the processing means capable of inserting synthetic images.

7. Training device according to any one of the preceding claims, characterized in that the device comprises locating means adapted to determine the position of the video capture means in the reference of a synthetic field in three dimensions, the synthetic field being a model corresponding to at least one element of the captured angular field.

8. Training device according to claim 7, characterized in that the locating means comprise means for matching, in real time, points of the synthetic field with corresponding points in the captured angular field.

9. Training device according to claim 7, characterized in that the device comprises means for setting the synthetic field on the captured angular field.

10. Training device according to any one of the preceding claims, characterized in that the device comprises a location receiver adapted to locate the device.

11. Training device according to any one of the preceding claims, characterized in that the device comprises image analysis means adapted to increase the accuracy of the measurements made by the angle measuring means.