KR20000012160A - Simulation system for training shooting using augmented reality and method thereof - Google Patents

Abstract

PURPOSE: A simulation system for training shooting is provided to scientifically and efficiently train shooting and to improve the individual marksmanship by exactly analyzing and correcting the consequences of shooting which are not provided to the existed shooting training. CONSTITUTION: The simulation system for training shooting has:a target image providing piece(100) having a screen(110) indicating the target image and an image projector(120) projecting the target image on the screen; a gun system(200) projecting laser on the target image of the screen by generating the laser according to shooting; an image recognizing piece(300) photographing the image of the screen to obtain the laser coordinate from a gun(210) according to shooting by photographing the image of the screen; an operating system(400) outputting the consequences of shooting through output pieces by unifying the consequences by a gun; and a sound output piece(500) outputting sound according to the shooting simulation.

Description

Target Training Simulation System Using Augmented Reality and Its Method

The present invention relates to a fire training simulation system and method thereof, and more particularly, to a fire training simulation using augmented reality technology, in which real-world augmentation information is pre-established and the constructed augmentation information is provided according to the shooting result of the fire target. A system and method thereof are provided.

Augmented reality is a technology derived from virtual reality technology that improves the perception of the real world, which excludes interaction with the real world and processes interactions in the pre-established virtual space. Unlike the virtual reality technology, the augmented reality technology is a real-time information (referred to as augmented information) pre-built on the basis of real-time processing is superimposed on the image of the real world actually observed through a special interface device, and mutual interaction with the real world It is a technical field to improve the user's understanding and awareness of real-world phenomena by providing action.

It is an object of the present invention to provide an accurate analysis and correction method for the shooting result, which was not provided in the existing actual shooting training, based on these techniques.

In order to achieve the above object, the present invention provides a technique for acquiring laser coordinates (augmentation information) using an image recognition system for a laser projected on a screen (corresponding to the real world of augmented reality technology), and for shooting results according to laser coordinates. Analysis and correction (enhancement information) data is displayed on the screen, and real-time data processing technology based on signals generated from multiple firearms is implemented.

The present invention, through the target image providing means for projecting the target image on the screen through the projection apparatus, in accordance with the shooting in the gun system by generating a laser from the gun to irradiate the screen and generate a trigger signal, image recognition Means for taking an impact image of the laser irradiated onto the screen using a CCD camera, and providing a moving image or a still image as a target image to the target image providing means from an operating system (PC), and the image according to the triggered signal. Recognizes the laser impact point image captured by the recognition means, compares the image projected on the screen with the impact point image, outputs the result to the monitor, and controls the overall fire simulation scenario and operation. It is achieved by configuring to output a sound according to.

The present invention can be simulated by transmitting and processing the signals generated by each gun and military general firearms, anti-aircraft guns and police firearms with a laser and a device for controlling guns to the system in real time.

1 is a block diagram of a shooting training simulation system using augmented reality according to the present invention.

Figure 2 is a block diagram showing an embodiment of a shooting training simulation system according to the present invention.

Figure 3 is a block diagram showing an impact point image recognition method according to the present invention.

<Description of the code | symbol about the principal part of drawing>

100: target video providing means 110: screen

120: video projection device 200: firearm system

210: Firearm 220: Interface

300: image recognition means 310: camera

311: infrared laser filter 320: image grabber

330: image analysis unit 331: image buffer

332: video analysis program 400: operating system

410: main control unit 411: interface port

412: Sound Card 413: Grabber Board

414: graphics board 420: monitor

430: peripheral device 431: power supply

432 printer 433 DVD

434: Mouse 435: Keyboard

500: sound output means 510: amplifier

520: Speaker

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing the concept of the shooting training simulation system according to the present invention, Figure 2 is a block diagram of a shooting training simulation system using augmented reality according to an embodiment of the present invention. As shown in the drawing, the present invention includes a screen 110 displaying a target image and an image projector 120 for projecting the target image onto the screen 110 to provide a moving image or a still image as the target image. Target image providing means 100 and; A firearm system (200) having a plurality of firearms (210) for generating a laser according to shooting and irradiating the target image side of the screen (110) and generating a trigger signal that can be distinguished for each firearm when the firearm is triggered; Image recognition means (300) for capturing an image of the screen (110) to obtain laser coordinates of the firearm (210) irradiated on the screen (110) of the target image providing means (100); The target image is provided to the target image providing means 100 according to the scenario of the entire shooting simulation operation, and the laser impact point image of the image recognition means 300 and the corresponding screen are generated according to the trigger signal of the firearm system 200. An operating system 400 for recognizing the location of the impact point by comparing and analyzing the provided target image and outputting it to the monitor, and integrating the shooting result for each firearm and outputting the output through the output means; By the control of the operating system 400 is composed of a sound output means 500 for outputting the sound according to the shooting simulation.

The firearm system 200 is composed of four firearms 210, each fired by using a laser optics device in a different shape on the screen of the operating system 400. In addition, the gun is equipped with an air cartridge (air cartridge), so that when triggered to produce the same shock as the actual. Each firearm is connected to the interface port 411 of the operating system 400 to have a chronological order without concurrency via a 4: 1 connection interface 220.

Image recognition means 200, a filter 311 capable of recognizing an invisible infrared laser, the camera 310 for receiving the image, the image taken by the camera 310 to digitize the image of the operating system 400 It consists of an image grabber 320 to synchronize with the system, and an image analyzer 330 that obtains coordinates by analyzing the digitized image, and acquires information about the real world in augmented reality. .

The operating system, as shown in Figure 2, is connected to the main control unit 410 to control the overall operation and the interface 220 for distinguishing and interface the trigger signal of the firearms of the firearm system 200 to fire the gun Interface port 411 for receiving a signal, a sound card 412 for outputting sound in accordance with a scenario of simulation to the sound output device 500, and the image provided by the camera 310 of the image recognition means 300 The PC body is configured to include a grabber board 413 including an image grabber 320, an image analyzer 330, and a graphic board 410 that provides a target image to the projection device 120. As a peripheral device 430, a watch screen monitor 420 for displaying an image according to a simulation operation program and an image of an impact result under control of the main control unit 410, and as a peripheral device 430, It is configured, including 431 and the printer 432 for printing the shooting simulation result, and the DVD (433) for providing a digital image, a mouse 434 for operation control, a keyboard 435.

The sound output unit 500 may include an amplifier 510 for amplifying the sound provided from the sound card 412 and outputting the audio output of the amplifier 510 in stereo. 520).

The operating system 400 is a system for providing virtual information of augmented reality according to a scenario and synthesizing it with real-world information and outputting the analyzed result.

The operating program has a function of advancing the entire system according to a pre-produced scenario and displaying augmented information (analysis and output data of training results) generated using augmented reality based on the information acquired by the image recognition means 200. .

The augmentation information output at this time is as follows. Formation of impact group, whether to acquire zero point, movement of aiming trajectory during triggering, triggering time after aiming, and correction method by sector. The operating program provides the shooter with courses such as zero shot, ranged shot, up / down shot, night shot and tactical shot.

Shooters may choose to train some or all of the courses offered. Shooter's training results are also stored and managed in a database to view the trainer's short and long term performance.

An image recognition method performed by the image recognition means and the operating system will be described below.

In the image recognition principle, the laser beam projected from the firearm 210 on the screen 110 is input as image data through the CCD camera 310 to distinguish the impact point coordinates from the firearm through image processing.

3 is a conceptual diagram of image recognition according to an embodiment of the present invention, in which an image signal input to a frame grabber 321 of an image grabber through a CCD camera 310 is converted into digital data and thus an image buffer 331 of the image analyzer. The image analysis program 332 grabs only the frame of the instant when the trigger signal comes from the firearm 210, reads the stored data for each pixel, and then retrieves the pixel corresponding to the color of the laser. The searcher acquires coordinates and shapes, compares them with the desired image shape, distinguishes firearms, and returns coordinate values to the main program.

That is, at the moment when the trigger signal of the firearm 210 input from the interface 220 is input through the RS-232C, the following operation is performed. Grab the image from the digitizer set in the initialization and save the image in the set buffer. Then, the image is stored in the image array again, the respective coordinates of the image data stored in the image array are sequentially searched, and the color of the pixel is examined at regular pixel intervals in the four directions of up, down, right, and left of each coordinate. It searches for whether a laser exists and uses it to determine the type of laser.

At this time, the image of the camera is matched with the coordinate system of the image projected on the screen by matching the image taken on the screen with the digitizer at the time of initialization. By contrasting the image, impact results can be expressed in augmented reality.

In addition, as a method for determining the type of laser, when different types of lasers are projected for different firearms, and the lasers of different colors are projected, the color of the laser projected on the screen is captured by the camera, and then the color is determined. By distinguishing the firearms, and matching the absolute coordinates with the coordinate values according to the digitizer, the impact coordinates in the projection image can be obtained.

The impact point screen display is implemented by a method of overlaying a program showing only the portion where the target image is executed and the impact point. We develop an algorithm using a window application function that enables overlay and implement it in real time. Minimize the delay time by comparing and correcting the time taken to implement the bullet speed in actual shooting. In addition, the mark of the impact point is displayed in a circle with a color distinguished for each shooter.

The scenario selects the shooter identification and course according to the shooting training program. The shooter identification method first presents a large target on the screen, the shooter recognizes his target, shoots at the large target projected on the screen, and displays the impact point on the screen. By displaying it, it is easy to visually check whether the target matches the point of impact by the shooter and determine it.

After that, choose the target subject for shooting training. Training selection subjects can be variously determined according to the shooting training program, for example, divided into basic courses, basic courses, and mastery courses.

Each course is divided into day shooting, night shooting, zero shooting, practice shooting, prison shooting, recording shooting, etc., and proceeds in each step, and provides target images, sounds, and surrounding conditions for each shooting condition as augmented reality. do.

In addition, during the shooting process, the target area may be further cross-up to further confirm the target to the shooter to convince the intermediate result.

The target image can freely provide a still image, a moving image, etc., and recognizes the shooting result by displaying the impact point by overlaying the impact point coordinates of the laser beam on the image coordinates at the time point when the trigger signal is generated. According to the result, the shooting result can be distinguished by sound.

As a method of interfacing the trigger signal generated by the firearm 210, when a trigger signal is generated in the firearm, the trigger signal is transmitted to the system through the RS-232C port 411, and the image is analyzed by the frame grabber at that moment. Proceed.

The overall operation of the system of the present invention will be described as follows. The shooter triggers at the target shown on the screen. The gun fires a laser and projects it onto the screen. The action of the air cartridge causes a recoil like a real gun. At this time, the laser is made of invisible light which is invisible to the eyes of the shooting person. The laser projected on the screen is acquired by the camera, which is digitized by the image grabber. In this process, the coordinates of the laser are analyzed, and the result data generated by the shooting result analysis program is output on the screen by comparing and analyzing the obtained coordinates with the coordinates of the target. The output data is stored and managed in the database, and can also be output to a printer.

As described above, the firing training simulation system and method using the augmented reality according to the present invention provide accurate analysis results and correction methods, compared to the existing actual firing, which enables scientific and efficient firing training, thereby greatly improving personal firing techniques. This has the advantage of being. In addition to military training, it can be applied to the training of police or bodyguards, especially for general leisure.

Claims (7)

A target image providing means (100) having a screen (110) for displaying a target image and an image projection apparatus (120) for projecting a target image on the screen (110) to provide a moving image or a still image as a target image; A firearm system (200) having a plurality of firearms (210) for generating a laser according to shooting and projecting onto a target image side of the screen (110) and generating a trigger signal that can be distinguished for each firearm when a firearm is triggered; Image recognizing means (300) for taking an image of the screen (110) to take an image of the screen (110) to obtain laser coordinates in the gun (210) according to the shooting; The target image is provided to the target image providing means 100 according to the scenario for the shooting simulation operation, and the laser impact point image of the image recognition means 300 is provided on the screen according to the trigger signal of the firearm system 200. An operating system 400 for recognizing the location of the impact point by comparison analysis with the target image and outputting the result to the monitor, and integrating the shooting result for each firearm and outputting the result through output means; Fire training simulation system, characterized in that composed of sound output means for outputting the sound according to the fire simulation under the control of the operating system (400). The method of claim 1, wherein the firearm system 200, A plurality of firearms 210 are provided, Each firearm 210 is equipped with a laser optics that the laser beam is projected according to the trigger, an air cartridge that generates the same impact when triggered, and trigger signal generation means according to the trigger of each gun, Shooting training simulation system, characterized in that it comprises a connection interface for interfacing the trigger signal of the plurality of firearms in a chronological order without concurrency. According to claim 1, Image recognition means 200, A filter 311 capable of recognizing an invisible infrared laser, A camera 310 for taking an image of the screen through the filter; An image grabber 320 for digitizing the image taken by the camera 310 and synchronizing with the image system of the operating system 400; Shooting training simulation system comprising an image analysis unit 330 for obtaining the coordinates by analyzing the digitized image to obtain information about the real world in augmented reality. The method of claim 1, wherein the operating system, The main control unit 410 for the overall operation control, An interface port 411 connected to the interface 220 of the firearm system of the firearm system 200 and receiving a firearm signal; A sound card 412 for outputting sound in accordance with a scenario of simulation with the sound output device 500, A grabber board 413 for processing an image provided by the camera 310 of the image recognition means 300 to match and analyze the impacted coordinates with the target image; A graphics board 410 for providing a target image to the projection device 120; Shooting training simulation system comprising a monitor, a printer, a peripheral device including a DVD and operation means. Target image projection means for projecting a target image on the screen, a firearm system for projecting a laser, image recognition means for recognizing laser coordinates by shooting a screen, and providing a target image by scenario progress and providing a target image. A simulation method of a fire training simulation system including an operating system that receives a trigger signal and analyzes impact coordinates and target images of a laser and outputs a shooting result. Projecting a target image which is a target of shooting onto a screen, and shooting a target on the screen with a laser using a gun including a laser generating means; Photographing an image of a screen to detect impact coordinates of the laser shot by image analysis; Analyzing the target image and the impact coordinates of the laser shot at the time of triggering the firearm to detect the matched impact point and output the result as augmented reality information, and to manage the database Shooting training simulation method. The method of claim 5, wherein the simulation method, Shooting training simulation method characterized in that to distinguish the shooter by giving a different color for each firearm laser beam generated from the firearm. The method of claim 5, wherein the image recognition process, Shooting an image projected on the screen through the camera, Matching the coordinate system by converting the photographed image into digital data through a frame grabber; Storing the image output from the frame grabber in the image buffer, Grab only the frame of the moment when the trigger signal is input from the firearm by the image analysis program, read the stored data for each pixel from the image buffer, and search for the pixel corresponding to the color of the laser to obtain coordinates and shapes. A fire training simulation method characterized by recognizing the impact point of the shooting result by the laser by performing a step of returning the impact point coordinate value to the main program after distinguishing the firearms compared to the image shape.