KR101610703B1 - Simulation apparatus for virtual shooting - Google Patents

Abstract

A virtual shooting simulation apparatus is disclosed. A virtual shooting simulation apparatus according to an embodiment of the present invention includes: a camera module for detecting an aiming point on a screen by a training gun for irradiating a laser; And a control device for determining whether the coordinates of the aiming point are inside a virtual figure located within the screen and outputting image data corresponding to a viewpoint at a predetermined reference azimuth and elevation angle if the determination result is internal . The controller calculates a distance and a direction that the coordinates of the aim point deviate from the boundary of the virtual figure if the coordinate of the aim point is outside the virtual figure as a result of the determination, Can be output.

Description

[0001] SIMULATION APPARATUS FOR VIRTUAL SHOOTING [0002]

The present invention relates to a virtual shooting simulation apparatus, and more particularly, to a virtual shooting simulation apparatus capable of precisely controlling a simulation image in accordance with a relationship between a virtual figure on a screen and an aim point position.

Virtual experience is not actually a real space, but an experience in a space artificially created to allow the experient to immerse as if it were a real situation. Representative examples of providing such a virtual experience include sports, fighter control, driving, shooting games, and simulated shooting training.

In particular, one of the most important exercises for soldiers, police, or similar personnel in preparation for an exhibit or counter-terrorism situation is shooting training for personal firearms. Such shooting training can be performed differently according to various scenarios depending on whether there is an obstacle or a place. If the shooting training using a pilot is very dangerous and the noise due to the shooting is very large, There is a problem in that it can only be carried out in a very restricted environment in place and personnel.

Accordingly, techniques have recently been disclosed that allow simulated shooting training to be carried out according to scenarios without using a bullet, among which Patent Document 1 and Patent Document 2 can be cited.

First, referring to FIG. 1, Patent Document 1 discloses a system configured to perform a shooting training by directing a situation that may actually occur in a virtual space. Specifically, it discloses a technique of determining a shooting result based on coordinates of a laser detected from a screen, and converting the image data according to the shooting result.

However, Patent Document 1 has a limitation in that the coordinates of the laser are merely used for determination of the shooting result, and can not be utilized as information for indicating a direction for converting a simulation image.

That is, in the shooting training system according to Patent Document 1, the shooting person is only provided with the function of providing the next image according to the shooting result performed on the specific image projected on the screen, and the shooting person adjusts the direction of the muzzle (That is, by changing the position of the aim point on the screen by the gun), it is impossible to receive a simulation image that is changed in accordance with the direction that the user wants to watch.

Next, Patent Document 2 discloses a technique for processing a simulation image corresponding to an operation on an operation unit such as a joystick provided in a gun. However, according to Patent Document 2, the shooter can only change the simulation image through only the joystick-shaped manipulation part, and there is no configuration in which the body change of the shooter himself / herself is linked to the simulation image change, There was a sense of divergence, and thus there was no sense of immersion.

Korean Patent Laid-Open Publication No. 10-2007-0040494: Image shooting training system (2007.04.17) Korean Registered Patent Publication No. 10-1196672: Simulation gun for shooting (2012.11.06)

SUMMARY OF THE INVENTION The present invention has been made in order to solve the above-mentioned problems of the prior art, and it is an object of the present invention to provide an information processing apparatus, I want to use. Specifically, the direction in which the simulation image is switched is calculated based on the position of the aiming point changed by the movement of the user (that is, muzzle direction operation), and the simulation image is switched at a speed corresponding to the position change amount of the aiming point, To provide virtual shot simulations close to the actual situation.

In addition, the screen in which the aiming point is located is divided into a plurality of regions, and the presence or absence of the aiming point for each region selectively controls whether or not the simulation image is changed, thereby preventing a situation in which the simulation image is unintentionally changed I want to.

The technical object of the present invention is not limited to the above-mentioned technical objects and other technical objects which are not mentioned can be clearly understood by those skilled in the art from the following description will be.

According to an aspect of the present invention, there is provided a camera module for detecting an aiming point on a screen by a training gun for irradiating a laser beam; And a control device for determining whether the coordinates of the aiming point are within a virtual figure located in the screen and outputting image data corresponding to a viewpoint at a predetermined reference azimuth angle and elevation angle if the determination result is internal A virtual shooting simulation apparatus is provided.

If the coordinates of the aiming point are outside the virtual figure, the control device calculates the distance and the direction deviating from the boundary of the virtual figure with the coordinates of the aiming point, It is possible to output moving image data.

The apparatus may further include an input unit for receiving either a first mode for changing the reference azimuth and elevation angle or a second mode for changing the viewing angle.

When the first mode is input, the controller calculates a reference azimuth angle and a high angle change value corresponding to the distance and direction, and adds the reference azimuth and elevation angle, the reference azimuth angle, The reference azimuth and elevation can be reset.

When the second mode is input, the controller calculates a gaze angle change value corresponding to the distance and the direction, and outputs the gaze angle change value corresponding to the time point of the gaze angle change value from the reference azimuth angle and the elevation angle Data can be output.

The controller may output image data corresponding to a view point at the reference azimuth angle and elevation angle when the coordinates of the aiming point move from outside to inside of the virtual figure in the second mode .

In addition, the control device may limit the range of the gaze angle change value or the reference azimuth angle and the elevation angle change value that is calculated differently depending on the distance and the direction that the coordinates of the aiming point deviate from the boundary of the virtual figure.

Further, the control device can output image data in which the coordinates of the aiming point changes at a speed proportional to the square of the distance from the boundary of the virtual figure.

In addition, the controller may adjust the size of the virtual figure based on a setting value including a long axis value and a short axis value input to the input unit.

According to the embodiment of the present invention, the aiming point on the screen can be used as information for calculating the direction in which the simulation image is switched, rather than simply calculating the shooting result.

Specifically, the direction in which the simulation image is switched is calculated based on the position of the aiming point changed by the movement of the user (that is, muzzle direction operation), and the simulation image is switched at a speed corresponding to the position change amount of the aiming point, Can provide virtual shot simulation close to the actual situation.

In addition, the screen in which the aiming point is located is divided into a plurality of regions, and the presence or absence of the aiming point for each region selectively controls whether or not the simulation image is changed, thereby preventing a situation in which the simulation image is unintentionally changed can do.

Also, even if the position of the aiming point is the same, the simulation image can be variously switched for each mode selected by the user.

The effects of the present invention are not limited to the above-mentioned effects, and various effects can be included within the scope of what is well known to a person skilled in the art from the following description.

FIG. 1 is a use state diagram of a video shooting training system according to Patent Document 1. FIG.
2 shows a schematic configuration of a virtual experience simulation apparatus according to an embodiment of the present invention.
FIGS. 3A and 3B are views illustrating an example in which a virtual shot simulation apparatus according to an exemplary embodiment of the present invention processes a simulation image data when coordinates of an aim point are located inside a virtual figure. FIG.
FIGS. 4A to 4F are diagrams illustrating an example in which a virtual shot simulation apparatus according to an exemplary embodiment of the present invention performs processing on simulation image data when coordinates of an aim point are located outside a virtual figure. FIG.
FIG. 5 illustrates an example of adjusting the size of a virtual figure according to an embodiment of the present invention.
FIG. 6 illustrates an example in which the control apparatus of the virtual shooting simulation apparatus adjusts the moving speed of a simulation image according to an embodiment of the present invention.

The embodiments disclosed herein should not be construed or interpreted as limiting the scope of the present invention. It will be apparent to those of ordinary skill in the art that the description including the embodiments of the present specification has various applications. Accordingly, it is intended that the scope of the invention be limited not by the claims, but rather by the appended claims, rather than by the claims. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 2 shows a schematic configuration of a virtual shooting simulation apparatus according to an embodiment of the present invention.

Referring to FIG. 2, a virtual shooting simulation apparatus according to an embodiment of the present invention includes a camera module 110 and a control device 120. At this time, the camera module 110 and the control device 120 can transmit and receive data through a wired / wireless network. Such a wired / wireless network is a communication network of a broadband wired Internet network, a mobile communication network, a WiFi network, a mobile WiMAX (for example, WiBro), a Zigbee, a bluetooth, There is no.

First, the camera module 110 senses an aiming point K on the screen 13 by a training gun 11 that irradiates a laser. The training gun 11 is provided with a laser emission module 12 capable of irradiating a laser toward the screen 13. For example, the laser irradiated from the laser emitting module 12 may be an infrared laser.

Specifically, the camera module 110 photographs the screen 13 to acquire an aim point image including an aiming point K by a laser. The controller 120, which will be described in detail below, analyzes the aim point image to calculate the coordinates of the aim point. The control device 120 can accurately obtain the coordinates for the position of the aim point K in the aim point image by correcting the distortion due to the position of the camera, the lens, the image output portion (e.g., projector) and the screen with respect to the aim point image .

The control device 120 judges whether the coordinates of the aiming point K is inside or outside the virtual figure P located within the screen 13. [ Here, the virtual figure P is virtually created by the control device 120 in order to divide the screen 13 into two regions (i.e., an inner region and an outer region of a virtual figure). The virtual figure may have various shapes such as an ellipse, a triangle, a rectangle, and an octagon. Hereinafter, it is assumed that the virtual figure is an ellipse. The size of the virtual ellipse P is determined by the long axis value 2 * A and the short axis value 2 * B and can be changed by the puncturer S.

It is preferable that the center of the virtual figure P coincides with the center of the screen 13, but it is not limited thereto and may be set differently depending on the physical characteristics of the shooter S and the like.

3A and 3B are diagrams for explaining processing of simulation image data by the virtual shooting simulation apparatus according to the embodiment of the present invention when the coordinates of the aiming point K are located 'inside' the virtual figure P. FIG.

The controller 120 outputs image data corresponding to a viewpoint at a predetermined reference azimuth angle and an elevation angle when it is determined that the coordinates of the aim point K are 'inside' of the virtual figure P.

Here, the 'reference azimuth and elevation angle' is information previously set in the controller 120 so as to recognize the body and head of the three-dimensional space shooter S in the direction of the head. The reference azimuth angle refers to the angle between the direction in which the body of the shooter S faces from a specific direction and the reference elevation angle means that the head of the shooter S is upward or downward at a predetermined reference azimuth angle. Means an angle toward the downward direction. The viewing angle change in the left and right directions with respect to the predetermined 'reference elevation angle' will be separately described in the following description of the second mode.

For example, assuming that the specific direction is the northward direction, when the predetermined 'reference azimuth' is (+) 90 degrees, the controller 120 recognizes that the body of the shooter S faces the forward direction , And the predetermined reference azimuth angle is 90 degrees, the controller 120 can recognize that the body of the shooter S faces the emotion direction. The 'reference elevation angle', which is preset to recognize that the head of the shooter S is facing the front, is 0 degree, and the 'reference elevation angle', which is preset to recognize the head of the shooter S upward by 30 degrees, (+) 30 degrees, and the reference elevation that is predetermined to allow the shooter S to recognize the head downward by 20 degrees may be (-) 20 degrees. The 'view point' at the reference azimuth and elevation means the 'azimuth direction' of the reference azimuth and elevation angle when looking at the front.

The simulation image data generated by the control device 120 may be transmitted to the video output unit 14 through the wired / wireless communication network as shown in FIG. The image output unit 14 is configured to process the simulation image data and output an actual image. As a representative example, a beam projector for projecting an image on the screen 13 shown in FIG. 2 may be mentioned. Alternatively, the image output unit 14 may be an image display device (e.g., LCD) that displays the image on its own without projecting the image on the screen 13 separately.

3A and 3B, the control device 120 does not switch the simulation image output to the screen 13 when the coordinates of the aim point K are changed within the virtual figure P. FIG. As shown in FIG. 3A, even if the aimpoint coordinates move in the order of K1? K2? K3 in the virtual figure, the control device 120 does not link the movement of the coordinates of the aiming point to the conversion of the simulation image. That is, as shown in FIG. 3B, since the same simulation image data is output irrespective of the position of the aiming point, it can be confirmed that the position of the target in the simulation image is fixed. Accordingly, when the coordinates of the aim point are located inside the virtual figure, a fixed simulation image is provided even when the muzzle direction is unintentionally changed due to a mistake or the like, and a target existing in the area of the virtual figure (P) There is an effect that can be accurately aimed.

4A to 4F are diagrams for explaining processing of simulation image data by the virtual shooting simulation apparatus according to the embodiment of the present invention when the coordinates of the aiming point K are located 'outside' of the virtual figure P. FIG.

4A to 4F, when it is determined that the coordinates of the aim point are outside the virtual figure P as a result of the determination of the aim point coordinate position, the controller 120 determines that the coordinates of the aim point are a distance and a direction .

The image generating unit of the controller 120 generates simulation image data moving at a speed corresponding to the distance and direction calculated previously and then transmits the simulation image data to the image output unit 14. A method of calculating the moving speed will be separately described below with reference to FIG.

In this case, the simulation image data outputted as moving at a predetermined speed corresponding to the calculated distance and direction can be changed according to the simulation mode selected by the shooter S, and the virtual shot simulation according to the embodiment of the present invention The device may include an input 130 for receiving a specific mode from the puncturer S.

This input 130 may preferably be mounted to the training gun 11. The input unit 130 may receive either the first mode or the second mode from the puncturer S, wherein the first mode is a mode for changing the reference azimuth and elevation angle, Change of angle '. For example, the button-shaped input unit 130 may be in the first mode in the pressed state (or in the unpressed state), or in the second mode in the unpressed state (or the depressed state).

Hereinafter, it is assumed that the screen 13 is a coordinate plane composed of the X axis and the Y axis, and that the center of the virtual figure P coincides with the origin of the coordinate plane.

≪ Examples of changing the angle of view >

4A and 4B, an example in which the simulation image changes when the input unit 130 selects the second mode from the puncturer S can be confirmed. When the second mode is input through the input unit 130, the controller 120 calculates a 'gaze angle change value' corresponding to the calculated distance and direction, and calculates a gaze angle change value corresponding to the gaze angle change value from the above- Can be output. Here, 'gaze angle change value' refers to the direction (for example, up, down, left and right) and velocity of the head which is changed from a specific reference azimuth and elevation angle. That is, as the magnitude of the line of sight changing value increases, the moving speed of the image data also increases.

First, in FIG. 4A, the coordinates of the aiming point (K4) are located at a distance from the boundary of the virtual figure (P) in the positive X-axis direction by L1 and by 0 in the Y-axis direction. In this case, the control device 120 can calculate the first right speed (for example, 30 degrees / sec) corresponding to the predetermined rightward direction and L1 corresponding to the direction of positive X-axis as the viewing angle changing value . Accordingly, the controller 120 can output the simulation image data corresponding to the time point when only the viewing angle is shifted to the 'rightward direction' at a speed of '30 degrees / sec while maintaining the reference azimuth angle and elevation angle have. 4B shows an actual simulation image in a case where the aiming point K4 is positioned as shown in FIG. 4A with respect to the image of FIG. 3B in the state where the second mode is selected. Only the heading direction (i.e., , The building of FIG. 3B disappears to the left, and the target moves to the left.

As another example, assume that in the second mode, the aiming point coordinate is located at a distance L1 (L1 L2) away from the boundary of the virtual figure P in the direction of positive X and positive L1 can do. In this case, the controller 120 corresponds to the predetermined 'left diagonal direction (i.e., the second quadrant of the coordinate plane)' and the distance L1 * 2 corresponding to the slope 1 (= L1 / L1) (For example, 40 degrees / sec) can be calculated. Accordingly, the controller 120 determines that the simulation image data corresponding to the time when the 'gaze angle', which is the head direction of the shooter in the reference azimuth angle and elevation angle, moves at a speed of '40 degrees / sec' with respect to the 'left diagonal direction' Can be output.

On the other hand, when it is determined that the coordinates of the aiming point has moved from the outside to the inside of the virtual figure P in the second mode, the controller 120 sets the simulation image, which has been changed in accordance with the gaze angle change value, To the corresponding image.

≪ Examples of changing the reference azimuth and elevation angle >

4C to 4D, an example in which the simulation image changes when the input unit 130 selects the first mode from the puncturer S can be confirmed. When the first mode is input through the input unit 130, the controller 120 calculates a 'reference azimuth and elevation change value' corresponding to the distance and direction of the aimpoint coordinates deviated from the boundary of the virtual figure, The azimuth angle and the elevation angle are changed from the reference azimuth angle and the elevation angle change value to the reference azimuth angle and elevation angle and then the image data corresponding to the reset reference azimuth angle and the elevation angle can be outputted.

At this time, the X-axis coordinate of the aiming point K5 is used as information for calculating the reference azimuth change value, and the Y-axis coordinate can be used as information for calculating the reference elevation change value.

First, in FIG. 4C, the coordinates of the aiming point K5 are located at a distance L2 from the boundary of the virtual figure P in the negative X-axis direction and a distance of 0 in the Y-axis direction. In this case, the controller 120 calculates a counterclockwise direction corresponding to the negative direction of the X-axis as the 'reference azimuth change value' and a third speed (for example, 20 degrees / sec) corresponding to L2 can do. Since the Y axis coordinate is 0, the reference elevation angle can be fixed.

Accordingly, the control device 120 can output image data corresponding to the 'reference azimuth' moving at 'third speed' with respect to 'counterclockwise'. FIG. 4D shows an actual simulation image when the aiming point K5 is positioned as shown in FIG. 4C with respect to the image of FIG. 4B in the first mode selected. When the reference azimuth moves to the third speed The target of FIG. 4B moves along the clockwise direction, and the right part of the building disappearing from the line of sight reappears on the left side of the image.

For example, referring to FIG. 4E, in the first mode, the aiming point K6 is located at a distance L3 from the boundary of the virtual figure in the X-axis negative direction and L3 in the positive Y-axis direction. In this case, the controller 120 calculates a predetermined counterclockwise direction corresponding to the negative X-axis direction as the reference azimuth change value and corresponds to the positive direction of the Y-axis as the reference high angle change value , And a fourth velocity (e.g., 25 degrees / sec) corresponding to the distance (= L3√2) can be calculated.

Accordingly, the control device 120 can output the simulation image data in which the 'reference azimuth' moves at the fourth speed with respect to the counterclockwise direction and the 'reference elevation angle' moves at the fourth speed with respect to the upward direction. FIG. 4F shows an actual simulation image when the aiming point K6 is positioned as shown in FIG. 4E with respect to the image of FIG. 4B in the first mode selected. The reference azimuth moves to the fourth speed with respect to the counterclockwise direction The right part of the building disappearing in FIG. 4B appears on the left side of the image, and the target shown in FIG. 4B disappears downward as the reference elevation moves to the fourth speed with respect to the upward direction.

According to the embodiment described above with reference to Figs. 4A to 4F, the control device 120 determines whether the coordinates of the aim point are calculated based on the 'reference' in the first mode in which the coordinates of the aim point are calculated differently depending on the distance and direction deviating from the boundary of the virtual figure P. The azimuth angle and elevation change value 'of the first mode, and the' gaze angle change value 'in the second mode. This is because a visual field that can be viewed according to a posture that a person can take is limited, so that a more realistic simulation image can be provided when the viewing angle and elevation angle are restricted to vary within a predetermined range.

As an example, since the human head can move left and right up and down by about 90 degrees, the angle that can be set to the reference elevation angle and the viewing angle can be set within the range of (-) 90 degrees to (+) 90 degrees. On the other hand, since the azimuth angle can be continuously changed as the shooting person S rotates clockwise or anticlockwise about the key direction, the range of angles (i.e., 0 to 360 degrees) that can be set as the reference azimuth angle, May not be limited.

FIG. 5 illustrates an example of adjusting the size of a virtual figure according to an embodiment of the present invention.

The input unit 130 may receive the long axis value 2 * A and the short axis value 2 * B from the puncturer S for specifying the size of the virtual figure. In addition, the input unit 130 may receive a long axis value and a short axis value for specifying the size of each virtual figure for the first mode and the second mode from the puncturer S, respectively.

5, the first virtual figure P1 generated by receiving the long axis value 2 * A1 and the short axis value 2 * B1 in the first mode and the long axis value 2 * A2 (A2> A1) and the short axis value 2 * B2 (B2 <B1 in FIG. 5). 5, the first virtual figure is shown to have a shorter major axis and a shorter minor axis than the second virtual figure, but the present invention is not limited thereto, and may be variously changed according to the selection of the shooter S.

FIG. 6 illustrates an example in which the controller 120 of the virtual shooting simulation apparatus adjusts the moving speed of a simulation image according to an embodiment of the present invention.

For the change of the 'reference azimuth and elevation angle' in the first mode or the 'viewing angle' change in the second mode, the control device 120 determines that the coordinates of the aiming point K is n squared It is possible to output simulation image data moving at a proportional speed (= w * distance ⁿ , w is a proportional constant). Herein, n is a value greater than 0, and n and w may be a predetermined value or a value input from the puncturer S through the input unit 130. [

Specifically, the moving speed of the simulation image is such that i) the distance from the boundary of the virtual figure P to the virtual point P is larger at the same n and w, ii) the larger the value at the same distance and w, iii) The distance and n increase with w value.

Referring to FIG. 6, a graph showing a relationship between the distance of the aimpoint coordinates spaced apart from the boundary of the virtual figure P, which varies according to the size of n, and the simulation image movement speed, is assumed, assuming that w is the same.

The shooter S is designed so that the rate of change of the simulation image is increased by directing the muzzle away from the boundary of the virtual figure P or by directing the direction of the muzzle near the boundary of the virtual figure P Can be adjusted. Accordingly, the shooter S can selectively increase or decrease the simulation image change speed by selectively controlling the muzzle direction, and can further increase the speed of the simulation image by using the change of the muzzle direction instead of using the joystick or button. You can perform near-realistic shooting exercises.

It is to be understood that the term "comprising" and / or &quot; comprising &quot; as used herein means that the constituent element may be implanted unless specifically stated to the contrary, .

The embodiments of the present invention described above are disclosed for the purpose of illustration, and the present invention is not limited thereto. It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit and scope of the invention.

S: Shooter
11: Training firearms
12: Laser emitting module
13: Screen
14: Video output section
110: camera module
120: Control device
130:
K, K1 ~ K6: Aiming point
P: Virtual figure
P1: first virtual figure
P2: second virtual figure

Claims (10)

A virtual shooting simulation apparatus for changing a simulation image in accordance with a direction of a muzzle controlled by a shooting person,
A camera module for sensing an aiming point on a screen by a training gun for irradiating a laser; And
A controller for determining whether the coordinates of the aiming point are inside a virtual figure located within the screen and outputting image data corresponding to a viewpoint at a predetermined reference azimuth and elevation if the determination result is inside;
And a virtual shot simulation device.
The method according to claim 1,
The control device includes:
As a result of the determination, if the coordinates of the aiming point are outside the virtual figure, the coordinates of the aiming point are calculated from the distance and direction deviated from the boundary of the virtual figure, and the image data moving at a speed corresponding to the distance and direction is output And the virtual shot simulation device.
3. The method of claim 2,
An input unit for receiving either a first mode for changing the reference azimuth angle and elevation angle or a second mode for changing the viewing angle;
Further comprising: means for generating a virtual shot from the virtual shot.
The method of claim 3,
The control device includes:
When the first mode is input, the reference azimuth and elevation change values corresponding to the distance and direction are calculated, and the sum of the reference azimuth and elevation angle, the reference azimuth angle, and the elevation angle change value is reset to the reference azimuth angle and elevation angle And the virtual shot simulation device.
The method of claim 3,
The control device includes:
When the second mode is input, calculating a gaze angle change value corresponding to the distance and the direction, and outputting image data corresponding to a time point of the gaze angle change value from the reference azimuth angle and the elevation angle. A virtual fire simulation device.
6. The method of claim 5,
The control device includes:
And outputs the image data corresponding to a view point at the reference azimuth angle and elevation angle when the coordinates of the aiming point move from outside to inside of the virtual figure in the second mode. .
The method according to claim 4 or 6,
The control device includes:
And limits the range of the gaze angle change value or the reference azimuth angle and elevation angle change value that is calculated differently depending on the distance and the direction deviating from the boundary of the virtual figure.
The method of claim 3,
The control device includes:
And outputs the image data in which the coordinates of the aim point change at a speed proportional to n squares of the distance from the boundary of the virtual figure.
9. The method of claim 8,
The n value may be,
Wherein the control unit is adjustable via the input unit.
The method of claim 3,
The control device includes:
Wherein the size of the virtual figure is adjusted based on a setting value including a long axis value and a short axis value input to the input unit.

Images