KR100807845B1 - Infrared LED Tracking System for Game Interface and Tracking Method thereof - Google Patents

Abstract

The present invention relates to an arcade gun used as an interface in a shooting game, and more particularly, to an LED tracking system and a tracking method for providing a new operation method of the arcade gun, the game progress unit driven by the installed program; A displayer for outputting a game appearance through a screen while communicating with the game progress unit; Light emitting means disposed on the display and provided with an infrared LED emitting infrared light; An arcade gun electrically connected to the light emitting means such that the infrared LED emits light when the trigger is pulled; A camera mounted on the arcade gun so as to photograph the light emitting means at different angles according to the position of the arcade gun, and starting shooting by operating the trigger; An infrared filter for filtering other light except infrared to allow the camera to capture only infrared light; And a signal processing unit which checks the position of the infrared LED in the image photographed by the camera, calculates and processes the aiming point of the arcade gun facing the screen, and transmits the position information of the calculated and processed aiming point to the game progress unit. It will include.

Description

Infrared LED Tracking System for Game Interface and Tracking Method

1 is a perspective view showing an application for the implementation of the infrared LED tracking system according to the present invention,

2 is a view showing an embodiment of the infrared LED tracking system shown in FIG.

3 is a block diagram showing the configuration of an infrared LED tracking system according to the present invention,

4 is a flowchart sequentially showing an infrared LED tracking method according to the present invention,

5 is a photographed image of the tracking system according to the present invention the initial photographed image (a), the graph for setting the threshold of the threshold for binarization (b), the image showing the state of labeling the photographed image (c), infrared LED area The figure shows the image (d) showing the position of the center of the

6 is a graph showing an example of setting a threshold by a P-tile method applied in a tracking system and a tracking method according to the present invention;

7 is a diagram of an algorithm for calculating a center point rotation of an infrared LED region in a tracking system and tracking method according to the present invention;

8 is a view showing an example of the relationship between the five correction points of the infrared LED region and the center and four edge points on the screen in the tracking system and tracking method according to the present invention,

9 is a view showing an example of the image histogram using the P-title method according to an embodiment of the tracking system and tracking method according to the present invention,

10 is a view showing an example of the area and the circularity dispersion value of the infrared LED region before the filtering process according to the tracking system and the tracking method according to the present invention,

11 is a view showing an example of the area and circularity dispersion value of the infrared LED region after the filtering process according to the tracking system and the tracking method according to the present invention,

12 is a view showing an example of the positional relationship between the five correction reference points and the infrared LED according to the present invention,

FIG. 13 is a view showing an example in which an upper correction point is inaccurate and a left correction point is inaccurate when it is ideal as a correction result screen of an infrared LED tracking system according to the present invention.

14 is a view showing an example of the linearity of the horizontal and vertical aiming line before the correction process according to the present invention,

15 is a view showing an example of the linearity of the horizontal and vertical aiming line after the correction process according to the present invention,

16 is a view showing an example of the scale measurement according to the web camera position according to the present invention.

The present invention relates to an arcade gun used as an interface in a shooting game, and more particularly, to an LED tracking system and a tracking method for providing a new operation method of the arcade gun.

Arcade guns are primarily control devices used in home video games or arcade games, and are typically modeled for ballistic weapons (usually pistols or bazooka), and are used to match target objects visible on video screens.

The representative control method of the existing arcade gun is divided into a light gun and a positional gun.

The light gun works optically with the screen, and does not provide position information on the screen until the gun is fired. After the gun is fired, the light gun clears the screen for a while and then the optics at the front of the gun Record where you are aiming. The recorded information is sent to a computer, and the computer determines whether the target object is hit.

However, in order to use a light gun, you must consider the type of monitor. That is, light guns designed for VGA CRT monitors cannot be used with LCD monitors or TVs, and TV-based light guns cannot be used with monitors other than TVs. In addition, there is a problem that the aiming position synchronization between the light gun and the monitor is not exactly matched according to the high resolution of the monitor and the high refresh rate.

The position gun is a stationary gun fixed to the arcade cabinet with the ability to aim left and right and up and down. Most position guns use analog-based potentiometers in their operation, and function like a joystick. Rotating the gun left or right is equivalent to moving the joystick left or right, and aiming up or down is equivalent to moving the joystick up or down. The position gun maintains the position of the screen every hour as well as the current position when the gun is fired. There are currently no PC-based position guns available on the market, and the only other platform available is to modify the arcade position gun with the cabinet. That is, the position gun has low degrees of freedom due to the limited platform and fixed interface.

That is, the light gun and the position gun have the following disadvantages.

1) Precise positioning is not possible to support clean shot gun shooting games (light gun),

2) low degree of freedom (positive gun) due to limited platform and fixed interface,

3) Inoperable due to high resolution and refresh rate (light gun and position girl),

4) Inoperable on LCD / TFT display or large screen (light gun and position gun),

Therefore, in order to solve such a problem, a new control method is needed, which is different from the existing method.

Accordingly, the present invention has been made to solve the above problems, to solve the problems of the arcade gun that is utilized as a game interface, to ensure a precise positioning while ensuring a sufficient degree of freedom, even in LCD / TFT display or large screen Technical task is to provide an infrared LED tracking system and a tracking method for a game interface that can be operated.

The present invention to achieve the above technical problem,

Game progress unit driven by the installed program;

A displayer for outputting a game appearance through a screen while communicating with the game progress unit;

Light emitting means disposed on the display and provided with an infrared LED emitting infrared light;

An arcade gun electrically connected to the light emitting means such that the infrared LED emits light when the trigger is pulled;

A camera mounted on the arcade gun so as to photograph the light emitting means at different angles according to the position of the arcade gun, and starting shooting by operating the trigger;

An infrared filter for filtering other light except infrared to allow the camera to capture only infrared light; And,

A signal processing unit which checks the position of the infrared LED in the image photographed by the camera, calculates and processes the aiming point of the arcade gun facing the screen, and transmits position information of the calculated and processed aiming point to the game progress unit;

Infrared LED tracking system for the game interface including a.

In order to achieve the above technical problem, the present invention, in the infrared LED tracking system,

The infrared LEDs are three in a row.

The present invention to achieve the above technical problem,

Aiming the arcade gun equipped with a camera including an infrared filter to the screen of the display and pulling the trigger;

Pulling the trigger to emit an infrared LED disposed on the display, the camera operating for imaging;

Binarizing the signal processor to recognize the position of the infrared LED image in the image photographed by the camera; And,

The signal processing unit calculates and processes the aiming point of the arcade gun by comparing the position of the infrared LED image with the reference point, and transmitting the position information of the aiming point to the game progress unit driven by the installed program;

Infrared LED tracking method for a game interface comprising a.

In order to achieve the above technical problem, the present invention, in the infrared LED tracking method,

And a labeling process to distinguish the infrared LED image appearing in a binarized photographed image so that the signal processor can recognize the infrared LED image.

In order to achieve the above technical problem, the present invention, in the infrared LED tracking method,

In order to check the circularity of the infrared LED image, the dispersion of the distance from the center to the outside of each of the shapes in the photographed image is calculated, and the shape having the dispersion outside a predetermined standard is not viewed as the infrared LED image.

In order to achieve the above technical problem, the present invention, in the infrared LED tracking method,

In order to absolutely check the position of the infrared LED image according to the position change of the arcade gun,

Aiming each reference point with the arcade gun by placing a plurality of reference points on the screen, and identifying a position of the infrared LED photographed when aiming the reference point to form a correction reference;

Correcting a coordinate value by the corresponding θ angle when the infrared LED image photographed after shooting using the arcade gun is rotated while the camera is rotated by θ by the rotation of the arcade gun;

Calculating an aiming position on the screen according to the correction criteria;

It is to include more.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a perspective view showing an application for the implementation of the infrared LED tracking system according to the present invention, Figure 2 is a view showing the implementation of the infrared LED tracking system shown in Figure 1, it will be described with reference to this .

Infrared LED tracking system according to the present invention aims to provide an arcade gun 10 that can overcome the problems with the conventional light gun and position gun at the same time to give the convenience of the game progress.

Therefore, the infrared LED tracking system according to the present invention, the arcade gun 10 in the form of a gun, the display 30 for outputting the background of the game as an image, and is disposed at one point of the display 30 to emit light Light emitting means 20, a camera 11 mounted on the arcade gun 10, and a signal processor 40 which reads the image captured by the camera 11 and applies it to game progress. The apparatus may further include a game progress unit 50 for progressing the game in conjunction with the signal processor 40 and the display 30.

The tracking system according to the present invention does not directly irradiate light on the screen 31 using an optical device as in the conventional light gun method, but observes and applies the movement of the arcade gun 10 as in the positional gun method. This increases the degree of freedom of the arcade gun 10 and can be applied regardless of the type of the display 30 (monitor), thereby increasing its utility. In addition, it is possible to support precise shooting games of the clean shot series without being affected by the change in the high resolution and refresh rate.

Figure 3 is a block diagram showing the configuration of the infrared LED tracking system according to the present invention, Figure 4 is a flowchart sequentially showing the infrared LED tracking method according to the present invention, will be described with reference to this.

As described above, the tracking system according to the present invention includes an arcade gun 10 equipped with a camera 11, a light emitting means 20, and a signal processor 40, and the signal processor 40 includes an image checking module. 41, the binarization module 42, the labeling module 43, and the positioning module 44.

On the other hand, in order to more clearly explain the tracking system according to the present invention will be described with a tracking method.

The position correction step (S10) will be described later.

S20; Shooting image forming step

The arcade gun 10 according to the present invention may be processed by the signal processor 40 to recognize its position, for this purpose, the arcade gun 10 has a camera for taking an image in the direction of the display (30) ( 11) is mounted.

In this case, the camera 11 may be a well-known complementary metal oxide semiconductor (CMOS) camera.

The camera 11 operates by the player pulling the trigger 10a. That is, when the player pulls the trigger 10a by aiming the arcade gun 10 at the required target, the camera 11 photographs the periphery of the display 30.

On the other hand, the arcade gun 10 is energized with the light emitting means 20 through the wire (W). In addition, similar to the operation of the camera 11, when the trigger 10a of the arcade gun 10 is pulled, the light emitting means 20 operates to emit light. To this end, a plurality of LED is located in the light emitting means 20, the LED emits light in the infrared region, in the embodiment according to the invention three infrared LEDs (21, 22, 23) for emitting infrared light The above is provided. In the embodiment according to the present invention, three odd-numbered infrared LEDs are arranged and fixed on the upper end of the display device 30, so that the infrared LEDs 21, 22, and 23 are taken when the camera 11 is photographed. Make sure you're shooting infrared light.

In this case, the camera 11 is provided with an infrared filter 12 for directly photographing only infrared light.

That is, when the game player aims the arcade gun 10 toward the screen 31 of the display 30 while the game is in progress, and pulls the trigger 10a, the infrared LEDs 21, 22, 23 emits infrared light and at the same time the camera 11 starts shooting toward the light emitting means 20.

S30; Infrared filtering steps

When the camera 11 takes a picture of the surroundings of the display 30 including the light emitting means 20, infrared rays emitted from the infrared LEDs 21, 22, and 23 of the light emitting means 20 through the camera 11. Filter all light except infrared to ensure that only the photo is exposed.

In this case, the filtering is performed through the infrared filter 12 attached to the front of the camera 11.

Therefore, the photographed image received by the image checking module 41 of the signal processor 40 will be only the appearance of the infrared LED (21, 22, 23) emitting infrared.

FIG. 5 (a) shows an image of a photographed image of an infrared LED. Only the lights corresponding to the three infrared LEDs 21, 22, and 23 are observed by the infrared filter 12. FIG. .

S40; Binarization stage

The photographed image identified by the image checking module 41 is binarized through the binarization module 42.

Since the infrared filter 12 is attached to the front of the camera 11, the infrared LED (21, 22, 23) light and the background in the captured image has a very high contrast. Therefore, even if the binarization process is performed using an appropriate threshold value, a sufficiently accurate segmentation result can be obtained. However, if the size of the light in the area of the infrared LED (21, 22, 23) is divided into small by the influence of the ambient lighting environment or by the change of the aiming position of the player, it will cause the unstable coordinate value later. More powerful splitting methods are required. In other words, the tracking system according to the present invention automatically selects the threshold value to enable the binarization process.

The infrared LED tracking system according to the present invention calculates an accurate threshold value by the P-tile method with reference to a histogram of the input image (see FIG. 5 (b)). In the P-tile method, the process of setting the threshold is not complicated if some characteristics of the image are known in advance. The area of the image has a gray value less than the threshold and the rest has a value greater than the threshold. Therefore, it is necessary to find a point for an area that becomes P% as shown in FIG. 6 (a graph showing an example of threshold setting by the P-tile method applied in the tracking system and the tracking method according to the present invention). That is, the number of background pixels is determined by increasing the ratio from the total number of pixels of the captured image with the histogram of the given photographed image and the ratio of the background pixels. At the same time, in the histogram of FIG. 6, the number of initial pixels is counted starting from zero and greater than or equal to the number of background pixels. Eventually, the threshold value is determined by the last count. [Equation 1] is a threshold setting formula, where N means the size of the photographed image.

S50; Labeling Step

Each infrared LED area is labeled using the labeling algorithm of Equation 2 from the binarized photographed image.

5 (c) is an image showing a state of labeling the photographed image, will be described with reference to this.

P denotes a logical judge of (R, x, T), (k) denotes each step, x denotes a pixel brightness value of a photographed image, and T denotes a threshold value. In the tracking system and tracking method according to the present invention, each region R is labeled by a region growing algorithm.

The region growing algorithm is a method of dividing and then dividing a region by measuring similarity between pixels.

First, one seed region is taken to measure the similarity of adjacent pixels, and it is determined whether it belongs to the seed region. In this case, the similarity is defined as in Equation 3.

A and B are two adjacent pixels, g (A) and g (B) are gray levels, and θ is a threshold value.

That is, if the similarity, which is the difference between two gray levels, falls within the absolute threshold value θ, it expands to the same area.

Other methods of labeling include the Glassfire algorithm, which is similar to the region growing method, and the recursive call method with self-call. However, in the latter case, excessive self-calling is not suitable for labeling an object area that is too large because it overflows the system stack, and self-calling slows down due to many instructions that the program processes internally. Since there may be disadvantages, it may be desirable to apply egion growing or Glassfire algorithms to label the binarized photographed image in the tracking system and the tracking method according to the present invention.

On the other hand, the infrared rays utilized in the implementation of the tracking system and the tracking method according to the present invention is not limited to emit light through the light emitting means 20, but is emitted from a variety of places, such as fluorescent light and natural light is photographed in the camera (11).

Therefore, when the labeling module 43 labels the binarized photographed image, not only the infrared rays of the infrared ray LEDs 21, 22, and 23 of the light emitting means 20, but also various infrared rays emitted from the surroundings may be labeled.

In this case, the tracking system and the tracking method according to the present invention do not accurately capture the movement of the arcade gun 10, it may cause an error.

Therefore, the labeling module 43 examines the geometric circularity of the labeled infrared LEDs 21, 22, and 23 to determine whether the outer shape is close to a circle. The circularity can be calculated using the boundary tracking method of the area, but this is not suitable because the calculation takes a long time.

The infrared LED tracking system and tracking method according to the present invention examines the circularity using the radius variance value of the labeled area without the boundary tracking of the area. In an ideal circle, the radius, the distance from the center of the region to the boundary of the outer shell, is constant, so the variance of this radius is close to zero. If the object is elongated (a fluorescent lamp), the distance from the center to the outer boundary becomes jagged, so the dispersion value is large. The circularity of the area of the labeled infrared LEDs 21, 22, and 23 is inspected using this characteristic value, and when the dispersion value of the circularity is increased, the areas are excluded to enable separation of only the infrared LED area.

Finally, the center position of each infrared LED region in the image is obtained using Equation 4 (see FIG. 5D).

,

,

와

는 라벨링된 적외선 LED(21, 22, 23) 영역에 대한 구성픽셀의 가로와 세로 이미지 좌표이다.

Wow

Is the horizontal and vertical image coordinates of the constituent pixels for the labeled infrared LEDs 21, 22, 23 area.

Infrared LED tracking system uses P-tile-based dynamic binarization method and Glassfire algorithm to accurately segment the infrared LED (21, 22, 23) light region in the image and performs the area evaluation using geometric features. Accurately and accurately track infrared LED areas in real time without being affected by changes in user's aiming distance and angle, or changes in fluorescent or ambient lighting.

Here, the labeling step (S50) to accurately determine the position of the infrared LED (21, 22, 23) on the photographed image, after the binarization step (S40) to the movement tracking step of the following labeled region (S60) It could be done directly.

S60; Tracking steps for labeled areas

When the player pulls the trigger 10a of the arcade gun 10 to photograph the infrared LEDs 21, 22, and 23 of the light emitting means 20, the positioning module 44 may label the infrared LEDs 21, 22, and the like. The location of the arcade gun 10 may be aimed at the display 31 of the display 31 by searching the photographing position of the apparatus 23.

In general, as shown in FIG. 12, the image captured by the camera 11 depends on the aiming direction of the arcade gun 10. Therefore, by comparing the points of the infrared LED (21, 22, 23) of the photographed image relatively, it is possible to track the aiming direction of the current arcade gun (10). To this end, there must be a reference point that can be compared with the photographed infrared LED (21, 22, 23), if the arcade gun 10 is fixed, the reference point is invariant due to the position of the fixed arcade gun 10 You will have a reference point. However, if the arcade gun 10 is not fixed to one point to secure the degree of freedom, it will have to go through the position correction step (S10) described below.

S70; Location information delivery stage

The aiming position identified through the movement tracking step S60 of the labeled area is transmitted to the game progress unit 50 to proceed to the next process.

That is, in the case of a game of matching apples, the positioning module 44 checks whether the aiming of the arcade gun 10 with respect to the apples being output through the screen 31 is correct, and the result of the game progress unit. 50 is to send.

Subsequently, the movement tracking step (S60) of the labeled area is a step of checking the photographing positions of the infrared LEDs 21, 22, and 23 and corresponding to the image being output on the screen 31. , 22, 23) should be determined to know where the image corresponds to. That is, the position of the arcade gun 10 is changed according to the game player and / or usage time, and thus the position of the photographed infrared LEDs 21, 22, and 23 may change even when aiming the image output on the same image. The above criteria should be taken.

Of course, when the arcade gun 10 is fixed at one point, the position of the infrared LEDs 21, 22, and 23 photographed through the camera 11 may be constant regardless of the player and the game time. If the gun 10 is independently separated and the degree of freedom is maintained, the infrared ray LEDs 21, 22, and 23 may be operated according to the shooting position and the shooting distance of the camera 11, even when aiming the same image output on the screen 31. The location where the image is captured by the camera is changed.

Therefore, the infrared LED tracking system and tracking method for the game interface according to the present invention further includes a position correction step (S10) for correcting this.

S10; Position correction step

Infrared LED tracking system according to the present invention accurately partitions the infrared LED (21, 22, 23) light region in the image using a P-tile-based dynamic binarization method and Glassfire algorithm, and the area evaluation using geometric features It tracks the infrared LED area accurately and quickly in real time without being affected by changes in the user's aiming distance and angle, or changes in fluorescent lights and ambient lighting.

Since the substrate on which the infrared LEDs 21, 22, and 23 are arranged in the infrared LED tracking system is attached to the upper portion of the display 30, the center position of the infrared LED area in the acquired image and the actual user's aiming position are different. . In addition, coordinate mapping becomes very sensitive as the player's aiming distance and angle change. The reason for the sensitivity is the CMOS camera. Inexpensive single-lens camera pixels, such as CMOS, are not square and distort the image according to the environment. That is, the scaling factors for the pixels of the rows and columns are different.

Therefore, the coordinate correction of the aiming point which converts the center coordinate value of the infrared LED area in the image into the aiming coordinate value in the screen and linearly maps the nonlinear coordinates is very important. As a solution to such a problem, there is a method of obtaining a camera internal parameter and performing a correction process, but there is a problem in applying it to a game because it hinders the processing speed. Therefore, the present invention proposes a fast and powerful 2D-mapping method. Although it is a simple mapping method, it is error-free and suitable for speed handling when used as a real-time interface in games.

각도만큼 적외선 LED 영역의 중심 좌표값을 [수학식 5]을 이용 하여 회전시킨다.First, before performing the coordinate correction process of the aiming point, as shown in FIG. 7 (a diagram of an algorithm for calculating the center point rotation of the infrared LED area in the tracking system and the tracking method according to the present invention), the arcade gun 10 aimed at by the player is shown. ) Is rotated

Rotate the center coordinates of the infrared LED area by [Equation 5] by the angle.

Next, for the coordinate correction of the aiming point, the system is shown in Fig. 8 (an example of the relationship between the five calibration points of the infrared LED area and the center and four edge points on the screen in the tracking system and tracking method according to the present invention). Screen's center point and 4 edge points

 Adopted as a calibration point. The calibration sequence is performed in the order of center, up, down, left and right. In the coordinate correction process, the player must aim while moving the target point until the sequence of five calibration aim points is completed. The system calculates the center coordinates of the infrared LED area equal to the five calibration aim points on the screen.

는 [수학식 6]를 이용하여 구 한다.

는 좌표비례요소이고,

는 좌표이동요소이다.Acquire. Coordinate transformation factor

Is obtained using Equation 6.

Is a proportional factor,

Is a coordinate moving element.

Within an image

가 가장자리

을 12초 정도 계속해서 넘게 되면 [수학식 7]를 이용하여

만큼 보정을 한다.The values represent the center point and the four edge points and when the player is aiming at the screen the range of values should not be greater than the value obtained during the calibration step. If the system detects that the range of edge values has been exceeded, an alarm will sound to allow the user to fall within the possible range. If the range of edge values continues to be exceeded, correction is necessary because the user's aiming distance and angle have changed. For example, if

Autumn edge

If you continue to exceed 12 seconds using Equation 7

Correct it by

,

,

와 적외선 LED(21, 22, 23) 중심

은 다음과 같이 동일한 관계로 표현할 수 있다.Aim point in zones I, II, III, IV

And infrared LEDs (21, 22, 23) center

Can be expressed in the same relationship as

1) Zone I

2) Zone II

3) Zone III

4) Zone IV

Correction according to the above, since the shooting angle is changed by the distance between the display 30 and the arcade gun 10 and the rotation of the arcade gun 10 according to the player in a state where the freedom of the arcade gun 10 is maintained. This is to make them uniform.

Therefore, the change in the shooting angle due to the rotation of the arcade gun 10 is corrected by [Equation 3] previously input to the system according to the present invention after shooting, and if the shooting angle is corrected with the result [Equation 4] Equation (5) and areas I to IV are applied to calculate the correct aiming position.

Meanwhile, the arcade gun 10 according to the present invention further includes a pointer 13 to check whether the player performs the above-described aiming process or correctly aims the object being output on the screen 31 during the game. Make sure The pointer 13 may be a general laser pointer, but may be modified in various ways.

The following embodiments are shown by implementing the tracking system and the tracking method according to the present invention.

240 해상도의 영상을 입력받는다. 카메라 렌즈 앞에는 적외선 필터가 부착되어 있다. 약 지름이 6㎜ 인 적외선 LED (SI5313-H) 3개가 기판에 45㎜ 간격으로 배열되었으며, 17 인치 LCD 모니터 위에 부착되어있다.The infrared LED tracking system is controlled at Pentium IV 2.66 GHz. Acquisition of images is usually via a readily available USB camera, with color formats of 24 bit RGB or 12 bit YUV2, 320 at 30 frames per second.

Receive an image of 240 resolution. An infrared filter is attached to the front of the camera lens. Three infrared LEDs (SI5313-H), approximately 6 mm in diameter, were arranged at 45 mm intervals on the board and mounted on a 17-inch LCD monitor.

The processing result of the dynamic binarization can be seen in FIG. 9 (a diagram showing an example of an image histogram using the P-title method according to an embodiment of the tracking system and tracking method according to the present invention). The percentage of background pixels from the samples of the acquired infrared LED image ranges from 13.72% to 25.09% on average. The system set a threshold percentage of 25%, which is the maximum change in background pixels, and the actual threshold corresponding to each image has a value between about 58 and 64.

8 shows an example of the relationship between the five calibration points of the infrared LED area and the center and four edge points on the screen in the tracking system and the tracking method according to the present invention. Area and circularity represent the magnitudes of the variance values. Sampling order represents seconds and an average value of 30 frames per second. In the interval where the sampling order of the images in the graph is greater than 50 and less than 92, the infrared LED area has an ideal area and circularity variance. However, it can be seen that the area and circularity variance values are large near the sampling order of less than about 50. This is because the distance between the user's camera 11 and the light emitting means 20 attached to the top of the display 30 is so close that there is a distortion in the infrared LED area acquired by the reflection of the lens of the camera 11, This is caused by the same surrounding objects. In the vicinity of the sampling sequence of about 92 or more, the circularity variance value is not significantly different from the ideal interval, but the area is very small. This occurs because white pixels are included as noise in the image due to the low threshold value in the dynamic binarization step.

The infrared LED tracking system according to the present invention excludes an area of interest in an area that is too large or too small (an area having 18 or less pixels or 50 or more pixels in the area of the area) and removes the value of the circular dispersion filter. Gave 0.3. Therefore, noises generated by infrared LED area lights or fluorescent lights distorted by the reflection of the lens are almost filtered out because the dispersion value of the circularity is very large and the circularity constraint is not satisfied. 11 shows an example of the area and the circularity dispersion value of the infrared LED area after the filtering process according to the tracking system and the tracking method according to the present invention, and shows the size of the area and the circularity dispersion value of the infrared LED area after filtering. .

Fig. 12 (an illustration of the positional relationship between the five calibration reference points and the infrared LED according to the present invention) shows the aiming position correction process of the infrared LED tracking system. The player must aim the aiming point in the center, up, down, left, and right of the screen 31. At this time, the system coordinates the center coordinates of the infrared LED area equal to the five calibration points of the screen 31.

Care must be taken to match

는 사용자의 조준능력을 평가하는데 유용하다. 도 13(본 발명에 따른 적외선 LED 추적시스템의 보정결과화면으로 이상적인 경우, 위쪽 보정점이 부정확한 경우, 좌측 보정점이 부정확한 경우의 예를 보여주는 도면)은 조준위치 보정의 세 가지 예를 보여준다. (A)의 경우는 이상적인 경우이며, (B)는 게임자가 위쪽을 조준했을 때 조준 능력이 부정확함을 보여준다. 그리고 (C)는 게임자가 좌측을 조준했을 때 조준 능력이 부정확함을 보여준다. 이 세 가지 경우의 좌표 변환 계수

는 다음과 같이 [표 1]에서 보여진다. Hence the coordinate transformation factor

Is useful for evaluating the user's aiming ability. FIG. 13 (a diagram showing an example where the upper correction point is inaccurate and the left correction point is inaccurate when it is ideal as a correction result screen of the infrared LED tracking system according to the present invention) shows three examples of aiming position correction. The case of (A) is ideal, and (B) shows that the aiming ability is incorrect when the player aims upwards. And (C) shows that the aiming ability is incorrect when the player aims to the left. Coordinate transformation coefficients in all three cases

Is shown in [Table 1] as follows.

Coefficient Case (A) Case (B) Case (C)

1.46 1.46 0.90

1.36 1.36 3.2

1.15 1.87 1.15

1.25 0.91 1.25

값은 거의 2에 가까운 값을 보여지고 있으며, (C)의 경우

값은 3을 넘었음을 보인다.As shown in [Table 1], in case of (A), coefficient values have an ideal value between about 0.15 ~ 1.46. But in the case of (B)

The value is nearly 2, and in case of (C)

The value is shown to be over 3.

을 획득하였다.The aiming position correction method is (B), (C) of FIG. 13 (a diagram showing an example where the upper correction point is incorrect and the left correction point is incorrect when it is ideal as a correction result screen of the infrared LED tracking system according to the present invention). Calibrate irregular nonlinear coordinates to linear coordinates. In the experiment, the infrared LED tracking system aimed at 81 points horizontally and 64 points vertically.

Obtained.

는 비선형성을 나타낸다. 이런 결과는 적외선 LED(21, 22, 23)가 디스플레이어(30)의 상단부위에 부착되어 있고, 게임자의 위치의 변화(조준 거리 및 각도)에 따라 조준 좌표값에 에러가 생기기 때문이다.Fig. 14 (a diagram showing an example of linearity of horizontal and vertical aiming lines before correction processing according to the present invention) shows the linearity of aiming lines in horizontal and vertical directions before correction processing. As you can see in the graph

Indicates nonlinearity. This result is because the infrared LEDs 21, 22, and 23 are attached to the upper end of the display 30, and an error occurs in the aiming coordinate value according to the change of the position (aiming distance and angle) of the player.

FIG. 15 (a diagram showing an example of linearity of horizontal and vertical aiming lines after the correction process according to the present invention) shows the result of the aiming position correction process, and the MSE (Mean Square Error) values before and after the correction process are shown in [Table 2]. Shown.

Before calibration 688.379 1706.711 After calibration 6.184 3.632

As can be seen in FIG. 15, the linearity of the aiming coordinate values has been proved, and thus the aiming position correction method is sufficient to find the correct aiming position. Fig. 16 (a diagram showing an example of a scale measurement according to the position of the web camera according to the present invention) calculates the positions of the respective LEDs 21, 22, and 23 from the input infrared LED image, and receives the aiming direction information of the player. It is a scale measurement screen according to the position of the final camera 11 after the coordinates have been corrected.

In addition, the infrared LED tracking system operates at more than 30 frames, and the CPU throughput is 25-28% on average, so there is no problem to operate as a game interface.

According to the present invention as described above, it is possible to solve the limitation of the precise positioning limitation and the lack of degree of freedom, which is a problem of the light gun and the position gun as an arcade gun at the same time, the application regardless of the type and type of display This is possible to increase the usability.

Claims (6)

delete delete Aiming the arcade gun equipped with a camera including an infrared filter to the screen of the display and pulling the trigger; Pulling the trigger to emit an infrared LED disposed on the display, the camera operating for imaging; Binarizing the signal processor to recognize the position of the infrared LED image in the image photographed by the camera; Labeling the infrared LED image from the binarized photographed image so that the signal processor can recognize the infrared LED image; Calculating an variance of the distance from the center to the periphery of each shape of the labeled photographed image and retrieving the infrared LED image by checking whether the shape is circular while excluding a shape having a dispersion outside a predetermined standard; And The signal processing unit calculates and processes the aiming point of the arcade gun by comparing the position of the infrared LED image with the reference point, and transmitting the position information of the aiming point to the game progress unit driven by the installed program; Infrared LED tracking method for a game interface comprising a. delete delete The method of claim 3, wherein In order to absolutely check the position of the infrared LED image according to the position change of the arcade gun, Aiming each reference point with the arcade gun by placing a plurality of reference points on the screen, and identifying a position of the infrared LED photographed when aiming the reference point to form a correction reference; Correcting a coordinate value by the corresponding θ angle when the infrared LED image photographed after shooting using the arcade gun is rotated while the camera is rotated by θ by the rotation of the arcade gun; Calculating an aiming position on the screen according to the correction criteria; Infrared LED tracking method for a game interface characterized in that it further comprises.

Images