KR20040070750A - Method for searching input of light source and Apparatus for play bodily sensation game using image sensor - Google Patents

Abstract

PURPOSE: A bodily sensation game equipment using image sensor and method for inputting and detecting light source is provided to make the reality connected with virtual experience felt by using image sensor and by detecting the infrared signal, besides the position, velocity and the movement direction of the light source. CONSTITUTION: The bodily sensation game equipment(200) using image sensor includes; an input device(100a,100b) moving in 3-dimensional space; an output device(230) detecting the operation of the input device and outputting it onto the screen of a display unit; more than at least one infrared sensor on the input device(100a,100b), detecting position of it and outputting infrared signal; more than at least one image sensor on the output device(230), detecting infrared signal, converting it into electric signal and outputting the position values of the converted electric signal; and a control unit detecting the moving velocity and direction of the infrared signal with aid of the position value, and controlling the movement of game character with the detected values.

Description

Method for searching input of light source and Apparatus for play bodily sensation game using image sensor}

The present invention relates to a haptic game device and a detection method, and more particularly, a user's movement of a game tool such as a baseball bat, a ball, or a racket is detected using an infrared sensor and an image sensor, and the detected motion is simulated. The present invention relates to a haptic game device and a detection method using an image sensor that is output to a display device and a game tool so as to connect with experience.

As a known game experience game machine, for example, Japanese Patent Application Laid-open No. Hei 7-30988, Japanese Patent Application Laid-open No. Hei 7-323145 and Japanese Utility Model Registration No. Hei 1-30385 are known. All of these known techniques generate a bodily sensation by directly giving a vibration to a game player, and it is common to use a dedicated seat or the like so that the vibration can be reliably transmitted to the game player.

In addition, since it is necessary to synchronize the progress of the game on the display in the game cabinet with the vibration transmitted to the game player through the seat, the game cabinet and the sheet generating vibration are connected. Electrical wiring is often performed, or the game cabinet and the sheet are often formed integrally. Thus, what is popular as a haptic game machine integrally formed is what is called a driving game.

In addition, Korean Laid-Open Patent Publication No. 2001-81060 provides a haptic baseball game device that can be played using a real game tool or a game tool having a shape close to that while using a television monitor. 1 is a block diagram showing the configuration of the haptic baseball game device, wherein the haptic baseball game device 10 includes a game machine 12, and the game machine 12 includes a television monitor 18 through an AV cable 20. Is connected to the AV terminal 16 of the control panel 12, and a power switch 22 and three operation keys 24, 26, and 28 are provided on the housing of the game machine 12, and the game machine 12 has an infrared light receiving unit. 30 is installed, and the infrared light receiving unit 30 receives the infrared signal from the infrared LED 34 of the bat-type input device 32. In addition, the bat-type input device 32 is provided with an acceleration sensor (not shown) therein for detecting the movement of the input device 32, and if the acceleration is detected by the acceleration sensor more than a predetermined time, the carrier generation circuit The generated carrier (carrier) is transmitted to the game machine 12 via the infrared LED 34, and outputs such that a change occurs in the game image displayed on the television monitor 18 connected to the game machine 12.

However, such a haptic game device has an input device such as an acceleration detection circuit and a modulation circuit for transmitting the detected acceleration to a game device, and input means such as a carrier generating circuit, in order to detect a game motion that is operated like a user actually playing a game. It should be, such an input means has a problem that is damaged by external conditions, such as shock generated during the operation. In addition, by detecting the operation of the input device by using the acceleration, the location of the input device high and low, left / right, etc. can not be known, there is a problem that does not cause realism and interest like the actual game.

Therefore, in order to achieve the above object, the present invention detects the operation of the input device for outputting an infrared signal, and detects the infrared signal using an image sensor to determine the speed and position information of the input device, virtual experience It is an object of the present invention to provide a haptic game device using an image sensor that is output to a display device and an input device so as to feel a sense of reality by connecting to the device.

Another object of the present invention is to provide an input detection method of a haptic game using an image sensor that detects the position, the speed, and the movement direction of a light source using an image sensor.

1 is a block diagram showing a configuration of a conventional game experience device.

Figure 2 is a block diagram showing an embodiment of a haptic game device using an image sensor according to the present invention.

3 is a block diagram showing the configuration of the haptic game device of FIG.

4 is a block diagram showing the configuration of an infrared detection unit in the haptic game device of FIG. 3;

FIG. 5 is a diagram illustrating a trajectory of movement of a light source on an image sensor in the haptic game device of FIG. 2.

6 is an exemplary view showing an example of a game screen output to the display unit in the haptic game device of FIG.

7 is a flowchart illustrating a process for driving a racket in the haptic game device of FIG. 2.

8 is a flow chart showing a process of playing a game with one racket in the haptic game device of FIG.

9 is a flowchart illustrating a process of playing a game with a plurality of rackets in the haptic game device of FIG.

10 is a block diagram showing another embodiment of a haptic game device using an image sensor according to the present invention.

11 is a flowchart illustrating an input detection process of a haptic game device using an image sensor according to the present invention.

(Explanation of symbols for the main parts of the drawing)

100, 100a, 100b: Racket input device

110, 110a, 110b, 110c, 220: infrared light source

112, 112a, 112b: infrared light receiving unit

114, 114a, 114b: input selector

116: sensory signal output unit 118: control unit

200: game machine 210: infrared detector

211: infrared filter 212: lens

213: image sensor 215: light source

230: display unit 231: table character

232: opponent character 233: score character

234: ball character 240: control unit

241: selection switch 242: movement selection switch

250: cable 300: television

In order to achieve the above object, the present invention provides a haptic game device having an input device for moving in a three-dimensional space, and an output device for detecting the operation of the input device to operate the game character output on the screen of the display means; At least one infrared ray sensor installed in the input device and outputting an infrared signal to detect a position of the input device; At least one image sensor installed in the output device, detecting the infrared signal and converting the infrared signal into an electrical signal, and outputting a position value of the converted electrical signal; And a control means for detecting the moving speed and the moving direction of the infrared signal by using the position value of the electric signal, and interlocking the detected value with the game character and the motion.

In addition, the present invention is provided with at least one input device is provided with at least one light source for outputting an infrared signal and at least one image sensor for detecting the position of the infrared signal output from the light source and converting the signal into an electrical signal is installed, the image sensor In the haptic game device having a control unit for detecting the moving speed and the moving direction of the infrared signal using the position signal, and using the detected value to control the operation of the game character output on the screen of the display means, CLAIMS 1. A method for detecting the position of an infrared light source input to the image sensor, the method comprising: sequentially detecting frame pixel values of the image sensor; Comparing the detected pixel value with a predetermined reference value and detecting a pixel value that is greater than or equal to the reference value; And storing pixel values of the reference value or more in a memory.

Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings.

Figure 2 is a block diagram showing an embodiment of a haptic game device using an image sensor according to the present invention, Figure 3 is a block diagram showing the configuration of the haptic game device of Figure 2, with reference to Figures 2 and 3 Same as The racket-type input devices 100a and 100b include infrared light sources 110a and 110b, infrared light receiving units 112a and 112b, input selectors 114a and 114b, sensory signal output unit 116 and control unit 118. And the game machine 200 includes an infrared detector 210, an infrared light source 220, a display 230, and a controller 240.

The racket-type input device (100, 100a, 100b) is a molded member made of plastic, has a shape, size, and weight similar to a real table tennis racket, the grill portion of the racket as a user plays a real table tennis game in three-dimensional space Grab and swing.

The infrared light sources 110, 110a, and 110b are installed on one side of both sides of the racket-type input device 100, 100a, and 100b, and emit infrared light.

The infrared light receiving units 112, 112a and 112b) are installed on both sides of the racket-type input device 100, 100a and 100b, and detect the control signal transmitted from the game machine 200.

The input selectors 114, 114a, and 114b are installed at lower ends of one side of the racket-type input devices 100, 100a, and 100b, and distinguish the racket-type input devices 100, 100a, and 100b (for example, , First racket, second racket, etc.). The input selector 114, 114a, 114b is preferably a switch, and selects any one of "00", "01", "10", and "11", and the selected number is the racket-type input device (100, 100a, 100b).

The sensory signal output unit 116 is installed inside the racket-type input device (100, 100a, 100b), the sound effect and vibration generated during the game progress (for example, if the ping-pong ball hit the racket, it occurs) Sound and the impact vibration caused by the ping pong ball hit the racket).

The controller 118 is connected to the infrared light sources 110, 110a and 110b, the infrared light receivers 112, 112a and 112b, the input selectors 114, 114a and 114b, and the sensor signal output unit 116. In addition, the infrared light receiving unit 112, 112a, 112b detects a control signal corresponding to the number input from the input selection unit 114, 114a, 114b to turn on the infrared light source (110a, 110a, 110b) When the sensor signal output signal is detected through the infrared light receiving units 112, 112a and 112b, the sensor signal output unit 116 is driven.

The infrared detector 210 is installed at least one side of the front side of the housing 200, the racket-type input device (100, 100a, 100b) by detecting the infrared light emitted from the infrared light source (110, 110a, 110b) ) Is detected. 4 is a block diagram showing the configuration of the infrared detection unit, and an infrared filter 211 for detecting an infrared light source from a light source input in a three-dimensional space is installed, and all lights except infrared are blackened. A lens 212 for condensing and imaging an infrared light source filtered by the infrared filter 211 and an image sensor 213 for converting an image formed by the lens 212 into an electrical signal are provided. The image sensor 213 has a characteristic of quantifying and outputting the amount of light, and the value of the pixel in which the infrared light source is located is larger than the value of the pixel in which the infrared light source is not located. As shown in FIG. 5, when the brightness of the infrared light source 215 formed on the image sensor 213 is lower than or equal to a threshold, the current frame is ignored and the infrared light source 215 formed on the image sensor 213 is ignored. If the brightness is greater than or equal to the threshold value, the pixel value of the current frame is converted into an electrical signal and provided to the controller 240 to be described later.

In one embodiment of detecting the position of the infrared light source in the frame, detecting that the position of the infrared light source 215 is moved from (X1, Y1) to (X2, Y2) pixels is one frame (for example, t = 1/60 seconds) read all the pixel values and store them in the memory, add the values of each stored pixel, calculate the average value, and search for the position of the light source (X1, Y1) by searching the position of the pixel that is above the calculated average value. Serve

In addition, another embodiment of determining the position of (X1, Y1) reads the pixels of one frame sequentially and determines the pixel position of the pixel above the boundary value as the absolute position (X1, Y1) of the light source based on a predetermined boundary value. .

The positions of the light sources detected through the two embodiments are changed when the positions X1 and Y1 of the light sources are detected in the first frame t and the positions X2 and Y2 of the light sources are detected in the second frame t + 1. The moving speed of the light source can be calculated through dD / dT by using the time t + 1 and the changed positions X1, Y1 to X2 and Y2.

At least one infrared light emitting unit 220 is installed on one side of the front side of the housing of the game machine 200, and a selection signal and the sensory signal output unit 116 for selecting the racket-type input device (100, 100a, 100b). Outputs a control signal.

The display unit 230 is any one of a television receiver, a CRT monitor, and an LCD, and is integrally installed on an upper side of the housing of the game machine 200. As shown in FIG. 6, the opponent game player character 232 is output on the opposite side of the table tennis table character 231 and the table tennis table character 231, and the score character 233 displaying a score on one side of the game screen is displayed. The ball character 234 is outputted and moved according to the input of the input device.

The controller 240 includes a memory (not shown), and is connected to the infrared detector 210, the infrared light source 220, and the display 230 inside the game machine 200.

The controller 240 calculates a moving direction, a moving speed, and an acceleration of the light source by using the frame pixel value of the light source detected by the infrared detector 210, and uses the calculated result through the infrared light source 220. Transmits a selection signal and a sensory signal for selecting input devices 100, 100a, and 100b, and changes the character (eg, collision intensity, motion trace, etc.) according to the calculation result through the display unit 230. Output In addition, a control signal necessary for game progress is received through the selection switch 241 and the movement selection switch 242 formed at the center of the game machine 200 housing.

Next will be described the operation of the haptic game device according to the present invention. FIG. 7 is a flowchart illustrating a process for driving a racket in the haptic game device of FIG. 2. 3 and 7, when the racket number setting is generated through the input selector 114 of the input apparatus 100 (S100), the controller 118 stores the set racket number and disables the racket. (S110).

In operation S110, the disabled input device 100 detects whether an enable signal is generated in the infrared light receiver 112 (S120), and when an enable signal is detected, the infrared light is detected through the infrared sensor 110. Enable the light source (S130), and determines whether the racket sensory signal is detected (S140) in the infrared light receiving unit (112). When the racket sensory signal is received in step S140, the racket sensory signal is output through the sensory signal output unit S116 (S150), and it is determined whether a signal for disabling the input device 100 is detected (S160).

On the other hand, in step S140, if the racket sense signal is not detected to go to step S160, and if the racket disable signal is not detected in step S160 to return to step S130.

In step S160, when the set racket disable signal is detected, the controller 118 turns off the infrared light source 110 to disable the infrared light source (S170).

Meanwhile, in step S100, the controller 118 enables the infrared light source (S101) when the input for setting the racket number does not occur, and enables the sensory signal output unit 116 in the infrared light receiver 112. It is determined whether the sensory signal is detected (S102), and when the sensory signal is detected, the sensory signal output unit 116 outputs the sound or vibration in the form of S103.

8 is a flowchart illustrating a process of playing a game with one racket in the haptic game device of FIG. 2. 3 and 8, when an input for selecting a single game is selected through a selection switch (not shown) of the game machine 200, the controller 240 outputs a single game screen through the display 230 (S200). Then, the infrared light source emitted from the input device 100 detects the position value on the image sensor of the infrared detector 210 (S210).

After performing the step S210, the control unit 240 detects the position value of the ball character output through the display unit 230, calculates an expected path to which the ball character moves, and stores the expected hitting position value in a memory (not shown). Save to (S220).

After performing the step S220, the control unit 240 detects the swing position and direction of the input device 100 by tracking the trajectory of the infrared light source detected by the infrared detection unit 210 (S230). That is, the moving positions X2 and Y2 of the infrared light source generated while the input device 100 moves (swing) at the initial light source positions X1 and Y1 detected in step S210 are detected, and the values X1 and X2 are determined. The left / right moving direction of the input device 100 is detected by using the upper and lower moving directions of the input device 100 by using the Y1 and Y2 values.

If the hitting position of the input device 100 hitting the ball character by comparing the trajectory position of the swing detected in the step S230 with the hitting position stored in the memory (S240) is determined to be a hut swing, the ball ends. If the hitting position of the input device 100 hitting the character is smaller than the tolerance, it is determined that the correct hitting detects the swing speed of the input device 100 (S250). The swing speed of the input device detects the speed at which the light source moves, that is, the speed at which the input device swings using the position and time of the light source moved per unit time. Meanwhile, the swing position and the swing speed of the input device 100 may be detected together in step S230, and the determination condition may be set using the swing speed in step S240.

After performing the step S250 and outputs the racket sensory signal through the infrared light emitting unit 220 (S260), and determines the element to move the ball character according to the swing position, direction and speed of the input device (S270) Then, the ball character is output through the screen of the display 230 according to the determined element (S280).

FIG. 9 is a flowchart illustrating a process of playing a game with a plurality of rackets in the haptic game device of FIG. 2, which will be described with reference to FIGS. 3 and 9 as follows. If an input for selecting a double match is selected through a selection switch (not shown) of the game machine 200, the controller 240 outputs a double game screen through the display unit 230 (S300), and displays the first input device. The signal to enable is output (S310).

After performing the step S310, the control unit 240 detects the position value on the image sensor of the infrared detection unit 210 with the infrared light source emitted from the first input device (S311) and is output through the display 230 The position value of the ball character is detected, and the estimated path at which the ball character moves is calculated to store the estimated strike position value in a memory (not shown) (S312).

After performing step S312, the controller 240 detects a swing position and a direction of the first input device by tracking a trajectory of the infrared light source detected by the infrared detector 210 (S313).

If the hitting position of the first input device hitting the ball character by comparing the trajectory position of the swing detected in the step S313 with the hitting position stored in the memory (S314) is determined to be a hut swing, the ball ends. When the hitting position of the first input device hitting the character is smaller than the tolerance, it is determined that the correct hit is detected and the swing speed of the first input device is detected (S315).

After performing the step S315 and outputs the racket sensory signal through the infrared light source 220 (S316), determine the element to move the ball character according to the swing position, direction and speed of the first input device (S317), The ball character is output through the screen of the display unit 230 according to the determined element (S318).

After performing step S318, the controller 240 determines whether the enabled input device is the second input device (S319), and disables the first input device when the input device is not the second input device. Outputs a signal (S320), outputs a signal for enabling the second input device (S321), and returns to step S311.

On the other hand, in the case of the second input device in step S319 outputs a signal for disabling the second input device (S323) and ends.

10 is a block diagram showing another embodiment of a haptic game device using an image sensor according to the present invention. In FIG. 10, game machine 200 is connected to television 300 via AV connection cable 250.

In addition, the racket-type input device 100 has an infrared light source 110 and the infrared light receiving unit 112 is installed on one side of both sides, at least one infrared light source (110c) at both corners of the racket-type input device 100. It is installed, the input selector 114 is installed at one lower side.

The game machine 200 housing includes an infrared detector 210, an infrared light source 220, and a controller 240, and a screen output device for display can be connected using a television 300, an LCD, a monitor, or the like. Do.

11 is a flowchart illustrating an input detection process of a haptic game device using an image sensor according to the present invention. In FIG. 11, when an optical signal is exposed to an arbitrary pixel of a frame of the image sensor at an arbitrary time t, the pixel value of the frame of the exposed image sensor is sequentially detected (S400). The optical signal is preferably infrared.

In operation S400, the pixel values sequentially input are compared with a pre-stored reference value (S401), and when the pixel value is greater than or equal to the reference value, the detected pixel values X1 and Y1 are stored in the memory (S402).

After the operation S402 is performed, a sensor frame pixel value of the image is sequentially detected again (S403) after a predetermined time (t + 1), the detected pixel value is compared with a reference value (S404), and the pixel value is a reference value. In case of abnormality, the difference between the pixel values stored in the step S402 is obtained from the detected pixel values X2 and Y2, and the difference values (X1-X2, Y1-Y2) are differentiated by unit time (dx / dt, dy / dt). The moving speed v of the light source is calculated (S405).

The acceleration (a) of the light source is calculated by differentiating (dv / dt) the change value of the speed calculated in the above step S405 in unit time (S406).

As described above, the present invention detects the operation of an input device that outputs a constant signal, determines the speed and location information of the input device using the detected signal, and connects the determination information with a virtual experience to feel a sense of reality. There is an advantage in that the input device is simplified to detect a user's game movement, and thus, there is an advantage of reducing the problem of damage caused by external conditions such as impact generated during the operation. In addition, it is possible to know the exact position of the input device has the advantage of increasing the realism and interest like a real game.

In the above, the present invention has been illustrated and described with respect to certain preferred embodiments. However, the present invention is not limited only to the above-described embodiments, and those skilled in the art to which the present invention pertains may vary without departing from the spirit of the technical idea of the present invention described in the claims below. It will be possible to carry out the change.

Claims (9)

A haptic game device comprising: an input device moving in a three-dimensional space; and an output device for detecting a motion of the input device and outputting a game character output on a screen of a display means. At least one infrared sensor installed in the input device and outputting an infrared signal to detect a position of the input device; At least one image sensor installed in the output device, detecting the infrared signal and converting the infrared signal into an electrical signal, and outputting a position value of the converted electrical signal; And a control means for detecting the moving speed and the moving direction of the infrared signal by using the position value of the electric signal, and for interlocking the detected value with the game character and the motion. . The apparatus of claim 1, wherein the infrared sensor comprises: a signal detector for detecting an infrared signal input from the outside; Game experience device using an image sensor comprising a signal control unit for controlling the output of the infrared signal using the signal of the signal detection unit. The image sensor of claim 1, wherein the image sensor comprises: an infrared filter for detecting an infrared light source input in a three-dimensional space; A lens for condensing and imaging the light source filtered by the infrared filter; And Feeling game device using an image sensor, characterized in that the conversion unit for converting the image formed in the lens into an electrical signal. The game experience device according to claim 1, wherein the control unit further comprises a control signal output unit for outputting an infrared control signal. The game experience device according to claim 2, wherein the controller further comprises a sensory signal output unit for outputting a sensory signal of vibration or sound. The game experience device according to claim 2, wherein the control unit further comprises input selecting means for selecting a unique number of the infrared light source. At least one input device having at least one light source for outputting an infrared signal and at least one image sensor for detecting a position of the infrared signal output from the light source and converting the signal into an electrical signal are installed, and using the position signal converted by the image sensor. And a control unit for detecting a moving speed and a moving direction of the infrared signal, and controlling a motion of a game character output on a screen of a display means by using the detected value. Method for detecting the position of the infrared light source, Sequentially detecting frame pixel values of the image sensor; Comparing the detected pixel value with a predetermined reference value and detecting a pixel value that is greater than or equal to the reference value; And And storing the pixel value of the reference value or more in a memory. The method of claim 7, wherein the storing of pixel values greater than or equal to the reference value in the memory comprises sequentially detecting frame pixel values of the image sensor after a predetermined time elapses; Comparing the detected pixel value with a predetermined reference value and detecting a pixel value that is greater than or equal to the reference value; And calculating a speed by differentiating the difference between the pixel value greater than or equal to the reference value and the pixel value stored in the memory in unit time, wherein the speed is different. The method of claim 8, wherein the calculating of the speed further comprises calculating an acceleration by differentiating the change in the speed in unit time. 10.