TWI478756B - Interactive game control system and control method - Google Patents

Description

Interactive game control system and control method

The present invention relates to a game control system, and more particularly to an interactive game control system that senses the user's limb movements and directions as input control parameters of the game.

Generally, the game programs or game consoles commonly used in the market are mostly operated by the user to input a joystick or a keyboard to input input parameters required during the game, and the game program executes the program according to the above input parameters, and is displayed on the screen. Show the game process. That is, the user uses the joystick and keyboard control in the hand to cope with the progress of the game program, and uses the image displayed on the screen as a basis for controlling the game.

In recent years, the game console technology has advanced, and the user has been able to perform the game program execution in the game console by waving the handheld wireless joystick. For example, in the game program of the batting game, the user uses the waving handheld wireless joystick for the game. The program recognizes the timing of hitting the ball, but whether the user hits the left or right, or whether it is a forehand or a backhand, the game console is unrecognizable and the actual hitting method. There are still differences, not true enough.

In addition, in the process of executing the game program by the game host, the game process is fed back to the user by outputting the image. After the user views the image, appropriate control is performed, and the user only participates in the game program by visually participating. The realism of the game during the game is particularly lacking.

Accordingly, it is an object of the present invention to provide an interactive game control system that uses the user's physical motion as an input signal to the game program to improve the game's true presence.

Another object of the present invention is to provide an interactive game control method that uses the user's limb motion as an input signal of a game program to improve the game's true presence.

Therefore, the interactive game control system of the present invention is suitable for connecting a display device and operating with a game program. The interactive game control system includes: a sensing device mounted on the user, and a signal for receiving the sensing device. The signal processing device, a control device that receives the signal output from the signal processing device, a host device that receives the input control signal of the control device, and a signal that receives the host device and generates a feedback device that stimulates the user's effect.

The sensing device has an inertial sensor mounted on the limb of the user to sense the movement of the user's limb and output an action signal, and is mounted on the user to sense the user's face. A direction sensor that outputs a direction signal. The signal processing device respectively interprets and calculates the motion signal and the direction signal measured by the inertial sensors, thereby identifying the action type and body direction of the limb in the user's three-dimensional space.

The control device receives the signal output by the signal processing device and translates the user's action type and body direction into one of the input control signals compatible with the game program and outputs the same.

The host device receives the input control signal of the control device, and inputs the control signal as an input parameter for controlling the execution process of the game program, and outputs an image signal to the display device during the execution of the game program, thereby causing the user to The action type and body direction of the limb are displayed on the display device and output a feedback control signal in conjunction with the execution of the game program.

The feedback device has a plurality of interactive feedback devices respectively arranged on the user and receiving feedback control signals output by the host device, and the interactive feedback device receives the feedback control signal output by the host device and generates a stimulus user effect.

The interactive game control method of the present invention is suitable for use with a game program, and the interactive game control method comprises the following steps:

(A) The plurality of interactive feedback devices of the feedback device are respectively attached to the user.

(B) A motion signal that senses the direction of the user's body and the limb.

(C) Calculate and recognize the action type of the limbs of the user's limbs.

(D) inputting the user action type and direction into the game program as an input parameter for controlling execution of the game program.

(E) transmitting an output image signal during operation of the game program to the display device.

(F) The interactive feedback device of the feedback device receives a feedback control signal from the game program output, and converts the feedback control signal into a physical effect that stimulates the user.

The function of the invention is to measure the motion signal and the direction signal of the user by using the sensing device worn on the user, and process the signal by the signal And the control device recognizes the type and direction of the action and converts the parameters into the execution process of the game program, so that the user can directly control the game by the action, and the game program synchronously feeds back the relevant signal to the feedback device, thereby improving The user's participation in the game's realism and presence.

The above and other technical contents, features and advantages of the present invention will be apparent from the following detailed description of the preferred embodiments.

Referring to FIG. 1 , FIG. 2 and FIG. 3 , a preferred embodiment of the interactive game control system of the present invention is suitable for connecting a display device 2 and operating with a game program. The interactive game control system comprises: one worn on the user The sensing device 3 on the body, a signal processing device 4 that receives the output signal of the sensing device 3 and recognizes the type and direction of the action of the user's limbs, and a wireless transmission disposed between the sensing device 3 and the signal processing device 4 The device 5, a control device 6 for compiling the action type and direction of the user's limbs into control signals usable by the game program, a host device 7 for executing and operating the game program, and an output of the receiving host device 7 The signal also produces a feedback device 8 that stimulates the user's effect.

The sensing device 3 has a plurality of inertial sensors 31 that are respectively worn on the limbs of the user to sense the motion of the user's limbs and output an action signal, and one is worn on the user to sense the user. A direction sensor 32 that faces the direction and outputs a direction signal. In this embodiment, the inertial sensors 31 are a gyroscope or an accelerometer, and the obtained motion signal is the three-dimensional acceleration of the user's limb movement process, and the direction sensor 32 is A magnetometer or an electronic compass is worn on the user to measure the direction of the user's face. In the embodiment, the four inertial sensors 31 and the one-way sensor 32 are taken as an example for description. In actual implementation, the inertial sensor 31 and the direction sensor 32 can be increased or decreased according to the requirements of the game program, so implementation is implemented. The scope is not limited to the above number.

Referring to FIG. 2, FIG. 3 and FIG. 4, the wireless transmission device 5 has a plurality of transmitters 51 respectively coupled to the inertial sensors 31 and the direction sensors 32, and a plurality of transmitters 51 are mounted on the feedback device 8. The receiver 50 is coupled to the signal processing device 4 and receives signals from the transmitters 51 and transmits signals to the transceivers 52 of the receivers 50. The transmitters 51 transmit the motion signals of the inertial sensors 31 and the direction signals of the direction sensors 32 to the transceiver 52 in a wireless transmission manner.

Referring to FIG. 3, FIG. 4 and FIG. 5, the signal processing device 4 receives the action signal and the direction signal received by the transceiver 52 to identify the action type and body direction of the limb in the user's three-dimensional space. The signal processing device 4 has an inertia processing module 41 and a directional processing module 42. The inertia processing module 41 has an inertia pre-processing unit 411 that samples an action signal of the inertial sensor 31 and filters out the noise therein, a feature extraction unit 412 that captures the characteristic value of the motion signal, and a screenable The feature dimension reduction unit 413 of the feature value is necessary, and an identification unit 414 that identifies the user's three-dimensional motion type from the feature values described above. The direction processing module 42 has a direction pre-processing unit 421 that samples a direction signal of the direction sensor 32 and filters out the noise therein, and compares the direction of the user with a threshold value and a direction signal. Threshold unit 422.

The manner in which the inertial processing module 41 recognizes the action type of the user's limb is as follows: the inertia pre-processing unit 411 filters out the noise in the received motion signal, and the feature extraction unit 412 then uses the motion signal as a window. The method cuts, and then takes the statistical values of the average value and standard deviation of the motion signals in each window to form a feature value vector. Then, the feature dimension reduction unit 413 utilizes a feature dimensionality reduction algorithm (eg, linear recognition). The analysis method performs the work of reducing the dimension of the feature value, and finally obtains the feature value of the three-dimensional acceleration, and then uses the identification unit 414 to identify the action type in the user's three-dimensional space from the feature value of the acceleration.

The direction processing module 42 recognizes the direction of the user's direction as follows: First, assume that the human body is facing the front of the screen and the head is directly facing the front when the game is started, and the head direction is set to a reference direction of 0 degree angle, and the user The maximum can still be rotated about 90 degrees horizontally. Then, the threshold threshold unit 422 sets a threshold value. In this embodiment, 25%-30% of the maximum angle of the left and right rotation is taken as the left and right rotation threshold. In this embodiment, the threshold value is about 25 degrees. Then, the direction pre-processing unit 421 filters the direction signal measured by the direction sensor 32, and the threshold value unit 422 compares the direction signal with the threshold value, and when the user's head turns left (right) more than 25 degrees. When the threshold value unit 422 determines that the player is currently performing the left (right) turn operation, and the left (right) turn is lower than 25 degrees, the threshold value unit 422 determines that the user has not performed any direction change action by the above. The comparison of the rotation angle with the threshold value not only determines the direction of the user but also greatly reduces the amount of calculation of the overall system. In this embodiment, the threshold value is set and the rotation angle is compared with the measured rotation angle. However, in actual implementation, the direction sensor can be directly measured by the direction sensor 32. As the angle of rotation, the implementation range is not limited by the threshold value. And if the display device 2 (see FIG. 1) can support a 360-degree visual effect (for example, implemented by four liquid crystal display screens), the user can also set the horizontal left and right rotations by 180 degrees, and can be increased. On-the-spot visual effects.

The signal processing device 4 calculates the action signal and the direction signal measured by the inertial sensor 31 and the direction sensor 32 by using the above-mentioned program for checking noise, calculation and judgment to identify the user. The type of movement and body direction of the limb in the three-dimensional space.

Referring to FIG. 1 and FIG. 4, the control device 6 receives the signal output by the signal processing device 4, and translates the action type and body direction of the user's limb into one of the input control signals compatible with the game program. That is, the action type and body direction of the user's limb are translated into parameters that the game program can receive and use and output to the host device 7.

The host device 7 mainly executes the game program and receives an input control signal of the control device 6 to input an input control signal into the game program and execute it, and an image signal is immediately output during the execution of the game program to The display device 2 causes the image of the user's limb movement and the body direction to be displayed on the display device 2, and operates in conjunction with the game program. When the host device 7 executes the game program, if the game program interacts with the user image, the host device 7 immediately outputs a feedback control signal to the transceiver 52 of the wireless transmission device 5, and wirelessly transmits the signal to the transceiver 52. The feedback device 8. In this embodiment, the host device 7, the control device 6, and the signal processing device 4 are devices capable of processing data, and can be used in a general computer, a game console, a single crystal computer, a computer, or a pluggable device. The device or the home appliance of the computer is implemented, and the detailed process of the internal processing data of the above components is not a feature of the present invention, and will not be further described below.

The feedback device 8 has a plurality of interactive feedback devices 81 respectively supported on the limbs of the user and receiving the feedback control signals output by the host device 7. Each of the interactive feedback devices 81 is electrically connected to a receiver 50 and wirelessly transmitted between the receiver 50 and the transceiver 52 to receive the feedback control signal output by the host device 7 and to generate a stimulating user effect. Each of the interactive feedback devices 81 in this embodiment has a vibration element 811 that generates a vibration effect, an output speaker 812 that outputs an audio, and a light-emitting element 813 that emits light. That is, the interactive feedback device 81 generates a stimulating effect such as vibration, sound, or light on the user's limb.

The following description refers to FIG. 1 , FIG. 2 and FIG. 6 , whereby the user does not need to manually press any button or keyboard during the game, and does not need to control the rocker, as long as the body rotates and moves with the limbs. The game can be controlled. For example, in a tennis game, when the tennis ball flies to the right as shown in FIG. 2, the user faces the right side and shoots the ball from the right back to the right front with the forehand. 3 Immediately detecting the acceleration and body direction of the limbs and wirelessly transmitting to the signal processing device 4, after being processed and recognized by the signal, transmitted to the control device 6 and translated into relevant game parameters, and then transmitted to the host device 7, that is, the right forward wave The action of the arm hitting ball is converted into the parameter of the hitting in the game program, and the button slamming process does not need to use the button and the rocker completely, and if the direction in which the tennis ball flies is to the left as shown in FIG. 6, the user turns On the left side, the action of hitting the ball with the backhand also immediately enters the game program.

That is, the type of action of the user's positive and negative hand and the direction of the body face are measured by the sensing device 3 worn on the user, and then wirelessly transmitted to the signal processing device 4 and the control device 6 to enter the host device. 7 in the game program. That is to say, the invention can completely recognize the movement, type and direction of the user's limbs in the three-dimensional space, so whether the forehand or the backhand slaps the ball, or even the action of killing the ball from the top to the bottom can be recognized, and In the prior art, the method of judging the timing of hitting the ball by shaking the handheld wireless joystick is compared, and the present invention can improve the control authenticity of the game process.

It is worth mentioning that when the host device 7 executes the game program, such as when the game program interacts with the user, for example, in a batting game, the ball hits the user's hand, or the shooting game, the user When the hand is hit, the host device 7 immediately outputs the feedback control signal and wirelessly transmits it to the corresponding interactive feedback device 81 to generate a vibration effect, a light effect and a sound effect on the corresponding limb, so that the user feels the hand is The stimulating effect of a tennis hit or being shot, enhancing the user's presence in the game. In addition, the interactive feedback device 81 of the feedback device 8 can also be worn on the acupuncture point of the user to increase the effect of the massage acupoint during the game.

It can be concluded from the above description that the interactive game control method of the present invention comprises the following steps:

(A) The plurality of interactive feedbacks 81 of the feedback device 8 are respectively attached to the user.

(B) Sensing the motion signal of the user's body direction signal and limbs.

(C) Identifying the motion signals of the user's limbs as the action type and direction of the limbs.

(D) inputting the user action type and direction into the game program as an input parameter for controlling execution of the game program.

(E) transmitting the output image signal during the operation of the game program to the display device 2.

(F) The interactive feedback device 81 of the feedback device 8 receives the feedback control signal output by the game program, and converts the feedback control signal into a physical effect that stimulates the limbs of the user.

In summary, the interactive game control system of the present invention measures the motion and direction of the user by using the sensing device 3 worn on the user, and the above-mentioned action is performed by the signal processing device 4 and the control device 6. And the direction is converted into a parameter of the execution process of the game program, so that the user can directly control the game by the action, and the game program synchronously feeds back the relevant signal to the corresponding feedback device 8, thereby enhancing the realism and presence of the user participating in the game. The effect is indeed achieved by the object of the present invention.

The above is only the preferred embodiment of the present invention, and the scope of the invention is not limited thereto, that is, the simple equivalent changes and modifications made by the scope of the invention and the description of the invention are All remain within the scope of the invention patent.

2‧‧‧Display device

3‧‧‧Sensing device

31‧‧‧Inertial Sensor

32‧‧‧ Directional Sensor

4‧‧‧Signal processing unit

41‧‧‧Inertial Processing Module

411‧‧‧Inertial pre-processing unit

412‧‧‧Character extraction unit

413‧‧‧Characteristic dimension reduction unit

414‧‧‧ Identification unit

42‧‧‧ Directional Processing Module

421‧‧‧ Directional pre-processing unit

422‧‧‧direction threshold unit

5‧‧‧Wireless transmission

50‧‧‧ Receiver

51‧‧‧Transmitter

52‧‧‧ transceiver

6‧‧‧Control device

7‧‧‧Host device

8‧‧‧Return device

81‧‧‧Interactive Feedback

811‧‧‧Vibration element

812‧‧‧ output speaker

813‧‧‧Lighting elements

1 is a block diagram of a preferred embodiment of the game system of the present invention; FIG. 2 is a schematic view of the preferred embodiment mounted on the user to illustrate the situation in which the user hits the ball with a forehand; 3 is a partial block diagram of the preferred embodiment to illustrate a sense FIG. 4 is a view similar to FIG. 3, illustrating the wireless transmission device transmitting a feedback control signal of a host device to a feedback device; FIG. 5 is similar to FIG. View to illustrate the internal construction of the signal processing device; and Figure 6 is similar to the view of Figure 2 to illustrate the situation in which the user slaps the ball with a backhand.

2. . . Display device

3. . . Sensing device

4. . . Signal processing device

5. . . Wireless transmission device

6. . . Control device

7. . . Host device

8. . . Feedback device

Claims (20)

An interactive game control system for connecting a display device and operating with a game program, the interactive game control system comprising: a sensing device having a body mounted on the user to sense the user's limb And an output inertial sensor that outputs an action signal, and a direction sensor mounted on the user to sense the direction of the user and output a direction signal; a signal processing device receiving the sensing The action signal and the direction signal of the device are respectively interpreted and calculated for the action signals measured by the inertial sensors, thereby identifying the action type and body direction of the limb in the three-dimensional space; a control device Receiving a signal output by the signal processing device and translating the user's action type and body direction into one of the input control signals compatible with the game program and outputting the same; a host device receiving the input control signal of the control device, And inputting the control signal as an input parameter for controlling the execution process of the game program, and the game program is directly input during the execution process An image signal is sent to the display device, so that the user's action type and body direction are displayed on the display device and a feedback control signal is outputted in conjunction with the game program; and a feedback device has a plurality of feedback devices respectively disposed on the user And an interactive feedback device that receives the feedback control signal output by the host device, and the interactive feedback device receives the feedback control signal output by the host device and generates an effect of stimulating the user. The interactive game control system according to claim 1, wherein the feedback device of each feedback device has a vibration element that can be driven by the feedback control signal to generate a vibration effect. According to the interactive game control system of claim 1, wherein the feedback device of each feedback device has an output speaker that can be driven by the feedback control signal to generate a sound effect. The interactive game control system of claim 1, wherein the feedback device of each feedback device has a light-emitting element that can be driven by a feedback control signal to produce a flashing effect. According to the interactive game control system of claim 2, the interactive feedback device of the feedback device is worn at a user's acupuncture point. The interactive game control system according to claim 1, wherein the inertial sensor of the sensing device is a gyroscope. The interactive game control system according to claim 1, wherein the inertial sensor of the sensing device is an accelerometer. The interactive game control system according to claim 6 or 7, wherein the signal processing device has an inertial pre-processing unit that samples an action signal of the inertial sensor and filters out noise therein. And a feature extraction unit that extracts the feature value of the motion signal, a feature dimension reduction unit that can filter the feature value unless necessary, and an identification unit that recognizes the user's three-dimensional motion from the feature values. According to the interactive game control system of claim 8, wherein the feature capturing unit measures the inertial sensors The signal cuts the motion signal in the form of a window method, and then extracts the statistical value of the motion signal in each window to form a feature value vector. Then, the feature dimension reduction unit uses the feature dimension reduction algorithm to reduce the dimension of the feature value. Work, and finally, the identification unit is used to identify the type of action and body direction in the user's three-dimensional space. The interactive game control system according to claim 1, wherein the direction sensor of the sensing device is a magnetometer. The interactive game control system according to claim 1, wherein the direction sensor of the sensing device is an electronic compass. The interactive game control system according to claim 10 or 11, wherein the signal processing device has a direction pre-processing unit that samples a direction signal of the direction sensor and filters out the noise therein. And a direction threshold unit that uses a threshold to determine the direction. The interactive game control system according to claim 1 further includes a wireless transmission device disposed between the sensing device and the signal processing device to wirelessly transmit the motion signal and the direction signal to the signal processing device, and the wireless transmission device The feedback control signal output by the host device is also wirelessly transmitted to the interactive feedback devices. According to the interactive game control system of claim 13, the wireless transmission device has at least one transmitter coupled to the sensing device, a receiver mounted on the feedback device, and a signal The processing device electrically connects and receives signals from the transmitters and transmits signals to the transceivers of the receivers. An interactive game control method suitable for use with a game program The interactive game control method comprises the following steps: (A) respectively arranging a plurality of interactive feedback devices of a feedback device on the user; (B) sensing an action signal of the user's body direction and the limb; (C) The action signals of the user's limbs are calculated and recognized as the action type of the limb; (D) the user action type and direction are input into the game program as input parameters for controlling execution of the game program; (E) Transmitting an output image signal during operation of the game program to a display device; and (F) the interactive feedback device of the feedback device receives a feedback control signal from the game program output, and converts the feedback control signal into a stimulus The physical effect of the user. According to the interactive game control method of claim 15, wherein in step F, the feedback control signal is converted into a vibration effect. The interactive game control method according to claim 15, wherein in step F, the feedback control signal is converted into a light effect. According to the interactive game control method of claim 15, wherein in step F, the feedback control signal is converted into a sound effect. The interactive game control method according to claim 15, wherein in step D, the user action and direction are input to the game program by wireless transmission. According to the interactive game control method described in claim 15 of the patent application scope, In step C, the measured motion signals are first cut in a window method, and then the statistical values of the motion signals in each window are extracted to form a feature value vector, and then the feature is obtained. The value vector uses linear recognition analysis to reduce the eigenvalues. Finally, the program of the user's three-dimensional motion is identified.