TWI469814B - Voice - based and brain waves, supplemented by the role of video game control system Methods and methods - Google Patents

Description

Voice-activated and brainwave-assisted video game character control system System and method

The present invention relates to a video game character manipulation system and method, and more particularly to a system and method for performing video game character manipulation through voice and brain waves.

In recent years, video games have gradually evolved into a very popular industry. New games are constantly being introduced around the world, and due to continuous breakthroughs in control technology and image processing technology, the gameplay of video games has been made up of traditional joysticks and buttons. The combination of manipulations is transformed into sensing through body movements, or through voice or brain waves.

Although the voice control method can eliminate the action of the joystick and the button operation of the hand, and can control the video game character to generate the corresponding action through voice, but the situation that the game needs to be continually issued can often be played, and some frequently used voice commands are easy. Causes the players to be annoyed and affect their interest in the game. When the brain wave is used for the manipulation of the video game character, the player needs to maintain high concentration for a long time, which is easy to cause the player to be exhausted, thereby affecting the stability of the manipulation, so the brain wave controlled video game usually cannot be performed for a long time. Therefore, there is still a change in the role of the current video game. Good space.

Accordingly, it is an object of the present invention to provide a system and method for playing a game character of a video game through voice and brain waves.

Therefore, the video game character control system with the sound control as the main and the brain wave as the supplement is suitable for a game player to play a video game through the voice and the brain wave, and the video game character manipulation system includes a voice that can be used to record the player and Corresponding to a sound receiving device for outputting a voice data, a brain wave detecting device for detecting a brain wave signal of the player and correspondingly outputting a brain wave data, and a game host. The game host includes an instruction matching module and a game execution module. The command matching module is connected to the sound receiving device and the brain wave detecting device, and comprises a command library unit with a plurality of voice commands and a plurality of brain wave assist commands, and the voice data can be analyzed and a voice command recognition unit for finding a voice command corresponding to the voice data in the command library unit, and a brain wave frequency command for analyzing the brain wave frequency of the brain wave data and finding a corresponding brain wave assist command from the command library unit Brainwave command recognition unit. The game execution module is connected to the command matching module, and can execute a video game, and determines the action of one of the video game characters according to the voice command output by the voice command recognition unit, and according to the brain The brain wave assist command output by the wave command recognition unit controls the magnitude and/or speed of the action determined by the video game character.

Therefore, the sound control main character and the brain wave supplemented by the video game character control method can control the action of a video game character of a video game game by a game player's voice and brain wave, the video game game corner. The color manipulation method comprises the following steps: (A) recording the player's voice, and correspondingly outputting a voice data to the game host; (B) detecting the player's brain wave signal, and correspondingly outputting a brain wave data to the game host And (C) the game host converts the voice data into a voice command, and determines the action of the video game character according to the voice command, and converts the brain wave data into a brain wave assist command, and controls according to the brain wave assist command The amplitude and/or speed of the action determined by the video game character.

The effect of the invention: through the design of the video game character control system and method supplemented by the voice control and the brain wave of the present invention, the player can intuitively and correctly manipulate the video game character by issuing voice commands and changing the brain wave frequency. Game action.

3‧‧‧ Radios

4‧‧‧Brain wave detection device

5‧‧‧ game console

51‧‧‧Instruction Matching Module

511‧‧‧Command Library Unit

512‧‧‧Voice Command Identification Unit

513‧‧‧ Brainwave Command Identification Unit

52‧‧‧ Game Execution Module

6‧‧‧Image output device

61‧‧‧Projection screen

62‧‧‧Projection equipment

Other features and effects of the present invention will be apparent from the following description of the drawings, wherein: FIG. 1 is a preferred embodiment of a video game character manipulation system in which the voice control is dominant and the brain wave is supplemented. Functional block diagram; FIG. 2 is a flow chart showing the steps of a preferred embodiment of the method for controlling the character of a video game game based on the voice control and the brain wave.

Before the present invention is described in detail, it should be noted that in the following description, similar elements are denoted by the same reference numerals.

Referring to FIG. 1 and FIG. 2, a preferred embodiment of the video game character control system with the voice control as the main and the brain wave as the supplement is provided for a player to pass through. Voice and brain waves complement one of the video game characters. The video game character control system includes a sound receiving device 3, a brain wave detecting device 4, a game host 5 connected to the sound receiving device 3 and the brain wave detecting device 4, and a signal connected to the game host 5. Image output device 6.

In the present embodiment, the sound pickup device 3 and the brain wave detecting device 4 are designed in a kit form for the player to directly wear on the head. The radio device 3 is a wireless microphone that can record the sound of the player and can wirelessly transmit the recorded voice to the game console 5 in the form of a voice data. The brain wave detecting device 4 is disposed at the forehead of the player, and is mainly used for detecting the brain wave signal of the player's forehead leaf, and wirelessly transmitting a corresponding brain wave data to the game host 5. In the implementation, the sound receiving device 3 and the brain wave detecting device 4 can also be disposed separately, not limited to being designed as a set, and the brain wave detecting device 4 is not required to be disposed on the forehead, and can also be set. In the head, other positions where the brain break signal can be measured. Since the sound pickup device 3 and the brain wave detecting device 4 are both well-known members and have many types, they will not be described in detail.

The game console 5 includes a wireless signal connected to the audio device 3 and the command matching module 51 of the brain wave detecting device 4, and a signal connected to the command matching module 51 for executing a video game game execution. Module 52.

In this embodiment, the command matching module 51 and the sound receiving device 3 and the brain wave detecting device 4 are connected by a Bluetooth communication technology, but when implemented, Wi-Fi and NFC are also implemented. Or other communication technologies such as ZigBee for signal connection.

The command matching module 51 includes a command library unit 511 with a plurality of voice commands and a plurality of brain wave assist commands, a voice command recognition unit 512, and a brain wave command recognition unit 513. The voice commands respectively have specific voiceprint feature parameters, and the brain wave assist commands respectively correspond to specific frequency parameters, and different brain wave frequencies represent different brain wave assist commands, for example, the brain wave frequency is lower than 12 Hz, and is between 12 ~15Hz, and greater than 15Hz will represent different brainwave assist commands.

The voice command recognition unit 512 receives the voiceprint feature parameters that identify the voice data sent by the sound pickup device 3, and compares the analyzed voiceprint feature parameters with the voiceprint feature parameters of the voice commands to find the phase. Matching voice commands and transmitting the voice commands to the game execution module 52.

The brain wave command recognition unit 513 receives the frequency parameter of the brain wave data sent by the brain wave detecting device 4, and finds a brain wave assisting command having the corresponding frequency parameter from the command library unit 511, and the brain is The wave assist command is transmitted to the game execution module 52.

In this embodiment, the voice command recognition unit 512 and the brain wave command recognition unit 513 are established through an artificial neural network system, but may also pass through a finite state machine when implemented. The operation mode is used to identify the voice command and the brain wave assist command. However, the implementation of the voice command recognition unit 512 and the brain wave command recognition unit 513 is not limited to the above type.

The game execution module 52 is controlled to execute a video game, and determines the movement of one of the video game characters according to the voice command. At the same time, according to the brain wave assist command, the amplitude and/or speed of the action determined by the video game character is controlled. For example, when the voice command represents "forward" and the brainwave assist command represents "fast", the game execution module 52 determines that the video game character is to perform the "forward" action, and simultaneously according to the brainwave assist command. The advancement speed of the video game character is fast. In this process, the game execution module 52 changes the game content according to the action generated by the game character being manipulated, for example, changing the scene around the video game character, and the like. Since the game execution module 52 changes the game content with the manipulated video game character as a conventional technique, it will not be described in detail.

The image output device 6 includes a projection screen 61 and a projection device 62. The projection screen 61 is annular and surrounds the player, and has an annular imaging surface for projection imaging. The projection screen 61 can be a curtain or a wall. The projection device 62 is connected to the game console 5 and can image and distribute the video game content executed by the game execution module 52 to the imaging surface of the projection screen 61 to form a ring image.

The method for controlling a video game character based on the voice control and the brain wave of the present invention comprises the following steps:

Step (1) includes the player voice, and correspondingly outputs a voice data to the game host 5. After the game execution module 52 starts to execute a video game, the user can speak the voice command of the action to be performed by the video game character to be controlled by speaking, and the sounding device 3 will record the voice command and correspondingly A voice data is sent to the command matching module 51.

Step (2) detecting the brain wave signal of the player and correspondingly outputting a brain wave data to the game host 5. The player needs to change the brain wave frequency for the voice command given at the same time as the voice command is issued, and the brain wave detecting device 4 continuously detects the brain wave signal of the player and according to the measured brain wave. The signal sends a brainwave data to the command matching module 51.

Step (3) The game host 5 controls a video game character based on the received voice data and brain wave data. The command matching module 51 converts the voice data into a voice command and converts the brain wave data into a brain wave assist command. Next, the game execution module 52 determines whether a voice command is received, and determines whether the newly received voice command is the same as the previous voice command, if no voice command is received or a new voice command and a previous voice command are received. In the same way, the previous voice command is followed, and the action of the previous voice command is continuously controlled according to the brain wave assist command. If the new voice command is different from the previous voice command, the action of the video game character is changed according to the new voice command, and the new action amplitude and/or speed of the video game character is further controlled in conjunction with the received brain wave assist command. For example, the voice command is changed from "forward" to "jump", and the "jump height" is controlled according to the brain wave assist command.

Through the above game control design, when the voice control main character and the brain wave are supplemented by the video game character manipulation system of the present invention, the player can use the voice command to determine the action of the controlled video game character through the speech mode, and simultaneously pass through The way of changing the frequency of the brain wave, using the brain wave assisting command to control the amplitude and/or speed of the action character, thereby achieving the purpose of manipulating the video game character for playing, and in the process of controlling, unless the power is changed Play the action of the character, otherwise the player can continue to generate the same action by continuously controlling the brain wave frequency after releasing a voice command, without repeating the same voice command continuously and repeatedly, and the video game is performed. At the time, there is no traditional problem that it is easy to get tired by only controlling the character of the game through the brain wave. It is a brand new way of controlling video games.

In addition, the ring image output mode of the image output device 6 can be further matched to improve the game fun of the player in the game environment of the ring image, and the 3D visual effect of the game environment can be enjoyed. However, in the implementation, the image output device 6 does not need to project a circular field image, and a general planar projection imaging method can be used, and the image output device 6 does not need to output an image in a projection manner, and may be a general screen device. For example, a liquid crystal screen or the like.

In summary, through the design of the video game character control system and method supplemented by the voice control and the brain wave of the present invention, the player can further change the brain wave frequency by using the voice command to correctly manipulate the action of the video game character. The way to control the action range and / or speed of the video game character, so it is more intuitive to correctly manipulate the game action of the video game character, without the need to continue to reach the same voice command frequently, and there will be no exhaustion completely controlled by brain waves. Feeling and manipulation instability. And can further cooperate with the design of the ring image output, so that the player has the feeling of being in the game content, is a brand new video game control experience. Therefore, the object of the present invention can be achieved.

However, the above is only the preferred embodiment of the present invention, and the scope of the present invention cannot be limited thereto. The simple equivalent changes and modifications made by the patent scope and the contents of the patent specification are still within the scope of the invention.

3‧‧‧ Radios

4‧‧‧Brain wave detection device

5‧‧‧ game console

51‧‧‧Instruction Matching Module

511‧‧‧Command Library Unit

512‧‧‧Voice Command Identification Unit

513‧‧‧ Brainwave Command Identification Unit

52‧‧‧ Game Execution Module

6‧‧‧Image output device

61‧‧‧Projection screen

62‧‧‧Projection equipment

Claims (10)

A video game character control system mainly composed of voice control and brain wave is suitable for a game player to play video games through voice and brain waves, comprising: a sound collecting device, which can be used to record the voice of the player, and corresponding output one Voice data; a brain wave detecting device, which can be used to detect the brain wave signal of the player and correspondingly output a brain wave data; and a game host, comprising: an instruction matching module, wherein the signal is connected to the sound receiving device The brain wave detecting device comprises a command library unit with a plurality of voice commands and a plurality of brain wave assist commands, wherein the voice data can be analyzed and a voice data is found from the command library unit. a voice command recognition unit of the voice command, and a brain wave command recognition unit capable of analyzing the brain wave frequency of the brain wave data and finding a corresponding brain wave assist command from the command library unit, and a game execution module The signal is connected to the command matching module, and can execute a video game, and determines a video game corner of the video game according to the voice command output by the voice command recognition unit. Operation, and electroencephalogram assist command recognition unit outputs a command of the electroencephalogram, generating an amplitude control and / or speed of the video game character's action is determined. The video game character control system of the voice control main and the brain wave supplemented by the item 1 further includes an image output device for displaying the video content of the video game played by the game host, the image output device comprising a projection screen, and a projection device that can project the video game content executed by the game execution module onto the projection screen. The video game character control system as claimed in claim 2, wherein the projection screen is annular and surrounds the player, and the projection device can execute the game execution module. The executed video game content projection is distributed on the annular projection screen to form a surround image that surrounds the player. The video game character control system of the voice control system and the brain wave is supplemented by the method of claim 1, wherein the sound receiving device and the brain wave detecting device are respectively connected to the command matching module by using a wireless communication method. A video game character control method based on voice control and brain wave supplementation, which can control the action of a video game character of a game play by a game player through a player's voice and brain wave, and the video game character manipulation method includes the following Step: (A) recording the player's voice, and correspondingly outputting a voice data to the game host; (B) detecting the player's brain wave signal, and correspondingly outputting a brain wave data to the game host; and (C) The game host converts the voice data into a voice command, and determines the action of the video game character according to the voice command, and converts the brain wave data into a brain wave assist command, and the video game character is determined according to the brain wave assist command. The magnitude and/or speed of the action. The method for controlling a video game character based on the voice control and the brain wave as claimed in claim 5, wherein the game host has a built-in voice. The instruction library unit of the instruction, in step (C), the game host receives the voiceprint feature parameter for analyzing the voice data, and compares the voice from the command library unit to find a voice matching the voiceprint feature parameter of the voice data. instruction. The method for controlling a video game character based on the voice control and the brain wave as claimed in claim 6, wherein the command library unit further stores a plurality of brain wave assist commands, and the step (C) the game host receives and analyzes the brain. The frequency parameter of the wave data, and the brainwave assist command matching the frequency parameter of the brain wave data is found out from the instruction library unit. The method for controlling a video game character based on the voice control and the brain wave as claimed in claim 5, wherein the step (A) is to transmit the voice data to the game host through wireless communication. The method for controlling a video game character based on the voice control and the brain wave as claimed in claim 5, wherein the step (B) is to transmit the brain wave data to the game host through wireless communication. The method for controlling a video game character based on the voice control and the brain wave as claimed in claim 5, wherein the step (B) is to set a brain wave detecting device on the forehead of the player to detect the brain wave signal.