JP2017217425A - Game control device, game control method, and game control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve a game property of a game which can be operated by a voice.SOLUTION: A voice complexity calculation part 123 calculates a voice complexity which is an index indicating a complexity of a voice signal, from voice analysis data. The invention comprises a voice command storage part 113 for storing information in which, the voice signal, the voice complexity, and an execution command are combined. A voice command selection part 125 causes the voice signal to be input from an external part, calculates the voice analysis data by a voice analysis part 122, and compares respective piece of voice analysis data of the voice signal corresponding to the stored voice command, with voice analysis data of the input voice data, for selecting the voice command for which, the highest similarity is calculated. A voice execution command part 126 executes processing of the execution command of the selected voice command, and changes a processing content based on the voice complexity.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a game control device that can be operated by voice input, a game control method, and a game control program.

  Game software operations on game dedicated devices and mobile terminals are generally performed using game dedicated controllers and touch panels, but there are game software that can be operated by inputting sound into a microphone.

  For example, Patent Document 1 discloses a technique for improving the fun of a video game and the enjoyment of operating a character by enabling the player character to be operated not only by a controller but also by voice. According to the literature, you can give instructions to switch the player character's weapon to a flamethrower by saying "It's a flamethrower!" The fear parameter can be lowered.

JP 2002-248261 A

  However, in the prior art, only the voice and the command are associated, and the difficulty of inputting the voice itself has not been considered. In other words, since the nature of the voice itself does not affect the effect of the associated command, it is more advantageous for the progress of the game to input a short and simple voice than a long and complicated voice. End up.

  Therefore, the present invention has been made in view of the above, and replaces a voice input by a user with a command and can be operated by voice by changing a command to be executed according to the complexity of the voice. It aims at improving the game nature of a game.

  In order to solve the above-described problems, a game control device according to the present invention is a voice analysis unit that calculates voice analysis data that is data obtained by quantifying the acoustic characteristics of a voice signal, and an index that indicates the complexity of the voice signal. A voice command that combines a voice complexity calculation unit that calculates voice complexity from the voice analysis data, a voice signal, a voice complexity of the voice signal, and an execution command indicating an execution process corresponding to the voice signal. A voice command storage unit that stores the first voice signal input from the outside, the voice analysis unit analyzes the voice command data stored in the voice command storage unit By comparing each voice analysis data of the corresponding voice signal with the voice analysis data of the first voice data, the voice code having the highest similarity is calculated. A voice command selection unit for selecting a command and a voice command for executing a command for executing the selected voice command and changing a processing content of the execution command based on a voice complexity of the selected voice command A command execution unit.

  The game control method according to the present invention includes a step of calculating speech analysis data that is data obtained by quantifying the acoustic characteristics of a speech signal, and speech complexity that is an index indicating the complexity of the speech signal. A step of calculating from data, a step of storing a voice command combining a voice signal, a voice complexity of the voice signal, and an execution command indicating an execution process corresponding to the voice signal; and voice inputted from outside The signal is a first voice signal, and voice analysis data of the first voice signal is acquired, each of the voice analysis data of the voice signal corresponding to the stored voice command, and the first voice data The step of selecting the voice command having the highest similarity calculated by comparing with the voice analysis data, and the execution of the selected voice command And executes the command processing, based on the sound complexity of the selected voice commands, and a step of changing the processing content of the execution command.

  In addition, the game control program according to the present invention includes a step of calculating speech analysis data that is data obtained by quantifying the acoustic characteristics of a speech signal, and a speech complexity that is an index indicating the complexity of the speech signal. A step of calculating from data, a step of storing a voice command combining a voice signal, a voice complexity of the voice signal, and an execution command indicating an execution process corresponding to the voice signal; and voice inputted from outside The signal is a first voice signal, and voice analysis data of the first voice signal is acquired, each of the voice analysis data of the voice signal corresponding to the stored voice command, and the first voice data Selecting the voice command having the highest similarity calculated by comparing the voice analysis data; and the selected voice command. And it executes the process of executing the command, based on the audio complexity of the selected voice commands, and a step of changing the processing content of the execution command to the computer.

  The game control device of the present invention can provide a game with higher game performance because the complexity of the audio signal directly affects the operation and effect of the game.

FIG. 1 is a block diagram illustrating a configuration example of the game control apparatus according to the first embodiment. FIG. 2 is a diagram illustrating an example of a format stored in the voice analysis data storage unit according to the first embodiment. FIG. 3 is a diagram illustrating an example of a format stored in the voice command storage unit according to the first embodiment. FIG. 4 is a flowchart illustrating an example of a processing flow of the speech analysis unit according to the first embodiment. FIG. 5 is a diagram illustrating an example of an amplitude spectrum obtained by analyzing voice data according to the first embodiment. FIG. 6 is a diagram illustrating an example of a UI presented by the voice command creation unit according to the first embodiment. FIG. 7 is a flowchart illustrating an example of a flow of processing in which the voice command creation unit according to the first embodiment registers the player's voice. FIG. 8 is a flowchart illustrating the processing flow of the voice command selection unit according to the first embodiment. FIG. 9 is a diagram illustrating an example of a game screen according to the first embodiment. FIG. 10 is a diagram illustrating an example in which the voice command execution unit according to the first embodiment executes a command. FIG. 11 is a diagram illustrating an example in which the voice command execution unit according to the first embodiment changes the effect of the command according to the voice complexity.

  The configuration of the comment creation / display apparatus according to Embodiment 1 will be described with reference to FIG. FIG. 1 is a functional block diagram illustrating a configuration example of the game control device according to the first embodiment.

  As shown in FIG. 1, the game control device 100 includes an input unit 101, a display unit 102, a microphone 103, a storage unit 110, and a control unit 120.

  The input unit 101 includes a keyboard, a mouse, a touch panel, and the like, and inputs various information in the game control apparatus 100 by a user operation. The display unit 102 includes a monitor (or a display, a touch panel, etc.) and a speaker as a display device, and outputs various information in the game control device 100. The microphone 103 is installed to acquire the player's voice.

  The storage unit 110 is a storage device such as a RAM (Random Access Memory), a hard disk, an optical disk, or a flash memory, and stores data required for various processes by the control unit 120 and various processing results by the control unit 120. To do.

  The storage unit 110 includes a voice data storage unit 111, a voice analysis data storage unit 112, and a voice command storage unit 113.

  The audio data storage unit 111 stores audio data, which is digital data of an audio signal, and an audio data ID for uniquely identifying the audio data.

The voice analysis data storage unit 112 performs an acoustic analysis on the voice data, and stores voice analysis data that is a result of the acoustic analysis. Specifically, the voice analysis data storage unit 112 stores a voice data ID and voice analysis data corresponding to the voice data ID. As voice analysis data, the time series data of the amplitude spectrum for each frequency band and the start position and end position of a voiced section that is a section in which voice is continuously detected are stored.

FIG. 2 shows an example of the format of the voice analysis data storage unit 112. 2A stores the time-series data of the amplitude spectrum for each frequency band, and FIG. 2B stores the start position and end position of the sound section. (A) of FIG. 2 has memorize | stored audio | voice data ID and the power spectrum of the frequency band 1-500 for every time series. Note that the sampling frequency of the audio data in FIG. 2A is 44100 Hz, and the FFT frame size stores the results calculated with 2048 samples. That is, the time resolution is about 46.4 ms, and the frequency resolution is about 21.5 Hz. FIG. 2B stores a voice data ID, a section number, and a start position and an end position of the section number as a time series number. Two voiced sections are stored in the voice data ID1, section number 1 is from time series number 1 to time series number 5, and section number 2 is from time series number 7 to time series number 10. Show.

  The voice command storage unit 113 stores an execution command corresponding to the voice data. Specifically, the voice command storage unit 113 stores a combination of a voice data ID, a voice complexity indicating the complexity of the voice data, and an execution command ID that is an identifier of the execution command. This combination is called a voice command.

  The execution command is a command that is actually executed as an operation in the game, such as “invoking recovery magic” or “invoking weapon special move A”. The voice complexity will be described later.

  FIG. 3 shows an example of the format of the voice command storage unit 113. In the example of the format in FIG. 3, a voice command ID that is an identifier for uniquely identifying a voice command, a voice data ID, an execution command ID, and a voice complexity are stored. The voice data ID of the voice command whose voice command ID is voice command ID1 is stored as “voice data 1”, the execution command ID is “flame magic”, and the voice complexity is 100.

  In the present embodiment, the storage unit 110 has been described as being included in the game control device 100, but a part or all of the storage unit 110 may be disposed in an external device connected via a network.

  The control unit 120 is a unit that executes a program that defines a control program, a control program, various processing procedures, and the like. Therefore, it has an internal memory necessary for executing these programs, and is composed of electronic components such as ASIC (Application Specific Integrated Circuit) and SoC (System on a chip). The control unit 120 further includes an audio signal conversion unit 121, an audio analysis unit 122, an audio complexity calculation unit 123, an audio command creation unit 124, an audio command selection unit 125, and an audio command execution unit 126. included.

  The audio signal conversion unit 121 is a unit that quantizes the analog audio signal input from the microphone 103 into a digital signal and converts it into audio data. The converted digital data is stored in the audio data storage unit 111 by assigning an audio data ID which is an identifier uniquely indicating the audio data.

  The voice analysis unit 122 analyzes the signal of the voice data created by the voice signal conversion unit 121 and creates voice analysis data. The processing flow of the voice analysis unit 122 will be described with reference to the flowchart of FIG.

  First, the voice analysis unit 122 reads the voice data body from the voice data storage unit 111 from the voice data ID passed from the outside (step S100).

  Next, the voice analysis unit 122 performs fast Fourier transform on the read voice data to calculate time frequency data (step S110).

  Next, the voice analysis unit 122 calculates an amplitude spectrum for the calculated frequency component (step S120).

  Next, the voice analysis unit 122 cuts out a section in which a predetermined or higher amplitude spectrum is continued in a predetermined frequency band, that is, a voiced section in which a sound of a certain level or more is detected (step S130).

  FIG. 5 is an example of a graph in which the horizontal axis represents time and the vertical axis represents the average of amplitude spectra in a predetermined frequency band. The threshold value 1100 indicates a threshold value of an amplitude spectrum that is regarded as a level at which sound is present. In FIG. 5, three sound sections 1000, sound sections 1010, and sound sections 1020 are cut out by the voice analysis unit 122. An amplitude spectrum is also present between the voiced section 1010 and the voiced section 1020, but is below the threshold 1100, so that the speech analysis unit 122 includes the voiced section 1010 and the voiced section 1020. Separately detect the voiced section.

  Next, the voice analysis unit 122 stores the voice analysis data in the voice analysis data storage unit 112 (step S140).

The above is the description of the voice analysis unit 122.

  The voice complexity calculator 123 calculates the voice complexity from the created voice analysis data.

  The speech complexity is a numerical index that represents the complexity of the input speech as an acoustic signal. The larger the speech complexity, the more complex the speech is. The speech complexity is calculated using parameters such as the length of speech input (sound interval length) and the number of sound segments. The voiced section length is obtained by obtaining all the lengths of the voiced sections corresponding to the voice data ID from the voice analysis data storage unit 112 and obtaining the sum. As the number of voiced sections, the number of voiced sections corresponding to the voice data ID stored in the voice analysis data storage unit 112 is obtained.

  The speech complexity is calculated by a sound interval length and a monotonically increasing function of the number of sound intervals. For example, the voice complexity C is calculated by the following formula 1, where the length of the voiced section is L (seconds) and the number of voiced sections is N.

  In Equation 1, a and b are arbitrary coefficients.

  The calculation of the voice complexity of the music complexity calculator 123 can of course use other parameters in addition to the length and the number of voiced sections. For example, the number of times a consonant appears may be counted, and the greater the number, the greater the voice complexity.

  Conversely, monotonous speech such as “Ah” may be detected, and a penalty term may be provided to reduce speech complexity. In a specific processing example, if the amplitude spectrum of the frequency band corresponding to the voiced sound is equal to or greater than a predetermined value and the condition appears continuously in the same frequency band for a predetermined time or longer, the predetermined time is expressed as Tθ. The speech complexity is calculated as shown in Equation 2, where T is a continuously detected time.

  In addition, in the case where the increase rate of the calculated speech complexity C is increased as the voiced section is longer, a predetermined index may be given to the voiced section length L and the number of voiced sections N in Equation 1. good. For example, in the following Equation 3, since the voiced section length L is raised to the power of 1.05, the larger the voiced section length L is, the larger the speed of increasing the voice complexity C is. .

  The voice command creation unit 124 presents a UI for creating a voice command to the user, and stores the created voice command in the voice command storage unit 113. In order to create a voice command, a voice is recorded and a UI for registering an execution command ID executed by the voice is presented. An example of a UI for creating a voice command is shown in FIG.

  The execution command list 1200 of FIG. 6 displays a list of selectable execution commands. The user can select an execution command via the input unit 101. The execution command being selected is indicated by a check mark. In FIG. 6, “ice magic” is selected.

  The recording button 1210 is a button for starting recording of voice. When the record button 1210 is pressed, the voice command creation unit 124 starts accepting voice input from the player. The processing flow of the voice command creation unit 124 when the recording button 1210 is pressed will be described with reference to the flowchart of FIG.

  First, the voice command creation unit 124 receives a player's voice input via the microphone 103 (step S200).

  Next, the voice command creation unit 124 passes the input voice to the voice signal conversion unit 121, and converts the voice signal into digital voice data (step S210).

  Next, the voice command creation unit 124 passes the voice data to the voice analysis unit 122 to calculate the voice analysis data (step S220).

  Next, the voice command creation unit 124 causes the voice complexity calculation unit 123 to calculate the voice complexity from the voice analysis data (step S230).

  The above is the processing of the voice command creation unit 124 when the recording button 1210 is pressed.

  Returning to the explanation of FIG. 6, the save button 1220 is a button for storing a voice command. When the save button 1220 is pressed, the voice command creation unit 124 combines the execution command ID of the selected execution command, the voice data ID of the recorded voice, and the calculated voice complexity, Store in the command storage unit 113. The cancel button 1230 is a button for exiting the voice command creation screen without saving the voice command.

The above is the description of the voice command creation unit 124.

  The voice command selection unit 125 compares the input voice with the voice data of the voice command stored in the voice command storage unit 113, and selects the closest voice command. A specific processing flow of the voice command selection unit 125 will be described based on the flowchart of FIG.

  First, the voice command selection unit 125 receives voice input from the microphone 103 (step S300).

  Next, the voice command selection unit 125 passes the input voice signal to the voice signal conversion unit 121 and converts it into voice data (step S310).

  Next, the voice command selection unit 125 passes the voice data acquired in step SXXX to the voice analysis unit 122, and acquires voice analysis data (step S320).

  Next, the voice command selection unit 125 reads all the created voice commands from the voice command storage unit 113, the voice analysis data corresponding to the voice data ID of each voice command, and the voice analysis data calculated in step S320. Is calculated (step S330).

  The similarity is calculated by comparing the amplitude spectra and calculating the error. The amplitude spectrum of the speech analysis data is an N × T matrix of N frequency bands and time T. The frequency band is the same for all voice analysis data, but the time T differs depending on the recording time. Therefore, in order to obtain the error between the two data, the time direction is corrected using the dynamic time expansion / contraction method.

  The dynamic time expansion / contraction method is a method used for comparing two data having different time series lengths. Specifically, two data are set as data A and data B, time series data ta (α) (0 ≦ α ≦ A) of data A, and time series data tb (β) (0 ≦ β of data B). ≦ B, A ≦ B), the time series data ta (0) and the time series data tb (β) are first compared to select tb (β0) that minimizes the Euclidean distance. To do. The range that β0 can take is 0 ≦ β0 ≦ (B−A).

  Next, the time series data ta (1) and the time series data tb (β) are compared again to select tb (β1) that minimizes the Euclidean distance. The possible range of β1 is β0 <β1 ≦ (B−β0) − (A-1). When the range that β can take is generalized, in the case of time-series data ta (m), the following equation 4 is obtained.

  The above comparison calculation is performed up to ta (A), and the total E of the obtained distances is calculated. From the total distance E obtained, the similarity S can be calculated by the following equation (5).

  Next, the voice command selection unit 125 selects the voice command having the highest similarity calculated from the similarities calculated in step S330 (step S340).

  Next, it is determined whether or not the similarity of the voice command selected in step S340 is greater than or equal to a predetermined threshold (step S350). If it falls below the threshold, it is determined that the voice command is not applicable, and the process is terminated. If it is equal to or greater than the threshold, the process proceeds to step S360.

  If the similarity of the selected voice command is greater than or equal to a predetermined threshold (YES in step S350), the voice command selection unit 125 finally selects that the voice command has been input (step S360).

  The voice command execution unit 126 executes the voice command selected by the voice command selection unit 125 as an actual process.

  For example, when the selected voice command is the voice command 1 shown in FIG. 3, the voice command type is “flame magic”. In this case, the “flame magic” process associated with the voice command type is performed. Further, at this time, the degree of the effect of the voice command is changed according to the complexity of the voice command. For example, in the “fire magic” example, changes such as changing the appearance or increasing the power are added according to the complexity.

  The operations of the voice command selection unit 125 and the voice command execution unit 126 will be described with reference to the example of the game screen in FIG. In FIG. 9, a player character 1300, a microphone button 1310, and an enemy 1320 are arranged on the display unit 102. The purpose of the game is to perform voice input, activate magic that is a voice command, and defeat enemy 1320.

  When microphone button 1310 is pressed, voice command selection unit 125 accepts voice input and selects a voice command according to the input voice. The voice command execution unit 126 executes predetermined processing according to the selected voice command.

  FIG. 10 shows a state where the voice command selection unit 125 selects the voice command type “flame magic” and activates “flame magic”. That is, the voice command execution unit 126 performs a process of moving the fireball 1330 that is the result of the “fire magic” activation from the player character 1300 toward the enemy 1320.

  FIG. 11 shows an example in which the voice command type “flame magic” is the same as that in FIG. 10, but the voice complexity of the selected voice command is higher. In FIG. 11, the fireball 1340 is larger than the fireball 1330 shown in FIG. That is, since the voice complexity is high, a more flashy effect is displayed.

  The above is the description of the game control device 100.

  All or part of the game control device in the present embodiment is installed inside a computer constituted by a storage device such as a CPU (Central Processing Unit), a RAM (Read Access Memory), and an HDD (Hard Disk Drive). It may be implemented as a computer program.

  In addition, although the content of the command executed by the voice command execution unit 126 is changed according to the voice complexity of the selected voice command, the power calculated by the voice command selection unit 125 is also used, You may make it change appearance.

DESCRIPTION OF SYMBOLS 100 Game control apparatus 101 Input part 102 Display part 103 Microphone 110 Storage part 111 Voice data storage part 112 Voice analysis data storage part 113 Voice command storage part 120 Control part 121 Voice signal conversion part 122 Voice analysis part 123 Voice complexity calculation part 124 Voice command creation unit 125 Voice command selection unit 126 Voice command execution unit 1000-1020 Voiced section 1100 Threshold 1200 Execution command list 1210 Record button 1220 Save button 1230 Cancel button 1300 Player character 1310 Microphone button 1320 Enemy 1330, 1340 Fireball

Claims (5)

A speech analysis unit that calculates speech analysis data that is data of acoustic characteristics of the speech signal, a speech complexity calculation unit that calculates speech complexity that is an index indicating the complexity of the speech signal from the speech analysis data, and speech A voice command storage unit that stores a voice command that combines a signal, a voice complexity of the voice signal, and an execution command that indicates an execution process corresponding to the voice signal; The voice analysis data of the first voice signal is acquired as a voice signal, and each of the voice analysis data of the voice signal corresponding to the stored voice command and the voice analysis data of the first voice data are obtained. By comparing, the voice command selection unit that selects the voice command for which the highest similarity is calculated and the processing of the execution command of the selected voice command are executed. While, on the basis of the audio complexity of the selected voice command, the game control device, characterized in that it comprises a voice command execution section for changing the processing content of the execution command.
A speech complexity that is an index indicating the complexity of the speech signal is calculated from the speech analysis data, and a monotonous repetitive pattern is detected from the speech analysis data to reduce the calculated speech complexity. The game control device according to claim 1, further comprising a calculation unit.
The voice command execution unit executes a process of an execution command of the selected voice command, and changes a processing content of the execution command based on a voice complexity of the selected voice command and the similarity. The game control apparatus according to claim 1, wherein the game control apparatus is a game control apparatus.
Calculating voice analysis data which is data of acoustic characteristics of the voice signal; calculating voice complexity which is an index indicating complexity of the voice signal from the voice analysis data; the voice signal; and the voice signal. A step of storing a voice command combining an execution command indicating an execution process corresponding to the voice signal, a voice signal input from the outside as a first voice signal, and the first voice By obtaining the voice analysis data of the signal and comparing each of the voice analysis data of the voice signal corresponding to the stored voice command with the voice analysis data of the first voice data, the highest similarity Selecting the calculated voice command, processing the selected voice command execution command, and executing the selected sound command. Based on the audio complexity of command, game control method characterized by including the step of changing the processing content of the execution command.
  Calculating voice analysis data which is data of acoustic characteristics of the voice signal; calculating voice complexity which is an index indicating complexity of the voice signal from the voice analysis data; the voice signal; and the voice signal. A step of storing a voice command combining an execution command indicating an execution process corresponding to the voice signal, a voice signal input from the outside as a first voice signal, and the first voice By obtaining the voice analysis data of the signal and comparing each of the voice analysis data of the voice signal corresponding to the stored voice command with the voice analysis data of the first voice data, the highest similarity Selecting the calculated voice command, processing the selected voice command execution command, and executing the selected sound command. Based on the audio complexity of command, game control program for executing the steps on a computer to change the processing content of the execution command.

Images