JP2009125077A - Mobile terminal and game program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To diversify game contents by executing the game requiring not only voice input but also the operation of moving a terminal itself thereby changing required operations during a game. <P>SOLUTION: A cellular phone 1 includes: a sentence presentation part 31 for presenting the sentence of voice to be input; a voice input part 32 for inputting the voice; a voice recognition part 33 for recognizing the matching rate of the input voice and the presented sentence; a posture change determination part 35 for determinating whether or not a posture change detected by a sensor 20 is pertinent to the posture change corresponding to the sentence presented by the sentence presentation part 31; and a display switching part 36 for displaying an image corresponding to the matching rate obtained by the voice recognition part 33 and a determination result for the posture change by the posture change determination part 35. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a portable terminal such as a mobile phone and a portable game machine, and a game program executed on the terminal.

  In recent years, an increasing number of users run games on mobile phones. The game program executed on the mobile phone can be downloaded from a site providing the game, for example, connected to a network, or read through a removable recording medium. Various portable game machines (portable game machines) are also widely used.

By the way, conventionally, a game that is executed by inputting sound by a player has been considered (see Patent Document 1). For example, in the voice game machine described in Patent Document 1, processing is performed according to input voice, and the output is changed so that the user can easily instruct the computer to perform various processes by voice.
Japanese Patent No. 3179626

  In the voice game machine described in Patent Document 1, the display can be changed according to the combination of the pressed key and the voice recognition result. However, the voice game machine of Patent Document 1 only allows various inputs by changing a combination of a predetermined key and input voice, and the operation itself is always the same. For this reason, there was a situation in which changes during the game were scarce and the player was easily bored with the game.

  The present invention has been made in view of the above-described circumstances, and its purpose is to change the necessary operation during the game by executing a game that requires not only voice input but also an operation of moving the terminal itself. An object of the present invention is to provide a portable terminal and a game program capable of diversifying game contents by providing a game.

  The present invention provides sentence presentation means for presenting a voice sentence to be input, voice input means for inputting voice, and a match rate between the voice input by the voice input means and the sentence presented by the sentence presentation means A speech recognition means for recognizing a posture, a sensor means for detecting a posture change, and a posture change for determining whether the posture change detected by the sensor means corresponds to a posture change corresponding to a sentence presented by the sentence presentation means. And a display switching unit that displays a screen according to a matching rate recognized by the voice recognition unit and a determination result for the posture change by the posture change determination unit.

  According to the present invention, the game is progressed not only by voice input but also by moving the terminal itself corresponding to the voice input, so that the game contents can be diversified by changing necessary operations during the game. It becomes possible to do.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a functional configuration of a mobile phone 1 (mobile terminal) in the present embodiment. As shown in FIG. 1, a mobile phone 1 communicates with a mobile terminal 3 such as another mobile phone or a personal digital assistant (PDA) via a network 2 including a telephone network and the Internet (voice call and data communication). ), Or communication with the server 4 that provides various contents. It is assumed that the server 4 provides a service for downloading an application program including a game program that can be executed on the mobile phone 1.

  The mobile phone 1 in the present embodiment is provided with a sensor 20 that can detect a change in posture, and the posture change detected by the sensor 20 can be used in a game. For example, by executing a game program, the mobile phone 1 presents a sentence (serif) prepared for each stage, inputs a voice corresponding to the sentence, and performs a predetermined terminal operation related to the sentence It is possible to execute a game that is progressed by performing (an operation for changing the posture of the mobile phone 1) (details will be described later).

  As shown in FIG. 1, the mobile phone 1 includes a control unit 10, a display unit 11, an input unit 12, a sound unit 13, a camera unit 14, a communication unit 15, a ROM 16, a RAM 17, a memory device attaching / detaching unit 18, and a memory device attaching / detaching. A memory device 19 attached to the unit 18 and a sensor 20 are provided.

  The control unit 10 controls the entire mobile phone 1 and realizes various functions by executing programs stored in the ROM 16 and the RAM 17 by the CPU. Functions realized by the control unit 10 include a telephone function unit 10a, a Web function unit 10b (download unit 10c), and a game function unit 10c.

  The telephone function unit 10a controls communication for a voice call.

  The Web function unit 10b performs control for accessing a Web page through the network 2 (Internet). The Web function unit 10b can download a game program or the like by the download unit 10c through, for example, a Web page published by the server 4.

  The game function unit 10 c is realized by executing the game program 17 a stored in the RAM 17. The game function unit 10c includes various functions realized by executing the game program 17a and various data used in the game. The functions included in the game function unit 10c include a text presentation unit 31, a voice input unit 32, a voice recognition unit 33, a sensor unit 34, a posture change determination unit 35, a display switching unit 36, and a score calculation unit 37. The data used in the game includes game control data 38 and game screen data 39.

  The sentence presentation unit 31 presents a sentence (line) representing the voice to be input by the player, and the sentence is displayed on the game screen based on each line data of a plurality of stages set in the game control data 38. Is displayed.

  The voice input unit 32 inputs the voice uttered by the player with respect to the sentence (serif) presented by the sentence presentation unit 31 through the microphone of the sound unit 13. The voice input unit 32 displays, for example, a screen for notifying the player of the timing for starting voice input in order to specify the voice to be voice-recognized. It is possible to input a voice for a predetermined time after input or an operation on a predetermined key provided in the input unit 12.

  The voice recognition unit 33 recognizes the matching rate between the voice input by the voice input unit 32 and the text presented by the text presentation unit 31. In the present embodiment, voice recognition is not performed on the entire voice input by the voice input unit 32, but a part of the sentence presented by the sentence presentation unit 31, for example, only some words are registered in advance. Collation with the recognition dictionary data and the matching rate at the time of the collation is obtained. In this way, for example, the processing load is reduced by executing the speech recognition process for only some words. As a result, the game (game program 17a) can be executed even with the mobile phone 1 having a relatively low processing capability.

  If the processing capability of the cellular phone 1 is sufficiently high, the voice recognition unit 33 compares the entire voice input by the player with the voice input unit 32 with a preset voice recognition dictionary. It is also possible to recognize and obtain the coincidence rate.

  The sensor unit 34 inputs a notification indicating the posture of the mobile phone 1 detected by the sensor 20.

  The posture change determination unit 35 determines whether the posture change detected by the sensor 20 corresponds to the posture change corresponding to the text presented by the text presentation unit 31 based on the notification input by the sensor unit 34, that is, the player Determines whether the preset terminal operation has been performed correctly. The game control data 38 is set with terminal operation data indicating how the player should move, that is, how to move the mobile phone 1 in association with the sentence (serif data) determined for each stage. The posture change determination unit 35 makes a determination by comparing the terminal operation data with the posture change determined by the notification from the sensor 20. Further, the posture change determination unit 35 can further determine the posture change based on the posture change timing detected by the sensor 20. For example, when the mobile phone 1 is set to swing at a predetermined timing in accordance with music as the terminal operation set in the game control data 38, it is determined whether or not it matches the set timing. By setting the timing for operating the terminal, it is possible to provide a game that gives a tension to the player and requests a quicker reaction.

  The display switching unit 36 causes the display unit 11 to display a game screen corresponding to the progress of the game based on the game screen data 39. The display switching unit 36 displays a game screen corresponding to the match rate recognized by the voice recognition unit 33 and the determination result for the posture change by the posture change determination unit 35 every time the stage is finished.

  The score calculation unit 37 calculates a score based on the coincidence rate recognized by the voice recognition unit 33 and the determination result determined by the posture change determination unit 35. For example, the score calculation unit 37 adds or subtracts the scores determined in each of the plurality of stages, and obtains a final score as a game result after the game ends.

  The game control data 38 is data used in a game executed by the game function unit 10c. For example, various data are set for each of a plurality of stages set in the game. In the game control data 38, for example, for each stage, serif data about a sentence (serif) presented by the sentence presenting unit 31 and posture change (terminal operation data) determined by the posture change determining unit 35 corresponding to the sentence. Are set in association with each other. By making the terminal operation data associated with this line data different for each stage, it is possible to diversify the game contents and prevent the player from getting bored. Details of the game control data 38 will be described later (see FIG. 2).

  The game screen data 39 is game screen data displayed as the game progresses. The game screen data 39 includes game screen data for each stage according to the matching rate recognized by the voice recognition unit 33 and the determination result determined by the posture change determination unit 35. A specific example of the game screen will be described later.

  The display unit 11 displays a screen associated with the execution of the control unit 10 on the display. The display unit 11 displays a game screen in accordance with the progress of the game as the game function unit 10c executes the game.

  The input unit 12 receives an input operation from the user, and is provided with a plurality of keys. In addition to numeric keys, call keys, disconnect keys, etc. for executing functions as a telephone, a plurality of keys include cursor keys for instructing up / down / left / right directions, and decisions for instructing execution of selection. Keys and function keys corresponding to various functions are included. When the game function unit 10c is executed, a key for inputting an instruction corresponding to the game situation is assigned to any of the plurality of keys provided in the input unit 12.

  The sound unit 13 outputs / inputs sound under the control of the control unit 10, and includes a microphone for inputting sound and a speaker for outputting sound. The sound unit 13 can input sound from the player through the microphone when the game function unit 10c is executed. In addition, the sound unit 13 can output an operation sound according to an operation of the input unit 12, a sound due to reproduction of music data (BGM data), a message sound when the game function unit 10 c is executed, or the like.

  The camera unit 14 captures a still image or a moving image in accordance with a user operation under the control of the control unit 10.

  The communication unit 15 controls communication with the mobile terminal 3 and the server 4 through the network 2 including a mobile phone network and the Internet under the control of the control unit 10.

  The ROM 16 stores programs and data for controlling basic functions (such as voice calls) preinstalled in the mobile phone 1.

  The RAM 17 stores programs and various data downloaded by the communication unit 15 or programs and data read from the memory device 19 through the memory device attaching / detaching unit 18. In the present embodiment, a game program 17a for executing a game using voice input and a posture change of the mobile phone 1 is stored.

  The memory device attaching / detaching unit 18 is a unit for attaching / detaching a memory device 19 such as a portable type (for example, an SD (Secure Digital) card), and mediates reading / writing of data with respect to the memory device 19 by the control unit 10. The memory device 19 is used, for example, when reading a game program or data (image data or the like) recorded by a personal computer (PC) 5 or another mobile phone.

  The sensor 20 is for detecting that the posture of the mobile phone 1 has changed, and is configured by, for example, an acceleration sensor, an angular velocity sensor, a magnetic sensor, or the like. The sensor 20 may detect not only a change in posture in one direction but also a change in posture in a plurality of directions (for example, three axis directions). When the sensor 20 capable of detecting a change in posture in a plurality of directions is provided, in a game realized by the game program 17a, a terminal operation to be operated by the player depending on the stage, that is, a direction in which the posture of the mobile phone 1 is changed. By changing it, the contents of the game can be diversified.

  In the present embodiment, the mobile phone 1 will be described as an example. However, the mobile phone 1 can be realized by other mobile terminals such as a portable game machine and a PDA (personal digital assistant).

FIG. 2 is a diagram illustrating an example of data set in the game control data 38.
In the game process executed by the mobile phone 1 of the present embodiment, for example, a player becomes a station clerk, and a simulation is performed to guide passengers getting on and off at home. In a series of operations from when the train enters the platform to when the passenger gets on the train and departs, the player voices the announcement, and the station staff performs actions (pointing confirmation, pushing the passenger into the train, (E.g., ringing a departure bell) by a terminal operation to advance the game. In the game control data 38, a series of operations are divided into a plurality of stages, and data relating to announcements (serial data) and actions (terminal operation data) performed in each stage are set.

  As shown in FIG. 2, in the game control data 38, various data are set in association with each stage. Data set in the game control data 38 includes speech data, voice recognition data, terminal operation data, game screen data, and score data.

  For example, for stage 1 shown in FIG. 2, “Line 1 train is coming” is set as the speech data. In stage 1, the sentence presentation unit 31 displays the line “Line 1 train is coming” indicated by the line data on the game screen. In addition, regarding the voice input by the player to the speech displayed by the text presentation unit 31, “1st line” which is a part of the speech is targeted for speech recognition, and speech recognition for this word “1st line” is performed. Data is set.

  In the game control data 38, terminal operation data is set in association with the speech data. The terminal operation data is data indicating how the player should move the hand holding the mobile phone 1. The posture change determination unit 35 can compare the posture change of the mobile phone 1 detected by the sensor 20 with the terminal operation data to determine whether a preset terminal operation has been executed. It is assumed that a plurality of terminal operation data can be set for one line data. The game control data 38 shown in FIG. 2 indicates that two terminal operation data 1 and 2 can be set. Further, three or more terminal operation data may be set. By setting a plurality of terminal operation data, it is possible to request the player to perform different terminal operations depending on the stage. Note that terminal operation data may not be set in association with the speech data for all stages. That is, depending on the stage, the terminal operation can be made unnecessary only by voice input.

  Further, the game control data 38 includes game screens for displaying various game screens such as a screen for displaying speech data, a screen displayed as a result of voice input, and a screen for causing a player to operate the terminal. Data is available. Further, the game control data 38 is set with a score to be added at each stage according to the matching rate obtained by voice recognition and the result of the terminal operation. For example, the coincidence rate determined by voice recognition (indicated here by an integer value) is divided into a plurality of numbers such as “80 to 100”, “50 to 79”, and “0 to 49”. It is assumed that a score to be added in the same stage is set corresponding to each combination of the case where is correctly performed (OK) and the case where it is not correctly performed (NG).

  FIG. 3 shows an example of a message on the game screen set in the game control data 38. FIG. 3 shows only messages corresponding to the matching rate (classification) for the speech recognition result. The stage for which the terminal operation data is set indicates a message when the terminal operation is correctly performed (OK), and is separately set for the message when the terminal operation is not correctly performed (NG). Shall.

  For example, in stage 1, when the speech recognition is performed on the voice input to the “Line 1 train is coming” line displayed by the text presentation unit 31, the matching rate is “80 to 100”. Indicates that a game screen including the message “Line 1, train is coming” is displayed. Similarly, when the match rate is “50 to 79”, “Line 1 and the train will go around”, and when the match rate is “0 to 49”, “10,000 yen will be included in cash”. The game screen including the message is displayed.

  In FIG. 3, all stages are classified by the same match rate “80 to 100”, “50 to 79”, and “0 to 49”, but the match rate is high depending on the speech to be input. The range of the division may be changed for each stage because it may be likely to be low or may be low.

  In the game processing of the present embodiment, as shown in FIG. 3, instead of displaying a character string obtained by speech recognition for input speech, a message prepared in advance is displayed even when the matching rate is low. By doing so, it is possible to provide a message for entertaining a player similar to the correct line.

FIG. 4 shows an example of the terminal operation of the player with respect to the mobile phone 1.
The mobile phone 1 shown in FIG. 4 is configured in a foldable type, and is used in an open state so that the display can be visually recognized and voice input can be performed when the game is executed.

  For example, when execution of the terminal operation is instructed during the game, for example, when an operation message “shake the terminal” is displayed on the game screen, the player moves the mobile phone 1 as shown in FIG. With the hand held, the sensor 20 is shaken in a direction in which a change in posture can be detected by a predetermined sensor 20. When the mobile phone 1 can be shaken so as to match the terminal operation data set in the game control data 38 (it should be within a predetermined allowable range), the terminal operation (posture change) ) Is determined to have been performed correctly.

  The terminal operation with respect to the mobile phone 1 is not limited to the way of swinging shown in FIG. 4 and can be set in various ways according to the number of axes that the sensor 20 can detect a change in posture. You can avoid it.

Next, game processing executed in the mobile phone 1 according to the present embodiment will be described with reference to the flowchart shown in FIG. 6-10 is a figure which shows an example of the game screen in each tee displayed during a game process.
First, the control unit 10 activates the game function unit 10c by executing the game program 17a. The game function unit 10c makes the various functions 31 to 37 executable by the game program 17a and starts the game process.

  The text presentation unit 31 causes the display unit 11 to display a speech to be input by the player based on the stage 1 speech data set in the game control data 38 (step A1). FIG. 6A1 shows an example of a game screen on which a speech to be input by voice is presented on the game screen. In FIG. 6 (a1), the line “The first train is coming” is presented.

  Here, the game function unit 10c causes the display unit 11 to display a screen for notifying the player of the timing for voice input. For example, the countdown displays “3”, “2”, “1”, and “GO” until the timing of starting the voice input are switched and displayed at regular intervals (for example, 1 second).

  After “GO” is displayed on the display, the player inputs the speech of the dialogue presented on the game screen. The voice input unit 32 inputs the voice through the sound unit 13 for a predetermined time after “GO” indicating the voice input start timing is displayed (step A2). Note that the remaining time during which voice input is possible may be displayed on the screen with a gauge to notify the player. Further, instead of displaying a screen for notifying the timing to start voice input, the player may press a predetermined key and input the voice for a predetermined time after the key is pressed.

  The voice recognition unit 33 performs voice recognition on the input voice based on the stage 1 voice recognition data set in the game control data 38. The voice recognition unit 33 does not perform voice recognition on the entire input voice, but checks voice recognition data “No. 1 line” which is a part of the line set in the stage 1. That is, the voice recognition unit 33 extracts a portion corresponding to “No. 1 line” from the input voice, and recognizes the matching rate with the voice recognition data (step A3).

  Then, the display switching unit 36 displays a game screen including words (messages) corresponding to the match rate. That is, as shown in FIG. 3, the display switching unit 36 displays a game screen including a message set for each match rate category in the game control data 38. For example, when the matching rate is within the range of “80 to 100”, a game screen including a message indicating a correct answer of “No. 1 train is coming” is displayed as shown in FIG. If the match rate is in the range of “0 to 49”, a game screen including a message indicating an incorrect answer of “10,000 yen cash included” is displayed as shown in FIG.

  Here, it is determined whether or not terminal operation data is set in the game control data 38. As for stage 1, since the terminal operation data is not set as shown in FIG. 2 (step A5, No), the score calculation unit 37 refers to the game control data 38 and responds to the match rate for the input voice. The score is calculated (step A10). For example, when the coincidence rate is within the range of “80 to 100”, 10 points are added, and when it is within the range of “0 to 49”, 0 points are set. Note that the score obtained here may be displayed together with a message.

  Here, if the processing for all the stages is not completed (step A11, No), the game function unit 10c executes the same processing for the next stage 2.

  The text presentation unit 31 causes the display unit 11 to display on the game screen a speech that is input by the player based on the speech data of the stage 2 set in the game control data 38 (step A1). FIG. 6B1 shows an example of a game screen on which a speech to be input by voice is presented on the game screen. In FIG. 6 (b1), a line “Please come down inside the yellow line” is presented.

  Here, the game function unit 10c causes the display unit 11 to display a screen for notifying the player of the voice input timing in the same manner as described above.

  Here, after “GO” indicating the start timing of the voice input is displayed, the player inputs the voice of the speech presented on the game screen. The voice input unit 32 inputs voice through the sound unit 13 for a predetermined time from the voice input start timing (step A2).

  The voice recognition unit 33 performs voice recognition on the input voice based on the voice recognition data “yellow line” of the stage 2 set in the game control data 38 (step A3).

  Then, the display switching unit 36 displays a game screen including words (messages) corresponding to the match rate. In stage 2, for example, when the match rate is in the range of “80 to 100”, a game including a message indicating a correct answer of “Please fall inside the yellow line” as shown in FIG. When the screen is displayed and the matching rate is within the range of “0 to 49”, a message indicating an incorrect answer “Please paint inside the lymph gland” as shown in FIG. Display the game screen that contains it.

  Here, it is determined whether or not terminal operation data is set in the game control data 38. As for stage 2, since the terminal operation data is set as shown in FIG. 2 (step A5, Yes), the display switching unit 36 includes a game screen including an operation message indicating the content of the terminal operation determined in the stage. Is displayed (step A6). In FIG. 6 (c1), as the contents of the terminal operation, the operation message “Pointing confirmation” performed by the station clerk and the “Shake terminal” operation message corresponding to the pointing confirmation to be performed by the player are displayed.

  Here, it is assumed that the player holds the mobile phone 1 and makes a predetermined movement, for example, as shown in FIG. This change in posture of the mobile phone 1 is detected by the sensor 20 and notified to the sensor unit 34.

  When posture change is detected from the notification input through the sensor unit 34 (step A7), the posture change determination unit 35 compares the terminal operation data set in the game control data 38 with the posture change and is set in advance. It is determined whether or not it coincides with the changed posture change (pointing confirmation operation) (step A8).

  The display switching unit 36 displays a game screen corresponding to the matching rate recognized for the input voice and the determination result (OK, NG) for the posture change (step A9). 6 (c2) and 6 (c3) show game screens that are displayed when the recognition rate for the input speech is good (within a range of “80 to 100”) and the terminal operation that correctly indicates pointing is performed. Show. The display switching unit 36 can display a game screen corresponding to each of the other processing results.

  In addition, the score calculation unit 37 refers to the game control data 38 and calculates the score according to the matching rate for the input voice and the determination result for the posture change (step A10).

  If the matching rate for the input speech is low, the process for inputting the terminal operation may not be executed even if the terminal operation is set (for each stage). That is, when the voice input cannot be performed correctly, the high score cannot be obtained by not executing the process for the terminal operation. In the game processing of this embodiment, voice input and terminal operation are executed in combination, and when both results are good, a high score can be obtained, so that the game is made difficult and the game performance is improved. Can be made.

  Thereafter, until the processes for all the stages are completed (step A11), the processes in the respective stages are executed in the same manner. A specific example of the game screen displayed in each stage 3 to 7 will be described.

  In stage 3, as shown in FIG. 7 (a1), a game screen including a line “please open it in front of the door, please wait” is displayed. As a result of performing voice recognition on the speech input by the player with respect to this line, if the matching rate is within the range of “80 to 100”, as shown in FIG. When a game screen including a message indicating the correct answer “Open and wait” is displayed, and the matching rate is within the range of “0 to 49”, as shown in FIG. , Please wait for a while, "and display a game screen that includes a message indicating an incorrect answer.

  In stage 3, terminal operation data is set, and as shown in FIG. 7B1, a game screen including an operation message indicating the contents of the terminal operation determined in stage 3 is displayed. In FIG. 7 (b1), as the contents of the terminal operation, an operation message “departure bell” performed by the station staff and an operation message “shake terminal” corresponding to the pointing confirmation to be performed by the player are displayed. In stage 3, the player is requested to perform an operation for ringing the departure bell and an operation for stopping the departure bell.

  First, as shown in FIG. 7 (b2), a screen for pressing a button for ringing the departure bell is displayed to prompt the player to execute the terminal operation. This screen contains a message “Let's shake the terminal and ring the departure bell”. Here, when the player shakes the mobile phone 1 and the terminal operation is correctly performed, the game function unit 10c causes the sound unit 13 to output the sound of the departure bell of the train from the speaker. As shown in FIG. 7 (b3), a screen showing a state where the departure bell is ringing is displayed.

  Here, the sound of the departure bell output from the speaker is, for example, a sound in which the same pattern of sound (or music) is repeated. And, for example, when a predetermined terminal operation is performed at the timing of the break after being repeated four times, 10 points when the terminal operation is performed at the timing of the break after being repeated three times, and 5 points for others It is assumed that the timing is set so that 0 points are acquired.

  As shown in FIG. 7 (b4), the game function unit 10c displays a screen including a message “Stop the departure bell at a good timing”, for example, and executes a terminal operation to stop the departure bell from the player. Prompt. Here, when the player shakes the mobile phone 1 and the terminal operation is correctly performed, the game function unit 10c stops the sound output of the departure bell (departure song) of the train. In addition, the score calculation unit 37 compares the timing at which the terminal operation is performed with the departure bell separation to determine the score, and executes the score calculation.

  For example, when the terminal operation is performed with good timing at the departure bell correctly, as shown in FIG. 7 (b5), a screen indicating that the terminal operation for correctly stopping the departure bell has been performed is displayed. The sound of “Please close the door, please be careful” is output. Thereafter, when a predetermined key operation (for example, a determination key) is performed by the player, the next stage is performed.

  Thus, in stage 3, by causing the player to perform a terminal operation different from that in stage 2, the game content can be varied and the game contents can be diversified. In particular, in stage 3, it is necessary not only to perform a predetermined terminal operation, but also to match the timing of executing the terminal operation, so that it is possible to give the player a sense of tension and concentrate on the game. In addition, when the sensor 20 provided in the mobile phone 1 can detect a change in posture in a plurality of directions, a plurality of terminal operations executed in one stage are different from each other, so that the game content can be further improved. It can also give change.

  In stage 4, as shown in FIGS. 8 (a1), (a2), and (a3), the lines set in stage 4 are displayed, the player inputs voices, and the matching rate obtained by voice recognition for the voices is obtained. Display a screen that contains the corresponding message. Similarly, the screen shown in FIGS. 8 (b1), (b2), and (b3) is displayed on the stage 5, and the screens shown in FIGS. 8 (c1), (c2), and (c3) are displayed on the stage 6.

  In stage 6, terminal operation data is set, and as shown in FIG. 9 (a1), a game screen including an operation message indicating the contents of the terminal operation determined in stage 6 is displayed. In FIG. 9 (a1), as the contents of the terminal operation, the operation “push” performed by the station staff (pushing a passenger who cannot get on the train into the train) and “pushing the terminal left and right” corresponding to the push to be performed by the player "Is displayed.

  First, as shown in FIG. 9 (a2), an indicator is displayed on the screen, and when the player performs a terminal operation of shaking the mobile phone 1, the indicator gauge is increased for each swing. . When the mobile phone 1 is shaken a plurality of times by the player, as shown in FIG. 9 (a3), when all the gauges of the indicator are satisfied, the display switching unit 36, as shown in FIG. 9 (a4), A screen including a “success” message indicating that the operation has been performed correctly is displayed. It should be noted that a time limit may be provided for the terminal operation, and whether the terminal operation is complete or not may be determined based on whether the terminal operation is completed within a predetermined time. The score calculation unit 37 calculates the score according to the matching rate for the voice input and the determination result regarding the terminal operation. As described above, the stage 6 can also request a terminal operation different from the stages 3 and 4.

  At stage 7, as shown in FIG. 10 (a1), a game screen including a dialogue “door closes” is displayed, and the matching rate obtained by voice recognition for the speech input by the player is displayed on this dialogue. In response, for example, a screen including the message shown in FIGS. 10A2 and 10A3 is displayed. Then, in the same manner as in stage 2, the player is caused to execute a terminal operation for “pointing confirmation” according to the terminal operation data. Then, the score corresponding to the voice input coincidence rate and the determination result for the terminal operation is calculated.

  In this way, when the processing for all the stages is completed (step A11, Yes), the display switching unit 36 displays a game end screen including the score totals calculated by the score calculation unit 37.

  FIG. 10C shows an example of the game end screen. In the example of the screen shown in FIG. 10C, a message of the total score obtained at each stage and an evaluation (for example, “You are a station manager”) corresponding to the total score is displayed.

  In this way, in the mobile phone 1 (mobile terminal) in the present embodiment, a game process that requires a terminal operation of moving the mobile phone 1 itself as well as causing the player to input sound is executed. The game contents can be diversified by changing the necessary operations. For this reason, it is possible to prevent the player from getting bored with the game.

  In the above description, it is assumed that a plurality of stages according to a story prepared in advance are executed. However, depending on the recognition result of the voice input and the determination result for the terminal operation, it is branched to a separately prepared story. Anyway. Thereby, in a stage prepared in another story, it is possible to cause the player to perform voice input and terminal operation different from others.

  Further, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  In addition, the method described in the embodiment uses, as a program (software means) that can be executed by a computer, for example, a magnetic disk (flexible disk, hard disk, etc.), an optical disk (CD-ROM, DVD, MO, etc.), and a semiconductor memory. It can also be stored in a recording medium such as (ROM, RAM, flash memory, etc.), or transmitted and distributed via a communication medium. The program stored on the medium side also includes a setting program that configures in the computer software means (including not only the execution program but also a table and data structure) that is executed by the computer. A computer that implements the present apparatus reads the program recorded on the recording medium, constructs software means by a setting program in some cases, and executes the above-described processing by controlling the operation by the software means. The recording medium referred to in this specification is not limited to distribution, but includes a storage medium such as a magnetic disk or a semiconductor memory provided in a computer or a device connected via a network.

The block diagram which shows the function structure of the mobile telephone 1 (mobile terminal) in this embodiment. The figure which shows an example of the data set in the game control data. An example of the message in the game screen set to the game control data 38 is shown. The figure which shows an example of the terminal operation | movement of the player with respect to the mobile telephone 1. FIG. The flowchart for demonstrating the game process performed in the mobile telephone 1 in this embodiment. The figure which shows an example of the game screen in each tee displayed during a game process. The figure which shows an example of the game screen in each tee displayed during a game process. The figure which shows an example of the game screen in each tee displayed during a game process. The figure which shows an example of the game screen in each tee displayed during a game process. The figure which shows an example of the game screen in each tee displayed during a game process.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Mobile phone, 2 ... Network, 3 ... Mobile terminal, 4 ... Server, 5 ... PC, 10 ... Control part, 10a ... Telephone function part, 10b ... Web function part, 10c ... Game function part, 11 ... Display part, DESCRIPTION OF SYMBOLS 12 ... Input part, 13 ... Sound part, 14 ... Camera part, 15 ... Communication part, 16 ... ROM, 17 ... RAM, 17a ... Game program, 18 ... Memory device attachment / detachment unit, 19 ... Memory device, 20 ... Sensor, 30 DESCRIPTION OF SYMBOLS ... Download part, 31 ... Text presentation part, 32 ... Voice input part, 33 ... Voice recognition part, 34 ... Sensor part, 35 ... Posture change determination part, 36 ... Display switching part, 37 ... Score calculation part, 38 ... Game control Data, 39 ... game screen data.

Claims (6)

A sentence presentation means for presenting a voice sentence to be input;
Voice input means for inputting voice;
Voice recognition means for recognizing the coincidence rate between the voice input by the voice input means and the text presented by the text presentation means;
Sensor means for detecting a change in posture;
Posture change determination means for determining whether the posture change detected by the sensor means corresponds to a posture change corresponding to the sentence presented by the sentence presentation means;
A portable terminal comprising: a display switching unit that displays a screen according to a matching rate recognized by the voice recognition unit and a determination result with respect to a posture change by the posture change determination unit.   2. The stage according to claim 1, wherein a plurality of stages are provided, and a combination of a sentence presented by the sentence presentation unit and a posture change determined by the posture change determination unit corresponding to the sentence is different depending on the stage. Mobile devices.   The portable terminal according to claim 1 or 2, wherein the voice recognition means recognizes a match rate with a voice for a part of the text presented by the text presentation means.   4. The portable terminal according to claim 1, wherein the posture change determination unit further determines the posture change based on a posture change timing detected by the sensor unit.   5. The calculation device according to claim 1, further comprising a calculation unit configured to calculate a score based on the matching rate recognized by the voice recognition unit and the determination result determined by the posture change determination unit. The mobile terminal according to Crab. Computer
A sentence presentation means for presenting a voice sentence to be input;
Voice input means for inputting voice;
Voice recognition means for recognizing the coincidence rate between the voice input by the voice input means and the text presented by the text presentation means;
Posture change determination means for determining whether the posture change detected by the sensor corresponds to a posture change corresponding to the sentence presented by the sentence presentation means;
A game program for functioning as a display switching unit for displaying a screen according to a matching rate recognized by the voice recognition unit and a determination result for a posture change by the posture change determination unit.

Images