JP3882017B2 - Audio output method, game apparatus, communication game system, computer program, and recording medium - Google Patents

Description

【００５６】
表１に示すように単音の基本となるのは、「ａ」、「ｉ」、「ｕ」、「ｅ」及び「ｏ」として示している母音並びに「ｋ」、「ｓ」、「ｔ」、「ｎ」、「ｈ」、「ｍ」、「ｙ」、「ｒ」及び「ｗ」として示している子音である。
なお濁音及び半濁音については、修飾音声として子音の操作入力時に濁音又は半濁音を示す操作入力、例えばジョイスティックを上又は下へ倒す操作入力を行うことにより指定されるが、「ｇ」、「ｚ」、「ｄ」、「ｂ」及び「ｐ」等の子音を用いるようにしてもよい。
【００５７】
そして一又は連続する複数の単音により、ひとまとまりの音として認識される音声の単位である「あ」、「い」、「か」及び「し」等の音節が構成される。
音節が「あ」行の音節については母音を示す単音を指定することにより、「か」行から「わ」行までの音節については、子音を示す単音及び母音を示す単音を指定することにより、音節が判定される。
ただし「ん」については、ジョイスティックを押下する操作入力により音節の指定が行われる。
【００５８】
なお表１に示した例の場合、複数の単音からなる音節については、単音の指定を複数回行わなければならないが、本発明はこれに限らず、一回の指定で複数の単音からなる音節を決定するようにしてもよく、具体例としては「Ｌ２」と示されたボタンを押下することにより、単音「ｓ」及び「ａ」からなる音節「さ」を判定するようにしてもよい。
【００５９】
音節の成文を調整する操作入力として、音節の音量、強弱、高低及び長さを調整する操作入力があり、その一例が、母音を示す単音の指定と同時的にジョイスティックを操作してその押下強度、方向、及び長さにより調整する方法である。
【００６０】
例えばジョイスティックの押下強度又は押下時間により、音節の音量を調整し、ジョイスティックを上に倒すことにより音を高く、又下に倒すことにより音を低くする調整を行う。
またジョイスティックを右に倒すことにより、音節の長さを長く、特に所定時間以上倒していた場合には、長音として判定することにより音節の調整を行う。逆にジョイスティックを左に倒すことにより、音節の長さを短く、特に連続して２回左に倒した場合には、促音として判定することにより音節の調整を行う。
【００６１】
これらの調整操作は予め任意に設定しておくことが可能であり、音量及び長さを同時に調整することにより、強弱又は抑揚を表現することも可能である。
【００６２】
表２は本発明の音声出力方法において、「今日は（わ）元気です」という文を発声させるための操作入力の例を示している。
【００６３】
【表２】

【００６４】
なお表１及び表２に示す例は、日本語を表現する場合の操作入力の一例を示したものに過ぎず、他の操作入力にて音節を判定させる設定を行うことも可能であり、英語、更には仮想上の言語を判定させるように設定することも可能である。
【００６５】
また予め夫々異なる周波数の正弦波を各ボタンに割り付けておき、各ボタンの押下状況により振幅を調整した複数の正弦波を組み合わせ、擬似的な音声を出力させるようにしてもよい。
【００６６】
次に音声情報の平滑処理について説明する。
図５は本発明のゲーム装置１００を用いた音声情報の平滑処理を示すフローチャートである。
図４のステップＳ１１４に示す音声情報が複数である場合の平滑処理としては、先ず相前後する二の音声情報が示す音節を構成する単音を検出し（Ｓ２０１）、先の音声情報の最後の単音及び後の音声情報の最初の単音に基づいて、二の音声情報の間に出力すべき中間音声情報を生成する（Ｓ２０２）。
【００６７】
表３は本発明のゲーム装置１００を用いた音声情報の平滑処理において、中間音声情報の生成方法を示す説明図である。
【００６８】
【表３】

【００６９】
複数の連続する音声情報が「と」、「き」、「め」及び「き」である場合、夫々の音節を構成する単音は、「ｔ」及び「ｏ」、「ｋ」及び「ｉ」、「ｍ」及び「ｅ」並びに「ｋ」及び「ｉ」であり、これらの単音に基づいて「ｏ」及び「ｋ」、「ｉ」及び「ｍ」並びに「ｅ」及び「ｋ」を夫々連続して出力する音節を示す音声情報を中間音声情報として生成する。
この場合、必ずしも単独で日本語の音節として発音することが可能な音声情報が生成されるとは限らず、またその長さは通常の音声情報の１／５程度が望ましい。
【００７０】
なお表３中で「Ｖｏｉｃｅ＿ｔｏ」とは、音節「ｔｏ」を示す音声情報のコードを示し、「Ｖｏｉｃｅ＿ｏｋ」とは、音節「ｏｋ」を示す音声情報のコードを示している。
【００７１】
そして次に連続する音声情報及び中間音声情報が示す音節の音量及び／又は高低の成分を調整し（Ｓ２０３）、調整後の音声情報及び中間音声情報を、図４におけるステップＳ１１５の処理により、音声出力手段１２０へ送出する（Ｓ２０４）。
【００７２】
図６は本発明のゲーム装置１００を用いた音声情報の平滑処理において、音節の高低の成分の調整を示すグラフである。
図６では、横軸に時間をとり、縦軸に音節の高低として周波数を示している。音節の高低は、相前後する音節において、後の音節の初めの部分の周波数が前の音節の周波数から徐々に変化するように平滑化処理がなされているため、自然な発声として出力することができる。
なお音量についても、連続する音節間の音量が一時的に低くなるようにすることで、夫々の音節が明瞭に聞き取れるようになる。
【００７３】
また音節の調整処理及び平滑処理を行う前に、ステップＳ１１７にて実施した辞書データベースを参照して意味の解析処理を行い、合致する単語が存在する場合には、単語の音声として予め強弱及び高低等の成分の調整並びに平滑化を行われた状態で辞書データベースに記録されている音声情報に基づく音声を出力するようにしてもよい。
【００７４】
次に本発明のゲームシステムにて用いられるゲーム装置１００及び中央装置２００の通信処理を図７に示すフローチャートを用いて説明する。
複数のゲーム装置１００，１００，…は、予め中央装置２００にアクセスし、認証を行うことで通信ゲームの提供を受けており、各ゲーム装置１００，１００，…を夫々操作する複数の操作者間で、実時間でのゲームが進行する。
【００７５】
なおここでは複数のゲーム装置１００，１００，…を用いて音声情報を送受信する処理を説明するので、便宜上、送信側のゲーム装置１００を一のゲーム装置１００ａとし、受信側のゲーム装置１００を他のゲーム装置１００ｂとして説明するが、夫々の機能に差異があるわけではない。
【００７６】
また他のゲーム装置１００ｂとして表現しているが、３以上のゲーム装置１００，１００，１００，…を用いる場合、一のゲーム装置１００ａ以外の複数のゲーム装置１００ｂ，１００ｂ，…を示すことになる。
一のゲーム装置１００ａでは、図４を用いて説明した音声処理のステップＳ１０１〜Ｓ１１４の処理により生成した音声情報を、通信ゲームを実行するために予め認証されている中央装置２００へ送信する（Ｓ３０１）。
なおこのとき送信される音声情報は複数の音声情報を一括した音声情報列であってもよい。
【００７７】
中央装置２００では、音声情報を受信し（Ｓ３０２）、受信した音声情報を他のゲーム装置１００ｂへ送信する（Ｓ３０３）。
【００７８】
他のゲーム装置１００ｂでは、音声情報を受信し（Ｓ３０４）、受信した音声情報を音声出力手段１２０へ送出し（Ｓ３０５）、音声手段１２０から一のゲーム装置１００ｂにて操作される操作対象が発声する音声として出力する（Ｓ３０６）。
【００７９】
なお上述したように一の端末装置１００ａから他の端末装置１００ｂへ音声情報を送信し、中央装置２００を単なる音声情報の中継装置として用いるのではなく、中央装置２００へ操作入力の信号を送信し、単音及び音節の判定等の処理を中央装置２００にて行うようにしてもよく、更には他の端末装置１００ｂにて単音及び音節の判定等の処理を行うようにしてもよい。
【００８０】
前記実施の形態では、複数の単音を指定する操作入力を受け付ける処理に際し、所定の時間に到達するまでに受け付けた操作入力に基づいて音声情報を生成する形態を示したが、本発明はこれに限らず、ゲーム中のイベント、例えばモンスターの攻撃を受けた場合に、それまでに受け付けた操作入力に基づいて音声情報を生成してもよく、これによりモンスターの攻撃により発声が中断された状況を演出することが可能となる。
【００８１】
【発明の効果】
以上詳述した如く本発明に係る音声出力方法、ゲーム装置、通信ゲームシステム、コンピュータプログラム及び記録媒体では、インターネット等の通信網を介して複数台のゲーム装置を接続し、実時間で進行するゲーム等のゲームにおいて、擬似的な会話を行う場合に、キー、ボタン及びジョイスティック等の複数の入力部を有するキーボード及び専用コントローラ等の入力手段を用いた入力操作に基づいて、「ｋ」及び「ａ」等の複数の単音により構成される「か」等の音節単位で音声情報を生成し、生成した音声情報を音声として出力することにより、文として未完成な状態の音声及び言い間違えた音声を出力させる状況が発生し、音節の集合体としての文を完成させてから出力する従来のゲームと比べて現実感を高めゲームに対する気分を高揚させる演出を行うことが可能である等、優れた効果を奏する。
【００８２】
また本発明では、単音を入力する入力操作の完了を判定するトリガとして、文の決定及び送信処理等の所定の入力操作ではなく時間を用いることにより、文の決定及び送信処理等の特別な操作を行わなくとも、操作入力に基づいて生成した音声情報に基づく音声を出力させることにより、例えば「モンス」等の未完成な状態の音声を出力させる状況が発生し、会話の途中でゲーム中のモンスターから攻撃を受けて最後まで言葉を発することができない状況を演出することができるので、現実感を高めゲームに対する気分を高揚させる演出を行うことが可能である等、優れた効果を奏する。
【００８３】
さらに本発明では、アナログジョイスティックを押下する指圧、方向及び時間等の度合を検出して成分を調整することにより、アクセント、抑揚及び音の高低等の変化を持たせることができるので、会話として違和感の無い自然な発声を行うことができ、現実感を高める演出を行うことが可能である等、優れた効果を奏する。
【００８４】
そして本発明では、複数の音節を連続して出力する場合に、連続する音節間に中間音声情報を挿入する処理及び連続する音節を調整する処理を行うことにより、会話として違和感の無い自然な発声を行うことができ、現実感を高める演出を行うことが可能である等、優れた効果を奏する。
【００８５】
しかも本発明では、日本語及び英語等の実在する言語体系又はゲーム中でのみ用いられる仮想上の言語体系に基づいて準備された辞書データベースと照合し、出力する音声の意味を解析して、解析した意味に基づく処理を行うことにより、例えば操作者が操作するプレイヤキャラクタが「今日はいい天気ですね。」と発声した場合に、プレイヤキャラクタ以外のキャラクタ、即ち非操作対象が「はい。いい天気です。」と返答することにより、現実感を高めゲームに対する気分を高揚させる演出を行うことが可能である等、優れた効果を奏する。
【図面の簡単な説明】
【図１】本発明の通信ゲームシステムを概念的に示す説明図である。
【図２】本発明のゲームシステムの構成を示すブロック図である。
【図３】本発明のゲーム装置が備える入力手段を示す外観図である。
【図４】本発明のゲーム装置を用いた音声処理方法を示すフローチャートである。
【図５】本発明のゲーム装置を用いた音声情報の平滑処理を示すフローチャートである。
【図６】本発明のゲーム装置を用いた音声情報の平滑処理において、音節の高低の成分の調整を示すグラフである。
【図７】本発明のゲームシステムにて用いられるゲーム装置及び中央装置の通信処理を示すフローチャートである。
【符号の説明】
１００ ゲーム装置
２００ 中央装置
３００ 通信網
４００ 記録媒体
４０１ コンピュータプログラム[0001]
BACKGROUND OF THE INVENTION
The present invention provides an audio output method for outputting audio from an output unit based on an operation input received by an input unit, a game device to which the method is applied, a communication game system using the device, and a device for realizing the device A computer program and a recording medium on which the program is recorded, and in particular, a plurality of operators operate each player character to be operated via a communication network such as the Internet, and the player character advances while talking. The present invention relates to an audio output method, a game device, a communication game system, a computer program, and a recording medium applied to a game.
[0002]
[Prior art]
A game such as a role-playing game in which an operator operates a player character to be operated and simulates a virtual adventure in a game space has become widespread. The operator has operated each player character in the same game space, and has developed into a communication game system in which the game progresses in real time.
[0003]
In such a communication game system, pseudo-conversation for operators to communicate each other's intentions is an important element, and now pseudo-conversation is realized using a chat system that transmits and receives text information. is doing.
[0004]
In the chat system, a single operator operates a keyboard having a plurality of input parts such as keys, buttons and joysticks, and an input means such as a dedicated controller to “exchange items” and “monsters. Is input to the game machine, and after confirming the input character information, the input character information is transmitted and connected to the game machine operated by another operator. This is a system for outputting character information to output means such as a monitor.
[0005]
Also, instead of entering characters one by one, a sentence is assigned to each input section in advance, a method of inputting by the assigned input section, and a plurality of sentences are displayed, and a desired single sentence is selected from among them. A system for outputting character information by a method such as a method for performing the above is also used.
Further, there is a system in which character information to be output is converted into voice information and output as voice.
[0006]
[Problems to be solved by the invention]
However, in the conventional system, in order to output the voice based on the character information input up to the state established as a sentence or the character information established in advance as a sentence, the voice established as a sentence is output or input Either the monster attack or other event occurred before the completion of the speech and no sound was output, and the speech was output in an unfinished state as a sentence such as a break in the middle of a sentence or a misrepresentation There is a problem that it is not done and lacks reality.
[0007]
The present invention has been made in view of such circumstances, and after inputting character information, by performing input for transmitting the input character information, generation of voice information based on the input character information is started. Rather, by starting the generation of voice information by operation input indicating syllables such as `` a '', `` ka '' and `` kya '', the generated character information is automatically transmitted without performing a special operation, A situation in which audio information is output in an incomplete state occurs, and thereby an audio output method capable of providing an effect that enhances the sense of reality and enhances the mood of the game, a game device to which the method is applied, and the device The main object is to provide a communication game system used, a computer program for realizing the device, and a recording medium on which the program is recorded.
[0008]
Furthermore, in the present invention, by accepting and processing the operation for adjusting the components that indicate the volume, strength, height, and length of the syllable, it is possible to produce an effect that enhances the sense of reality by approaching a natural utterance without a sense of incongruity as a conversation. Another object is to provide a game device or the like that can be used.
[0009]
In the present invention, the meaning of the speech information is analyzed as a language, and a non-operation target in the game, for example, a character other than the player character operated by the operator is operated based on the analyzed meaning. Another object is to provide a game device or the like capable of producing an effect that enhances performance.
[0010]
[Means for Solving the Problems]
  The voice output method according to the first aspect of the present invention is the voice output method for outputting voice from the output means based on the operation input accepted by the input means, wherein the operation indicates a single tone that is a consonant and a single tone that constitutes a syllable. Accept input,Starts timing after accepting operation input, and when the time counted after accepting operation input reaches the specified time,Audio information indicating syllables based on accepted operation inputofGenerationStartAndAnd based on the plurality of operation inputs received from the time when the operation input is received until the predetermined time is reached, one or a plurality of audio information is generated,Based on the generated voice information, a voice including one or a plurality of syllables is output from the output means.
[0011]
  In the voice output method according to the first aspect of the present invention, only an operation input indicating a syllable such as “ka” composed of a plurality of single notes such as “k” and “a” is accepted, and a special sentence such as sentence determination and transmission processing is accepted. Even if no operation is performed, a situation in which an unfinished voice such as “Mons” or a wrong voice is output by outputting a voice based on the voice information generated based on the operation input occurs. Since it is possible to produce a situation such as being unable to speak to the end due to an attack from a monster in the game, it is possible to produce an effect that enhances the sense of reality and enhances the mood of the game.Moreover, as a trigger for determining the completion of an input operation for inputting a single sound, that is, by using time instead of a predetermined input operation such as sentence determination and transmission processing, for example, an unfinished voice such as “Mons” is output. It is possible to produce a situation where you can not speak to the end because you are attacked by a monster in the game in the middle of the conversation, so you can enhance the sense of reality and raise the mood for the game Is possible.
[0012]
  According to a second aspect of the present invention, there is provided a game apparatus comprising: an input unit having a plurality of input units for receiving operation inputs, wherein the input unit accepts the sound information for generating sound from the output unit during execution of the game. Determination means for determining a single sound that is a consonant and a single sound that is a vowel specified by a plurality of operation inputs;Means for starting timing after receiving one operation input, and the determination meansGenerating means for generating sound information indicating a syllable composed of a plurality of single sounds and having a volume, strength, high and low, and length components based on the determined combination of the single sounds;The generating means is adapted to start generating voice information when the time being measured reaches a predetermined time, and accepting the time from when one operation input is received until the predetermined time is reached. One or more voice information should be generated based on a plurality of operation inputs.It is characterized by that.
[0013]
  In the game device according to the second aspect of the present invention, based on an input operation using an input means such as a keyboard and a dedicated controller having a plurality of input units such as keys, buttons and joysticks, a plurality of “k” and “a” and the like Generates voice information in units of syllables such as “ka” composed of a single sound, and outputs the generated voice information as voice, resulting in a situation where unfinished voice and wrong voice are output as sentences In addition, it is possible to produce an effect that enhances the sense of reality and enhances the mood of the game as compared to a device that outputs after completing a sentence as a syllable aggregate.Moreover, as a trigger for determining the completion of an input operation for inputting a single sound, that is, by using time instead of a predetermined input operation such as sentence determination and transmission processing, for example, an unfinished voice such as “Mons” is output. It is possible to produce a situation where you can not speak to the end because you are attacked by a monster in the game in the middle of the conversation, so you can enhance the sense of reality and raise the mood for the game Is possible.
[0014]
  A game device according to a third invention is the game device according to the second invention,The determination means includesA single sound specified by an operation input received from one input unit or a plurality of operation inputs received simultaneously from a plurality of input unitsTo judgeIt is characterized by being.
[0015]
In the game device according to the third aspect of the invention, since a single sound can be designated by an operation such as simultaneous pressing of a plurality of buttons, a large number of single sounds can be expressed even using a dedicated controller with a small number of input units. is there.
[0018]
  First4The game device according to the invention is a second invention.Or the third inventionMeans for detecting at least one of the intensity, direction and time of the operation input, and means for adjusting at least one of the components of syllable volume, intensity, height and length based on the detected result It is characterized by providing.
[0019]
  First4In the game device according to the invention, when using an input means capable of detecting the degree of acupressure, direction, time, etc., by adjusting the component based on the detected degree, accent, inflection, pitch of sound, etc. Therefore, it is possible to produce a natural utterance without a sense of incongruity as a conversation, and to produce an effect that enhances the sense of reality.
[0020]
  First5The game device according to the invention is a second invention to a second invention.4In any one of the inventions, when there are a plurality of pieces of voice information generated by the generation unit, a unit is provided that adjusts at least one of the syllable volume, strength, and height of syllables included in the succeeding voice information. Features.
[0021]
  First5In the game device according to the present invention, when a plurality of syllables are output continuously, by adjusting the syllables that follow each other, a natural utterance without a sense of incongruity can be performed as a conversation, and an effect that enhances the sense of reality is performed. It is possible.
[0022]
  First6The game device according to the invention is a second invention to a second invention.5In any one of the inventions, when there are a plurality of pieces of voice information generated by the generation unit, the means for generating intermediate voice information to be output between the two pieces of voice information based on the two pieces of neighboring voice information It is characterized by providing.
[0023]
  First6In the game device according to the invention, when a plurality of syllables are continuously output, intermediate voice information is inserted between successive syllables, for example, the syllable “ha” composed of the single notes “h” and “a” and the single note “r”. When the syllable “ru” consisting of the single note “u” is output continuously, the syllable “ar” consisting of the single notes “a” and “r” is inserted, thereby making a natural utterance without a sense of incongruity as a conversation. It is possible to produce an effect that enhances the sense of reality.
[0024]
  First7The game device according to the invention is a second invention to a second invention.6In any one of inventions, the said audio | voice information is the audio | voice which the operation target in a game utters.
[0025]
  First7In the game device according to the invention, the player character in the game can be operated as a part of the operator by outputting the audio information as the voice uttered by the operation target that is the player character in the game operated by the operator. It is possible to produce a virtual experience of a virtual adventure on the game space.
[0026]
  First8The game device according to the invention is a second invention to a second invention.7In any one of the inventions, means for analyzing the meaning of the voice information as a language based on an existing language system or a virtual language system, and an operation target and / or a non-operation target in the game based on the analyzed meaning And a means for operating.
[0027]
  First8The game device according to the invention is collated with a dictionary database prepared based on a real language system such as Japanese and English or a virtual language system used only in the game, and analyzes the meaning of the output voice. By performing processing based on the analyzed meaning, for example, when the player character operated by the operator utters “Today is a good weather,” characters other than the player character, that is, non-operation targets are “Yes. By replying “It ’s good weather,” it is possible to enhance the reality and enhance the game.
[0028]
  First9The communication game system according to the invention is a second invention to a second invention.8A plurality of game devices according to any one of the inventions, and a central device that connects the game devices via a communication network, wherein the one game device includes means for transmitting generated voice information to the central device. The central device includes means for transmitting the received audio information to another game device, and the other game device includes means for outputting the received audio information from the output means.
[0029]
  First9In the communication game system according to the invention, in a system in which a plurality of operators operate each player character in the same game space using a communication network such as the Internet, and the game progresses in real time, there is no natural discomfort. It is possible to have a highly realistic conversation with a simple utterance, thereby performing an effect of simulating a virtual adventure with a large number of people.
[0030]
  First10The communication game system according to the invention is a communication game system in which a plurality of game devices having an input means for receiving an operation input and an output means for outputting a sound are connected via a communication network. Determines consonant single sound and vowel single sound specified by multiple accepted operation inputsJudgment meansWhen,Means for starting timing after receiving one operation input, and the determination meansBased on the determined combination of single notes, it generates voice information consisting of multiple single notes and indicating syllables.Generation meansWhenThe generating means is adapted to start generating audio information when the time being measured reaches a predetermined time, and from when one operation input is received until the predetermined time is reached. Based on a plurality of operation inputs received in step S1 to generate one or a plurality of voice information,Means for outputting generated voice information from output means of other game deviceFurtherIt is characterized by providing.
[0031]
  First10In the communication game system according to the invention, a game device is a system in which a plurality of operators operate each player character in the same game space using a communication network such as the Internet, and the game progresses in real time. "K" composed of a plurality of single notes such as "k" and "a" based on an input operation using an input means such as a keyboard and a dedicated controller having a plurality of input units such as keys, buttons and joysticks A set of syllables is generated by generating voice information in units of syllables, etc., and outputting the generated voice information from other game devices, so that unfinished voice and wrong voice are output as sentences Compared to a device that outputs after completing a sentence as a body, it is possible to produce an effect that increases the sense of reality and enhances the mood for the game. More a virtual adventure in multiplayer it is possible to carry out the performance of simulated experience.Moreover, as a trigger for determining the completion of an input operation for inputting a single sound, that is, by using time instead of a predetermined input operation such as sentence determination and transmission processing, for example, an unfinished voice such as “Mons” is output. It is possible to produce a situation where you can not speak to the end because you are attacked by a monster in the game in the middle of the conversation, so you can enhance the sense of reality and raise the mood for the game Is possible.
[0032]
  First11The computer program according to the present invention is a computer program for generating sound information for outputting a sound from an output means to a computer having an input means for receiving an operation input. The computer program is designated by a plurality of operation inputs received by the input means. A procedure for determining a single tone that is a consonant and a single tone that is a vowel;A procedure for the computer to start timing after receiving one operation input;And a procedure for generating sound information indicating a syllable consisting of a plurality of single sounds based on a combination of the determined single sounds.The voice information is generated based on a plurality of operation inputs that are started when the time being counted reaches a predetermined time and from when one operation input is received until the predetermined time is reached.It is characterized by that.
[0033]
  First11The computer program according to the present invention is executed by a computer such as a home game device and a personal computer, so that the computer operates as the game device of the present invention. Therefore, a keyboard having a plurality of input units such as keys, buttons, and joysticks. And voice information generated in units of syllables such as “ka” composed of a plurality of single notes such as “k” and “a” based on an input operation using an input means such as a dedicated controller. Is generated as a sentence, and there is a situation in which unfinished and unspoken voices are output as sentences, and it is more realistic than a device that outputs after completing a sentence as a syllable aggregate. It is possible to produce an effect that raises the mood for the game.Moreover, as a trigger for determining the completion of an input operation for inputting a single sound, that is, by using time instead of a predetermined input operation such as sentence determination and transmission processing, for example, an unfinished voice such as “Mons” is output. It is possible to produce a situation where you can not speak to the end because you are attacked by a monster in the game in the middle of the conversation, so you can enhance the sense of reality and raise the mood for the game Is possible.
[0034]
  First12The computer-readable recording medium according to the invention is a computer-readable recording medium in which a computer program for generating sound information for outputting sound from an output means is recorded in a computer having an input means for receiving an operation input. In a possible recording medium, a procedure for causing a computer to determine a single sound that is a consonant and a single sound that is a vowel specified by a plurality of operation inputs received by the input unit;A procedure for the computer to start timing after receiving one operation input;And a procedure for generating sound information indicating a syllable consisting of a plurality of single sounds based on a combination of the determined single sounds.The voice information is generated based on a plurality of operation inputs that are started when the time being counted reaches a predetermined time and from when one operation input is received until the predetermined time is reached.A computer program is recorded.
[0035]
  First12In the computer-readable recording medium according to the invention, a computer program recorded on a recording medium such as a ROM cartridge, a CD-ROM, or a DVD is executed on a computer such as a consumer game device or a personal computer. Since the computer operates as the game device of the present invention, “k” and “a” are based on an input operation using an input means such as a keyboard having a plurality of input units such as keys, buttons, and a joystick and a dedicated controller. Generates speech information in syllable units such as “ka” composed of multiple single notes such as, and outputs the generated speech information as speech, thereby outputting unfinished speech and wrong speech as sentences Compared to a device that outputs after completing a sentence as a collection of syllables It is possible to perform the production to be uplifting for the experience the enhanced game.Moreover, as a trigger for determining the completion of an input operation for inputting a single sound, that is, by using time instead of a predetermined input operation such as sentence determination and transmission processing, for example, an unfinished voice such as “Mons” is output. It is possible to produce a situation where you can not speak to the end because you are attacked by a monster in the game in the middle of the conversation, so you can enhance the sense of reality and raise the mood for the game Is possible.
[0036]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, the present invention will be described in detail with reference to the drawings illustrating embodiments thereof.
FIG. 1 is an explanatory diagram conceptually showing the communication game system of the present invention.
1, 100, 100,... Are game devices of the present invention using computers such as home game devices and personal computers, and the game devices 100, 100,... Are connected via a communication network 300 such as the Internet. It is possible to connect to a central device 200 using a server computer, and a game progresses in real time between a plurality of operators who respectively operate a plurality of game devices 100, 100,... Via the central device 200. Various games such as a communication game are played.
[0037]
FIG. 2 is a block diagram showing the configuration of the game system of the present invention.
The game apparatus 100 applies the CPU 101 that controls the entire apparatus, the signal processor 102 that performs signal processing such as processing related to sound under the control of the CPU 101, the image rendering processor 103 that performs image rendering processing, and the speech output method of the present invention. A computer program 401 for games, a ROM cartridge that records various information such as data, a slot for reading various information from a recording medium 400 such as a CD-ROM and a DVD, an auxiliary storage means 104 such as a CD-ROM drive and a DVD drive, and A RAM 105 for temporarily storing information is provided.
[0038]
The data recorded on the recording medium 400 includes a dictionary database prepared based on a real language system such as Japanese and English or a virtual language system used only in a game.
Note that the voice output processing of the present invention may be speeded up by incorporating in the game apparatus 100 a dedicated chip for the dictionary database and a voice processor specialized for voice processing.
[0039]
Various information such as the computer program 401 and data of the present invention recorded on the recording medium 400 is read by the auxiliary storage means 104, stored in the RAM 105, and executed by the CPU 101, so that a game machine for home use, a personal computer, etc. The computer operates as the game apparatus 100 that implements the audio output method of the present invention.
[0040]
The game apparatus 100 also includes an input unit 107 such as a keyboard and a dedicated controller connected via the interface circuit 106. The input unit 107 includes a plurality of input units 107a such as keys, buttons, and a joystick. A person can perform an operation such as an operation of a player character as an operation target by performing an operation input using the input unit 107a.
In the following description, a mode in which a dedicated controller having an input unit 107a such as a button and a joystick operable in eight directions is used as the input unit 107 will be described.
[0041]
FIG. 3 is an external view showing the input means 107 provided in the game apparatus 100 of the present invention.
FIG. 3A shows an appearance viewed from the operator side during operation, and FIG. 3B shows an appearance viewed from the opposite side of the operator.
Note that the left and right in the following description are based on the direction viewed from the operator during operation, the front indicates the operator side shown in FIG. 3A, and the rear indicates FIG. 3B. The reverse side of the operator indicated by
As a button that is the input unit 107a, a cross button used for an operation such as direction indication is arranged on the left side of the front surface, and function buttons having symbols such as ○, Δ, □, and X are arranged on the right side of the front surface, and the left side of the rear surface The function buttons indicated by L1 and L2 are arranged on the right side, and the function buttons indicated by R1 and R2 are arranged on the right side of the back surface.
Each button does not have a fixed function, but can have various functions by changing a game or setting to be executed.
[0042]
In addition, two analog joysticks that can be operated in eight directions are arranged in the center of the front, and the degree of the acupressure that is pressed when the operation is input, the direction in which the finger is pressed down, and the length of the time that the button is pressed, etc. It is possible to detect.
[0043]
Furthermore, the game apparatus 100 includes an interface circuit 108 that is used to output audio information. The audio information that is a digital signal output from the interface circuit 108 is converted into an analog signal by the D / A converter 109, and the D / A converter The analog signal converted by 109 is amplified by the pre-main amplifier 110 and then sent to the sound output means 120 such as a speaker that outputs sound based on the sound information.
[0044]
The game apparatus 100 also includes an interface circuit 111 that is used to output image information. Image information that is a digital signal output from the interface circuit 111 is converted into an analog signal by the D / A converter 112, and is based on the image information. The image is output to the image output means 130 such as a television monitor that outputs the image.
One television may be used as a device that serves as both the audio output means 120 and the image output means 130.
[0045]
Furthermore, the game apparatus 100 includes a communication unit 113 such as a modem, and can connect to the communication network 300 by the communication unit 113 and communicate with other game apparatuses 100.
[0046]
The central apparatus 200 includes a CPU 201, a recording unit 202 such as a hard disk and a RAID, a RAM 203, and a communication unit 204 connected to the communication network 300. The recording unit 202 includes a computer program and a game apparatus 100 for executing a communication game. Various information such as data for authentication is recorded, and a service for executing a communication game is provided by executing a recorded computer program.
[0047]
Next, a sound processing method using the game apparatus 100 of the present invention will be described using the flowchart shown in FIG.
When an operator starts a game using the game apparatus 100 and makes a conversation with an operation target that is a player character, the operator performs an operation input a plurality of times using the input means 107.
In the game device 100, as an interrupt process during execution of the game program, an operation input is accepted (S101), the input unit 107a used for the operation input is identified (S102), and the strength, direction, and time of the operation input are identified. The information indicating the identified input unit 107a and the information indicating the degree are stored in the RAM 105 (S104).
The process from the reception of the operation input to the storage is repeated every time the operation input is received (S105), and when a plurality of operation inputs are received simultaneously, the situation is also stored.
[0048]
In addition, timing is started after first receiving an operation input (S106), and when the measured time reaches a predetermined time (S107: YES), the timing is terminated (S108) and generation of voice information is started. (S109).
As the voice information generation process, the operation input received from the time when the operation input is received in step S101 to the time when the time measurement is ended due to the arrival of the predetermined time in step S107, that is, stored in the RAM 105 when the time measurement is completed. Based on the information related to the operation input, a single sound specified by the operation input received from one input unit 107a or a plurality of operation inputs received simultaneously from the plurality of input units 107a, 107a is determined (S110); Based on the determined single note or a combination of multiple single notes, a syllable having volume, strength, high and low, and length components is determined (S111), and the determined syllable is detected by the detection process in step S103 or the like. The volume, strength, height, and length components are adjusted based on the result (S112), and the adjusted syllable is output as speech. Of generating the audio information (S113).
If there is a plurality of generated voice information, smoothing processing is performed so that the voice of the continuous voice information can be naturally heard as the voice of the player character (S114).
[0049]
The generated audio information is sent to the audio output means 120 (S115), and is output from the audio output means 120 as the operation object during the game, that is, the audio uttered by the player character (S116).
When there is a plurality of voice information, a plurality of voice information is handled as a batch voice information string, thereby enabling voices composed of a plurality of syllables, that is, utterance imitating a conversation that is a collection of syllables. It becomes.
[0050]
The operation input performed by the operator to generate the voice information in this way is an operation input for designating a single sound or an operation input for adjusting a syllable component, and an operation input for determining the input content or An operation input such as an operation input for sending the input content is not necessary.
This also means that the voice is output even when the operator's operation is wrong or when the operator cannot input to the end of a plurality of syllables.
[0051]
The generated speech information can be analyzed as a language by referring to a dictionary database prepared based on a real language system such as Japanese and English or a virtual language system used only in a game. Performed (S117), and based on the analyzed meaning, a process of operating the operation target and non-operation target in the game, that is, the player character and a character other than the player character is performed (S118). Thereby, the player character and other characters move based on the utterance of the player character, so that it is possible to produce a virtual conversation in the game.
[0052]
The non-operation target may be not only a living thing such as a person and an animal but also an object such as a vending machine. For example, when the player character outputs a voice “Please give me a meal ticket”, the player character automatically A virtual vending machine having a voice recognition function can be produced by performing an operation of putting money in the vending machine and the vending machine performing an operation of discharging the meal ticket.
[0053]
Next, voice information generation processing will be described.
The single sound received by the operation input in step S101 and the like and determined in step S110 indicates the minimum unit obtained by decomposing individual vowels such as “a” and “k” and sounds such as consonants.
[0054]
Table 1 shows an example of operation input for designating a single sound in the audio output method of the present invention.
In Table 1, the notation indicated as R2 + Δ indicates that the button indicated as R2 and the button indicated as Δ are simultaneously pressed.
[0055]
[Table 1]

[0056]
As shown in Table 1, the basics of a single sound are vowels indicated as “a”, “i”, “u”, “e”, and “o”, and “k”, “s”, “t”. , “N”, “h”, “m”, “y”, “r”, and “w”.
Note that the muddy sound and semi-muddy sound are specified by performing an operation input indicating muddy sound or semi-turbid sound when the consonant operation is input as the modified sound, for example, an operation input of tilting the joystick up or down. ”,“ D ”,“ b ”and“ p ”may be used.
[0057]
A single or a plurality of continuous single notes constitute syllables such as “a”, “i”, “ka”, and “shi”, which are units of speech recognized as a group of sounds.
For syllables with the syllable line “a”, specify a single note indicating a vowel, and for the syllables from the “ka” line to the “wa” line, specify a single sound indicating a consonant and a single sound indicating a vowel. Syllables are determined.
However, for “n”, a syllable is designated by an operation input of pressing the joystick.
[0058]
In the case of the example shown in Table 1, for a syllable composed of a plurality of single notes, it is necessary to designate a single sound a plurality of times. However, the present invention is not limited to this, and the syllable composed of a plurality of single notes by a single designation. As a specific example, the syllable “sa” composed of the single notes “s” and “a” may be determined by pressing a button labeled “L2”.
[0059]
There is an operation input to adjust the syllable volume, strength, height, height, and length as an operation input to adjust the syllable composition, and one example is operating the joystick at the same time as specifying a single vowel sound, and pressing intensity , Direction and length.
[0060]
For example, the volume of the syllable is adjusted according to the pressing intensity or pressing time of the joystick, and the sound is increased by tilting the joystick up, and the sound is decreased by tilting it down.
Further, by tilting the joystick to the right, the length of the syllable is lengthened. In particular, when the syllable has been tilted for a predetermined time or longer, the syllable is adjusted by determining it as a long sound. Conversely, when the joystick is tilted to the left, the length of the syllable is shortened. In particular, when the joystick is tilted to the left twice in succession, the syllable is adjusted by determining as a prompt sound.
[0061]
These adjustment operations can be arbitrarily set in advance, and it is also possible to express strength or inflection by adjusting the volume and length at the same time.
[0062]
Table 2 shows an example of operation input for uttering a sentence “I am fine today” in the audio output method of the present invention.
[0063]
[Table 2]

[0064]
Note that the examples shown in Table 1 and Table 2 are merely examples of operation inputs when expressing Japanese, and it is possible to make settings for determining syllables by other operation inputs. Further, it is possible to set to determine a virtual language.
[0065]
Alternatively, a sine wave having a different frequency may be assigned to each button in advance, and a plurality of sine waves whose amplitudes are adjusted according to the pressing state of each button may be combined to output a pseudo sound.
[0066]
Next, speech information smoothing processing will be described.
FIG. 5 is a flowchart showing a smoothing process of audio information using the game apparatus 100 of the present invention.
As a smoothing process in the case where there are a plurality of pieces of audio information shown in step S114 of FIG. 4, first, a single phone constituting a syllable indicated by two adjacent audio information is detected (S201), and the last single phone of the previous audio information is detected. Then, based on the first single sound of the subsequent sound information, intermediate sound information to be output between the two sound information is generated (S202).
[0067]
Table 3 is an explanatory diagram showing a method for generating intermediate sound information in the sound information smoothing process using the game apparatus 100 of the present invention.
[0068]
[Table 3]

[0069]
When a plurality of continuous voice information is “to”, “ki”, “me”, and “ki”, the single notes constituting each syllable are “t” and “o”, “k”, and “i”. , “M” and “e” and “k” and “i”, and “o” and “k”, “i” and “m”, and “e” and “k”, respectively, based on these single notes. Audio information indicating syllables to be output continuously is generated as intermediate audio information.
In this case, voice information that can be uttered as a Japanese syllable alone is not necessarily generated, and the length is preferably about 1/5 of normal voice information.
[0070]
In Table 3, “Voice_to” indicates a voice information code indicating syllable “to”, and “Voice_ok” indicates a voice information code indicating syllable “ok”.
[0071]
Then, the volume and / or high / low component of the syllable indicated by the next continuous audio information and intermediate audio information is adjusted (S203), and the adjusted audio information and intermediate audio information are converted into audio by the process of step S115 in FIG. The data is sent to the output means 120 (S204).
[0072]
FIG. 6 is a graph showing the adjustment of the syllable height component in the smoothing processing of audio information using the game apparatus 100 of the present invention.
In FIG. 6, the horizontal axis represents time, and the vertical axis represents frequency as syllable height. The syllable height is smoothed so that the frequency of the first part of the subsequent syllable gradually changes from the frequency of the previous syllable in successive syllables. it can.
As for the volume, each syllable can be clearly heard by temporarily reducing the volume between successive syllables.
[0073]
Also, before performing syllable adjustment processing and smoothing processing, semantic analysis processing is performed with reference to the dictionary database performed in step S117, and if there is a matching word, the strength and level of the word sound are preliminarily determined. The voice based on the voice information recorded in the dictionary database may be output in a state where the adjustment and smoothing of the components are performed.
[0074]
Next, communication processing of the game apparatus 100 and the central apparatus 200 used in the game system of the present invention will be described using the flowchart shown in FIG.
A plurality of game devices 100, 100,... Are provided with a communication game by accessing the central device 200 in advance and performing authentication, and between a plurality of operators who operate each of the game devices 100, 100,. And the game in real time progresses.
[0075]
Here, since the process of transmitting and receiving audio information using a plurality of game devices 100, 100,... Is described, for convenience, the game device 100 on the transmission side is set as one game device 100a, and the game device 100 on the reception side is set as another. However, there is no difference in the functions of the game apparatuses 100b.
[0076]
In addition, although expressed as another game device 100b, when three or more game devices 100, 100, 100,... Are used, a plurality of game devices 100b, 100b,. .
In one game apparatus 100a, the audio information generated by the processes in steps S101 to S114 of the audio process described with reference to FIG. 4 is transmitted to the central apparatus 200 that has been authenticated in advance to execute the communication game (S301). ).
Note that the audio information transmitted at this time may be an audio information string in which a plurality of audio information is collected.
[0077]
The central device 200 receives the sound information (S302), and transmits the received sound information to the other game device 100b (S303).
[0078]
The other game apparatus 100b receives the sound information (S304), sends the received sound information to the sound output means 120 (S305), and the operation target operated by the one game apparatus 100b from the sound means 120 speaks. Is output as a sound to be played (S306).
[0079]
As described above, voice information is transmitted from one terminal device 100a to another terminal device 100b, and the central device 200 is not used as a mere voice information relay device, but an operation input signal is transmitted to the central device 200. The central device 200 may perform processing such as single note and syllable determination, and may also perform processing such as single note and syllable determination in the other terminal device 100b.
[0080]
In the above-described embodiment, in the process of accepting the operation input designating a plurality of single sounds, the voice information is generated based on the operation input received until the predetermined time is reached. Not limited to, in the event of an attack in the game, for example, a monster attack, voice information may be generated based on the operation input accepted so far, and the situation where the utterance is interrupted by the monster attack It becomes possible to produce.
[0081]
【The invention's effect】
  As described above in detail, in the audio output method, game device, communication game system, computer program, and recording medium according to the present invention, a game that progresses in real time by connecting a plurality of game devices via a communication network such as the Internet. In a game such as, when performing a pseudo-conversation, based on an input operation using an input means such as a keyboard and a dedicated controller having a plurality of input units such as keys, buttons and joysticks,Multiple such as “k” and “a”Composed of single notes"Ka"The voice information is generated in units of syllables, etc., and the generated voice information is output as a voice, so that a situation where an unfinished voice and a wrong voice are output as a sentence occurs, Compared to a conventional game that is output after a sentence is completed, it is possible to produce an effect that enhances the sense of reality and enhances the mood of the game.
[0082]
Also, in the present invention, a special operation such as sentence determination and transmission processing is performed by using time instead of a predetermined input operation such as sentence determination and transmission processing as a trigger for determining completion of an input operation for inputting a single sound. For example, a situation in which an unfinished voice such as “Mons” is output occurs by outputting a voice based on voice information generated based on an operation input. Since it is possible to produce a situation in which words cannot be spoken to the end after being attacked by a monster, it is possible to produce an effect that can enhance the sense of reality and enhance the mood of the game.
[0083]
Furthermore, in the present invention, by adjusting the components by detecting the degree of acupressure, direction and time of pressing the analog joystick, it is possible to give changes such as accent, inflection, and pitch of the sound, so that the conversation is uncomfortable. It is possible to produce a natural utterance without any problems and to produce an effect that enhances the sense of reality.
[0084]
According to the present invention, when a plurality of syllables are output continuously, a process of inserting intermediate voice information between consecutive syllables and a process of adjusting continuous syllables are performed, so that a natural utterance without a sense of incongruity as a conversation is obtained. It is possible to perform an effect such as that it is possible to perform an effect that enhances the sense of reality.
[0085]
Moreover, in the present invention, collation is performed with a dictionary database prepared based on a real language system such as Japanese and English or a virtual language system used only in a game, and the meaning of the output speech is analyzed and analyzed. By performing the processing based on the meaning, for example, when the player character operated by the operator utters “Today's good weather”, characters other than the player character, that is, non-operation targets are “Yes, good weather”. By replying “It is possible to produce an effect that enhances the sense of reality and enhances the mood for the game,” and so on.
[Brief description of the drawings]
FIG. 1 is an explanatory diagram conceptually showing a communication game system of the present invention.
FIG. 2 is a block diagram showing a configuration of a game system of the present invention.
FIG. 3 is an external view showing input means provided in the game apparatus of the present invention.
FIG. 4 is a flowchart showing a sound processing method using the game apparatus of the present invention.
FIG. 5 is a flowchart showing a smoothing process of audio information using the game apparatus of the present invention.
FIG. 6 is a graph showing adjustment of syllable height components in a smoothing process of audio information using the game apparatus of the present invention.
FIG. 7 is a flowchart showing communication processing of the game device and the central device used in the game system of the present invention.
[Explanation of symbols]
100 game devices
200 Central equipment
300 communication network
400 recording media
401 Computer program

Claims (12)

In the sound output method for outputting sound from the output means based on the operation input received by the input means,
Accepts operation input indicating the consonant single sound and the vowel single sound that constitute the syllable,
Start timing after accepting operation input,
Operation When the input time is timed from accepting reaches a predetermined time, based on the received operation input, and starts generating the audio information indicating the syllables, and reaches a predetermined time after receiving an operation input Based on a plurality of operation inputs received during the period until one or more voice information is generated,
An audio output method comprising: outputting an audio including one or more syllables from an output unit based on the generated audio information. In a game apparatus including an input unit having a plurality of input units for receiving operation inputs, and generating sound information for outputting a sound from an output unit during execution of the game,
Determination means for determining a single sound that is a consonant and a single sound that is a vowel, which are designated by a plurality of operation inputs received by the input means;
Means for starting timing after receiving one operation input;
Generating means for generating audio information indicating a syllable composed of a plurality of single sounds and having components of volume, strength, high and low, and length based on a combination of the plurality of single sounds determined by the determining means ;
The generating means is configured to start generating audio information when the time being measured reaches a predetermined time, and has received the time from when one operation input is received until the predetermined time is reached. A game device characterized in that one or more sound information is generated based on a plurality of operation inputs .   The determination unit is configured to determine a single sound specified by an operation input received from one input unit or a plurality of operation inputs received simultaneously from a plurality of input units. The game device described. Means for detecting at least one of the intensity, direction and time of the operation input;
Based on the detected result, the game device according to claim 2 or claim 3, wherein the volume of syllables, intensity, further comprising a means for adjusting at least one of components of high and low and length. 3. The apparatus according to claim 2, further comprising: a unit that adjusts at least one of a syllable volume, strength, and height of syllables of successive audio information when there is a plurality of audio information generated by the generation unit. The game device according to claim 4 . When there is a plurality of pieces of voice information generated by the generation unit, the information generation unit includes means for generating intermediate voice information to be output between the two pieces of voice information based on the two pieces of neighboring voice information. The game device according to any one of claims 2 to 5 . The audio information, the game device according to any one of claims 2 to 6 the operation target in the game is characterized in that the sound to be uttered. Means for analyzing the meaning of the speech information as a language based on an existing language system or a virtual language system;
Game apparatus according to any one of claims 2 to 7, characterized in that it comprises a means for operating the operation target and / or non-operation target in the game based on the meanings and analyzed. A plurality of game devices according to any one of claims 2 to 8 ,
A central device for connecting the game device via a communication network,
One game device is
Means for transmitting the generated voice information to the central unit;
The central device is
Means for transmitting the received audio information to another game device;
Other game devices
A communication game system comprising means for outputting received voice information from an output means. In a communication game system in which a plurality of game devices having input means for receiving operation input and output means for outputting sound are connected via a communication network,
Determination means for determining a single sound that is a consonant and a single sound that is a vowel, specified by a plurality of operation inputs received by an input means included in one game device;
Means for starting timing after receiving one operation input;
A generating unit configured to generate audio information including a plurality of single notes and indicating a syllable based on a combination of the plurality of single notes determined by the determining unit;
With
The generating means includes
When the time counted reaches a predetermined time, the generation of voice information is to be started, and a plurality of operation inputs received from when one operation input is received until the predetermined time is reached. To generate one or more audio information based on
A communication game system , further comprising means for outputting the generated voice information from output means of another game device. In a computer program for generating sound information that causes a computer including an input means for receiving an operation input to output sound from an output means,
A procedure for causing a computer to determine a single sound that is a consonant and a single sound that is a vowel, designated by a plurality of operation inputs received by the input means;
A procedure for the computer to start timing after receiving one operation input;
The computer, on the basis of a plurality of single tones of combinations determined, a plurality of single notes, see contains a procedure for generating the audio information indicating the syllable,
The generation of the audio information is based on a plurality of operation inputs that are started when the time being counted reaches a predetermined time and from when one operation input is received until the predetermined time is reached. A featured computer program. In a computer-readable recording medium in which a computer program for generating sound information for outputting sound from an output means is recorded in a computer having an input means for receiving an operation input,
A procedure for causing a computer to determine a single sound that is a consonant and a single sound that is a vowel, designated by a plurality of operation inputs received by the input means;
A procedure for the computer to start timing after receiving one operation input;
The computer, on the basis of a plurality of single tones of combinations determined, a plurality of single notes, see contains a procedure for generating the audio information indicating the syllable,
The computer program based on a plurality of operation inputs that are started when the time being counted reaches a predetermined time and that has been received from when one operation input is received until the predetermined time is reached. A computer-readable recording medium characterized by the above-mentioned recording.

Images