JP2018072805A - Voice generation program and game device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a voice generation program capable of generating voices having contents with a high degree of freedom, in an expressive manner.SOLUTION: A voice generation program reads out word expressions related to predetermined text data from a storage unit, and synthesizes voices obtained by inputting the read-out word expressions into the text data to reproduce them. If a predetermined condition is established, the program generates: modified word expressions obtained by modification of changes in order of word characters composing the read-out word expressions; modified word expressions obtained by modification of additions of the word characters composing the read-out word expressions; or modified word expressions obtained by modification of replacement of at least one word character composing the read-out word expressions with a different word character. The program inputs the modified word expressions into the text data instead of the read-out word expressions. Then, after the reproduction of the modified word expressions, the programs reproduces recorded voices that are voice signals recorded in advance, thereby causing voices to be synthesized to make error to produce realistic conversations.SELECTED DRAWING: Figure 7

Description

  The present invention relates to a sound generation program and a game device for reproducing sound including sound synthesized based on text.

  When generating a sound corresponding to a scene in a video game or the like, a voice synthesis that synthesizes a voice waveform based on text data (see Patent Document 1), a voice playback that plays back a previously recorded voice, or the like is used. It is done.

JP2001-034282

  Since speech synthesis can synthesize speech based on text data for any sentence, it has a high degree of freedom and can make speech of a sentence flexible. On the other hand, since it takes time to synthesize an audio signal waveform, it is not possible to immediately generate audio. In addition, since the speech waveform is artificially synthesized, there is a drawback in that it is monotonous and cannot express emotion sufficiently.

  On the other hand, the recorded voice can be played back simply by reading the voice data from the memory, so it can be played back immediately, and if you record the sound with emotion as the recorded voice, A certain voice can be generated. On the other hand, since only pre-recorded sound can be reproduced, there is a drawback that it is not possible to generate flexible contents with low flexibility.

  An object of the present invention is to provide a sound generation program and a game device that can generate highly expressive sound with a high degree of freedom.

  According to a first aspect of the present invention, there is provided a speech generation program comprising: a computer having a storage unit; a first means for storing a phrase composed of a plurality of characters input by a user in the storage unit; a phrase associated with predetermined text data; A means for inserting a word read from the storage unit and read into the text data, and when a predetermined condition is satisfied, a modified word or phrase modified to change the order of the characters constituting the word read, or A second means for generating a modified word / phrase that is modified to further add characters constituting the read word / phrase, and inserting the modified word / phrase into the text data instead of the read word / phrase, and synthesizing the text data. Third means, first voice reproducing means for reproducing the synthesized voice, and a voice signal recorded in advance after reproduction of the modified phrase by the first voice reproducing means. Second sound reproducing means for reproducing sound audio, to function as a.

  According to a second aspect of the present invention, there is provided a speech generation program comprising: a computer having a storage unit; first means for storing a phrase composed of a plurality of characters input by a user in the storage unit; and a phrase associated with predetermined text data A means for inserting a phrase read from the storage unit and read into the text data, and when a predetermined condition is satisfied, a modified phrase that has been modified to replace at least one character constituting the read phrase with a different character A second means for generating and inserting the modified phrase into the text data in place of the read phrase; a third means for synthesizing the text data; a first voice reproducing means for reproducing the synthesized voice; After the correction word / phrase is reproduced by the first sound reproduction means, it is made to function as a second sound reproduction means for reproducing a recorded sound that is a sound signal recorded in advance.

  3. The sound generation program according to claim 1, wherein the second sound reproducing means selects the sound of the interjection corresponding to the wrong word as the recorded sound.

  In the above invention, the predetermined condition is that when the number of times the second means of the read word is used is less than or equal to the first predetermined number of times, the number of times that the read word is used by the second means is greater than the first predetermined number of times. The voice generation program according to any one of claims 1 to 3, wherein the voice generation program is a case where the number is more than a second predetermined number of times or is selected by random lottery.

  A game device according to a third aspect of the present invention includes the voice generation program, a storage unit that stores text data, an input operation unit, and a control unit that executes the voice generation program. The text data is a conversational sentence spoken to the user by a virtual speaker on the game, and words stored in the storage unit are input to the virtual speaker by the user using the input operation unit. It is characterized by that.

  According to the present invention, it is possible to generate a voice with a high degree of freedom based on text data by expressing it with the recorded voice.

It is a block diagram of the audio | voice production | generation apparatus with which this invention is applied. It is a figure explaining the procedure of the audio | voice generation by an audio | voice production | generation apparatus. It is a block diagram of a game device. It is a memory block diagram of a game device. It is a figure explaining the progress procedure of the game performed with a game device. It is a flowchart which shows the conversation process in the game of the control part of a game device. It is a flowchart which shows operation | movement of the control part of a game device in the case of inserting an incorrect word / phrase into text data, and dividing | segmenting immediately after that and reproducing | regenerating middle sound. It is a figure explaining the procedure of the audio | voice production | generation in the case of dividing | segmenting the reproduction | regeneration of synthetic | combination audio | voice and inserting a recording audio | voice in the middle. It is a figure explaining the procedure of the audio | voice generation | occurrence | production in the case of dividing | segmenting the production | generation of synthetic | combination audio | voice and inserting a recording audio | voice in the middle.

  A speech generator 100 to which the present invention is applied will be described with reference to the drawings. FIG. 1 is a functional block diagram of the voice generation device 100. FIG. 2 is a diagram illustrating a basic procedure of voice generation by the voice generation device 100. The speech generation apparatus 100 includes a speech synthesizer 101 that synthesizes speech data based on text data (hereinafter simply referred to as text) 110, and a speech playback unit 104 that plays back the speech data. I have.

  The voice reproduction unit 104 reproduces both the voice data (recorded voice) 111 recorded in advance and the voice data (synthesized voice) 112 synthesized by the voice synthesis unit 101. When the speech synthesizer 101 synthesizes speech based on the text 110, the speech playback unit 104 before and after playing back the synthesized speech 112, as shown in FIG. , The rear voice 111B) is reproduced.

  The recorded voice is, for example, voice (live voice) uttered by a voice actor or the like with rich expression. As a result, the synthesized voice 112 that is artificially synthesized and has a poor facial expression can be supplemented with the recorded voice.

  The text 110 supplied to the speech synthesizer 101 is accompanied by some emotion (for example, joy or surprise), for example. The recorded voice memory 103 stores a plurality of recorded voices corresponding to various emotions and expressing the emotions. As the front voice 111A and the rear voice 111B, those expressing emotions similar to the emotions of the supplied text (those classified into similar categories (see FIG. 4)) are selected.

  When the process of synthesizing and outputting the text 110 starts, first, the previous voice 111A is read from the memory 103 and is reproduced by the voice reproduction unit 104. While the previous speech 111A is being reproduced, the speech synthesizer 101 synthesizes the supplied text 110 (speech synthesis). The synthesized voice 112 synthesized by the voice synthesizing unit 101 is stored in the synthesis buffer 102, and after the previous voice 111A has been reproduced, it is reproduced following the previous voice 111A. During the reproduction of the synthesized voice 112, the rear voice 111B is read. When the reproduction of the synthesized voice 112 is finished, the voice reproducing unit 104 reproduces the subsequent voice 111B subsequently.

  Similarly to the previous voice 111A, the rear voice 111B also corresponds to the text 110 (the synthesized voice 112 synthesized by the voice synthesis section 101) supplied to the voice synthesis section 101 from the recorded voice 111 stored in the memory 103. What to do is selected. Note that the reading of the rear audio 111B from the memory 103 may be performed simultaneously with the reading of the front audio 111A.

  The rear audio 111B is preferably selected to be different from the previous audio 111A, but may be the same. The front voice 111A and the synthesized voice 112, and the synthesized voice 112 and the rear voice 111B may or may not be completely continuous, but the user can hear them as a series of audible sounds. It is preferable to play back continuously at intervals (for example, within 1 second). Both the front voice 111A and the rear voice 111B shown in FIG. 2 may be played back, but only the front voice 111A may be played.

  The speech generation device 100 described in FIGS. 1 and 2 can be applied to various devices that synthesize speech. For example, you may use for the production | generation of the conversation voice of the character in a video game. Hereinafter, a portable game machine and a game executed on the portable game device will be described as application examples of the sound generation device 100.

  The game described below as an example is a breeding game in which the character (AI) in the game and the user (game player) increase the knowledge of the character (AI) while having a conversation. The character utters words that speak to the user. The speech generation apparatus 100 described above is in charge of this word generation function.

  FIG. 3 is a block diagram of the game apparatus 1 in which the functions of the sound generation apparatus 100 are realized in cooperation with a program. In FIG. 3, the game apparatus 1 has a control unit 20, an operation unit 30, a game media interface 31, an SD card interface 32, a wireless communication circuit unit 33, and a microphone interface 34 on a bus 26. The control unit 20 includes a CPU 21, a ROM (flash memory) 22, a RAM 23, an image processor 24 and an audio processor 25.

  A video RAM (VRAM) 40 is connected to the image processor 24, and a display unit 41 is connected to the VRAM 40. The display unit 41 includes the upper display 10 and the lower display 11 described above. An amplifier 42 including a D / A converter is connected to the audio processor 25, and the speaker 16 and the earphone terminal 17 are connected to the amplifier 42.

  The operation unit 30 includes the touch panel 12, the button group 13, and the slide pad 14 described above. The operation unit 30 receives a user operation and generates an operation signal corresponding to the operation content. This operation signal is read by the CPU 21. The microphone interface 34 has a built-in A / D converter. A microphone 18 is connected to the microphone interface 34. The microphone interface 34 returns the sound collected by the microphone 18 to a digital signal and inputs it to the control unit 20.

  The game media interface 31 includes a media slot 31A, and performs read / write on the game media 5 set in the media slot 31A. The game media 5 is a dedicated semiconductor memory in which game data and a game program are stored. The game data includes a conversation sentence text 110 spoken by the character, and a recorded voice 111 used as a front voice and a rear voice. The game media 5 has a game history data storage area 50.

  The game history data includes words and the like input by the user in this game. When the game is once ended, game history data indicating the state of the game at that time is stored in the game history data storage area 50 from the RAM 23. Thereafter, when the game is resumed, it is transferred from the game history data storage area 50 to the RAM 23. The game media 5 is not limited to a dedicated semiconductor memory, and may be a general-purpose semiconductor memory or an optical disk.

  The SD card 6 is connected to the SD card interface 32. The SD card 6 is a micro SD card and is built in the lower housing 1B. The SD card 6 stores downloaded game programs and the like.

  In the RAM 23, a load area for storing the game program and game data read from the game media 5 and a work area used when the CPU 21 executes the game program are set. Therefore, the RAM 23 is provided with a storage area 61 for storing the conversation text 110 and the recorded voice 111, and an input phrase storage area 60 for storing words input by the user in the initial setting or conversation with the character. 1 is also provided in the RAM 23. The ROM 22 is configured by a flash memory, and a basic program for the game device 1 to read a game program from the game media 5 and execute the game is set.

  The image processor 24 has a GPU (Graphics Processing Unit) and forms an image of a character displayed on the upper display 10 and an image of a character panel displayed on the lower display 11. Draw on the VRAM 40.

  The sound processor 25 has a DSP (Digital Signal Processor) and generates game sound. In this game, the game voice includes a voice in which the character has a conversation with the user. The voice generation device 100 shown in FIG. 1 includes the control unit 20 (particularly the voice processor 25) of the game device 1 and the game program. Realized by collaboration. The amplifier 42 amplifies the audio signal by the audio processor 25 and outputs it to the speaker 16 and the earphone terminal 17.

  The wireless communication circuit unit 33 includes a 2.4 GHz band digital communication circuit, and performs Internet communication via a wireless access point and directly communicates with another game device 1. The wireless communication circuit unit 33 performs communication using the IEEE802.11g (so-called Wi-Fi) standard when performing Internet communication, and performs communication using the ad hoc mode of the IEEE802.11b standard or a unique standard when performing local communication. Do.

  Note that the voice synthesis unit 101 and the voice reproduction unit 104 in FIG. 1 are realized in cooperation with the control unit 20 and the game program.

  FIG. 4 is a diagram for explaining a storage form of the conversation sentence text 110 and the recorded voice 111 which are a part of the game data. FIG. 4A is a diagram showing the configuration of the storage area 61 for text 110 and recorded voice 111. The storage area 61 is divided into a plurality of categories, and each category is divided into a plurality of subcategories.

  The category is, for example, a rough classification of emotions such as “joy”, “normal”, and “crisp”. The subcategory represents a specific emotion in the category (rough feeling). For example, the “joyful” category includes subcategories such as “happy”, “satisfied”, “happy”, “easy”, and “relaxed”. The “normal” category includes subcategories such as “confirmation”, “denial”, “conceived”, and “everyone”.

  In each subcategory, text of one or more conversation sentences (conversation sentence data) and one or more recorded voices are stored. A category and a conversation sentence 110 corresponding to the progress of the game are selected at a predetermined conversation timing, and recorded voices corresponding to the category are selected as the front voice 111A and the rear voice 111B.

  FIG. 4B is a diagram showing a specific example of a part of the voice generation data storage area. This figure shows an example of the storage area of the “joyful” category. The “joyful” category includes subcategories of “happy”, “satisfied”, “happiness”, “easy”, and “relaxed”, and each subcategory area stores one or more conversation sentences and recorded voices. .

  As a conversation sentence, text such as “I am glad to receive XX” and “Looks good” is stored. “XX” in a part of the text indicates a blank, and a phrase (input phrase) input by the user is applied (inserted) to this place.

  As the recorded voice, short voices such as interjections expressing “happy” feelings such as “Wow ~”, “Wow”, “I did it!” Are stored. Based on the stored conversational sentence and the recorded voice, a utterance of a character such as “Wow, I am glad to receive a present. I did it!” Is generated.

  Further, some or all of the recorded voices stored may be common to a plurality of categories. For example, memorize words such as “haha”, “um”, “hah”, or laughter such as “hahaha”, “ufu”, “ca”, etc. Also good. These recorded voices may be used in common for all categories, or may be used in common for some (a plurality of) categories.

  In addition, when the same word, for example, “U” is used in a plurality of categories, it may be stored as a recorded voice for each category. In this case, it is only necessary to record what is pronounced with an expression according to the category.

  Further, a plurality of blanks may be provided in the conversation sentence. For example, “Do you like △△? For example, the user's name or the words registered by the user are applied to OO and △ Δ.

  FIG. 5 is a diagram illustrating the order and flow of conversations performed by the control unit 20 of the game apparatus 1 and the user. At the start of the game, the control unit 20 registers the profile and preferences with the game device 1 (S100). And the control part 20 memorize | stores the input content in the input phrase memory | storage area 60 by the control part 20 (S101).

  Thereafter, the control unit 20 starts a game in which the user and the character go on a journey together in the game (S110). And the control part 20 performs the event in which a character and a user have a conversation for every scene in the middle of a trip (S120).

  The conversation is conducted in the following procedure. First, the control part 20 performs the event which a character asks a user a question (S121), and receives the user's answer with respect to this (S122).

  The character performs a conversation by applying a phrase registered by the user to the conversation sentence. In response to this, the user's conversation is input by selecting a character from the character palette displayed on the lower screen.

  The control unit 20 stores the answer input by the user and updates (learns) the content (answer to the question). By repeating this conversation event, the number of phrases stored in the input phrase storage area 60 increases, and the attributes (meanings) of the phrases are accumulated. As a result, it is possible to express how the character grows.

  FIG. 6 is a flowchart showing the operation of the control unit 20 that creates a comment of a character. This process is executed in response to a periodic trigger. First, the control unit 20 determines the current game situation (S10). The control unit 20 determines whether or not now is the conversation timing based on the game situation (S11). If the current timing is not the conversation timing based on the game situation (NO in S11), the control unit 20 ends the operation as it is.

  If it is determined that the current timing is the conversation timing based on the game situation (YES in S11), the control unit 20 selects a conversation category or conversation sentence to be generated based on the current game situation ( S12). Note that the selection of the category and the conversation sentence may be performed randomly.

  Next, the control part 20 selects the phrase applied to the blank of the selected conversation sentence from the input phrase storage area 60 (S13). This completes the conversation text 110. Then, the control unit 20 selects the front voice 111A and the rear voice 111B from the recorded voices 111 classified into the same category as the conversation sentence (S14).

  The control unit 20 outputs the text of the completed conversation sentence to the voice synthesis unit 101 to instruct voice data synthesis (S15), and inputs the previous voice 111A to the voice reproduction unit 104 for reproduction (S16). The playback of the previous speech 111A continues for about 1 to 2 seconds, and during this time, the control unit 20 synthesizes the speech of the conversation sentence.

  When the reproduction of the previous voice 111A is completed (S17), the control unit 20 causes the voice reproduction unit 104 to reproduce the synthesized voice 112 synthesized by the voice synthesis unit 101 (S18). When the reproduction of the synthesized speech 112 is completed (S19), the control unit 20 causes the audio reproduction unit 104 to reproduce the post-sound 111B (S20). The control unit 20 receives an input of an answer by the user along with this reproduction (S21). The control unit 20 stores the input answer phrase in the input phrase storage area 60 (S22).

  Note that the control unit 20 may randomly apply a phrase to a conversation sentence without considering the meaning. For example, when the words “Capcom” and “Cake” are stored in the storage unit due to user operation input, usually “Eh, that (Capcom) is working hard. When the input phrase is used in the usage, or “Eh, that (cake) seems to be delicious. Uh.”, “Eh, that (Capcom) seems to be delicious. Input phrases may be used in unusual ways such as “.”.

In this conversation sentence, “e-” and “u-n” are the pre-speech and post-speech, and “capcom” enclosed in parentheses is a phrase inserted. In other words, this conversation sentence is an example in which the phrase “capcom” (mismatch phrase) is inserted into the text data “It seems to be delicious” without regard to the information that it is not food. In this game, the cuteness of the character and the learning level are produced by using the wrong phrase.

  Further, the control unit 20 causes the character to have a conversation with “Eh, that Capcom seems to be delicious. . At this time, when the user responds (inputs) “Capcom is not food”, the control unit 20 stores (learns) that Capcom is not food. The control unit 20 may display a plurality of answer options in parallel with the question, and allow the user to select an appropriate option, thereby obtaining the user's response.

The following is an example of a form in which words are mistaken.
(1) Make the word meaning wrong. For example, “I ate a tire yesterday.”
(2) Make a mistake in the sound of the phrase. For example, “baseball (Yaku)” is synthesized with “Yakyu”.
(3) Make the word order wrong. For example, “Yamamoto” is synthesized with “Yamato”.
(4) Don't sound smoothly. For example, “Mesopotamia” is voice-synthesized with “Mesopopo, Potamia”.
Etc.

  “Tire”, “baseball”, “Yamamoto”, and “Mesopotamia” are input phrases that are stored in the storage unit by user operation input. On the other hand, “Yagu”, “Yamatomo”, “Mesopopo, Potamia” are phrases stored in the storage unit as mismatched phrases as these input phrases are stored. The control unit 20 generates a mismatch phrase by correcting a part of the phrase input by the user.

  Note that the control unit 20 may generate the mismatched phrase by correcting a part of the phrase when generating the mismatched phrase in the wrong usage. When newly registering an input phrase, a mismatch phrase may be stored in parallel, or a mismatch phrase may be generated when a conversation sentence is generated.

  In the game, the user teaches the character by talking to the character. On the other hand, immediately after learning this phrase, the character uses it without obtaining information on the meaning and pronunciation of the phrase. That is, the control unit 20 uses an input word randomly inserted into a part of text data stored in advance in the storage unit. And the control part 20 accumulate | stores the information of an input phrase by conversation, and selects the phrase based on text data so that it may become an appropriate conversation.

In addition, when a predetermined condition is satisfied, the control unit 20 changes the pronunciation of the input phrase or changes the word order, and selects the mismatch phrase by changing to the input phrase. For example, when an input phrase is used for the first time or is used less than 10 times (representing a state where the meaning of the word is not well understood), random (inadvertently expressing a mistake), or the input phrase is used 100 times If it is present (representing a playful state), the predetermined condition can be used. As a result, it is possible to express in conversation that the character does not understand the meaning of the word, is inadvertently wrong, or is joking.

  Also, the phrase may be mistaken as described above in the conversation sentence, and the recorded voice may be generated immediately after the mistaken phrase. For example, immediately after making a mistake, an embarrassed phrase such as “Taehe” may be inserted in the recorded voice. Furthermore, after that, the control unit 20 may synthesize a text including a phrase used in a correct usage.

  FIG. 7 is a diagram for explaining the procedure of voice generation according to the embodiment of the present invention. In this embodiment, the control unit 20 inserts a mismatch phrase into the conversation sentence, interrupts the reproduction of the conversation sentence after reproducing the mismatch phrase, and transmits a short recorded voice such as “Tahe” or “Ah” as a medium voice. Play as. Thereby, the expression of the conversation sentence is performed more efficiently.

  FIG. 7 is a flowchart showing the operation of the control unit 20 when a recorded voice is played back as a middle voice after inserting a mismatched phrase into a conversation sentence and playing back the mismatched phrase. FIG. 8 is a diagram showing a procedure of voice generation by the voice generation device 100. This process is executed in response to a periodic trigger. First, the control unit 20 determines the current game situation (S30). The control unit 20 determines whether or not now is the conversation timing based on the game situation (S31). If it is not the timing (NO in S31), the control unit 20 ends the operation as it is.

  When determining that it is the timing of the conversation (YES in S31), the control unit 20 selects a conversation category or conversation sentence to be generated based on the current game situation (S32). Next, the control part 20 selects the phrase applied to the blank of the selected conversation sentence from the input phrase storage area 60 (S33). At this time, the control unit 20 may ignore the correspondence between the conversation sentence and the phrase and select a phrase at random. Further, the control unit 20 changes the pronunciation and word order of the selected phrase to make a mistaken phrase (S34). Either one of the word selection mistake in S33 or the pronunciation mistake in S34 may be applied, or both may be applied. In addition, immediately after the mistaken word / phrase is defined as a divided part of the conversation sentence.

  The control unit 20 selects the front voice 111A and the rear voice 111B from the recorded voices classified into the same category as the selected conversation sentence, and selects the middle voice 111C to be reproduced immediately after the mistaken phrase. (S35). The middle voice 111C reproduced immediately after the mistaken phrase may be classified for each category, or may be classified as a recorded voice corresponding to the mistake, separately from the category of the conversation sentence.

  After that, the control unit 20 outputs the text of the conversation sentence to the voice synthesis unit 101 to instruct the synthesis of voice data (S36) and instruct to reproduce the previous voice 111A (S37). The control unit 20 waits until the playback of the previous voice 111A is finished in S38, and when the playback of the previous voice is finished (YES in S38), the part of the synthesized voice synthesized by the voice synthesis unit 101 that has the wrong word / phrase The first half portion 112A until is input to the audio reproduction unit 104 and reproduced (S40).

  When the reproduction of the first half 112A of the synthesized voice is completed (YES in S41), the control unit 20 reproduces the medium voice 111C such as “Taehe” and “Ah” on the voice reproduction unit 104 (S42). When the reproduction of the medium voice 111C is completed (YES in S43), the control unit 20 reproduces the second half 112B of the synthesized voice on the voice reproduction unit 104 (S44). Then, when the reproduction of the second half 112B of the synthesized voice is completed (YES in S45), the control unit 20 reproduces the rear voice 111B on the voice reproduction unit 104 (S46). The control unit 20 receives an input of an answer by the user along with this reproduction (S47). The control unit 20 stores the input answer phrase in the input phrase storage area 60 (S48).

  Further, when the text of the conversation sentence is long, the conversation sentence may be divided into a plurality of phrases. In this case, it is only necessary to synthesize and reproduce voices for each phrase, and to insert a recorded voice between each phrase. What is necessary is just to synthesize | combine the audio | voice of the phrase immediately after that during the reproduction | regeneration of the recorded audio | voice inserted. Similarly, when synthesizing multiple conversation sentences in succession, a recorded voice is inserted between the conversation sentences and the conversation sentence is synthesized during playback of the recorded voice. You just have to do it.

  FIG. 8 and FIG. 9 are diagrams for explaining the procedure of voice generation when mismatch words are inserted (when middle voice is generated). Here, the conversation sentence is divided into a plurality of phrases (two in this example), and a short recorded voice such as “Taehe” or “Ah” is inserted at the boundary between the phrase and the phrase. This makes it possible to more efficiently perform facial expression when a word is mistaken.

  In this way, it is possible to enrich the expression more realistically by making a mistake in the phrase in the conversation sentence and inserting the recorded voice 111 that is a live voice immediately after that.

  In the example of FIGS. 7 and 8, the text 110 is synthesized during the playback of the previous voice 111A, but the first half of the text (corresponding to the synthesized voice 112A) is synthesized during the playback of the previous voice 111A and the second half (to the synthesized voice 112B). May be synthesized during playback of the middle voice 111C.

  FIG. 9 is a diagram showing a procedure in the case where a conversational sentence is divided into two phrases at a wrong place and voice synthesis is performed for each phrase.

  When the text 110 having an error is determined and the process of synthesizing and outputting the voice is started, first, the previous voice 111A is read from the memory 103 and reproduced by the voice reproducing unit 104. While the previous speech 111A is being played back, the speech synthesizer 101 synthesizes (synthesizes speech) the first half phrase (the first half of the conversation sentence) up to the wrong place. The synthesized voice 112A synthesized by the voice synthesizing unit 101 is stored in the synthesis buffer 102, and after the previous voice 111A has been reproduced, it is reproduced following the previous voice 111A. During the reproduction of the synthesized voice 112A, the middle voice 111C that is a recorded voice reproduced between phrases is read out. When the reproduction of the synthesized voice 112A is finished, the voice reproducing unit 104 reproduces the middle voice 111C subsequently. The middle voice 111C can be read any time after the previous voice 111A is read and until the generation of the synthesized voice 112A is completed.

  As the middle voice 111C, for example, a voice such as “Tehhe” or “Ah” as described above, such as concealment of an error, is selected. While the middle voice 111C is being reproduced, the voice synthesizer 101 synthesizes the second half phrase (second half of the conversation sentence). The second half synthesized voice 112B synthesized by the voice synthesizing unit 101 is stored in the synthesis buffer 102, and after the reproduction of the middle voice 111C is finished, it is reproduced following the middle voice 111C. The later voice 111B is read during the reproduction of the second half synthesized voice 112B. When the reproduction of the synthesized voice 112B is finished, the voice reproducing unit 104 reproduces the subsequent voice 111B subsequently.

  In the above embodiment, as shown in FIGS. 7 to 9, the recorded voice 111 (the front voice 111A and the rear voice 111B) is added before and after the conversation sentence (synthesized voice) 112, that is, the conversation sentence is recorded voice. It is sandwiched between. These front voice 111A and rear voice 111B may be omitted, or only one of them may be added.

  Note that the voice synthesis unit 101 may change the speed, pitch, volume, and the like of the synthesized voice 112 according to the content of the conversation sentence and the game situation. In that case, the parameter is provided to the sound reproduction unit 104, and the sound reproduction unit 104 reproduces the recorded sound 111 at a speed, pitch, and volume in accordance with the synthesized sound 112. Also, the voice synthesizer 101 synthesizes voice at normal speed, pitch, and volume, and the voice playback unit 104 speeds both the synthesized voice 112 and the recorded voice 111 according to the content of the conversation sentence and the game situation. In addition, playback may be performed by adjusting the pitch and volume.

  Note that the ending of the post-speech 111B may be changed according to the character of the character, the degree of character growth, the character's clothes, and the like. That is, after selecting a word such as “~ nya” or “It is ~”, it may be added to the end of the voice and reproduced. In addition, voices of “XX Nya” and “It is XX” (XX is a phrase) may be stored in advance as recorded voices.

  Further, the volume and sound quality of the generated sound (sound that the character speaks) may be changed according to the location on the game. For example, you may generate a voice with a guilloche voice when the place is on a train, and a voice with a cheerful voice under the blue sky.

DESCRIPTION OF SYMBOLS 1 Game device 5 Game media 20 Control part 21 CPU
22 ROM (flash memory)
50 game history data storage area 60 input phrase storage area 61 (conversation sentence, voice recording) storage area 100 voice generation device 101 voice synthesis unit 104 voice reproduction unit

Claims (5)

A computer with a storage unit
First means for storing, in the storage unit, a phrase composed of a plurality of characters input by a user;
A means for reading a word / phrase associated with predetermined text data from the storage unit and inserting the read word / phrase into the text data, and constitutes the read word / phrase when a predetermined condition is satisfied. A modified word / phrase modified to change the order of characters or a modified word / phrase modified to further add characters constituting the read word / phrase are generated, and the modified word / phrase is replaced with the read word / phrase. A second means of inserting into the text data;
A third means for synthesizing the text data;
First sound reproducing means for reproducing the synthesized sound; and
Second sound reproducing means for reproducing a recorded sound which is a sound signal recorded in advance after the reproduction of the modified phrase by the first sound reproducing means;
Voice generation program to function as. A computer with a storage unit
First means for storing, in the storage unit, a phrase composed of a plurality of characters input by a user;
A means for reading a word / phrase associated with predetermined text data from the storage unit and inserting the read word / phrase into the text data, and constitutes the read word / phrase when a predetermined condition is satisfied. A second means for generating a modified word / phrase modified by replacing at least one character with a different character, and inserting the modified word / phrase into the text data instead of the read word / phrase;
A third means for synthesizing the text data;
First sound reproducing means for reproducing the synthesized sound; and
Second sound reproducing means for reproducing a recorded sound, which is a sound signal recorded in advance, after the correction phrase is reproduced by the first sound reproducing means;
Voice generation program to function as.   3. The sound generation program according to claim 1, wherein the second sound reproduction unit selects an interjection sound corresponding to an incorrect word as the recorded sound. 4.   The predetermined condition is that when the number of times the second word is used by the second means is equal to or less than a first predetermined number of times, the number of times the second word is used by the second means is the first predetermined number. The sound generation program according to any one of claims 1 to 3, which is a case where the number is a second predetermined number or more which is greater than the number of times, or a case where the number is selected by random lottery. The speech generation program according to any one of claims 1 to 4, the storage unit that stores the text data, an input operation unit, and a control unit that executes the speech generation program.
The text data is a conversation sentence spoken to the user by a virtual speaker on the game,
The phrase stored in the storage unit is a phrase that the user has input to the virtual speaker using the input operation unit.
Game device.

Images