JP2018025706A - Voice generator - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a voice reproduction device which can generate voice with a highly free content expressively.SOLUTION: The voice generator includes: a text storage section for storing a plurality of pieces of text data; a recorded voice storage section for storing a plurality of recorded voices; a voice synthesis section for synthesizing a selected piece of text data with a voice signal; a recorded voice reading section for reading a recorded voice from the storage section; and a voice reproduction section for reproducing a voice signal. The voice reproduction section reproduces a recorded voice continuously before and after a synthesis voice when reproducing the synthesis voice synthesized by the voice synthesis section. A recorded voice is made of a human voice, for example, colorfully expressing the emotions of text data.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an audio generation apparatus that reproduces audio including audio synthesized based on text.

  When generating a sound according to a scene in a video game or the like, a voice synthesis that synthesizes a voice waveform based on text data (see Patent Document 1), or a voice playback that plays back a previously recorded voice. Etc. are used.

JP2001-034282

  Since speech synthesis can synthesize speech based on text data for any sentence, it has a high degree of freedom and can make speech of a sentence flexible. On the other hand, since it takes time to synthesize an audio signal waveform, it is not possible to immediately generate audio. In addition, since the speech waveform is artificially synthesized, there is a drawback in that it is monotonous and cannot express emotion sufficiently.

  On the other hand, the recorded voice can be played back simply by reading the voice data from the memory, so it can be played back immediately, and if you record the sound with emotion as the recorded voice, A certain voice can be generated. On the other hand, since only pre-recorded sound can be reproduced, there is a drawback that it is not possible to generate flexible contents with low flexibility.

  An object of the present invention is to provide an audio reproducing apparatus capable of generating a highly expressive audio with rich expression.

  The speech generation device of the present invention includes a speech synthesizer that synthesizes speech signals based on text data to generate synthesized speech, a recorded speech storage unit that pre-stores recorded speech that is speech signals in a storage unit, and recorded speech Are recorded from the storage unit, and a sound reproduction unit that reproduces the sound signal and the recorded sound. The sound reproduction unit reproduces the synthesized sound before reproducing the synthesized sound. It is characterized in that at least one of the previous voice that is the recorded voice, the subsequent voice that is the recorded voice that is played after the synthesized voice is played back, and the middle voice that is played back during the playback of the synthesized voice is further played back.

  In the above invention, when the voice reproduction unit reproduces the previous voice, the recorded voice reading unit reads the previous voice from the storage unit before the voice synthesis unit generates the synthesized voice, and the voice reproduction unit performs the synthesis by the voice synthesis unit. The previous sound may be played back during the sound generation.

  In the above invention, when the audio reproducing unit reproduces the post-sound, the recorded sound reading unit may read the post-sound from the storage unit while the sound reproducing unit is generating the synthesized sound.

  In the above invention, when the sound reproduction unit reproduces medium sound, the recorded sound reading unit reads medium sound from the storage unit while the sound reproduction unit generates the first half of the synthesized sound, and the sound reproduction unit The middle voice may be played after the first half of the voice and before the second half of the synthesized voice.

  In the above invention, a text storage unit that stores a plurality of text data for each category may be further provided, and the recorded voice storage unit may store a plurality of recorded voices for each category. The speech synthesizer selects text data from a plurality of text data stored in the text storage unit to synthesize a speech signal, and the speech read unit selects a recorded voice of the same or similar category as the text data You may make it read.

  In the above invention, the voice synthesis unit, the recorded voice storage unit, the recorded voice reading unit, and the voice playback unit may be realized by a control unit that executes a video game. The text data is a conversational sentence spoken to the user by a virtual speaker on the game, and the virtual speaker has continuous or stepwise emotion parameters that change as the game progresses. The category may be set based on a virtual speaker emotion parameter.

  According to the present invention, it is possible to generate a voice with a high degree of freedom based on text data by expressing it with the recorded voice.

It is a block diagram of the audio | voice production | generation apparatus which is embodiment of this invention. It is a figure explaining the procedure of the audio | voice generation by an audio | voice production | generation apparatus. It is a block diagram of a game device. It is a memory block diagram of a game device. It is a figure explaining the progress procedure of the game performed with a game device. It is a flowchart which shows the conversation process in the game of a game device control part. It is a figure explaining the procedure of the audio | voice production | generation in the case of producing | generating the voice of a long sentence. It is a flowchart which shows the conversation process corresponding to a long conversation sentence.

  An audio generator 100 according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a functional block diagram of the voice generation device 100. FIG. 2 is a diagram illustrating a procedure of voice generation by the voice generation device 100. The speech generation apparatus 100 includes a speech synthesizer 101 that synthesizes speech data based on text data (hereinafter simply referred to as text) 110, and a speech playback unit 104 that plays back the speech data. I have.

  The voice reproduction unit 104 reproduces both the voice data (recorded voice) 111 recorded in advance and the voice data (synthesized voice) 112 synthesized by the voice synthesis unit 101. When the speech synthesizer 101 synthesizes speech based on the text 110, the speech playback unit 104 before and after playing back the synthesized speech 112, as shown in FIG. , The rear voice 111B) is reproduced.

  The recorded voice is, for example, voice (live voice) uttered by a voice actor or the like with rich expression. As a result, the synthesized voice 112 that is artificially synthesized and has a poor facial expression can be supplemented with the recorded voice.

  The text 110 supplied to the speech synthesizer 101 is accompanied by some emotion (for example, joy or surprise), for example. The recorded voice memory 103 stores a plurality of recorded voices corresponding to various emotions and expressing the emotions. As the front voice 111A and the rear voice 111B, those expressing emotions similar to the emotions of the supplied text (those classified into similar categories (see FIG. 4)) are selected.

  When the process of synthesizing and outputting the text 110 starts, first, the previous voice 111A is read from the memory 103 and is reproduced by the voice reproduction unit 104. While the previous speech 111A is being reproduced, the speech synthesizer 101 synthesizes the supplied text 110 (speech synthesis). The synthesized voice 112 synthesized by the voice synthesizing unit 101 is stored in the synthesis buffer 102, and after the previous voice 111A has been reproduced, it is reproduced following the previous voice 111A. During the reproduction of the synthesized voice 112, the rear voice 111B is read. When the reproduction of the synthesized voice 112 is finished, the voice reproducing unit 104 reproduces the subsequent voice 111B subsequently.

  Similarly to the previous voice 111A, the rear voice 111B also corresponds to the text 110 (the synthesized voice 112 synthesized by the voice synthesis section 101) supplied to the voice synthesis section 101 from the recorded voice 111 stored in the memory 103. What to do is selected. Note that the reading of the rear audio 111B from the memory 103 may be performed simultaneously with the reading of the front audio 111A.

  The rear audio 111B is preferably selected to be different from the previous audio 111A, but may be the same. The front voice 111A and the synthesized voice 112, and the synthesized voice 112 and the rear voice 111B may or may not be completely continuous, but the user can hear them as a series of audible sounds. It is preferable to play back continuously at intervals (for example, within 1 second). Both the front audio 111A and the rear audio 111B shown in FIG. 2 may be reproduced, but only one of them may be reproduced.

  The speech generation device 100 described in FIGS. 1 and 2 can be applied to various devices that synthesize speech. For example, you may use for the production | generation of the conversation voice of the character in a video game. Hereinafter, a portable game machine and a game executed on the portable game device will be described as application examples of the sound generation device 100.

  The game described below as an example is a breeding game in which the character (AI) in the game and the user (game player) increase the knowledge of the character (AI) while having a conversation. The character utters words that speak to the user. The speech generation apparatus 100 described above is in charge of this word generation function.

  FIG. 3 is a block diagram of the game apparatus 1 in which the functions of the sound generation apparatus 100 are realized in cooperation with a program. In FIG. 4, the game apparatus 1 has a control unit 20, an operation unit 30, a game media interface 31, an SD card interface 32, a wireless communication circuit unit 33, and a microphone interface 34 on a bus 26. The control unit 20 includes a CPU 21, a ROM (flash memory) 22, a RAM 23, an image processor 24 and an audio processor 25.

  A video RAM (VRAM) 40 is connected to the image processor 24, and a display unit 41 is connected to the VRAM 40. The display unit 41 includes the upper display 10 and the lower display 11 described above. An amplifier 42 including a D / A converter is connected to the audio processor 25, and the speaker 16 and the earphone terminal 17 are connected to the amplifier 42.

  The operation unit 30 includes the touch panel 12, the button group 13, and the slide pad 14 described above. The operation unit 30 receives a user operation and generates an operation signal corresponding to the operation content. This operation signal is read by the CPU 21. The microphone interface 34 has a built-in A / D converter. A microphone 18 is connected to the microphone interface 34. The microphone interface 34 returns the sound collected by the microphone 18 to a digital signal and inputs it to the control unit 20.

  The game media interface 31 includes a media slot 31A, and performs read / write on the game media 5 set in the media slot 31A. The game media 5 is a dedicated semiconductor memory in which game data and a game program are stored. The game data includes a conversation sentence text 110 spoken by the character, and a recorded voice 111 used as a front voice and a rear voice. The game media 5 has a game history data storage area 50.

  The game history data includes words and the like input by the user in this game. When the game is once ended, game history data indicating the state of the game at that time is stored in the game history data storage area 50 from the RAM 23. Thereafter, when the game is resumed, it is transferred from the game history data storage area 50 to the RAM 23. The game media 5 is not limited to a dedicated semiconductor memory, and may be a general-purpose semiconductor memory or an optical disk.

  The SD card 6 is connected to the SD card interface 32. The SD card 6 is a micro SD card and is built in the lower housing 1B. The SD card 6 stores downloaded game programs and the like.

  In the RAM 23, a load area for storing the game program and game data read from the game media 5 and a work area used when the CPU 21 executes the game program are set. Therefore, the RAM 23 is provided with a storage area 61 for storing the conversation text 110 and the recorded voice 111, and an input phrase storage area 60 for storing words input by the user in the initial setting or conversation with the character. 1 is also provided in the RAM 23. The ROM 22 is configured by a flash memory, and a basic program for the game device 1 to read a game program from the game media 5 and execute the game is set.

  The image processor 24 has a GPU (Graphics Processing Unit) and forms an image of a character displayed on the upper display 10 and an image of a character panel displayed on the lower display 11. Draw on the VRAM 40.

  The sound processor 25 has a DSP (Digital Signal Processor) and generates game sound. In this game, the game voice includes a voice in which the character has a conversation with the user. The voice generation device 100 shown in FIG. 1 includes the control unit 20 (particularly the voice processor 25) of the game device 1 and the game program. Realized by collaboration. The amplifier 42 amplifies the audio signal by the audio processor 25 and outputs it to the speaker 16 and the earphone terminal 17.

  The wireless communication circuit unit 33 includes a 2.4 GHz band digital communication circuit, and performs Internet communication via a wireless access point and directly communicates with another game device 1. The wireless communication circuit unit 33 performs communication using the IEEE802.11g (so-called Wi-Fi) standard when performing Internet communication, and performs communication using the ad hoc mode of the IEEE802.11b standard or a unique standard when performing local communication. Do.

  Note that the voice synthesis unit 101 and the voice reproduction unit 104 in FIG. 1 are realized in cooperation with the control unit 20 and the game program.

  FIG. 4 is a diagram for explaining a storage form of the conversation sentence text 110 and the recorded voice 111 which are a part of the game data. FIG. 4A is a diagram showing the configuration of the storage area 61 for text 110 and recorded voice 111. The storage area 61 is divided into a plurality of categories, and each category is divided into a plurality of subcategories.

  The category is, for example, a rough classification of emotions such as “joy”, “normal”, and “crisp”. The subcategory represents a specific emotion in the category (rough feeling). For example, the “joyful” category includes subcategories such as “happy”, “satisfied”, “happy”, “easy”, and “relaxed”. The “normal” category includes subcategories such as “confirmation”, “denial”, “conceived”, and “everyone”.

  In each subcategory, text of one or more conversation sentences (conversation sentence data) and one or more recorded voices are stored. A category and a conversation sentence 110 corresponding to the progress of the game are selected at a predetermined conversation timing, and recorded voices corresponding to the category are selected as the front voice 111A and the rear voice 111B.

  FIG. 4B is a diagram showing a specific example of a part of the voice generation data storage area. This figure shows an example of the storage area of the “joyful” category. The “joyful” category includes subcategories of “happy”, “satisfied”, “happiness”, “easy”, and “relaxed”, and each subcategory area stores one or more conversation sentences and recorded voices. .

  As a conversational sentence, sentences such as “I am glad to receive XX” and “Looks good” are stored. “XX” in the sentence indicates a blank, and the phrase inputted by the user is applied to this place.

  As a recorded voice, short voices expressing emotions of “happy” such as “Wow ~”, “Wow”, “I did it!” Are stored. Based on the stored conversational sentence and the recorded voice, a utterance of a character such as “Wow, I am glad to receive a present. I did it!” Is generated.

  Further, some or all of the recorded voices stored may be common to a plurality of categories. For example, memorize words such as “haha”, “um”, “hah”, or laughter such as “hahaha”, “ufu”, “ca”, etc. Also good. These recorded voices may be used in common for all categories, or may be used in common for some (a plurality of) categories.

  In addition, when the same word, for example, “U” is used in a plurality of categories, it may be stored as a recorded voice for each category. In this case, it is only necessary to record what is pronounced with an expression according to the category.

  Note that the control unit 20 may randomly apply a phrase to a conversation sentence without considering the meaning. For example, the input phrase may be used in a different usage such as “Eh, the game looks delicious. In this game, the cuteness of the character and the learning level are produced by using the wrong phrase.

  In addition, the control unit 20 causes the character to have a conversation with “Eh, the game seems to be delicious. . At this time, when the user replies “game is not food”, the control unit 20 stores (learns) that the game is not food. The control unit 20 may display a plurality of answer options in parallel with the question, and allow the user to select an appropriate option, thereby obtaining the user's response. The learning of the control unit 20 (character) will be described later.

  Further, a plurality of blanks may be provided in the conversation sentence. For example, “Do you like △△? For example, the user's name or the words registered by the user are applied to OO and △ Δ.

  FIG. 5 is a diagram illustrating the order and flow of conversations performed by the control unit 20 of the game apparatus 1 and the user. At the start of the game, the user registers a profile and preferences for the game apparatus 1 (S100). And the control part 20 memorize | stores the input content in the input phrase memory | storage area 60 (S101).

  Then, the game which a user and a character go on a journey together in a game is started (S110). And the control part 20 performs the event in which a character and a user have a conversation for every scene in the middle of a trip (S120).

  The conversation is conducted in the following procedure. First, the control part 20 performs the event which a character asks a user a question (S121), and receives the user's answer with respect to this (S122).

  The character performs a conversation by applying a phrase registered by the user to the conversation sentence. In response to this, the user's conversation is input by selecting a character from the character palette displayed on the lower screen.

  The control unit 20 stores the answer input by the user and updates (learns) the content (answer to the question). By repeating this conversation event, the number of phrases stored in the input phrase storage area 60 increases, and the attributes (meanings) of the phrases are accumulated. As a result, it is possible to express how the character grows.

  FIG. 6 is a flowchart showing the operation of the control unit 20 that creates a comment of a character. This process is executed in response to a periodic trigger. First, the current game situation is determined (S10). Based on the game situation, it is determined whether or not the present time is the conversation timing (S11). If it is not the timing (NO in S11), the operation is terminated as it is.

  If it is determined that it is the timing of the conversation (YES in S11), a conversation category or conversation sentence to be generated is selected based on the current game situation (S12). Note that the selection of the category and the conversation sentence may be performed randomly.

  Next, a phrase to be applied to the blank of the selected conversation sentence is selected from the input phrase storage area 60 (S13). This completes the conversation text 110. Then, the front voice 111A and the rear voice 111B are selected from the recorded voices 111 classified into the same category as the conversation sentence (S14).

  The text of the completed conversation sentence is output to the voice synthesizer 101 to instruct to synthesize voice data (S15), and the previous voice 111A is input to the voice playback unit 104 and played back (S16). The reproduction of the previous voice 111A continues for about 1 to 2 seconds, and during this time, the voice synthesis unit 101 synthesizes the voice of the conversation sentence.

  When the reproduction of the previous voice 111A is finished (S17), the synthesized voice 112 synthesized by the voice synthesizing unit 101 is reproduced by the voice reproducing unit 104 (S18). When the reproduction of the synthesized voice 112 is completed (S19), the rear voice 111B is played back by the voice playback unit 104 (S20). Along with this reproduction, an input of an answer by the user is accepted (S21). The input answer phrase is stored in the input phrase storage area 60 (S22).

  In the above embodiment, as shown in FIG. 2 and FIG. 6, the recorded voice 111 (the previous voice 111A and the rear voice 111B) is added before and after the conversation sentence (synthesized voice) 112, that is, the conversation sentence is recorded voice. Sandwiched between. Alternatively, the recorded voice may be added only before or after the conversation sentence.

  When the text of the conversation sentence is long, the conversation sentence is divided into a plurality of phrases. Then, it is possible to synthesize and reproduce voices for each phrase, and to insert a recorded voice between each phrase. What is necessary is just to synthesize | combine the audio | voice of the phrase immediately after that during the reproduction | regeneration of the recorded audio | voice inserted. Similarly, when synthesizing multiple conversation sentences in succession, a recorded voice is inserted between the conversation sentences and the conversation sentence is synthesized during playback of the recorded voice. You just have to do it.

  FIG. 7 is a diagram showing a procedure for dividing a conversation sentence into two phrases and synthesizing speech for each phrase. As the speech synthesizer, the one shown in FIG. 1 can be applied.

  When the process of synthesizing and outputting the text 110 starts, first, the previous voice 111A is read from the memory 103 and is reproduced by the voice reproduction unit 104. While the previous speech 111A is being played back, the speech synthesizer 101 synthesizes the supplied text (the first half of the conversation sentence) into speech (speech synthesis). The synthesized voice 112A synthesized by the voice synthesizing unit 101 is stored in the synthesis buffer 102, and after the previous voice 111A has been reproduced, it is reproduced following the previous voice 111A. During the reproduction of the synthesized voice 112A, the middle voice 111C that is a recorded voice reproduced between phrases is read out. When the reproduction of the synthesized voice 112A is finished, the voice reproducing unit 104 reproduces the middle voice 111C subsequently. The middle voice 111C can be read any time after the previous voice 111A is read and until the generation of the synthesized voice 112A is completed.

  Similarly to the previous voice 111A, the middle voice 111C may be selected from the recorded voice 111 stored in the memory 103 in the same category as the conversation sentence. While the middle voice 111C is being reproduced, the voice synthesizer 101 synthesizes the second half of the conversation sentence. The second half synthesized voice 112B synthesized by the voice synthesizing unit 101 is stored in the synthesis buffer 102, and after the reproduction of the middle voice 111C is finished, it is reproduced following the middle voice 111C. The later voice 111B is read during the reproduction of the second half synthesized voice 112B. When the reproduction of the synthesized voice 112B is finished, the voice reproducing unit 104 reproduces the subsequent voice 111B subsequently.

  In this way, by dividing a conversation sentence into a plurality of phrases and inserting a recorded voice 111 that is a live voice between them, even if a long synthesized voice has a shortage of facial expressions, a recorded voice 111 with a facial expression is inserted in the middle To enrich your facial expression. Also, it takes a long time to synthesize a long conversation sentence, but by dividing the conversation sentence into multiple phrases, each phrase can be synthesized in a short time, and the synthesized time can be covered with the recorded voice. Is possible.

  When a long conversation sentence (or a plurality of conversation sentences) is voice-synthesized and reproduced at once, the previous voice 111A may be lengthened. However, since there are many short voices such as “Wow ~”, “Wai”, “Done!”, Etc., when making the previous voice 111A longer, a combination of a plurality of recorded voices or the same recorded voice is used. What is necessary is just to reproduce | regenerate what repeated this as the front audio | voice 111A. For example, “Wow, did it, did it!”.

  Further, when the speech synthesis of the conversation sentence is not completed when the playback of the previous speech 111A is completed, the previous speech 111A may be added and played back. In this case, the previously reproduced previous sound 111A may be repeated or a new previous sound 111A may be selected.

  FIG. 8 is a flowchart showing the operation of the control unit 20 when the length of the previous speech 111A is adjusted according to the time required for speech synthesis of the conversational sentence. This process is executed in response to a periodic trigger. First, the current game situation is determined (S30). Based on the game situation, it is determined whether or not the present time is the conversation timing (S31). If it is not the timing (NO in S31), the operation is terminated as it is.

  If it is determined that it is a conversation timing (YES in S31), a conversation category or conversation sentence to be generated is selected based on the current game situation (S32). Next, a phrase to be applied to the blank of the selected conversation sentence is selected from the input phrase storage area 60 (S33). This completes the text of the conversation. The text of the completed conversation sentence is output to the voice synthesizer 101 to instruct voice data synthesis (S34). The time required for speech synthesis is estimated based on the length of the conversation sentence (S35). Based on the estimated synthesis time, one or a plurality of recorded voices to be the previous voice 111A are selected and / or the number of repetitions of the selected recorded voice is set (S36). The previous voice 111A may be selected from the recorded voices that are classified in the same category as the conversation sentence. The audio reproduction unit 104 is instructed to reproduce the selected recorded audio for the set number of times (S37).

  The process waits until the reproduction of the previous sound 111A is completed in S39 (S38). When the reproduction of the previous voice is completed (YES in S38), it is determined whether the voice synthesis by the voice synthesis unit 101 is completed (S39). If the voice synthesis has been completed (YES in S39), the voice playback unit 104 is instructed to play the synthesized voice (S41).

  On the other hand, if the speech synthesis is not completed even after the playback of the previous voice 111A is completed (NO in S39), the voice playback unit 104 is instructed to play back the previous voice 111A that has been played back (S40). ), Return to S38. At this time, a new recorded voice may be selected again and reproduced.

  When the process proceeds to S41, the post-sound 111B is selected until the reproduction of the synthesized speech is completed (S42). Note that the selection of the post-sound may be performed at any time after S32 until the reproduction of the synthesized sound is finished. When the reproduction of the synthesized voice 112 started to be reproduced in S41 is completed (YES in S43), the subsequent audio 111B is reproduced by the audio reproducing unit 104 (S44). Along with this reproduction, an input of an answer by the user is accepted (S45). The input answer phrase is stored in the input phrase storage area 60 (S46).

  As shown in FIG. 8, a long conversation sentence (or a plurality of conversation sentences) may be divided and synthesized / reproduced. As shown in FIG. 9, the previous voice 111A has sufficient time for voice synthesis. It may be long so that it can be removed.

  Note that the voice synthesis unit 101 may change the speed, pitch, volume, and the like of the synthesized voice 112 according to the content of the conversation sentence and the game situation. In that case, the parameter is provided to the sound reproduction unit 104, and the sound reproduction unit 104 reproduces the recorded sound 111 at a speed, pitch, and volume in accordance with the synthesized sound 112. Also, the voice synthesizer 101 synthesizes voice at normal speed, pitch, and volume, and the voice playback unit 104 speeds both the synthesized voice 112 and the recorded voice 111 according to the content of the conversation sentence and the game situation. In addition, playback may be performed by adjusting the pitch and volume.

  Note that the ending of the post-speech 111B may be changed according to the character of the character, the degree of character growth, the character's clothes, and the like. That is, after selecting a word such as “~ nya” or “It is ~”, it may be added to the end of the voice and reproduced. In addition, voices of “XX Nya” and “It is XX” (XX is a phrase) may be stored in advance as recorded voices.

  Further, the volume and sound quality of the generated sound (sound that the character speaks) may be changed according to the location on the game. For example, you may generate a voice with a guilloche voice when the place is on a train, and a voice with a cheerful voice under the blue sky.

DESCRIPTION OF SYMBOLS 1 Game device 5 Game media 20 Control part 21 CPU
22 ROM (flash memory)
50 game history data storage area 60 input phrase storage area 61 (conversation sentence, voice recording) storage area 100 voice generation device 101 voice synthesis unit 104 voice reproduction unit

The speech generation device of the present invention includes a display unit that displays a character that is a virtual speaker, an operation unit that receives input from a user, a phrase storage unit that stores a phrase input to the operation unit, and text data. A voice synthesizer that generates a synthesized voice by synthesizing a voice signal based on the created text data, a recorded voice storage unit that stores a recorded voice that is a voice signal in a storage unit, and a recorded voice Is recorded from the storage unit , and a voice reproduction unit that reproduces the voice signal and the recorded voice as the voice uttered by the character , and the voice synthesis unit includes a phrase stored in the phrase storage unit create a text data, sound reproduction unit, when reproducing synthesized speech, speech before a recorded sound to be played before playing the synthesized speech, and to play after play synthesized speech It characterized by further reproducing the different succeeding note voice before and voice a sound voice.

In the above invention, when the voice playback unit to play back sound, recorded speech reading unit may read the speech after the from the storage unit while the audio reproduction unit is reproducing the synthesized speech.

In the above invention, the voice synthesis unit, the recorded voice storage unit, the recorded voice reading unit, and the voice playback unit may be realized by a control unit that executes a video game. Then, the text data is a sentence that character on the game is spoken to the user, the character set continuously or stepwise emotion parameter changes according to the progress of the game, the category of character emotion It may be set based on a parameter.

Claims (6)

A speech synthesizer that synthesizes speech signals based on text data to generate synthesized speech;
A recording voice storage unit that stores in advance a recording voice that is an audio signal in the storage unit;
A recorded voice reading unit for reading the recorded voice from the storage unit;
An audio reproduction unit for reproducing the audio signal and the recorded audio;
With
The audio playback unit, when playing back the synthesized speech, the pre-speech that is the recorded speech to be played before playing the synthesized speech, the post-speech that is the recorded speech to be played after playing the synthesized speech, and the An audio generation device that further reproduces at least one of the intermediate sounds reproduced during the reproduction of the synthesized sound. When the audio reproduction unit reproduces the previous audio,
The recorded voice reading unit reads the previous voice from the storage unit before the voice synthesizing unit generates the synthesized voice.
The audio generation device according to claim 1, wherein the audio reproduction unit reproduces the previous audio during the generation of the synthesized audio by the audio synthesis unit. When the audio reproduction unit reproduces the post audio,
The voice generation device according to claim 1, wherein the recorded voice reading unit reads the post-voice from the storage unit while the voice reproduction unit is generating the synthesized voice. When the audio reproduction unit reproduces the medium audio,
The recorded voice reading unit reads the middle voice from the storage unit while the voice reproduction unit generates the first half of the synthesized voice,
The sound generation device according to any one of claims 1 to 3, wherein the sound reproduction unit reproduces the middle sound after the first half of the synthesized speech is reproduced and before the second half of the synthesized speech is reproduced. A text storage unit for storing a plurality of the text data by category;
The recorded voice storage unit stores a plurality of the recorded voices by category,
The speech synthesizer selects text data from the plurality of text data stored in the text storage unit to synthesize a speech signal,
The voice generation device according to any one of claims 1 to 4, wherein the voice reading unit selects and reads a recorded voice of the same or similar category as the text data. The voice synthesis unit, the recorded voice storage unit, the recorded voice reading unit, and the voice playback unit are realized by a control unit that executes a video game,
The text data is a conversation sentence spoken to the user by a virtual speaker on the game,
The virtual speaker is set with continuous or stepwise emotion parameters that change as the game progresses,
The category is set based on the emotion parameter of the virtual speaker.
The voice generation device according to claim 5.

Images