JP2015022162A - Voice synthesizing system, and voice conversion supporting system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enhance the response speed of a voice synthesizing apparatus while reducing the load on it by making the greatest possible use of the history of conversions done by its user.SOLUTION: A voice conversion supporting apparatus comprises: a converted voice data memory unit; a historical information memory unit; a searching unit; a test reproducing unit; and a control unit. The searching unit references the historical information memory unit by using as the keyword text data in a prescribed test reproduction part out of the text data inputted from a user terminal for conversion and identifies the place in which voice in the test reproduction part is stored. If the place for storage is the converted voice data memory unit in the apparatus, the converted voice data memory unit is designated as the destination of reading out the voice data; if the place for storage is another voice conversion supporting system on the network, a request for acquisition of the voice data is made with that other voice conversion supporting system and the voice data is acquired.

Description

  Embodiments described herein relate generally to a speech synthesis system and a speech conversion support device used in a service that converts characters such as text (characters, symbols, etc.) and figures into speech.

  In recent years, for example, on the Internet, a service for converting characters into speech has been started, and a speech synthesizer is used for this service.

  In general, a speech synthesizer converts a text (character string) of text input by a user from a terminal into speech synthesis waveform data and returns a speech signal or a speech file to the terminal.

  By the way, if the text entered by the user is Hiragana, for example, there are homonyms, that is, words that are the same in the text but different in pronunciation due to semantic differences, and speech conversion is performed for texts containing such words When the process is performed, an audio signal or an audio file having a sound different from the user's intention may be returned to the terminal.

JP 2004-117778 A

  In this case, the user causes the speech synthesizer to perform re-conversion of the corrected text, that is, the speech conversion, but this re-processing does not only put a great load on the speech synthesizer, Since a corresponding time is required, the response to the user is deteriorated.

  A problem to be solved by the present invention is to provide a speech conversion system and a speech conversion support device that can improve the response speed while reducing the load on the speech synthesizer by using the conversion history previously performed by the user as much as possible. Is to provide.

  The speech conversion support device according to the embodiment includes a converted speech data storage unit, a history information storage unit, a search unit, a test playback unit, and a control unit. The converted voice data storage unit stores voice data converted by the voice converter and text data corresponding to the voice data. The history information storage unit stores history information for searching the storage destination of the converted voice data including the converted voice data storage unit and other voice conversion support devices on the network. The search unit uses the text data of the specified test playback portion of the text data to be converted input from the terminal as a keyword, and refers to the history information storage unit to specify the storage location of the audio data of the test playback portion When the storage destination is the converted voice data storage unit in the apparatus, the converted voice data storage unit is designated as a reading destination of the voice data, and the storage destination is another voice conversion on the network. In the case of the support device, the voice data acquisition request is made to the other voice conversion support device, and the voice data is acquired. The test playback unit performs test playback of the voice data read from the converted voice data storage unit designated as the reading destination of the voice data by the search unit or the voice data acquired from the other voice conversion support device To do. When the control unit receives an instruction from the terminal that the audio data test-reproduced by the test reproduction unit is correct, the control unit is obtained by converting the text data excluding the test reproduction part to the audio conversion device. Audio data and test-reproduced audio data converted in the past are combined and transmitted to the terminal.

1 is a diagram illustrating an overall configuration of a speech synthesis system according to an embodiment. It is a block diagram of an application server. It is a figure which shows an example of index information. It is a flowchart which shows operation | movement of this speech synthesis system. It is a flowchart which shows operation | movement of this speech synthesis system. It is a flowchart which shows the search operation | movement of the existing audio | voice file.

  Hereinafter, embodiments will be described in detail with reference to the drawings. FIG. 1 is a diagram illustrating a configuration of a speech synthesis system according to an embodiment.

  As shown in FIG. 1, the speech synthesis system of this embodiment includes a computer 1 (hereinafter referred to as “user PC1”), which is a terminal operated by a service user (hereinafter referred to as “user”), and a speech conversion apparatus. A speech synthesis server 3 that is a computer, computers 2a to 2n (hereinafter referred to as “application servers 2a to 2n”) as speech conversion support devices, and these devices are connected via a network 4.

  The user PC 1 makes a conversion request from text data to voice data to the application servers 2a to 2n. The speech synthesis server 3 includes a speech synthesis engine, converts the text data received from the application servers 2a to 2n into speech data in response to a conversion request from the application servers 2a to 2n, and requests the application servers 2a to 2n. This is a voice conversion device to return to.

  Specifically, the speech synthesis server 3 converts the intermediate file (text data and accent symbol pair) sent from the application servers 2a to 2n into speech data (hereinafter referred to as “speech file”). Return to the application servers 2a to 2n.

  The application servers 2a to 2n are connected to the user PC 1 and the speech synthesis server 3 via the network 4. The application servers 2a to 2n are interposed between the voice synthesis server 3 and the user PC 1 and exchange text data, intermediate files, and voice files.

  Specifically, the application servers 2 a to 2 n cause the speech synthesis server 3 to convert the text data when there is no conversion history of the text data in the past in response to the text data conversion request from the user PC 1. Is transmitted to the user PC 1.

  Among the plurality of application servers 2a to 2n connected to the network 4, as shown in FIG. 2, for example, the application server 2a includes a graphic user interface unit 21 (hereinafter referred to as “GUI unit 21”), a memory 22, and an intermediate file. Generation unit 23, index information storage unit 24 as a history information storage unit for managing cached data, cache data storage unit 25 as a converted audio data storage unit, search unit 26, communication processing unit 27, data processing Unit 28, registration unit 29, test reproduction unit 30, distribution unit 31, and the like.

  Since the other application servers 2b to 2n have the same configuration as the application server 2a, the configuration of the application server 2a will be described below as a representative.

  The application server 2a searches the voice file cached (stored) in the cache data storage unit 25 using the index information in the index information storage unit 24 using the text data input from the user PC 1 as a keyword (search key). If there is a hit, the cached voice file is read out and returned to the requesting user PC 1 without requesting the voice synthesis server 3 for voice synthesis.

  That is, the application server 2a checks whether or not it is cached in its own hard disk device, and if it is not cached, it outputs the text data input from the user PC 1 to the speech synthesis server 3 and applies this text data. As a response, the voice file converted (voice synthesized) by the voice synthesis server 3 is acquired and sent to the user PC 1.

  The GUI unit 21 displays a screen for logging in to the application server 2a from the user PC 1, a search screen, a registration screen, and the like, accepts a voice synthesis request from the user PC 1, input of text data, and the like as a response to the request. Send the file to user PC1. For example, on the search screen, the GUI unit 21 functions as a reception unit that receives a designated test reproduction portion of text data to be converted newly input from the user PC 1.

  That is, the GUI unit 21 realizes an input / output interface between the user PC 1 and the application server 2a.

  The memory 22 is used as a work area when the data processing unit 28, the search unit 26, the registration unit 29, etc. execute the respective processes, and as a temporary storage area for the intermediate file created when a conversion request is made.

  The intermediate file generation unit 23 divides the text data to be converted input from the user PC 1 into units of words or phrases, and the divided text data is not cached, or the pronunciation is not correct by the user in the test playback. Refer to the speech conversion dictionary using what is designated as a keyword, read the corresponding accent symbol from the speech conversion dictionary, generate an intermediate file of text data and accent symbol pairs, and generate a speech synthesis server 3 is stored in the memory 22 as data for requesting conversion to 3. This intermediate file is transmitted to the speech synthesis server 3 as original data for speech synthesis.

  For text data that has already been approved by the user and that has been flagged as not requiring conversion (confirmed), no intermediate file is generated because voice conversion is not performed.

  The cache data storage unit 25 stores files (voice data files, text data files, intermediate data files, etc.) that have been converted into the previous (past) format.

  That is, the cache data storage unit 25 stores the voice data converted by the voice synthesis server 3 and the conversion source text data corresponding to the voice data.

  The index information storage unit 24 includes a plurality of pieces of index information with different narrowing ranges for searching past data (files) cached (saved) in the cache data storage unit 25 in descending order of affinity with the user. They are ranked and stored.

  The index information storage unit 24 stores a voice conversion dictionary for each user, a conversion history, and the like. The dictionary stores index information indicating the storage destination of the voice data uniquely registered by the user. The conversion history is obtained by leaving the index information when each user performs voice conversion as the conversion history.

  The index information includes storage destination information (directory, link destination, server ID, etc.) corresponding to the storage destination of the voice data, and an accent that specifies the strength of the sound when the text data is converted to voice. This is file management information in which a pair with a symbol (accent information) is stored.

  That is, the index information is history information for searching the storage destination of the converted audio file including the cache data storage unit 25 of the application server 2a and the other application servers 2a to 2n on the network 4.

  The voice data may be voice data converted (voice synthesis) by the voice synthesis server 3. This voice conversion dictionary is used by the intermediate file generation unit 23.

  That is, the index information storage unit 24 stores index information for managing the data cached in the cache data storage unit 25. The index information will be specifically described with reference to FIG.

  The search unit 26 uses the text data of the designated test playback portion among the text data to be converted newly input from the user PC 1 as a keyword, and the audio data of the test playback portion is cached in the application server 2a (own device). A search is made as to whether or not the data storage unit 25 exists and whether or not it exists in the other application servers 2b to 2n (other devices).

  The search unit 26 searches the registration dictionary 42 for each user ID, the conversion history 43 for each user ID, and the server history 44 in the order of preset priority. The search unit 26 ranks the plurality of pieces of index information in the index information storage unit 24 based on the text data input from the request source (first file collation, second file collation, third file collation, fourth The presence of an existing voice file (voice data) is confirmed by searching in the order of file verification and fifth file verification).

  In the first file collation, the search unit 26 searches the voice file (voice data) at the test playback location with reference to the registered dictionary 42 (User1) of the user ID of the logged-in user using the text data at the test playback location as a keyword. To do.

  In the second file collation, the search unit 26 searches the voice file (voice data) at the test playback location with reference to the conversion history 43 (User1) of the user ID of the logged-in user using the text data at the test playback location as a keyword. To do.

  In the third file collation, the search unit 26 searches the voice file (voice data) at the test playback location by referring to the registered dictionaries 42 (User2...) Of a plurality of users using the text data at the test playback location as a keyword.

  In the fourth file collation, the search unit 26 searches the audio file (audio data) at the test reproduction location by referring to the conversion history 43 (User2...) Of the user IDs of a plurality of users using the text data at the test reproduction location as a keyword. To do.

  In the fifth file collation, the search unit 26 refers to the server history 44 of the application server 2a using the text data of the test playback location as a keyword, and the test playback location audio stored in all of the application servers 2a to 2n. Search for files (voice data).

  The search unit 26 refers to the index information storage unit 24 using the text data of the designated test playback portion of the text data to be converted input from the user PC 1 as a keyword, and specifies the storage location of the audio file of the test playback portion. To do.

  When the specified storage destination is the cache data storage unit 25 in the application server 2a, the search unit 26 designates the cache data storage unit 25 as a read destination of the audio file.

  When the specified storage destination is the other application servers 2b to 2n on the network 4, the search unit 26 requests the external application servers 2b to 2n to acquire the audio file, and acquires the audio file. .

  Specifically, the search unit 26 displays the test playback location received by the GUI unit 21 when the test playback location is specified in the text data input from the user PC 1 on the screen displayed on the user PC 1 by the GUI unit 21. The past converted data, that is, the converted audio file (audio data) is searched for in which cache data storage unit 25 of the application servers 2a to 2n.

  The test playback unit 30 performs test playback of the audio file read from the cache data storage unit 25 designated by the search unit 26 as a read destination of the audio file or the audio file acquired from the other application servers 2b to 2n. .

  The communication processing unit 27 exchanges data with the speech synthesis server 3 by TCP (HTTP) communication.

  As a result of the search by the search unit 26, the data processing unit 28 is cached from the past data storage destination indicated by the index information in which text data (also referred to as a search key or keyword) exists, that is, from the cache data storage unit 25. The audio file included in the existing file is read out and transferred to the user PC 1 as the conversion request source.

  When the user gives an instruction on the screen of the user PC 1 that the sound of the test data reproduced by the test reproduction unit 30 is correct and the data processing unit 28 receives the instruction from the user PC 1, the data The processing unit 28 functions as a control unit that combines the voice data obtained by converting the text data excluding the test playback portion into the voice synthesis server 3 and the existing voice data that has been tested and played back to the user PC 1. .

  On the other hand, if no keyword exists in any index information, the data processing unit 28 sends the intermediate file generated by the intermediate file generation unit 23 based on the input text data and stored in the memory 22 to the speech synthesis server 3. Then, the voice file converted (voice synthesized) by the voice synthesis server 3 is transferred (transmitted) to the requesting user PC 1. It is also possible to send input text data instead of an intermediate file.

  The registration unit 29 uses the dictionary registration screen displayed by the GUI unit 21 to store information (voice data, text data, and accent marks) that the user has entered or edited in the registration dictionary 42 for each user ID in the memory 22. At the same time, the management information of the registration dictionary 42 in the memory 22 is registered in the index information storage unit 24. The management information includes the target text, intermediate file, and storage destination. The registration unit 29 registers the storage location information of the audio file distributed from the other application servers 2 b to 2 n on the network 4 in the index information storage unit 24.

  The distribution unit 31 reads out the storage destination information of the audio file newly registered in the cache data storage unit 25 from the index information storage unit 24 and distributes it to the other application servers 2b to 2n on the network 4.

  As shown in FIG. 3, the index information storage unit 24 stores a plurality of pieces of index information (registered dictionaries 42 for each user ID (User 1, 2...)) Associated with each user ID in the user ID table 41, for each user ID. Conversion history 43 (User 1, 2...) And usage index 44 (hereinafter referred to as “server history 44”) of all users of the application server 2 are stored. The conversion history 43 of one user who has logged into the application server 2 is referred to as a first conversion history. A conversion history of a plurality of users who have logged into the application server 2 (for example, all users who have logged in so far) is referred to as a second conversion history.

  In the user ID table 41, a user ID that is identification information of a user who can log in to the application server 2 is set. The user identification information includes not only the user ID but also a password.

  The registration dictionary 42 (User 1, 2,...) For each user ID includes text data (this is referred to as “text”) uniquely registered by the user, an intermediate file that is a pair of text and its access symbol, and The storage destination index indicating the storage destination of the audio file corresponding to these data is stored.

  The registration dictionary 42 (User 1, 2...) For each user ID is set to the first and second ranks (first and second ranks) as the ranks for the search, and the search unit 26 searches the cache data. When you refer to it first. In the dictionary, the first rank is an intermediate file, and the second rank is text. The search order as index information is first.

  The conversion history 43 for each user ID (User 1, 2,...) Includes text when this voice conversion function is used for each logged-in user ID, an intermediate file that is a pair of text and its access symbol, and The storage destination index indicating the storage destination of the audio file corresponding to these data is stored. Text, intermediate files, save destination indexes, etc. are called usage history.

  The conversion history 43 (User 1, 2,...) For each user ID is set to the third and fourth ranks (third and fourth ranks) as the ranks for the search, and the search unit 26 searches the cache data. Sometimes referred to 3rd and 4th. In the history, the third rank is an intermediate file, and the fourth rank is text. The search order as index information is second.

  The server history 44 stores use histories of all users when the user logs in to the application server 2 and uses the voice conversion function. The server history 44 is set to the fifth and sixth ranks (fifth and sixth ranks) as the rank in the search, and is referred to the fifth and sixth when the search unit 26 searches the cache data. The In the history, the fifth rank is an intermediate file, and the sixth rank is text. The search order as index information is the third.

  The information registered in the storage destination information column of the server history 44 is, for example, the directory of the cache data storage unit 25 if it is inside the server itself, or the link information of that server if it is another server connected to the network 4. Or a URL or a server identifier (server ID) for identifying the server.

Next, the operation of the speech synthesis system of this embodiment will be described with reference to the flowcharts of FIGS. First, the operation of the entire system will be described with reference to the flowcharts of FIGS.
In the case of the speech synthesis system of this embodiment, when the user inputs a predetermined URL from the user PC 1 and accesses the application server 2, the GUI unit 21 displays a login screen on the user PC 1, so that the user displays the displayed login screen. The login information such as “User1”, for example, is input in the input field (step S101 in FIG. 4). In addition, a password may be input as login information.

  Then, the GUI unit 21 determines whether the login information has been registered by checking the input login information with the user ID in the user ID table 41 of the memory 22 (step S102). In the case (Yes in step S102), login to the application server 2 is permitted and a voice conversion screen is displayed (step S103).

  When the user moves the cursor to the character input field on the voice conversion screen and inputs a character to be converted (text data) by key input (step S104), the GUI unit 21 accepts the input and receives the input text data. It is displayed in the character input field (step S105).

  When the button for voice file creation instruction displayed on the voice conversion screen is pressed (Yes in step S106), the routine proceeds to a routine for voice file creation processing.

  On the other hand, the test playback location in the text data displayed in the character input field is specified by the user by an operation such as range specification (such as a mouse drag operation), and the test playback button displayed on the voice conversion screen is pressed. Then (Yes in step S107), the GUI unit 21 accepts the pressing of the test playback button and notifies the search unit 26 of it.

  The search unit 26 searches whether or not an existing audio file exists in the device (memory 22 or index information storage unit 24) (step S108).

  More specifically, with reference to the index information storage unit 24, whether or not the index information of the file at the test reproduction location exists by using the text data at the designated test reproduction location among the text data to be converted as a keyword. If the index information exists, “existing audio file exists” is determined (step S109), and the audio file at the test playback location is read from the cache data storage unit 25 according to the index information and cached in the playback work area of the memory 22 ( Step S110). This audio file is <data 1>.

  When there is an existing file as a result of the search by the search unit 26, the test playback 30 reads the existing audio file at the test playback location cached in the playback work area and plays the audio from the speaker of the user PC 1 (step S30). S111).

  When the user who has heard this voice confirms the pronunciation and selects a button such as “OK” on the voice conversion screen on the assumption that the pronunciation is correct (Yes in step S112), the data processing unit 28 determines the portion of the test playback portion. The text data is confirmed (step S113), and a conversion unnecessary flag is attached to the confirmed text data. If there is the next text data to be tested, the process returns to S104 and the above process is repeated.

  In this way, when there is no next text data to be test-played, test playback of all test playback locations is completed, and the button for audio file creation instruction is pressed (step S115), the data processing unit 28 The text data of the text input in the character input field is divided into words or clauses (step S116), and the text data is transferred to the search unit 26 in the divided units, and is stored in this apparatus in the same manner as in step S108. The existing audio file is searched (step S117). Details of the search operation for the existing audio file will be described later with reference to FIG. Further, in this case, text data that has already been approved by the user and has been subjected to test reproduction with a conversion unnecessary (confirmed) flag added is not subject to search because it is not converted to speech.

If there is an existing audio file as a result of the search, the search unit 26 determines that “existing audio file exists” (Yes in step S118), reads out the audio file from the cache data storage unit 25 according to the index information, and reproduces the work area of the memory 22 (Step S119). This audio file is <data 2>.
And

  As a result of the search, if the existing voice file does not exist in the apparatus (No in step S118), the data processing unit 28 generates an intermediate file of the searched divided text data and transfers it to the voice synthesis server 3. (Step S120), the voice file converted by the voice synthesis server 3 is acquired (Step S121).

  Then, the obtained audio file (product) is cached in the reproduction work area of the memory 22 (step S122). This audio file is <data 3>.

  Then, the data processing unit 28 combines the audio files cached in the playback work area (<data 1>, <data 2>, <data 3>) according to the divided order (step S123), and the audio file as written. And the combined audio file is reproduced from the speaker of the user PC 1 (step S124).

  The user who has heard the sound confirms the pronunciation of the reproduced sound, and if the pronunciation is incorrect, an editing screen displaying the intermediate file (text data and accent mark) of the sound file is displayed (step S126). A message such as “Please correct the accent symbol in the wrong place” is displayed to prompt the user to correct it. When the user corrects the accent symbol (step S127), the process returns to step S124 to reproduce the voice.

  As a result of the user confirming the pronunciation, if the pronunciation is correct and the sound saving button on the screen is selected and operated (step S128), the data processing unit 28 displays a screen for designating the saving destination, and the saving destination is designated. If so (step S129), the audio file is transferred to the storage location of the designated user PC 1 and stored (step S130).

  Thereafter, the process is changed depending on whether or not to continue the process. For example, if the process end operation is not performed, it is assumed that the process is continued (Yes in step S131), the process returns to the process in step S104 and waits for the next text input.

  When the process end operation is performed, the data processing unit 28 stores the audio file in the cache data storage unit 25 that is a history recording area (step S132), assuming that the process is not continued (No in step S131). The storage destination information (device ID and text data (hereinafter referred to as “word / phrase”) is registered in the index information storage unit 24 (step S133), and the storage destination information is transmitted to the other application servers 2b to 2n on the network 4. Distribute (step S134), and a series of text / speech conversion processing ends.

  When the storage destination information (link information or server ID and word (text data)) of the audio file is distributed from the other application servers 2b to 2n and received by the communication processing unit 27, the registration unit 29 The received storage location information (device ID and word / phrase) is registered in the index information storage unit 24.

Here, the details of the search operation (step S108, step S117) of the existing audio file by the search unit 26 will be described with reference to FIG.
The search unit 26 uses the text data as a keyword and sets the index information in the order of preset priorities (first file verification, second file verification, third file verification, fourth file verification, fifth file verification). By searching, the storage location of the existing audio file is specified, and the existing audio file is read or acquired from the specified storage location.

  In this case, as shown in FIG. 6, the search unit 26 uses the text data as a keyword, and the user of the login user who is the target of the first file verification among the index information stored in the index information storage unit 24. By searching the index (intermediate file, text, etc.) of the registration dictionary 42 (see FIG. 3) of ID (User1) (step S201), the storage destination that is the link destination of the searched index is specified (step S202). Read audio file.

  If no matching information is found as a result of the first file collation, the retrieval unit 26 records history data (intermediate) of the conversion history 43 (see FIG. 3) of the user ID (User1) of the login user who is the second file collation target. (File and text) are searched (step S203), and the storage destination that is the link destination of the searched history data is specified (step S204), and the audio file is read out.

  If no matching information is found as a result of the second file collation, the search unit 26 indexes the registration dictionary 42 (see FIG. 3) of the user ID (User2...) Of another user who is the third file collation target (see FIG. 3). An intermediate file, text, etc.) are searched (step S205), and a storage destination that is a link destination of the searched index is specified (step S206), and an audio file is read.

  If no matching information is found as a result of the third file collation, the retrieval unit 26 records the history data of the conversion history 43 (see FIG. 3) of the user ID (User2...) Of another user who is the fourth file collation target. (Intermediate file, text, etc.) are searched (step S207), and the storage destination that is the link destination of the searched history data is specified (step S208), and the audio file is read.

If no matching information is found as a result of the fourth file collation (No in step S207), the retrieval unit 26 records the server history 44 (see FIG. 3) of the application servers 2a to 2n that are the targets of the fifth file collation. It is searched whether or not the sound file exists in the data (text, intermediate file, storage destination, etc.) (step S209), and the storage destination that is the link destination of the history data matching the keyword is specified.
If the specified storage destination is the cache data storage unit 25 (Yes in step S210), the search unit 26 designates the cache data storage unit 25 as a read destination of the audio file to the test reproduction unit 30 (step S210). S211).
Further, if the specified storage destination is the application server 2b to 2n (for example, the application server 2b) on the network 4 outside the application server 2a (No in step S210), the search unit 26 includes the storage destination application server, For example, an audio file acquisition request is made to the application server 2b, and the audio file is acquired from the application server 2b (step S212).

  As described above, according to this embodiment, not only the application server 2a (also referred to as the own device or the own device) but also the other application servers 2b to 2n (others) on the network 4 are recorded on the history of text / speech conversion so far. (Synchronized audio files), and by sharing and managing cached audio file information and immediately specifying the search range of converted audio files, the user can make use of the conversion history previously performed as much as possible. The response speed can be improved while reducing the load on the server 3.

  By distributing and storing the converted audio files to the plurality of application servers 2a to 2n on the network 4, the storage capacity and processing performance of the individual application servers 2a to 2n can be suppressed, and the cost of the apparatus can be reduced. Can be achieved.

  In addition, it is possible to reduce the load on the speech synthesis server 3 and convert it by using the speech files converted in the past stored in the plurality of application servers 2a to 2n without requesting the speech synthesis server 3 for speech conversion. The time can be shortened and the response speed to the user can be improved. In addition, the amount of data to be converted by the speech synthesis server 3 can be reduced. In addition, the correction location can be minimized, which ultimately shortens the time required for voice conversion by the user.

  That is, by sharing management information related to storage of audio data in the audio conversion support device, it is possible to improve the processing speed and reduce the load by immediately specifying and searching for the device.

  The described embodiments are presented by way of example and are not intended to limit the scope of the invention. The novel embodiment can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. The above-described embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and equivalents thereof.

  Further, each component shown in the above embodiment may be realized by a program installed in a storage such as a hard disk device of a computer, and the program is stored in a computer-readable electronic medium: electronic media, The computer may realize the functions of the present invention by causing a computer to read a program from an electronic medium. Examples of the electronic medium include a recording medium such as a CD-ROM, flash memory, and removable media. Further, the configuration may be realized by distributing and storing components in different computers connected via a network, and communicating between computers in which the components are functioning.

  DESCRIPTION OF SYMBOLS 1 ... User PC, 2a-2n ... Application server, 3 ... Speech synthesis server 31 ... Graphic user interface part (GUI part), 22 ... Memory, 23 ... Intermediate file generation part, 24 ... Index information storage part, 25 ... Cache data Storage unit 25 ... Cache data storage unit 26 ... Search unit 27 ... Communication processing unit 28 ... Data processing unit 29 ... Registration unit 30 ... Test playback unit 41 ... User ID table 42 ... For each user ID Registration dictionary, 43 ... Conversion history for each user ID, 44 ... Server history.

Claims (5)

Connected via a network to a user terminal that makes a conversion request from text data to voice data and a voice conversion device that converts the text data to voice data, and in response to the text data conversion request from the terminal In the speech conversion support device for causing the speech conversion device to convert the text data when there is no conversion history of the text data in the past, and transmitting the converted speech data to the terminal,
A converted voice data storage unit in which the voice data converted by the voice converter and the text data of the conversion source corresponding to the voice data are stored;
A history information storage unit storing history information for searching for a storage destination of the converted voice data including the converted voice data storage unit and other voice conversion support devices on the network;
Using the text data of the designated test playback portion of the text data to be converted input from the terminal as a keyword, the history information storage unit is referred to specify the storage location of the audio data of the test playback portion, and the storage When the destination is the converted voice data storage unit in the device, the converted voice data storage unit is designated as the voice data read destination, and the storage destination is another voice conversion support device on the network A search unit for requesting acquisition of the voice data to the other voice conversion support device, and acquiring the voice data;
A test reproduction unit for performing test reproduction of the audio data read from the converted audio data storage unit designated by the search unit as a read destination of the audio data or the audio data acquired from the other audio conversion support device; ,
When receiving an instruction from the terminal that the audio data test-reproduced by the test reproduction unit is correct, the audio data obtained by converting the text data excluding the test reproduction location to the audio conversion device and the test A voice conversion support apparatus comprising: a control unit that combines the reproduced voice data that has been converted in the past and transmits the voice data to the terminal.   The speech conversion support device according to claim 1, further comprising: a distribution unit that distributes storage destination information of the speech data newly registered in the converted speech data storage unit to another speech conversion support device on the network.   The speech conversion support apparatus according to claim 1, further comprising a registration unit that registers storage destination information of speech data distributed from another speech conversion support apparatus on the network in the history information storage unit. Connected via a network to a user terminal that makes a conversion request from text data to voice data and a voice conversion device that converts the text data to voice data, and in response to the text data conversion request from the terminal In the speech conversion support method in the speech conversion support device for causing the speech conversion device to convert the text data when there is no conversion history of the text data in the past, and transmitting the converted speech data to the terminal,
Storing the voice data converted by the voice converter and the text data of the conversion source corresponding to the voice data in the converted voice data storage unit;
Storing history information for searching a storage destination of the converted voice data including the converted voice data storage unit and other voice conversion support devices on the network in the history information storage unit;
The search unit specifies the storage destination of the audio data of the test reproduction part by referring to the history information storage unit using the text data of the designated test reproduction part among the text data to be converted inputted from the terminal as a keyword. When the storage destination is the converted voice data storage unit inside the apparatus, the converted voice data storage unit is designated as a reading destination of the voice data, and the storage destination is another voice conversion support on the network. In the case of a device, it makes an acquisition request for the voice data to the other voice conversion support device, acquires the voice data,
The test reproduction unit performs test reproduction of the audio data read from the converted audio data storage unit designated by the search unit as the audio data read destination or the audio data acquired from the other audio conversion support device. ,
When the control unit receives an instruction from the terminal that the audio data test-reproduced by the test reproduction unit is correct, the audio obtained by converting the text data excluding the test reproduction part to the audio conversion device An audio conversion support method for combining data and test-reproduced audio data converted in the past and transmitting the data to the terminal. A user terminal that makes a conversion request from text data to voice data, a voice conversion device that converts the text data to voice data, and conversion of the text data in the past in response to the text data conversion request from the terminal In the speech synthesis system in which the speech conversion device is connected via a network with the speech conversion support device that converts the text data to the speech conversion device when there is no history, and transmits the converted speech data to the terminal.
The voice conversion support device
A converted voice data storage unit in which the voice data converted by the voice converter and the text data of the conversion source corresponding to the voice data are stored;
A history information storage unit storing history information for searching for a storage destination of the converted voice data including the converted voice data storage unit and other voice conversion support devices on the network;
Using the text data of the designated test playback portion of the text data to be converted input from the terminal as a keyword, the history information storage unit is referred to specify the storage location of the audio data of the test playback portion, and the storage When the destination is the converted voice data storage unit in the device, the converted voice data storage unit is designated as the voice data read destination, and the storage destination is another voice conversion support device on the network A search unit for requesting acquisition of the voice data to the other voice conversion support device, and acquiring the voice data;
A test reproduction unit for performing test reproduction of the audio data read from the converted audio data storage unit designated by the search unit as a read destination of the audio data or the audio data acquired from the other audio conversion support device; ,
When receiving an instruction from the terminal that the audio data test-reproduced by the test reproduction unit is correct, the audio data obtained by converting the text data excluding the test reproduction location to the audio conversion device and the test A speech synthesis system comprising: a control unit that combines the reproduced speech data that has been converted in the past and transmits the combined speech data to the terminal.

Images