JP2007171765A - Speech database producing device, speech database, speech segment restoring device, speech database producing method, speech segment restoring method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a speech database producing device and the like for effectively protecting speech data while freely supplying data representing speeches. <P>SOLUTION: A speech segment registration unit R acquires speech segment data representing a speech segment, acquires three kinds of data representing the data length of the speech segment data, the speaking speed of the speech segment and time variation in frequency of a pitch component, extracts and operates one piece of data from each data, i.e. three pieces of data in total to produce an encryption key, encrypts the speech segment data by using this encryption key into encrypted speech segment data, and stores the encrypted speech segment data in a speech segment database D together with speech segment reading data. A main body unit M reads out the encrypted speech segment data from the speech segment database D, produces the encryption key by using the three pieces of data among data stored in the speech segment database D, restores the speech segment data by decoding the encrypted speech segment data by using the encryption key, and uses the data. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a voice database manufacturing device, a voice database, a sound piece restoring device, a voice database manufacturing method, a sound piece restoring method, and a program.

As a technique for synthesizing speech, there is a technique called a recording editing system. The recording / editing system is used in a station voice guidance system, an in-vehicle navigation system, and the like.
The recording and editing method associates a word with voice data representing a voice that reads out the word, divides a sentence to be synthesized into words, and acquires voice data associated with these words. This is a technique of joining them together (for example, see Patent Document 1).
JP 10-49193 A

  As a technique for making it possible to change the speaker of the synthesized speech obtained by the recording and editing method, or to diversify the synthesized speech obtained, record the speech data on removable media (portable recording media). As one to use, a plurality of removable media in which different audio data are recorded may be replaced as necessary.

  However, there is a problem that the audio data recorded on the removable medium is easily subjected to unauthorized duplication and other unauthorized use. Therefore, as a technique for solving this problem, a technique of encrypting audio data and recording it on a removable medium is conceivable.

  However, when audio data is encrypted using an encryption key, recorded on a removable medium, and a device that performs speech synthesis uses this audio data, it is necessary to decrypt the encrypted audio data. The content of this encryption key needs to be understood by a device that performs speech synthesis.

  However, if this device stores the encryption key in advance, for example, the person who manufactures the removable media on which the audio data is recorded needs to know this encryption key (in other words, what is this encryption key? Even if a removable medium that records voice data encrypted using a different encryption key is used, voice synthesis cannot be performed normally), and free supply of voice data is hindered.

  In addition, for example, when an encryption key is simply supplied separately to this device, the encryption key can be easily leaked to a target person who makes the encryption key private, and the protection of encrypted audio data is effective. I can't figure it out.

  In addition, when the encryption key is encrypted and then supplied to the apparatus, the apparatus needs to be able to decrypt the encryption key. Therefore, the same problem as the condition for decrypting the audio data is further caused in terms of how to make the apparatus securely grasp the condition for decrypting the encryption key.

  The present invention has been made in view of the above circumstances, and is intended to provide a voice database manufacturing device, a voice database, a sound piece restoration device, and an effective protection of voice data while freely supplying data representing voice. An object of the present invention is to provide a voice database manufacturing method, a sound piece restoration method, and a program.

In order to achieve the above object, an audio database manufacturing apparatus according to the first aspect of the present invention provides:
Data acquisition means for acquiring sound piece data representing a sound piece;
Data representing the characteristics of the acquired sound piece data and / or data representing the characteristics of the sound pieces represented by the sound piece data are generated, and encryption is performed using a plurality of predetermined data among the generated data An encryption key generating means for generating a key;
An encryption means for generating encrypted sound piece data by encrypting the acquired sound piece data using the generated encryption key;
Sound piece storage means for storing the generated encrypted sound piece data in a storage area of an external storage device,
It is characterized by that.

  The encryption key generation means decrypts the storage device or the encrypted sound piece data among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. A plurality of data determined by identification data values uniquely assigned to an external device that performs the processing may be handled as the predetermined plurality of data to generate the encryption key.

  The encryption key generation means complies with a rule determined by the value of identification data uniquely assigned to the predetermined plurality of data in the storage device or an external device that decrypts the encrypted sound piece data. The encryption key may be generated by performing an operation.

  The data representing the characteristics of the sound piece data may be data including data representing the data length of the sound piece data, for example.

  The data representing the characteristics of the sound piece represented by the sound piece data may be data including the data representing the utterance speed of the sound piece or the data representing the time change of the frequency of the pitch component of the sound piece. .

The speech database according to the second aspect of the present invention is:
An audio database that stores encrypted sound piece data corresponding to sound piece data representing sound pieces,
The encrypted sound piece data is generated using a plurality of predetermined data among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. It corresponds to the sound piece data encrypted using an encryption key.
It is characterized by that.

  The encrypted sound piece data is, for example, the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. The sound piece data is encrypted using an encryption key generated as the predetermined plurality of pieces of data determined by identification data values uniquely assigned to an external device that performs data decryption. Anything equivalent to the above may be used.

  The encrypted sound piece data is determined by, for example, the value of identification data uniquely assigned to the predetermined plurality of data in the sound database itself or an external device that decrypts the encrypted sound piece data. What is necessary is just to correspond to what the said sound piece data was encrypted using the encryption key produced | generated by performing the calculation according to a rule.

  The data representing the characteristics of the sound piece data may be data including data representing the data length of the sound piece data, for example.

  The data representing the characteristics of the sound piece represented by the sound piece data may be data including the data representing the utterance speed of the sound piece or the data representing the time change of the frequency of the pitch component of the sound piece. .

Moreover, the sound piece restoring device according to the third aspect of the present invention is:
Encrypted sound piece data corresponding to the sound piece data representing the sound piece is stored, and the data representing the characteristics of the sound piece data and / or the characteristics of the sound pieces represented by the sound piece data are stored. It is configured to be connectable to an external audio database that further stores data to represent,
A selection means for selecting one of the encrypted speech piece data stored in the speech database to be used for restoring the speech piece;
And decryption means for decrypting the encrypted speech piece data selected by the selection means,
The encrypted sound piece data is generated using a plurality of predetermined data among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. It corresponds to the sound piece data encrypted using an encryption key,
The decryption means acquires the predetermined plurality of data from the voice database, generates the encryption key using the acquired plurality of data, and uses the generated encryption key to generate the encrypted sound. It is for decrypting one piece of data.
It is characterized by that.

The voice database may be assigned identification data unique to the voice database. In this case, the encrypted sound piece data includes data representing characteristics of the sound piece data and / or the sound piece. Among the data representing the characteristics of the sound pieces represented by the data, a plurality of data determined by the value of the identification data uniquely assigned to the speech database are used, using the encryption key generated as the predetermined plurality of data, It corresponds to the sound piece data encrypted,
The decoding means is based on the value of identification data uniquely assigned to the speech database among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. A plurality of determined ones are acquired from the voice database, the encryption key is generated using the acquired plurality of data, and the encrypted sound piece data is decrypted using the generated encryption key. May be.

When identification data unique to the voice database is assigned to the voice database, the encrypted speech piece data is a value of the identification data uniquely assigned to the voice database. The sound piece data is encrypted using an encryption key generated by performing an operation according to a rule determined by:
The decryption means generates the encryption key by performing an operation according to a rule determined by a value of identification data uniquely assigned to the speech database on the predetermined plurality of data acquired from the speech database. Then, the encrypted sound piece data may be decrypted using the generated encryption key.

  The sound piece restoration device may further include synthesis means for generating data representing synthesized speech by combining the sound piece data decoded by the decoding means.

In the case where the sound piece restoration device further includes synthesis means for generating data representing synthesized speech by combining the sound piece data decoded by the decoding means, the synthesis means includes the synthesis means Unique identification data may be assigned to the means.
In this case, the encrypted sound piece data is uniquely assigned to the synthesizing unit among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. A plurality of items determined by the value of the identification data may be equivalent to those obtained by encrypting the sound piece data using an encryption key generated as the predetermined plurality of data,
The decoding means is based on the value of the identification data uniquely assigned to the synthesizing means among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. A plurality of determined ones are acquired from the voice database, the encryption key is generated using the acquired plurality of data, and the encrypted sound piece data is decrypted using the generated encryption key. May be.

The sound piece restoration device further includes a synthesis means for generating data representing synthesized speech by combining the sound piece data decoded by the decoding means, and the synthesis means includes the synthesis means. When the unique identification data is assigned, the encrypted sound piece data is subjected to an operation according to a rule determined by the value of the identification data uniquely assigned to the synthesizing means on the predetermined plurality of data. The sound piece data may be equivalent to the encrypted data using the encryption key generated by
The decryption means generates the encryption key by performing an operation according to a rule determined by a value of identification data uniquely assigned to the synthesis means on the predetermined plurality of data acquired from the speech database Then, the encrypted sound piece data may be decrypted using the generated encryption key.

A speech database manufacturing method according to the fourth aspect of the present invention is as follows.
Acquire sound piece data representing a sound piece,
Data representing the characteristics of the acquired sound piece data and / or data representing the characteristics of the sound pieces represented by the sound piece data are generated, and encryption is performed using a plurality of predetermined data among the generated data Generate a key
Encrypting the acquired sound piece data using the generated encryption key to generate encrypted sound piece data,
Storing the generated encrypted sound piece data in a storage area of an external storage device;
It is characterized by that.

Moreover, the sound piece restoration method according to the fifth aspect of the present invention provides:
Encrypted sound piece data corresponding to the sound piece data representing the sound piece is stored, and the data representing the characteristics of the sound piece data and / or the characteristics of the sound pieces represented by the sound piece data are stored. A sound piece restoration method using a voice database for further storing data to be represented,
A selection step of selecting one of the encrypted speech piece data stored in the speech database to be used for restoring the speech piece;
A decryption step for decrypting the encrypted speech piece data selected in the selection step,
The encrypted sound piece data is generated using a plurality of predetermined data among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. It corresponds to the sound piece data encrypted using an encryption key,
In the decryption step, the predetermined plurality of data is acquired from the speech database, the encryption key is generated using the acquired plurality of data, and the encrypted sound is generated using the generated encryption key. Decrypt one piece of data,
It is characterized by that.

A program according to the sixth aspect of the present invention is
Computer
Data acquisition means for acquiring sound piece data representing a sound piece;
Data representing the characteristics of the acquired sound piece data and / or data representing the characteristics of the sound pieces represented by the sound piece data are generated, and encryption is performed using a plurality of predetermined data among the generated data An encryption key generating means for generating a key;
An encryption means for generating encrypted sound piece data by encrypting the acquired sound piece data using the generated encryption key;
Sound piece storage means for storing the generated encrypted sound piece data in a storage area of an external storage device;
It is for making it function.

A program according to the seventh aspect of the present invention is
Encrypted sound piece data corresponding to the sound piece data representing the sound piece is stored, and the data representing the characteristics of the sound piece data and / or the characteristics of the sound pieces represented by the sound piece data are stored. A computer connectable to an external audio database that further stores data to represent
A selection means for selecting one of the encrypted speech piece data stored in the speech database to be used for restoring the speech piece;
A program for functioning as decryption means for decrypting encrypted sound piece data selected by the selection means,
The encrypted sound piece data is generated using a plurality of predetermined data among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. It corresponds to the sound piece data encrypted using an encryption key,
The decryption means acquires the predetermined plurality of data from the voice database, generates the encryption key using the acquired plurality of data, and uses the generated encryption key to generate the encrypted sound. It is for decrypting one piece of data.
It is characterized by that.

  According to the present invention, a voice database manufacturing apparatus, a voice database, a sound piece restoration apparatus, a voice database production method, and a sound piece restoration method for effectively protecting voice data while freely providing data representing voice. And a program is realized.

Hereinafter, embodiments of the present invention will be described with reference to the drawings, taking a speech synthesis system as an example.
FIG. 1 is a diagram showing a configuration of a speech synthesis system according to an embodiment of the present invention. As shown in the figure, this speech synthesis system is composed of a main unit M, a sound piece registration unit R, and a sound piece database D.

The main unit M includes a language processing unit 1, a general word dictionary 2, a user word dictionary 3, a rule synthesis processing unit 4, a sound piece editing unit 5, a search unit 6, a decoding unit 7, a speech speed. It is comprised by the conversion part 8.
Among these, the rule synthesis processing unit 4 includes an acoustic processing unit 41, a search unit 42, an expansion unit 43, and a waveform database 44.
The sound piece editing unit 5 includes a morphological analysis unit 51, a matching sound piece determination unit 52, a prosody prediction unit 53, and an output synthesis unit 54.

  The language processing unit 1, the acoustic processing unit 41, the search unit 42, the decompression unit 43, the sound piece editing unit 5, the search unit 6, the decoding unit 7, and the speech rate conversion unit 8 are all CPU (Central Processing Unit) or A processor such as a DSP (Digital Signal Processor), a memory for storing a program to be executed by the processor, and the like, each of which performs processing to be described later.

  A part or all of the functions of the language processing unit 1, the sound processing unit 41, the search unit 42, the decompression unit 43, the sound piece editing unit 5, the search unit 6, the decoding unit 7, and the speech rate conversion unit 8 are united. May be performed by the processor. Therefore, for example, the processor that performs the function of the decompression unit 43 may perform the function of the decoding unit 7, or one processor performs the functions of the acoustic processing unit 41, the search unit 42, and the decompression unit 43. Also good.

  The general word dictionary 2 is configured by a non-volatile memory such as a PROM (Programmable Read Only Memory) or a hard disk device. In the general word dictionary 2, words including ideographic characters (for example, kanji) and phonograms (for example, kana and phonetic symbols) representing the reading of these words are the manufacturer of this speech synthesis system. Etc., and stored in advance in association with each other.

The user word dictionary 3 includes a nonvolatile memory capable of rewriting data such as an EEPROM (Electrically Erasable / Programmable Read Only Memory) or a hard disk device, and a control circuit for controlling writing of data to the nonvolatile memory. . The processor may perform the function of this control circuit. The language processing unit 1, the acoustic processing unit 41, the search unit 42, the decompression unit 43, the sound piece editing unit 5, the search unit 6, the decoding unit 7, and the speech speed. A processor that performs part or all of the functions of the conversion unit 8 may perform the function of the control circuit of the user word dictionary 3.
The user word dictionary 3 obtains words including ideograms and phonograms representing readings of these words from the outside according to user operations, and stores them in association with each other. It is sufficient that the user word dictionary 3 stores words and the like that are not stored in the general word dictionary 2 and phonograms representing the readings.

  The waveform database 44 is configured by a non-volatile memory such as a PROM or a hard disk device. In the waveform database 44, a phonetic character and a voice constituting a phoneme represented by the phonetic character (that is, a voice of one cycle (or other predetermined number of cycles) of a voice waveform constituting one phoneme). ) And the compressed waveform data obtained by entropy coding the segment waveform data representing the data are stored in advance in association with each other by the manufacturer of the speech synthesis system. Note that the segment waveform data before entropy encoding may be, for example, PCM digital data.

  A single nonvolatile memory may perform a part or all of the functions of the nonvolatile memory of the general word dictionary 2, the user word dictionary 3, the waveform database 44, and the matching sound piece determination unit 52.

  The sound piece database D is composed of a non-volatile memory such as a PROM or a hard disk device, and is configured to be detachably connected to the main unit M, and is also detachably connectable to the sound piece registration unit R. It is configured as follows.

  In the sound piece database D, for example, data having a data structure shown in FIG. 2 is stored. That is, as shown in the figure, the data stored in the sound piece database D is divided into four types: a header part HDR, an index part IDX, a directory part DIR, and a data part DAT.

  Note that the data storage in the sound piece database D is performed in advance by, for example, the manufacturer of the speech synthesis system and / or by the sound piece registration unit R performing the operation described later.

  The header portion HDR stores data identifying the sound piece database D, data indicating the index portion IDX, the data amount of the directory portion DIR and the data portion DAT, the format of the data, the attribution of copyright, and the like.

The data portion DAT stores a plurality of pieces of encrypted sound piece data obtained by encrypting sound piece data representing the waveform of a sound piece.
Note that a sound piece refers to a continuous section including one or more phonemes in speech, and usually includes a section for one word or a plurality of words. Sound pieces may contain conjunctions. It is assumed that the sound pieces represented by the encrypted sound piece data stored in one sound piece database are uttered by the same speaker.
Further, the sound piece data before being encrypted is composed of data in the same format as the waveform data before being encrypted for the generation of the compressed waveform data (for example, data in a digital format converted to PCM). Just do it.

In the directory part DIR, for each encrypted sound piece data,
(A) data (phonetic piece reading data) representing a phonetic character indicating reading of the voice piece represented by the encrypted voice piece data
(B) data representing the head address of the storage location where this encrypted sound piece data is stored;
(C) data representing the data length of this encrypted sound piece data;
(D) data (speed initial value data) representing the utterance speed of the sound piece represented by the encrypted sound piece data (the length of time when played back);
(E) data (pitch component data) representing the time variation of the frequency of the pitch component of this sound piece;
Are stored in association with each other. (It is assumed that an address is assigned to the storage area of the sound piece database D.)

  FIG. 2 shows, as data included in the data portion DAT, encrypted sound piece data having a data amount of 1410 h bytes representing the waveform of a sound piece whose reading is “Saitama” is stored in a logical position starting at address 001A36A6h. The case where it is done is illustrated. (In this specification and drawings, the number with “h” at the end represents a hexadecimal number.)

  Note that each piece of encrypted sound piece data corresponds to the original sound piece data encrypted using an encryption key. As the encryption key, a predetermined one (specifically, for example, one associated with encrypted sound piece data of a predetermined reading) is selected from the entire data set of (C) described above, Similarly, a predetermined one is selected from the entire data set of (D), and a predetermined one is further selected from the entire data set of (E). It is assumed that the data is generated by calculating the sum of the data values. These three pieces of selected data are not necessarily associated with the same encrypted sound piece data. The above-described encryption only needs to be performed by any symmetric key encryption method, and specifically, may be performed by a method compliant with, for example, DES (Data Encryption System).

In addition, at least the data (A) (that is, the speech piece reading data) of the set of data (A) to (E) is sorted according to the order determined based on the phonetic characters represented by the speech piece reading data. (For example, if the phonetic character is kana, the phonetic characters are arranged in ascending order of addresses in the order of the Japanese syllabary) and stored in the storage area of the speech piece database D.
In addition, the above-described pitch component data includes, for example, as shown in the figure, when the frequency of the pitch component of the sound piece is approximated by a linear function of the elapsed time from the head of the sound piece, What is necessary is just to consist of the data which show the value of gradient (alpha). (The unit of the gradient α may be [Hertz / second], for example, and the unit of the intercept β may be [Hertz], for example.)
In addition, it is assumed that the pitch component data further includes data (not shown) indicating whether or not the sound piece represented by the encrypted sound piece data is nasalized and whether or not it is devoiced.

  The index part IDX stores data for specifying the approximate logical position of the data in the directory part DIR based on the sound piece reading data. Specifically, for example, assuming that the sound piece reading data represents kana, the address range of the kana characters and the sound piece reading data whose first character is this kana character is in the range. Data (directory address) to be shown is stored in association with each other.

  The sound piece registration unit R includes a recorded sound piece data set storage unit 10, a sound piece database creation unit 11, and a compression unit 12, as illustrated.

The recorded sound piece data set storage unit 10 is composed of a rewritable nonvolatile memory such as a hard disk device.
The recorded sound piece data set storage unit 10 includes phonetic characters representing the reading of the sound pieces and sound piece data representing the waveforms obtained by collecting the sound pieces actually uttered by a person. They are stored in advance in association with each other by the manufacturer of the speech synthesis system. The sound piece data may be composed of, for example, PCM digital data.

  The sound piece database creation unit 11 and the compression unit 12 are configured by a processor such as a CPU and a memory that stores a program to be executed by the processor, and performs processing to be described later according to the program.

  Note that a single processor may perform a part or all of the functions of the speech piece database creation unit 11 and the compression unit 12, and the language processing unit 1, the acoustic processing unit 41, the search unit 42, and the expansion unit. 43, even if a processor that performs some or all of the functions of the sound piece editing unit 5, the search unit 6, the decoding unit 7, and the speech rate conversion unit 8 further performs the functions of the sound piece database creation unit 11 and the compression unit 12. Good. Further, a processor that performs the functions of the sound piece database creation unit 11 and the compression unit 12 may also function as a control circuit of the recorded sound piece data set storage unit 10.

  Next, the operation of this speech synthesis system will be described.

(Operation of sound piece registration unit)
First, the operation of the sound piece registration unit R will be described.
When registering sound pieces in the sound piece database D, the sound piece database creating unit 11 firstly stores the sound piece database D from the recorded sound piece data set storage unit 10 in a state where the sound piece database D is connected to the sound piece registration unit R. Corresponding phonetic character and speech piece data are read out, and the data length of the speech piece data and the time variation of the voice production speed and the frequency of the pitch component represented by the speech piece data are specified.

  The data length and speech speed of the sound piece data may be specified, for example, by counting the number of samples of the sound piece data.

  On the other hand, the time change of the frequency of the pitch component may be specified by performing cepstrum analysis on the sound piece data, for example. Specifically, for example, the waveform represented by the sound piece data is divided into a number of small parts on the time axis, and the intensity of each obtained small part is converted to the logarithm of the original value (the base of the logarithm is arbitrary). Convert to a substantially equal value, and use this fast Fourier transform method (or generate data that represents the result of Fourier transform of discrete variables, etc.) (Any method). Then, the minimum value among the frequencies giving the maximum value of the cepstrum is specified as the frequency of the pitch component in this small portion.

  The time change of the frequency of the pitch component is specified based on the pitch waveform data after the sound piece data is converted into the pitch waveform data according to the method disclosed in Japanese Patent Laid-Open No. 2003-108172, for example. A good result can be expected. Specifically, the pitch data is extracted by filtering the piece data, and the waveform represented by the piece data is divided into sections of unit pitch length based on the extracted pitch signal. It is only necessary to convert the sound piece data into a pitch waveform signal by identifying the phase shift based on the correlation and aligning the phases of each section. Then, the obtained pitch waveform signal is handled as sound piece data, and a cepstrum analysis is performed, for example, so that the time change of the frequency of the pitch component may be specified.

  Next, the sound piece database creation unit 11 uses the above-described data (C), speed initial value data, and the three data indicating the results of specifying the time variation of the specified data length, utterance speed, and pitch component frequency. (That is, the data of (D) described above) and pitch component data (that is, the data of (E) described above).

When the generation of the data (C), (D), and (E) is completed for all the sound pieces to be registered in the sound piece database, the sound piece database creation unit 11 sets the generated data set (C). Select one generated from sound piece data of a predetermined reading from among the whole, and select one generated from sound piece data of a predetermined reading from the entire set of generated data of (D) Further, one generated from the piece data of the predetermined reading is selected from the entire set of generated data (E), and the sum of the values of the selected three data is expressed. Data, that is, an encryption key is generated. Then, the sound piece data read from the recorded sound piece data set storage unit 10 and the generated encryption key are supplied to the compression unit 12.
The compression unit 12 uses the encryption key supplied from the sound piece database creation unit 11 to encrypt the sound piece data supplied from the sound piece database creation unit 11 by using a symmetric key encryption technique, thereby encrypting the sound piece. Data is created and returned to the sound piece database creation unit 11.

  The predetermined data (C), (D), and (E) are determined in such a manner that which is the predetermined data is not disclosed to the user of the speech synthesis system. As long as the data is arbitrary (however, it is not necessary that the data take a predetermined value). Therefore, the reading of the encrypted sound piece data associated with the three pieces of data to be used for generating the encryption key may be directly determined, or these three pieces of data are stored in the storage area of the sound piece database D. The position from the beginning may be determined. Alternatively, the sound piece database creation unit 11 calculates a value obtained by substituting certain predetermined data into a predetermined hash function or performing other predetermined operations, and is uniquely determined by the obtained value. These data may be used for generating an encryption key.

  When the sound piece data is encrypted and returned as the encrypted sound piece data from the compression unit 12, the sound piece database creation unit 11 uses the encrypted sound piece data as data constituting the data part DAT as a sound. Write to the storage area of the fragment database D.

Further, the sound piece database creating unit 11 converts the phonetic character read from the recorded sound piece data set storage unit 10 as the sound piece reading data (that is, the above-described sound piece reading data (ie, the above-mentioned). (A) data) is written in the storage area of the sound piece database D.
Further, the head address of the written encrypted sound piece data in the storage area of the sound piece database D is specified, and this address is written in the storage area of the sound piece database D as the data (B) described above.
In addition, the above-described data (C), (D), and (E) generated using sound piece data corresponding to the written encrypted sound piece data are also written in the storage area of the sound piece database D.

(Operation of the main unit)
Next, the operation of the main unit M will be described. In the following, first, it is assumed that the language processing unit 1 has acquired free text data describing a sentence (free text) including an ideogram prepared by the user as a target for synthesizing speech in the speech synthesis system. .

  The language processing unit 1 may acquire any free text data. For example, the language processing unit 1 may acquire the free text data from an external device or a network via an interface circuit (not shown), or may be set in a recording medium drive device (not shown). It is also possible to read from a recording medium (for example, a flexible disk or a CD-ROM) via this recording medium drive device.

Alternatively, the processor performing the function of the language processing unit 1 may deliver the text data used in other processing executed by itself to the processing of the language processing unit 1 as free text data.
As the other processing executed by the processor, for example, voice data representing voice is acquired, and voice recognition is performed on the voice data to identify a phrase represented by the voice. Based on the identified phrase, For example, processing for causing the processor to perform the function of the agent device that specifies the content of the request of the voice speaker and specifies and executes the processing to be executed to satisfy the specified request can be considered.

  When the free text data is acquired, the language processing unit 1 specifies a phonetic character representing the reading of each ideographic character included in the free text by searching the general word dictionary 2 and the user word dictionary 3. . Then, the ideogram is replaced with the specified phonogram. Then, the language processing unit 1 supplies the phonogram string obtained as a result of replacing all ideographic characters in the free text with phonograms to the acoustic processing unit 41 of the rule synthesis processing unit 4.

  When the sound processing unit 41 is supplied with a phonetic character string from the language processing unit 1, for each phonetic character included in the phonetic character string, the waveform of the segment constituting the phoneme represented by the phonetic character The search unit 42 is instructed to search for. The acoustic processing unit 41 supplies the phonetic character string to the prosody prediction unit 53 of the speech piece editing unit 5.

  The search unit 42 searches the waveform database 44 in response to this instruction, and searches for compressed waveform data that matches the contents of this instruction. Then, the searched compressed waveform data is supplied to the decompression unit 43.

  The decompression unit 43 restores the compressed waveform data supplied from the search unit 42 to the segment waveform data before being compressed, and returns it to the search unit 42. The search unit 42 supplies the segment waveform data returned from the decompression unit 43 to the acoustic processing unit 41 as a search result.

  On the other hand, the prosodic prediction unit 53 supplied with the phonetic character string from the acoustic processing unit 41 uses the phonetic character string as a prosody prediction method such as “Fujisaki model” or “ToBI (Tone and Break Indices)”. By adding the analysis based on this, the prosody of the speech represented by the phonetic character string (accent, intonation, stress, phoneme duration, etc.) is predicted, and prosodic prediction data representing the prediction result is generated. Then, this prosodic prediction data is supplied to the acoustic processing unit 41.

  When the acoustic processing unit 41 is supplied with the segment waveform data from the search unit 42 and is supplied with the prosody prediction data from the prosody prediction unit 53, the language processing unit 1 uses the supplied segment waveform data. Speech waveform data representing a speech waveform represented by each phonogram included in the phonogram string is generated.

  Specifically, the acoustic processing unit 41 uses, for example, the prosody supplied from the prosody prediction unit 53 to determine the time length of phonemes configured by the segments represented by the respective segment waveform data supplied from the search unit 42. Identify based on forecast data. Then, an integer closest to the value obtained by dividing the time length of the specified phoneme by the time length of the segment represented by the segment waveform data is obtained, and the segment waveform data is mutually connected by the number equal to the obtained integer. Thus, the speech waveform data may be generated.

  The acoustic processing unit 41 not only determines the time length of the speech represented by the speech waveform data based on the prosodic prediction data, but also processes the segment waveform data constituting the speech waveform data to represent the speech waveform data. The voice may have intensity, intonation, and the like that match the prosody indicated by the prosodic prediction data.

Alternatively, the waveform database 44 may store a plurality of compressed waveform data representing a plurality of segments that constitute the same phoneme and have different intensities and / or intonations. In this case, the acoustic processing unit 41 matches the prosody indicated by the prosody prediction data supplied from the prosody prediction unit 53 among the segment waveform data supplied from the search unit 42 instead of processing the segment waveform data. Speech waveform data representing speech having strength, intonation, and the like that matches the prosody indicated by the prosodic prediction data may be generated by using a unit representing an element having strength, intonation, and the like.
Alternatively, the search unit 42 selects a segment having strength and intonation that matches the prosody indicated by the prosody prediction data supplied from the prosody prediction unit 53 among the compressed waveform data that matches the content of the instruction of the sound processing unit 41. Only what is represented may be searched.

  Then, the sound processing unit 41 synthesizes the generated speech waveform data from the speech piece editing unit 5 in the order in which the phonograms are arranged in the phonogram string supplied from the language processing unit 1. To the unit 54.

  When the waveform data is supplied from the acoustic processing unit 41, the output synthesis unit 54 combines the waveform data with each other in the order supplied by the acoustic processing unit 41, and outputs the combined data as data representing the synthesized speech (synthetic speech data). To do. This synthesized speech synthesized based on the free text data corresponds to speech synthesized by the rule synthesis method.

  The method of outputting the synthesized voice data by the output synthesizer 54 is arbitrary. For example, the synthesized voice represented by the synthesized voice data is output via a D / A (Digital-to-Analog) converter or a speaker (not shown). You may make it reproduce | regenerate. Further, it may be sent to an external device or a network via an interface circuit (not shown), or may be written to a recording medium set in a recording medium drive device (not shown) via this recording medium drive device. Further, the processor that performs the function of the output synthesis unit 54 may deliver the synthesized voice data to another process that is being executed by the processor.

  Next, it is assumed that the acoustic processing unit 41 acquires data representing a phonetic character string (delivery character string data) distributed from the outside. (Note that the method by which the acoustic processing unit 41 acquires the distribution character string data is also arbitrary. For example, the distribution character string data may be acquired by a method similar to the method by which the language processing unit 1 acquires the free text data. )

  In this case, the acoustic processing unit 41 handles the phonetic character string represented by the distribution character string data in the same manner as the phonetic character string supplied from the language processing unit 1. As a result, the compressed waveform data representing the phoneme constituting the phoneme represented by the phonetic character included in the phonetic character string represented by the delivery character string data is retrieved by the search unit 42, and the segment waveform data before being compressed. Is restored by the decompression unit 43. On the other hand, the prosody prediction unit 53 adds an analysis based on the prosody prediction method to the phonetic character string represented by the distribution character string data, and as a result, represents the prediction result of the prosody of the voice represented by the phonetic character string. Prosodic prediction data is generated. Then, the acoustic processing unit 41 converts the speech waveform data representing the speech waveform represented by each phonogram included in the phonogram string represented by the distribution character string data, the restored segment waveform data, and the prosody prediction data. The output synthesizer 54 combines the generated speech waveform data with each other in the order of the phonograms in the phonogram string represented by the distribution character string data. Output as data. This synthesized voice data synthesized based on the distribution character string data also represents voice synthesized by the rule synthesis method.

  In addition, when synthesizing the synthesized speech data based on the distribution character string data, the acoustic processing unit 41 not only determines the time length of the speech represented by the speech waveform data based on the prosodic prediction data, but also the speech waveform data. The segment waveform data constituting the data may be processed so that the voice represented by the voice waveform data has intensity, intonation, and the like that match the prosody indicated by the prosodic prediction data. Alternatively, the waveform database 44 may store a plurality of compressed waveform data representing a plurality of segments that constitute the same phoneme and have different intensities and / or intonations. In this case, the acoustic processing unit 41 matches the prosody indicated by the prosody prediction data supplied from the prosody prediction unit 53 among the segment waveform data supplied from the search unit 42 instead of processing the segment waveform data. Speech waveform data representing speech having strength, intonation, and the like that matches the prosody indicated by the prosodic prediction data may be generated by using a unit representing an element having strength, intonation, and the like. Alternatively, the search unit 42 selects a segment having strength and intonation that matches the prosody indicated by the prosody prediction data supplied from the prosody prediction unit 53 among the compressed waveform data that matches the content of the instruction of the sound processing unit 41. Only what is represented may be searched.

Next, it is assumed that the sound piece editing unit 5 acquires the standard message data, the utterance speed data, and the collation level data while the sound piece database D is connected to the main unit M.
The fixed message data is data representing the fixed message as an ideographic character string. Specifically, for example, if the main unit M constitutes a navigation device mounted on a vehicle, the fixed message data is used for navigation purposes. This is data representing a message or the like to be uttered by the navigation device.
The utterance speed data is data indicating a specified value of the utterance speed of the standard message represented by the standard message data (specified value of the length of time for uttering this standard message).
The collation level data is data for designating a search condition in a search process to be described later performed by the search unit 6, and is assumed to take one of the values “1”, “2”, or “3” below, and “3”. Indicates the strictest search condition.

  Further, the matching sound piece determination unit 52 may use any method for acquiring the standard message data, the utterance speed data, and the collation level data. For example, the standard message may be obtained by the same method as the method for the language processing unit 1 to acquire the free text data. Data, utterance speed data, and verification level data may be acquired.

  When the standard message data, the utterance speed data, and the collation level data are supplied to the sound piece editing unit 5, the morpheme analysis unit 51 of the sound piece editing unit 5 performs morphological analysis on the fixed message data by a known method. The ideographic character string constituting the standard message data is replaced with the phonetic character string. Then, the obtained phonetic character string is supplied to the matching sound piece determination unit 52.

  When the phonogram string is supplied from the morphological analysis unit 51, the coincidence sound piece determination unit 52 searches for all the encrypted phonogram data associated with the phonogram string that matches the phonogram string. The search unit 6 is instructed to do so.

  The search unit 6 searches the sound piece database D in response to an instruction from the matching sound piece determination unit 52, and the corresponding encrypted sound piece data and the above-described sound associated with the corresponding encrypted sound piece data. The piece-read data, the speed initial value data, and the pitch component data are retrieved, and the retrieved encrypted sound piece data is supplied to the decryption unit 7. Even when a plurality of encrypted speech piece data corresponds to a common phonetic character or phonetic character string, all the corresponding encrypted speech piece data are searched for as data candidates used for speech synthesis. On the other hand, when there is a sound piece for which the encrypted sound piece data could not be found, the search unit 6 generates data for identifying the corresponding sound piece (hereinafter referred to as missing part identification data).

Further, the search unit 6 generates the same encryption key as that used for generation of the encrypted sound piece data stored in the sound piece database D, and supplies it to the decryption unit 7.
Specifically, the search unit 6 extracts a total of three of each of the above-mentioned data (C), (D), and (E) stored in the sound piece database D and extracts them. By generating data representing the sum of the three data values, the same encryption key as that used to generate the encrypted sound piece data is generated, and this encryption key is supplied to the decryption unit 7 To do.

  The decryption unit 7 restores the encrypted speech piece data supplied from the search unit 6 to the speech piece data before being compressed using the encryption key supplied from the search unit 6, and then returns to the search unit 6. And return.

  The retrieval unit 6 supplies the speech piece data returned from the decoding unit 7 and the retrieved speech piece reading data, speed initial value data, and pitch component data to the speech speed conversion unit 8 as retrieval results. . Further, when missing part identification data is generated, this missing part identification data is also supplied to the speech speed conversion unit 8.

  On the other hand, the coincidence sound piece determination unit 52 converts the sound piece data supplied to the speech speed conversion unit 8 to the speech speed conversion unit 8, and sets the time length of the sound piece represented by the sound piece data to the sound piece. The editing unit 5 is instructed to match the speed indicated by the utterance speed data supplied.

  In response to the instruction from the matching sound piece determination unit 52, the speech speed conversion unit 8 converts the sound piece data supplied from the search unit 6 so as to match the instruction, and supplies it to the matching sound piece determination unit 52. Specifically, for example, the speech piece data supplied from the search unit 6 is divided into sections representing individual phonemes, and for each obtained section, the segments constituting the phoneme represented by the section from the section. By identifying the part that represents and duplicating the specified part (s) and inserting it into the section, or by removing the part (s) from the section By adjusting the length of the section, the total number of samples of the sound piece data may be set to a time length that matches the speed indicated by the matching sound piece determination unit 52. Note that the speech speed conversion unit 8 may determine the number of inserted or removed portions representing segments for each section so that the ratio of time lengths between phonemes represented by each section does not substantially change. . By doing so, it is possible to finely adjust the sound compared to the case where the phonemes are simply combined and synthesized.

  In addition, the speech speed conversion unit 8 also supplies the sound piece reading data and pitch component data supplied from the search unit 6 to the matching sound piece determination unit 52, and when missing part identification data is supplied from the search unit 6, Further, the missing portion identification data is also supplied to the matching sound piece determination unit 52.

  Note that, when the utterance speed data is not supplied to the matching sound piece determination unit 52, the matching sound piece determination unit 52 causes the speech speed conversion unit 8 to convert the sound piece data supplied to the speech speed conversion unit 8. The speech speed conversion unit 8 responds to this instruction and supplies the speech piece data supplied from the search unit 6 to the matching sound piece determination unit 52 as it is. do it.

  When the voice piece data, the voice piece reading data, and the pitch component data are supplied from the speech speed conversion unit 8, the coincident voice piece determination unit 52 receives the voice pieces constituting the fixed message from the supplied voice piece data. One piece of piece data representing a waveform that can be approximated to a waveform is selected for each piece of sound. However, the matching sound piece determination unit 52 sets, according to the collation level data supplied to the sound piece editing unit 5, what kind of waveform is to be a waveform close to the sound piece of the standard message.

  Specifically, first, the matching sound piece determination unit 52 supplies a phonetic character string obtained, for example, by converting standard message data to the prosody prediction unit 53, and the phonetic character string is sent to the prosody prediction unit 53. Instructs to predict the prosody of the canonical message represented by. In accordance with this instruction, the prosody prediction unit 53 performs analysis based on the above-described prosodic prediction method, predicts the prosody of this fixed message, generates prosodic prediction data representing the prediction result, and matches the speech piece determination unit Return to 52.

When the prosody prediction data is acquired, the matching sound piece determination unit 52, for example,
(1) When the value of the collation level data is “1”, all the speech piece data supplied from the speech rate conversion unit 8 (that is, speech piece data whose reading matches the speech piece in the standard message) Select as close to the waveform of the sound piece in the standard message.

(2) When the value of the collation level data is “2”, the condition of (1) (that is, the condition that the phonetic character representing the reading is matched) is satisfied, and the frequency of the pitch component frequency of the sound piece data is further satisfied. When there is a strong correlation of a predetermined amount or more between the content of the pitch component data representing the time change and the prediction result of the accent (so-called prosody) of the speech piece included in the standard message (for example, the time difference between the accent positions is a predetermined amount) (If it is the following), the sound piece data is selected as being close to the waveform of the sound piece in the standard message. Note that the prediction result of the accent of the sound piece in the standard message can be specified from the prediction result of the prosody of the standard message, and the matching sound piece determination unit 52 is predicted to have the highest frequency of the pitch component, for example. What is necessary is just to interpret the position which is the predicted position of the accent. On the other hand, for the position of the accent of the sound piece represented by the sound piece data, for example, if the position where the frequency of the pitch component is the highest is specified based on the above-described pitch component data, this position is interpreted as the position of the accent. Good. The prosody prediction may be performed on the entire sentence, or the sentence may be divided into predetermined units and performed on each unit.

(3) When the value of the collation level data is “3”, the condition of (2) (that is, the condition of coincidence of phonetic characters and accents indicating reading) is satisfied, and further, The sound piece data is selected as being close to the waveform of the sound piece in the fixed message only when the presence or absence of nasal muffler or devoicing matches the prosodic prediction result of the fixed message. The coincidence sound piece determination unit 52 may determine whether or not the voice represented by the sound piece data is nasalized or unvoiced based on the pitch component data supplied from the speech speed conversion unit 8.

  In addition, when there are a plurality of pieces of sound piece data that match the conditions set by itself, the matching sound piece determination unit 52 sets the pieces of sound piece data to 1 according to conditions that are stricter than the set conditions. We shall narrow down to pieces.

  Specifically, for example, when the set condition corresponds to the value “1” of the collation level data and there are a plurality of corresponding piece of piece data, it corresponds to the value “2” of the collation level data. If the search condition is also selected and multiple pieces of sound piece data are selected, the selection result that further matches the search condition corresponding to the collation level data value “3” is further selected. Perform operations such as If a plurality of pieces of sound piece data still remain after being narrowed down by the search condition corresponding to the value “3” of the collation level data, the remaining one may be narrowed down to one on an arbitrary basis.

Then, the matching sound piece determination unit 52 supplies the sound piece data selected as satisfying the condition corresponding to the value of the collation level data to the output composition unit 54.
However, when there is a sound piece that cannot select sound piece data that satisfies the condition corresponding to the value of the collation level data from the sound piece data supplied from the speech speed conversion unit 8, It is determined that the corresponding sound piece is treated as a sound piece for which the search unit 6 cannot find the encrypted sound piece data (that is, the sound piece indicated by the above-described missing portion identification data).

  On the other hand, the coincidence sound piece determination unit 52, when missing part identification data is also supplied from the speech speed conversion unit 8, or a sound piece for which sound piece data that satisfies the condition corresponding to the value of the collation level data could not be selected If there is, the phonetic character string representing the reading of the sound piece indicated by the missing part identification data (including the sound piece for which the sound piece data that satisfies the condition corresponding to the value of the collation level data could not be selected) is fixed. It is extracted from the message data and supplied to the acoustic processing unit 41 to instruct to synthesize the waveform of this sound piece.

  Upon receiving the instruction, the acoustic processing unit 41 treats the phonetic character string supplied from the matching sound piece determination unit 52 in the same manner as the phonetic character string represented by the distribution character string data. As a result, the compressed waveform data representing the segments constituting the phonemes represented by the phonetic characters included in the phonetic character string is retrieved by the search unit 42, and the segment waveform data before being compressed is expanded by the decompressing unit 43. Restored. On the other hand, the prosody prediction unit 53 generates prosody prediction data representing the prediction result of the prosody of the speech piece represented by the phonetic character string. Then, the acoustic processing unit 41 generates speech waveform data representing the speech waveform represented by each phonogram included in the phonogram string based on each restored unit waveform data and prosodic prediction data. Then, the generated speech waveform data is supplied to the output synthesis unit 54.

  Note that the coincidence sound piece determination unit 52 generates a portion corresponding to the sound piece indicated by the missing part identification data from the prosodic prediction data already generated by the prosody prediction unit 53 and supplied to the coincidence sound piece determination unit 52. In this case, the acoustic processing unit 41 does not need to cause the prosody prediction unit 53 to perform prosody prediction of the sound piece again. In this way, it is possible to utter more naturally than when prosodic prediction is performed for each fine unit such as a sound piece.

  When the output synthesis unit 54 is supplied with the sound piece data from the coincidence sound piece determination unit 52 and is supplied with the sound waveform data generated from the unit waveform data from the acoustic processing unit 41, each of the supplied sound waveforms is supplied. By adjusting the number of segment waveform data included in the data, the time length of the speech represented by the speech waveform data is matched with the utterance speed of the speech unit represented by the speech piece data supplied from the coincidence speech piece determination unit 52 To do.

  Specifically, the output synthesis unit 54 specifies, for example, a ratio in which the time length of the phoneme represented by each of the sections included in the speech piece data from the coincidence speech piece determination unit 52 is increased or decreased with respect to the original time length. The number of segment waveform data in each speech waveform data may be increased or decreased so that the time length of the phonemes represented by the speech waveform data supplied from the acoustic processing unit 41 changes at the ratio. In order to specify the ratio, the output synthesis unit 54 acquires, for example, the original sound piece data used for generating the sound piece data supplied by the matching sound piece determination unit 52 from the search unit 6, and 2 It is only necessary to specify one section representing the same phoneme in each piece of piece data. Then, the number of segments included in the segment specified in the segment data supplied by the matching tone segment determination unit 52 is the number of segments included in the segment specified in the segment data acquired from the search unit 6. The ratio increased or decreased with respect to the number may be specified as the ratio of increase or decrease of the phoneme time length. When the time length of the phoneme represented by the speech waveform data is already matched with the speed of the speech piece represented by the speech piece data supplied from the coincidence speech piece determining unit 52, the output synthesis unit 54 There is no need to adjust the number of segment waveform data.

  Then, the output synthesis unit 54 combines the speech waveform data for which the number of segment waveform data has been adjusted and the speech piece data supplied from the coincidence speech piece determination unit 52 in the standard message indicated by the standard message data. They are combined with each other in the order of each sound piece or phoneme, and output as data representing synthesized speech.

  If the missing part identification data is not included in the data supplied from the speech speed conversion unit 8, the sound piece selected by the sound piece editing unit 5 is immediately selected without instructing the sound processing unit 41 to synthesize the waveform. The data may be combined with each other in the order of the phonetic character string in the standard message indicated by the standard message data and output as data representing the synthesized speech.

  In the speech synthesis system according to the embodiment of the present invention described above, the speech piece data representing the waveform of the speech piece that can be a unit larger than the phoneme is naturally connected by the recording and editing method based on the prosodic prediction result. The voice that reads out the fixed message is synthesized. On the other hand, a sound piece for which appropriate sound piece data could not be selected is synthesized in accordance with a rule synthesis method using compressed waveform data representing a piece that is a unit smaller than a phoneme.

  The decryption of the encrypted sound piece data consists of data extracted by the main unit M from a predetermined portion whose position is not disclosed to the user among other data stored in the sound piece database D. This is done using an encryption key. For this reason, it is not necessary for the sound piece registration unit R or its user to separately supply an encryption key to the main unit M, and therefore there is a low risk that the encryption key will be leaked to a target person who makes the encryption key private. .

  Further, the decryption of the encrypted sound piece data is performed using an encryption key extracted from the data stored in the sound piece database D storing the encrypted sound piece data. For this reason, the main unit M correctly decrypts the encrypted sound piece data stored in the replaced sound piece database D even when the sound piece database D connected to the main body unit M is replaced with another sound piece database D. .

On the other hand, even if the sound pieces have the same reading, if different speakers speak, the data length of the data representing the sound piece, the utterance speed of the sound piece, the frequency of the pitch component of the sound piece The time change is a different value between speakers.
Therefore, even if three pieces of data to be used for generating an encryption key are extracted from a plurality of sound piece databases D from the data (C), (D) and (E) under the same conditions, If the speakers of the sound pieces represented by the encrypted sound piece data stored in the piece database D are different from each other, the encryption keys generated for the respective sound piece databases D are also different from each other. Therefore, the encryption key is unique to the sound piece database D, and the risk that the encryption key generated for one sound piece database D is used for decryption of the encrypted sound piece data in another sound piece database D is substantially avoided. it can.

Note that the configuration of this speech synthesis system is not limited to that described above.
For example, the nonvolatile memory constituting the sound piece database D may be a recording medium that requires a recording medium drive device (for example, a CD-RW drive device) for access, such as a CD (Compact Disc) -RW (ReWritable). It may be configured. However, in this case, the main unit M and the sound piece registration unit R are each provided with a recording medium drive device for accessing the recording medium. Then, the recording medium drive device of the sound piece registration unit R records the data supplied from the sound piece database creation unit 11 on the recording medium set in itself, and the recording medium drive device of the main body unit M self-records. It is assumed that data is read from the set recording medium and supplied to the search unit 6.

Further, the sound piece database D does not necessarily store the header part HDR, the index part IDX or the directory part DIR, and a part or all of the header part HDR, the index part IDX and the directory part DIR is made up of the Internet or the like. You may memorize | store in the external computer connected to the external network.
In this case, specifically, for example, the sound piece database creation unit 11 of the sound piece registration unit R and the search unit 6 of the main unit M may each include a communication control device including a modem or the like. Then, the sound piece database creation unit 11 accesses this computer via this network and uploads part or all of the data belonging to the header part HDR, the index part IDX, and the directory part DIR to this computer, The search unit 6 may acquire the uploaded data by accessing the computer via the network.

In addition, the memory constituting the decoding unit 7 of the main unit M may store an identification code uniquely assigned to the main unit M, and the sound piece registration unit R and the main unit M receive the identification code. You may use for the production | generation of an encryption key.
Specifically, the sound piece database creation unit 11 of the sound piece registration unit R acquires the identification code of the main body unit M, and among the data (C) generated by itself, a predetermined value determined by the value of this identification code. Similarly, a predetermined one determined by the value of this identification code is extracted from the data of (D) and (E) generated by itself, and a total of three extracted You may make it produce | generate an encryption key using data.
Further, the search unit 6 also counts a predetermined one determined by the value of the identification code of the main unit M stored in itself among the data (C), (D), and (E) stored in the sound piece database D. It is only necessary to extract three and generate the encryption key using the extracted three data.
The “predetermined one determined by the value of the identification code” specifically refers to, for example, substituting the value of the identification code (or data including the identification code in a predetermined format) into a predetermined hash function, or Any other data may be used as long as the value is obtained by performing another predetermined calculation on the value of the identification code.

  Moreover, the method in which the sound piece registration unit R acquires the identification code of the main body unit M is arbitrary. Therefore, for example, the sound piece registration unit R includes an input unit composed of a keyboard or the like and a display unit composed of a liquid crystal display device or the like, and the user can identify the main unit M by operating the input unit of the sound piece registration unit R. When a code is input, the compression unit 12 may acquire the identification code from the input unit and use it for creating an encryption key. Further, the sound piece registration unit R and the main unit M may be configured to be connectable to each other. In this case, the compression unit 12 is connected in a state where the sound piece registration unit R and the main unit M are connected to each other. May access the decoding unit 7 to obtain the identification code of the main unit M.

  The memory or recording medium constituting the sound piece database D may store an identification code uniquely assigned to the memory or recording medium, and the sound piece registration unit R stores the identification code as the main unit M. Similarly to the above identification code, it may be used to generate an encryption key.

The calculation performed for generating the encryption key is not necessarily limited to the calculation of adding the extracted three data values to each other, but is arbitrary. Further, the number of data used for the calculation is not limited to three, and two or four or more data may be extracted and used for the calculation.
Further, when the above identification code is used for generating the encryption key, the sound piece database creating unit 11 and the search unit 6 are predetermined values determined by the value of the identification code to the values indicated by the data extracted for generating the encryption key. It is good also as what performs the calculation according to the rule of.

In addition, the data used for generating the encryption key does not necessarily need to be extracted from the data of (C), (D), and (E), and the sound piece database creation unit 11 and the search unit 6 are (C), (D ) And (E), and any data belonging to the header part HDR, index part IDX or directory part DIR is replaced with the data (C), (D) or (E), or ( You may use for the production | generation of an encryption key with the data of C), (D), or (E).
Further, the sound piece database creating unit 11 generates data representing the characteristics of the sound piece data and other arbitrary data representing the characteristics of the sound pieces represented by the sound piece data, stores them in the sound piece database D, and the search unit 6. However, these data may be used for creating an encryption key instead of the data of (C), (D) or (E) or together with the data of (C), (D) or (E).

  The sound piece database creation unit 11 may include a microphone, an amplifier, a sampling circuit, an A / D (Analog-to-Digital) converter, a PCM encoder, and the like. In this case, instead of obtaining the sound piece data from the recorded sound piece data set storage unit 10, the sound piece database creating unit 11 amplifies a sound signal representing the sound collected by its own microphone, samples it, and performs A / After D conversion, the piece data may be created by performing PCM modulation on the sampled audio signal.

Further, the sound piece database creating unit 11 generates a new encrypted sound piece data material to be added to the sound piece database D from a recording medium set in a recording medium drive device (not shown) via the recording medium drive device. May be read.
The sound piece registration unit R does not necessarily need to include the recorded sound piece data set storage unit 10.

  Further, the pitch component data may be data representing a time change of the pitch length of the sound piece represented by the sound piece data. In this case, the matching sound piece determination unit 52 may identify a position having the shortest pitch length (that is, a position having the highest frequency) based on the pitch component data, and interpret this position as an accent position.

  Further, the segment waveform data does not have to be PCM format data, and the data format is arbitrary. Further, the waveform database 44 does not necessarily store the unit waveform data and sound piece data in a compressed state. When the waveform database 44 stores the segment waveform data in a state where the data is not compressed, the main body unit M does not need to include the decompression unit 43.

  Although the embodiment of the present invention has been described above, the speech database manufacturing apparatus and sound piece restoration apparatus according to the present invention can be realized using a normal computer system, not a dedicated system.

  For example, the above-described recorded sound piece data set storage unit 10, sound piece database creation unit 11, and compression unit 12 are caused to execute operations on a personal computer that can be connected to an external nonvolatile memory or recording medium constituting the sound piece database D. By installing the program from a recording medium (CD-ROM, flexible disk, etc.) that stores the program for recording, the sound piece registration unit R that executes the above-described processing can be configured.

A personal computer that executes this program and functions as the sound piece registration unit R performs the process shown in FIG. 3 as a process corresponding to the operation of the sound piece registration unit R of the speech synthesis system of FIG. You can also.
FIG. 3 is a flowchart showing processing executed by the personal computer that performs the function of the sound piece registration unit R.

  That is, when the personal computer registers a sound piece in the sound piece database D, the personal computer first records the non-volatile memory or recording medium constituting the sound piece database D in a state where the personal computer is connected to the personal computer. The phonetic character string and the voice piece data associated with each other are read from the voice piece data set storage unit 10, or the phonetic character string and the voice piece data associated with each other are acquired from the outside (FIG. 3). Step S001), the data length of the obtained sound piece data, and the time variation of the voice production speed and the frequency of the pitch component represented by the sound piece data are specified (Step S002).

The personal computer may specify the data length and the utterance speed in step S002 by, for example, counting the number of samples of the sound piece data.
Moreover, what is necessary is just to identify the time change of the frequency of a pitch component, for example by performing a cepstrum analysis to this sound piece data. Specifically, for example, the waveform represented by the sound piece data is divided into a large number of small parts on the time axis, the cepstrum of each obtained small part is obtained, and the minimum of the frequencies giving the maximum value of this cepstrum is obtained. The value may be specified as the frequency of the pitch component in this small portion. As described above, the time change of the frequency of the pitch component is based on the pitch waveform data after the sound piece data is converted into the pitch waveform data according to the method disclosed in, for example, Japanese Patent Laid-Open No. 2003-108172. If you specify it, you can expect good results.

  Next, the personal computer uses the data (C) and the speed initial value data described above as the result of specifying the data length, the utterance speed, and the frequency change of the pitch component frequency specified in step S002. (That is, the data of (D) described above) and pitch component data (that is, the data of (E) described above) are generated (step S003).

  When the generation of the data (C), (D), and (E) is completed for all the sound pieces to be registered in the sound piece database, the personal computer, for example, collects the generated data set (C), From each of the data set of (D) and the data set of (E), a total of three are selected, one each generated from sound piece data of a predetermined reading for each, Data representing the sum of the values of these three data is generated as an encryption key (step S004).

  Next, the personal computer creates encrypted sound piece data by encrypting the sound piece data supplied from the personal computer using a symmetric key encryption method using the encryption key generated in Step S004 (Step S004). In step S005), the data portion DAT is written in the storage area of the sound piece database D as data constituting the data portion DAT (step S006).

In step S006, the personal computer converts the phonetic character read from the recorded sound piece data set storage unit 10 to indicate the reading of the sound piece represented by the written encrypted sound piece data. (A) is written in the storage area of the sound piece database D.
Further, the head address of the written encrypted sound piece data in the storage area of the sound piece database D is specified, and this address is written in the storage area of the sound piece database D as the data (B) described above.
In addition, the above-described data (C), (D), and (E) generated using sound piece data corresponding to the written encrypted sound piece data are also written in the storage area of the sound piece database D.

  Further, the above-described language processing unit 1, general word dictionary 2, user word dictionary 3, rule synthesis processing unit 4, and sound piece editing unit 5 are connected to a non-volatile memory or a recording medium constituting the sound piece database D. , A main unit that executes the above-described processing by installing the program from a recording medium that stores the program for executing the operations of the search unit 6, the sound piece database D, the decoding unit 7, and the speech rate conversion unit 8. M can be configured.

Then, a personal computer that executes this program and functions as the main unit M may perform the processes shown in FIGS. 4 to 6 as the process corresponding to the operation of the main unit M of the speech synthesis system of FIG. it can.
FIG. 4 is a flowchart showing processing when a personal computer that performs the function of the main unit M acquires free text data.
FIG. 5 is a flowchart showing a process when the personal computer that performs the function of the main unit M acquires the distribution character string data.
FIG. 6 is a flowchart showing processing when a personal computer that performs the function of the main unit M acquires standard message data and utterance speed data.

  That is, when the personal computer obtains the above-mentioned free text data from the outside (step S101 in FIG. 4), the phonogram representing the reading of each ideographic character included in the free text represented by the free text data. Is identified by searching the general word dictionary 2 and the user word dictionary 3, and the ideogram is replaced with the identified phonogram (step S102). Note that the method of acquiring free text data by this personal computer is arbitrary.

  And when this personal computer obtains a phonetic character string representing the result of replacing all ideographic characters in the free text with phonetic characters, for each phonetic character contained in this phonetic character string, The waveform of the unit speech represented by the phonetic character is searched from the waveform database 44, and compressed waveform data representing the waveform of the segment constituting the phoneme represented by each phonetic character included in the phonetic character string is retrieved (step S103). ), The retrieved compressed waveform data is restored to the segment waveform data before being compressed (step S104).

  On the other hand, the personal computer predicts the prosody of the speech represented by the free text by adding analysis based on the prosody prediction method to the free text data (step S105). Then, speech waveform data is generated based on the segment waveform data restored in step S104 and the prosodic prediction result in step S105 (step S106), and the obtained speech waveform data is generated in the phonetic character string. Are combined with each other in the order of the phonograms and output as synthesized speech data (step S107). Note that the method by which the personal computer outputs the synthesized voice data is arbitrary.

  When this personal computer obtains the above-mentioned distribution character string data from the outside by an arbitrary method (FIG. 5, step S201), each phonogram included in the phonogram string represented by this distribution character string data In the same manner as in steps S103 to S104 described above, the process of searching for compressed waveform data representing the waveform of the segment constituting the phoneme represented by the phonetic character, and the retrieved compressed waveform data as the segment waveform A process of restoring data is performed (step S202).

  On the other hand, this personal computer predicts the prosody of the speech represented by the distribution character string by adding an analysis based on the prosody prediction method to the distribution character string (step S203), and the segment waveform data restored in step S202. And speech waveform data is generated based on the prosodic prediction result in step S203 (step S204), and the obtained speech waveform data is exchanged with each other in the order in which the phonograms are arranged in the phonogram string. Combined and output as synthesized speech data by the same process as the process of step S107 (step S205).

  On the other hand, in a state where the non-volatile memory or recording medium constituting the sound piece database D is connected to the personal computer, the personal computer receives the above-mentioned fixed message data, collation level data, and utterance speed data from the outside. When acquired by the technique (FIG. 6, step S301), first, by performing morphological analysis by a known technique on the fixed message data, the ideographic character string constituting the fixed message data is converted into a phonetic character string (step). S302).

  Next, the personal computer searches for all encrypted speech piece data associated with the phonetic character string that matches the phonetic character string obtained in the process of step S302 (step S303).

  In step S303, the above-described sound piece reading data, speed initial value data, and pitch component data associated with the corresponding encrypted sound piece data are also retrieved. In addition, when a plurality of encrypted sound piece data corresponds to one sound piece, all the corresponding encrypted sound piece data are searched. On the other hand, when there is a sound piece for which the encrypted sound piece data could not be found, the above-described missing part identification data is generated.

  Next, the personal computer restores the retrieved encrypted sound piece data to sound piece data before being compressed (step S304). Then, the restored sound piece data is converted by a process similar to the process performed by the speech speed conversion unit 8 described above, and the time length of the sound piece represented by the sound piece data matches the speed indicated by the utterance speed data. (Step S305). In addition, when the utterance speed data is not supplied, the restored sound piece data may not be converted.

  In step S304, the personal computer accesses the sound piece database D, and a predetermined number of each of the data (C), (D), and (E) stored in the sound piece database D is 3 in total. The same encryption key as that used to generate the encrypted sound piece data is generated by extracting the number and generating data representing the sum of the values of the extracted three data. Then, the encrypted sound piece data is decrypted by using the generated encryption key to restore the sound piece data before being compressed.

  Next, the personal computer predicts the prosody of the fixed message by adding an analysis based on the prosodic prediction method to the fixed message represented by the fixed message data (step S306). Then, the above-mentioned matching piece determination unit 52 performs the piece piece data representing the waveform closest to the waveform of the piece constituting the standard message from the piece pieces data in which the time length of the piece is converted, By performing the same process, one piece is selected for each sound piece according to the reference indicated by the collation level data acquired from the outside (step S307).

Specifically, in step S307, the personal computer specifies sound piece data in accordance with, for example, the conditions (1) to (3) described above. That is, when the value of the collation level data is “1”, all of the piece data whose reading matches the sound piece in the standard message is regarded as representing the waveform of the sound piece in the standard message. When the value of the collation level data is “2”, the phonetic character representing the reading matches, and the content of the pitch component data representing the time change of the frequency of the pitch component of the sound piece data is displayed in the standard message. Only when the predicted result of the accent of the included speech piece matches, this speech piece data is considered to represent the waveform of the speech piece in the standard message. When the value of the collation level data is “3”, the phonetic character and the accent representing the reading match, and whether or not the voice represented by the speech piece data is nasalized or unvoiced is determined by the prosody of the standard message. The sound piece data is regarded as representing the waveform of the sound piece in the standard message only when the result matches the predicted result.
If there are a plurality of pieces of sound piece data that match the criteria indicated by the collation level data for one piece of sound, the plurality of pieces of sound piece data are narrowed down to one according to conditions that are stricter than the set conditions. . In addition, when there is a sound piece that cannot select sound piece data that satisfies the condition corresponding to the value of the collation level data, the corresponding sound piece is treated as a sound piece for which the encrypted sound piece data could not be found. For example, it is assumed that missing part identification data is generated.

On the other hand, when the personal computer generates the missing part identification data, the personal computer extracts a phonetic character string representing the reading of the sound piece indicated by the missing part identification data from the standard message data. By processing the phonetic character string represented by the delivery character string data in the same manner as the processing in steps S202 to S204 described above, the waveform of the voice indicated by each phonetic character in the phonetic character string is obtained. The voice waveform data to be represented is generated (step S308).
However, in step S308, the personal computer may generate speech waveform data using the result of prosody prediction in step S306 instead of performing the processing corresponding to the processing in step S203.

  Next, the personal computer adjusts the number of segment waveform data included in the speech waveform data generated in step S308 by performing processing similar to the processing performed by the output synthesis unit 54 described above, and The time length of the voice represented by the waveform data is matched with the utterance speed of the sound piece represented by the sound piece data selected in step S307 (step S309).

  That is, in step S309, for example, the personal computer specifies a ratio in which the time length of the phoneme represented by each of the sections included in the sound piece data selected in step S307 is increased or decreased with respect to the original time length. What is necessary is just to increase or decrease the number of segment waveform data in each audio | voice waveform data so that the time length of the audio | voice represented by the audio | voice waveform data produced | generated by S308 may change by the said ratio. In order to specify the ratio, for example, the speech piece data selected in step S307 (speech piece data after utterance speed conversion) and the original speech piece data before the speech piece data is converted in step S305. And each segment representing the same voice is identified, and the number of segments contained in the segment identified in the speech segment data after the speech speed conversion is identified in the original speech segment data. What is necessary is just to specify the ratio increased / decreased with respect to the number of the pieces contained in an area as a ratio of increase / decrease of the audio | voice time length. In addition, when the time length of the voice represented by the voice waveform data is already matched with the speed of the voice piece represented by the voice piece data after the utterance speed conversion, the personal computer uses the number of segment waveform data in the voice waveform data. There is no need to adjust.

  The personal computer then combines the speech waveform data that has undergone the process of step S309 and the speech piece data selected in step S307 in the order in which the phonetic character strings in the standard message indicated by the standard message data are arranged. Combined and output as data representing synthesized speech (step S310).

The program that causes the personal computer to perform the function of the main unit M or the sound piece registration unit R may be uploaded to a bulletin board (BBS) of a communication line and distributed via the communication line. The carrier wave may be modulated with a signal representing these programs, the obtained modulated wave may be transmitted, and a device that receives the modulated wave may demodulate the modulated wave to restore these programs.
The above-described processing can be executed by starting up these programs and executing them under the control of the OS in the same manner as other application programs.

  When the OS shares a part of the processing, or when the OS constitutes a part of one component of the present invention, a program excluding the part is stored in the recording medium. May be. Also in this case, in the present invention, it is assumed that the recording medium stores a program for executing each function or step executed by the computer.

It is a block diagram which shows the structure of the speech synthesis system which concerns on embodiment of this invention. It is a figure which shows typically the data structure of a sound piece database. It is a flowchart which shows the process which the personal computer which performs the function of the sound piece registration unit of FIG. 1 performs. It is a flowchart which shows a process when the personal computer which performs the function of the main body unit of FIG. 1 acquires free text data. It is a flowchart which shows a process when the personal computer which performs the function of the main body unit of FIG. 1 acquires delivery character string data. It is a flowchart which shows a process when the personal computer which performs the function of the main body unit of FIG. 1 acquires fixed message data and utterance speed data.

Explanation of symbols

M Main unit D Sound piece database R Sound piece registration unit 1 Language processing unit 2 General word dictionary 3 User word dictionary 41 Acoustic processing unit 42 Search unit 43 Extension unit 44 Waveform database 5 Sound piece editing unit 51 Morphological analysis unit 52 Matching sound piece Determination unit 53 Prosody prediction unit 54 Output synthesis unit 6 Search unit 7 Decoding unit 8 Speech rate conversion unit 10 Recorded sound piece data set storage unit 11 Sound piece database creation unit 12 Compression unit HDR Header part IDX Index part DIR Directory part DAT data Part

Claims (20)

Data acquisition means for acquiring sound piece data representing a sound piece;
Data representing the characteristics of the acquired sound piece data and / or data representing the characteristics of the sound pieces represented by the sound piece data are generated, and encryption is performed using a plurality of predetermined data among the generated data An encryption key generating means for generating a key;
An encryption means for generating encrypted sound piece data by encrypting the acquired sound piece data using the generated encryption key;
Sound piece storage means for storing the generated encrypted sound piece data in a storage area of an external storage device,
A voice database manufacturing apparatus characterized by the above. The encryption key generation means decrypts the storage device or the encrypted sound piece data among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. A plurality of data determined by the value of identification data uniquely assigned to an external device for performing the processing as the predetermined data, and generating the encryption key;
The speech database manufacturing apparatus according to claim 1. The encryption key generation means complies with a rule determined by the value of identification data uniquely assigned to the predetermined plurality of data in the storage device or an external device that decrypts the encrypted sound piece data. Generating the encryption key by performing an operation;
The speech database manufacturing apparatus according to claim 1 or 2, wherein The data representing the characteristics of the sound piece data consists of data representing the data length of the sound piece data.
The speech database manufacturing apparatus according to claim 1, 2, or 3. The data representing the characteristics of the sound piece represented by the sound piece data consists of data representing the utterance speed of the sound piece, or data representing the time change of the frequency of the pitch component of the sound piece.
The speech database manufacturing apparatus according to any one of claims 1 to 4, wherein An audio database that stores encrypted sound piece data corresponding to sound piece data representing sound pieces,
The encrypted sound piece data is generated using a plurality of predetermined data among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. It corresponds to the sound piece data encrypted using an encryption key.
Voice database characterized by that. The encrypted speech piece data includes data representing the characteristics of the speech piece data and / or data representing the characteristics of the sound pieces represented by the sound piece data. The sound piece data is encrypted using an encryption key generated as a plurality of predetermined data determined by identification data values uniquely assigned to an external device to be decrypted Equivalent to
The voice database according to claim 6. The encrypted sound piece data has a rule determined by the predetermined plurality of data according to the value of identification data uniquely assigned to the sound database itself or an external device that decrypts the encrypted sound piece data. Using the encryption key generated by performing the operation according to the above, it corresponds to the sound piece data is encrypted,
The voice database according to claim 6 or 7, characterized in that The data representing the characteristics of the sound piece data consists of data representing the data length of the sound piece data.
The voice database according to claim 6, 7 or 8. The data representing the characteristics of the sound piece represented by the sound piece data consists of data representing the utterance speed of the sound piece, or data representing the time change of the frequency of the pitch component of the sound piece.
The speech database according to any one of claims 6 to 9, characterized by the above. Encrypted sound piece data corresponding to the sound piece data representing the sound piece is stored, and the data representing the characteristics of the sound piece data and / or the characteristics of the sound pieces represented by the sound piece data are stored. It is configured to be connectable to an external audio database that further stores data to represent,
A selection means for selecting one of the encrypted speech piece data stored in the speech database to be used for restoring the speech piece;
And decryption means for decrypting the encrypted speech piece data selected by the selection means,
The encrypted sound piece data is generated using a plurality of predetermined data among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. It corresponds to the sound piece data encrypted using an encryption key,
The decryption means acquires the predetermined plurality of data from the voice database, generates the encryption key using the acquired plurality of data, and uses the generated encryption key to generate the encrypted sound. It is for decrypting one piece of data.
A sound piece restoration device characterized by that. The voice database is assigned identification data unique to the voice database,
The encrypted sound piece data includes identification data uniquely assigned to the sound database among data representing the characteristics of the sound piece data and / or data representing the characteristics of the sound pieces represented by the sound piece data. A plurality of items determined by values correspond to those obtained by encrypting the sound piece data using an encryption key generated as the predetermined plurality of data,
The decoding means is based on the value of identification data uniquely assigned to the speech database among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. A plurality of determined items are acquired from the voice database, the encryption key is generated using the acquired plurality of data, and the encrypted sound piece data is decrypted using the generated encryption key. ,
The sound piece restoration apparatus according to claim 11. The voice database is assigned identification data unique to the voice database,
The encrypted sound piece data uses an encryption key generated by performing an operation according to a rule determined by the value of identification data uniquely assigned to the predetermined plurality of data to the predetermined plurality of data, It corresponds to the sound piece data encrypted,
The decryption means generates the encryption key by performing an operation according to a rule determined by a value of identification data uniquely assigned to the speech database on the predetermined plurality of data acquired from the speech database. And decrypting the encrypted sound piece data using the generated encryption key,
The sound piece restoration device according to claim 11 or 12, Further comprising synthesis means for generating data representing synthesized speech by combining the speech piece data decoded by the decoding means with each other;
The sound piece restoration device according to claim 11, 12 or 13. Further comprising synthesizing means for generating data representing synthesized speech by coupling the speech piece data decoded by the decoding means to each other;
The synthesizing means is assigned identification data unique to the synthesizing means,
The encrypted sound piece data includes identification data uniquely assigned to the synthesizing unit among data representing the characteristics of the sound piece data and / or data representing the characteristics of the sound pieces represented by the sound piece data. A plurality of items determined by values correspond to those obtained by encrypting the sound piece data using an encryption key generated as the predetermined plurality of data,
The decoding means is based on the value of the identification data uniquely assigned to the synthesizing means among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. A plurality of determined items are acquired from the voice database, the encryption key is generated using the acquired plurality of data, and the encrypted sound piece data is decrypted using the generated encryption key. ,
The sound piece restoration apparatus according to claim 11. Further comprising synthesizing means for generating data representing synthesized speech by coupling the speech piece data decoded by the decoding means to each other;
The synthesizing means is assigned identification data unique to the synthesizing means,
The encrypted sound piece data uses an encryption key generated by performing an operation according to a rule determined by a value of identification data uniquely assigned to the combining unit on the predetermined plurality of data, It corresponds to the sound piece data encrypted,
The decryption means generates the encryption key by performing an operation according to a rule determined by a value of identification data uniquely assigned to the synthesis means on the predetermined plurality of data acquired from the speech database And decrypting the encrypted sound piece data using the generated encryption key,
The sound piece restoration apparatus according to claim 11 or 15, wherein Acquire sound piece data representing a sound piece,
Data representing the characteristics of the acquired sound piece data and / or data representing the characteristics of the sound pieces represented by the sound piece data are generated, and encryption is performed using a plurality of predetermined data among the generated data Generate a key
Encrypting the acquired sound piece data using the generated encryption key to generate encrypted sound piece data,
Storing the generated encrypted sound piece data in a storage area of an external storage device;
A voice database manufacturing method characterized by the above. Encrypted sound piece data corresponding to the sound piece data representing the sound piece is stored, and the data representing the characteristics of the sound piece data and / or the characteristics of the sound pieces represented by the sound piece data are stored. A sound piece restoration method using a voice database for further storing data to be represented,
A selection step of selecting one of the encrypted speech piece data stored in the speech database to be used for restoring the speech piece;
A decryption step for decrypting the encrypted speech piece data selected in the selection step,
The encrypted sound piece data is generated using a plurality of predetermined data among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. It corresponds to the sound piece data encrypted using an encryption key,
In the decryption step, the predetermined plurality of data is acquired from the speech database, the encryption key is generated using the acquired plurality of data, and the encrypted sound is generated using the generated encryption key. Decrypt one piece of data,
A sound piece restoration method characterized by the above. Computer
Data acquisition means for acquiring sound piece data representing a sound piece;
Data representing the characteristics of the acquired sound piece data and / or data representing the characteristics of the sound pieces represented by the sound piece data are generated, and encryption is performed using a plurality of predetermined data among the generated data An encryption key generating means for generating a key;
An encryption means for generating encrypted sound piece data by encrypting the acquired sound piece data using the generated encryption key;
Sound piece storage means for storing the generated encrypted sound piece data in a storage area of an external storage device;
Program to make it function. Encrypted sound piece data corresponding to the sound piece data representing the sound piece is stored, and the data representing the characteristics of the sound piece data and / or the characteristics of the sound pieces represented by the sound piece data are stored. A computer connectable to an external audio database that further stores data to represent
A selection means for selecting one of the encrypted speech piece data stored in the speech database to be used for restoring the speech piece;
A program for functioning as decryption means for decrypting encrypted sound piece data selected by the selection means,
The encrypted sound piece data is generated using a plurality of predetermined data among the data representing the characteristics of the sound piece data and / or the data representing the characteristics of the sound pieces represented by the sound piece data. It corresponds to the sound piece data encrypted using an encryption key,
The decryption means acquires the predetermined plurality of data from the voice database, generates the encryption key using the acquired plurality of data, and uses the generated encryption key to generate the encrypted sound. It is for decrypting one piece of data.
A program characterized by that.

Images