JP2007241321A - Message transmission system, message transmission method, reception device, transmission device and message transmission program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a message transmission system including a reception device for reading a text message transmitted from a transmission device while displaying an image. <P>SOLUTION: The transmission device 11 transmits the text message to the reception device 13. In the reception device 13, an audio synthesis unit 21 generates a synthesized audio according to the received text message, and outputs it from a loudspeaker 27. An image configuration information generation unit 24 generates information on an image to be displayed together with the output of the synthesized audio, and an image display unit 22 displays an image based on the image information. Here, the audio synthesis unit 21 generates segmentation information as information indicating the break point of the synthesized audio, and inputs it to the image display unit 22. According to the input segmentation information, the image display unit 22 changes the image to be displayed at the timing of the break point of the synthesized audio. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a message transmission system, a message transmission method, a reception apparatus, a transmission apparatus, and a message transmission program for reading a message received by a reception apparatus and displaying an image.

  An example of a conventional message transmission system is described in Non-Patent Document 1. FIG. 17 is a block diagram showing a configuration example of a conventional message transmission system. As shown in FIG. 17, this conventional message transmission system includes a voice synthesis unit 21 and an image display unit 22. The conventional message transmission system having such a configuration operates as follows.

  The voice synthesizer 21 reads out the content of the received electronic mail. At this time, the nature of the voice used for reading (hereinafter referred to as voice quality information) is voice quality information set by the user of the reception apparatus 11 (hereinafter referred to as the receiver) or voice quality information automatically selected by the reception apparatus 11. Is used. The image display unit 22 displays an image corresponding to the electronic mail received by the receiving device 13 and changes the image as the reading progresses.

  For this reason, image configuration information that is information for changing the image information and the image is used. Here, the image configuration information is an image stored in advance in the receiving device 13 by the receiver, and position information of facial parts such as eyes and mouth set by the receiver for the image. In another example, the image configuration information may be stored in advance in the terminal instead of being set by the receiver.

  Another system that reads a received electronic mail is described in Patent Document 1. The system described in Patent Document 1 moves the robot simultaneously with reading out an e-mail with synthesized speech based on the operation control information embedded in the character string in the received message. Also, the voice data of the email received in association with the sender is stored.

  Furthermore, Patent Document 2 describes another method of reading a received electronic mail. The method described in Patent Document 2 selects and displays an image by a sender ID from a plurality of images stored in advance on the receiving side for the received e-mail, and synthesizes the e-mail. Read aloud. The voice quality information of the synthesized voice is used by analyzing the voice of the sender in advance.

“NTT DOCOMO mobile phone general catalog December 2003 (9th edition)” NTT DOCOMO, INC., December 2003, p. 27 JP 2003-308142 A (paragraph 0059-0112, FIG. 1) JP 07-0666832 (paragraphs 0014-0059, FIG. 1)

  However, the first problem of the prior art is that when voice quality information and image configuration information are set together, they must be set separately. In addition, the second problem is that the receiver needs to make preparations such as preselecting voice quality information or image configuration information suitable for the sender of the received electronic mail. Sometimes there is no way to provide voice quality information or image composition information suitable for the sender via a communication line. Furthermore, the third problem is that there is no method for providing voice quality information or image configuration information provided by a third party other than the sender and the receiver to the receiver via the communication line.

  Accordingly, an object of the present invention is to provide a message transmission system, a message transmission method, a reception device, a transmission device, and a message transmission program that can handle voice quality information or image configuration information as a unit. The present invention also provides a message transmission system, a message transmission method, a receiving apparatus, and a transmission in which an e-mail sender can provide voice quality information or image configuration information suitable for the sender at the time of e-mail transmission via a communication line. An object is to provide a device and a message transmission program. Furthermore, the present invention provides a message transmission system, a message transmission method, a reception apparatus, a transmission apparatus, and a message transmission that provide voice quality information or image configuration information provided by a third party other than the sender and the receiver via a communication line. The purpose is to provide a program.

  The message transmission system according to the present invention includes a transmitting means for transmitting a text message, a speech synthesizing means for generating synthesized speech based on the received text message, and image information generation for generating image information to be displayed together with the output of the synthesized speech. Means, image display means for displaying an image based on image information generated by the image information generation means, image configuration information which is information of an image to be displayed on the image display means, and characteristics of synthesized speech to be generated by the voice synthesis means Expression information storage means for preliminarily storing expression information including voice quality information which is information of the image, the image information generation means generates image information based on the image configuration information, and the speech synthesis means Generates synthesized speech based on the generated information, generates delimiter information that indicates the delimiter of the generated synthesized speech, and inputs it to the image display means. Image display means, based on the input delimiter information, and wherein the changing the image to be displayed at the timing of the separated synthesized speech.

  A transmission device including a transmission unit, a voice synthesis unit, an image information generation unit, an image display unit, and a reception device including an expression information storage unit may be provided. According to such a configuration, an image and sound desired by the user of the receiving device can be output to the receiving device.

  Expression information for transmitting the expression information stored in the reception apparatus including the voice synthesis means, the image information generation means, and the image display means, the transmission means, the expression information storage means, and the expression information storage means to the reception apparatus. A receiving device may include voice quality information generating means for receiving the expression information and generating voice quality information, and the image information generating means receives the expression information from the transmitting device. The image configuration information may be generated from the expression information received. According to such a configuration, an image and sound desired by the user of the transmission device can be output to the reception device.

  The transmitting device may include a charging unit that generates expression information charging information that is information on a fee according to the expression information transmitted to the receiving device. According to such a configuration, a charge can be charged to the user of the transmission apparatus according to the expression information transmitted to the reception apparatus.

  External image configuration information storage means for storing all or part of the image configuration information; and image configuration information transmission means for transmitting all or part of the image configuration information stored in the external image configuration information storage means to the receiving device; May be provided. According to such a configuration, the image provided by a third party other than the user of the transmission device and the reception device stored in the external image configuration information storage unit can be output to the reception device.

  The receiving device and the image configuration information providing device may be connected by a dedicated line. According to such a configuration, since the communication protocol between the receiving device and the image configuration information providing device can be simplified, the construction of the message transmission system is simplified.

  The receiving device and the image configuration information providing device may be connected via a public network. According to such a configuration, the user of the receiving device can use image configuration information stored in a plurality of image configuration information providing devices via a public network such as the Internet.

  The expression information may include image index information that is information indicating the position of all or part of the image configuration information stored in the external image configuration information storage unit, and the image information generation unit generates an image based on the image index information. The configuration information transmission unit may request transmission of all or part of the image configuration information stored in the external image configuration information storage unit.

  The image configuration information transmission unit may transmit all or part of the image configuration information stored in the external image configuration information storage unit to the receiving device in response to a request from the image information generation unit.

  The image configuration information providing device may include a billing unit that generates image billing information that is fee information according to the image configuration information transmitted to the receiving device. According to such a configuration, a charge can be charged to the user of the receiving device according to the image configuration information transmitted to the receiving device.

  Voice quality information providing device including external voice quality information storage means for storing all or part of voice quality information, and voice quality information transmission means for sending all or part of voice quality information stored in the external voice quality information storage means to the receiving device May be provided. According to such a configuration, it is possible to cause the receiving device to output synthesized speech having the nature of speech provided by a third party other than the user of the transmitting device and the receiving device, stored in the external voice quality information storage unit. .

  The receiving device and the voice quality information providing device may be connected by a dedicated line. According to such a configuration, since the communication protocol between the receiving device and the voice quality information providing device can be simplified, the construction of the message transmission system is simplified.

  The receiving device and the voice quality information providing device may be connected via a public network. According to such a configuration, the user of the receiving device can use image configuration information stored in a plurality of voice quality information providing devices via a public line network such as the Internet.

  The expression information may include voice quality index information that is information indicating the position of all or part of the voice quality information stored in the external voice quality information storage means, and the voice synthesis means is configured to transmit voice quality information based on the voice quality index information. In addition, transmission of all or part of the voice quality information stored in the external voice quality information storage means may be requested.

  The voice quality information transmitting means may transmit all or part of the voice quality information stored in the external voice quality information storage means to the receiving device in response to a request from the voice synthesis means.

  The voice quality information providing device may include a billing unit that generates voice quality billing information that is information on a fee according to the voice quality information transmitted to the receiving device. According to such a configuration, a charge can be charged to the user of the receiving apparatus according to the voice quality information transmitted to the receiving apparatus.

  The message transmission method according to the present invention receives a text message, voice quality information of expression information including image configuration information that is information of an image to be displayed and voice quality information that is characteristic information of synthesized speech, and a received text message. Generating synthesized speech based on the generated speech, generating break information which is information indicating a break of the synthesized speech, outputting the synthesized speech, generating information on the image to be displayed together with the output of the synthesized speech based on the image configuration information, An image based on the image information is displayed, and the image to be displayed is changed at the timing of the synthesized speech separation based on the separation information.

  Image configuration information may be generated from expression information, and voice quality information may be generated from expression information. According to such a method, an image and sound desired by the user can be output.

  Expression information stored in advance may be transmitted. When expression information is received, image configuration information may be generated from the received expression information, or voice quality information may be generated from the received expression information. According to such a method, the image and sound desired by the user on the transmission side can be output to the output side.

  Expression information billing information, which is fee information corresponding to the transmitted expression information, may be generated. According to such a method, it is possible to charge a charge to the user on the receiving side according to the transmitted expression information.

  The expression information may include image index information that is information indicating a position where all or part of the image configuration information is stored in the external image configuration information storage unit that stores all or part of the image configuration information. Often, based on the image index information, the external image configuration information storage means may be requested to transmit all or part of the stored image configuration information. You may receive all or one part. According to such a method, an image of a third party or the like stored in the external image configuration information storage unit can be output to the receiving side.

  The external image configuration information storage means may generate image billing information that is fee information according to the transmitted image configuration information. According to such a method, a charge can be charged to the user on the receiving side according to the image configuration information transmitted to the receiving side.

  The expression information may include voice quality index information which is information indicating a position where all or part of the voice quality information is stored in the external voice quality information storage means storing all or part of the voice quality information. Based on the index information, the external voice quality information storage means may be requested to transmit all or part of the voice quality information, and all or part of the voice quality information may be received from the external voice quality information storage means. According to such a method, it is possible to cause the receiving side to output synthesized speech having the nature of third-party speech stored in the external voice quality information storage unit.

  In the external voice quality information storage means, voice quality billing information which is information on a fee corresponding to the transmitted voice quality information may be generated. According to such a method, a charge can be charged to the user on the receiving side according to the voice quality information transmitted to the receiving side.

  A receiving device according to the present invention is a receiving device that receives a text message from a transmitting device, and includes voice quality information of expression information including image configuration information that is image information and voice quality information that is information of characteristics of synthesized speech, Speech synthesis means for generating synthesized speech based on a text message received from a transmission device, image information generating means for generating information on an image to be displayed together with output of synthesized speech based on image configuration information, and image information generation Image display means for displaying an image based on the information of the image generated by the means, the speech synthesis means generates separator information that is information indicating a separator of the generated synthesized speech, and inputs it to the image display means, The image display means is characterized in that the image to be displayed is changed at the timing of the synthesized speech separation based on the inputted separation information.

  Expression information storage means for storing expression information in advance may be included, and the image information generation means may generate image configuration information from the expression information. According to such a configuration, it is possible to output an image and sound desired by the user of the receiving apparatus.

  Voice quality information generating means for receiving the expression information and generating voice quality information from the expression information may be included, and the image information generating means may receive the expression information and generate image configuration information from the expression information. According to such a configuration, an image and sound desired by the user of the transmission device can be output to the reception device.

  All or part of the image configuration information may be received from an image configuration information providing apparatus that stores all or part of the image configuration information. According to such a configuration, an image of a third party or the like stored in the image information providing device can be output to the receiving device.

  The expression information may include image index information that is information indicating the position of all or part of the image configuration information stored in the image configuration information providing apparatus, and the image information generation unit is configured to generate the image configuration information based on the image index information. The information providing device is requested to transmit all or part of the image configuration information stored in the image configuration information providing device, and all or part of the image configuration information stored in the image configuration information providing device is transmitted from the image configuration information providing device. May be received.

  The image information providing apparatus may be connected by a dedicated line. According to such a configuration, a communication protocol between the receiving device and the image configuration information providing device can be simplified.

  The image information providing apparatus may be connected to the public line network. According to such a configuration, the user of the receiving device can use the image configuration information stored in the plurality of image information providing devices.

  You may receive all or a part of voice quality information from the voice quality information provision apparatus which memorize | stores all or a part of voice quality information. According to such a configuration, it is possible to cause the receiving device to output synthesized speech having the nature of third-party speech stored in the voice quality information providing device.

  The expression information may include voice quality index information which is information indicating the position of all or a part of the voice quality information stored in the voice quality information providing apparatus, and the speech synthesis means provides the voice quality information providing apparatus based on the voice quality index information. The voice quality information providing apparatus may request transmission of all or part of the voice quality information stored therein, and may receive all or part of the voice quality information stored in the voice quality information providing apparatus from the voice quality information providing apparatus.

  The voice quality information providing apparatus may be connected by a dedicated line. According to such a configuration, the communication protocol between the receiving device and the voice quality information providing device can be simplified.

  The voice quality information providing apparatus may be connected to the public line network. According to such a configuration, the user of the receiving apparatus can use voice quality information stored in a plurality of voice quality information providing apparatuses.

  The transmission device according to the present invention includes a text message to be transmitted to the reception device, image configuration information that is information of an image to be displayed on the reception device, and voice quality information that is information on characteristics of synthesized speech of the text message to be generated by the reception device. It includes transmission means for transmitting expression information.

  The message transmission program according to the present invention provides a computer with synthesized speech based on voice quality information of expression information including image configuration information that is image information and voice quality information that is information of characteristics of synthesized speech, and a received text message. Information generation processing for generating image information to be displayed together with the output of the synthesized voice of the text message, based on the image configuration information And image display means for displaying an image based on the separation information, and performing an image display process for changing the image at the timing of the synthesized speech separation.

  The computer may receive expression information and execute voice quality information generation processing for generating voice quality information from the expression information. In the image information generation process, the expression information is received and image configuration information is generated from the expression information. You may perform the process to perform. According to such a configuration, the image desired by the user on the transmission side can be displayed on the image display means, and the synthesized voice having the property desired by the user on the transmission side can be output to the sound output means.

  In the image information generation process, external image configuration information storage means for storing all or part of the image configuration information and all or part of the image configuration information stored in the external image configuration information storage means are transmitted to the computer. Based on image index information which is information included in the expression information from the image information providing apparatus including the image configuration information transmitting unit and which indicates the position of all or part of the image configuration information stored in the external image configuration information storage unit. The image information providing apparatus may execute processing for requesting the image information providing apparatus to transmit all or part of the image configuration information stored in the image information providing apparatus, and receive all or part of the image configuration information from the image information providing apparatus. Processing may be executed. According to such a configuration, an image of a third party or the like stored in the image information providing apparatus can be displayed on the image display means.

  An external voice quality information storage means for storing all or part of the voice quality information in the speech synthesis process; and a voice quality information transmission means for transmitting all or a part of the voice quality information stored in the external voice quality information storage means to the computer. A voice quality information providing device based on voice quality index information which is information indicating the position of all or part of the voice quality information stored in the external voice quality information storage means. Processing for requesting the voice quality information providing apparatus to transmit all or part of the stored voice quality information may be executed, or processing for receiving all or part of the voice quality information from the voice quality information providing apparatus may be executed. Good. According to such a configuration, it is possible to cause the voice output means to output the synthesized voice having the nature of the third party voice stored in the voice quality information providing apparatus.

  The first effect of the present invention is that an e-mail can be expressed by synthesized speech and an image using voice quality information and image configuration information which are contents linked to a sender. The second effect is that closer communication can be performed by using voice quality information or image configuration information provided by the sender of the e-mail. Furthermore, the third effect is that, for example, a third party who has the right to use voices and images of celebrities and characters provides the receiver with voice quality information or image configuration information. This means that more diverse communication is possible.

Embodiment 1 FIG.
A first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration example of the first embodiment of the present invention.

  In the first embodiment of the present invention, a transmission device 11 that transmits a text message such as an electronic mail via a communication line 12, an output of synthesized speech based on the text message received from the transmission device 11, and a synthesized speech And a receiving device 13 that outputs an image corresponding to the output.

  The transmission device 11 includes a text message storage unit 31 that stores a text message, and a transmission unit 32 that transmits the text message stored in the text message storage unit 31 to the reception device 13 via the communication line 12.

  The receiving device 13 includes an expression information storage unit (expression information storage unit) 34 that stores expression information including voice quality information and image configuration information, and a voice quality information generation unit (voice quality information generation unit) 23 that generates voice quality information from the expression information. An image configuration information generation unit (image information generation unit) 24 that generates image configuration information from expression information, an image configuration information storage unit 33 that stores image configuration information, and converts a text message into synthesized speech based on voice quality information A speech synthesizer (speech synthesizer) 21 that generates delimiter information, which is information indicating a delimiter of the synthesized speech, and an image display unit (image display unit) 22 that displays an image based on the image configuration information and the delimiter information. And a speaker 27 for outputting synthesized speech.

  The voice quality information generation unit 23 generates voice quality information from the expression information stored in the expression information storage unit 34. Here, the voice quality information is information that designates the voice quality of the synthesized voice generated by the voice synthesis unit 21 by converting the text message. Voice quality information includes the elements that recall the voice of a specific individual or conceptual person, such as speaker name, voice pitch, strength of inflection, and ending features, as well as utterances such as utterance speed and impatience. It includes one or more of the elements that remind you of the situation you are facing.

  The image configuration information generation unit 24 generates image configuration information from the expression information stored in the expression information storage unit 34. Here, the image configuration information is information used by the image display unit 22 to configure and display an image of the sender himself or his / her proxy character. In addition, the image configuration information may include information on a basic image, which is a basic image for generating an image, and information on the position and shape of eyes, mouth, eyebrows, etc. in the case of a face image. In the case of the image of this part, the same information may be included. The image configuration information generation unit 24 stores the generated image configuration information in the image configuration information storage unit 33. The image configuration information storage unit 33 stores image configuration information.

  Note that the image configuration information may be information such as an inanimate object such as a portrait or a character that reminds the receiver of the sender, in addition to the photograph of the sender himself / herself or the whole body. The image configuration information is not limited to the above, but uses parameters for combining and displaying characters by computer graphics (CG), or a bundle of numbers of each of a plurality of still images. May be.

The voice synthesis unit 21 converts the text message received from the transmission device 11 into synthesized voice based on the voice quality information generated by the voice quality information generation unit 23 and outputs the synthesized voice to the speaker 27.
During the output of synthesized speech, there are various types of breaks such as the start of output of synthesized speech, paragraph breaks, sentence breaks, syllable breaks, and termination of output of synthesized speech. The voice synthesizer 21 outputs the delimiter information to the image display unit 22 at some predetermined delimiter timings among these delimiters.

  The image display unit 22 generates an image based on the image configuration information stored in the image configuration information storage unit 33 at the timing when the speech synthesis unit 21 inputs the delimiter information, and displays the generated image. The image display unit 22 stores elements of image configuration information that are read according to the delimiter information input by the speech synthesizer 21 in advance.

  Here, the transmission device 11 and the reception device 13 are, for example, cellular phones having an electronic mail transmission / reception function, and the communication line 12 is a cellular phone communication network and a data communication network associated therewith. However, the application of the present invention is not limited to these, and may be an electronic mail system or chat system via the general Internet, a personal computer communication system using a dedicated host, an IP telephone network, a video communication network, or the like. Further, the communication between the transmission device 11 and the reception device 13 via the communication line 12 may not be bidirectional communication, but may be unidirectional communication from the transmission device 11 to the reception device 13.

  Here, the receiving device 13 generates synthesized speech based on voice quality information of expression information including image configuration information that is image information and voice quality information that is information of characteristics of synthesized speech, and the received text message. A speech synthesis process for generating delimiter information, which is information indicating a delimiter of the synthesized speech, an image information generation process for generating image information to be displayed together with the output of the synthesized voice of the text message based on the image configuration information, and a delimiter On the basis of the information, a message transmission program for executing an image display process for changing and displaying an image at the timing of the synthesized speech is mounted on the image display unit 22 for displaying an image.

  Next, the operation of the first exemplary embodiment of the present invention will be described. FIG. 2 is a flowchart for explaining the operation of the first embodiment of the present invention.

  The transmission unit 32 of the transmission device 11 transmits the text message stored in the text message storage unit 31 to the reception device 13 via the communication line 12 (step S101). FIG. 3 shows an example of the text message stored in the text message storage unit 31. In the example illustrated in FIG. 3, the text message storage unit 31 stores a text message “Today is good weather”. The transmission unit 32 transmits a text message “Today is good weather” to the reception device 13 via the communication line 12.

  In the receiving device 13, when the speech synthesizer 21 receives the text message, it notifies the voice quality information generator 23 and the image configuration information generator 24 that the text message has been received (step S102). The voice quality information generation unit 23 and the image configuration information generation unit 24 read the expression information stored in the expression information storage unit 34 (step S103). FIG. 4 is an explanatory diagram illustrating an example of expression information. In the example shown in FIG. 4, the expression information includes voice quality information and image configuration information.

  The voice quality information generation unit 23 generates voice quality information from the read expression information, and the image configuration information generation unit 24 generates image configuration information from the read expression information (step S104). FIG. 5 is an explanatory diagram showing an example of voice quality information. The voice quality information is information indicating a speaker, an utterance speed, and a voice pitch. Here, in the example shown in FIG. 5, the pitch of the voice is set to the reference value +100 Hz, but may be indicated by an absolute value such as 350 Hz, for example. FIG. 6 is an explanatory diagram illustrating an example of image configuration information. The image configuration information indicates the basic image, the relative position of the eyes, the size of the eyes, the relative position of the mouth, and the opening of the mouth. The relative position of the eyes and the relative position of the mouth are represented by coordinate values normalized with the center of the face image as the origin, for example. In the relative position of the eyes, the relative position of the right eye is, for example, the Y coordinate value and the X coordinate value of the intersection of the diagonal lines of the rectangle surrounding the right eye, and the relative position of the left eye is surrounded by the left eye. The Y coordinate value and the X coordinate value of the intersection of the diagonal lines of the rectangle. The relative position of the mouth is, for example, the Y coordinate value (indicating the vertical position of the mouth) of the upper side of the quadrangle surrounding the mouth, the square width value (indicating the mouth width), and the like. It is indicated by the value of the height of the rectangle (indicating the thickness of the mouth). In the size of the eye, for example, the size of the right eye is indicated by the values of the height (indicating the thickness of the right eye) and the width (indicating the width of the right eye) of the quadrangle surrounding the right eye. The size is indicated by the values of the height (indicating the thickness of the left eye) and the width (indicating the width of the left eye) of the quadrangle surrounding the left eye. The opening degree of the mouth is represented by a normalized value, for example, where the height of a quadrangle that touches and surrounds the mouth when the mouth is opened the most is 100. For example, when the opening degree of the mouth is 75, it indicates that the mouth is open at a height of 75% when the mouth is opened most widely. In the example of this embodiment, the image indicated by the image configuration information is expressed by the numerical value by the above-described method. However, the present invention is not limited to this. May show. The image configuration information generation unit 24 stores the generated image configuration information in the image configuration information storage unit 33.

  The image display unit 22 reads the image configuration information stored in the image configuration information storage unit 33 and displays a basic image (step S105). The voice synthesizer 21 performs voice synthesis of the received text message based on the voice quality information generated by the voice quality information generator 23, generates a synthesized voice, and starts outputting the synthesized voice to the speaker 27 (step S106). .

  FIG. 7 is an explanatory diagram illustrating an example of a speech waveform of a synthesized speech generated by the speech synthesizer 21 performing speech synthesis of a received text message based on voice quality information. Here, the speech synthesizer 21 has timing point information therein. As an example of the timing points in this embodiment, time A to time D are shown in FIG. Time A represents the time at the start of utterance, time B represents the time at the time of reading, time C represents the time at the paragraph break recognized by the speech synthesizer 21, and time D represents the end of utterance. The voice synthesizer 21 generates delimiter information at the time of each timing point and outputs it to the image display unit 22. The image information display unit 22 changes the image to be displayed in a predetermined image at the time of each timing point based on the delimiter information.

  At time A (step S107), the image display unit 22 reads information on the relative position of the mouth and the opening degree of the mouth stored in the image configuration information storage unit 33 (step S108). Then, the image display unit generates an image around the mouth according to the read information on the relative position of the mouth and the opening degree of the mouth, and overwrites the image around the mouth of the displayed basic image. In this embodiment, since the opening degree of the mouth of the basic image is 75, the mouth opening degree is 100, and the image is rewritten to an image with the mouth opened (step S109).

  At time B (step S110), the image display unit 22 reads information on the relative position and the eye size stored in the image configuration information storage unit 33 (step S111). Then, with the relative position of the eyes at the center, for example, the image in the quadrangle surrounding the right eye is tilted 30 degrees counterclockwise. Further, the image in the quadrangle that touches the left eye is tilted 30 degrees in the clockwise direction. Then, an image that looks like the eyes are laughing is generated, and the image display unit 22 rewrites the image around the eyes of the basic image into an image that looks like the eyes are laughing (step S112).

  At time C (step S113), the image display unit 22 reads information on the relative position and the eye size stored in the image configuration information storage unit 33 (step S114). Then, the image display unit generates an image around the eye according to the read information on the relative position of the eye and the size of the eye, and overwrites the image around the laughing eye being displayed. Is rewritten to a basic image (step S115).

  At time D (step S116), the image display unit 22 reads information on the relative position of the mouth and the opening degree of the mouth stored in the image configuration information storage unit 33 (step S117). Then, the image display unit generates an image around the mouth according to the read information on the relative position of the mouth and the opening of the mouth, and overwrites the displayed image around the open mouth. In this embodiment, since the opening degree of the mouth of the basic image is 75, the image of the opening degree of the mouth having the opening degree of 100 is rewritten to the basic image having the opening degree of the mouth of 75 (step S118). .

  The voice synthesizer 21 finishes outputting the synthesized voice (step S119), and the image display unit 22 finishes displaying the image (step S120).

  FIG. 8 is an explanatory diagram illustrating an example of an image output from the image display unit 22 in the first embodiment. As described in the description of the operation of the first embodiment, it can be seen that from time A to time D, the image output by the image display unit 22 changes according to the time.

  As described above, according to this embodiment, the image display unit 22 can output an image so that the image appears to move in conjunction with the output of the text message.

  In this embodiment, the text message has been described by taking plain text as an example. However, a rich text with modification information, a phonetic symbol string representing the utterance content of speech synthesis, or the like may be used. In that case, the speech synthesizer 21 corresponding to each is used. The operation shown in the flowchart of FIG. 2 is predetermined for each delimiter time, but in addition to the type of word in the sentence, a specific character type such as a symbol, and modification information in the case of rich text It may be determined in advance.

  In this embodiment, the expression information is single for the sake of explanation. Here, when there are a plurality of transmission apparatuses 11 (senders), the expression information storage unit 34 stores a plurality of expression information corresponding to the transmission apparatuses 11. Then, the transmission device 11 transmits a sender ID indicating the transmission device together with the text message, and the speech synthesizer 21 outputs the received sender ID to the voice quality information generation unit 23 and the image configuration information generation unit 24 to obtain the voice quality. The information generation unit 23 and the image configuration information generation unit 24 each read expression information corresponding to the sender ID.

Embodiment 2. FIG.
A second embodiment of the present invention will be described with reference to the drawings. FIG. 9 is a block diagram showing a configuration example of the second exemplary embodiment of the present invention. In the configuration of the present embodiment, the transmission device 11 includes the expression information storage unit 34 of the reception device 13 of the first embodiment, and other configurations are the same as those of the first embodiment. For this reason, the same circuits as those in the first embodiment are denoted by the same reference numerals as those in FIG.

  The transmission unit (expression information transmission means) 32 included in the transmission device 11 is stored in the expression information storage unit 34 via the communication line 12 together with or separately from the text message stored in the text message storage unit 31. The expression information is transmitted to the receiving device 13. In the receiving device 13, the voice quality information generation unit 23 and the image configuration information generation unit 24 receive the expression information.

  Here, the transmission unit 32 may transmit the text message and the expression information as a unit through the communication line 12 or separately. When the text message and the expression information are transmitted separately, the communication lines 12 that transmit the text message and the expression information may not be physically and logically the same.

  The receiving device 13 generates synthesized speech based on voice quality information of expression information including image configuration information which is image information and voice quality information which is characteristic information of synthesized speech, and a received text message, and generates synthesized speech. A speech synthesis process for generating delimiter information, which is information indicating the delimiter of the image, an image information generation process for generating image information to be displayed together with the output of the synthesized voice of the text message based on the image configuration information, and based on the delimiter information Then, a message transmission program for executing an image display process for displaying an image by changing the image at the timing of the synthesized speech is mounted on the image display unit 22 for displaying the image. In addition, the voice information generation processing for generating the voice quality information from the expression information may be executed by receiving the expression information. In the image information generation process, the expression information is received and the image configuration information is generated from the expression information. Processing may be executed.

  Next, the operation of the second exemplary embodiment of the present invention will be described with reference to the drawings. FIG. 10 is a flowchart for explaining the operation of the second exemplary embodiment of the present invention.

  The transmission unit 32 of the transmission device 11 transmits the text message and the expression information to the reception device 13 via the communication line 12 (Step S201). The transmission unit 32 attaches a common header to the text message and the expression information, and transmits the communication line 12 as a unit. However, the present invention is not limited to this, and the transmission unit 32 may transmit the text message and the expression information as separate data. In addition, once the text message and the expression information are sent together, the expression information is stored in a storage unit (not shown) of the receiving device 13 and transmission of the expression information is omitted unless the expression information is changed. May be. Then, it becomes the structure similar to the 1st Embodiment of this invention.

  In the receiving device 13, the voice quality information generation unit 23 and the image configuration information generation unit 24 receive the expression information, and the speech synthesis unit 21 receives the text message (step S202).

  The voice quality information generation unit 23 generates voice quality information from the received expression information, and the image configuration information generation unit 24 generates image configuration information from the received expression information (step S203). The image configuration information generation unit 24 stores the generated image configuration information in the image configuration information storage unit 33.

  The image display unit 22 reads the image configuration information stored in the image configuration information storage unit 33 and displays a basic image (step S204). The voice synthesizer 21 performs voice synthesis of the received text message based on the voice quality information generated by the voice quality information generator 23, generates a synthesized voice, and starts outputting the synthesized voice to the speaker 27 (step S205). .

  Since the operations after step S206 (steps S206 to S219) are the same as the operations after step S107 (steps S107 to S120) in the first embodiment, the description thereof will be omitted.

  As described above, according to the second embodiment of the present invention, since the transmission device 11 transmits the expression information to the reception device 13, the reception device receives the synthesized voice of the voice quality desired by the user of the transmission device 11. 13 speakers 27, and an image desired by the user of the transmission device 11 can be displayed on the image display unit 22 in conjunction with the output of the synthesized voice.

Embodiment 3 FIG.
A third embodiment of the present invention will be described with reference to the drawings. FIG. 11 is a block diagram showing a configuration example of the third embodiment of the present invention. The configuration of this embodiment includes a server (image configuration information providing device, voice quality information providing device) 15 connected to the image configuration information generating unit 24 of the receiving device 13 of the second embodiment via a communication line 14. Including points is different from the second embodiment. Then, the server 15 transmits a server image configuration information storage unit (external image configuration information storage unit) 35 that stores image configuration information in advance and an image configuration information stored in the server image configuration information storage unit 35 to a communication line. 14 includes an image configuration information transmission unit (image configuration information transmission unit) 25 that transmits the image configuration information to the image configuration information generation unit 24 of the reception device 13 via the network 14. Other configurations are the same as those of the second embodiment. For this reason, circuits similar to those of the second embodiment are denoted by the same reference numerals as those in FIG. 9, and description thereof is omitted. The communication line 14 may connect the image information generation unit 24 and the server 15 via a dedicated line such as a LAN (Local Area Network), or may connect the image information generation unit 24 and the server 15 via a public line such as the Internet. May be connected. If the communication line 14 is a public line such as the Internet, the communication line 14 may be partially shared with the communication line 12.

  FIG. 12 is an explanatory diagram illustrating an example of expression information according to the third embodiment. In the example shown in FIG. 12, the expression information includes voice quality information and an index of image configuration information. The index of the image configuration information is information indicating a device that stores the image configuration information and a position in the device that stores the image configuration information. In the example of this embodiment, since the server image configuration information storage unit 35 of the server 15 stores the image configuration information, the index of the image configuration information includes the IP address of the server 15 and the image configuration in the server 15. The position number is a number indicating the position where the information is stored. Here, the index of the image configuration information is not limited to the set of the server IP address and the position number in the server 15, but may be a set of the server name and full path name, a URI (Uniform Resource Identifier), or the like. .

  When receiving the expression information including the index of the image configuration information, the image configuration information generation unit 24 connects to the server 15 via the communication line 14 based on the index of the image configuration information, and transmits the position number of the image configuration information. . The image configuration information transmission unit 25 of the server 15 reads the image configuration information of the position number received from the image configuration information generation unit 24 from the server image configuration information storage unit 35, and the read image configuration information via the communication line 14. It transmits to the image configuration information generation unit 24.

  Here, the receiving device 13 generates synthesized speech based on voice quality information of expression information including image configuration information that is image information and voice quality information that is information of characteristics of synthesized speech, and the received text message. A speech synthesis process for generating delimiter information, which is information indicating a delimiter of the synthesized speech, an image information generation process for generating image information to be displayed together with the output of the synthesized voice of the text message based on the image configuration information, and a delimiter On the basis of the information, a message transmission program for executing an image display process for changing and displaying an image at the timing of the synthesized speech is mounted on the image display unit 22 for displaying an image. Also, in the image information generation process, the server image configuration information storage unit 35 that stores all or part of the image configuration information, and all or part of the image configuration information stored in the server image configuration information storage unit 35 are transmitted. An index of image configuration information that is information included in the representation information from the server 15 including the image configuration information transmission unit 25 to be stored and that indicates the position of all or part of the image configuration information stored in the server image configuration information storage unit 35 The server 15 may execute a process of requesting the server 15 to transmit all or part of the image configuration information stored in the server 15 or perform a process of receiving all or part of the image configuration information from the server 15. May be. Furthermore, in the speech synthesis process, an external voice quality information storage unit (not shown) that stores all or part of the voice quality information, and a voice quality that transmits all or part of the voice quality information stored in the external voice quality information storage unit From the server 15 including the information transmitting unit (not shown), an index of voice quality information which is information included in the expression information and indicating the position of all or part of the voice quality information stored in the external voice quality information storage unit Based on the above, processing for requesting the server 15 to transmit all or part of the voice quality information stored in the server 15 may be executed, and processing for receiving all or part of the voice quality information from the server 15 is executed. May be.

  Next, the operation of the third exemplary embodiment of the present invention will be described. FIG. 13 is a sequence diagram illustrating an operation when the image configuration information generation unit 24 receives image configuration information from the image configuration information transmission unit 25.

  When receiving the index of the image configuration information (step S301), the image configuration information generation unit 24 requests connection to the image configuration information transmission unit 25 of the server 15 via the communication line 14 (step S302). The image configuration information transmitting unit 25 permits the connection (step S303).

  The image configuration information generation unit 24 transmits the position number included in the index of the image configuration information to the image configuration information transmission unit 25 via the communication line 14 and requests transmission of the image configuration information (step S304). When receiving the position number (step S305), the image configuration information transmitting unit 25 reads the image configuration information of the received position number from the server image configuration information storage unit 35 (step S306), and the read image configuration information is stored in the image configuration information. The information is transmitted to the information generator 24 via the communication line 14 (step S307).

  When receiving the image configuration information (step S308), the image configuration information generation unit 24 requests the image configuration information transmission unit 25 to disconnect the connection (step S309). The image configuration information transmission unit 25 permits the disconnection (step S310). The image configuration information generation unit 24 disconnects from the image configuration information transmission unit 25 (step S311).

  Operations of the transmission device 11, the reception device 13, and the server 15 according to the third embodiment of the present invention will be described. FIG. 14 is a flowchart for explaining the operation of the third embodiment of the present invention.

  The transmission unit 32 of the transmission device 11 transmits the text message and the expression information to the reception device 113 via the communication line 12 (Step S401). In the receiving device 13, the voice quality information generation unit 23 and the image configuration information generation unit 24 receive the expression information, and the speech synthesis unit 21 receives the text message (step S402).

  The image information generation unit 24 receives the image configuration information from the server 15 via the communication line 14 based on the index of the image configuration information included in the expression information (step S403). The image information generation unit 24 performs the operation shown in the sequence diagram of FIG. 13 and receives image configuration information from the server 15. Then, the image information generation unit 24 stores the received image configuration information in the image configuration information storage unit 33 and notifies the voice synthesis unit 21 that the image configuration information has been received.

  The voice quality information generation unit 23 generates voice quality information from the received expression information (step S404). The image display unit 22 reads the image configuration information stored in the image configuration information storage unit 33 and displays a basic image (step S405). The voice synthesizer 21 performs voice synthesis of the received text message based on the voice quality information generated by the voice quality information generator 23, generates a synthesized voice, and starts outputting the synthesized voice to the speaker 27 (step S406). .

  Since the operations after step S407 (steps S407 to S420) are the same as the operations after step S106 in the first embodiment (steps S107 to S120), description thereof will be omitted.

  In the example described in the third embodiment, the image configuration information generation unit 24 receives all of the image configuration information from the server 15, but the present invention is not limited to this, and the image configuration information is not limited to this. May be received from the transmission device 11 as expression information, and the remaining information may be received from the server 15. Specifically, a part of the information necessary for the image display unit to display an image (for example, a basic image) is missing in the image configuration information of the expression information, or the image configuration information of the expression information includes the basic information. In a case where information indicating that there is no image and an index in which the basic image is stored are included, the image configuration information generation unit 24 connects to the server 15 to receive the basic image and receives from the server 15 The image configuration information may be generated from the basic image and other information included in the expression information.

  In the example described in the third embodiment, all or part of the image configuration information is received from the server 15. However, the server 15 stores the voice quality information and the voice quality information generation unit 23. May be connected to the server 15 via the communication line 14, and all or part of the voice quality information may be received from the server 15 to generate the voice quality information. In that case, an index of voice quality information is included in the expression information. Further, the image configuration information unit 24 may receive all or part of the image configuration information from the server 15, and the voice quality information generation unit 23 may receive all or part of the voice quality information from the server 15.

  As described above, according to this embodiment, the image displayed by the image display unit 22 or the synthesized speech generated by the speech synthesis unit 21 is based on the image configuration information or voice quality information stored in the server 15. For example, a third party who has the right to use celebrity or character images and voices stores the image configuration information or voice quality information in the server 15 and transmits the information to the reception device 13. The 11 users and the user of the receiving device 13 can perform more various communications.

  Further, if the communication line 14 is a dedicated line such as a LAN, the communication protocol between the image information generation unit 24 and the server 15 can be simplified, so that the system can be easily constructed. If the communication line 14 is a public line network such as the Internet, the image information generation unit 24 may connect to another server and receive image configuration information or voice quality information stored in the other server. Therefore, the user of the receiving device 13 can use image configuration information or voice quality information stored in a plurality of servers.

Embodiment 4 FIG.
A fourth embodiment of the present invention will be described with reference to the drawings. FIG. 15 is a block diagram showing a configuration example of the fourth embodiment of the present invention. The configuration of the present embodiment is that the server 15 of the third embodiment includes a billing information generation unit (billing means) 26 connected to an external billing processing system via the communication line 16 in the third embodiment. The form is different. Then, when the image configuration information transmission unit 25 transmits the image configuration information stored in the server image configuration information storage unit 35 to the image configuration information generation unit 24 of the reception device 13 via the communication line 14, the transmitted image configuration information is transmitted. The information and information indicating the destination receiving device 13 are output to the billing information generating unit 26. Other configurations are the same as those of the third embodiment. For this reason, circuits similar to those of the third embodiment are denoted by the same reference numerals as those in FIG.

  Next, the operation of the fourth exemplary embodiment of the present invention will be described. In FIG. 16, the image configuration information generation unit 24 receives image configuration information from the image configuration information transmission unit 25, and the image configuration information transmission unit 25 displays information indicating the transmitted image configuration information and the receiving device 13 that is the transmission destination. FIG. 11 is a sequence diagram illustrating an operation when outputting to billing information generating unit 26.

  When the image configuration information generation unit 24 receives the index of the image configuration information (step S501), it transmits information indicating the receiving device 13 to the image configuration information transmission unit 25 of the server 15 to request connection (step S502). . The image configuration information transmitting unit 25 authenticates the receiving device 13 (step S503) and permits the connection (step S504).

  The image configuration information generation unit 24 transmits the position number included in the index of the image configuration information to the image configuration information transmission unit 25 (step S505). When receiving the position number (step S506), the image configuration information transmitting unit 25 reads the image configuration information of the received position number from the server image configuration information storage unit 35 (step S507), and the read image configuration information is read out from the image configuration information. It transmits to the information generation part 24 (step S508).

  The image configuration information transmitting unit 25 outputs the transmitted image configuration information and information indicating the destination receiving device 13 to the billing information generating unit 26 (step S509). The charging information generation unit 26 determines the amount to be charged to the receiving device 13 based on the transmitted image configuration information and the information indicating the receiving device 13 of the transmission destination, and the determined charging amount and the information indicating the receiving device 13 The billing information is generated (step S510), and the generated billing information is transmitted to the external billing processing system via the communication line 16 (step S511). The external charging processing system charges the user of the receiving device 13 based on the received charging information and charges a fee. The amount to be charged may be determined by an external charging processing system. In this case, the billing information is information including the transmitted image configuration information and information indicating the destination receiving device 13.

  When receiving the image configuration information (step S512), the image configuration information generation unit 24 requests the image configuration information transmission unit 25 to disconnect (step S513). The image configuration information transmission unit 25 permits the disconnection (step S514). The image configuration information generation unit 24 disconnects from the image configuration information transmission unit 25 (step S515).

  In the example described above, the billing information generation unit 26 determines the amount to be billed to the receiving device 13 based on the transmitted image configuration information and the information indicating the receiving device 13 of the transmission destination. The server 15 may store voice quality information, and determine the amount charged to the receiving device 13 based on the transmitted voice quality information and information indicating the receiving device 13 of the transmission destination.

  As described above, according to this embodiment, the user of the receiving device 13 can perform billing processing according to the number and types of use of the image configuration information and voice quality information, for example, voice quality information of celebrities and characters. And image configuration information can be provided to the user of the receiving device 13 for a fee. Further, for example, if an element of advertisement / promotion is included in the image configuration information or voice quality information, the advertiser can be charged according to the number of times such image configuration information or voice quality information is used.

  In the present embodiment, the billing information generation unit 26 is included in the server 15, but the transmission device 11 includes the billing information generation unit 26, and the billing information generation unit 26 receives the expression information from the transmission unit 32. May be charged to the user of the receiving device 13 according to the transmitted expression information.

  INDUSTRIAL APPLICABILITY According to the present invention, the present invention can be applied to uses for transmitting and receiving text messages such as e-mail, electronic conference, and chat. Further, the present invention can be applied to a purpose of outputting a mechanically generated message such as a man-machine interface.

It is a block diagram which shows one structural example of the 1st Embodiment of this invention. It is a flowchart explaining the operation | movement of the 1st Embodiment of this invention. It is an example of the text message which the text message storage part has memorized. It is explanatory drawing which shows an example of expression information. It is explanatory drawing which shows an example of voice quality information. It is explanatory drawing which shows an example of image structure information. It is explanatory drawing which shows an example of the audio | voice waveform of a synthetic voice. It is explanatory drawing which shows the example of the image which an image display part outputs. It is a block diagram which shows one structural example of the 2nd Embodiment of this invention. It is a flowchart explaining the operation | movement of the 2nd Embodiment of this invention. It is a block diagram which shows one structural example of the 3rd Embodiment of this invention. It is explanatory drawing which shows an example of the expression information of 3rd Embodiment. It is a sequence diagram explaining operation | movement at the time of an image structure information generation part receiving image structure information from an image structure information transmission part. It is a flowchart explaining the operation | movement of the 3rd Embodiment of this invention. It is a block diagram which shows one structural example of the 4th Embodiment of this invention. When the image configuration information generation unit receives the image configuration information from the image configuration information transmission unit, and the image configuration information transmission unit outputs information indicating the transmitted image configuration information and the receiving device of the transmission destination to the billing information generation unit. It is a sequence diagram explaining the operation | movement of. It is a block diagram which shows the example of 1 structure of the conventional message transmission system.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Transmission apparatus 12, 14, 16 Communication line 13 Reception apparatus 15 Server 21 Speech synthesis part 22 Image display part 23 Voice quality information generation part 24 Image structure information generation part 25 Image structure information transmission part 26 Billing information generation part 27 Speaker 31 Text message Storage unit 32 Transmission unit 33 Image configuration information storage unit 34 Expression information storage unit 35 Server image configuration information storage unit

Claims (40)

A transmission means for transmitting a text message;
Speech synthesis means for generating synthesized speech based on the received text message;
Image information generating means for generating information of an image to be displayed together with the output of the synthesized speech;
Image display means for displaying an image based on image information generated by the image information generation means;
Expression information storage means for preliminarily storing expression information including image configuration information which is information of an image to be displayed on the image display means and voice quality information which is information of characteristics of synthesized speech to be generated by the speech synthesis means. ,
The image information generation means generates image information based on the image configuration information,
The speech synthesizer generates synthesized speech based on the voice quality information, generates delimiter information which is information indicating a delimiter of the generated synthesized speech, and inputs it to the image display unit,
The message display system is characterized in that the image display means changes the image to be displayed at the timing of the synthesized speech separation based on the inputted separation information. A transmission device including transmission means;
The message transmission system according to claim 1, further comprising: a receiving device including voice synthesis means, image information generation means, image display means, and expression information storage means. A receiving device including speech synthesis means, image information generation means, and image display means;
A transmission device including transmission means, expression information storage means, and expression information transmission means for transmitting expression information stored in the expression information storage means to the reception device;
The receiving device includes voice quality information generating means for receiving the expression information and generating voice quality information,
The message transmission system according to claim 1, wherein the image information generation unit receives the expression information from the transmission device and generates image configuration information from the expression information. The message transmission system according to claim 3, wherein the transmitting device includes charging means for generating expression information charging information, which is fee information corresponding to the expression information transmitted to the receiving device. External image configuration information storage means for storing all or part of the image configuration information, and image configuration information transmission for transmitting all or part of the image configuration information stored in the external image configuration information storage means to the receiving device The message transmission system according to claim 3, further comprising an image configuration information providing device including means. The message transmission system according to claim 5, wherein the receiving device and the image configuration information providing device are connected by a dedicated line. The message transmission system according to claim 5, wherein the receiving device and the image configuration information providing device are connected by a public network. The expression information includes image index information that is information indicating the position of all or part of the image configuration information stored in the external image configuration information storage unit,
The image information generation unit requests the image configuration information transmission unit to transmit all or a part of the image configuration information stored in the external image configuration information storage unit based on the image index information. The message transmission system according to any one of items 7 to 9. The message transmission system according to claim 8, wherein the image configuration information transmitting unit transmits all or part of the image configuration information stored in the external image configuration information storage unit to the receiving device in response to a request from the image information generation unit. The message transmission according to any one of claims 5 to 9, wherein the image configuration information providing device includes charging means for generating image charging information which is fee information according to the image configuration information transmitted to the receiving device. system. Voice quality information including external voice quality information storage means for storing all or part of voice quality information, and voice quality information transmission means for transmitting all or part of the voice quality information stored in the external voice quality information storage means to a receiving device The message transmission system according to any one of claims 3 to 10, further comprising a providing device. The message transmission system according to claim 11, wherein the receiving device and the voice quality information providing device are connected by a dedicated line. The message transmission system according to claim 11, wherein the receiving device and the voice quality information providing device are connected by a public network. The expression information includes voice quality index information that is information indicating the position of all or part of the voice quality information stored in the external voice quality information storage means,
The voice synthesizing unit requests the voice quality information transmitting unit to transmit all or part of the voice quality information stored in the external voice quality information storage unit based on the voice quality index information. The message transmission system according to any one of the above. The message transmission system according to claim 14, wherein the voice quality information transmitting means transmits all or part of the voice quality information stored in the external voice quality information storage means to the receiving device in response to a request from the voice synthesis means. The message transmission system according to any one of claims 11 to 15, wherein the voice quality information providing device includes billing means for generating voice quality billing information which is information on a fee according to voice quality information transmitted to the receiving device. Receive a text message,
Generating synthesized speech based on voice quality information of expression information including image configuration information which is information of an image to be displayed and voice quality information which is information of characteristics of synthesized speech, and the received text message;
Generating delimiter information which is information indicating a delimiter of the synthesized speech;
Outputting the synthesized speech,
Generating information of an image to be displayed together with the output of the synthesized speech based on the image configuration information;
Displaying an image based on the image information;
A message transmission method characterized in that an image to be displayed is changed at the timing of synthesis speech separation based on the separation information. Generate image composition information from expression information,
The message transmission method according to claim 17, wherein voice quality information is generated from the expression information. Send pre-stored expression information,
The message transmission method according to claim 17, wherein when the expression information is received, image configuration information is generated from the received expression information, and voice quality information is generated from the received expression information. The message transmission method according to claim 19, wherein expression information billing information that is fee information according to the transmitted expression information is generated. The expression information includes image index information which is information indicating a position where all or part of the image configuration information is stored in the external image configuration information storage unit storing all or part of the image configuration information. ,
Based on the image index information, the external image configuration information storage means is requested to transmit all or part of the image configuration information,
The message transmission method according to claim 19 or 20, wherein all or part of the image configuration information is received from the external image configuration information storage unit. The message transmission method according to claim 21, wherein the external image configuration information storage means generates image billing information which is fee information according to the transmitted image configuration information. The expression information includes voice quality index information which is information indicating a position where all or part of the voice quality information is stored in the external voice quality information storage means storing all or part of the voice quality information,
Based on the voice quality index information, the external voice quality information storage means is requested to transmit all or part of the voice quality information,
The message transmission method according to any one of claims 19 to 22, wherein all or part of the voice quality information is received from the external voice quality information storage unit. 24. The message transmission method according to claim 23, wherein the external voice quality information storage means generates voice quality billing information which is information on a fee according to the transmitted voice quality information. In a receiving device that receives a text message from a sending device,
Speech synthesis means for generating synthesized speech based on voice quality information of expression information including image configuration information which is image information and voice quality information which is characteristic information of synthesized speech, and a text message received from the transmission device; And image information generating means for generating image information to be displayed together with the output of the synthesized speech based on the image configuration information, and image display means for displaying an image based on the image information generated by the image information generating means. Including
The speech synthesizer generates delimiter information that is information indicating a delimiter of the generated synthesized speech, and inputs the delimiter information to the image display unit.
The receiving apparatus according to claim 1, wherein the image display means changes an image to be displayed at the timing of the synthesized speech separation based on the inputted separation information. Including expression information storage means for storing expression information in advance,
The receiving device according to claim 25, wherein the image information generating means generates image configuration information from the expression information. Voice quality information generating means for receiving expression information and generating voice quality information from the expression information;
The receiving device according to claim 25, wherein the image information generating means receives the expression information and generates image configuration information from the expression information. The receiving device according to claim 26 or claim 27, wherein all or part of the image configuration information is received from an image configuration information providing device that stores all or part of the image configuration information. The expression information includes image index information that is information indicating the position of all or part of the image configuration information stored in the image configuration information providing device,
The image information generation means requests the image information providing device to transmit all or part of the image configuration information stored in the image information providing device based on the image index information, and from the image information providing device. The receiving device according to claim 28, wherein all or part of the image configuration information stored in the image information providing device is received. 30. The receiving device according to claim 28 or 29, connected to the image information providing device by a dedicated line. 30. The receiving apparatus according to claim 28 or 29, connected to the image information providing apparatus via a public network. The receiving device according to any one of claims 26 to 31, wherein the receiving device receives all or part of the voice quality information from a voice quality information providing device that stores all or part of the voice quality information. The expression information includes voice quality index information that is information indicating the position of all or part of the voice quality information stored in the voice quality information providing device,
Based on the voice quality index information, the voice synthesis means requests the voice quality information providing apparatus to transmit all or part of the voice quality information stored in the voice quality information providing apparatus, and from the voice quality information providing apparatus, The receiving device according to claim 32, wherein all or part of the voice quality information stored in the information providing device is received. The receiving device according to claim 32 or 33, wherein the receiving device is connected to the voice quality information providing device via a dedicated line. The receiving device according to claim 32 or 33, wherein the receiving device is connected to the voice quality information providing device via a public network. Transmission that transmits a text message to be transmitted to the receiving device, image configuration information that is information of an image to be displayed on the receiving device, and expression information that includes voice quality information that is characteristic of synthesized speech of the text message to be generated by the receiving device A transmission device comprising: means. On the computer,
A synthesized speech is generated based on voice quality information of expression information including image configuration information which is image information and voice quality information which is characteristic information of synthesized speech, and a received text message, and indicates a break of the synthesized speech Speech synthesis processing for generating delimiter information as information,
Image information generation processing for generating information on an image to be displayed together with the output of the synthesized voice of the text message based on the image configuration information;
A message transmission program for causing an image display means for displaying an image based on the separation information to perform an image display process for changing and displaying an image at a separation timing of the synthesized speech. On the computer,
Receiving expression information, and executing voice quality information generation processing for generating voice quality information from the expression information;
38. The message transmission program according to claim 37, wherein in the image information generation process, the expression information is received, and a process of generating image configuration information from the expression information is executed. On the computer,
In the image information generation process, an external image configuration information storage unit that stores all or part of the image configuration information, and an image that transmits all or part of the image configuration information stored in the external image configuration information storage unit From the image information providing apparatus including the configuration information transmitting means, based on the image index information that is included in the expression information and indicates the position of all or part of the image configuration information stored in the external image configuration information storage means. , Causing the image information providing apparatus to execute a process of requesting the image information providing apparatus to transmit all or part of the image configuration information stored in the image information providing apparatus, and sending all or part of the image configuration information from the image information providing apparatus. 39. The message transmission program according to claim 38, wherein the message transmission program is executed. On the computer,
External voice quality information storage means for storing all or part of voice quality information in voice synthesis processing, and voice quality information transmission means for transmitting all or part of the voice quality information stored in the external voice quality information storage means The voice quality information is provided based on voice quality index information that is included in the expression information and indicates the position of all or part of the voice quality information stored in the external voice quality information storage means from the voice quality information providing device that includes the voice quality information A process for requesting the voice quality information providing apparatus to transmit all or part of the voice quality information stored in the apparatus, and a process for receiving all or part of the voice quality information from the voice quality information providing apparatus The message transmission program according to claim 38 or 39.

Images