JP4173056B2 - Mobile communication terminal and program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a mobile communication terminal and a program.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, mobile communication terminals such as mobile phones, PHS (Personal Handy-phone System), and PDA (Personal Digital Assistant) that can send and receive electronic mail have been widely used.
[0003]
In a mobile communication terminal having such a mail function, in order to improve the communication effect between users who send and receive mail, a technique for sending and receiving mail via an electronic pet (for example, see Patent Document 1), a mail text When a melody data is added to a message and transmitted to the other party, a technique has been developed that allows the other party to reproduce the melody data when receiving mail and to easily identify the mail sender (see Patent Document 2, for example). .
[0004]
Using such a portable communication terminal, the user can communicate with the other party by sending and receiving mail. Conventionally, emotional expression has been performed by devising and creating e-mail texts using symbols, pictograms, etc., or sending melody data or image data attached to e-mail texts.
[0005]
[Patent Document 1]
JP 2001-276436 A
[Patent Publication 2]
JP 2003-8686 A
[0006]
[Problems to be solved by the invention]
However, there is a limit to the emotional expression using symbols and pictograms, and it is not enough to express the emotion that you want to convey to the other party. Even if melody data or image data is attached to the mail text, the mail text and image are displayed separately, and only the text is displayed in the specified font for the mail text. It gives an inorganic impression, and the communication effect is not very good.
[0007]
An object of the present invention is to provide a mobile communication terminal capable of creating an e-mail rich in emotional expression.
[0008]
[Means for Solving the Problems]
  The invention according to claim 1 is a portable communication terminal,
  An input means for inputting characters in the mail text;
  Display means for displaying the inputted mail text;
  Setting means for setting voice playback conditions when playing back the inputted mail text;
  E-mail text with the set audio playback conditionsFor voice with inflectionVoice conversion means for creating voice-converted voice data;
  The input mail text is set to the set voice playback condition.Display form of graph of voice inflection stateCreating message data that is graphicized, and creating mail data for transmission by attaching the voice data subjected to voice conversion to the message data;
  A communication means for transmitting the created mail data for transmission to a specified destination;
  It is characterized by providing.
[0009]
  The invention according to claim 2 is a portable communication terminal,
  Displayed graphs showing the state of inflection of speech due to audio playback conditionsMessage data in which mail text is graphicized and the mail textFor voice with inflectionReceive audio data that has been convertedbe able toCommunication means;
  Display means for displaying the received message data;
  Voice playback means for playing back the voice data in accordance with the display of the message data;
  It is characterized by providing.
[0010]
  The invention according to claim 3 is a portable communication terminal,
  An input means for inputting characters in the mail text;
  Display the entered email textdisplayMeans,
  Setting means for setting voice playback conditions when playing back the inputted mail text;
  Mail text according to the set audio playback conditionsFor voice with inflectionVoice conversion means for creating voice-converted voice data;
  The input mail text is set to the set voice playback condition.The display form of the state of voice inflectionA mail creating means for creating graphic message data, attaching the voice converted voice data to the message data and creating mail data for transmission;
  While sending the created e-mail data for transmission to a specified destination,Displayed graphs showing the state of inflection of speech due to audio playback conditionsMessage data in which mail text is graphicized andConcernedEmail textFor voice with inflectionCommunication means for receiving voice-converted voice data;
  SaidReceivedDisplay message dataAboveDisplay means;
  In accordance with the display of the message dataAboveAudio playback means for playing back audio data;
  It is provided with.
[0011]
  The invention according to claim 4 is the mobile communication terminal according to claim 1 or 3,
  The display means displays a preview of the contents of the email before sending the email, and displays the state of voice inflection due to the voice playback condition of the outgoing email in the form of a graph when the preview is displayed,
  The voice playback means plays back the voice with inflection in accordance with the display of the message data.It is characterized by that.
[0012]
  The invention according to claim 5 is the portable communication terminal according to claim 1, 3 or 4,
  The setting means uses the text or character string of the mail sentence as the audio playback condition., Sound pitch and / or audio tempoSet
  The sound converting means is configured to adjust the set sound level.And / or convert voice text into intonated voice at voice tempoIt is characterized by that.
[0013]
  The invention according to claim 6 is the5In the mobile communication terminal described in
  AboveEmail creation meansAboveMessage data isAboveWhen displayed on the display means, the setting meansA character or character string with a high sound is displayed at a high position, a character or character string with a low sound is displayed at a low position, and / orCharacter spacing between characters or strings with a fast tempoNarrow,Character spacing between characters or strings with a slow tempoIs displayed in a graph that displays the state of voice inflection.Graphical mail text to be displayedMessage data is created, and the mail data for transmission is created by attaching the voice data subjected to the voice conversion to the message data.It is characterized by that.
[0014]
  The invention according to claim 7 is the portable communication terminal according to any one of claims 1 to 3,
  The setting means sets a voice type as a voice playback condition,
  The voice conversion means converts the mail sentence into voice with the set voice type.It is characterized by that.
[0015]
  The invention according to claim 8 is the invention according to claimAny one of 1, 3-7In the mobile communication terminal described in
  Storage means for storing sound data of sound effects and graphic data corresponding to the sound effects;
The setting means sets a sound effect on a character or a character string of a mail sentence as a sound reproduction condition,
The voice conversion means creates voice data by adding sound effect sound data to the sound of the character or character string in which the sound effect is set after voice conversion of the mail sentence,
  The mail creating means displays the stored graphic so that when the message data is displayed on the display means, a graphic corresponding to the sound effect is displayed on the character or character string to which the sound effect is set. Graphicalize email text using dataIt is characterized by that.
[0016]
  The invention according to claim 9 is the first, third, or third aspect.8In the mobile communication terminal according to any one of
  The mail creation means has message dataAboveThe mail text is graphicized so that when displayed on the display means, the mail text is displayed in a character style according to the set voice reproduction condition.
[0017]
  The invention according to claim 10 is:
  ComputerThe
  Input for entering text in mail textmeans,
  Display the entered email textYouDisplaymeans,
  Set voice playback conditions for voice playback of the entered email textYouSettingmeans,
  E-mail text with the set audio playback conditionsFor voice with inflectionVoice conversion to create voice converted voice datameans,
  The input mail text is set to the set voice playback condition.Display form of graph of voice inflection stateCreate mail data that creates message data that has been graphicized and attaches the voice data that has been voice converted to the message data to create mail data for transmissionMeans,
  Send the created e-mail data for transmission to the specified destinationYouCommunicationmeans,
  Function asIt is a program for making it happen.
[0018]
  The invention according to claim 11
  ComputerThe
  Displayed graphs showing the state of inflection of speech due to audio playback conditionsMessage data in which mail text is graphicized and the mail textFor voice with inflectionReceive audio data that has been converted to audiocan docommunicationmeans,
  Display the received message dataYouDisplaymeans,
  Play back the audio data according to the message data displayYouAudio playbackmeans,
  Function asIt is a program for making it happen.
[0019]
  The invention according to claim 12
  ComputerThe
  Input for entering text in mail textmeans,
  Display means for displaying the inputted mail text;
  Set voice playback conditions for voice playback of the entered email textYouSettingmeans,
  Mail text according to the set audio playback conditionsFor voice with inflectionVoice conversion to create voice converted voice datameans,
  The input mail text is set to the set voice playback condition.The display form of the state of voice inflectionCreate mail data that creates graphic message data and attaches the voice data that has been converted to voice to the message data.means,
  While sending the created e-mail data for transmission to a specified destination,Displayed graphs showing the state of inflection of speech due to audio playback conditionsMessage data in which mail text is graphicized andConcernedEmail textFor voice with inflectionReceive audio data that has been converted to audioYouCommunicationmeans,
  SaidReceivedDisplay message dataYouRuAbovedisplaymeans,
  In accordance with the display of the message dataAbovePlay audio dataYouAudio playbackmeans,
  Function asIt is a program for making it happen.
[0020]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
In this embodiment, at the time of creating a mail, message data in which a mail sentence is graphicized in a form corresponding to the voice reproduction condition set by the user is created, and voice data obtained by converting the mail sentence into voice according to the voice reproduction condition is generated. An example of a portable communication terminal that creates and reproduces audio data in accordance with the display of graphic message data when displaying mail will be described.
[0021]
First, the configuration will be described.
FIG. 1 shows a system configuration of a communication system 100 configured to include mobile communication terminals 1a and 1b in the present embodiment. As shown in FIG. 1, the communication system 100 includes mobile communication terminals 1 a and 1 b, and the mobile communication terminals 1 a and 1 b are connected to each other via a communication network N so as to be able to transmit and receive data. Although FIG. 1 shows an example in which two portable communication terminals 1a and 1b are connected, the number of installed terminals is not particularly limited.
[0022]
The mobile communication terminals 1a and 1b perform radio communication via a radio base station (not shown), and transmit / receive conversation voice data to / from other mobile communication terminals. In addition, electronic mail (hereinafter simply referred to as mail) data is exchanged via a mail server (not shown). As the mobile communication terminals 1a and 1b, mobile phones, PHS, PDAs, and the like are applicable.
[0023]
Hereinafter, the configuration of the mobile communication terminals 1a and 1b will be described. Since the basic configuration is the same even if the appearance and application functions of the mobile communication terminals 1a and 1b are different, the configuration will be described using the mobile communication terminal 1a as a representative. I will do it.
FIG. 2 is an external view of the mobile communication terminal 1a.
As shown in FIG. 2, the mobile communication terminal 1a includes a display unit 2 and a key input unit 3, and the display unit 2 and the key input unit 3 are connected to each other by a coupling mechanism (not shown) provided at the center. It is configured to be foldable.
[0024]
The display unit 2 is provided with a receiving speaker 21 that outputs the voice of the communication partner and an LCD (Liquid Crystal Display) 22 that displays various operation screens.
[0025]
The key input unit 3 includes a numeric key group 31, a power / off hook key 32, an on hook key 33, an up key U, a down key D, a left key L, a right key R, soft keys S1 and S2, an enter key K, and a clear key C. Each key group is provided. The function of each key will be described later. Below each key group, a transmission microphone 35 for inputting the user's voice is provided.
[0026]
FIG. 3 shows the internal configuration of the mobile communication terminal 1a.
As shown in FIG. 3, the mobile communication terminal 1a includes a control unit 11, an input unit 12, a display unit 13, a RAM (Random Access Memory) 14, a ROM (Read Only Memory) 15, a communication unit 16, a receiving speaker 21, a transmission speaker. A talk microphone 35 and a sound reproduction speaker 17 are provided.
[0027]
The control unit 11 includes a CPU (Central Processing Unit) and the like, expands a system program stored in the ROM 15 to the RAM 14, and comprehensively controls the operation of each unit of the mobile communication terminal 1 in cooperation with the program. And realize the mobile phone function. Specifically, a reception voice signal input from the transmission microphone 18 during transmission is output to the communication unit 16, and a transmission partner's transmission voice signal input from the communication unit 16 is output to the reception speaker 17 during reception. .
[0028]
At the time of mail transmission, a mail combining voice and graphics (hereinafter, such mail is referred to as a music mail) is created in cooperation with a mail creation processing program (see FIG. 4) stored in the ROM 15. . Specifically, voice data is converted into voice data according to voice playback conditions set by the user to create voice data, and message data in which the mail text is graphicized in a mode according to the voice playback conditions is created. . The mail text graphic means that the graphic is prepared by using a graphic prepared in advance or changing the style and layout of the mail text.
[0029]
When the created music mail is previewed or received, the graphic message data is displayed on the display unit 13 and the sound data is output and reproduced by the sound reproduction speaker 17 in accordance with the display of the message data.
[0030]
The input unit 12 includes the keypad group 31, the power / off hook key 32, the on hook key 33, the up key U, the down key D, the left key L, the right key R, the soft keys S1 and S2, the enter key K and the clear shown in FIG. The key C is configured to output an operation signal corresponding to the input operation of each key to the control unit 11. That is, the input means and the setting means can be realized by inputting characters in the mail text using these keys or by inputting the voice reproduction conditions of the mail text.
[0031]
The ten key group 31 is a key for inputting a telephone number and a character string (Hiragana, Katakana, English characters, symbol characters, etc.), and the power / off hook key 32 is used to turn on / off the power of the mobile communication terminal 1a. An end instruction is input, and the on-hook key 33 is a key for inputting a call start instruction.
[0032]
The up key U, the down key D, the left key L, and the right key R are cursor keys for instructing movement of an input position on various operation screens, and the soft keys S1 and S2 are predetermined on each operation screen. A key to which a soft function is assigned. The determination key K is a key for inputting a determination instruction, and the clear key C is a key for inputting a cancellation of the input instruction.
[0033]
The display unit 13 is a display unit configured by the LCD 22 illustrated in FIG. 2, and various display information such as a mail creation screen, a preview screen of the created mail, a received mail screen, and a processing result by the control unit 11. Is displayed.
[0034]
The RAM 14 forms a work area for temporarily storing various programs executed by the control unit 11 and data related to these programs.
[0035]
In addition to the system program, the ROM 15 stores a mail creation processing program, data processed by each program, and the like. The ROM 15 has a memory area for storing dictionary data for converting input characters (Hiragana) into kanji, katakana, pictograms, etc., a memory area for storing voice data for voice conversion corresponding to character information, and creation of music mail And a memory area for storing pattern data of various graphics (including still images and moving images) prepared for use, and a memory area for storing transmitted / received mail data (message data and audio data). The voice data for voice conversion is prepared as voice data corresponding to the type of voice (hereinafter referred to as voice type) such as a boy's voice and a girl's voice.
[0036]
The communication unit 16 includes an antenna 16a that transmits and receives wireless communication signals to and from a wireless base station, and a communication interface such as an RF circuit and a modem (not shown). At the time of receiving, the received voice or mail wireless communication signal received via the antenna 16a is demodulated by an RF circuit and a modem and output to the control unit 11. On the other hand, during transmission, transmission voice data and message data input from the control unit 11 are modulated by an RF circuit and a modem, and transmitted to the radio base station via the antenna 11.
[0037]
The reception speaker 21 converts the reception voice signal input from the control unit 11 into a reception voice and outputs it.
[0038]
The transmission microphone 35 converts the user's transmission voice into a transmission voice signal and outputs it to the control unit 11.
[0039]
The sound reproduction speaker 17 is a speaker configured separately from the reception speaker 17 and is for outputting a sound obtained by converting a ring tone or a mail text (hereinafter referred to as a mail sound). That is, the sound reproducing means can be realized by the sound reproducing speaker 17.
[0040]
Next, the operation in the present embodiment will be described.
In the present embodiment, the mobile communication terminal 1a creates a music mail and transmits it to the mobile communication terminal 1b. The mobile communication terminal 1b displays the music mail received from the mobile communication terminal 1a and reproduces the mail voice. An example will be described.
[0041]
First, the mail creation processing executed by the mobile communication terminal 1a will be described with reference to the flowchart shown in FIG. 4 and the screen transition diagram of the mail creation screen shown in FIG. As a premise for explanation, the music mail mode is selected between the normal mode for creating and sending only the text data of the mail and the music mail mode for creating the music mail, and the mail creation process described below is started. I will do it.
[0042]
In the mail creation process shown in FIG. 4, first, a mail creation screen (not shown) for inputting text of a mail text is displayed on the display unit 13 (step S1). When the user inputs characters in the mail text via the input unit 12 (step S2), a conversion point indicating the timing of switching the voice voice level and tempo is set for each input character. Is displayed on the display unit 13 as shown in FIG. 5A (step S3).
[0043]
As shown in FIG. 5A, on the mail creation screen 131, the input mail sentence a1 is displayed, and a point line a2 is displayed above the mail sentence a1. The point line a2 is obtained by connecting the conversion points displayed at the positions corresponding to the respective characters of the mail text by lines.
[0044]
For example, if an e-mail message is entered as “Natsuda!”, Conversion points are set for the four characters “summer”, “da”, “ne”, and “!”. Points are connected with a line and displayed at the top of the email text. In the initial setting, conversion points are automatically set for each character as described above. However, according to the user's instruction, a plurality of conversion points can be combined into one conversion point, or conversion points can be added or deleted. It is assumed that the setting can be changed as appropriate. For example, the four conversion points set for each character such as “summer”, “da”, “ne”, “!” Are combined into one conversion point, and one for the character string “summer dae!” Two conversion points may be set.
[0045]
The line shape of the point line a2 shown in FIG. 5A indicates the pitch and tempo of the initial set value. In the mail creation screen 131, the voice playback condition is not yet set, so the line shape is a straight line. However, the conversion point display position is changed up, down, left, and right depending on the voice playback condition set later. The inflection at the time of reproducing the voice of the mail text is expressed by the degree of refraction and expansion of the line a2.
[0046]
When a voice conversion point is set for the input mail text, a mail creation screen 132 as shown in FIG. 5B is displayed on the display unit 13, and the voice type for voice playback of the mail text is set. Performed (step S4). As shown in FIG. 5B, on the mail creation screen 132, a voice type menu bar a3 is displayed at the left end of the screen. In the voice type menu bar a3, for example, settable voice types such as a boy's voice and a girl's voice are displayed as icons. The user operates the input unit 12 to select a desired voice type icon from the icons displayed on the voice type menu bar a3. When the voice type is selected by the user, the selected voice type is set as the voice type when the voice of the mail sentence is reproduced.
[0047]
When the voice type is set in accordance with the user's instruction, as shown in FIG. 5C, a mail creation screen 133 displaying the voice type icon a4 set at the upper left end of the screen is displayed on the display unit 13. Is done. In addition, on the mail creation screen 133, a selection frame a5 for selecting a conversion point is displayed, and the user can select an arbitrary conversion point by moving the selection frame a5.
[0048]
Hereinafter, a process for setting the voice playback condition of the mail text at the conversion point will be described. On the mail creation screen for setting the voice playback condition at the conversion point, the up key U among the operation keys is set to be high. Function, a function for setting the sound low for the down key D, a function for setting the tempo slow for the left key L, a function for setting the tempo fast for the right key R, and a sound effect selection menu for the soft key S2. It is assumed that a function is assigned. The pitch and tempo of the sound are set according to the number of times each key is pressed, for example, when the up key U is pressed three times, the sound is set three steps higher from the initial setting value.
[0049]
Next, on the mail creation screen 133, it is determined whether or not a conversion point has been selected (step S5). When the conversion point is not selected (step S5; N), the process proceeds to step S12 described later, and when the conversion point is selected (step S5; Y), the user presses the up key U or the down key D. It is determined whether or not it has been performed (step S6).
[0050]
When the up key U or the down key D is pressed (step S6; Y), the pitch of the sound at the selected conversion point is set higher or lower than the initial setting value. When the pitch of the sound is changed from the initial setting value, the reference line a6 indicating the pitch of the initial setting is displayed on the back of the point line a2 on the mail creation screen 133, and the sound is set to be high. When the position of the conversion point is set above the reference line a6 and the sound is set low, the conversion point is displayed below the reference line a6 (step S9).
[0051]
On the other hand, when the up key U or the down key D is not pressed (step S6; N), it is determined whether the left key L or the right key R is pressed (step S8). When the left key L or the right key R is pressed (step S8), the audio tempo at the selected conversion point is set faster or slower than the initial setting value. When the tempo is set slower, the interval between the selected conversion point and the next next conversion point is displayed wide on the mail creation screen 131, and when the tempo is set faster, the distance between the next conversion point adjacent to the next conversion point is displayed. The interval is displayed narrowly (step S9).
[0052]
Further, when the left key L or the right key R is not pressed with the conversion point selected (step S8; N), it is determined whether or not the soft key S2 is pressed (step S10). When the soft key S2 is pressed (step S10; Y), the mail creation screen 133 can be used to select sound effects prepared in advance, such as echoing voice, splashing water, buzzer sound, etc. Is displayed. When the user selects a desired sound effect from the sound effects displayed on the selection menu and presses the enter key K, the selected sound effect is set as a conversion point (step S11). It should be noted that at the time of setting the sound effect, it is assumed that each selected sound effect is output from the sound reproduction speaker 17 so that the sound effect can be viewed. When the sound effect is set, as shown in FIG. 5D, a sound effect mark a7 indicating that the sound effect is set at the conversion point where the sound effect is set is displayed on the mail creation screen 134. .
[0053]
On the other hand, if the soft key S2 is not pressed (step S10; N), it is determined whether or not an instruction to end the setting of the audio reproduction condition is given (step S12). When the setting end is not instructed (step S12; N), the process returns to the process of step S5, and the setting of the audio reproduction condition is continued. When the setting end is instructed (step S12; Y), the audio reproduction condition Is temporarily finished, and mail voice data and message data are created under the voice reproduction conditions set so far (step S13).
[0054]
When creating the mail voice data, first, the dictionary data is referred to from the ROM 15, and the reading of the mail text is recognized by the control unit 11 based on the dictionary data. For example, a reading of “Natsuda!” Is recognized for an email sentence “Natsuda!”. Next, voice conversion of the mail text is performed according to the reading of the mail text, and voice data is generated. Specifically, the voice conversion voice data corresponding to the set voice type is read from the ROM 15 and the mail text is read using the voice data so as to match the set pitch and tempo. The mail voice data corresponding to is created.
[0055]
Also, when creating message data, the style and layout such as the character size and font of the mail text are changed according to the voice reproduction conditions. For example, the character or character string of a conversion point that is set to high sound is bolded and the layout is changed so that it is placed at the top of the screen when displayed, and conversely the sound is set low. The character or character string at the conversion point is changed in layout so that the character size is a fine character and is arranged at the bottom of the screen. In addition, a graphic corresponding to the sound effect is added to the character or character string at the conversion point where the sound effect is set. For example, if an echo sound effect is set, a moving image that changes its size like a wave, a so-called motion graphic, is added as the shadow of the character string becomes smaller or larger. The
[0056]
When message data and audio data are created in this way, a preview is executed (step S14). At the time of preview, a mail screen 135 as shown in FIG. 6 is displayed on the display unit 13. As shown in FIG. 6, on the mail screen 135, a character or character string of a mail sentence is arranged on the point line a2. In other words, characters or character strings are arranged at positions corresponding to the pitch and tempo of the sound set at the conversion point, and the character size and font are also displayed in the size and font corresponding to the set pitch and tempo. . Therefore, the inflection and emphasis levels of the mail text and the mail voice appear to be synchronized. Furthermore, in a character or character string for which a sound effect is set, a motion graphic corresponding to the sound effect is displayed.
[0057]
  In this mail screen 135, the message data shown in FIG. 6 is automatically scrolled from left to right according to the display axis, and the sound effect is set.OrThe motion graphic in the character string is displayed as the graphic changes over time (for example, the graphic of the flag pattern displayed on the back of the character string “Summer!” The size of the character shadow displayed on the back of the character changes.) In addition, the mail voice data of the mail text displayed in the display area is voice-reproduced through the sound reproduction speaker 17 in accordance with the movement of the scroll-displayed mail screen 135.
[0058]
After the preview, a confirmation message such as “Do you want to send with this content?” Is displayed. The user confirms the display contents and mail voice of the created music mail on the mail screen 135 that has been previewed, and presses the enter key K if satisfied with the mail creation contents, and the clear key C if the contents are not satisfactory. Press.
[0059]
The portable communication terminal 1 waits for the determination key K or the clear key C to be pressed, and it is determined whether or not the contents of the previewed music mail creation have been approved by the user (step S15). When the clear key C is pressed and the content of creation of the music mail is not approved by the user (step S15; N), the process returns to step S4 and the audio playback condition is set again.
[0060]
On the other hand, when the determination key K is pressed and the creation content of the music mail is approved by the user (step S15; Y), the mail voice data is attached to the created message data, and the mail data for transmission is created. . The created mail data for transmission is transmitted to the specified destination via the communication unit 16 (step S16), and this process is terminated.
[0061]
In the mobile communication terminal 1b, when a music mail is transmitted from the mobile communication terminal 1a, processing similar to the preview processing in step S14 described above is performed. In other words, a mail screen as shown in FIG. 6 is displayed on the display unit, a graphic mail text is displayed, and mail voice data is output from the sound playback speaker in accordance with the display of the mail text. Is done. When a reply mail is created for the received music mail, the above-described mail creating process is also activated in the mobile communication terminal 1b, and a music mail can be created.
[0062]
As described above, according to the present embodiment, when a music text voice playback condition is set at the time of music mail transmission, the mail text is converted into voice according to the set voice playback condition, and the mail voice data is converted. Is created, and message data in which the mail text is graphically created in a manner according to the audio playback conditions is created and sent to the specified destination. Can be sent to.
[0063]
In addition, in the mobile communication terminal that has received the music mail, graphic message data is displayed and the voice data of the mail is played back in accordance with the display, so the mail can be transmitted visually and audibly. It becomes easy to grasp the emotion of the former user.
[0064]
Therefore, it is possible to improve communication between the two who exchange music mail.
[0065]
In addition, since the voice type, pitch, tempo, and sound effects can be set as voice playback conditions, the voice data that matches the content of the mail text and the presence of the voice are full depending on the emotion at the time of mail creation. Email voice data can be created, and by arbitrarily changing the voice type, pitch, tempo, and sound effect, unique inflection email voice data or email voice data with a strange sound combined can be created You can also
[0066]
In addition, depending on the audio playback conditions that have been set, the message text or character string style and layout are changed, or message data with motion graphics added is created. It is possible to express the emotion that the user wants to convey to the communication partner visually by creating message data intentionally with emphasis on the visuality when the mail is displayed, such as setting it to high and displaying it in bold It is also possible to create message data with a unique design that is not intended by the user by setting voice playback conditions so that the voice voice is emphasized and approaching realistic voice.
[0067]
As described above, since the user can arbitrarily set the audio reproduction condition, the user's willingness to create mail can be improved.
[0068]
Further, when creating a music mail, a music mail can be created while confirming the display contents and mail voice of the created music mail by preview, and the operability of mail creation is further improved.
[0069]
In addition, the description content in this Embodiment is a suitable example of the mobile communication terminals 1a and 1b to which this invention is applied, and is not limited to this.
For example, the present invention is not limited to the above-described sound reproduction conditions such as sound level, tempo, and sound effect, and other sound reproduction conditions such as setting a scale at a conversion point may be applied.
[0070]
In addition, not only motion graphics but also static graphics can be applied to graphics of email text according to audio playback conditions, and various methods such as changing the display color of characters in the email text, blinking, etc. Of course, it is possible to make it graphic.
0000
In addition, the detailed configuration and detailed operation of the mobile communication terminals 1a and 1b in the present embodiment can be changed as appropriate without departing from the spirit of the present invention.
0000
【The invention's effect】
According to the present invention, it is possible to create a mail that is rich in emotional expression visually and audibly with an easy operation.
[Brief description of the drawings]
FIG. 1 is a diagram showing a system configuration of a communication system 100 to which mobile communication terminals 1a and 1b are connected in an embodiment to which the present invention is applied.
FIG. 2 is a diagram showing an external appearance of a mobile communication terminal 1a.
FIG. 3 is a diagram showing an internal configuration of the mobile communication terminal 1a.
FIG. 4 is a flowchart for explaining mail creation processing executed by the mobile communication terminal 1a.
FIG. 5 is a screen transition diagram of a mail screen displayed on the display unit 13 in mail creation processing.
FIG. 6 is a mail screen displayed when previewing a created mail.
[Explanation of symbols]
1 Mobile communication terminal
2 Display section
21 Telephone speaker
3 Key input part
31 Numeric keys
U Up key
D Down key
L Left key
R light key
K OK key
C Clear key
35 Transmitting microphone
11 Control unit
12 Input section
13 Display section
14 RAM
15 ROM
16 Communication Department
17 sound reproduction speaker

Claims (12)

An input means for inputting characters in the mail text;
Display means for displaying the inputted mail text;
Setting means for setting voice playback conditions when playing back the inputted mail text;
Voice conversion means for creating voice data obtained by voice-converting a mail sentence into voice with inflection under the set voice playback conditions;
Create a message data graphic of the input mail text display form graph of the state of the voice inflection due to the set sound reproduction condition, attached audio data said the speech converted to the message data Email creation means to create email data for transmission,
A communication means for transmitting the created mail data for transmission to a specified destination;
A mobile communication terminal comprising: A communication means capable of receiving message data in which a mail sentence is graphicized in a display form in which a state of voice inflection according to a voice reproduction condition is graphed, and voice data in which the mail sentence is voice-converted into voice with inflection ; ,
Display means for displaying the received message data;
Voice playback means for playing back the voice data in accordance with the display of the message data;
A mobile communication terminal comprising: An input means for inputting characters in the mail text;
Display means for displaying the inputted mail text ;
Setting means for setting voice playback conditions when playing back the inputted mail text;
Voice conversion means for creating voice data obtained by voice-converting a mail sentence into voice with inflection according to the set voice playback condition;
Create a message data graphic of the input mail text display form graph of the state of the voice inflection due to the set sound reproduction condition, attached audio data said the speech converted to the message data Email creation means to create email data for transmission,
Transmits to the destinations specified for transmission mail data created in the above, the message data and the mail sentence intonation mail statement was graphically into display mode graph of the state of the speech intonation voice reproducing condition Communication means for receiving voice data that has been voice-converted into a certain voice ;
Said display means for displaying the received message data,
And audio reproduction means for reproducing the audio data in accordance with the display of said message data,
A mobile communication terminal comprising: The display means displays a preview of the contents of the email before sending the email, and displays the state of voice inflection due to the voice playback condition of the outgoing email in the form of a graph when the preview is displayed,
The mobile communication terminal according to claim 1 or 3, wherein the voice reproduction means reproduces the voice with the inflection in accordance with the display of the message data . The setting means sets the pitch of the sound and / or the tempo of the voice in the text or character string of the mail sentence as the voice playback condition,
5. The mobile communication terminal according to claim 1, wherein the voice conversion unit converts the mail text into a voice having an inflection at the set pitch and / or voice tempo . 6. The mail creation means, when the message data is displayed on the display means, a character or string that high sound is set by the setting means to a higher position, a character or character string is set low sound is Display the voice inflection status by displaying it at a low position and / or narrowing the character spacing of a character or character string with a fast tempo and widening the character spacing of a character or character string with a slow tempo. Creating message data in which a mail text is graphicized so as to be displayed in a graphed display form, and creating mail data for transmission by attaching the voice data converted into voice to the message data The mobile communication terminal according to claim 5 . The setting means sets a voice type as a voice playback condition,
The mobile communication terminal according to any one of claims 1 and 3 to 6, wherein the voice conversion unit performs voice conversion of a mail sentence with the set voice type. Storage means for storing sound data of sound effects and graphic data corresponding to the sound effects;
The setting means sets a sound effect on a character or a character string of a mail sentence as a sound reproduction condition,
The voice conversion means creates voice data in which sound data of sound effects is added to the sound of the character or character string in which the sound effects are set after voice conversion of the mail sentence,
The mail creation means, when the message data is displayed on the display unit, graphic the sound effects corresponding to the sound effect to the set character or character string to be displayed, said stored graphic the portable communication terminal according to any one of claims 1,3～ 7, characterized in that the graphics of the mail text using the data. The mail creation means, when the message data is displayed on the display means, and characterized in that the graphics of the mail text to mail text is displayed in a character style corresponding to the set sound reproduction condition the portable communication terminal according to any one of claims 1,3～ 8. The computer,
Input means for inputting text in email texts ,
Display means that displays the input mail statement,
Setting means to set the sound reproduction condition for audio playback the input mail text,
Voice conversion means for creating voice data obtained by voice-converting a mail text into voice with inflection under the set voice playback conditions ;
Create a message data graphic of the input mail text display form graph of the state of the voice inflection due to the set sound reproduction condition, attached audio data said the speech converted to the message data Email creation means to create email data for transmission ,
A communication means for transmitting the created mail data for transmission to a specified destination ;
Program to function as. The computer,
A communication means capable of receiving message data in which a mail sentence is graphicized in a display form in which a state of voice inflection according to a voice reproduction condition is graphed, and voice data in which the mail sentence is voice-converted into voice with inflection ;
Display means that displays the received message data,
Audio reproducing means you play the audio data in accordance with the display of said message data,
Program to function as. The computer,
Input means for inputting text in email texts ,
Display means for displaying the inputted mail text;
Setting means to set the sound reproduction condition for audio playback the input mail text,
Voice conversion means for creating voice data obtained by voice-converting a mail sentence into voice with inflection according to the set voice playback condition ;
Create a message data graphic of the input mail text display form graph of the state of the voice inflection due to the set sound reproduction condition, attached audio data said the speech converted to the message data Email creation means to create email data for transmission ,
Transmits to the destinations specified for transmission mail data created in the above, the message data and the mail sentence intonation mail statement was graphically into display mode graph of the state of the speech intonation voice reproducing condition communication means that will receive the audio data speech converted to speech with,
The display means that displays the received message data,
Audio reproducing means you play the audio data in accordance with the display of said message data,
Program to function as.

Images