JP2007259427A - Mobile terminal unit - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mobile terminal unit for outputting the effect predetermined by a user during a call. <P>SOLUTION: The effect corresponding to each parameter, key word, variation of voice power, and pitch fluctuation or the like, is defined at an effect pattern management part, and saved in an effect pattern data base. The mobile terminal unit analyzes the speech data by an analysis means using voice recognition or emotion estimation, and detects the particular key word, the voice power variation, the pitch fluctuation or the like. When the detected particular key word or the like is collated with the effect pattern and coincided, the previously set effect is given, made into voice by a data voice part, and outputted to a speaker, and the sounding of the voice data with the effect is performed. <P>COPYRIGHT: (C)2008,JPO&amp;INPIT

Description

  The present invention relates to a portable terminal device having a function of adding and outputting an effect desired by a user during a call, in particular, an effect such as a sound effect, background sound or effect image desired by the user during a call. A mobile terminal device that has a function of adding to and / or outputting to at least one of audio and / or image to be output to the terminal, and the effect of the sound effect, background sound, or effect image desired by the user during the call. The present invention relates to a portable terminal device having a function of adding to and transmitting at least either sound or image to be transmitted to the mobile phone.

  Mobile phones, which are portable terminal devices, have become widespread and are already indispensable for people's lives. And the performance improvement and multifunctionalization of portable terminal devices are steadily progressing. In particular, the functions that allow users to set ringtones arbitrarily, such as ringtone melodies, have gained a lot of support, and in recent years, mobile terminal devices equipped with high-performance sound source chips for the output of ringtones have been put into practical use. Has been. Not only that, but also a portable terminal device that has a sound effect or background sound output function using key buttons during a call in order to demonstrate any sound effect function to further enhance the entertainment of the call. (For example, refer to Patent Document 1).

FIG. 13 shows a conventional portable terminal device. 13 shows a key button unit 180 having a plurality of key buttons, a storage unit 110 storing a plurality of key button information and sound effects or background sounds to be transmitted to the other terminal during a call, and the key buttons. Key tone output unit 142 that outputs a sound effect or background sound corresponding to the sound signal, a transmission side signal processing unit 160 that performs signal processing, and a sound effect or background sound according to a key button selection signal input from the key button unit 180 Is read from the storage unit 110 and output to the key tone output unit 142, and further includes a main controller 170 for transferring the sound effect or background sound output through the transmission side signal processing unit 160 through a predetermined channel. ing. In the conventional portable terminal device, when any key button of the key button unit 180 is pressed during a call, a sound effect or background sound corresponding to the key button is added to the call voice, and the wireless communication unit 130 causes the server 300 to Can be sent to the other terminal via.
Japanese Patent Laying-Open No. 2004-312662 (first page, FIG. 1)

  However, in the conventional portable terminal device described above, it is troublesome to operate a key button for generating a sound effect. Since the operation unit cannot be seen during a call, it is difficult to select an appropriate key button in a timely manner and to provide a desired sound effect. There is a problem in that the operation may be wrong and a sound effect that is not suitable for the occasion may be given. An object of the present invention is to provide a portable terminal device that automatically adds an effect desired by a user during a call without performing a key button operation and outputs the result to the own terminal or to the other terminal. It is an object.

  In order to solve the above problems, in the present invention, the analysis means for analyzing the call data, the effect pattern database for accumulating the effect pattern and the effect associated with the effect pattern to be compared with the analyzed result, and the output of the effect pattern An effect pattern management means for managing, an analysis collating means for collating the analyzed result with the effect pattern, and a synthesis means for adding an effect to at least one of sound and image, and the analysis result analyzed by the analyzing means; The effect pattern whose output is managed by the effect pattern management means is collated by the analysis and collation means, and the effect associated with the matched effect pattern is added to at least one of sound and image and output to the own terminal, or the partner terminal The mobile terminal device is configured to transmit to.

  With this configuration, the user's favorite effects can be pre-assigned to the effect pattern database, and a specific parameter is detected from the call voice during a call, and an effect corresponding to the detected parameter pattern is added to the effect pattern database. By outputting to the terminal or sending to the other terminal, it is possible to let the person or the other party hear the effect.

  The present invention further includes storage means for storing the identification information for identifying the effect associated with the adapted effect pattern or the effect associated with the adapted effect pattern, and the analyzing means is silent for a certain time from the call data. When a section is detected, the image processing apparatus includes a synthesis unit that adds the effect stored in the storage unit or the effect indicated by the identification information to at least one of the sound and the image.

  With this configuration, it is possible to effectively use the silent section, prevent the effect from being frequently added to the voice or image during the conversation, and output the effect without disturbing the user's concentration on the conversation Is possible.

  Further, it is possible to output a visual effect by further providing image synthesizing means for synthesizing the effect image with the image displayed on the display means of the portable terminal device during a call.

  Further, according to the present invention, the analysis means is an analysis means having a voice recognition means, so that a specific keyword is detected from the call voice and an effect corresponding to the detected keyword can be output.

  Furthermore, according to the present invention, the analysis means is an analysis means having an emotion estimation means, so that voice power fluctuations, pitch fluctuations, and the like are extracted, an emotion pattern is detected, and an effect corresponding to the detected emotion pattern is output. You can also.

(Embodiment 1)
DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, a first embodiment of the invention will be described with reference to the drawings. The mobile terminal device 100 according to the present embodiment is configured such that in addition to the communication functions of a mobile phone terminal, a PHS terminal, etc., a sound effect can be added during a call and output to the terminal itself. Examples of sound effects include various BGM (Back Ground Music), environmental sounds of stations, roads and parks, voices of people such as shouts and hands, applause and cheers, animal calls, celebrity voices and users Examples thereof include pre-recorded voices, electronic sounds that are sounds other than voices, mechanical sounds, and others. In addition to this, there can be repeated sounds, modulated sounds such as tempo and tone.

  FIG. 1 is a block diagram showing a configuration of a mobile terminal device 100 according to the present invention. The mobile terminal device 100 includes a wireless unit 4 that receives voice data from the counterpart terminal, a voice analysis unit 8 as an analysis unit that analyzes a pattern of the received voice data, and an effect pattern and an effect associated with the effect pattern in advance. The stored effect pattern database 10, the effect pattern management unit 9 that manages the output of the effect pattern, the analysis collation unit 7 that collates the analysis result with the effect pattern, and the data that utters the effect corresponding to the effect pattern From the voice generating unit 6, the voice synthesizing unit 5 that synthesizes the voice of the call received from the partner terminal and the data obtained by converting the effect corresponding to the effect pattern into voice, the control unit 1 that sends the synthesized voice data to the speaker, and the user The operation unit 2 for receiving the operation of the above, the speaker 3 for sounding the sound data, and the like.

  Here, “calling” means a state in which the mobile terminal device 100 used by the user and the mobile terminal device of the other party (hereinafter referred to as a counterpart terminal) are connected to each other via a telecommunication line. The sound effect means all sounds other than a sound signal input in real time via a microphone during a call. Therefore, it may be a recording of a real voice. The portable terminal device 100 is a concept that includes all devices capable of communicating via an electric communication line so as to enable conversation between a plurality of people.

  In the mobile terminal device 100, an effect corresponding to each parameter pattern such as a voice-recognized keyword, voice power fluctuation or pitch fluctuation is defined in advance, and the defined correspondence relationship is stored in the effect pattern database 10. FIG. 2 shows an example of the data configuration stored in the storage area of the effect pattern database 10. As shown in FIG. 2, in the storage area of the effect pattern database 10, a plurality of sets of effect patterns 90 and effects 91 associated with the effect patterns 90 are stored as a set of data. The output of the effect pattern 90 and the effect 91 in the effect pattern database 10 is managed by the effect pattern management unit 9, and is output to the analysis collation unit 7 according to the operation of the mobile terminal device 100. That is, the effect pattern 90 is sequentially output to the analysis collation unit 7 when the analysis result and the effect pattern are collated. As for the effect 91, when the analysis result and the effect pattern are matched, the effect associated with the matched effect pattern is specified and output to the analysis collation unit 7.

  In addition, many effect patterns are preserve | saved in the effect pattern database 10, and it is also considered that one defined effect pattern is a plurality of combinations. The effect pattern is stored in the effect pattern database 10 by, for example, downloading via an electric communication line or recording in advance via a microphone (not shown).

  FIG. 3 shows a flowchart for explaining the operation of the mobile terminal device 100 of the present invention when analyzing the voice of a call and adding an effect. In FIG. 3, when the mobile terminal device 100 starts a voice call with a partner terminal that is a voice call originator (step 201), it receives voice data of the partner's voice and surrounding sounds (step 202). Then, the voice analysis unit 8 analyzes various parameters included in the voice data (step 203). When the analysis result is obtained, the effect pattern management unit 9 sequentially outputs the effect pattern 90, and the analysis collation unit 7 collates the pattern of the parameter as the analysis result with the effect pattern (step 204). When the analysis collation unit 7 collates with the effect pattern and matches, the effect 91 of the matched effect pattern is specified as an effect to be output (step 206). The effect pattern management unit 9 outputs the identified effect 91 to the data voice converting unit 6 via the analysis matching unit 7, and the data voice generating unit 6 voices the effect 91 (step 207). Thereafter, the voice synthesizer 5 synthesizes the voice data received from the counterpart terminal and the data obtained by converting the effect 91 into voice (step 208). Then, the control unit 1 sends out the sound data to the speaker 3 and sounds the sound data to which the effect is added (step 209). If the effect pattern in the effect pattern database does not coincide with the parameter pattern of the audio data in step 204, the normal audio data is generated without any special processing (step 205) without any special processing (step 209).

(Embodiment 2)
Next, the portable terminal device concerning the 2nd Embodiment of this invention is demonstrated. The mobile terminal device 200 according to the second embodiment of the present invention adds a speech recognition unit 82 to the speech analysis unit 8 of FIG. Are configured as analysis means having voice recognition means. FIG. 4 shows a block diagram of a portable terminal device 200 according to the second embodiment of the present invention.

  Hereinafter, the operation of the portable terminal device according to the second embodiment of the present invention using the analysis unit having the voice recognition unit will be described. FIG. 5 is a flowchart in the case where an analysis operation by the speech recognition means is added at the time of speech data analysis with respect to steps 203 and 204 in the flowchart of FIG. 3 already described. Hereinafter, with reference to the drawings, the analysis operation by the voice recognition means at the time of call voice analysis in the present embodiment will be described.

  In FIG. 5, a parameter pattern such as a keyword is extracted from the voice data received from the counterpart terminal by the voice analysis unit 81 having the voice recognition unit 82 (step 303). For example, for the keyword “he”, when the effect “hehehehehehe” is stored in advance in the effect pattern database 10 in correspondence with the keyword “hehe” (step 204), the voice analysis having the voice recognition unit 82 is performed. When the keyword “heo” is detected by the unit 81, “analysis is present” is made by the analysis collation unit 7 and the effect “hehehehehehe” corresponding to the keyword “hee” is specified (step 206). Similarly, in the effect pattern database 10 for which the effect pattern management unit 9 manages the output, if the effect “Ah Ah…” is stored corresponding to the keyword “Ah”, the keyword “Ah” is stored in the audio data. ”And the analysis matching unit 7 can collate with the effect pattern database 10, the effect corresponding to the keyword“ A ”is specified (Step 206), and the effect“ Ah ”… corresponding to the effect pattern is voiced. (Step 207). After that, the data in which the effect “Ah! ...” is voiced is synthesized (step 208). Then, the sound data is sounded (step 209). If the effect pattern 90 in the effect pattern database 10 does not match the keyword of the voice data in step 204, normal voice data is emitted as it is without any special processing (step 205) (step 209).

(Embodiment 3)
Next, the portable terminal device concerning the 3rd Embodiment of this invention is demonstrated. The portable terminal device according to the third embodiment of the present invention is obtained by replacing the voice recognition unit 82 of FIG. 4 already described in the second embodiment with an emotion estimation unit, and the voice analysis unit is an emotion estimation unit. It is constituted as an analysis means having Since the other configurations are the same as those in FIG. 4, the block diagram is omitted.

Hereinafter, the operation of the portable terminal device according to the third embodiment of the present invention using the analysis unit having the emotion estimation unit will be described. FIG. 6 is a flowchart in the case where an analysis operation by the emotion estimation means is added at the time of voice data analysis with respect to steps 203 and 204 in the flowchart of FIG. 3 already described. Hereinafter, with reference to the drawings, the analysis operation by the emotion estimation means at the time of call voice analysis in the present embodiment will be described.

  In FIG. 6, the emotion estimation means extracts parameters such as voice power fluctuations representing the loudness and length of voice, parameters such as pitch fluctuations representing frequency fluctuations, and the like from the voice data received from the partner terminal. Detect (step 403). For example, if the voice data has an emotional pattern “Wawahaha”, and the effect pattern database 10 stores a pre-stored effect that makes the meeting place “wahahaha”, When the emotion estimation means of the voice analysis unit detects the emotion pattern “wahhaha”, the process is continued, and an effect is produced where the venue corresponding to the emotion pattern is excited. If there is no emotion pattern, or if there is no effect pattern corresponding to the emotion pattern, there is no special processing and the voice data can be emitted as it is.

  Similarly, if the effect “no bother” is stored in the effect pattern database 10 in association with a silent period of a certain time or longer, the effect “no bother” is voiced. When there is no silent section longer than a certain time, normal processing is performed. In addition, the data created by the user such as “Yes”, “Ya h”, “Y a h”, “H e y”, and other human voices such as laps are also used as an effect, and more parameters and It can also have a large amount of effect patterns. And you may provide the some effect pattern management part 9 and the effect pattern database 10 in it.

(Embodiment 4)
Next, the portable terminal device concerning the 4th Embodiment of this invention is demonstrated. In the fourth embodiment of the present invention, a mobile terminal device is used as a videophone so that not only the effect of audio data is output but also the effect of an image can be seen during a call. FIG. 7 shows a block diagram of a portable terminal device 300 in which voice and images are sent simultaneously during a call. In the mobile terminal device 300, the image synthesis unit 11 is installed separately from the voice synthesis unit 5, and the effect pattern corresponding to the image is also stored in the effect pattern database 20. Image data received by the wireless unit 4 is processed by the image processing unit 93 and output to the image composition unit 11. Further, an image captured by the camera 92 is also processed by the image processing unit 93 and output to the image composition unit 11.

  When the analysis data collation unit 7 of the portable terminal device 300 matches the pattern of the audio data with the effect pattern, an image corresponding to the effect pattern is read from the effect pattern database 20 and passes through the effect pattern management unit 9 and the analysis collation unit 7. And output to the image composition unit 11. The image synthesis unit 11 synthesizes the received image data or the image taken by the camera 92 and the image corresponding to the matched effect pattern. Since the display unit 12 is connected to the control unit 1, the synthesized image is displayed on the display unit 12.

  For example, when the received image of the other party is displayed on the display unit of the videophone, the received voice data is analyzed, and the keyword “damejan” is detected. In the effect pattern database 20, “damejan” And the effect that the letter “sorry” comes down from the top of the display screen is stored as an effect pattern. If the analysis result of the audio data matches the effect pattern by the collation, the image synthesis unit 11 synthesizes the effect corresponding to this effect pattern into the image. As a result, on the display unit 12, the video of the person who is calling is displayed, and at the same time, the text “I'm sorry” comes down from the upper end of the screen. If the word “I'm sorry” comes down from above the face of the caller who ’s angry, “No. If they do not match, normal processing in which no effect is output is performed.

  In the videophone shown in FIG. 7, the user's face talking on the videophone is photographed by the camera 92, and the screen of the display unit 12 is divided and displayed, so that the other party's face is displayed at the same time. It can also be displayed. Therefore, the received voice data of the other party is analyzed and added to the other party's image and displayed, and the transmitted voice data is analyzed and added to the own picture. When displayed, the speech content spoken by each can be highlighted and displayed as a character image on each image. For example, if the other party laughs, “Wahaha”, the word “Wahaha” will be displayed on the image of the other party who laughed. Is displayed.

(Embodiment 5)
The embodiment of adding the effect to the received voice of the other party and outputting it to the own terminal has been described above. However, as the fifth embodiment of the present invention, the effect is added to the own voice and the other party's terminal is added. A mobile terminal device that transmits data to the mobile terminal will be described. FIG. 8 shows a block diagram of a portable terminal device 400 according to the fifth embodiment of the present invention in the case where an effect is exerted on the voice emitted from the terminal.

According to the present embodiment, voice data, which is a call voice emitted from the microphone 150 of the terminal itself, is analyzed by the voice analysis unit 8 which is an analysis means, parameters are extracted, a pattern of the extracted parameters is analyzed, The analyzed pattern and the effect pattern are collated by the analysis collating unit 7, and if they match, the effect corresponding to the effect pattern is voiced by the data voice converting unit 6 and synthesized by the voice synthesizing unit 5 by the voice synthesizing unit 5. The effect is added to the voice of, and output from the wireless unit 4 under the control of the control unit 1. As a result, it is possible to automatically add an effect to one's own voice and transmit it to the other terminal.

(Embodiment 6)
Next, a portable terminal device according to a sixth embodiment of the present invention will be described. In the sixth embodiment of the present invention, an effect is not added every time matching is performed by the analysis matching unit 7 described in the first to fifth embodiments, and the conversation is interrupted. A portable terminal device characterized by an operation of adding an effect will be described.

  FIG. 9 shows a block diagram of a portable terminal device 500 according to the sixth embodiment of the present invention.

  FIG. 9 has a configuration provided with a storage unit 13 in addition to the configuration of FIG. 4 already described in the second embodiment. The storage unit 13 is a general-purpose memory that is normally provided in the mobile terminal device, and the effect output from the effect pattern management unit 9 when the analysis result matches the effect pattern in the analysis matching unit 7. Is stored as identification information (for example, an identification number).

  FIG. 10 is a diagram illustrating an example of a data configuration stored in the storage area of the effect pattern database 30 included in the mobile terminal device 500 according to the sixth embodiment of the present invention.

  As illustrated, the effect pattern database 30 stores a plurality of sets of identification numbers 31, effect patterns 90, and effects 91 as a set of data. Here, when the effect pattern 90 is a silent section of a certain time or longer, the effect stored in the storage unit 13 is read as the effect 91.

  FIG. 11 is a flowchart showing a process flow of the mobile terminal device 500 according to the sixth embodiment of the present invention. Note that this processing flow stores an identification number 31 for identifying an effect associated with an effect pattern adapted to the processing flow of FIG. 5 already described in the second embodiment (step 501); And a step (step 502) for determining that the conversation is interrupted.

  In step 202 of FIG. 11, the case where the voice data received from the counterpart terminal is “Hey, yes, my name is (silent period of a certain period of time)” is described below as an example. The flow will be described.

  First, the mobile terminal device 500 starts a voice call with the counterpart terminal that is the originator of the voice call (step 201), and the voice data sent from the counterpart terminal during the call is “Hey, that ’s right. Receives (silent period of a certain time) "(step 202).

  Next, the speech analysis unit 81 having the speech recognition unit 82 extracts a parameter pattern such as a keyword from the speech data (step 203). Here, the speech analysis unit 81 extracts four patterns of “he”, “sore”, “wahaha” and “(silent period of a certain time)” (step 303), and sequentially analyzes and collates them. Output to unit 7.

  Next, the analysis collation unit 7 collates the pattern that is the analysis result with the effect pattern 90 of the effect pattern database 30 (step 204).

  If the analysis collation unit 7 collates and matches the analysis result pattern with the effect pattern 90, the analysis collation unit 7 determines whether or not the matched effect pattern is a silent section of a fixed time (step 502). Whether or not it is a silent section may be determined based on the elapsed time by setting a timer (not shown) for measuring the duration of the silent part when analyzing the audio data in step 203. Alternatively, the silent section selection processing by the effect pattern database 10 described in the third embodiment may be used.

  On the other hand, if the analysis result pattern and the effect pattern 90 do not match, the analysis collating unit 7 emits normal voice data as it is without any special processing (step 205) (step 209).

  Next, when the analysis matching unit 7 determines that the matched effect pattern 90 is not a silent section of a certain time, the analysis matching unit 7 identifies the matched effect 91 as an effect to be output (step 206), and matches from the effect pattern database 30. The identification numbers 31 corresponding to the effect patterns are sequentially stored in the storage unit 13 in correspondence with the order (step 501). Then, the processes of Step 202, Step 203, Step 303, Step 204, Step 502, Step 206, and Step 501 are repeated until the matched effect pattern is a silent section of a fixed time.

  Here, FIG. 12 shows an example of the data configuration stored in the storage unit 13. As shown in FIG. 12, in the storage unit 13, the order 121 stored in the left column is sequentially arranged as “1” and “2”, and the identification numbers corresponding to the order 121 are sequentially stored in the right column. The FIG. 12 shows an example of the data configuration in the case where the voice data received from the partner terminal is “Hey, yes, that is (silent period of a certain time)”.

  The storage unit 13 receives the identification number “0003” corresponding to the effect pattern “he” determined to be matched by the analysis matching unit 7 and the identification number “0005” corresponding to the effect pattern “wahahaha”. 7 are stored in the order in which they are determined to match.

  Next, when the analysis matching unit 7 determines that the matched effect pattern is a silent section of a certain time, the identification numbers 92 “0003” and “0005” stored in the storage unit 13 are read according to the order 121, The effect pattern management unit 9 utters the effects 91 “hehehehehehe” and the effect 91 “an effect that makes the venue feel exciting” (step 207). Then, the voice synthesizer 5 synthesizes the voice data (silent part) received from the counterpart terminal and the data obtained by converting the effect 91 into voice (step 208), and the speaker 3 rings the synthesized voice data (step 208). Step 209).

  In the present embodiment, the case where the effect 91 is output in the silent section based on the voice data received from the counterpart terminal has been described. However, by providing the storage unit 13 in the configuration of FIG. The same can be applied to the case where the effect 91 is transmitted in the silent period based on the audio data transmitted from.

  In the present embodiment, the voice recognition unit 82 extracts the keyword from the voice data received from the counterpart terminal (step 303), and the process of adding the effect has been described. By replacing with step 403 in FIG. 6, an effect can be added by an emotion pattern.

  In addition, in the present embodiment, only the effect of the voice data is output, but by providing the storage unit 13 in the configuration of the videophone (FIG. 7) that can simultaneously transmit and receive voice and images during a call, An image with the effect 91 added to the silent section can be output or transmitted.

  In the present embodiment, it has been described that the storage unit 13 stores the identification number 31 indicating the effect 91 matched by the analysis collation unit 7. However, the effect pattern database 30 is used as the storage unit 13, and the effect pattern is used. The database 30 may be provided with a flag for identifying the matched effect 91, the order 121, and the like.

  In the present embodiment, it has been described that the identification number 31 indicating the effect 91 matched by the analysis collation unit 7 is sequentially stored in the storage unit 13, but it is determined that the analysis collation unit 7 matches. Only an identification number indicating the latest effect may be stored. Thereby, the output or transmission frequency of the effect 91 can be suppressed, and even when the keyword of the effect pattern database 30 is continuously called during a call, it is possible to prevent an excessive effect from being added.

  In addition, the number of times that the keyword used in one sentence matches the effect pattern 90 is stored in the storage unit 13 in association with the identification number 31, and the effect pattern 90 having the highest use frequency is stored. You may make it output or transmit the effect 91 corresponding to.

  As described above, according to the mobile terminal device of the sixth exemplary embodiment of the present invention, it is possible to effectively use the silent section, and the effect is frequently added to the voice or the image during the conversation. It is possible to output the effect without disturbing the user's concentration on the conversation.

  In addition, the specific configuration of each part is not limited to the above embodiment, and various modifications can be made without departing from the spirit of the present invention.

  According to the present invention described in detail above, it is possible to analyze voice data and output a predetermined effect as desired by the user to the own terminal or to transmit it to the partner terminal. In addition, it can be applied to a portable terminal device that enhances entertainment and exhibits advanced sound effect functions.

The block diagram of the portable terminal device in the 1st Embodiment of this invention The figure which shows the data structure of the effect pattern database of the portable terminal device in the 1st Embodiment of this invention. The flowchart which shows the operation | movement at the time of the analysis in the 1st Embodiment of this invention The block diagram of the portable terminal device in the 2nd Embodiment of this invention The flowchart which shows the operation | movement at the time of the analysis in the 2nd Embodiment of this invention. The flowchart which shows the operation | movement at the time of the analysis in the 3rd Embodiment of this invention The block diagram of the portable terminal device in the 4th Embodiment of this invention The block diagram of the portable terminal device in the 5th Embodiment of this invention The block diagram of the portable terminal device in the 6th Embodiment of this invention The figure which shows the data structure of the effect pattern database of the portable terminal device in the 6th Embodiment of this invention. The flowchart which shows the operation | movement at the time of the analysis in the 6th Embodiment of this invention The figure which shows the data structure of the memory | storage part in the 6th Embodiment of this invention. Block diagram of a conventional portable terminal device

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Control part 2 Operation part 3 Speaker 4 Radio | wireless part 5 Speech synthesis part 6 Data voice conversion part 7 Analysis collation part 8 Voice analysis part 9 Effect pattern management part 10 Effect pattern database 11 Image composition part 12 Display part 13 Storage part 100 Portable terminal apparatus

Claims (7)

An analysis means for analyzing the received call data;
An effect pattern database for accumulating the effect pattern for matching with the analysis result of the call data and the effect associated with the effect pattern;
Effect pattern management means for managing the output of the effect pattern;
An analysis collation unit that collates the analysis result with an effect pattern and a synthesis unit that adds and outputs the effect to at least one of voice and image output to the terminal during a call,
The analysis result analyzed by the analysis means and the effect pattern whose output is managed by the effect pattern management means are collated by the analysis collation means, and the effect associated with the matched effect pattern is output to the own terminal A mobile terminal device configured to output by adding to at least one of images. An analysis means for analyzing the call data to be transmitted;
An effect pattern database for accumulating the effect pattern for matching with the analysis result of the call data and the effect associated with the effect pattern;
Effect pattern management means for managing the output of the effect pattern;
An analysis collation unit that collates the analysis result with an effect pattern, and a synthesis unit that adds the effect to at least one of voice and an image transmitted to a partner terminal during a call,
The analysis result analyzed by the analysis unit and the effect pattern whose output is managed by the effect pattern management unit are collated by the analysis collation unit, and the effect associated with the matched effect pattern is transmitted to the counterpart terminal Alternatively, a portable terminal device configured to be added to at least one of images and transmitted. The synthesizing unit collates the analysis result with the effect pattern by the analysis collating unit, and each time it is determined that they match each other, the synthesizing unit displays an effect associated with the adapted effect pattern at least on the sound or the image. The mobile terminal device according to claim 1, wherein the mobile terminal device is added to either one. Storage means for storing identification information for identifying an effect associated with the adapted effect pattern or an effect associated with the adapted effect pattern;
The synthesizing means, when the analyzing means detects a silent section of a predetermined time from the call data, shows the effect stored in the storage means or the effect indicated by the identification information at least for the voice or the image. The mobile terminal device according to claim 1, wherein the mobile terminal device is added to either one. The portable terminal device according to any one of claims 1 to 4, further comprising image combining means for combining an effect with an image to be displayed during a call. The portable terminal device according to claim 1, wherein the analysis unit is an analysis unit having a voice recognition unit. The portable terminal device according to claim 1, wherein the analysis unit is an analysis unit including an emotion estimation unit.

Images