JP2006324940A - Communication apparatus with image display function having automatic answering function with automatic animation, and communication method using automatic answering function with automatic animation - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a communication apparatus capable of easily generating animation and having a function capable of synchronously transmitting, receiving and reproducing especially both voice and image information, and a communication method using the communication apparatus. <P>SOLUTION: The communication apparatus with an image display function comprises a voice analysis part for analyzing a voice message in each prescribed time and calculating voice feature information, an animation data storage part for storing animation data which are the collection of a series of still images selected by a transmitter according to the voice message and an animation generation part for generating animation while synchronizing the stored voice feature information and the animation data corresponding to the voice data with each other. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a communication device with an image display function, and more particularly to a communication device with an image display function and a communication method having an answering machine function capable of recording an image.

  2. Description of the Related Art Conventionally, there is known a communication device with an image display function capable of transmitting and receiving images in addition to voice. For example, for a telephone that has been answered when the user is away or cannot answer a telephone, disclosed in Patent Document 1 below. Some of them have an answering machine function that can record an image such as an animation together with a voice message. Further, Japanese Patent Application Laid-Open No. 2004-151867 is disclosed regarding audio analysis necessary for synchronizing this processing between an audio signal and an image signal.

Japanese Patent Application Laid-Open No. 07-095546 JP 2003-316378 A

  However, in such a conventional answering machine function, only the image taken by the calling camera can be recorded together with the message, and for example, an animation other than the image taken by the camera should be recorded. The user's request could not be met.

  Also, creating an animation requires specialized techniques and was not easy to create.

  Therefore, an object of the present invention is to provide a communication device with an image display function that has an answering machine function that can easily animate a business message.

  To achieve the above object, according to claim 1 of the present invention, an answering machine with automatic animation capable of transmitting and receiving a message message as an audio signal and an animation data as an image signal as a caller terminal or a callee terminal. A communication apparatus with an image display function having a function of analyzing a business message that is voice data and calculating voice feature information indicating a voice state for each predetermined time; An animation for storing animation data that includes a plurality of image data corresponding to the voice state selected at the calling terminal in response to the message and is a collection of a series of still images having a predetermined correlation Based on the data storage unit, the voice feature information, and the animation data, it synchronizes with the voice state of the message for each predetermined time. It defines an image display function communication device with a voice mail with automatic animation with, and anime generator for generating an animation to display the corresponding image data of the data the animation Te.

  According to a second aspect of the present invention, the communication device with an image display function having an answering machine function with automatic animation according to the first aspect is stored in the animation data storage unit when used as the calling terminal. Communication device with an image display function provided with an answering machine function with automatic animation, having an animation data communication unit as a data transmission means and when used as the receiving terminal, the animation data reception means It stipulates.

  According to a third aspect of the present invention, the communication apparatus with an image display function having an answering machine function with automatic animation according to the first or second aspect acquires desired animation data from a content server connected to the Internet. A communication apparatus with an image display function provided with an answering machine function with automatic animation, characterized in that it has an Internet communication section for the purpose.

  In claim 4, the communication method using the answering machine function with automatic animation capable of processing the message message and the animation data as the image signal as the calling terminal or the receiving terminal, In the receiving terminal, after analyzing the message in the voice analysis unit, the voice analysis unit calculates voice feature information indicating a voice state for each predetermined time, and the voice feature information is converted into the voice feature information. A set of still images that are stored in a storage unit and include a plurality of image data corresponding to the state of the voice selected in the sending terminal with respect to the message, and have a predetermined correlation. Certain animation data is stored in the animation data storage unit, and stored in the audio feature information storage unit and the audio feature information stored in the audio feature information storage unit. Based on the animation data being generated, the animation generation unit generates and displays the animation from the corresponding image data of the animation data in synchronization with the state of the voice for each predetermined time of the message. It stipulates the communication method using the answering machine function with automatic animation.

  According to a fifth aspect of the present invention, in the communication method using the answering machine with automatic animation function according to the fourth aspect, the animation data communication unit is stored in the animation data storage unit when used as the calling terminal. When using the received data or as the receiving terminal, a communication method using an answering machine function with automatic animation for receiving the animation data transmitted from the transmitting side is defined.

  According to a sixth aspect of the present invention, in the communication method performed via the communication device with an image display function according to the fourth or fifth aspect, desired animation data is obtained from a content server connected to the Internet at the transmitting terminal. It defines a communication method using an answering machine function with automatic animation that selects and acquires, and transmits the selected animation data together with the message to the receiving terminal via the Internet communication unit.

  The communication method using an answering machine with automatic animation according to claim 6, wherein the transmitting terminal receives a list of animation data from the content server, and the transmitting terminal receives the reception Selecting the desired data from the list of animation data, and transmitting information on the selected animation data including the address in the content server and the identification information of the animation data to the receiving terminal, The terminal stipulates a communication method using the answering machine function with automatic animation for acquiring the corresponding animation data from the content server based on the transmitted information on the animation data.

  According to the present invention, a message message is analyzed to calculate a voice state for each predetermined time of the message, and image data corresponding to the voice state for each predetermined time is transmitted on the transmission side. Since it is read from the data for animation selected on the terminal and displayed in synchronization with the message, even if there is no technology for creating animation with voice, it is possible to easily add animation to the message. .

  Further, by transmitting the animation data from the transmission side terminal and receiving it at the reception side terminal, it is possible to generate an animation at the reception side terminal using the animation data held by the transmission side terminal.

  Further, if the animation data is acquired from the content server, the animation data can be selected from the abundant data of the content server, and the use time of the telephone line can be shortened.

  Hereinafter, the present invention will be described with reference to the drawings. In the following embodiments, a case where the present invention is applied to a so-called “videophone device” will be described in order to simplify comparison and reference with the prior art. Actually, the present invention is not limited to a videophone device, and is generally applicable to any voice communication device having an image display function. FIG. 1 is a configuration diagram of a communication system using such a voice communication device. FIG. 1A shows a case where a calling terminal 01 and a receiving terminal 02 are connected via a telephone line 03. b) shows a case where these two terminals are connected via the Internet 24. In the latter case, FIG. 1B shows a case where the animation data and communication transmission / reception are shared over the Internet, but the connection with the content server and the communication line can be used separately. The former configuration will be described in the first embodiment, and the latter configuration will be described in the second embodiment.

(Embodiment 1)
FIG. 2 is a block diagram of a videophone apparatus as Embodiment 1 of the present invention. A videophone device having the same configuration is used as a terminal on both the outgoing side and the incoming side. The videophone devices 01 and 02 in the first embodiment are connected via a telephone line 03 as shown in FIG. Further, the configuration of the videophone devices 01 and 02 as terminals can be divided into three parts: an audio data processing unit A, an animation data processing unit B, and a control unit C. Here, the animation data refers to a series of still images having a predetermined correlation.

  The voice data processing unit A connects the videophone device which is the calling terminal 01 or the receiving terminal 02 to the telephone line 03, and the voice data communication unit 11 for performing voice data communication between both terminals is used as the voice of the terminal. It has as a signal input / output unit. In the case of the receiving terminal 02, the voice analysis unit 12 that analyzes voice data received by the voice data communication unit 11 to calculate voice feature information described later, and the voice feature information calculated by the voice analysis unit 12 are stored. The voice feature information storage unit 13 to be operated operates. In addition, the voice input unit 19 including a microphone that collects the utterance of the caller when the caller terminal 01 is used, and the speaker that outputs the message received by the voice data communication unit 11 when the caller terminal 02 is used. The audio output unit 20 including the audio data communication unit 11 further includes an audio storage unit 21 serving as a temporary memory for audio data to be transmitted and received by the audio data communication unit 11.

  The animation data processing unit B is connected to the telephone line 03 and communicates with the partner terminal (01 or 02) for animation data, and the animation data communication unit 14 receives or transmits the animation. Animation data storage unit 15 that is stored as a temporary memory for data, animation data that is received and stored in animation data storage unit 15, and audio feature information that is stored in the audio feature information storage unit 13 The animation generation part 17 which produces | generates an animation based on these, and the image output part 18 which outputs the animation produced | generated by the animation production | generation part 17 are comprised.

  The control unit C includes an operation control unit 22 for controlling the transmission / reception processing of the above voice data and animation data, and a communication signal control unit for transmitting / receiving a signal connected to the telephone line 03 to control communication with the partner terminal. 16. Note that the telephone line to which the voice data communication unit 11, the animation data communication unit 14, and the communication signal control unit 16 are connected is the same (one) line, and the operation control unit 22 switches the connection destination to switch the A , B and C are processed.

The videophone apparatus described above has an answering machine function, and in communication between the same videophone apparatuses, an animation character is selected and recorded together with a voice message to be recorded on the answering machine at the calling terminal 01. When the message is played, the animation of the selected character is automatically generated and output in conjunction with the voice.
Specifically, as shown in the sequence diagram of FIG. 3, when the operation control unit 22 of the receiving side terminal 02 detects an incoming call (S11) from the telephone line 03, the calling side terminal 01 is in the answering machine state. The communication signal to be notified is transmitted by the communication signal control unit 16 (S12).

  When the operation control unit 22 of the calling-side terminal 01 receives a communication signal notifying that the receiving-side terminal 02 is in the answering machine state via the communication signal control unit 16, the operation control unit 22 checks whether an animation can be output. Then, the communication signal of the content transmission request is transmitted to the receiving terminal 02 via the communication signal control unit 16 (S13).

  When the operation control unit 22 of the receiving terminal 02 receives the communication signal for the content transmission request via the communication signal control unit 16, the operation control unit 22 may check the free space of the animation data storage unit 15 and receive the animation data. If it is determined that the communication is possible, a communication signal for accepting content transmission is transmitted to the caller terminal 01 via the communication signal control unit 16 (S14), the telephone line connection destination is switched to the animation data communication unit 14, and the animation data communication is performed. The data for animation can be received by the unit 14.

  When the operation control unit 22 of the transmission side terminal 01 receives a communication signal for accepting content transmission via the communication signal control unit 16, the operation control unit 22 displays on the image output unit 18 that the reception side terminal 02 is in the answering machine state, The output unit 20 outputs a voice notifying that the receiving terminal 02 is in the answering machine state, and sends a message for selecting whether to output both the message and the animation together with the image output unit 18 and the voice output unit 20. Output from.

When the operation control unit 22 of the transmission-side terminal 01 is selected to output an animation by a user's button operation or the like, the transmittable animation data stored in the animation data storage unit 15 of its own device. A message for selecting a character to be used is output to the image output unit 18 together with the list of characters.
When the character to be used is selected by the user's button operation or the like, the operation control unit 22 of the transmission side terminal 01 switches the connection destination of the telephone line 03 to the animation data communication unit 14, and the animation data of the corresponding character is displayed. Is transmitted to the receiving terminal 02 by the animation data communication unit 14 (S15).
The animation data communication unit 14 of the receiving terminal 02 stores the received data in the animation data storage unit 15.

  When the data reception is completed, the operation control unit 22 of the receiving terminal 02 switches the connection destination of the telephone line to the communication signal control unit 16 and communicates the animation data reception notification indicating that the reception of the animation data is completed. A signal is transmitted to the caller terminal 01 via the communication signal controller 16 (S16), and then a communication signal for requesting voice data transmission is transmitted to the caller terminal 01 via the communication signal controller 16 (S17). The connection destination of the telephone line is switched to the voice data communication unit 11.

  When the transmission of the animation data is completed, the operation control unit 22 of the transmission side terminal 01 switches the connection destination of the telephone line to the communication signal control unit 16, and the communication signal of the animation data receipt notification via the communication signal control unit 16. Then, when a communication signal for voice transmission request is received, the connection destination of the telephone line is switched to the voice data communication unit 11, and a message for instructing the user to blow a message is sent to the image output unit 18, voice output. The voice data output to the unit 20 and input from the voice input unit 19 is transmitted to the receiving terminal 02 via the voice data communication unit 11 (S18).

The voice data communication unit 11 of the receiving terminal 02 stores the received data in the voice storage unit 21 and outputs it to the voice analysis unit 12.
As the voice analysis unit 12, for example, using the technique disclosed in Patent Document 2, the input voice data is analyzed, and a value indicating the voice state for each set time is calculated and used as voice feature information. It is stored in the voice feature information storage unit 13.

When the reception of the voice data is completed, the operation control unit 22 of the receiving terminal 02 switches the connection destination of the telephone line to the communication signal control unit 16 and sends a communication signal for content reception completion notification indicating that the content reception has been completed. The message is transmitted to the calling terminal 01 via the communication signal control unit 16 (S19), the telephone line communication is cut off, the lamp indicating that the message is recorded is turned on, and the message is recorded. A message indicating that the image is present is output to the image output unit 18.
When the transmission of the audio data is finished, the operation control unit 22 of the calling side videophone switches the connection destination of the telephone line to the communication signal control unit 16, and transmits a communication signal for content reception completion notification via the communication signal control unit 16. When received, the communication on the telephone line is disconnected and the process ends.

Next, a process of reproducing the business message recorded in this manner on the videophone device serving as the receiving terminal 02 will be described.
When the operation control unit 22 of the videophone device at the receiving terminal 02 is instructed to reproduce the message by a user's button operation or the like, the message output unit 20 outputs the message stored in the voice storage unit 21. The data for animation is reproduced on the basis of the audio feature information corresponding to the audio data stored in the audio feature information storage unit 13 by the animation generation unit 17 in synchronization with the reproduction of the audio data. An animation is generated from the animation data corresponding to the transmitted audio data stored in the storage unit 15 and output to the image output unit 18.

  The animation data includes a plurality of image data (may be moving images) corresponding to the value indicating the sound state stored as the sound feature information, and the value indicating the sound state is divided into a plurality of stages. Image data representing the sound state of each stage is associated.

  The animation generation unit 17 uses the audio feature information read from the audio feature information storage unit 13 to display the image data corresponding to the value from the value indicating the state of the audio for each hour. Data is read out and output to the image output unit 18.

  In this manner, an animation in which the selected character moves in accordance with the voice state can be reproduced in synchronization with the voice of the recorded message.

(Embodiment 2)
Next, FIG. 4 is a diagram showing a videophone apparatus according to Embodiment 2 of the present invention. Since the second embodiment is configured in substantially the same manner as the above-described first embodiment, the same reference numerals are given to the same configurations, and only characteristic portions will be described.
The videophone device according to the second embodiment includes an Internet communication unit 23 that is a means for communicating with a device on the Internet 24, and acquires animation data from a content server 25 on the Internet 24. To do.

  Specifically, as shown in the sequence diagram of FIG. 5, as in the first embodiment, the operation control unit 22 on the receiving side detects an incoming call from the calling terminal 01 (S11). The side terminal 02 notifies the calling side terminal 01 that it is in the answering machine state (S12). When receiving this, the operation control unit 22 of the calling terminal 01 transmits a content transmission request (S13). When the operation control unit 22 of the receiving terminal 02 determines that the animation data can be received, the content transmission acceptance is received. A communication signal is transmitted to the originating terminal 01 (S14). The connection to the Internet 24 is switched to the animation data communication unit 14 so that the animation data communication unit 14 can receive the animation data.

  When the operation control unit 22 of the transmission side terminal 01 receives a communication signal for accepting content transmission via the communication signal control unit 16, the operation control unit 22 displays on the image output unit 18 that the reception side terminal 02 is in the answering machine state, The output unit 20 outputs a voice notifying that the receiving terminal 02 is in the answering machine state. At this time, a message for selecting whether to output an animation together with the business message is output from the image output unit 18 and the audio output unit 20.

  When the operation control unit 22 of the transmission-side terminal 01 is selected to output an animation by a user's button operation or the like, it sends an animation data list request to the content server 25 in order to obtain a list of animation data. It transmits via the communication part 23 (S21). Then, when receiving the animation data list from the content server 25 (S22), the operation control unit 22 of the originating terminal 01 displays a message for selecting a character to be used together with the received animation data character list. Output to the output unit 18.

When the character to be used is selected by a user's button operation or the like, the operation control unit 22 of the transmitting terminal 01 sends an animation data request for the selected animation data to the content server 25 via the Internet communication unit 23. (S23).
Then, when the internet communication unit 23 of the originating terminal 01 receives the animation data from the content server 25 (S24), it stores the received animation data in the animation data storage unit 15.

  When receiving the animation data from the content server 25, the operation control unit 22 of the transmission-side terminal 01 switches the connection to the Internet 24 to the animation data communication unit 14, and the animation data acquired from the content server is converted into the animation data. The data communication unit 14 transmits the data to the receiving terminal 02 (S15).

  Next, as in the second embodiment, the animation data communication unit 14 of the receiving terminal 02 stores the received data in the animation data storage unit 15, and when the data reception ends, the receiving terminal The operation control unit 22 of 02 transmits a communication signal for notification of receipt of animation data indicating that the reception of animation data has been completed (S16). Next, a voice transmission request communication signal is transmitted (S17), and the operation control unit 22 of the calling terminal 01 finishes the transmission of the animation data, and the communication signal of the animation data receipt notification from the receiving terminal 02 is received. Next, when a communication signal for voice transmission request is received, a message for instructing the user to inject a message is output from the voice output unit 20 and the image output unit 18, and voice data input from the voice input unit 19 is received. It transmits to the side terminal 0202 (S18).

  The receiving terminal 02 stores the received data in the voice storage unit 21, analyzes the voice data in the voice analysis unit 12, and stores the voice feature information in the voice feature information storage unit 13. When the reception of the audio data is completed, a communication signal for notifying the completion of content reception is transmitted to the originating terminal 01 (S19), and an output indicating that the message is recorded is cut off and the telephone line communication is disconnected. finish. When the transmission of the voice data is completed and the communication signal for notifying the completion of content reception is received via the communication signal control unit 16, the operation control unit 22 of the transmission-side terminal 01 disconnects the telephone line communication and ends.

  As described above, in the second embodiment, since the necessary animation data is downloaded from the content server 25 and transmitted, the memory capacity for storing the animation data in the videophone devices 01 and 02 is stored. The animation data can be selected from the various animation data of the content server 25.

  As shown in FIG. 6, the calling terminal 01 obtains only a list of animation data of the content server 25 (S21, S22), and information about the selected animation data (address of the content server 25, animation) Data identification information) is transmitted to the receiving terminal 02 as animation data information (S31), and the receiving terminal 02 receives the animation data from the content server 25 based on the received information relating to the animation data. Request (S32), acquire this (S33), and when the acquisition of the animation data is completed, transmit the communication signal of the animation data receipt notification and the communication signal of the voice transmission request (S16, S17). A message may be recorded.

In this way, it is not necessary to transmit animation data from the calling terminal 01 via the telephone line, and the usage time of the telephone line can be shortened.
Further, the acquisition of animation data at the receiving terminal 02 may be performed at the time of message message reproduction.
By doing so, it is possible to shorten the use time of the telephone line and to avoid unnecessary downloading of animation data.

FIG. 2A is a diagram illustrating a configuration example of a communication system, and FIG. 3B is a configuration diagram using the Internet. The block diagram which shows the structure of the voice call apparatus with an image display function. The sequence diagram which shows the communication process by this invention. The block diagram in the case of connecting a content server via the internet. The sequence diagram in the case of connecting and transmitting a content server via the Internet. The sequence diagram which shows the other example of the sequence in FIG.

Explanation of symbols

01: Videophone device (calling side) 02: Videophone device (receiving side)
03: Telephone line 11: Voice data communication unit 12: Voice analysis unit 13: Voice feature information storage unit 14: Anime data communication unit 15: Anime data storage unit 16: Communication signal control unit 17: Anime generation unit 18: Image Output unit 19: Audio input unit 20: Audio output unit 21: Audio storage unit 22: Operation control unit 23: Internet communication unit 24: Internet 25: Content server

Claims (7)

A communication device with an image display function equipped with an answering machine function with automatic animation capable of transmitting and receiving a message message as an audio signal and an animation data as an image signal as a calling terminal or a receiving terminal,
A voice analysis unit that analyzes a message message that is voice data and calculates voice feature information indicating a voice state for each predetermined time;
Stores animation data including a plurality of image data corresponding to the audio state selected at the calling terminal in response to the message, and a set of still images having a predetermined correlation. Anime data storage,
An animation for generating an animation for displaying the corresponding image data of the animation data in synchronization with a predetermined audio state of the message based on the audio feature information and the animation data A generator,
A communication apparatus with an image display function provided with an answering machine function with an automatic animation. A communication apparatus with an image display function having an answering machine function with automatic animation according to claim 1,
When used as the caller terminal, the data transmission means for data stored in the animation data storage unit, and when used as the callee terminal, the animation data communication serves as a means for receiving the animation data. A communication apparatus with an image display function, which has an answering machine function with automatic animation, characterized in that it has a section. A communication apparatus with an image display function having an answering machine function with automatic animation according to claim 1 or 2,
A communication apparatus with an image display function, having an answering machine function with automatic animation, comprising an Internet communication unit for acquiring desired animation data from a content server connected to the Internet. A communication method using an answering machine function with automatic animation capable of processing a message message as an audio signal and an animation data as an image signal as a calling terminal or a receiving terminal,
In the receiving terminal,
After analyzing the message in the voice analysis unit, the voice analysis unit calculates voice feature information indicating a voice state for each predetermined time, and stores the voice feature information in the voice feature information storage unit. ,
The animation data including a plurality of image data corresponding to the state of the audio selected by the caller terminal in response to the message and a set of still images having a predetermined correlation is animated. Stored in the data storage unit,
Based on the voice feature information stored in the voice feature information storage unit and the animation data stored in the animation data storage unit, the voice message at a predetermined time of the message is stored. Synchronously generating and displaying an animation from the corresponding image data of the animation data by the animation generation unit,
A communication method using an answering machine with automatic animation, characterized by In the communication method using the answering machine function with automatic animation according to claim 4,
When the animation data communication unit is used as the transmitting terminal, the data stored in the animation data storage unit is transmitted, or when it is used as the receiving terminal, the data is transmitted from the transmitting side. A communication method using an answering machine with automatic animation, wherein the animation data is received. In the communication method performed via the communication apparatus with an image display function according to claim 4 or 5,
Select and obtain desired animation data from a content server connected to the Internet at the calling terminal, and send the selected animation data together with the message to the receiving terminal via the Internet communication unit. Send
A communication method using an answering machine with automatic animation characterized by the above. In the communication method using the answering machine function with automatic animation according to claim 6,
The calling terminal receives a list of animation data from the content server,
The calling terminal selects desired data from the received animation data list, and sends information on the selected animation data including the address and identification information of the animation data in the content server 25 to the receiving side. Send it to your device,
The receiving terminal obtains the corresponding animation data from the content server according to the information about the transmitted animation data.
A communication method using an answering machine with automatic animation characterized by the above.

Images