JP2007214909A - Telephone device and telephoning method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a telephone device through which a user and a communication partner can understand each other through character information even in a state in which sounds cannot be used. <P>SOLUTION: An image display 35a which displays the moving images etc., of a video telephone and a character display 35b which displays character information etc., of a video chat communication are provided to the display of the telephone device. When an indication that a conversation mode is switched from a videotelephone mode to a video chat communication mode is issued from an originator to a communication partner, a control unit 72 receives the above request, switches the conversation mode without interrupting communications with the communication partner, and enables both the originator and communication partner to display and input the character information, to carry out transmission/reception, etc. in the video chat communication mode, and to carry on a conversation with each other through character information. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a telephone device and a telephone method for communicating with a communication destination in a predetermined conversation mode while displaying an image transmitted from the communication destination on a screen.

  Conventionally, in a videophone, an image obtained by capturing a caller has been used as an aid for a voice call. Therefore, when sound cannot be used, only images are transmitted, and communication with the communication partner cannot be achieved.

  FIG. 11 is a block diagram showing a schematic configuration of a conventional TV telephone. The TV phone 101 includes a telephone body 110, a microphone 121, a speaker 122, a sound sensor 123, a character data input unit 124, a character data display unit 125, a camera 126, and an image display unit 127.

  The telephone main body 110 is provided with a telephone function unit 111, a mode control unit 114, a character data input / output I / F unit 115, a voice character conversion unit 116, and an image input / output interface (I / F) unit 117. The telephone function unit 111 is provided with a voice input / output I / F unit 112 to which a microphone 121 and a speaker 122 are connected, and an image I / F unit 113 to be connected to the image communication path 102. The mode control unit 114 is connected to a sound sensor 123 that measures the ambient noise level and is provided with a switching level table 114a. A character data input unit 124 and a character data display unit 125 are connected to the character data input / output I / F unit 115. The image input / output I / F unit 117 is provided with a camera 126 and an image display unit 127.

  The TV phone 101 having such a configuration uses the sound sensor 123 to determine whether or not the noise has reached a certain level, and when it reaches the certain level, not only plays the other party's voice from the speaker 122, It is converted into characters and displayed on the character data display unit 125. Further, it is possible to switch between the voice call mode and the character call mode without interrupting the conversation and without manual operation by the user (see Patent Document 1).

JP 2004-328181 A

  However, the conventional telephone device having the TV phone function has the following problems. In other words, in a situation where voice cannot be used in a videophone, such as during a conference or a hearing impaired person, only the image is transmitted, and in the character call mode, only the character is transmitted, and communication with the communication partner is sufficient. It was not possible to plan. Moreover, real-time information could not be obtained by communication using only e-mail.

  The present invention has been made in view of the above circumstances, and provides a telephone device and a telephone method capable of communicating with a communication partner almost in real time using character information even in a situation where voice cannot be used. For the purpose.

  The telephone device of the present invention is a telephone device having a communication means capable of communicating with a communication destination in a plurality of conversation modes, and an image display means for displaying an image transmitted from the communication destination on a screen of a display unit; Character display means for displaying character information communicated with the communication destination on the screen of the display unit, and the conversation mode without disconnecting communication with the communication destination, at least image and voice transmission / reception And a conversation mode control means for switching to a TV phone mode to be performed or a TV chat communication mode to perform transmission and reception of image and character information.

  With this configuration, even in situations where voice cannot be used, by performing character communication during image transmission, it is possible to switch to a chat function that allows conversation based on character information while displaying images without disconnecting communication. Therefore, communication with the communication partner can be achieved almost in real time by the character information. Therefore, it is possible to switch between TV chat communication and TV phone according to the change of the situation.

Further, the present invention is the above telephone device, further comprising: a calling time notification means for notifying the communication destination of the TV phone mode as the conversation mode when making a call, wherein the notified TV phone mode is permitted by the communication destination. If so, the conversation mode control means sets the conversation mode to the TV phone mode.
This makes it possible to preferentially set the TV phone mode when making a call.

Further, the present invention is the above telephone device, wherein when the notified TV phone mode is not permitted by the communication destination, the conversation mode control means sets the conversation mode to a voice telephone mode for transmitting and receiving only voice. Shall be switched.
As a result, even when the TV phone mode cannot be set at the time of outgoing call, it is possible to make a voice call without being disconnected.

Further, the present invention is the telephone device described above, further comprising permission means for permitting the TV phone mode notified from the communication destination when an incoming call is received, and when the notified TV phone mode is permitted, the conversation mode control is performed. The means sets the conversation mode to the TV phone mode.
This makes it possible to set the TV phone mode in response to the caller's request when an incoming call is received.

Further, the present invention is the above telephone device, further comprising an incoming call notification means for notifying the communication destination of the transition to the TV chat communication mode when the notified TV phone mode is not permitted. When the transition to the chat communication mode is permitted, the conversation mode control means switches to the TV chat communication mode.
Thereby, it is possible to set the conversation mode based on the intention of the callee.

Further, the present invention is the above telephone device, comprising communication time notification means for notifying the communication destination of the change of the conversation mode during communication with the communication destination in a predetermined conversation mode, and the notified conversation mode If the change is permitted, the conversation mode control means changes to the notified conversation mode.
Thereby, it is possible to easily change the conversation mode during communication.

Further, the present invention is the above telephone device, comprising: initial setting means for initial setting of the conversation mode; and initial setting switching means for switching the conversation mode to the initial setting according to a predetermined operation, The communication means communicates with a communication destination in the switched default conversation mode.
Thus, for example, by initially setting a conversation mode that is frequently used first, it is possible to save the trouble of pressing a button multiple times when switching to voice communication, TV chat communication, or the like. .

Further, the present invention is the telephone device described above, further comprising storage means for storing telephone book information in which a conversation mode is registered for each destination of the communication destination, wherein the conversation mode control means specifies the destination of the communication destination. Then, the conversation mode corresponding to this destination is selected from the telephone directory information.
Thereby, it is possible to easily set the conversation mode for each destination.

Further, the present invention is the telephone device described above, further comprising voice recognition means for converting voice transmitted from the communication destination into character information, wherein the character display means displays the converted character information. And
Thereby, even when voice information is transmitted to and received from the communication destination, the voice information can be converted into character information and displayed, and TV chat communication or the like can be used for conversation with character information while displaying an image. Can be performed.

  The telephone system of the present invention is a telephone system capable of communication between both telephone apparatuses in a plurality of conversation modes, and a TV telephone that transmits and receives images and sounds as a conversation mode when communicating with the telephone apparatus. At least a TV chat communication mode for transmitting and receiving image and text information, and the telephone device on the calling side notifies the communication destination of the change of the conversation mode, and the change of the notified conversation mode And a first conversation mode control means for switching to the conversation mode in which the change is permitted without disconnecting communication with the communication destination when the telephone apparatus on the reception side is permitted. An apparatus for permitting the change of the notified conversation mode, a permission notifying means for notifying the communication destination of the change permission of the permitted conversation mode, In which and a second conversation mode control means for switching the conversation mode permits the change.

  With this configuration, even in situations where voice cannot be used, by performing character communication during image transmission, it is possible to switch to a chat function that allows conversation based on character information while displaying images without disconnecting communication. Therefore, communication with the communication partner can be achieved almost in real time by the character information.

  The telephone method of the present invention is a telephone method in a telephone device having a communication means capable of communicating with a communication destination in a plurality of conversation modes, and disconnects communication with the communication destination at the time of communication in a predetermined conversation mode. Without any communication, the conversation mode is transmitted from the communication destination in the TV phone mode in which a voice call is made with the communication destination while displaying at least an image transmitted from the communication destination on the screen of the display unit. There is a conversation mode control step for switching to a TV chat communication mode in which character information transmitted / received to / from the communication destination is displayed on the screen of the display unit while displaying an image on the screen of the display unit.

  As a result, even in situations where voice cannot be used, by performing character communication during image transmission, it is possible to switch to a chat function that allows conversation by character information while displaying images without disconnecting communication, It is possible to communicate with the communication partner almost in real time by using the character information.

  The present invention also provides a program having a program code for causing a computer to realize the function of each means in the telephone device described above.

  According to the present invention, it is possible to provide a telephone device and a telephone method that can communicate with a communication partner in near real time by using character information even in a situation where voice cannot be used.

  The telephone device of the present embodiment is applied to a portable TV phone connected to another mobile phone or the like via a wireless communication network. The telephone method according to the present embodiment is realized in the communication operation in the telephone device of the present embodiment.

[overall structure]
FIG. 1 is a plan view showing an external configuration of a TV phone according to an embodiment of the present invention.

  The video phone 1 has a housing composed of an upper body 1a and a lower body 1b that can be opened and closed by a hinge portion 2. The upper body 1 a is provided with an antenna 17, a display (LCD) panel 35, a speaker 37, a camera 38, and an LED indicator 39 that notifies the presence / absence of a voice call. On the LCD panel 35, an image display unit 35a corresponding to an example of an image display unit for displaying an image of a communication partner or the like, and a character display corresponding to an example of a character display unit for displaying characters in a chat or the like for carrying out a conversation using character information. A section 35b, a menu button 35c, and a switching button 35d are displayed. The LCD panel 35 is provided with a touch panel, and each function is instructed by pressing the menu button 35c and the switching button 35d.

  On the other hand, the lower body 1b is provided with a microphone 34b and a key operation unit 33. The key operation unit 33 is provided with a cross key 33a for selecting a setting menu, a plurality of digit keys 33b, a call start key 33c, a call end key 33d, a confirmation key 33e, an initial setting key 33f, and the like. The key operation unit 33 is used for scrolling, selecting, inputting characters, and the like of information displayed on the LCD panel 35 in addition to making and receiving calls.

  By pressing the digit key 33b and pressing the call start key 33c, dial connection to the call destination is performed, and the call starts. Various menus are set by pressing the cross key 33a. In addition, the conversation mode is switched to the initial setting by pressing the switching button 35d displayed on the LCD panel 35. Further, by pressing the menu button 35c displayed on the LCD panel 35, a conversation mode other than the initial setting can be selected. Specifically, “only voice call (voice phone mode)”, “only image (TV phone mute mode)”, “only text communication (chat mode)”, “image + voice communication (TV phone mode)” and “ “Image + text communication (TV chat communication mode)” can be selected. “Image only” corresponds to voice erasure (mute) in a videophone. In this way, the conversation mode can be switched by a simple operation.

  FIG. 2 is a block diagram showing a functional configuration inside the TV phone 1 of the present embodiment.

  The video phone 1 includes a control unit 72, a wireless communication unit 73, an internal memory 74, an audio processing unit 75, an image processing unit 76, and a character processing unit 77 therein. The antenna 17 is connected to the wireless communication unit 73. A speaker 37 and a microphone 34b are connected to the sound processing unit 75. An image display unit 35 a and a camera 38 are connected to the image processing unit 76. A character display unit 35 b and a key operation unit 33 are connected to the character processing unit 77. The control unit 72 is connected with a menu button 35c and a switching button 35d.

  The control unit 72 includes a known CPU, ROM, RAM, and the like connected via a bus, and the CPU executes various control programs stored in the ROM to perform predetermined processing. Thereby, the control unit 72 controls the internal memory 74, the wireless communication unit 73, the sound processing unit 75, the image processing unit 76, and the character processing unit 77, and transmits and receives data between these units. The control unit 72 realizes functions of a conversation mode control unit, a notification unit at the time of calling, a permission unit, a notification unit at the time of incoming call, a notification unit at the time of communication, an initial setting unit, an initial setting switching unit, and a voice recognition unit. .

  The internal memory 74 stores control programs and data executed by the control unit 72. Further, the internal memory 74 has a function of storage means, such as telephone directory information of each destination, content data such as images downloaded from an information providing site, music, programs, voice data recorded by an answering machine, and the like. Remembered. The wireless communication unit 73 performs wireless communication with the wireless access point via the antenna 17.

  The audio processing unit 75 encodes the audio signal input from the microphone 34 b and sends it to the control unit 72, and decodes the audio signal received by the wireless communication unit 73 and outputs it from the speaker 37. The image processing unit 76 processes the image data received by the wireless communication unit 73 and the image data stored in the internal memory 74 and outputs the processed image data to the image display unit 35a. The image processing unit 76 is photographed by the camera 38 and transmitted to the outside. The image data is processed and output to the control unit 72. The character processing unit 77 outputs the character data received by the wireless communication unit 73 to the character display unit 35 b and also outputs the character data input via the key operation unit 33 and transmitted to the outside to the control unit 72.

[Communication control]
The operation of the TV phone 1 having the above configuration will be described. FIG. 3 is a sequence diagram showing a communication control procedure when switching from the TV phone mode to the TV chat communication mode. Here, in the TV phone mode, moving images and audio data are transmitted and received. On the other hand, in the TV chat communication mode, moving images and character data are transmitted / received.

  In the voice telephone mode, only voice data is transmitted / received, in the videophone mute mode, only images are transmitted / received, and in the chat mode, only character data is transmitted / received.

  First, the TV phone screen is displayed (T0), and when the caller requests the callee to make a call in the TV phone mode (T1), a TV phone notification is displayed on the receiver's TV phone (T2). When the callee agrees and notifies the caller of the TV phone permission (T3), a conversation in the TV phone mode is performed between both parties (T4).

  Thereafter, when it is desired to change the conversation mode due to a change in the situation or the like, the caller performs a chat switching operation (T5), and notifies the callee of a request to switch the conversation mode to the TV chat communication mode (T6). When the callee agrees and switches to the chat screen (T7) and notifies the caller of the TV chat communication permission (T8), the caller's TV phone is switched to the chat screen (T9). A conversation in the TV chat communication mode is performed between both parties (T10).

  In the TV chat communication mode, a DTMF (Dial Tone Multi Frequency) signal is used as means for converting character information into voice information. When the caller transmits a DTMF signal (T11), the character information corresponding to the received DTMF signal is displayed on the screen of the receiver's videophone (T12). Similarly, when the callee transmits a DTMF signal (T13), character information corresponding to the received DTMF signal is displayed on the screen of the caller's videophone (T14). Instead of making a switching request from the caller, a switching request may be made from the callee.

  In addition, when both the caller and the receiver obtain voice information by using the DTMF signal, when one side makes a voice call, the other side obtains the character information by converting the received voice information into characters by the voice recognition function. You may do it. Conversely, voice information may be generated and reproduced from the DTMF signal or character information received by the voice caller side using a voice synthesis function. This makes it possible to make a call in the TV phone mode on one side and in the TV chat communication mode on the other side.

  In this way, it is possible to select a conversation mode suitable for oneself, and it is possible to continue the conversation without interrupting communication. As a result, for example, when a hearing impaired person gets lost, he / she can send the scenery around him / her to the other party through TV chat communication and receive advice on text information in real time.

[Initial setting]
FIG. 4 is a flowchart showing an initial setting process procedure of the TV phone 1. This processing program is stored in the internal memory 74, and is executed by the CPU in the control unit 72 when the initial setting key 33f is pressed. First, an initial setting screen is displayed (step S1). A list of conversation modes is displayed on the LCD panel 35. Specifically, “voice call only”, “image only”, “text communication only”, “image + voice communication”, and “image + text communication” are displayed as conversation modes.

  It waits for one mode to be selected from the list of conversation modes (step S2). When one mode is selected, the selected mode is determined (steps S3 to S7). If the selected mode is “voice communication only”, “voice communication only” is initially set to the conversation mode (step S8). Similarly, if any of “image only”, “text communication only”, “image + voice communication”, and “image + text communication”, it is initialized to the conversation mode. Then, this process is complete | finished.

  Thus, by initially setting the conversation mode that is frequently used first, it is possible to save the trouble of pressing the button a plurality of times when switching to voice communication or chat communication.

  A communication mode (conversation mode) corresponding to each destination is registered in a telephone directory which is a communication destination database provided in the TV phone, and when a destination is designated, the corresponding communication mode is automatically initialized. It may be set. Thereby, the conversation mode for each destination can be easily set.

[Conversation mode for outgoing calls]
FIG. 5 is a flowchart showing a conversation mode switching process procedure at the time of outgoing. This processing program is stored in the internal memory 74, and is executed by the CPU in the control unit 72 when the call start key 33c is pressed.

  First, it is determined whether or not to make a call using a TV phone (step S11). When using the TV phone, it is determined whether or not the conversation is made in the TV phone mode by pressing the switching button 35d (step S12). When talking in the TV phone mode, the TV phone mode is notified to the communication partner (step S13). And it is discriminate | determined whether there was consent (permission) of TV telephone mode from the other party (step S14). Consent from the communication partner is confirmed by, for example, pressing the confirmation key 33e within a predetermined time and transmitting the signal within the predetermined time on the incoming TV phone. This also applies to the same processing thereafter. If there is an agreement in the TV phone mode, the screen is switched to the TV phone screen and a conversation is carried out by the TV phone (step S15). Then, this process is complete | finished.

  On the other hand, if no conversation is made in the TV phone mode in step S12, it is determined whether or not communication is made in the TV chat communication mode (step S16). When communicating in the TV chat communication mode, the communication partner is notified of the TV chat communication mode (step S17). And it is discriminate | determined whether there was consent of TV chat communication mode from the other party (step S18). If there is an agreement in the TV chat communication mode, the screen is switched to the chat screen and a conversation is performed by TV chat communication (step S19). Then, this process is complete | finished.

  If communication is not performed in the TV chat communication mode in step S16, it is determined whether or not a voice conversation is performed (step S20). If the voice conversation is not performed, the process is terminated. On the other hand, when talking by voice in step S20, talking by voice (step S21). Then, this process is complete | finished. If a videophone is not used in step S11, a conversation is performed by voice call in step S21. Then, this process is complete | finished. As a result, it is possible to select a conversation mode suitable for the user without disconnecting the communication at the time of outgoing call.

  FIG. 6 is a flowchart showing a processing procedure when talking on the TV phone in step S15 of FIG. First, it is determined whether or not the caller has selected to convert the content of the conversation from voice to text information (step S31). This selection is performed by, for example, pressing the switching button 35d to switch the conversation mode to the initial setting, or pressing the menu button 35c to switch to the conversation mode other than the initial setting. The conversion of voice to character information is used, for example, when the communication destination wants to display on the screen as character information.

  If the user selects to convert to character information, the voice is converted to character information (step S32), and the converted character information and image are transmitted and displayed on the screen of the receiver's TV phone (step S33). Thereafter, it is determined whether or not an end operation has been performed by pressing the call end key 33d (step S34). When the end operation is performed, the process is terminated as it is, and the process returns to the main process. On the other hand, when the end operation is not performed, the process returns to step S31.

  In addition, when the selection of converting the content of the conversation from voice to character information is not performed in step S31, the conversation is performed in the normal TV phone mode (step S35). Thereafter, the process proceeds to step S34.

  As a result, when the caller changes the content of the conversation with the callee from voice to text display in response to a change in the situation during a videophone call, “image” + “text” is displayed on the screen of the callee's videophone. "Can be displayed. Therefore, even if each other's environment (noisy place, quiet place, etc.) is different, the conversation can be continued in the favorite mode. For example, on the caller side, “image” + “text” information is transmitted and voice is received. On the other hand, on the incoming side, “image” + “text” information is received and voice is transmitted. Is done.

[Select conversation mode for incoming calls]
FIG. 7 is a flowchart showing a conversation mode switching process procedure at the time of an incoming call. This processing program is stored in the internal memory 74 and is executed when an incoming call is received by the CPU in the control unit 72.

  First, it is determined whether the incoming call is an incoming videophone call or an incoming voice call (step S41). If the incoming call is a voice call, the voice call is used for conversation (step S52). Then, this process is complete | finished.

  On the other hand, if it is an incoming videophone call, it is determined whether or not the incoming videophone call is received (step S42). For example, when receiving an incoming videophone call by pressing the confirmation key 33e, it is determined whether or not to talk in the videophone mode (step S43). At this time, for example, a message “TV phone mode?” Is displayed on the LCD panel 35. When a conversation is made in the TV phone mode, that is, when the called party requests a conversation in the TV phone mode and the caller responds to the conversation, the screen is switched to the TV phone screen and the video phone conversation is performed (step S44). The request for conversation in the TV phone mode is made, for example, by pressing the confirmation key 33e. Then, this process is complete | finished.

  Further, when no conversation is made in the TV phone mode in step S43, that is, when the called party does not request a conversation in the TV phone mode, or when the called party requests a conversation in the TV phone mode, the caller does not respond to it. Then, it is determined whether or not to communicate in the TV chat communication mode (step S45). At this time, for example, a message “TV chat communication mode?” Is displayed on the LCD panel 35. When communicating in the TV chat communication mode, that is, when the called party requests the TV chat communication mode, the caller who is the communication partner is notified of the transition to the TV chat communication (step S46). A request for a conversation in the TV chat communication mode is made, for example, by pressing the confirmation key 33e.

  Thereafter, it is determined whether or not the caller as the communication partner has agreed to shift to the TV chat communication (step S47). If there is an agreement to shift to the TV chat communication, the screen is switched to the TV chat screen and a conversation is performed in the TV chat communication mode (step S48). Then, this process is complete | finished.

  On the other hand, if there is no consent to the transition to the TV chat communication in step S47, if the callee does not desire the TV chat communication mode in step S45, or if the incoming call is not received in step S42, the voice conversation is performed. Whether or not (step S49). At this time, for example, a message “voice call mode?” Is displayed on the LCD panel 35. When a conversation is made by voice by pressing the confirmation key 33e, the voice call is carried out at step S52.

  If no voice conversation is made in step S49, it is determined whether or not the voice mail is recorded (step S50). At this time, for example, a message “answering phone mode?” Is displayed on the LCD panel 35. When recording is performed by pressing the confirmation key 33e, recording is performed with an answering machine (step S51). Then, this process is complete | finished. On the other hand, if the confirmation key 33e is not pressed and recording is not performed, this processing is terminated as it is. Thereby, even if it does not cut | disconnect communication, the called party can select the conversation mode suitable for oneself.

[Change conversation mode during communication]
8, FIG. 9 and FIG. 10 are flowcharts showing the conversation mode switching processing procedure during communication. This processing program is stored in the internal memory 74 and is executed every time the conversation mode is switched during the conversation mode by the CPU in the control unit 72 of the videophone 1 on the transmission side.

  First, it is determined whether the conversation mode in which conversation is currently being performed is voice communication, TV telephone, or TV chat communication (steps S61, S62, and S63). If the conversation is currently being performed by voice communication, it is determined whether the caller wants to shift to TV phone, TV chat communication, or can be left as it is by operating the menu 35c or the switching button 35d (step S64). , S65).

  When it is desired to shift to the video phone, the caller who is the communication partner is notified of the shift to the video phone (step S66). And it is discriminate | determined whether there was consent of the video telephone from the called party who is a communicating party (step S67). If there is an agreement of the video phone, the process shifts to the video phone (step S68), and a conversation is performed with the video phone (step S69). Then, this process is complete | finished.

  On the other hand, when the caller wants to shift to TV chat communication in step S65, the caller who is the communication partner is notified of the shift to TV chat communication (step S70). And it is discriminate | determined whether there was consent of TV chat communication from the called party who is a communicating party (step S71). If there is consent for the TV chat communication, the process shifts to the TV chat communication (step S72), and a conversation is performed by the TV chat communication (step S73). Then, this process is complete | finished. On the other hand, if there is no consent of the TV phone and TV chat communication from the called party in step S67 or S71, the voice communication is continued (step S74), and this process is terminated. If the process does not shift to the TV chat communication in step S65, the current conversation mode is continued (step S75), and this process ends.

  In step S62, if the user is currently talking on the TV phone, it is determined whether the caller wants to shift to voice communication or TV chat communication by operating the menu 35c or the switching button 35d (step S62). S76).

  When it is desired to change to voice communication, the caller who is the communication partner is notified of the shift to voice communication (step S77). And it is discriminate | determined whether there was consent of voice communication from the called party who is a communicating party (step S78). If there is an agreement for voice communication, the process shifts to voice communication (step S79), and a conversation is performed by voice communication (step S80). Then, this process is complete | finished.

  On the other hand, when the caller wants to shift to TV chat communication in step S76, the caller who is the communication partner is notified of the shift to TV chat communication (step S81). And it is discriminate | determined whether there was consent of TV chat communication from the called party who is a communicating party (step S82). If there is consent for the TV chat communication, the process shifts to the TV chat communication (step S83), and a conversation is performed by the TV chat communication (step S84). Then, this process is complete | finished. On the other hand, if there is no consent for voice communication and TV chat communication from the called party in step S78 or S82, the TV phone is continued (step S85), and this process is terminated.

  Further, in step S63, when the conversation is currently being performed through the TV chat communication, it is determined by the operation of the menu 35c or the switch button 35d whether the caller wants to shift to voice communication or shift to the TV phone (step S63). S86).

  When it is desired to shift to voice communication, the caller who is the communication partner is notified of the shift to voice communication (step S87). And it is discriminate | determined whether there was consent of voice communication from the called party who is a communicating party (step S88). If there is an agreement for voice communication, the process shifts to voice communication (step S89), and a conversation is performed by voice communication (step S90). Then, this process is complete | finished.

  On the other hand, when the caller wants to shift to the videophone in step S86, the caller who is the communication partner is notified of the shift to the videophone (step S91). And it is discriminate | determined whether there was consent of the video telephone from the called party who is a communicating party (step S92). If there is a consent for the videophone, the videophone is transferred (step S93) and the videophone is used for conversation (step S94). Then, this process is complete | finished. On the other hand, if there is no voice communication or videophone consent from the called party in step S88 or S92, TV chat communication is continued (step S95), and this process is terminated. If it is determined in step S63 that the conversation is not currently being performed in the TV chat communication, the current conversation mode is continued (step S96), and the process ends. Thereby, when it is desired to change the conversation mode during the conversation due to a change in the situation, the conversation can be switched at any time without interruption.

  As described above, according to the TV phone of the present embodiment, TV phone (including both voice communication and audio mute) and TV chat communication are possible, and TV phone and TV chat can be performed without disconnecting communication. Communication can be arbitrarily switched. Therefore, even in a situation where voice cannot be used, by performing character communication during image transmission, it is possible to switch to the chat function while displaying an image without disconnecting the communication.

  For example, even in situations where voice cannot be used, such as during a meeting or a hearing-impaired person, text information communication for chat is added to image transmission, and communication using character information is performed together with image transmission of moving images for videophones. Thus, sufficient communication with the called party can be achieved. Further, since the conversation mode can be switched without disconnecting the communication, it is possible to switch between the TV chat communication and the TV phone in accordance with a change in the situation.

  Further, since the operation buttons are arranged on the display screen of the LCD panel in an easy-to-understand manner, the operability can be improved and the conversation mode can be easily switched without interrupting the conversation. Furthermore, even if the situation is different from each other, the range of conversation is expanded by voice recognition and character recognition, so that the caller and the callee can talk without worrying about the communication partner.

  In addition, this invention is not restricted to the structure of the said embodiment, A various deformation | transformation implementation is possible. For example, the caller recognizes the voice from the callee and converts the text, and performs text communication to the caller's chat screen, or the caller converts the text transmission to the caller to voice. It is good also as a structure to carry out. As a result, various forms of conversation can be realized such that one is a TV phone and the other is a TV chat communication, and voice information and text information can be transmitted according to changes in each situation. In the above embodiment, a portable TV phone is exemplified, but the present invention may be applied to a fixed TV phone.

  The present invention has an effect that it is possible to communicate with a communication partner almost in real time by text information even in a situation where voice cannot be used, and an image transmitted from the communication destination is displayed on the screen. However, it is useful for a telephone device and a telephone method for communicating with a communication destination in a predetermined conversation mode.

The top view which shows the external appearance structure of the TV telephone in embodiment of this invention The block diagram which shows the functional structure inside the video telephone of this embodiment The sequence diagram which shows the communication control procedure at the time of switching from the TV telephone mode in this embodiment to TV chat communication mode The flowchart which shows the initial setting processing procedure of the TV telephone in this embodiment The flowchart which shows the conversation mode switching processing procedure at the time of transmission in this embodiment The flowchart which shows the process sequence at the time of having a conversation by a TV phone in this embodiment. The flowchart which shows the conversation mode switching processing procedure at the time of the incoming call in this embodiment The flowchart which shows the conversation mode switching processing procedure in communication in this embodiment The flowchart which shows the conversation mode switching processing procedure in communication in this embodiment The flowchart which shows the conversation mode switching processing procedure in communication in this embodiment Block diagram showing a schematic configuration of a conventional TV phone

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 TV telephone 35 LCD panel 35a Image display part 35b Character display part 35c Menu button 35d Switching button 38 Camera 72 Control part 73 Wireless communication part 74 Internal memory 75 Voice processing part 76 Image processing part 77 Character processing part

Claims (12)

A telephone device having a communication means capable of communicating with a communication destination in a plurality of conversation modes,
Image display means for displaying an image transmitted from the communication destination on a screen of a display unit;
Character display means for displaying character information communicated with the communication destination on the screen of the display unit;
Conversation mode control means for switching the conversation mode to a TV phone mode for transmitting / receiving images and voices or a TV chat communication mode for transmitting / receiving images and text information without disconnecting communication with the communication destination; A telephone device comprising: The telephone device according to claim 1,
A calling time notification means for notifying the communication destination of the TV phone mode as the conversation mode when calling,
When the notified TV phone mode is permitted by the communication destination, the conversation mode control means sets the conversation mode to the TV phone mode. The telephone device according to claim 2,
When the notified TV phone mode is not permitted by the communication destination, the conversation mode control means switches the conversation mode to a voice telephone mode for transmitting and receiving only voice. The telephone device according to claim 1,
Comprising permission means for permitting the TV phone mode notified from the communication destination when receiving an incoming call;
When permitting the notified TV phone mode, the conversation mode control means sets the conversation mode to the TV phone mode. The telephone device according to claim 4, wherein
An incoming call notification means for notifying the communication destination of the transition to the TV chat communication mode when not permitting the notified TV phone mode;
When transition to the TV chat communication mode is permitted, the conversation mode control means switches to the TV chat communication mode. The telephone device according to claim 1,
During communication with a communication destination in a predetermined conversation mode, the communication time notification means for notifying the communication destination of the change of the conversation mode,
When the change of the notified conversation mode is permitted, the conversation mode control means changes to the notified conversation mode. The telephone device according to claim 1,
Initial setting means for initial setting of the conversation mode;
An initial setting switching means for switching the conversation mode to the initial setting according to a predetermined operation;
The communication means is a telephone device that communicates with a communication destination in the switched initial conversation mode. The telephone device according to claim 7, wherein
Storage means for storing telephone directory information in which a conversation mode is registered for each destination of the communication destination;
When the communication destination is designated, the conversation mode control means selects a conversation mode corresponding to the destination from the telephone directory information. The telephone device according to claim 1,
Voice recognition means for converting voice transmitted from the communication destination into character information;
The character display means is a telephone device that displays the converted character information. A telephone system capable of communication between both telephone devices in a plurality of conversation modes,
The conversation mode when communicating with the telephone device includes at least a TV phone mode for transmitting and receiving images and sounds, and a TV chat communication mode for transmitting and receiving image and text information,
The telephone device on the calling side
Change notification means for notifying the communication destination of the change of the conversation mode;
First conversation mode control means for switching to the conversation mode in which the change is permitted without disconnecting communication with the communication destination when the notified telephone mode change is permitted by the telephone device on the receiving side; With
The telephone device on the receiving side
Permission means for permitting change of the notified conversation mode;
Permission notifying means for notifying the communication destination of permission to change the permitted conversation mode;
A telephone system comprising: second conversation mode control means for switching to the conversation mode in which the change is permitted. A telephone method in a telephone device having a communication means capable of communicating with a communication destination in a plurality of conversation modes,
During communication in a predetermined conversation mode, without disconnecting communication with the communication destination, the conversation mode is displayed between the communication destination while displaying at least an image transmitted from the communication destination on the screen of the display unit. A TV phone mode for performing a voice call on the TV, or a TV for displaying character information transmitted / received to / from the communication destination while displaying an image transmitted from the communication destination on the screen of the display portion. A telephone method having a conversation mode control step for switching to a chat communication mode.   A program having a program code for causing a function of each means in the telephone device according to any one of claims 1 to 9 to be realized by a computer.

Images