JP2006303902A - Communication terminal having tv telephone function of switching communication line in response to variation in animation - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a communication terminal having a TV telephone function of reducing power consumption. <P>SOLUTION: A portable terminal A includes: a main control part 1; a communication part 3; a power source management part 27; and a power source battery (battery) 31. The main control part 1 includes: a reception animation decoding part 1a; a reception sound decoding part 1b; a transmission animation encoding part 1c; a transmission sound encoding part 1d; and software (program) 1e for a TV/sound telephone. The communication part 3 is connected to the main control part, including: an interface part 3a for a sound telephone line; and an interface part 3b for a TV telephone sound line. The software (program) 1e for the TV/sound telephone functions as a line switching control part for controlling the switching of the lines. The line switching control part functions for controlling the switching between the TV telephone line and the sound telephone line in response to the variation in the movement of the animation. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a communication terminal with a videophone function.

  In recent years, the functions of communication terminals including mobile terminals have been further enhanced, and the number of terminals having functions of videophones (hereinafter referred to as videophones) in addition to voice calls has been increasing. Voice telephones generally have a larger data transmission capacity and higher power consumption than videophones. In some cases, the price of the TV phone is set higher as a fee structure. As described above, since general voice calls and data communications and videophones have different characteristics, various proposals have been made accordingly.

  For example, by providing a means for switching between image communication and voice call, there is described a technique for switching to the image communication side when transmitting an image and switching to the voice call side when making a call when the line condition is poor. (See Patent Document 1).

  In addition, a technique is described in which the remaining battery level is monitored by a remaining battery level monitoring unit, and a function restriction is provided in a mobile communication terminal with a telephone function that uses a battery as a power source, such as a mobile videophone (Patent Document 2). reference).

Japanese Patent Laid-Open No. 10-79823 Japanese Patent Laid-Open No. 11-18457

  The power consumption when using a TV phone is larger than when using a voice phone, and there is a problem that the electricity charge increases in a communication terminal with an AC-driven videophone function. In the communication terminal with a battery-powered videophone function, the battery drive time of the communication terminal There is a problem that becomes shorter.

  An object of the present invention is to reduce power consumption in a communication terminal having a TV phone function. Another object is to reduce the communication fee system.

  In the existing videophone function, the data size of the moving image transmitted to the communication line is reduced by calculating the amount of change (difference) in the movement of the previous and subsequent frames in the moving image. By using this communication method, in a communication terminal with a videophone function, while using a videophone, the change amount (difference) of the motion of the video transmitted from the own terminal and the change amount (difference) of the motion of the video received from the partner terminal When both are smaller than a predetermined value, it is determined that there is no motion, and when this state continues for a predetermined time, the line or bearer is switched. Such switching is, for example, automatically switching from a videophone line to a voice telephone line. At this time, power consumption can be reduced by stopping the video transmission processing of the communication unit, lowering the frame rate of the camera, lowering the luminance of the backlight of the liquid crystal display unit, etc. By switching to the line, the communication charge can be reduced. Further, when the amount of change (difference) in the motion of the moving image transmitted from the terminal becomes larger than a predetermined value, the moving image is determined to be moving, and for example, control is performed to automatically switch the voice telephone line to the video phone line.

  As described above, according to the communication terminal of the present invention, the communication line can be switched in accordance with the line usage status and the communication terminal usage status. Thereby, for example, power consumption when using a videophone can be reduced. It is also possible to reduce the communication fee system.

  Hereinafter, a communication terminal according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating a configuration example of a communication terminal according to the first embodiment of the present invention. As shown in FIG. 1, the mobile terminal A according to the present embodiment includes a main control unit 1, a communication unit 3, a power management unit 27, and a power battery (battery) 31. The main control unit 1 includes a received video decoding unit 1a, a received audio decoding unit 1b, a transmission video encoding unit 1c, a transmission audio encoding unit 1d, and software (program) 1e for TV / voice telephone. ROM for storing. The communication unit 3 includes an interface unit 3a for a voice telephone line and an interface unit 3b for a videophone voice line, and is connected to a corresponding configuration of the main control unit.

  Furthermore, the communication terminal A according to the present embodiment includes a storage unit 7, an audio control unit 5, an external audio output unit 33 (earphone microphone, etc.), a speaker unit 35 (for speakerphone), and a receiver unit 37. The audio control unit 5 to be connected, the LCD display unit 41, and a display driver 11 for driving the LCD display unit 41 are provided. Furthermore, the camera unit 15, the microphone unit 17, the timer (counter) 21, the operation unit 23, the camera lens cover state detection unit 25, and the camera lens cover 43 may be included. The TV / voice telephone software (program) 1e functions as a line switching control unit that performs line switching control described below. In short, the line switching control unit functions as a line switching control unit that performs switching control between a videophone line and a voice telephone line.

  For example, when the communication speed is different between the first line and the second line to be switched, the communication charge may be different. Also, these lines have different line types, for example, the first line includes a videophone, and the second line includes a voice call. The predetermined condition for the line switching to occur is when the change amount of the moving image is smaller or larger than a certain value. The moving image change amount includes the received moving image or the transmission moving image. The predetermined condition includes a camera state, a power supply state, and the like.

  The application to be activated changes according to the switching of communication based on these conditions. For example, a change from a videophone application to a voice telephone application occurs. At this time, an image to be displayed can be appropriately selected. For example, it is possible to display the final frame image of a moving image or display an image stored in advance in a memory. In addition, a change from the voice phone application to the video phone application is also performed. This is the case when videophone conditions are preferred.

  Hereinafter, the line or bearer control will be described in more detail.

  2 to 13 are flowcharts showing an operation flow (mainly an operation flow of the main control unit 1) of the communication terminal according to the embodiment of the present invention. In the case where the same processing is performed in different drawings, the same step symbols are attached and the description thereof is omitted. FIGS. 2 to 7 are flowcharts showing line switching processing during use of the videophone software. As shown in FIG. 2, first, the processing is started (START), and in step S1, the videophone software 1e is activated and a connection destination is selected, thereby connecting through a videophone line. Next, when the dialing to be connected through the videophone line is started and the connection is established, the camera is activated and communication (transmission / reception) is started via the communication unit 3 (transmission / reception of moving images and audio). Next, in step S2, it is determined whether a moving image is being transmitted / received. If transmission / reception is being performed, go to 1).

  FIGS. 3 to 6 are flowcharts showing conditions for switching between lines or bearers. From 1) in FIG. 2, it is determined in step S8 whether or not the amount of change in the transmitted moving image is smaller than a certain value. If the amount of change in the transmitted moving image is smaller than a certain value (Yes), the process proceeds to step S10 and the timer 21 starts counting. Next, in step S11, it is determined whether or not the amount of change in the transmitted moving image is smaller than a certain value. If the amount of change in the transmitted moving image is smaller than a certain value (Yes), the process proceeds to step S13, where it is determined whether the timer value is larger than a certain value. If the timer value is greater than a certain value (YES), the timer value is initialized and the process proceeds to 2) in FIG. If the duration is less than or equal to a certain value (NO), the process returns to step S11. If it is determined in step S8 that the amount of change in the transmitted moving image is greater than or equal to a certain value (No), the process proceeds to 3) in FIG. If it is determined in step S11 that the amount of change in the transmitted moving image is greater than or equal to a certain value (No), the process proceeds to step S10-1, the timer value is initialized, and the process proceeds to 3 of FIG.

  As shown in FIG. 4, in 3) to step S9, it is determined whether or not the amount of change in the received moving image is smaller than a certain value. When the amount of change in the received moving image is smaller than a certain value (Yes), the process proceeds to step S10 and the timer 21 starts counting. Next, in step S12, it is determined whether or not the amount of change in the received moving image is smaller than a certain value. If the amount of change in the received moving image is smaller than a certain value (Yes), the process proceeds to step S13 to determine whether or not the timer value is larger than a certain value. If the timer value is larger than a certain value (YES), the timer value is initialized in step S10-2, and the process proceeds to 2) in FIG. If the timer value is greater than or equal to a certain value (NO), the process returns to step S11. If it is determined in step S9 that the amount of change in the received moving image is greater than or equal to a certain value (No), the process proceeds to 4) in FIG. If it is determined in step S12 that the amount of change in the received moving image is greater than or equal to a certain value (No), the process proceeds to step S10-1, the timer value is initialized, and the process proceeds to 4) in FIG.

  As shown in FIG. 5, in 4) to step S38, it is determined whether or not the camera 15 is usable. If the camera 15 is usable, the process proceeds to 5) in FIG. If the camera 15 cannot be used, the process proceeds to 2) in FIG. As shown in FIG. 6, the process proceeds from step 5) to step S58 to determine whether the communication terminal is battery-driven or AC-driven. If it is AC driving, the process proceeds to 6) in FIG. If the battery is driven, it is determined whether or not the remaining battery level is smaller than a certain value. If it is smaller (YES), go to 2) in FIG. When the remaining battery level is greater than or equal to a certain value (NO), the process proceeds to 6) in FIG.

  As shown in FIG. 7, from 2), the process proceeds to step S14 to determine whether the communication line switching setting is automatic or manual. If it is manual, the process proceeds to step S15, and if it is automatic, the process proceeds to step S16. In step S15, a display for confirming to the user whether or not the communication line switching is OK is performed. If the user's confirmation cannot be obtained (NO), the process proceeds to step S4. If the transition to FIG. Next, the process proceeds to 6) in FIG. 1, and the processing from step S1 is performed.

  In step S16, it is determined whether the partner image display setting is the final frame or the designated image. If it is the designated image in the storage unit 7, the process proceeds to step S18, the designated image in the storage unit 7 is displayed as the image of the other party, and the process proceeds to step S19. If it is the last frame in step S16, the process proceeds to step S17, where the last frame is stored / displayed as the partner image. In step S19, communication line switching processing is performed (for example, switching from a videophone line to a voice telephone line is performed). Next, the process proceeds to step S20, where the connection of the voice telephone line is established. In step S2, unnecessary functions are stopped and excessive functions are stopped (including partial stop and transition to the power saving mode). For example, processing for reducing power consumption is performed such as lowering the frame rate of the camera, lowering the illuminance of the backlight, or stopping the moving image transmission processing of the communication unit. However, its own camera is kept in an operating state. As described above, when at least one of the conditions shown in FIGS. 3 to 6 is satisfied, line switching is performed in standby or automatic line switching, and the line is used under conditions more advantageous to the user. be able to.

  Next, when the communication line is switched from the videophone line to the voice telephone line in step S19 in FIG. 7 (6), the process proceeds to step S101 in FIG. 8 to use the voice telephone software (voice telephone line). Connected). Even in this state, the camera is in operation, and therefore its own operation is monitored. In step S102, if the camera detects a self-motion that cannot be handled by a voice call over the voice telephone line (YES), it determines whether or not to transmit a moving image. If it is determined that the moving image is to be transmitted (YES), the process proceeds to 11) in FIG.

  As shown in FIG. 9, in condition 5, it is determined in step S108 whether or not the amount of change in the transmitted moving image is greater than or equal to a certain value. When it is determined that the amount of change in the transmission video is greater than or equal to a certain value (YES), the timer 21 starts counting in step S110, and in step S108, it is counted whether or not the amount of change in the transmission video is greater than a certain value. In step S111, it is determined whether or not the timer value is larger than a certain value. The comparison in step S111 is performed until the timer value becomes larger than a certain value. If the timer value becomes larger than the certain value (YES), the process proceeds to step S110-2 to initialize the timer value, and the process proceeds to 12). . If it is determined in step S108 that the amount of change in the transmitted moving image is smaller than a certain value, the process proceeds to 13). If the change amount of the transmitted moving image is smaller than the fixed value in step S111, the process proceeds to step S110-1, the timer value is initialized, and the process proceeds to 13).

  From step 13 in FIG. 10, it is determined in step S109 whether or not the amount of change in the received moving image is greater than or equal to a certain value. If it is greater than or equal to a certain value, the process proceeds to step S110, where the timer 21 starts counting. Next, the process proceeds to step S112, and it is continuously monitored whether or not the amount of change in the received moving image is greater than or equal to a certain value. In step S113, it is determined whether or not the timer value is equal to or greater than a certain value. If the timer value is equal to or greater than the certain value, the timer value is initialized in step S110-2 and the process proceeds to 12) in FIG. If it is determined in step S110 that the amount of change in the received moving image is smaller than a certain value, the process proceeds to 14). If the amount of change in the received moving image is smaller than a certain value in step S112, the timer value is initialized in step S110-1 and the process proceeds to 14).

  From 14) in FIG. 11, it is determined in step S138 whether or not the camera 15 is usable. If it is usable, proceed to 12), and if unusable, proceed to 15). From step 15) in FIG. 12, it is determined in step S158 whether the portable terminal is battery-driven or AC-driven. If the battery is driven, the process proceeds to step S159, and it is determined whether or not the remaining battery level is a certain value or more. If it is above a certain value, go to 12). If it falls below a certain value, the process proceeds to 16) in FIG. 8 and the processing from step S101 is continued.

  FIG. 13 is a diagram showing the flow of processing from 12). As shown in FIG. 13, first, from step 12), it is determined in step S114 whether the communication line switching setting is automatic or manual. If it is manual, the process proceeds to step S115. If automatic, the process proceeds to step S121, and the communication line is switched. In this case, switching from the voice telephone line to the video telephone line is performed. Next, in step S122, a videophone line connection is established. If it is manual in step S114, the process proceeds to step S115, a display prompting the user to confirm whether or not the communication line may be switched is displayed, and if OK (YES), the process proceeds to step 121. If NO here, the process proceeds to 16).

  As explained above, when it is preferable to switch to a videophone while using voice phone software (when movement becomes intense), the line is switched automatically or after obtaining user approval. Do.

  When the application before disconnection is a videophone, the partner image display after switching can be displayed as the last frame of a moving image or an image stored in advance. As a result, it is possible to prevent the camera screen from suddenly disappearing and becoming a noise screen when the line is disconnected.

  By appropriately performing the line switching described above, there is an advantage that it is possible to control unnecessary power consumption and control power consumption and to improve the use efficiency of the line by not occupying the line. .

  Examples of the state in which the camera cannot be used practically include 1) when the lens cover of the camera is closed and in the retracted state, and 2) in the retracted state, such as a rotating lens type, with the camera facing away from the subject. 3) When a removable camera is removed from the communication terminal. It is preferable to provide a detection unit for detecting such a state.

  As described above, in the communication terminal according to the present embodiment, when the camera becomes practically unusable, it is switched to the voice telephone line, and when the camera becomes practically unusable, video output is performed. A switching process that takes into account the state of the camera is performed by providing a means for prompting the user to select whether to stop and continue the videophone with only voice output or to switch to the voice telephone line. There is an advantage that you can.

  As described above, according to the communication terminal according to the present embodiment, for example, since the communication line is switched according to the remaining battery level when the battery is driven, the battery can last longer, and communication can be performed for as long as possible. Can be controlled.

  As audio output destinations, a receiver, a speaker, an external audio output (earphone microphone, etc.) and the like are stored in advance as switchable objects. Note that when switching communication lines, there may be provided means for continuing the audio output destination before switching after switching. More specifically, as an example of continuing the voice output means before switching at the time of switching the communication line, 1) a videophone (speakerphone) to a voicephone (continuous use of the same speakerphone), 2) a videophone (Earphone microphone) to voice call (continue use of the same earphone microphone), 3) Voice call (speaker phone) to videophone (continue use of the same speakerphone), 4) Voice call (earphone microphone) to videophone (same earphone) Continue to use the microphone). As described above, the continuous use of the audio output destination has an advantage that the switching control is unnecessary and the operation can be simplified.

  The line is not limited to the combination of the video telephone line and the voice telephone line. For example, when the number of lines is 3 or more, line switching can be performed by the same method. Further, not only general line switching but also bearer switching / frequency band switching / channel switching in the same line are targeted. That is, during communication with another terminal using the first line, switching to communication using the second line is performed according to a predetermined condition. As an example of the predetermined condition at this time, when the communication speeds of the first line and the second line are different, or when the communication charges of the first line and the second line are different, the first line This is the case when the line type of the second line and the second line are different.

  As described above, according to the communication terminal according to each embodiment of the present invention, there is an advantage that, for example, power consumption when using a videophone can be reduced by appropriately switching a line or the like. In addition, it is possible to control to switch to a more advantageous one in terms of the communication fee system.

  The present invention can be used for a communication terminal having a videophone function.

It is a figure which shows the example of 1 structure of the communication terminal by the 1st Embodiment of this invention. It is a flowchart figure which shows the flow of the 1st operation | movement of the communication terminal by one embodiment of this invention. It is a figure following FIG. It is a figure following FIG. It is a figure following FIG. It is a figure following FIG. It is a figure following FIG. 3 to FIG. It is a flowchart figure which shows the flow of the 2nd operation | movement of the communication terminal by one embodiment of this invention. It is a figure following FIG. It is a figure following FIG. It is a figure following FIG. It is a figure following FIG. It is a figure following FIG. 9 to FIG.

Explanation of symbols

A ... mobile terminal, 1 ... main control unit, 1a ... received video decoding unit 1a, 1b ... received voice decoding unit, 1c ... transmission video coding unit, 1d ... transmission voice coding unit, 1e ... TV / voice phone Software (program), 3 ... communication unit, 3a ... interface unit for voice telephone line, 3b ... interface unit for videophone voice line, 5 ... voice control unit, 7 ... storage unit, 11 ... display driver, 15 DESCRIPTION OF SYMBOLS ... Camera part, 17 ... Microphone part, 21 ... Timer (counter), 23 ... Operation part, 25 ... Camera lens cover state detection part, 27 ... Power supply management part, 31 ... Power supply battery (battery), 33 ... External audio output part 35 ... Speaker unit, 37 ... Receiver unit, 41 ... LCD display unit, 43 ... Camera lens cover.

Claims (14)

A communication terminal with a videophone function including an imaging unit, a display unit, and a voice input / output unit,
A line switching means for switching a plurality of connectable communication lines (including bearers; the same applies hereinafter) according to a predetermined condition;
A motion change amount detecting means for detecting a motion change amount of the video;
Control means for performing line switching control by the line switching means when the amount of change in motion of the moving image detected by the movement change amount detecting means is larger than a first threshold value or smaller than a second threshold value; Communication terminal provided.   The movement change amount detecting means is configured to detect a time when either or both of the amount of data transmitted from the own terminal and the amount of received data from the counterpart terminal exceed the first threshold value determined in each case, or the second The communication terminal according to claim 1, wherein a time point when the threshold value is below the threshold is set as a motion change detection time point. 3. The line switching by the line switching means is executed when at least one of the following variables 1) to 4) satisfies a predetermined condition. The communication terminal described in 1.
1) Change amount of received moving image, 2) Change amount of transmitted moving image, 3) State of imaging unit, 4) State of power supply. A storage means for storing an image related to a video sent from a videophone communication partner when switching from a videophone line to a voice telephone line when the use before the switching is a videophone;
The communication terminal according to claim 1, further comprising: a display control unit that performs control to display the image stored in the storage unit after switching to a voice telephone line.   2. The communication terminal according to claim 1, further comprising display control means for controlling to display a previously stored image in a final frame of a moving image when switching to the voice telephone line.   2. The communication terminal according to claim 1, further comprising display control means for performing control to display in a final frame of the moving image of the other party image after switching to the voice telephone line.   2. When the application before switching is a videophone, the display of the partner image after switching is controlled to display the last frame of a moving image or an image stored in advance on the display unit. The communication terminal described in 1.   An image pickup unit detecting means for detecting the state of the image pickup unit; and when the image pickup unit detecting means detects that the image pickup unit is unusable, the line switch means controls to switch the videophone line to a voice phone line. The communication terminal according to any one of claims 1 to 3, wherein the communication terminal is characterized in that:   Providing means for prompting a user to select whether to stop video output and continue a video call with only voice output or switch to a voice telephone line when the imaging unit detection unit detects that the imaging unit is unusable. The communication terminal according to claim 8, wherein: With a power battery,
A remaining amount detecting means for detecting the remaining amount of the power battery;
The communication terminal according to any one of claims 1 to 9, further comprising: a unit configured to perform line switching by the line switching unit when the remaining amount of the power battery falls below a certain value. .   A timer that counts the time from the time point when the movement change amount detecting unit detects that the moving amount change amount of the moving image is larger than the first threshold value or the time point that the moving amount change amount is detected to be smaller than the second threshold value. 3. The communication terminal according to claim 2, wherein after the timer value exceeds a certain value, line switching is controlled by the line switching means. A line switching method in a communication terminal including an imaging unit, a display unit, and a voice input / output unit,
Monitoring the amount of change in motion of the video;
A line switching method including a step of switching to a line when it is detected that the amount of change in motion of the moving image is greater than a first threshold value or smaller than a second threshold value.   The program for making a computer perform the step of Claim 12. In communication terminals with videophone functions,
Line switching means for switching a communication line between a voice telephone line and a video telephone line;
Data compression means for compressing video data for videophone transmission;
First detection means for detecting a data size before data compression;
First comparison means for comparing the data size before the data compression with a threshold serving as a reference for determining that the amount of change in motion of the moving image is small;
Data decompression means for receiving and expanding data received from a videophone communication partner;
Second detection means for detecting a data size after the data expansion;
Second comparison means for comparing the data size after the data expansion with the threshold;
Time measuring means for measuring the duration from when the data size of both before and after data compression or after decompression falls below the threshold;
A communication terminal comprising: control means for controlling the line switching means to operate when the time measured by the time measuring means exceeds a certain value.

Images