JP4850509B2 - Communication terminal device and image display method in communication terminal device - Google Patents

Description

  The present invention relates to a communication terminal device and an image display method in the communication terminal device.

Conventionally, there is a video conference system as a technique for realizing multipoint communication. In the video conference system, image data sent from a large number of terminals is displayed on one screen, and transmitted to each terminal together with audio data, thereby realizing a video conference connecting multiple points.
In such a video conferencing system, for example, when a meeting is held with four people, the screen is divided into four equal parts by dividing the screen vertically and horizontally, but this makes it difficult to distinguish the speaker, so the speaker is visually identified. In order to make it easy to understand, techniques such as Patent Document 1 and Patent Document 2 have been devised. The technique described in Patent Document 1 is such that the display area of an area (screen) for displaying a speaker is larger than the area (screen) for displaying other conference participants. The screen brightness of the speaker is made brighter than the screen brightness of other conference participants.

As described above, in the video conference system, the screen is divided into rectangles according to the number of conference participants. However, depending on the number of conference participants, it may be difficult to divide the screen. There is a problem that a portion that is not used on the screen is generated, and the screen cannot be effectively used.
Also, if you make the speaker's screen larger than the screens of other conference participants, if you try to keep the other conference participants' screens uncovered by the speaker's screen, However, it is difficult to appropriately arrange the screens having different sizes. Furthermore, when the speaker changes, the size relationship of each screen will be updated. If each screen is a rectangle, the size of each screen will be changed continuously, and the size of each screen will change. Proper relocation is not only difficult, but also visually cumbersome.

  The present applicant has applied for Patent Documents 3 to 8 as techniques for solving the above-described problems. In these techniques, the face part of the conference participant is cut into an oval shape to form a screen, and each screen is displayed on one screen. Then, by changing the display area of each screen in accordance with the volume of sound produced by each conference participant, the speaker is displayed in a large size, and images of other conference participants are preferably arranged. I am doing so.

On the other hand, mobile terminal devices such as mobile phones are becoming more and more multifunctional, and in recent years, functions such as the above-described video conference system that allow a plurality of people to talk while looking at their faces are being developed. In mobile terminal devices, both the screen and the operation unit are miniaturized, so the size and arrangement of each screen are automatically controlled without manual operation, compared to a system with other screens and operation units. The importance of doing is high.
JP-A-6-141310 JP-A-6-141131 Japanese Patent Application No. 2005-344296 Japanese Patent Application No. 2005-344752 Japanese Patent Application No. 2005-344753 Japanese Patent Application No. 2005-344754 Japanese Patent Application No. 2005-344755 Japanese Patent Application No. 2005-344756

  By the way, the speaker is not necessarily one person. For example, in the case of a meeting that announces a plan or research result, the presenter is the main speaker, and the other conference participants are mainly listeners. is there. In such a case, according to the above-described conventional example, every time the listener hits the screen, the size of the screen is changed or the screen of the presenter and the listener flickers because the speaker is changed. This is undesirable because the user's concentration on the conference is hindered.

Furthermore, in the above conventional example, when brightness control is performed regardless of the size of the screen, the current consumption greatly increases on a large screen, which adversely affects the battery life of the battery-powered communication terminal device, for example, enabling a call There is a risk of causing inconveniences such as shortening the time.
That is, the prior arts such as Patent Documents 1 and 2 have been considered on the premise of a video conference system that is fixedly installed and used, and do not consider current consumption when performing luminance control. In a battery-driven communication terminal device, it is necessary to consider the influence on the battery holding time (such as a callable time), for example, by suppressing the current consumption in the display device to a certain value or less.

  The present invention has been made in view of the above-described circumstances, and displays images of each communication partner so as not to disturb the user's concentration when displaying the image of each communication partner so that the speaker can be easily identified. With the goal.

  In order to solve the above-described problem, in the present invention, as a first means related to a communication terminal device, images and sounds of a plurality of communication partners are received, the images are displayed on a display means, and the sound is pronounced. In the communication terminal device, upper limit setting means for setting an upper limit value of luminance of each area based on a size of an area occupied by each image in the display means, and a range of each area within a range not exceeding the upper limit value The thing provided with the brightness | luminance control means which controls a brightness | luminance was employ | adopted.

  Further, as a second means related to the communication terminal device, in the first means, the brightness control means determines the brightness of the area occupied by the image received together with the sound based on the volume of the sound. The one to control is adopted.

  As a third means related to the communication terminal device, in the first or second means, the upper limit setting means sets an upper limit value of luminance within a range not exceeding a current consumption allowed for the display means, and the luminance For the control of the luminance of the area, a control means that takes into account the size of the area is adopted.

  As a fourth means related to the communication terminal device, in any one of the first to third means, the size of the area occupied by the image received together with the sound is changed based on the size of the sound. A device further equipped with display area control means was adopted.

  As a fifth means related to the communication terminal device, in any one of the first to fourth means, each pixel of the display means is constituted by a self-luminous element.

  Furthermore, in the present invention, as a first means related to an image display method in a communication terminal device, a communication terminal that receives images and sounds of a plurality of communication partners, displays each image on a display means, and produces the sound. An image display method in the apparatus, wherein an upper limit value of luminance of each region is set based on a size of a region occupied by each image in the display unit, and the upper limit value of each region is not exceeded. A method of controlling the brightness was adopted.

  Further, as a second means related to the image display method in the communication terminal device, in the first means, the luminance of the area occupied by the image received together with the sound is controlled based on the volume of the sound. The method was adopted.

  As a third means related to the image display method in the communication terminal device, in the first or second means, an upper limit value of luminance is set within a range not exceeding the current consumption allowed for the display means, and the luminance of the area In the control of the above, a method in which the size of the region is taken into consideration was adopted.

  As a fourth means related to the image display method in the communication terminal device, in any one of the first to third means, the size of the region occupied by the image received together with the sound based on the sound volume. The method of changing the length was adopted.

Furthermore, in the present invention, as a sixth means related to the communication terminal device, in a communication terminal device that receives images and sounds of a plurality of communication partners and reproduces the images together with the sound, the communication terminal device is based on the volume of the sound. The start and end of the communication partner's speech is detected, and the brightness at the time of reproducing the image is set based on the volume of the sound received together with the image, and when the speech ends, the brightness is set. Attenuation is performed according to the duration of the speech, and when the speech is finished, the brightness is increased as the duration of the speech is longer, and the brightness is decreased as the duration of the speech is shorter . .

  According to the present invention, when displaying images of a plurality of people on one screen and reproducing them together with sound, it is possible to control the brightness of a specific area extracted from each image. It is easy to identify the speaker by making it relatively high, and when making the brightness high, by making sure that it does not exceed the upper limit set based on the size of the area, it is displayed large enough It is possible to prevent waste of electric power caused by brightening a region that has received a lot of attention.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings and mathematical expressions. 1 and 2 are diagrams showing a configuration example of a main part of a mobile phone which is an embodiment of a communication terminal device according to the present invention. FIG. 1 is a block diagram showing an encoding device, and FIG. It is a block diagram which shows a decoding apparatus.
The mobile phone has an encoding device 10 as a transmission source and a decoding device 20 as a reception side, and is configured to be capable of multipoint communication.

  The encoding apparatus 10 includes an audio input unit 101, an image input unit 102, an operation unit 103, an audio encoding processing unit 104, an image encoding processing unit 105, a terminal control unit 106, a control information generation unit 107, a transmission packet generation unit 108, And a network I / F (interface) 109.

The voice input unit 101 includes a microphone or the like. The image input unit 102 includes a digital camera or the like. The operation unit 103 includes keys and accepts input from the user. The audio encoding processing unit 104 encodes audio data input from the audio input unit 101. The image encoding processing unit 105 encodes the image data input from the image input unit 102. The terminal control unit 106 controls the mobile phone based on input information from the operation unit 103. The control information generation unit 107 generates control information based on the control that the terminal control unit 106 performs on the mobile phone.
The transmission packet generation unit 108 generates audio data encoded by the audio encoding processing unit 104, image data encoded by the image encoding processing unit 105, and control information generated by the control information generation unit 108 as transmission packets. The network I / F 109 transmits the transmission packet generated by the transmission packet generation unit 108 to the mobile phone or server of the communication partner via the network.

  The decoding device 20 includes a network I / F 201, an operation unit 202, a received packet analysis unit 203, an audio decoding processing unit 204, an image decoding processing unit 205, an image control unit 206, a volume correction unit 207, an audio output unit 208, and an image correction unit. 209, an image output unit 210 (display means), and a local terminal control unit 211.

The network I / F 201 receives a packet including audio data, image data, control information, and the like from a mobile phone or a server as a communication partner. The operation unit 202 includes keys and accepts input from the user. The received packet analysis unit 203 analyzes a packet received by the network I / F 201 and extracts voice data, image data, control information, and the like. The voice decoding processing unit 204 decodes the voice data extracted by the received packet analysis unit 203. The image decoding processing unit 205 decodes the image data extracted by the received packet analysis unit 203.
The image control unit 206 displays an image based on the image data on the image output unit 210 based on the image data decoded by the image decoding processing unit 205, the control information, and the audio data decoded by the audio decoding processing unit 204. The display position, display size, brightness, etc. are controlled. The volume correction unit 207 corrects the volume of the audio decoded by the audio decoding processing unit 204. The audio output unit 208 is a speaker or the like, and produces a sound based on the audio data with the volume corrected by the volume correction unit 207. The image correction unit 209 corrects the image data controlled by the image control unit 206. The image output unit 210 is configured by configuring each pixel with an organic EL (electro-luminescence) element (self-emitting element), and displays images of a plurality of communication partners based on the image data corrected by the image correction unit 209. To do. The own terminal control unit 211 gives control information such as the top and bottom information of the own terminal to the image control unit 206 based on the input information from the operation unit 202.

  In the encoding device 10 and the decoding device 20, the operation unit 103 and the operation unit 202, the network I / F 109 and the network I / F 201, the terminal control unit 106, and the own terminal control unit 211 can be shared.

  The image control unit 206 will be described below. The image control unit 206 includes a top and bottom correction unit 2061, a face area detection unit 2062 (extraction unit), a screen determination unit 2063, a cutout processing unit 2064, and a size / luminance calculation unit 2065 (upper limit setting unit, luminance control unit, display area control unit). ), A reduction / enlargement processing unit 2066, a display position calculation unit 2067, and a mapping processing unit 2068.

  The top / bottom correction unit 2061 corrects the top / bottom of the image data to match the top / bottom of the screen of the image output unit 210 based on the top / bottom information associated with the image data decoded by the image decoding processing unit 205. The face area detection unit 2062 detects and extracts a face area from the image data. The screen determination unit 2063 determines an area to be displayed on the screen that displays the speaker so as to include the face area detected by the face area detection unit 2062. The cutout processing unit 2064 cuts out a corresponding area from the image data based on the determination by the screen determination unit 2063. The size / luminance calculation unit 2065 calculates the display size of the screen and the luminance when the screen is displayed on the image output unit 210 according to the volume of the audio data. The reduction / enlargement processing unit 2066 reduces or enlarges the image data cut out by the cutout processing unit 2064 based on the calculation result of the size / luminance calculation unit 2065. The display position calculation unit 2067 calculates the display position of the image data reduced / enlarged by the reduction / enlargement processing unit 2066. The mapping processing unit 2068 maps the image data obtained by the reduction / enlargement processing unit 2066 to the position on the image output unit 210 obtained by the display position calculation unit 2067.

  When the face area detection unit 2062 detects a face area, the screen determination unit 2063 selects an ellipse that includes this face area and minimizes a portion other than the face area as the screen shape. Further, when the face area detection unit 2062 does not detect a face area, the screen determination unit 2063 determines that the image is a landscape and selects a rectangle.

  The size / luminance calculation unit 2065 calculates the size and luminance of the screen based on the volume of the audio data and the volume of the audio data received in the past. In the following, calculation of screen brightness, which is a characteristic part of the present embodiment, will be described.

FIG. 3 is a front view of the screen of the image output unit 210 during the video conference. Here, in order to make the explanation easy to understand, an example is given in which one person is the main speaker and the other is mainly the listener, as in planning and presentation of research results.
On the screen, four screens S (0) to S (3) are displayed. The magnitude relationship of these screens S (j) is fixed to make it easier to visually understand the relationship of the current conference participants. In other words, the large screen S (0) is a screen on which the main speaker, the presenter of the project and research results, is displayed, and the three small screens S (1) to S (3) are the three listeners. Is a screen on which is displayed.

  The screen S (j) is associated with three types of values: an area R (j), a luminance L (j) on the screen 1, and a volume V (j). Assuming that the attention level to be obtained by each screen S (j) is A (j), it is desirable that the screen S (j) on which the person who is speaking is displayed attracts attention. The ratio is controlled to be equal to the ratio of each volume V (j). This is expressed by equation (1).

A (1): A (2): ...: A (n-1): A (n)
= V (1): V (2): ...: V (n-1): V (n) (1)

  The attention level A (j) is considered to increase as the area R (j) increases, and as the brightness L (j) increases, the attention degree A (j) is calculated as the product of the area R (j) and the brightness L (j). To do. This is expressed by equation (2).

        A (j) = R (j) × L (j) (2)

  And Formula (3) is obtained from Formula (1) and Formula (2).

R (0) × L (0): R (1) × L (1):…
...: R (n-1) x L (n-1): R (n) x L (n)
= V (0): V (1): ...: V (n-1): V (n) (3)

Here, in order to obtain the ratio of each luminance L (j) from Equation (3), if V (j) / R (j) = p _j , Equation (4) is obtained.

L (0): L (1): ...: L (n-1): L (n)
= P ₀ : p ₁ : ...: p _n-1 : p _n (4)

Here, an initial luminance value L _ini is defined in the image output unit 210. Among the above luminance L (j), the smallest one is expressed as L _min = α × L _ini (α is a constant), and the ratio between the luminance L _min and the other luminance L (j) is expressed as p _min : p _j In other words, the other luminance L (j) is expressed by Expression (5).

L (j) = (p _j / p _min ) × α × L _ini (5)

Here, the luminance of the organic EL elements constituting each pixel of the image output unit 210 is generally determined by a current value. That is, the luminance L (j) is proportional to the current value I (j) per unit area. When the current value per unit area when the luminance is L _ini is I _ini , Equation (5) to Equation (6) are obtained.

I (j) = (p _j / p _min ) × α × I _ini (6)

  Thus, the total current value W consumed by the image output unit 210 is expressed by Expression (7).

Here, a maximum allowable current value W _max is defined in the image output unit 210. Therefore, since W ≦ W _max , the constant α is expressed by Expression (8).

By setting the luminance of each screen S (j) using this α, the current consumed by the image output unit 210 while setting the luminance according to the degree of attention A (j) to be obtained by each screen S (j) It becomes possible to keep the value W below the maximum allowable current value W _max .
Note that a condition of α ≦ 1 may be added so that the minimum luminance L _min does not exceed L _ini .

Now, when the above formula is applied to the example shown in FIG. 3, first, in this example, the ratio of the area R (j) of each screen S (j) is:
R (0): R (1): R (2): R (3) = 2: 1: 1: 1
It is. Then, assuming that the person displayed on the screen S (0) and the person displayed on the screen S (2) are speaking, the ratio of the volume V (j) of each screen S (j) is:
V (0): V (1): V (2): V (3) = 2: 1: 2: 1
If it is, from Formula (3),
2L (0): L (1): L (2): L (3) = 2: 1: 2: 1
From the above formula,
2L (0): L (1) = 2: 1
2L (0): L (2) = 2: 2
2L (0): L (3) = 2: 1
That is, that is,
L (0): L (1) = 1: 1
L (0): L (2) = 1: 2
L (0): L (3) = 1: 1
That is,
L (0): L (1): L (2): L (3) = 1: 1: 2: 1
It is.

From the above equation, if the luminance of the screen S (j) that minimizes the luminance is α × L _ini (α ≦ 1),
L (0) = L (1) = L (3) = α × L _ini
L (2) = 2α × L _ini
It is.

From the above formula, if the current value per unit area when the luminance is L _ini is I _ini ,
I (0) = I (1) = I (3) = α × I _ini
I (2) = 2α × I _ini

From the above equation and equation (7), the total current value consumed by the image output unit 210 is
W = R (0) × I (0) + R (1) × I (1) + R (2) × I (2) + R (3) × I (3)
= Α × I _ini (R (0) + R (1) + 2R (2) + R (3))
Since W ≦ W _max , α ≦ W / (I _ini (R (0) + R (1) + 2R (2) + R (3))) and α ≦ 1

  Α can be determined from the above equation, and the luminance to be set for each screen S (j) can be determined.

The size / luminance calculation unit 2065 is obtained by processing the volume of the audio data input from the audio decoding processing unit 204 for luminance calculation as shown in FIGS. 4 and 5 as the volume V (j) in the above formula. Used.
4 and 5 are graphs showing a change in sound volume with time. In these graphs, the volume (input volume) V _receive of the audio data input from the audio decoding processing unit 204 is indicated by a solid line, and the volume (processed volume) V _display processed for luminance calculation based on this volume is indicated by a broken line. It showed in.
The reason why the processing volume V _display is used for the brightness calculation is that if the brightness is calculated based on the input volume V _receive , there is a problem that the brightness is not stable and flickers. This is because it takes a short time to rise and then falls, so that the time when the brightness is high is short and it is difficult to recognize which person on the screen S (j) has spoken. .
Therefore, the processing volume V _display is obtained by averaging the input volume V _receive during the speech, and after the speech is finished, it is assumed that the processing volume V _{display is} gradually attenuated from the processing volume V _display during the speech. Further, the attenuation after the end of the speech is made gentler as the speech duration time is shorter.
FIG. 4 shows the case of a short utterance such as a conflict, and FIG. 5 shows the case of a utterance longer than a predetermined time. 4 and 5, T _speak is a speaking period (speech period), and T _silent is a silent period (silent period). V _level is a volume threshold set at a predetermined interval. 4 (a) and 5 (a) show the case where the volume during speaking is high, and FIGS. 4 (b) and 5 (b) show the case where the volume during speaking is low.

A method for calculating the processing volume V _display according to the speech duration will be described with reference to the flowcharts of FIGS. 6 and 7. By processing according to this chart, based on the change of the input volume V _receive and the processed volume V _display , it is distributed into a rising state (state 1), a falling (continuation) state (state 2), and a stable state (state 3). The processing volume V _display is calculated by an expression suitable for the state.
t is the current time, V _receive (t) is the current input volume, V _receive (t−Δt) is the input volume at the past time Δt from the present, and V _leveli is _higher than V _receive (t−Δt). , V _leveli-1 is a threshold below from V _receive (t−Δt), t _base is a time when a change (rising or falling) is detected, and V _base is a reference volume at the time of calculation. .
The following processing is performed by the size / luminance calculation unit 2065. This process is repeated every predetermined time.

First, when it is detected that the input sound volume V _receive (t) has risen across the threshold value V _leveli from time (t−Δt) to time t (Yes in S1), it is detected to which threshold value it has risen. (S2, S3), the time when the volume is fully increased is stored (S4).
Further, when the input volume V _receive (t) does not increase across the threshold value V _leveli from time (t−Δt) to time t (No in S1), the input volume V _receive (t) is the threshold value. When it is detected that descends across the _{V leveli-1} (S5 Yes in) to detect whether lowered to any threshold (S6, S7), to store the time t at which the volume is fully lowered as t _base ( S4).

Subsequently, when the input sound volume V _receive (t) increases across the threshold V _levelj from time (t−Δt) to time t (Yes in S11), it is assumed that the state is the rising state (state 1). (S12) The processing volume V _display is calculated by equation (9) (S13).

V _display = V _receive (9)

Then, the state is stored in the state _pre (S14), and the process ends.

If the input volume V _receive (t) has not increased across the threshold value V _levelj from time (t−Δt) to time t (No in S11), is the previous state state _pre 1? 3 (Yes in S15), and the input volume V _receive (t) has _fallen across the threshold V _levelj−1 from time (t−Δt) to time t (Yes in S16). ) Is assumed to be in the falling state (state 2) (S17), and the processing volume V _display at the past time point Δt is substituted for the calculation reference volume V _base (S18), and the processing volume V is expressed by equation (10). _Display is calculated (S19).

V _display = V _levelj−1 + (V _base −V _levelj−1 ) × exp (−a _j × T _speak × (t−t _base ))
(10)

Thereby, the processing volume V _display attenuates more slowly than the input volume V _receive .
Then, the state is stored in the state _pre (S14), and the process ends.

If the input volume V _receive (t) has not decreased across the threshold V _levelj−1 from time (t−Δt) to time t in S16 (No in S16), the stable state (state 3 ) (S20), and the processing volume V _display is calculated by equation (11) (S21).

Then, the state is stored in the state _pre (S14), and the process ends.

In S15, when the state _pre that is the previous state is 2 (No in S15), the past processing volume V _display has not attenuated to a value equivalent to the input volume V _receive for the time Δt (S22). Yes), the falling continuation state (state 2) is assumed (S23), and the processing volume V _display (t−Δt) has sufficiently approached the threshold V _levelj−1 , that is, the processing volume V _display (t−Δt) and V _If the difference from _levelj−1 is less than the predetermined value ΔV (Yes in S24), the reference is lowered to the lower threshold value (S25), and the processing volume V _display is calculated by equation (10) (S26). .

Then, the state is stored in the state _pre (S14), and the process ends.

In S22, when the past processed sound volume V _display is attenuated to a value equivalent to the input sound volume V _receive for the time Δt (No in S22), the stable state (state 3) is assumed (S27), and the expression (11) ) To calculate the processing volume V _display (S28).

Then, the state is stored in the state _pre (S14), and the process ends.

  In the present embodiment, the increase / decrease of the volume is all transferred to the increase / decrease of the luminance. However, in the implementation, the increase / decrease of the volume may be distributed not only to the increase / decrease of the luminance but also to the enlargement / reduction of the screen.

As described above, according to the present embodiment taking the communication terminal device capable of multi-screen (multi-window) display as an example, the size of the screen displaying each communication partner is associated with the screen. By performing brightness control according to the volume of the sound, it is possible to give each screen an appropriate degree of attention, and avoid excessive increase in current consumption by applying excessively high brightness to a large screen. it can.
In addition, even when brightness control is performed on the screen, it can be kept below a certain value that does not exceed the current consumption allowed for the display device (the maximum allowable current value, that is, the upper limit value). It is possible to avoid adversely affecting the performance (battery holding) of the device such as the talkable time of the terminal device.
Also, instead of identifying the speaker with the largest voice volume, brightness control is performed by the ratio of the voice volume, so that multiple speakers speak at approximately the same volume. Even in this case, it is possible to make a screen that makes it easy to visually understand who and who are discussing, and it is possible to avoid a screen that increases brightness frequently from being replaced frequently.
Furthermore, when the reception volume is greatly increased with respect to the change in the reception volume, that is, when the speech starts, the luminance is immediately increased. On the other hand, when the luminance is attenuated after the end of the speech, the utterance period is taken into consideration and the speech period is long. The attenuation is faster as the utterance period is shorter. As a result, the brightness immediately increases for a new utterance, but the brightness gradually attenuates for short utterances such as conflicts and replies. It is possible to eliminate the brightness fluctuation of the screen.

It is a block diagram which shows the structural example of the portable terminal device in one Embodiment of this invention. It is a block diagram which shows the structural example of the portable terminal device in one Embodiment of this invention. It is a front view of the screen in one Embodiment of this invention. It is a graph showing the time-dependent change of the volume in one Embodiment of this invention. It is a graph showing the time-dependent change of the volume in one Embodiment of this invention. It is a flowchart which shows the process in which the volume for brightness | luminance control according to the speech continuation time in one Embodiment of this invention is obtained. It is a flowchart which shows the process in which the volume for brightness | luminance control according to the speech continuation time in one Embodiment of this invention is obtained.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Encoding apparatus 101 ... Audio | voice input part 102 ... Image input part 103 ... Operation part 104 ... Voice encoding process part 105 ... Image encoding process part 106 ... Terminal control part 107 ... Control information generation part 108: Transmission packet generator 109: Network I / F
DESCRIPTION OF SYMBOLS 20 ... Decoding apparatus 20, 201 ... Network I / F, 202 ... Operation part, 203 ... Received packet analysis part, 204 ... Audio | voice decoding process part, 205 ... Image decoding process part, 206 ... Image control part, 207 ... Volume correction part , 208 ... Audio output unit, 209 ... Image correction unit, 210 ... Image output unit (display means), 211 ... Self-terminal control unit 2061 ... Top and bottom correction unit, 2062 ... Face area detection unit (extraction means), 2063 ... Screen determination , 2064 ... cutout processing unit, 2065 ... size / luminance calculation unit (upper limit setting means, luminance control means, display area control means), 2066 ... reduction / enlargement processing unit, 2067 ... display position calculation unit, 2068 ... mapping processing unit

Claims (10)

In a communication terminal device that receives images and sounds of a plurality of communication partners, displays each image on a display means and pronounces the sound,
Upper limit setting means for setting an upper limit value of the luminance of each area based on the size of the area occupied by each image in the display means;
A communication terminal apparatus comprising: luminance control means for controlling the luminance of each area within a range not exceeding the upper limit value.   The communication terminal apparatus according to claim 1, wherein the brightness control unit controls the brightness of the area occupied by the image received together with the sound based on the volume of the sound.   The upper limit setting unit sets an upper limit value of luminance within a range that does not exceed a current consumption allowed for the display unit, and the luminance control unit takes into account the size of the region in controlling the luminance of the region. The communication terminal apparatus according to claim 1 or 2, wherein   The display area control means for changing the size of the area occupied by the image received together with the sound based on the size of the sound, according to any one of claims 1 to 3. Communication terminal device.   The communication terminal apparatus according to claim 1, wherein each pixel of the display unit is configured by a self-luminous element. An image display method in a communication terminal device that receives images and sounds of a plurality of communication partners, displays each image on a display means, and pronounces the sound,
Based on the size of the area occupied by each image in the display means, set the upper limit of the brightness of each area,
A method for displaying an image in a communication terminal device, wherein the luminance of each of the regions is controlled within a range not exceeding the upper limit.   7. The image display method according to claim 6, wherein brightness of the area occupied by the image received together with the sound is controlled based on the volume of the sound.   8. The upper limit value of luminance is set within a range not exceeding the current consumption allowed for the display means, and the size of the region is taken into account in controlling the luminance of the region. Image display method in the communication terminal apparatus.   9. The image display method in the communication terminal device according to claim 6, wherein the size of the area occupied by the image received together with the sound is changed based on the size of the sound. . In a communication terminal device that receives images and sounds of a plurality of communication partners and reproduces the images together with the sounds,
Detecting the start and end of the communication partner's speech based on the volume of the voice;
Set the luminance at the time of playing the image based on the volume of the sound received together with the image, when the utterance is ended, attenuate the luminance according to the duration of the utterance ,
When the speech is finished , the communication terminal apparatus is characterized in that the luminance is attenuated faster as the duration of the speech is longer, and slower as the duration of the speech is shorter .

Images