KR101414603B1 - Method for connecting conference call and communication terminal implementing the same - Google Patents

Abstract

The present invention relates to a multi-party communication method provided to a terminal user so that a multi-party call is more convenient for exchanging calls with various parties and a communication terminal capable of implementing the multi-party communication method. The multi- And a volume adjustment step for allowing volumes to be individually adjusted for a call with each other, in a communication terminal. According to the present invention, it is possible to individually adjust the volume of sound received from each of the opponents when communicating with a plurality of opponents, and to individually adjust the volume of the sound transmitted to each opponent .

Video, call, volume, adjust

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a multi-

1 is a schematic block diagram showing a configuration of a mobile terminal according to the present invention.

2 is a schematic flow diagram of a multi-party calling method according to the first to sixth embodiments of the present invention.

3 is a diagram illustrating a screen of a display unit of a mobile terminal in which the multi-party calling method according to the first embodiment of the present invention is implemented.

4 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a second embodiment of the present invention is implemented.

5 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a third embodiment of the present invention is implemented.

6 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a fourth embodiment of the present invention is implemented.

7 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a fifth embodiment of the present invention is implemented.

8 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a sixth embodiment of the present invention is implemented.

9 is a schematic flow chart of a conference calling method according to the seventh through tenth embodiments of the present invention.

10 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a seventh embodiment of the present invention is implemented.

11 is a view illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to an eighth embodiment of the present invention is implemented.

12 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a ninth embodiment of the present invention is implemented.

13 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a tenth embodiment of the present invention is implemented.

14 is a schematic flow chart of a conference calling method according to an eleventh embodiment of the present invention.

15 is a diagram showing a concept of a multi-party calling method according to the eleventh embodiment of the present invention.

Description of the Related Art

1: mobile terminal 100: communication unit

200: memory unit 300: camera unit

400: display unit 500: sound input unit

600: Acoustic output unit 700: Input unit

800: control unit 830: three-dimensional virtual sound synthesis module

The present invention relates to a multiparty call method, and more particularly, to a multiparty call method provided to a terminal user so that a call sound to be exchanged with various parties in a multiparty call is more convenient, and a communication terminal capable of implementing the same.

With the remarkable development of the information communication and broadcasting field today, the information communication and the broadcasting environment are rapidly changing. Among such changes, the mobile terminal is being used as much as it is considered as a necessity in the modern society. In recent years, as the development of communication technologies has been accelerated more and more, there has been a tendency that the development of communication technology has been accelerated more and more, and a multi-party call (for example, a conference call) Communication terminals capable of communication (image communication) are gradually being introduced.

However, there is a problem that it is difficult to control the size of the reception volume in the conventional terminal when there are a large number of communication partners, a voice of one of the other parties is small and a voice of another party is large.

Also, when the voices of a plurality of parties are similar to each other and / or when a plurality of parties talk at the same time, there is a problem that it is difficult for the user of the conventional terminal to distinguish who is talking among a plurality of parties.

SUMMARY OF THE INVENTION The present invention has been proposed in order to solve the above problems, and it is an object of the present invention to provide a multi-party communication method which is easy to control the volume of reception volume from a plurality of communication parties, And to provide a communication terminal that can be implemented.

According to an aspect of the present invention, there is provided a communication terminal, including: a multi-party call performing step of performing a multi-party call with two or more parties; and a volume adjusting step of adjusting a volume of a call with each other, To provide a multi-party calling method.

According to another aspect of the present invention, there is provided a multi-party video communication method comprising: a multi-party video communication performing step of performing multi-way video communication with two or more opponents; And a volume adjustment step of adjusting volume volumes of the reception sound to be different from each other.

According to another aspect of the present invention, there is provided a multi-party video communication system comprising: a multi-party video communication performing step of performing multi-party video communication with two or more parties; And a three-dimensional virtual sound output step of outputting the three-dimensional virtual sound as a three-dimensional virtual sound.

According to another aspect of the present invention, there is provided a communication terminal including a communication unit for connecting a multi-party call with two or more parties, and a control unit for controlling volume of the communication with each other, to provide.

According to another aspect of the present invention, there is provided a communication system including a communication unit for connecting a multi-party video call with two or more parties, a display unit for displaying an image of a video call, The control unit controls the volume of the left and right reception sound of the other party to be different from each other.

According to another aspect of the present invention, there is provided a communication system including a communication unit for connecting a multi-party video call with two or more parties, a display unit for displaying an image of a video call, Dimensional virtual sound corresponding to a position at which the image of each of the other party is displayed.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.

The present invention can be applied to various types of terminals such as a notebook computer and a desktop computer as well as a mobile terminal such as a cellular phone if the terminal can receive video communication. Hereinafter, in order to simplify the explanation, the present invention will be described by way of example of a video communication through a mobile terminal such as a mobile phone, but the present invention is not limited thereto. Therefore, it should be noted that the present invention is not limited to the following description and embodiments.

First, a configuration of a mobile terminal according to the present invention will be described with reference to FIG. 1 is a schematic block diagram showing a configuration of a mobile terminal according to the present invention.

1, a mobile terminal 1 according to the present invention includes a communication unit 100, a memory unit 200, a camera unit 300, a display unit 400, a sound input unit 500, An input unit 600, a control unit 800,

Of course, the mobile terminal according to the present invention may include other than the above-described components (for example, a battery unit or the like) if necessary, but other than the above-mentioned components may be directly related to the present invention A detailed description thereof will be omitted here for simplicity of explanation.

On the other hand, it should be noted that when the components are implemented in a practical application, two or more components may be integrated into one component as needed, or one component may be divided into two or more components.

Hereinafter, the components of the mobile terminal 1 will be described in order.

The communication unit 100 preferably allows the mobile terminal 1 to perform image communication with two or more counterpart terminals through a mobile communication network. That is, the communication unit 100 transmits the image photographed by the camera unit 300 to the counterparts while the terminal user is making a voice call with two or more counterparts as the mobile terminal, And serves to receive counterpart images. It goes without saying that the communication unit 100 can support a general voice call.

The memory unit 200 stores various kinds of software for driving various functions provided by the mobile terminal 1 and various data corresponding thereto. The memory unit 200 preferably stores the volume of the left volume and the volume of the right volume for the sound received from the other party (hereinafter referred to as "reception sound") according to the position on the screen of the display unit 400 And stores data on relative sizes. In addition, the memory unit 200 may preferably be configured to output the three-dimensional virtual sound generated at the position at which the reception image is displayed, And a head-related transfer function (HRTF). This will be explained in detail later.

The camera unit 300 is for capturing a still image or a moving image, and is preferably arranged to photograph a user of the terminal during a video call. If necessary, the mobile terminal 1 may further include at least one camera unit (not shown) in addition to the camera unit 300, and the at least one camera unit may further photograph a scene other than the terminal user's image during a video call To the other party.

The display unit 500 displays a screen according to the real time operation status of the mobile terminal 1 and various functions provided by the mobile terminal 1. [ When the display unit 500 is configured as a touch screen, it may serve as an input unit for receiving various touch commands or information from the terminal user. In particular, the display unit 500 displays an image for the video call. In the following description, the screen of the display unit as well as the display unit will be referred to as reference numeral 500.

The sound input unit 500 receives a sound of a terminal user (hereinafter, referred to as a "transmission sound") to be transmitted to the other party during a call with the other party.

The sound output unit 600 serves to output a sound received from the other party during a call with the other party. Preferably, the sound output unit 600 is configured to include two channels (for example, a left channel and a right channel), and the received sound is divided into a left reception sound and a right reception sound Do.

The input unit 700 allows a terminal user to input various information or commands to the terminal 1, such as a keypad. The input unit 700 may be omitted from the configuration of the mobile terminal 1 if the display unit 400 is configured as a touch screen and can serve as a separate input unit.

The controller 800 controls the operation of the communication unit 100, the memory unit 200, the camera unit 300, the display unit 400, the sound input unit 500, the sound output unit 600, And the input unit 700 so that a multi-party communication method, which will be described later, can be implemented in the mobile terminal 1. The control unit 800 may include a 3D virtual sound synthesis module 850 as required. The virtual stereo sound synthesis module 850 may be configured separately from the control unit 800 as a separate component. The 3D virtual sound synthesis module 850 allows the 3D virtual sound output to be implemented in the mobile terminal 1, which will be described later.

Hereinafter, the method for multi-party calling according to the present invention will be described separately for each embodiment. Hereinafter, it is assumed that the display unit 400 is configured as a touch screen and various commands can be input through the touch screen. It will be appreciated that the following embodiments may be implemented through command input through the input unit 700 for simplicity of explanation.

1st Example

Referring to FIGS. 2 and 3, a method for calling a conference according to the first embodiment of the present invention will be described. FIG. 2 is a schematic flowchart of a multi-party calling method according to a first embodiment of the present invention, and FIG. 3 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to the first embodiment of the present invention is implemented.

The mobile terminal 1 is in a video call with two opponents, i.e., the first opponent Smith and the second opponent Judy [S21]. Of course, it is natural that the mobile terminal 1 can make a video call with three or more parties. This is the same in the following embodiments.

3, a first counterpart image 410 and a second counterpart image 420 are displayed on the display screen 400, respectively. The display unit screen 400 is provided with individual reception volume indicators 411 for displaying the volume of the reception sound RX1 from the first counterpart and the volume of the reception sound RX2 from the second counterpart respectively , 421 are displayed.

Suppose, however, that the voice of the first party is too small to be audible, while the voice of the second party is too large to be audible. In this case, if the sound output of the sound output unit 600 of the mobile terminal device 1 is increased as a whole, the sound of the first party can be heard well but the sound of the second party is made louder. However, if the sound output of the sound output unit 600 is reduced as a whole, the sound of the second party may be suitable for listening, but the sound of the first party may be smaller.

At this time, as shown in (3-2) of Fig. 3, the terminal user can increase the volume of the reception sound from the first counterpart and decrease the volume of the reception sound from the second counterpart (S22) . This may be done by simply touch-and-dragging the indicators 411 and 421 displayed on the display screen or through an appropriate key operation of the input unit 700. As those skilled in the art will readily appreciate, the detailed description will be omitted for the sake of simplicity in this specification.

Thus, the terminal user can make a call with the first party and the second party with a reasonable receive volume size.

The reception volume adjustment may be configured such that the volume of the first counterpart reception sound and the volume of the second counterpart reception sound are respectively automatically adjusted to a predetermined size predetermined by the terminal user.

It should be understood that the present embodiment can be applied not only to a multi-party video call but also to a multi-party general voice call.

Second Example

Referring to Fig. 4, a second embodiment according to the present invention will be described. 4 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a second embodiment of the present invention is implemented.

The first counterpart image 410 and the second counterpart image 420 are displayed on the display screen 400 as shown in (4-1) of FIG. A display volume indicator 431 is displayed on the display unit screen to indicate the volume of the first sound received by the first party and the volume of the second sound received by the second party as a whole. In addition, the display unit screen 400 displays a reception volume distributor 433, for example, in the form of a bar, for distributing the relative volume size between the reception sound of the first party and the reception sound of the second party. In (4-1) of FIG. 4, the reception volume distributor 433 is set such that the relative volume magnitudes between the first counterpart reception sound and the second counterpart reception sound are the same.

Suppose that the reception sound of the first party and the reception sound of the second party are both small and not well received. Then, as shown in (4-2) of FIG. 4, by using the reception volume indicator 431, the terminal user can increase the overall volume of the reception sound of the first counterpart and the reception sound of the second counterpart, .

Now, suppose that the reception sound of the first party is small but not heard yet, but the reception sound of the second party is so large that it sounds loud to the terminal user.

At this time, as shown in (4-3) in FIG. 4, the terminal user adjusts the reception volume distributor 433 so that the volume magnitude of the reception sound of the first counterpart is increased and the reception sound power of the second counterpart So that the volume size of the memory card is reduced. Then, the terminal user can make a call with the first party and the second party with a proper reception volume size.

It should be understood that the present embodiment can be applied not only to a multi-party video call but also to a multi-party general voice call.

Third Example

With reference to Fig. 5, a third embodiment, which is a modification of the above-described first embodiment, will be described. 5 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a third embodiment of the present invention is implemented.

The first counterpart image 410 and the second counterpart image 420 are displayed on the display screen 400 as shown in (5-1) of FIG. The display unit screen 400 is provided with individual reception volume indicators 411 for displaying the volume of the reception sound RX1 from the first counterpart and the volume of the reception sound RX2 from the second counterpart respectively , 421 are displayed. The display unit screen 400 further includes individual transmission volume indicators 413 for displaying the magnitude of the volume of the transmission sound TX1 to the first counterpart and the volume of the transmission sound TX2 to the second counterpart, , 423 are displayed

However, assume that the voice of the first party is too small to be heard by the terminal user, while the voice of the second party is too loud to sound. Suppose that the first party is talking to the terminal user with a smaller voice, and the second party is asking the terminal user to speak up with a larger voice.

At this time, as shown in (5-2) of FIG. 5, the terminal user can increase the volume of the reception sound from the first counterpart and reduce the volume of the transmission sound to the first counterpart. Further, the terminal user can increase the volume of the transmission sound to the second party while reducing the volume of the reception sound from the second party. Since the operation of increasing or decreasing the volume has already been described in the first embodiment, a detailed description thereof will be omitted for the sake of simplicity in this specification.

Thus, the terminal user can make a call with the first party and the second party with an appropriate reception volume size and a transmission volume volume size.

It should be understood that the present embodiment can be applied not only to a multi-party video call but also to a multi-party general voice call.

Fourth Example

Referring to Fig. 6, a fourth embodiment, which is a modification of the above-described second embodiment, will be described. 6 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a fourth embodiment of the present invention is implemented.

The first counterpart image 410 and the second counterpart image 420 are displayed on the display screen 400 as shown in (6-1) of FIG. The display unit screen includes a reception volume indicator 431 that shows the volume of the reception sound of the first counterpart and the reception sound of the second counterpart as a whole and a transmission sound indicator 431 that is a transmission sound to the second counterpart and a transmission sound to the second counterpart A transmission volume indicator 441 for indicating the volume size of the entire volume is displayed. In addition, the display unit screen 400 includes a reception volume distributor 433 for distributing a relative volume size between the reception sound of the first counterpart and the reception sound of the second counterpart, And a transmission volume distributor 443 for distributing the relative volume magnitude of the transmission sound to the other party is displayed, for example, in the form of a bar. 6 (6-1), the reception volume distributor 433 may be configured so that the relative volume magnitudes between the first and second counterpart reception sounds are equal, and the transmission volume distributor 443 transmits the first counterpart transmission The relative volume magnitudes between the sound and the second-party transmitting sound are set to be equal.

It is assumed that the terminal user is listening to the first party's reception sound and the second party's reception sound are both small and the first party and the second party are required to speak to the terminal user with a smaller voice. Then, as shown in (6-2) of FIG. 6, by using the reception volume indicator 431, the terminal user can increase the overall volume of the reception sound of the first party and the reception sound of the second party is large . Then, the terminal user uses the transmission volume indicator 441 to calculate the total volume of the transmission sound to the first counterpart and the transmission sound to the second counterpart, as shown in (6-2) of FIG. 6 .

Now, for the terminal user, it is assumed that the voice of the first party is too small to hear, while the voice of the second party is too loud to hear. Suppose that the first party is talking to the terminal user with a smaller voice, and the second party is asking the terminal user to speak up with a larger voice.

At this time, as shown in (6-3) of FIG. 6, the terminal user adjusts the reception volume distributor 433 so that the volume magnitude of the reception sound of the first counterpart is increased and the reception sound power of the second counterpart So that the volume size of the memory card is reduced. The terminal user adjusts the transmission volume distributor 443 so that the volume of the transmission sound to the first counterpart becomes smaller and the volume of the transmission sound to the second counterpart becomes larger. The terminal user can then make a call with the first and second parties with a reasonable receive acoustic and transmit acoustic volume magnitude.

It should be understood that the present embodiment can be applied not only to a multi-party video call but also to a multi-party general voice call.

Fifth Example

With reference to Fig. 7, a fifth embodiment, which is a modification of the above-described second embodiment, will be described. 7 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a fifth embodiment of the present invention is implemented.

The first counterpart image 410 and the second counterpart image 420 are displayed on the display screen 400 as shown in (7-1) of FIG. A display volume indicator 431 is displayed on the display unit screen to indicate the volume of the first sound received by the first party and the volume of the second sound received by the second party as a whole.

Suppose that the reception sound of the first party and the reception sound of the second party are both small and not well received. Then, as shown in (7-2) of FIG. 7, by using the reception volume indicator 431, the terminal user can increase the overall volume of the reception sound of the first party and the reception sound of the second party is large .

Now, suppose that the reception sound of the first party is small but not heard yet, but the reception sound of the second party is so large that it sounds loud to the terminal user.

At this time, the terminal user increases the size of the first counterpart image and reduces the size of the second counterpart image, as shown in (7-3) in Fig. Then, the volume magnitude of the reception sound of the first counterpart becomes large and the volume magnitude of the reception sound of the second counterpart becomes small. Then, the terminal user can make a call with the first party and the second party with a reasonable reception volume level.

If the reception sound of the first party is small but the reception sound of the second party is appropriate, it may be possible to adjust the size of the first party image to be a proper reception sound volume size.

6th Example

Referring to Fig. 8, a sixth embodiment, which is a modification of the above-described first embodiment, will be described. 8 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a sixth embodiment of the present invention is implemented.

The first counterpart image 410 and the second counterpart image 420 are displayed on the display screen 400 as shown in (8-1) of FIG. In (8-1) of Fig. 8, the first counterpart image 410 is selected and activated. Accordingly, the display unit screen 400 displays an individual reception volume indicator 411 indicating the volume of the reception sound RX1 from the first counterpart.

If the second counterpart image 420 is selected and activated as shown in (8-2) of FIG. 8, the size of the volume of the sound RX2 from the second counterpart is displayed on the display screen 400 An individual receiving volume indicator 421 is displayed.

Accordingly, the terminal user can select a desired one of the first counterpart image 410 and the second counterpart image 420 and activate the selected image to adjust the corresponding sound. The selection of the image may be performed by the terminal user touching a desired one of the images displayed on the display unit screen, or may be performed through an appropriate key operation of the input unit 700

Seventh Example

9 and 10, a description will be given of a conference calling method according to a seventh embodiment of the present invention. FIG. 9 is a schematic flowchart of a multi-party calling method according to a seventh exemplary embodiment of the present invention, and FIG. 10 is a view illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a seventh exemplary embodiment of the present invention is implemented.

The mobile terminal 1 is in a video call with two opponents, that is, a first opponent Smith and a second opponent John. On the display screen 400, as shown in FIG. 10, The counterpart image 410 and the second counterpart image 420 are displayed on the left side and the right side, respectively, on the screen (S91).

The sound output unit 600 of the mobile terminal 1 is composed of two channels (that is, a left channel and a right channel), and the reception sound from the counterparts is divided into a left reception sound and a right reception sound, Channel and the right channel. This is the same in the following embodiments.

Hereinafter, for simplicity of explanation, the sound received from the first counterpart will be referred to as RX1, and the sound received from the second counterpart will be referred to as RX2. The reception sound RX1 of the first counterpart is divided into the first counterpart left reception sound RX1 _L and the first counterpart right reception sound RX1 _R and output through the left channel and the right channel respectively. The reception sound RX2 of the second counterpart is divided into the second counterpart left reception sound RX2 _L and the second counterpart right reception sound RX2 _R and output through the left channel and the right channel, respectively.

The sound output from the sound output unit 600 through the left channel is referred to as RX _L , and the sound output through the right channel is referred to as RX _R.

The relationship between the above-described reception sound and output sound is summarized as follows.

Left channel output sound (RX _L ) = First left sound reception left (RX1 _L ) + Second left sound reception right (RX2 _L )

Right channel output sound (RX _R ) = First right sound reception right (RX1 _R ) + Second right sound reception right (RX2 _R )

An image of the first counterpart is displayed on the left side of the display screen 400 and an image of the second counterpart is displayed on the right side of the display screen 400 as shown in Fig.

Accordingly, the reception sound of the first counterpart is divided into the left and right channels so that the left reception sound is larger than the right reception sound as follows (S92).

(RX1 _L ) on the left side of the first opponent> RX1 _{R on the} right side of the first opponent

In an extreme case, only the first left-side reception sound RX1 _L and the first right-side reception sound RX1 _R may not be output.

Then, the reception sound of the second party is divided so that the right reception sound is larger than the left reception sound as follows and outputted to the left channel and the right channel (S92).

(RX2 _L ) < Second counterpart right reception sound (RX2 _R ) &_lt;

In the extreme case, the second counterpart left reception sound RX2 _L may not be output, and only the second counterpart right reception sound RX2 _R may be output.

That is, to the terminal user, the reception sound of the first counterpart sounds as if heard from the left side so as to fit the position of the first counterpart image, while the reception sound of the second counterpart sounds as if it is heard from the right side I feel like.

Accordingly, when a terminal user makes a video call with the two parties, it is easy to distinguish who is speaking or who is talking even if the parties have similar voices or when they talk at the same time.

Eighth Example

The eighth embodiment, which is a modified example of the above-described seventh embodiment, will be described with further reference to Fig. 11 is a view illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to an eighth embodiment of the present invention is implemented.

The mobile terminal 1 is in a video call with three parties, namely, the first party Smith, the second party John, and the third party Tom. On the display screen 400, The first counterpart image 410, the second counterpart image 420, and the third counterpart image 450 are displayed on the left side, the right side, and the center, respectively, on the screen as shown in Fig.

Hereinafter, the sound received from the first counterpart will be referred to as RX1 for simplicity of explanation, the sound received from the second counterpart will be referred to as RX2, and the sound received from the third counterpart will be referred to as RX3. (RX1 _L , RX2 _L , RX3 _L ) and the right reception sounds (RX1 _R , RX2 _R , RX3 _R , and RX3 _R ) of the first counterpart RX1, the second counterpart reception sound, _R and output as a left channel output sound RX _L and a right channel output sound RX _R through the left channel and the right channel of the sound output unit 600.

The relationship between the above-described reception sound and output sound is summarized as follows.

Left-channel output sound (RX _L) = the first party left sound receiving (RX1 _L) + the second party receives the left sound (RX2 _L) + the third party receives the left sound (RX3 _L)

Right channel output sound (RX _R ) = First counterpart right reception sound (RX1 _R ) + Second counterpart right reception sound (RX2 _R ) + Third counterpart right reception sound (RX3 _R )

11, the image of the first counterpart is displayed on the left side of the display screen 400, the image of the second counterpart is displayed on the right side of the display screen 400, And the image of the other party is displayed in the center of the display unit 400. [

Accordingly, the reception sound of the first counterpart is divided so that the left reception sound is larger than the right reception sound, and the reception sound of the second counterpart is divided so that the right reception sound is larger than the left reception sound, . This is the same as in the seventh embodiment described above, so a detailed description will be omitted.

The reception sound of the third party is divided into the left and right channels so that the left reception sound and the right reception sound are substantially equal to each other as follows.

(RX3 _L ) on the left side of the third party = RX3 _{R on the} right side of the third party

That is, to the terminal user, the reception sound of the first counterpart sounds as if heard from the left side so as to fit the position of the first counterpart image, while the reception sound of the second counterpart sounds as if it is heard from the right side And the reception sound of the third party is perceived to be heard from the center to match the position of the third party picture.

9th Example

Referring to Fig. 12, a ninth embodiment which is still another modification of the above-described seventh embodiment will be described. 12 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a ninth embodiment of the present invention is implemented.

The first counterpart image 410 and the second counterpart image 420 are displayed on the left and right sides of the display screen, respectively, as shown in (12-1) of FIG. Therefore, as described in Equations 2 and 3, the reception sound of the first party is divided so that the left reception sound is larger than the right reception sound and the reception sound of the second party is divided so that the right reception sound is larger than the left reception sound, Channel and the right channel.

At this time, it is assumed that the terminal user shifts the position of the first counterpart image to the left as shown in (12-2) of FIG.

Then, the reception sound of the first counterpart is divided so that the left reception sound is larger than the right reception sound as follows and outputted to the left channel and the right channel as follows.

(RX1 _L ) "First counterpart right reception sound (RX1 _R )

Next, it is assumed that the terminal user moves the position of the second counterpart image to the right as shown in (12-3) of FIG.

Then, the reception sound of the second party is divided into the left channel and the right channel so that the right reception sound is larger than the left reception sound as follows.

(RX2 _L ) of the second counterpart "Receive sound of the second counterpart (RX2 _R )

Then, to the terminal user, it is felt that the reception sound of the first party and the second party more closely coincides with the position of the image.

Article 10 Example

Referring to Fig. 13, the tenth embodiment, which is another modification of the ninth embodiment described above, will be described. 13 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party calling method according to a tenth embodiment of the present invention is implemented.

The first counterpart image 410 and the second counterpart image 420 are displayed on the left and right sides of the display screen, respectively, as shown in (13-1) of FIG. Therefore, as described in Equations (2) and (3), the reception sound of the first counterpart is set such that the left reception sound RX1 _L is larger than the right reception sound RX1 _R and the reception sound of the second counterpart is the right reception sound RX2 _R ) is larger than the left reception sound (RX2 _L ) and output to the left channel and the right channel.

Next, assume that the terminal user wants to change the positions of the images. The switching of the positions of the images may be performed by touch-and-dragging the image on the display unit, or by an appropriate key operation of the input unit 700. [ It will be understood by those skilled in the art that a detailed description thereof will not be given unless otherwise described.

In order to switch the positions of the images, the images are gradually moved to the center of the display screen as shown in (13-2) of FIG. At this time, in the reception sound of the first counterpart, the left reception sound RX1 _L gradually decreases and the right reception sound RX1 _R gradually increases so that the first counterpart image 410 moves to the center of the display screen 400 The left reception sound RX1 _L and the right reception sound RX1 _R become equal to each other. When the second reception side sound RX2 _L gradually increases and the right reception sound RX2 _R gradually decreases in the reception sound of the second counterpart so that the second counterpart image 420 is moved to the center of the display screen 400 The left reception sound RX2 _L and the right reception sound RX2 _R become equal to each other.

13, the first counterpart image 410 is moved to the right side of the display screen 400 and the second counterpart image 420 is moved to the right side of the display screen 400. Then, And is moved to the left side of the sub screen 400.

Then, in the reception sound of the first party, the left reception sound RX1 _L becomes smaller and the right reception sound RX1 _R becomes larger, so that the left reception sound RX1 _L becomes smaller than the right reception sound RX1 _R Lt; / RTI &gt; And, than the 2 (RX2 _L) the left receiving sound from the other party receives the sound of the more increased the right reception sound (RX2 _R) is so much smaller in the end receiving the left sound (RX2 _L) is the right reception sound (RX2 _R) It grows.

Then, to the terminal user, it is felt that the reception sound of the first party and the second party is heard more in accordance with the positional variation of the image.

Eleventh Example

Referring to Figs. 14 and 15, a description will be given of a conference calling method according to an eleventh embodiment of the present invention. FIG. 14 is a schematic flowchart of a multi-party calling method according to an eleventh embodiment of the present invention, and FIG. 15 is a diagram illustrating a concept of a multi-party calling method according to the eleventh embodiment of the present invention.

In this embodiment, a head transfer function is used for realizing a three-dimensional virtual sound. First, the head transfer function (HRTF) will be briefly described.

3D virtual sound synthesis refers to a technique whereby a virtual sound image can be reproduced from a mono sound recording of a sound signal at a specific position in a three-dimensional space.

3D virtual sound technology allows a three-dimensional sound effect to be generated using only one pair of speakers or a headset. In most 3D virtual sound effects technology, the mono sound signal is transformed by a pair of filters to simulate three-dimensional sound signals. The three-dimensional acoustic signals are sensed by the eardrum of the listener so that the actual sound source appears to be in a specific location in the three-dimensional space. The pair of filters, known as Head-Related Transfer Function (HRTF), simulate transfer functions for the acoustic paths from the mono sound source to the left and right ears of the listener . The HRTF reflects the changes that acoustic waves experience in free space on the path from the source to the listener's ear. A pair of HRTFs is associated with each location of the source. The HRTF measurement is briefly described as follows.

The head transfer function (HRTF) is measured in an anechoic chamber with respect to the dummy head. That is, the impulse response (impulse response) measured by a microphone mounted on both ears of the dummy head is measured by radiating an impulse signal from a plurality of loudspeakers disposed at various angles in the form of a sphere around the dummy head in an anechoic chamber The head transfer function is obtained.

The method of obtaining the head transfer function will be described in more detail as follows. That is, after the elevation and the azimuth are subdivided at regular intervals (for example, at intervals of 10 degrees) around the dummy head, the speakers are placed at respective subdivided angles and an impulse signal is outputted, And the impulse response is measured by measuring the arrival signal of the left and right microphones. At this time, the head transfer function of the unmeasured space can be obtained by interpolation between adjacent head transfer functions. For more information on HRTF, see " Introduction to Head - Related Transfer Functions (HRTFs): Representations of HRTFs in Time , Frequency , and Space , Cheng , Corey I. and Wakefield , G., H., Journal of Audio Engineering Society , vol. 49 no . 4 pp. 231-249; April 2001 ".

When the mobile terminal 1 returns to the present embodiment, the mobile terminal 1 is in a video call with two opponents, that is, the first opponent Smith and the second opponent John. On the display screen 400, 15, a first counterpart image 410 and a second counterpart image 420 are displayed on the left side and the right side, respectively, on the screen (S141).

The first counterpart reception sound RX1 is input to the three-dimensional virtual sound synthesis module 830 and is filtered by a head transfer function HRTF1 corresponding to the position of the first counterpart image 410, _L ) and the right reception sound RX1 _R (S142).

The second counterpart reception sound RX2 is input to the three-dimensional virtual sound synthesis module 830 and is filtered by a head transfer function HRTF2 corresponding to the position of the second counterpart image 420, (RX2 _L ) and the right reception sound RX2 _R (S142).

Then, the first sound is output to the other party receives the left _(L RX1) and the second party receives the left sound (RX2 _L) are combined with each other through the left channel of the sound output unit (600) [S143, S144] . The first counterpart right reception sound RX1 _R and the second counterpart right reception sound RX2 _R are combined and output through the right channel of the sound output unit 600 (S143, S144).

Accordingly, the reception sound RX1 of the first counterpart and the reception sound RX2 of the second counterpart are heard as a three-dimensional virtual sound generated at the image position to the terminal user.

When the mobile terminal 1 makes a video call with a plurality of counterparts, the sound received from each counterpart is filtered by a head transfer function corresponding to the position of each counterpart image, and then output. As those skilled in the art will readily understand from the foregoing description, a detailed description thereof will be omitted for the sake of simplicity.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. For example, the above-described embodiments can be used in combination with each other as needed. In particular, among the above-described embodiments, it is of course possible to combine the embodiments in which the volume of the reception sound is adjusted for each counterpart and the embodiment in which the reception sound of each counterpart is generated at the position of the image.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

The multi-party calling method according to the present invention and the effect of the communication terminal capable of implementing the multi-party calling method will be described as follows.

First, according to the present invention, when a plurality of parties communicate with each other, the volume of sound received from each other can be individually adjusted, and the volume of sound transmitted to each party can also be individually adjusted. Therefore, when the volume of the sound received from each of the other parties is different from each other, the user can easily adjust the volume of the sound to be heard by the user. In addition, It is advantageous that it can be adjusted and delivered.

Second, according to the present invention, when a video call is made with a plurality of parties, it is possible to make the sound of each party sound as if it is generated at the position of the image of each party. Accordingly, even if a plurality of parties have similar voices, it is possible to discriminate the reception sounds of a plurality of parties by knowing in which direction the voice of each party is heard.

Claims (18)

Displaying an image of two or more parties for performing a multi-party video call; Performing a multi-party video call with the at least two parties; Adjusting at least one image size of the at least two displayed images by user input; And Adjusting the volume of reception sound from the other party in proportion to the size of the adjusted image as the at least one image size is adjusted. delete 2. The method of claim 1, Further comprising the step of individually adjusting the volume of the transmission sound to each of the other parties. 2. The method of claim 1, Further comprising the step of automatically adjusting the volume of the reception sound from each counterpart to a predetermined size. 5. The method of claim 4, Wherein the predetermined size is set by a user. delete Displaying an image of two or more parties for performing a multi-party video call; Performing a multi-party video call with the at least two parties; Moving at least one image position of the at least two displayed images by user input; And And a volume adjusting step of gradually adjusting volume magnitudes of left and right receiving sound from the moved image side counterpart as the at least one image position is moved. 8. The method of claim 7, wherein in the volume adjustment step, When the position of any one of the two or more pictures is positioned to the left or right of the display screen of the terminal, the volume magnitude of the reception sound of any one of the image sides is the volume magnitude of the reception sound of the remaining image side The method further comprising the step of: 9. The method of claim 8, The step of adjusting the volume magnitude of the received sound on either side of the image to be larger than the volume magnitude of the received sound on the other side of the image in proportion to the degree to which the position of any one of the two or more images is biased The method comprising the steps of: delete delete 8. The method of claim 7, wherein in the volume adjustment step, The volume magnitude of the reception sound corresponding to the direction in which the position of the at least one image moves among the left and right reception sounds gradually increases and the volume magnitude of the reception sound corresponding to the direction opposite to the moving direction gradually decreases Featured multi-party calling method. Displaying an image of two or more parties for performing a multi-party video call; Performing a multi-party video call with the at least two parties; Filtering the reception sound received from each of the other parties according to a position at which the image of each counterpart is displayed, by a head transfer function, and separating the sound into left and right sounds of each counterpart; And And outputs the three-dimensional virtual sound through the left channel of the sound output unit, and outputs the three-dimensional virtual sound through the right channel of the sound output unit by summing all the right sound of the separated counterparts, And outputting the conference call to the communication terminal. delete 14. The method of claim 13, Further comprising the step of individually adjusting the volume of the reception sound from each of the other parties. A display unit for displaying images of two or more parties for performing a multi-party video call; A communication unit for establishing a conference call with the at least two parties; And Controlling the volume of at least one of the displayed two or more images by user input to be adjusted so that as the at least one image size is adjusted, the volume of sound received from the other party in proportion to the size of the adjusted image And a control unit for controlling the communication terminal. A display unit for displaying images of two or more parties for performing a multi-party video call; A communication unit for connecting a multi-party video call with the at least two parties; And And controls the moving of at least one image position among the displayed two or more images by user input so that as the at least one image position is moved, the volume magnitude of the left and right receiving sound from the moved image side counterpart And a control unit And a communication terminal. A voice output unit for outputting sound through the bidirectional channel; A display unit for displaying images of two or more parties for performing a multi-party video call; A communication unit for connecting a multi-party video call with the at least two parties; And A sound receiving unit for receiving sound received from each of the other parties according to a position at which an image of each of the other parties is displayed is filtered by a head transfer function so as to be output to the left and right sounds of each of the other parties, And outputting the three-dimensional virtual sound through the left channel, and outputting the three-dimensional virtual sound through the right channel of the sound output unit by summing all the right sounds of the respective counterparts.

Images