KR20080098806A - Multi-way call method and communication terminal that can implement it - Google Patents

Abstract

The present invention relates to a multi-party call method provided to a terminal user so as to make more convenient call sounds to and from multiple parties during a multi-party call, and a communication terminal capable of implementing the same. And a volume control step of allowing a volume to be individually adjusted for a call with each other. According to the present invention, when making a call with a plurality of counterparts, the volume of the sound received from each counterpart can be individually adjusted, and the volume of the sound transmitted to each counterpart can be individually adjusted. .

Description

Multi-way call method and communication terminal that can implement it {METHOD FOR CONNECTING CONFERENCE CALL AND COMMUNICATION TERMINAL IMPLEMENTING THE SAME}

1 is a schematic block diagram showing the configuration of a mobile terminal according to the present invention.

2 is a schematic flowchart of a multi-party call method according to the first to sixth embodiments of the present invention.

3 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to the first embodiment of the present invention is implemented.

4 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a second embodiment of the present invention is implemented.

5 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a third embodiment of the present invention is implemented.

6 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a fourth embodiment of the present invention is implemented.

7 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a fifth embodiment of the present invention is implemented.

8 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a sixth embodiment of the present invention is implemented.

9 is a schematic flowchart of a conference method according to the seventh to tenth embodiments of the present invention.

10 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a seventh embodiment of the present invention is implemented.

11 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to an eighth embodiment of the present invention is implemented.

12 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a ninth embodiment of the present invention is implemented.

FIG. 13 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a tenth embodiment of the present invention is implemented.

14 is a schematic flowchart of a conference method according to an eleventh embodiment of the present invention.

15 is a diagram illustrating the concept of a multi-party call method according to an eleventh embodiment of the present invention.

<Description of the symbols for the main parts of the drawings>

1: mobile terminal 100: communication unit

200: memory unit 300: camera unit

400: display unit 500: sound input unit

600: sound output unit 700: input unit

800: control unit 830: three-dimensional virtual acoustic synthesis module

The present invention relates to a multi-party call method, and more particularly, to a multi-party call method provided to a terminal user so as to make more convenient tones to and from each other during a multi-party call, and a communication terminal capable of implementing the same.

Today, due to the remarkable developments in the field of telecommunications and broadcasting, there is a rapid change in the environment of telecommunications and broadcasting. Among these changes, mobile terminals are used as much as they are considered necessities in modern society. Also, in recent years, as the development of communication technology has accelerated more and more, a multi-party call (for example, a conference call) in which several people make a call simultaneously, or a video call while watching each other's faces through video Communication terminals capable of communicating are gradually being introduced.

However, when there are a large number of parties to the call and the voice of any one of them is small and the voice of a certain party is large, there is a problem in that it is difficult to adjust the reception volume in the conventional terminal.

In addition, when the voices of the multiple counterparts are similar to each other and / or the multiple counterparts talk at the same time, the user of the conventional terminal has a problem in that it is not easy to distinguish who is among the multiple counterparts.

Accordingly, the present invention has been proposed to solve the above-described problems, a multi-party call method that is easy to adjust the volume of the reception volume from them when there are a large number of parties, and easy to distinguish the voices from the multiple parties and the same. It is an object of the present invention to provide a communication terminal that can be implemented.

In order to achieve the above object, the present invention provides a communication terminal including a multi-party call performing step of making a multi-party call with two or more counterparts, and a volume adjusting step of allowing the volume to be individually controlled for each call with the other party. Provides a multi-way call method.

In addition, in order to achieve the above object, the present invention, according to the multi-party video call step of performing a multi-party video call with two or more counterparts, and the position of the image received and displayed from each other, the left and right of each other Provided is a multi-party communication method in a communication terminal including a volume control step of adjusting the volume of the received sound is different.

In addition, in order to achieve the above object, the present invention provides a multi-party video call step of performing a multi-party video call with two or more counterparties, and the reception sound from each counterpart corresponds to a position where the image of each counterpart is displayed. Provided is a multi-way communication method in a communication terminal comprising a three-dimensional virtual sound output step of output as three-dimensional virtual sound.

In order to achieve the above object, the present invention provides a communication terminal including a communication unit for connecting a multi-party call with two or more counterparts, and a control unit for controlling the volume can be individually adjusted for the call with each other party. to provide.

In order to achieve the above object, the present invention provides a communication unit for connecting a multi-party video call with two or more counterparts, a display unit for displaying an image of the video call, and the position of the image received from each other and displayed on the display unit According to the present invention, a communication terminal including a control unit for controlling the volume of the left and right reception sound of each counterpart may be adjusted to be different from each other.

In order to achieve the above object, the present invention provides a communication unit for connecting a multi-party video call with two or more counterparts, a display unit for displaying an image of the video call, and the reception sound from each of the other parties on the screen of the display unit; Provided is a communication terminal including a control unit for controlling to output as a three-dimensional virtual sound corresponding to the position of the image of each counterpart.

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention that can specifically realize the above object will be described.

The present invention can be applied to various types of terminals such as a laptop and a desktop as well as a mobile terminal such as a mobile phone as long as the terminal can receive video communication. Hereinafter, for the sake of simplicity, the present invention will be described using video communication through a mobile mobile terminal such as a mobile phone as an example, but the present invention is not limited thereto. Therefore, it should be noted that the present invention is not limited to the following description and embodiments.

First, a configuration of a mobile terminal according to the present invention will be described with reference to FIG. 1. 1 is a schematic block diagram showing the configuration of a mobile terminal according to the present invention.

As shown in FIG. 1, the mobile terminal 1 according to the present invention includes a communication unit 100, a memory unit 200, a camera unit 300, a display unit 400, a sound input unit 500, and an audio output. It is preferably configured to include the unit 600, the input unit 700, and the control unit 800.

Of course, the mobile terminal according to the present invention may be configured to include other than the above-described components (for example, the battery unit, etc.), if necessary, anything other than the above-described components are directly related to the present invention. Since it is not there, for the sake of simplicity, a detailed description thereof will be omitted below.

On the other hand, it should be noted that the components may be configured by combining two or more components into one component, or one component may be subdivided into two or more components as necessary when implemented in actual applications.

Hereinafter, the components of the mobile terminal 1 will be described in sequence.

The communication unit 100 preferably allows the mobile terminal 1 to perform video communication with two or more counterpart terminals through a mobile communication network. That is, the communication unit 100 transmits an image captured by the camera unit 300 to the counterparts while the terminal user makes a voice call with two or more counterparts using the mobile terminal. It serves to receive counterpart images. Of course, the communication unit 100 may support a general voice call.

The memory unit 200 stores various software and various data for driving various functions provided by the mobile terminal 1. The memory unit 200 preferably includes a left volume and a right volume of a sound received from the other party (hereinafter referred to as "receive sound") according to a position on the screen of the display unit 400 of the other party's reception image. It stores data about relative sizes. In addition, the memory unit 200 preferably corresponds to each position of the display unit screen, so that the reception sound from the counterpart can be output as a three-dimensional virtual sound generated at the position where the reception image is displayed. Contains the Head-Related Transfer Function (HRTF). This will be explained later in detail.

The camera unit 300 is for capturing a still image or a video, and is preferably arranged to capture a state of a terminal user during a video call. If necessary, the mobile terminal 1 further includes at least one camera unit (not shown) in addition to the camera unit 300, and the at least one camera unit further captures a scene other than the terminal user during a video call. It may also be configured to provide to the other party.

The display unit 500 displays a screen according to a real-time operating situation of the mobile terminal 1 and various functions provided by the mobile terminal 1. When the display unit 500 is configured as a touch screen, the display unit 500 may serve as an input unit for receiving various touch commands or information from a terminal user. In particular, the display unit 500 displays an image for the video call. In the following description, not only the display unit but also the screen of the display unit will be referred to as 500.

The sound input unit 500 serves to receive a sound of a terminal user to be transmitted to the other party (hereinafter, referred to as a "transmission sound") during a call with the other party.

The sound output unit 600 plays a role of outputting a reception sound from a counterpart when a call is made with the counterpart. The sound output unit 600 is preferably composed of two channels (for example, the left channel and the right channel), it is preferable that the received sound is configured so that the output can be divided into the left and the right receiving sound. Do.

The input unit 700, such as a keypad, for example, allows a terminal user to input various information or commands to the terminal 1. When the display unit 400 is configured as a touch screen to serve as a separate input unit, the input unit 700 may be omitted from the configuration of the mobile terminal 1.

The control unit 800 includes the communication unit 100, the memory unit 200, the camera unit 300, the display unit 400, the sound input unit 500, the sound output unit 600, And by controlling the input unit 700, a multi-party call method to be described later to be implemented in the mobile terminal (1). The control unit 800 may be configured to include a three-dimensional virtual acoustic synthesis module 850, if necessary. The virtual stereophonic synthesis module 850 may be configured as a separate component independently of the controller 800. The 3D virtual sound synthesis module 850 enables the 3D virtual sound output to be implemented in the mobile terminal 1, which will be described later.

Hereinafter, the multi-party call method according to the present invention will be described by dividing by embodiment. Hereinafter, it is assumed that the display unit 400 is configured as a touch screen so that various commands can be input through the touch screen. This is merely for convenience of description, and the following embodiments may be implemented through command input through the input unit 700.

First Example

2 and 3, a multi-party call method according to a first embodiment of the present invention will be described. 2 is a schematic flowchart of a multi-party call method according to a first embodiment of the present invention, and FIG. 3 is a diagram illustrating a screen of a display unit of a mobile terminal in which the multi-party call method according to the first embodiment of the present invention is implemented.

The mobile terminal 1 is in a video call with two counterparts, namely, the first counterpart Smith and the second counterpart Judy [S21]. Naturally, the mobile terminal 1 can make a video call with three or more opponents. The same is true in the following embodiments.

In addition, as illustrated in (3-1) of FIG. 3, the display unit screen 400 displays the first counterpart image 410 and the second counterpart image 420, respectively. In addition, the display unit screen 400 displays individual receiving volume indicators 411 respectively indicating the magnitude of the volume of the received sound RX1 from the first counterpart and the volume of the received sound RX2 from the second counterpart. 421 is displayed.

However, suppose that the voice of the first party is too small to be heard while the voice of the second party is too loud. In this case, when the sound output of the sound output unit 600 of the mobile terminal 1 is made large as a whole, the voice of the first party can be heard well, but the voice of the second party becomes louder. However, if the sound output of the voice output unit 600 is reduced as a whole, the voice of the second counterpart may be appropriate for listening, but the voice of the first counterpart becomes smaller.

At this time, the terminal user can increase the volume of the received sound from the first counterpart while reducing the volume of the received sound from the second counterpart as shown in (3-2) of FIG. 3 [S22]. . This may be done by simply touching and dragging the indicators 411 and 421 displayed on the screen of the display unit, or through proper key manipulation of the input unit 700. This can be easily understood by those skilled in the art without much explanation, so the detailed description will be omitted for simplicity of the present specification.

Thus, the terminal user can talk to the first and second parties with an appropriate volume of the received sound.

The reception volume adjustment may be configured to automatically adjust the volume sizes of the first counterpart reception sound and the second counterpart reception sound so as to have a predetermined predetermined size by the terminal user, respectively.

This embodiment can of course be extended to not only multi-party video call but also multi-party general voice call.

2nd Example

4, a second embodiment according to the present invention will be described. 4 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a second embodiment of the present invention is implemented.

As shown in (4-1) of FIG. 4, the display unit screen 400 displays the first counterpart image 410 and the second counterpart image 420, respectively. In addition, the display unit displays a reception volume indicator 431 indicating the volume of the reception sound of the first and the reception sound of the second party as a whole. In addition, the display unit 400 displays a reception volume distributor 433 in the form of a bar for distributing a relative volume size between the reception sound of the first counterpart and the reception sound of the second counterpart. In (4-1) of Fig. 4, the reception volume distributor 433 is set so that the relative volume size between the first counterpart reception sound and the second counterpart reception sound is the same.

Assume that the reception sound of the first party and the reception sound of the second party are both small and difficult to hear. Then, the terminal user uses the reception volume indicator 431 to increase the total volume of the reception sound of the first party and the reception sound of the second party as shown in (4-2) of FIG. 4. To do that.

By the way, it is now assumed that the reception sound of the first counterpart is too small for the terminal user, but the reception sound of the second counterpart is too loud and sounds loud.

At this time, the terminal user adjusts the reception volume distributor 433 to increase the volume of the reception sound of the first party and the reception sound of the second party, as shown in (4-3) of FIG. Make the volume of the volume smaller. Then, the terminal user can make a call with the first counterpart and the second counterpart with an appropriate received sound volume level.

This embodiment can of course be extended to not only multi-party video call but also multi-party general voice call.

3rd Example

With reference to FIG. 5 further, a third embodiment which is a modification of the above-described first embodiment will be described. 5 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a third embodiment of the present invention is implemented.

As shown in (5-1) of FIG. 5, the display unit screen 400 displays the first counterpart image 410 and the second counterpart image 420, respectively. In addition, the display unit screen 400 displays individual receiving volume indicators 411 respectively indicating the magnitude of the volume of the received sound RX1 from the first counterpart and the volume of the received sound RX2 from the second counterpart. 421 is displayed. In addition, the display unit screen 400 displays individual transmission volume indicators 413 respectively indicating the magnitude of the volume of the transmission sound TX1 to the first party and the volume of the transmission sound TX2 to the second party. 423 is displayed

By the way, it is assumed that the voice of the first counterpart is too small to be heard by the terminal user while the voice of the second counterpart is too loud and loud. And, suppose that the first counterpart requests the terminal user to speak a smaller voice, and the second counterpart requests the terminal user to speak a larger voice.

At this time, the terminal user can increase the volume of the received sound from the first counterpart while reducing the volume of the transmitted sound to the first counterpart as shown in (5-2) of FIG. In addition, the terminal user can increase the volume of the transmission sound to the second counterpart while reducing the volume of the received sound from the second counterpart. Since the operation of increasing or decreasing the volume has already been described in the first embodiment, a detailed description thereof will be omitted for simplicity of the present specification.

Thus, the terminal user can make a call with the first and second parties with an appropriate volume for receiving sound and volume for transmitting.

This embodiment can of course be extended to not only multi-party video call but also multi-party general voice call.

4th Example

With reference to FIG. 6 further, the fourth embodiment which is a modification of the above-described second embodiment will be described. 6 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a fourth embodiment of the present invention is implemented.

As shown in (6-1) of FIG. 6, the display unit screen 400 displays a first counterpart image 410 and a second counterpart image 420, respectively. In addition, the display unit screen has a reception volume indicator 431 representing the volume of the received sound of the first party and the received sound of the second party as a whole, a transmission sound to the second party, and a transmission sound to the second party. A transmission volume indicator 441 indicating the volume size of the display as a whole is displayed. In addition, the display unit screen 400 includes a reception volume distributor 433 for distributing a relative volume size between the reception sound of the first counterpart and the reception sound of the second counterpart, and the transmission sound and the second sound to the first counterpart. A transmission volume distributor 443, which allows to distribute the relative volume size between transmission sounds to the other party, is displayed, for example, in the form of a bar. In (6-1) of FIG. 6, the reception volume distributor 433 is configured such that the relative volume size between the first counterpart reception sound and the second counterpart reception sound is the same, and the transmission volume distributor 443 transmits the first counterpart. The relative volume level between the sound and the second counterpart transmission sound is set to be the same.

It is assumed that the terminal user hears the received sound of the first counterpart and the second counterpart because both of them are small, and the first and second counterparts are asking the terminal user to speak a smaller voice. Then, the terminal user uses the reception volume indicator 431 to increase the total volume of the reception sound of the first party and the reception sound of the second party as shown in (6-2) of FIG. 6. To do that. Then, the terminal user uses the transmission volume indicator 441, and as shown in (6-2) of FIG. 6, the magnitude of the total volume of the transmission sound to the first counterpart and the transmission sound to the second counterpart. To increase.

Now, it is assumed that the first user's voice is too small to be heard well by the terminal user, while the second party's voice is too loud and loud. And, suppose that the first counterpart requests the terminal user to speak a smaller voice, and the second counterpart requests the terminal user to speak a larger voice.

At this time, the terminal user adjusts the reception volume distributor 433 to increase the volume of the reception sound of the first party as shown in (6-3) of FIG. 6 and the reception sound of the second party. Make the volume of the volume smaller. In addition, the terminal user adjusts the transmission volume distributor 443 so that the volume size of the transmission sound to the first counterpart becomes small and the volume size of the transmission sound to the second counterpart increases. The terminal user can then talk to the first and second parties with the appropriate volume of incoming and outgoing sounds.

This embodiment can of course be extended to not only multi-party video call but also multi-party general voice call.

5th Example

With reference to FIG. 7 further, the fifth embodiment which is a modification of the above-described second embodiment will be described. 7 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a fifth embodiment of the present invention is implemented.

As illustrated in (7-1) of FIG. 7, the display unit screen 400 displays a first counterpart image 410 and a second counterpart image 420, respectively. In addition, the display unit displays a reception volume indicator 431 indicating the volume of the reception sound of the first and the reception sound of the second party as a whole.

Assume that the reception sound of the first party and the reception sound of the second party are both small and difficult to hear. Then, the terminal user uses the reception volume indicator 431 to increase the total volume of the reception sound of the first party and the reception sound of the second party as shown in (7-2) of FIG. 7. To do that.

By the way, it is now assumed that the reception sound of the first counterpart is too small for the terminal user, but the reception sound of the second counterpart is too loud and sounds loud.

At this time, the terminal user increases the size of the first counterpart image while reducing the size of the second counterpart image, as shown in (7-3) of FIG. As a result, the volume of the received sound of the first counterpart is increased and the volume of the received sound of the second counterpart is reduced. The terminal user can then talk to the first and second parties at the appropriate volume level.

If the reception sound of the first counterpart is small but the reception sound of the second counterpart is appropriate, only the size of the first counterpart image may be adjusted so as to obtain an appropriate reception sound volume size.

6th Example

Referring to Fig. 8 further, a sixth embodiment which is a modification of the above-described first embodiment will be described. 8 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a sixth embodiment of the present invention is implemented.

As shown in (8-1) of FIG. 8, the display unit screen 400 displays a first counterpart image 410 and a second counterpart image 420, respectively. 8 (8-1), the first counterpart image 410 is selected and activated. Accordingly, the display unit 400 displays an individual receiving volume indicator 411 which displays the size of the volume of the received sound RX1 from the first counterpart.

If the second counterpart image 420 is selected and activated as shown in (8-2) of FIG. 8, the display unit 400 displays the size of the volume of the received sound RX2 from the second counterpart. The individual receiving volume indicator 421 to display is displayed.

Accordingly, the terminal user may select and activate a desired image from the first counterpart image 410 and the second counterpart image 420 to adjust the corresponding reception sound. The selection of the image may be performed by a terminal user touching a desired image among the images displayed on the screen of the display unit, or may be performed through an appropriate key operation of the input unit 700.

7th Example

9 and 10, a multi-party call method according to a seventh embodiment of the present invention will be described. 9 is a schematic flowchart of a multi-party call method according to a seventh embodiment of the present invention, and FIG. 10 is a diagram illustrating a screen of a display unit of a mobile terminal in which the multi-party call method according to the seventh embodiment of the present invention is implemented.

The mobile terminal 1 is in a video call with two counterparts, namely, a first counterpart (Smith) and a second counterpart (John). On the display unit 400, as shown in FIG. The counterpart image 410 and the second counterpart image 420 are displayed on the left side and the right side, respectively, on the screen [S91].

The sound output unit 600 of the mobile terminal 1 is composed of two channels (i.e., left channel and right channel), and the reception sound from the counterpart is divided into a left reception sound and a right reception sound. It is preferably configured to be output through the channel and the right channel. The same is true in the following embodiments.

Hereinafter, for the sake of simplicity, the sound received from the first counterpart will be referred to as RX1, and the sound received from the second counterpart will be referred to as RX2. The reception sound RX1 of the first party is divided into a first party left reception sound RX1 _L and a first party right reception sound RX1 _R and output through the left channel and the right channel, respectively. And, the reception sound RX2 of the second party is divided into a second party left reception sound RX2 _L and a second party right reception sound RX2 _R and output through the left channel and the right channel, respectively.

Meanwhile, the sound finally output by the sound output unit 600 through the left channel will be referred to as RX _L , and the sound output through the right channel will be referred to as RX _R.

The relationship between the received sound and the output sound described above is summarized as follows.

Left channel output sound (RX _L ) = first party's left reception sound (RX1 _L ) + second party's left reception sound (RX2 _L )

Right channel output sound (RX _R ) = first far right sound (RX1 _R ) + second far right sound (RX2 _R )

As shown in FIG. 10, an image of a first counterpart is displayed on the left side of the display unit screen 400, and an image of a second counterpart is displayed on the right side of the display unit screen 400.

Accordingly, the received sound of the first counterpart is divided so that the left received sound is larger than the right received sound as follows, and is output to the left channel and the right channel [S92].

First party's left-handed incoming sound RX1 _L > First party's right-handed incoming sound RX1 _R

Extremely, only the first counterpart left reception sound RX1 _L may be output and the first counterpart right reception sound RX1 _R may not be output.

Then, the received sound of the second counterpart is divided so that the right received sound is larger than the left received sound as follows, and is output to the left channel and the right channel [S92].

2nd party's left side RX2 _L <2nd party's right side RX2 _R

In an extreme case, the second counterpart left reception sound RX2 _L may not be output, and only the second counterpart right reception sound RX2 _R may be output.

That is, the terminal user feels that the reception sound of the first party is heard from the left side to match the position of the first party image, and the reception sound of the second party is heard from the right side to match the position of the second party image. It feels like

Therefore, when the terminal user makes a video call with the two counterparts, even if the voices of the counterparts are similar or they speak at the same time, it is easy to distinguish who is talking about what.

8th Example

With reference to Fig. 11 further, an eighth embodiment which is a modification of the above-described seventh embodiment will be described. 11 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to an eighth embodiment of the present invention is implemented.

The mobile terminal 1 is in a video call with three counterparts, namely, the first counterpart Smith, the second counterpart John, and the third counterpart Tom, and the display unit 400 includes FIG. 11. As shown in FIG. 1, the first counterpart image 410, the second counterpart image 420, and the third counterpart image 450 are displayed on the left side, the right side, and the center on the screen, respectively.

Hereinafter, for the sake of simplicity, the sound received from the first counterpart is referred to as RX1, the sound received from the second counterpart is referred to as RX2, and the sound received from the third counterpart is referred to as RX3. The reception sound RX1 of the first party, the reception sound of the second party, and the reception sound of the third party are respectively the left reception sound RX1 _L , RX2 _L , RX3 _L and the right reception sound RX1 _R , RX2 _R , RX3 _R ) is divided into a left channel output sound RX _L and a right channel output sound RX _R through the left and right channels of the sound output unit 600.

The relationship between the above-described reception sound and output sound is summarized as follows.

Left channel output sound (RX _L ) = first party's left reception sound (RX1 _L ) + second party's left reception sound (RX2 _L ) + third party's left reception sound (RX3 _L )

Right channel output sound (RX _R ) = first party's right receiving sound (RX1 _R ) + second party's right receiving sound (RX2 _R ) + third party's right receiving sound (RX3 _R )

As shown in FIG. 11, an image of a first counterpart is displayed on the left side of the display unit screen 400, an image of a second counterpart is displayed on the right side of the display unit screen 400, and a third The other party's image is displayed in the center of the display unit 400.

Accordingly, the reception sound of the first counterpart is divided so that the left reception sound is larger than the right reception sound, and the reception sound of the second counterpart is divided so that the right reception sound is larger than the left reception sound as follows. Is output. Since this is the same as the seventh embodiment described above, a detailed description thereof will be omitted.

Then, the received sound of the third counterpart is divided into a left receiving sound and a right receiving sound so as to be substantially equal to each other, and are output to the left channel and the right channel as follows.

Third party's left receive sound (RX3 _L ) = Third party's right receive sound (RX3 _R )

That is, the terminal user feels that the reception sound of the first party is heard from the left side to match the position of the first party image, and the reception sound of the second party is heard from the right side to match the position of the second party image. It is felt that the received sound of the third party is heard from the center to match the position of the third party's image.

9th Example

12, the ninth embodiment, which is another modified example of the above-described seventh embodiment, will be described. 12 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a ninth embodiment of the present invention is implemented.

As shown in (12-1) of FIG. 12, the first counterpart image 410 and the second counterpart image 420 are displayed on the left and right sides of the display unit screen, respectively. Accordingly, as described in Equations 2 and 3, the reception sound of the first counterpart is divided so that the left reception sound is larger than the right reception sound and the reception sound of the second counterpart is larger than the left reception sound. It is output to the channel and the right channel.

At this time, assume that the terminal user moves the position of the first counterpart image further to the left as shown in (12-2) of FIG.

Then, the reception sound of the first counterpart is divided so that the left reception sound is larger than the right reception sound as follows, and is output to the left channel and the right channel.

First opponent's left RX1 _L >> first party's right RX1 _R

Next, suppose that the terminal user moves the position of the second counterpart image further to the right as shown in (12-3) of FIG.

Then, the received sound of the second counterpart is divided so that the right received sound is larger than the left received sound as follows, and is output to the left channel and the right channel.

Second party's left receive sound (RX2 _L ) << second party's right receive sound (RX2 _R )

Then, the terminal user feels that the reception sound of the first counterpart and the second counterpart is heard more in accordance with the position of the image.

10th Example

Referring to Fig. 13 further, a tenth embodiment, which is another modification of the ninth embodiment described above, will be described. FIG. 13 is a diagram illustrating a screen of a display unit of a mobile terminal in which a multi-party call method according to a tenth embodiment of the present invention is implemented.

As shown in (13-1) of FIG. 13, the first counterpart image 410 and the second counterpart image 420 are displayed on the left and right sides of the display unit screen, respectively. Accordingly, as described in Equations 2 and 3, the reception sound of the first party is greater than the left reception sound RX1 _L toward the right reception sound RX1 _R , and the reception sound of the second party is right reception sound ( RX2 _R ) is divided into greater than the left reception sound (RX2 _L ) and outputted to the left channel and the right channel.

Then assume that the terminal user wants to swap positions of the images. The position change of the images may be performed by touch-and-drag the image on the display unit or may be performed through proper key manipulation of the input unit 700. Since it will be easily understood by those skilled in the art even if there is no separate description, a detailed description thereof will be omitted.

In order to change the position of the images, the images are gradually moved to the center of the display unit screen as shown in (13-2) of FIG. At this time, the left receiving sound RX1 _L gradually decreases and the right receiving sound RX1 _R gradually increases in the received sound of the first counterpart so that the first counterpart image 410 moves to the center of the display screen 400. When the left receiving sound (RX1 _L ) and the right receiving sound (RX1 _R ) is the same as each other. In addition, when the second reception image 420 is moved to the center of the display unit 400, the left reception sound RX2 _L gradually increases in the received sound of the second counterpart and the right reception sound RX2 _R gradually decreases. The left receiving sound RX2 _L and the right receiving sound RX2 _R become equal to each other.

Next, as shown in (13-3) of FIG. 13, the images of the first counterpart image 410 are moved to the right on the display screen 400 and the second counterpart image 420 is displayed on the display. It is moved to the left side of the sub screen 400.

Then, than the first party receives the left at the receiving sound of the acoustic (RX1 _L) is the sound (RX1 _R) is smaller receiving right it is further large, the end receiving the left sound (RX1 _L) is the right reception sound (RX1 _R) Becomes smaller. And, in the reception sound of the second party, the left reception sound RX2 _L becomes larger and the right reception sound RX2 _R becomes smaller so that the left reception sound RX2 _L becomes smaller than the right reception sound RX2 _R. Gets bigger

Then, the terminal user feels that the reception sound of the first counterpart and the second counterpart is heard more in accordance with the positional change of the image.

11th Example

Referring to Figures 14 and 15, a multi-party call method according to an eleventh embodiment of the present invention will be described. 14 is a schematic flowchart of a conference method according to an eleventh embodiment of the present invention, and FIG. 15 is a diagram illustrating a concept of a conference method according to an eleventh embodiment of the present invention.

In this embodiment, a head transfer function is used for 3D virtual acoustic implementation. First, the head transfer function (HRTF) will be briefly described.

Three-dimensional virtual sound synthesis refers to a technique for allowing a virtual sound image to be reproduced at a specific position in three-dimensional space from a mono sound recording of an acoustic signal.

Three-dimensional virtual sound technology allows a three-dimensional sound effect to be generated using only a pair of speakers or headsets. In most three-dimensional virtual sound effect technologies, monotone signals are transformed by a pair of filters to simulate three-dimensional sound signals. The three-dimensional acoustic signals are sensed by the listener's eardrum to make it feel as if the actual sound source is at a specific location in the three-dimensional space. The pair of filters, known as Head-Related Transfer Function (hereinafter referred to as "HRTF"), simulate transfer functions for acoustic paths from the monotone source to the listener's left and right ears. . HRTF reflects the changes that acoustic waves experience in free space on the path from the sound source to the listener's ears. A pair of HRTFs is associated with each position of the sound source. The HRTF measurement is briefly described as follows.

The head transfer function (HRTF) is measured in an anechoic chamber for a dummy head. That is, the impulse response measured by microphones mounted on both ears of the dummy head by emitting an impulse signal from a plurality of speakers arranged at various angles in the form of a sphere around the dummy head in the anechoic chamber is measured. The hair transfer function is then obtained.

The method of obtaining the head transfer function is described in more detail as follows. That is, after dividing the elevation and azimuth at regular intervals (for example, 10 ° intervals) around the dummy head, the dummy head is output by outputting an impulse signal with the speaker at each subdivided angle. The impulse response is measured by measuring the arrival signal of the left and right microphones. At this time, the head transfer function of the non-measured discontinuous space can be obtained through interpolation between adjacent head transfer functions. For more information on the HRTF's paper "Introduction to Head - related Transfer Functions (HRTFs): Representations of HRTFs in Time , Frequency , and Space , Cheng , Corey I. and Wakefield , G., H., Journal of Audio Engineering Society , vol. 49 no .4 pp. 231-249; April 2001 ".

Returning to the present embodiment again, the mobile terminal 1 is in a video call with two opponents, namely, the first and second counterparts, John and John. As shown in Fig. 15, the first counterpart image 410 and the second counterpart image 420 are displayed on the left side and the right side, respectively, on the screen [S141].

The first party's reception sound RX1 is input to the 3D virtual sound synthesis module 830, filtered by the head transfer function HRTF1 corresponding to the position of the first party's image 410, and then left reception sound RX1. _L ) and the right receiving sound (RX1 _R ) are separated [S142].

Then, the second party's reception sound RX2 is input to the 3D virtual sound synthesis module 830, filtered by the head transfer function HRTF2 corresponding to the position of the second party's image 420, and then left reception sound. (RX2 _L ) and the right receiving sound (RX2 _R ) are separated [S142].

Then, the first counterpart left reception sound RX1 _L and the second counterpart left reception sound RX2 _L are combined with each other and output through the left channel of the sound output unit 600 [S143, S144]. Then, the first opposite right receiving sound RX1 _R and the second opposite right receiving sound RX2 _R are combined together and output through the right channel of the sound output unit 600 [S143, S144].

Thus, the terminal user hears the reception sound RX1 of the first party and the reception sound RX2 of the second party as a three-dimensional virtual sound generated at the image position.

When the mobile terminal 1 makes a video call with a plurality of counterparts, the received sound from each counterpart is filtered by a head transfer function corresponding to the position of each counterpart image and then output. This will be easily understood by those skilled in the art from the foregoing description, so a detailed description thereof will be omitted for simplicity of the present specification.

It is apparent to those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit and essential features of the present invention. For example, the above-described embodiments may be used in combination with each other as needed. In particular, among the above-described embodiments, the embodiment for adjusting the volume of the received sound for each counterpart and the embodiment for implementing the reception sound of each counterpart as generated in the position of the image may be combined with each other.

Accordingly, the above detailed description should not be construed as limiting in all aspects and should be considered as illustrative. The scope of the invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

Referring to the multi-party call method according to the present invention and the effect of a communication terminal that can implement the same as follows.

First, according to the present invention, when making a call with a plurality of counterparts, the volume of the sound received from each counterpart can be individually adjusted, and the volume of the sound transmitted to each counterpart can be individually adjusted. Therefore, when the volume of the sound received from each counterpart is different from each other, there is an advantage that the terminal user can easily adjust the volume of the sound, and also, each party has their own sound to each counterpart in a volume that is comfortable for the other party to listen to. There is an advantage that can be delivered by adjusting.

Secondly, according to the present invention, when making a video call with a plurality of counterparts, the reception sound of each counterpart may sound as if it is generated at the position of the image of each counterpart. Therefore, even if a plurality of counterparts have similar voices, it is possible to distinguish the reception sounds of the plurality of counterparts from each other by grasping in which direction the voice of each counterpart sounds.

Claims (18)

Performing a multi-party call in which a multi-party call is made with two or more counterparts; And Volume control step of allowing the volume can be adjusted individually for each call with the other party. According to claim 1, wherein the volume control step, And a step in which the volume of the received sound from each counterpart can be adjusted individually. According to claim 1, wherein the volume control step, And a step in which the volume of the transmission sound to each counterpart can be adjusted individually. The method of claim 2, wherein the volume control step, Multi-party call method characterized in that the volume of the received sound from each party is automatically adjusted to a certain size. The method of claim 4, wherein the volume control step, And the predetermined size is set by the user. The method of claim 2, The conference call is a video call, and the volume control step, And controlling the volume of the received sound from each counterpart in proportion to the size of the image received and displayed from each counterpart. Performing a multiparty video call in which a multiparty video call is made with two or more parties; And And a volume control step of adjusting the volume sizes of the left and right reception sounds of the respective counterparts according to the positions of the images received and displayed from each counterpart. The method of claim 7, wherein in the volume control step, When the position of the image is offset to the left or right side of the screen of the display unit of the terminal, the volume of the received sound on the biased side is adjusted to be larger than the volume of the received sound on the opposite side Call way. The method of claim 8, wherein in the volume adjustment step, And the volume size of the received sound on the biased side is greater than the volume size of the received sound on the opposite side in proportion to the degree of the position of the image shifted. The method of claim 7, wherein And moving the position of the image on the screen of the display of the terminal according to a user's selection. The method of claim 10, wherein in the volume control step, And as the position of the image is shifted, volume levels of the left and right reception sounds are gradually adjusted. The method of claim 11, wherein in the volume control step, The volume size of the reception sound corresponding to the direction in which the position of the image moves among the left and right reception sounds gradually increases, and the volume size of the reception sound corresponding to the opposite direction of the moving direction gradually decreases. How to conference. Performing a multiparty video call in which a multiparty video call is made with two or more parties; And And a three-dimensional virtual sound output step in which the received sound from each counterpart is output as a three-dimensional virtual sound corresponding to a position where the image of each counterpart is displayed. The method of claim 13, wherein the three-dimensional virtual sound output step, And filtering the received sound from each counterpart by using a head transfer function corresponding to the location of each counterpart image. The method of claim 13, The method according to claim 1, further comprising the step of individually adjusting the volume of the received sound from each party. A communication unit for connecting a conference call with two or more parties; And And a controller for controlling the volume to be individually controlled for a call with each other. A communication unit for connecting a multi-party video call with two or more parties; A display unit which displays an image of a video call; And And a controller configured to control the volume of the left and right reception sounds of each counterpart to be different from each other according to the position of the image received from each counterpart and displayed on the display unit. A communication unit for connecting a multi-party video call with two or more parties; A display unit which displays an image of a video call; And And a controller configured to control the reception sound from each counterpart to be output as a 3D virtual sound corresponding to a position where the image of each counterpart is displayed on the screen of the display unit.

Images