KR101334015B1 - Portable terminal having function of classifying speaker during multilateral image communication and method for classifying speaker during multilateral image communication - Google Patents

Abstract

Disclosed are a portable terminal having a speaker discrimination function for a multi-party video call and a speaker discrimination method for a multi-party video call. A storage unit storing volume weight information corresponding to each speaker participating in the multi-party video call, and based on the volume weight read after reading the volume weight corresponding to the predetermined speaker from the storage unit when the voice data is provided from the predetermined speaker. And a control unit for generating a volume control signal, and an audio codec for adjusting the volume of the left channel and the volume of the right channel, respectively, based on the volume control signal. Therefore, the video of the speaker can be easily distinguished from the video of the plurality of video call participants displayed on the display unit only by listening to the voice of the speaker through the headset.

Video call, multi-party, voice, separate

Description

PORTABLE TERMINAL HAVING FUNCTION OF CLASSIFYING SPEAKER DURING MULTILATERAL IMAGE COMMUNICATION AND METHOD FOR CLASSIFYING SPEAKER DURING MULTILATERAL IMAGE COMMUNICATION}

The present invention relates to a portable terminal, and more particularly, to a portable terminal having a speaker discrimination function for a multi-party video call and a speaker discrimination method for a multi-party video call, which can be applied to a portable terminal having a multi-party video call function.

With the evolution of mobile communication technology, full-scale video telephony has become commercially available, and it is now possible to make a call while looking at the other party using a portable terminal regardless of a place, away from the existing voice communication and mobile communication service focused on short message transmission.

In addition, at least two people have been able to participate in a video call at the same time and make a multi-party video call where they can see each other while viewing each other. Video calls are used for business purposes such as teleconferences.

In a typical multi-party video call, the video of all participants participating in the video call is displayed in a separate area of the display of the mobile terminal, and the voices of all the video call participants are output in the same size through a speaker or a headset provided in the mobile terminal. Video calls are made.

In the conventional multi-party video call as described above, since the display area of the portable terminal divides the display area and displays the video of each participant participating in the video call on a different display area, the video of each participant can be easily distinguished. Since the voice of each participant synchronized with the video is output at the same volume through the speaker or the headset, it is difficult to distinguish the video of the speaker corresponding to the output voice.

Accordingly, a first object of the present invention is to provide a portable terminal having a speaker discrimination function during a multi-party video call, which can easily distinguish the video of the speaker during the multi-party video call.

In addition, a second object of the present invention is to provide a method for distinguishing a speaker during a multi-party video call, which can easily distinguish the video of the speaker during the multi-party video call.

According to an aspect of the present invention, a portable terminal having a speaker discrimination function according to an aspect of the present invention for storing the volume weight information corresponding to each speaker participating in the multi-party video call is stored. And a control unit for generating a volume control signal based on the volume weight value read out from the storage unit when the voice data is provided from a predetermined speaker and the volume weight corresponding to the predetermined speaker. And an audio codec for adjusting the volume of the left channel and the volume of the right channel through which the voice of the predetermined speaker is output. The volume weights may be set for the left channel and the right channel through which the voice of the predetermined speaker is output. When the voice data is provided from the predetermined speaker, the controller may extract the call separator included in the voice data to identify the predetermined speaker from each speaker participating in the multi-party video call. The audio codec may include a first amplifier for adjusting the volume of the left channel based on the volume control signal and a second amplifier for adjusting the volume of the right channel based on the volume control signal. The portable terminal having a speaker discrimination function during the multi-party video call may further include a headset connection unit for receiving the voice of the predetermined speaker in which the volume of the left channel and the volume of the right channel are respectively adjusted.

In addition, the method of distinguishing the speaker during the multi-party video call, which can easily distinguish the video of the speaker during the multi-party video call according to an aspect of the present invention for achieving the second object of the present invention, the voice data is provided from a predetermined speaker Reading a volume weight corresponding to a predetermined speaker; generating a volume control signal based on the read volume weight; and generating a volume control signal based on the generated volume control signal. Adjusting the volume of the volume and the right channel, respectively. The volume weights may be set for the left channel and the right channel through which the voice of the predetermined speaker is output. When the voice data is provided from the predetermined speaker, the step of reading a volume weight corresponding to the predetermined speaker may include extracting a call separator included in the voice data when the voice data is provided from the predetermined speaker. And identifying the predetermined speaker among each speaker participating in the. The method of distinguishing a speaker during the multi-party video call may further include providing a voice of the predetermined speaker in which the volume of the left channel and the volume of the right channel are respectively adjusted to the headset connection unit.

The portable terminal having the speaker discrimination function in the multi-party video call and the speaker discrimination method in the multi-party video call identify the predetermined speaker from the voice data when the voice data is provided from a predetermined speaker and correspond to the identified speaker. The volume weight is read from the storage. The volume of the predetermined speaker is adjusted based on the read volume weight and then output through the headset connection unit.

Therefore, the video of the speaker can be easily distinguished from the video of the plurality of video call participants displayed on the display unit only by listening to the voice of the speaker through the headset.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail.

It should be understood, however, that it is not intended to be limited to the particular embodiments of the invention but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

The terms first, second, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The same reference numerals are used for the same constituent elements in the drawings and redundant explanations for the same constituent elements are omitted.

Hereinafter, an embodiment of the present invention will be described as an example of performing a multi-party video call using a headset of a stereo type in which voice and / or sound are provided through two channels, that is, a left channel and a right channel.

1 is a block diagram showing the configuration of a portable terminal having a speaker discrimination function in a multi-party video call according to an embodiment of the present invention, Figure 2 is a block diagram showing a detailed configuration of the audio codec shown in FIG. 3 illustrates a user interface screen displayed on a display unit during a multi-party video call according to an embodiment of the present invention, and FIG. 4 illustrates a speaker set for a speaker classification function during a multi-party video call according to an embodiment of the present invention. Represents a star weight.

1 to 4, a portable terminal according to an embodiment of the present invention includes a camera unit 111, a display unit 113, a graphic processor 115, a video codec 117, a headset connection unit 120, The microphone 121, the speaker 123, the audio codec 130, the controller 140, the storage 150, a key input unit 160, and a wireless transceiver 170 are included.

Although the configuration of the camera unit 111 is well-known, it is not shown in detail, but includes a lens, an image sensor, and an analog-digital converter. When the image capturing or video call function is executed, The optical signal is converted into an electrical signal corresponding to the optical signal incident through the image sensor, and the converted electrical signal is converted into a digital image corresponding thereto through an analog-digital converter and then provided to the graphic processor 115.

Here, the camera unit 111 may capture an image of 15 frames per second or 30 frames per second under the control of the controller 140.

The display unit 113 may be, for example, a display device such as a liquid crystal display (LCD) or an organic light emitting diode (OLED), and an image signal provided from the graphic processor 115. Based on the display, the user interface such as a menu, an operation state, an application program execution screen, and the like of the portable terminal are displayed.

In particular, the display 113 receives a video call participant and / or a user's video from the graphic processor 115 during a multi-party video call, and displays a predetermined image of the video call participant and / or the user. Mark the area. In addition, when taking a picture, a preview image and a captured image are displayed.

For example, as shown in FIG. 4, when the multi-party video call is started, the display unit 113 divides the display area into a predetermined number of areas based on the number of video call participants, and then displays the video call in each of the divided areas. Each participant's video is displayed. In FIG. 4, for example, five people (A, B, C, D and users) including a user of a portable terminal participate in a video call.

The graphic processor 115 receives the digital image from the camera 111, reduces the size of the image by converting the color format of the digital image, and provides the digital image to the video codec 117. For example, the graphic processor 115 may receive raw data in the form of RGB (Red, Green, Blue) from the camera unit 111, encode the raw data, and convert the raw data into the YCbCr 420 format.

In addition, the graphic processor 115 receives a decoded image (eg, a video call participant's image) from the video codec 117, and resolutions such that the received image can be displayed on a predetermined region of the display 113. After performing graphics processing such as a display position, a frame rate, and the like, the display unit 113 is provided to the display unit 113.

The video codec 117 receives a digital image from the graphic processor 115 or the controller 140, encodes the digital image into a predetermined video call format, and provides the digital image to the controller 140. In addition, the video codec 117 receives a predetermined image (for example, a video call participant's image) provided from the controller 140, decodes the same, and provides the decoded image to the graphic processor 115.

The video codec 117 can encode and decode video using, for example, codecs such as H.261, H.263, H.264, and MPEG-4, and H.263, MPEG-4 during a video call. Simple profile level 0 can be used to encode and decode video.

The headset connection unit 120 may include a microphone input terminal (not shown), a left sound output terminal 127, and a right sound output terminal 129, and are connected to a headset (not shown).

The headset connection unit 120 outputs the voices of the video call participants provided from the audio codec to the headset through the left sound output terminal 127 and the right sound output terminal 129. In addition, the headset connection unit 120 may receive a user's voice input through a microphone installed in the headset through a microphone input terminal (not shown) and provide the audio codec.

The microphone 121 receives a user's voice in a video call and a voice call, converts the input user's voice into an electric signal corresponding thereto, and provides the same to an audio codec 130.

The speaker 123 receives the audio and / or sound signal decoded and converted into an analog signal from the audio codec 130 and amplified to a predetermined level, and outputs the audio and / or audio signal in the audio frequency band.

The audio codec 130 receives an analog signal corresponding to the user's voice from the microphone 121 and converts it into a corresponding digital signal, and then encodes the converted digital signal to comply with a voice call or video call transmission standard. It is provided to the control unit 140 after.

In addition, the audio codec 130 receives a predetermined voice and / or sound signal and a volume control signal from the control unit 140, and decodes the predetermined voice and / or sound signal based on the converted audio signal. Subsequently, the audio codec 130 adjusts the volume of the left channel and the right channel, from which the predetermined voice and / or sound signal converted into the analog signal, based on the volume control signal, respectively, and then connects the headset. And / or to the speaker 123.

In order to perform the above functions, the audio codec 130 may include a vocoder 131, a first digital to analog converter (DAC) 133, and a second digital analog as shown in FIG. 2. The converter 135 may include a first amplifier 137 and a second amplifier 139. The first digital analog converter 137 and the second digital analog converter 139 may be configured as one digital analog converter 136.

The vocoder 131 receives the voice data of the video call participants who are channel decoded from the controller 140, restores the received voice data to the voice signal, and then restores the restored voice signal to the first digital to analog converter 133 and the second digital signal. Provide to analog converter.

The first digital to analog converter 133 and the second digital to analog converter 135 convert an audio signal of the digital form provided from the vocoder 131 into an analog voice signal, respectively, and then the first amplifier 137 and the second amplifier. Provided at 139.

The first amplifier 137 amplifies the voice signal at a volume of a first magnitude based on the volume control signal of the controller 140 and then amplifies the left channel, that is, the left sound output terminal 127 of the headset connection unit 120. The voice signal.

The second amplifying unit 139 amplifies the voice signal at a volume of a second size based on the volume control signal of the controller 140, and then, the second amplifying unit 139 is connected to the right audio output terminal 129 of the headset connection unit 120. Provides an amplified speech signal.

The audio codec 135 is voiced using a codec such as, for example, QualComm Code Excited Linear Predictive Coding (QCELP), Enhanced Variable Rate Codec (EVRC), G.711, G.723, G.723.1, G.728, and the like. Encoding and decoding may be performed.

The controller 140 performs control and processing for a voice call and a video call, which are inherent functions of the portable terminal. For example, the controller 140 multiplexes the video and audio signals provided from the video codec 117 and the audio codec 130 and generates a baseband signal by channel coding the multiplexed signal. To provide. In addition, the controller 140 may decode and demultiplex the baseband signal provided from the wireless transceiver 170 and provide the demultiplexed video and audio signals to the video codec 117 and the audio codec 130, respectively. Can be.

When an event signal indicating a multi-party video call is provided from the key input unit 160, the controller 140 sets up a multi-party video call call with a portable terminal of each participant participating in the multi-party video call.

Subsequently, when a predetermined participant of the multi-party video call participant provides a voice signal, the controller 140 extracts a call separator from the voice data provided from the portable terminal of the speaker to provide the voice signal among the plurality of video call participants. Identifies the speaker.

In addition, the controller 140 reads the volume weight value corresponding to the speaker providing the voice signal from the storage 150 and provides a predetermined volume control signal to the audio codec 130 based on the read volume weight. The video of the predetermined speaker may be distinguished from the video of the multi-party video call participant displayed in the unit 113.

The volume control signal may be specifically provided to the first amplifier 137 and the second amplifier 139 of the audio codec 130.

As shown in FIG. 3, the volume weight is set by differently setting the volume of the volume output to the left sound output terminal 127 and the right sound output terminal 129 for each speaker participating in the video call. By varying the sense of space for each speaker's voice provided through the speaker, the speaker can be distinguished only by listening to each speaker's voice.

In FIG. 3, for example, four participants (A, B, C, and D) who participated in the multi-party video call except for the user of the portable terminal are shown, and the left sound output terminal 127 of the headset connection unit 120 for each speaker is illustrated. ) And the weight of the volume output to the right sound output terminal 129 as a percentage.

For example, in FIG. 3, the speaker A outputs the voice at the maximum volume (ie, 100 percent) through the left audio output terminal 127, and the voice is output at the maximum volume through the right audio output terminal 129. Since only 25 percent is set to be output, when the speaker A speaks during the multi-party video call, the speaker's voice is adjusted to a volume corresponding to the set volume weight and is output to the headset connection unit 120.

Therefore, when a user performs a multi-party video call by connecting a headset to the headset connection unit 120 provided in the portable terminal, the user may change the portable terminal as illustrated in FIG. 4 due to the difference in the volume heard from the left earphone and the right earphone. The video of the participant A among the video call participants' video displayed on the display 113 can be easily distinguished.

In FIGS. 3 and 4, four participants (excluding users) of the multi-party video call are described as examples. However, even when there are four or more participants in the multi-party video call, each participant may be set to have a different volume weight for each participant. Of course.

The storage unit 150 may be configured of a nonvolatile memory such as a flash memory, an electrically erasable and programmable read only memory (EEPROM), a system program (for example, an operating system) required for basic operation of the portable terminal, and / Or save other applications.

In addition, the storage 150 may store data generated by a user, and data generated during the execution of the system program and / or the application program.

In particular, the storage 150 may store volume weight information for distinguishing each speaker during a multi-party video call.

The key input unit 160 includes a plurality of numbers, character input keys, and function keys for performing special functions, and corresponding key input signals when a key operation (for example, executing a multi-party video call) occurs by a user. It provides to the control unit 130.

The wireless transceiver 170 converts a radio frequency (RF) signal received through the antenna 171 into a baseband signal and provides it to the controller 140, and the base provided from the controller 140. The band signal is converted into a radio frequency signal and output through the antenna 171.

In particular, the wireless transceiver 170 transmits a video call signal of a predetermined frame per second encoded by the video codec 117 and the audio codec 130 into a predetermined video call format to a portable terminal of the multi-party video call participants. The video call signal transmitted from the mobile terminal of the video call participants is received and provided to the controller 140.

1 to 4, the portable terminal according to the exemplary embodiment of the present invention controls the volume output through the left sound output terminal 127 and the right sound output terminal 129 included in the headset connection unit 120, respectively. For example, the present invention has been described as distinguishing a predetermined speaker, but in another embodiment of the present invention, two speakers connected to the left channel and the right channel are respectively provided, and configured to distinguish the speaker by adjusting the volume output through each speaker. You may.

5 is a flowchart illustrating a speaker classification process in a multi-party video call according to an embodiment of the present invention.

Referring to FIG. 5, first, when the event signal indicating the multi-party video call is provided from the key input unit 160, the control unit 140 connects the multi-party video call call between the mobile terminals of the participants participating in the multi-party video call (step S160). 201).

Thereafter, when a voice is provided to the user's portable terminal from a predetermined speaker among the multi-party video call participants (step 203), the controller 140 extracts a call separator from the voice data provided from the predetermined speaker, thereby providing a plurality of video call participants. The speaker who provided the voice is identified (step 205).

Thereafter, the controller 140 reads out the volume weight corresponding to the speaker who provided the voice signal from the storage unit 150 (step 207), and adjusts the volume of the speaker based on the read volume weight (step 209). ). Here, the controller 140 may adjust the volume of the speaker by providing a volume control signal corresponding to the read volume weight to the audio codec 130.

The audio codec 130 adjusts the volume of the speaker based on the volume control signal provided from the controller 140 and provides the headset connection unit 120 with the speaker whose volume is adjusted (step 211).

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. It will be possible.

1 is a block diagram showing the configuration of a portable terminal having a speaker discrimination function in a multi-party video call according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating a detailed configuration of the audio codec shown in FIG. 1.

3 illustrates a user interface screen displayed on a display unit in a multi-party video call according to an embodiment of the present invention.

4 illustrates volume weights for each speaker set for a speaker classification function in a multi-party video call according to an embodiment of the present invention.

5 is a flowchart illustrating a speaker classification process in a multi-party video call according to an embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

113: display unit 117: video codec

120: headset connection 130: audio codec

131: vocoder 140: control unit

150: storage unit 170: wireless transceiver

Claims (9)

In a portable terminal having a multi-party video call function, A storage unit for storing volume weight information corresponding to each speaker participating in the multi-party video call; A controller configured to generate a volume control signal based on the read volume weight after reading a volume weight corresponding to the predetermined speaker from the storage unit when voice data is provided from a predetermined speaker; And And a audio codec for adjusting the volume of the left channel and the volume of the right channel, respectively, on which the voice of the predetermined speaker is output based on the volume control signal. The method of claim 1, wherein the volume weight is And a speaker discrimination function for a multi-way video call, wherein the voice of the predetermined speaker is set for the left channel and the right channel, respectively. The method of claim 1, wherein the control unit When the voice data is provided from the predetermined speaker, the call separator included in the voice data is extracted to identify the predetermined speaker from each speaker participating in the multi-party video call. Portable terminal having a. The method of claim 1, wherein the audio codec A first amplifier adjusting a volume of the left channel based on the volume control signal; And And a second amplifier configured to adjust a volume of the right channel based on the volume control signal. The portable terminal of claim 1, wherein the portable terminal has a speaker discrimination function in the multi-party video call. And a headset connection unit configured to receive a voice of the predetermined speaker whose volume of the left channel and the volume of the right channel are respectively adjusted. Reading volume weights corresponding to the predetermined speaker when voice data is provided from a predetermined speaker; Generating a volume control signal based on the read volume weight; And And adjusting the volume of the left channel and the volume of the right channel, respectively, on which the voice of the predetermined speaker is output based on the generated volume control signal. The method of claim 6, wherein the volume weight is And a method for distinguishing a speaker during a multi-way video call, wherein the voice of the predetermined speaker is set for the left channel and the right channel, respectively. The method of claim 6, wherein when the voice data is provided from the predetermined speaker, reading a volume weight corresponding to the predetermined speaker comprises: And when the voice data is provided from the predetermined speaker, extracting a call separator included in the voice data to identify the predetermined speaker among each speaker participating in the multi-party video call. How to distinguish poetry speakers. The method of claim 6, wherein the method of identifying a speaker in the multi-party video call is And providing a voice of the predetermined speaker whose volume of the left channel and the volume of the right channel are respectively adjusted to a headset connection unit.

Images