KR100735415B1 - Method for performing video telephone call of multilateral in?wireless terminal - Google Patents

Abstract

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method of performing a multi-party video call of a mobile terminal, and more particularly, to a method of performing a multi-party video call of a mobile terminal capable of simultaneously performing a video call while displaying at least two speakers in the video call mode of the mobile terminal.

In order to achieve this, in the video call mode of the mobile terminal, when the multi-party video call is selected in the mobile terminal, at least two video screens for displaying at least two speakers connected to perform the video call are displayed. Displaying on the display unit of the portable terminal; During a multi-party call with the speakers displayed on the at least two video screens and during a multi-party call with the speakers displayed on the at least two video screens, the video screen of the speaker having the largest change in the mouth area is automatically displayed. Characterized in that the process of searching and displaying.

In addition, if the method of performing a multi-party video call in the video call mode of the mobile terminal is selected, the full-screen display is selected in the multi-party video call mode of the mobile terminal, at least two for displaying at least two speakers connected to perform the video call. Performing a multi-party call while displaying an image screen on a display unit of the mobile terminal; If a specific video screen display is selected in the conference call mode, performing a multi-party call while displaying only a video screen of a speaker selected from at least two speakers connected to perform the video call; When the automatic video display is selected in the multi-party call mode, the audio data is output from at least two speakers connected to perform the video call, or the video screen of the speaker with the largest change in mouth area is automatically searched and displayed. Characterized in that the process of performing a multi-party call.

Multi-party video call, full picture, specific picture, auto picture

Description

METHOOD FOR PERFORMING VIDEO TELEPHONE CALL OF MULTILATERAL IN WIRELESS TERMINAL}

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

2 is a flowchart illustrating a process of performing a call in a video call mode of a mobile terminal according to an exemplary embodiment of the present invention.

3A to 3C are views for explaining FIG. 2.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for performing a multi-party video call of a mobile terminal, and more particularly, to a method of performing a multi-party video call of a mobile terminal capable of simultaneously performing a video call while displaying at least two speakers in the video call mode of the mobile terminal.

Currently, portable mobile communication terminals are converting to a structure capable of transmitting high speed data in addition to voice communication functions. That is, by implementing a mobile communication network of the IMT 2000 standard, it is possible to implement high-speed data communication in addition to voice communication using the portable terminal. Data that can be processed by the mobile terminal performing the data communication may be packet data and image data. In addition, a function of displaying a video signal by adding a camera or a TV receiver to the portable terminal is implemented. Therefore, the mobile terminal having a camera as described above can take a picture of the video and display it as a moving picture and a still picture, and can also transmit the captured picture. In addition, the mobile terminal having a TV receiver may display a received video signal.

In addition, the mobile terminal having a video call function can perform a call while transmitting and receiving video along with an audio transmission and reception, transmitting video data of the user and receiving and displaying video data of the other party.

The recently announced Push to ALL technology enables multi-party meetings. However, this means that if the person you want to talk with after connecting several people is selected, the view is switched so that only the selected person can be seen.

If a multi-party video call overcoming the above disadvantages is made in a mobile terminal having the video call function, a more convenient function may be provided.

Accordingly, an object of the present invention is to provide a method of performing a multi-party video call of a mobile terminal capable of simultaneously performing a video call while displaying at least two speakers in a video call mode of the mobile terminal.

Another object of the present invention is to provide a method for performing a multi-party video call of a mobile terminal capable of performing a video call while displaying only the selected speaker among at least two callers in the video call mode of the mobile terminal.

It is still another object of the present invention to provide a method for performing a multi-party video call of a mobile terminal capable of conducting a video call while automatically searching for and displaying a voice outputting voice among at least two speakers in a video call mode of the mobile terminal. have.

In the video call mode of the mobile terminal for achieving the above object, if the multi-party video call is selected in the mobile terminal, at least two images for displaying at least two speakers connected to perform the video call. Displaying the screens on a display unit of the mobile terminal; During a multi-party call with the speakers displayed on the at least two video screens and during a multi-party call with the speakers displayed on the at least two video screens, the video screen of the speaker having the largest change in the mouth area is automatically displayed. Characterized in that the process of searching and displaying.

In addition, in order to achieve the above object, the method of performing a multi-party video call in the video call mode of the mobile terminal is selected, when the full-screen display is selected in the multi-party video call mode of the mobile terminal, at least two speakers connected to perform the video call. Performing a multi-party call while displaying at least two image screens for display on a display unit of the mobile terminal; If a specific video screen display is selected in the conference call mode, performing a multi-party call while displaying only a video screen of a speaker selected from at least two speakers connected to perform the video call; When the automatic video screen display is selected in the multi-party call mode, the voice data is output from at least two speakers connected to perform the video call, or the video screen of the speaker with the largest change in mouth area is automatically searched and displayed. Characterized in that the process of performing a multi-party call.

DETAILED DESCRIPTION Hereinafter, detailed descriptions of preferred embodiments of the present invention will be described with reference to the accompanying drawings. It should be noted that the same components in the figures represent the same numerals wherever possible.

1 is a view showing the configuration of a mobile terminal according to an embodiment of the present invention, which shows the configuration of a mobile terminal having a video call function.

Referring to FIG. 1, the RF unit 123 performs a wireless communication function of the portable terminal. The RF unit 123 includes an RF transmitter for upconverting and amplifying a frequency of a transmitted signal, and an RF receiver for low noise amplifying and downconverting a received signal. The modem 120 includes a transmitter for encoding and modulating the transmitted signal, a receiver for demodulating and decoding the received signal, and the like. The audio processor 125 may configure a codec, and the codec includes a data codec for processing packet data and an audio codec for processing an audio signal such as voice. The audio processor 125 converts and reproduces the digital audio signal received by the modem 120 through the audio codec or converts the analog audio signal generated from the microphone into a digital audio signal through the audio codec and converts the digital audio signal into the digital audio signal. Sends the function to 120. The codec may be provided separately or included in the controller 110.

The memory 130 may include program memory and data memories. The program memory may store programs for controlling a general operation of the portable terminal and programs for controlling a multi-party video call in a video call mode according to an embodiment of the present invention. The data memory also temporarily stores data generated during the execution of the programs.

The controller 110 controls a general operation of the mobile terminal. In addition, the controller 110 may include the modem 120 and the codec. In addition, the controller 110 controls the display unit 160 to display at least two image screens for displaying at least two speakers connected for a video call in the multi-party video call mode. In this case, the controller 110 controls to sequentially update the corresponding voice data and the corresponding video data on the at least two image screens, and controls to perform a multi-party video call while simultaneously displaying the at least two image screens on the display unit 160. do.

In addition, the controller 110 controls to perform a multi-party video call while displaying a specific image screen selected from among at least two image screens in the multi-party video call mode according to an embodiment of the present invention. In this case, the controller 110 may display the specific screen on a full screen and control to output only the voice data of the speaker of the specific image screen.

In addition, the controller 110 controls to perform a multi-party video call while automatically searching for and displaying an image screen outputting voice data while displaying at least two image screens in the multi-party video call mode according to an embodiment of the present invention. . In this case, the controller 110 may display the automatically searched picture screen on a full screen and control to output only the voice data of the speaker of the automatically searched picture screen.

The camera module 140 includes a camera sensor for capturing image data, converting the photographed optical signal into an electrical signal, and a signal processor for converting the analog image signal photographed from the camera sensor into digital data. Herein, it is assumed that the camera sensor is a CCD sensor, and the signal processor may be implemented by a digital signal processor (DSP). In addition, the camera sensor and the signal processor may be integrally implemented or may be separately implemented.

The image processor 150 performs a function of generating screen data for displaying an image signal output from the camera unit 140. The image processor 150 processes the image signal output from the camera unit 40 in units of frames, and outputs the frame image data according to the characteristics and size of the display unit 160. In addition, the image processor 150 includes an image codec and performs a function of compressing the frame image data displayed on the display unit 160 in a set manner or restoring the compressed frame image data to the original frame image data. The image codec may be a JPEG codec, an MPEG4 codec, a wavelet codec, or the like. It is assumed that the image processor 150 has an On Screen Display (OSD) function, and may output on-screen display data according to a screen size displayed by the control of the controller 110. In addition, the image processor 150 compresses the video data of the user received through the camera unit 140 in the video call mode, decodes the video data of the other party connected for the video call, and outputs the video data to the display unit 160.

The display unit 160 displays an image signal output from the image processor 150 on a screen, and displays user data output from the controller 110. The display unit 160 may use an LCD. In this case, the display unit 160 may include an LCD controller, a memory capable of storing image data, and an LCD display device. In this case, when the LCD is implemented using a touch screen method, the LCD may operate as an input unit. In addition, the display unit 160 displays at least two image screens in a multi-party video call mode according to an exemplary embodiment of the present invention.

 The key input unit 127 includes keys for inputting numeric and character information and function keys for setting various functions. In addition, the key input unit 127 may include a key for controlling a multi-party video call according to an embodiment of the present invention.

An operation of performing a multi-party video call in the mobile terminal as described above will be described in detail with reference to FIGS. 2 and 3.

2 is a flowchart illustrating a process of performing a multiparty call in a video call mode of a mobile terminal according to an embodiment of the present invention, and FIGS. 3A to 3C are views for explaining FIG.

Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. 1 and 3.

Referring to FIG. 2, when a multi-party video call is selected in the mobile terminal, the control unit 110 detects it in step 201 and switches the mobile terminal to a multi-party video call mode. In the multi-party video call mode, when the whole picture display is selected after being connected to at least two callers for the video call, the control unit 110 detects this in step 203 and at least two callers connected to the display unit 160 for the video call. The display proceeds to step 204 of displaying at least two image screens displaying. That is, all image screens for displaying all the speakers connected for the video call are displayed.

In the full image screen display mode of step 204, the control unit 110 controls to sequentially update the respective video data and the corresponding audio data for the at least two screens, and displays the at least two screens displayed on the display unit 160. Controls to conduct a video call between the displayed speaker and the multiparty.

3A illustrates a display unit 160 displaying four image screens 161-164 displaying four speakers connected for the video call in the full image display mode of step 204.

In addition, when a specific video display is selected after being connected to at least two callers for the video call in the multi-way video call mode, the controller 110 detects it in step 205 and selects at least two connected callers for the video call. In step 206, only the screen of the specific speaker is displayed.

In step 206, the controller 110 controls to activate and display only the screen of the selected specific speaker, and at this time, the image screen on which the specific speaker is displayed may be displayed to be displayed on a full screen. In addition, the controller 110 may control to output only the voice data of the specific speaker, and the selected specific speaker may be at least one person. In step 205 and step 206, a multi-party call can be performed while selecting a desired talker from at least two talkers connected for a video call of the user of the portable terminal.

Alternatively, steps 205 and 206 may be performed in which the specific image screen display is selected in the full image screen display mode of step 204. As shown in FIG. 3A, when a specific image screen 162 is selected in the full image screen display mode in which four image screens 161-164 are displayed on the display unit 160, the specific image screen 162 is full on the display unit 160 as shown in FIG. 3C. Only the voice data of the speaker displayed on the screen and displayed on the specific image screen 162 may be output.

In addition, when the automatic video display is selected after being connected to at least two talkers for the video call in the multi-party video call mode, the control unit 110 detects this in step 207 and automatically displays the video screen of the speaker having the largest change in the mouth area. Perform search by searching with.

Referring to the operation of automatically searching for and displaying the picture screen of the speaker with the largest change in the mouth area, the controller 110 extracts the face area of the speaker displayed on the picture screen and selects the mouth area from the extracted face area. Proceed to step 208 to extract. The control unit 110 searches for the change amount of the mouth area of each speaker extracted in step 208, and searches for the picture screen of the speaker having the maximum change amount in step 209, and activates and displays the picture screen retrieved in step 209. Proceed to step 210.

In step 210, the searched picture screen may be displayed as a full screen, or the remaining picture screens may be toggled and only the searched picture screen may be activated and displayed. In addition, the controller 110 may control to output only the speaker's voice data displayed on the searched image screen.

In the automatic image screen display operation, the automatic image screen display operation may be performed not only by automatically searching for and displaying the image screen of the speaker having the greatest amount of change in the mouth area, but also through audio data output.

That is, when the automatic picture display is selected in the multi-party video call mode, the control unit 110 detects this and outputs voice data among at least two connected speakers for the video call, that is, the speaker who is currently speaking. Automatically search and display.

The controller 110 may automatically search for a speaker that outputs the voice data, display the searched picture screen in full screen, or toggle the remaining picture screens, and activate and display only the searched picture screen. In addition, the controller 110 may control to output only the speaker's voice data displayed on the searched image screen.

Through the operation of automatically displaying the image screen, among the at least two speakers connected to the user of the mobile terminal for the video call, the speaker which outputs the voice data or the speaker having the largest change in mouth area is automatically searched for and focused. You can make a multi-party call by displaying and matching.

Alternatively, in the full screen display mode of step 204, the automatic picture display is selected to automatically search for and focus on the speaker that outputs the voice data or the speaker having the largest change in the mouth area, and perform a multi-party call. You may.

As shown in FIG. 3A, when the automatic picture display is selected in the full picture display mode in which four picture screens 161-164 are displayed on the display unit 160, the speaker outputting the voice data or the speaker having the largest change in the mouth area is displayed. Search automatically.

When the image screen 162 is searched through the automatic search, the non-discovered image screens 161, 163, and 164 are not toggled and displayed on the display unit 160 as shown in FIG. 3B, and only the searched image screen 162 is activated and displayed. Also, only the speaker's voice data displayed on the searched image screen 162 can be output.

Alternatively, when the image screen 162 is searched through the automatic search, the searched image screen 162 is displayed as a full screen on the display unit 160, and only the voice data of the speaker displayed on the searched image screen 162 can be output. have.

In the above description of the present invention, a specific embodiment such as a multi-party video call in the video call mode of the mobile terminal has been described, but various modifications can be made without departing from the scope of the present invention. Therefore, the scope of the present invention should not be defined by the described embodiments, but should be determined by the equivalent of claims and claims.

That is, as described above, the present invention provides the method for performing a multi-party video call in the video call mode of the mobile terminal, thereby enabling the multi-party video call to be performed while simultaneously displaying at least two speakers connected for the video call. .

In addition, at least two speakers connected for the video call can simultaneously perform a multi-party video call while displaying only a specific speaker selected from among the displays. In addition, there is an effect that a multi-party video call can be carried out while automatically searching for and displaying a speaker that outputs voice data while simultaneously displaying at least two speakers connected for the video call.

Claims (18)

In the video call mode of the mobile terminal, When a multi-party video call is selected in the mobile terminal, displaying at least two image screens for displaying at least two speakers connected to perform the video call on the display unit of the mobile terminal; Performing a multi-party call with the speakers displayed on the at least two video screens; And automatically searching for and displaying the video screen of the speaker having the largest change in the mouth area during a multi-party call with the speakers displayed on the at least two video screens. The method of claim 1, And displaying only the selected specific video screen when a specific video screen is selected by a user during a multi-party call with the speakers displayed on the at least two video screens. The method of claim 2, And when displaying the selected specific image screen, displaying the specific image screen on a full screen. The method of claim 2, And displaying only the voice data of the speaker displayed on the specific image screen when displaying the selected specific image screen. delete The method of claim 1, And if an automatic video screen is selected during a multi-party call with the speakers displayed on the at least two video screens, the video screen of the speaker having the largest change in the mouth area is automatically searched for and displayed. The method of claim 1, wherein the automatically searching and displaying the Extracting the speaker's face area displayed on the image screen; Extracting a mouth region from the extracted face region; And automatically searching for and displaying an image screen on which the speaker having the greatest amount of change in the mouth area is displayed. The method of claim 6, And displaying only the automatically searched picture screens and toggling the picture screens of the remaining speakers. The method of claim 6, And displaying only the automatically detected picture screen on a full screen. The method of claim 6, And outputting only the voice data of the speaker displayed on the automatically searched image screen. In the video call mode of the mobile terminal, When the full screen display is selected in the multi-party video call mode of the mobile terminal, a multi-party call is performed by displaying at least two video screens on the display unit of the mobile terminal to display at least two speakers connected to perform the video call. Process, When a specific video screen display is selected by the user in the multi-party call mode, performing a multi-party call while displaying only the video screen of a speaker selected from at least two speakers connected to perform the video call; When the automatic video display is selected in the multi-party call mode, a process of performing a multi-party call while automatically searching and displaying the video screen of the speaker with the largest change in mouth area among at least two speakers connected to perform the video call. The method, characterized in that consisting of. The method of claim 11, And displaying an image screen of the selected speaker on a full screen when displaying the image screen of the selected speaker. The method of claim 11, And outputting only voice data of the selected speaker when displaying the picture screen of the selected speaker. delete The method of claim 11, wherein the automatically searching and displaying the image comprises: Extracting the speaker's face area displayed on the image screen; Extracting a mouth region from the extracted face region; And automatically searching for and displaying an image screen on which the speaker having the greatest amount of change in the mouth area is displayed. The method of claim 11, When displaying the automatically searched picture screen, displaying only the automatically searched picture screen and toggling the picture screens of the remaining speakers. The method of claim 11, And displaying the automatically retrieved picture screen in full screen when displaying the automatically retrieved picture screen. The method of claim 11, And displaying only the speaker's voice data displayed on the automatically searched picture screen when displaying the automatically searched picture screen.

Images