TWI387301B - Method for displaying multiple video - Google Patents

Description

Method of displaying multi-party video call

The invention relates to a method for multi-party video calling.

H.323 is part of the International Telecommunications Union (ITU) multimedia communication series standard H.32x, which makes video conferencing possible on existing communication networks. H.320 is based on narrowband integrated service network (N -ISDN) is the standard for multimedia communication. H.321 is the standard for multimedia communication on the Broadband Integrated Service Network (B-ISDN). H.322 is used for multimedia communication on the LAN with service quality assurance. The standard, H.324 is the standard for multimedia communication over the public switched telephone network (GSTN) and wireless networks. H.323 provides multimedia communication standards for existing packet networks (PBN) such as IP networks.

H.323 defines four main components for network-based multimedia communication systems: Terminal, Gageway, Gagekeeper, and Multipoint Control Unit (MCU). The terminal is a node device capable of providing instant and two-way communication in a packet network, and is also an end user device capable of communicating with a gateway and a multipoint control unit. All terminals must support voice communication, but video and data communication is optional. H.323 specifies the operating modes required for different audio, video or data terminals to work together. It will be the primary standard for next-generation Internet telephony, audio conferencing endpoints and video conferencing technology. When performing multimedia communication, at the transmitting end, the video and audio signals obtained from the input device are compressed by the encoder, packaged according to a certain format, and sent out through the network. At the receiving end, the data packet from the network is first unpacked, and the video and audio compression resources obtained are obtained. After being decoded, it is sent to the output device, and the user data and control data are also processed accordingly.

At present, mobile communication terminals such as mobile phones usually have a built-in camera and a video capture card, and have the function of video call. However, only the video screen of the other party can be displayed on the mobile phone screen, and the video status of the video communication may not be known. The picture to the other party is not ideal. In order to solve the above problems, a mobile phone and a method for simultaneously displaying a video of the other party and a video of the local device are displayed on the screen. For example, the Chinese Patent Application Publication No. CN 1805534 provides a mobile phone and a method for displaying a plurality of video images. The video data acquired by the local device and the video data from the remote end are placed in different video channels, and the order of the channel display is determined by setting the parameters of the video channel to distinguish the foreground and the background, so that the present page can be displayed on the mobile phone screen at the same time. Machine video and remote video. This kind of mobile phone can be applied well under one-to-one video call conditions. However, when using a mobile phone for multi-party video calls, it is not only necessary to know the video of this machine and the video of a remote terminal, but also need to know other participation. The video sent by the remote terminal of the video call.

In view of the above, it is necessary to provide a method for displaying a plurality of video images on a screen and a mobile communication terminal particularly suitable for multi-party video calls, which can perform multi-party video calls and simultaneously display video transmitted by a plurality of remote mobile communication terminals. Picture.

A method for displaying a multi-party video call, comprising the steps of: dividing a window for displaying a video picture into a plurality of areas/sub-windows, such that each remote mobile communication terminal corresponds to an area/sub-window; Obtaining, by the decoder, the video and audio signals sent by each remote mobile communication terminal, and making a judgment as follows. If the video signal is included, then determining whether the audio signal is included therein, and if the audio signal is included, moving to the remote end Displaying the video signal of the mobile communication terminal in the area/sub-window corresponding to the communication terminal and highlighting the area/sub-window; otherwise, displaying the video signal in an ordinary manner in the area/sub-window corresponding to the remote mobile communication terminal; If the video signal is not included, it is next determined whether the audio signal is included, and if the audio signal is included, the icon stored in the local area is displayed in the area/sub-window corresponding to the remote mobile communication terminal and the area is displayed. The / sub-window is highlighted, and if the audio signal is not included, the icon stored on the unit is displayed in an ordinary manner in the area/sub-window corresponding to the remote mobile communication terminal.

Compared with the prior art, the method for displaying a plurality of video images on the display device of the mobile communication terminal and the mobile communication terminal can simultaneously display the video signals transmitted by the respective mobile communication terminals participating in the multi-party video call on the display device. And highlighting the mobile communication terminal that is speaking, so that the user can see the video picture of all the callers, and can easily obtain the state of the video call, enhance the communication ability of the video call, and the video call process is more humanized and comfortable.

1 is a schematic diagram showing the hardware structure of a mobile communication terminal according to a first embodiment. The mobile communication terminal includes a central processing unit, a signal portion, a multiplex decoder, a storage device, a video input device, and a display device. The central processor is separately connected to the signal part, the multiplexer, the storage device, and the video input device. The display device is connected to control its operation. The signal portion can include an antenna, a signal receiving and transmitting device, and a signal modulation and demodulation device. The signal part is mainly used to receive and transmit radio signals. The multiplex decoder is used for decoding the received multiple video and audio signals. The storage device includes random memory (RAM) and static memory such as a hard disk (HDD), a flash memory (FLASH), and the like. The video input device is typically a camera for capturing video images. The display device can be a liquid crystal display device (LCD).

The multi-party video call process of the mobile communication terminal in this embodiment is as follows. First, a multi-party video call connection is established. Then, the central processing unit controls the multiplex decoder to decode the received video voice signals from the plurality of remote mobile communication terminals, and respectively displays the video images of each remote mobile communication terminal on the corresponding area on the display device/ In the sub-window, the video picture sent by the mobile communication terminal of the remote user who is speaking is also indicated, so that the user can clearly understand the status of all video call participants. The specific display process can be seen in the following embodiments of the display method.

2 is a flow chart showing a method of displaying a multi-party video call screen in the first embodiment. The steps shown in Figure 2 are performed after a multi-party video call connection has been established. First, the window displaying the video picture is divided into a plurality of areas/sub-windows so that each of the remote mobile communication terminals corresponds to an area/sub-window. Then, the video voice signal sent by each remote mobile communication terminal is obtained from the decoder, and the following is determined. If the video signal is included, it is determined whether the audio signal is included. If the audio signal is included, the video of the mobile communication terminal is displayed in the area/sub-window corresponding to the remote mobile communication terminal. The signal is highlighted and the area/sub-window is highlighted, otherwise the video signal is displayed in an ordinary manner in the area/sub-window corresponding to the remote mobile communication terminal. If the video signal is not included, it is next determined whether the audio signal is included. If the audio signal is included, the icon stored in the local area is displayed in the area/sub-window corresponding to the remote mobile communication terminal and the area/ The child window is highlighted. If the audio signal is not included, the icon stored on the local machine is displayed in an ordinary manner in the area/sub-window corresponding to the remote mobile communication terminal.

In the above method, the number of remote mobile communication terminals can be obtained by issuing a control command query to the MCU before dividing the area/sub-window. The window displaying the video picture is then divided into corresponding numbers of areas/sub-windows. Referring to Figure 3, the window showing the video picture is divided into 6 areas/sub-windows. Each zone/sub-window corresponds to a remote mobile communication terminal. For example, sub-window 10 corresponds to remote mobile communication terminal 12, and its user is 14.

The manner in which the plurality of video images are simultaneously displayed in the corresponding area/sub-window can be the following two types. The first type processes the complex video by the processor, and combines the plurality of video pictures into one video picture for display on the playing video. In the device. The second type establishes a sub-window of a plurality of video players, and each sub-window corresponds to a video picture. Either way, the decoder is required to have the ability to simultaneously decode multiple video and audio signals.

Highlighting the area/sub-window includes bordering the area/sub-window, changing its background color, size, blinking, displaying identifying text or icons thereon, or displaying it in full screen. Because the area/sub-window needs to be enlarged when it is displayed in full screen, in order to avoid giving people a sudden sense of bluntness It is felt that this process can be achieved by a period of time, such as a one-second gradual process. In the case where the video picture of a remote mobile terminal is currently displayed in full screen, if the video picture of another remote terminal is to be switched, a gradual process may be employed. Specifically, the current video picture gradually becomes transparent and disappears, and the picture to be switched gradually becomes clear. In the present embodiment, referring to FIG. 4, when it is detected that the user 14 is speaking, the icon 102 indicating that the speaker is speaking is displayed on the sub-window 10.

When a signal transmitted by a remote mobile communication terminal does not include a video signal, the icon displayed in the corresponding area/sub-window may be a text icon, a static or dynamic picture, and a pre-recorded video.

Referring to FIG. 5, in addition, in addition to displaying the video screen of the remote mobile communication terminal, the contact information, such as name, position, etc., may be displayed in the corresponding area/sub-window, and the contact information may be from the mobile communication terminal. Contact database query is obtained. For example, the contact message 104 displayed on the sub-window 10 is displayed.

In the multi-party video calling method of the embodiment, the video signal transmitted by each mobile communication terminal participating in the multi-party video call can be simultaneously displayed on the display device, and the video picture transmitted by the mobile communication terminal that the user is speaking is highlighted. So that users can see the video of all the callers, and can clearly understand who is speaking.

Referring to FIG. 6, the method for displaying the multi-party video call screen of the second embodiment is similar to that of the first embodiment, except that in addition to displaying the video picture of each remote mobile communication terminal, each area/sub- The function table 206 is displayed in the window. By selecting the options on the above menu, you can achieve For the control of video calls. The function table 206 can directly display each area/sub-window, and can also be displayed when the area/sub-window is selected, and can also press a button after selecting the area/sub-window, or click the touch screen to display the corresponding Function table 206. The content of the user function table 206 having different control rights may be different. For example, for the controller of the multi-party video call, the content of the function table 206 may include hanging up a remote mobile communication terminal and giving a mobile communication terminal a right to speak. , mute processing of a mobile communication terminal, and the like. For a general participant, the contents of the function table 206 may include an exit video call, a request to speak, and the like. In the present embodiment, the contents of the function table 206 displayed in the sub-window 20 include hanging and muting.

Compared with the first embodiment, the method for displaying the multi-party video call screen in this embodiment further displays the function table 206 in the area/sub-window corresponding to each remote mobile communication terminal, which is more convenient for controlling the video call. .

The mobile communication terminal and the method have the advantages that the video signal transmitted by each mobile communication terminal participating in the multi-party video call can be simultaneously displayed on the display device, and the mobile communication terminal that is speaking is highlighted, so that the user can see all The video of the caller can easily obtain the status of the video call, enhance the communication ability of the video call, and the video call process is more humanized and comfortable.

In summary, the present invention has indeed met the requirements of the invention patent, and has filed a patent application according to law. However, the above description is only a preferred embodiment of the present invention, and it is not possible to limit the scope of the patent application of the present invention. Equivalent modifications or variations made by persons skilled in the art in light of the spirit of the invention are intended to be included within the scope of the following claims.

10, 20‧‧‧ child window

12‧‧‧Remote mobile communication terminal

14‧‧‧Users

102‧‧‧ indicates the icon being spoken

104‧‧‧Contact Message

206‧‧‧Menu

1 is a schematic diagram showing the hardware structure of a mobile communication terminal capable of displaying a multi-party video picture in the first embodiment.

2 is a flow chart showing a method of displaying a multi-party video call screen in the first embodiment.

FIG. 3 is a schematic diagram showing a divided area/sub-window of the method for displaying a multi-party video call screen according to the first embodiment.

FIG. 4 is a schematic diagram showing the display effect of the method for displaying a multi-party video call screen according to the first embodiment.

FIG. 5 is a schematic diagram showing the display effect of the method for displaying a multi-party video call screen according to the first embodiment.

FIG. 6 is a schematic diagram showing the display effect of the method for displaying a multi-party video call screen according to the second embodiment.

20‧‧‧ child window

206‧‧‧Menu

Claims (5)

A method for displaying a multi-party video call, comprising the steps of: dividing a window for displaying a video picture into a plurality of areas/sub-windows, so that each remote mobile communication terminal corresponds to an area/sub-window; obtaining each far from the decoder The video audio signal sent by the mobile communication terminal is determined as follows. If the video signal is included, it is next determined whether the audio signal is included, and if the audio signal is included, the area/sub-window corresponding to the remote mobile communication terminal Displaying the video signal of the mobile communication terminal and highlighting the area/sub-window, otherwise displaying the video signal in an ordinary manner in the area/sub-window corresponding to the remote mobile communication terminal; if the video signal is not included, then Determining whether the audio signal is included therein, if the audio signal is included, displaying the icon stored on the local machine in the area/sub-window corresponding to the remote mobile communication terminal and highlighting the area/sub-window, if not included The audio signal is in the normal area/sub-window corresponding to the remote mobile communication terminal. Icon on the display is stored in the machine. The method for displaying a multi-party video call according to claim 1, wherein the manner of highlighting the area/sub-window includes adding a border to the area/sub-window, changing its background color, size, and blinking , display the logo text or icon on it. The method for displaying a multi-party video call as described in claim 1, wherein the icon includes a text icon, a static or dynamic picture, or a pre-recorded video. For example, the method for displaying a multi-party video call as described in claim 1 of the patent scope, Wherein, the video information is displayed on the display device, and the corresponding contact information is displayed in the area/sub-window corresponding to each remote mobile communication terminal. The method for displaying a multi-party video call according to claim 1, wherein the displaying the video screen on the display device and displaying the corresponding control function in the area/sub-window corresponding to each remote mobile communication terminal table.