WO2016169496A1

WO2016169496A1 - Video conference image presentation method and device therefor

Info

Publication number: WO2016169496A1
Application number: PCT/CN2016/079928
Authority: WO
Inventors: 王福
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-04-24
Filing date: 2016-04-21
Publication date: 2016-10-27
Also published as: CN106162046A

Abstract

Disclosed is a video conference image presentation method. The method comprises: determining at least one meeting place as a specific meeting place; displaying the specific meeting place in a first region of a video interface; and displaying the rest of the meeting places in a second region of the video interface, wherein the rest of the meeting places include some or all of the meeting places participating in a conference except the at least one meeting place, and the area of the first region is greater than that of the second region.

Description

Video conference image presentation method and device thereof

Technical field

This document relates to, but is not limited to, communication technology, and more particularly to a video conference image presentation method and apparatus therefor.

Background technique

People in different locations, through communication devices and networks, conduct face-to-face meetings, called video conferences. Through video conferencing, participants can hear the voices of other venues, see the images, movements and expressions of participants at other venues, and send electronic presentations to give participants an immersive feel.

The current video conferencing mode includes a single-picture mode and a multi-picture mode. For example, the multi-picture mode refers to first dividing the entire picture in an equal-scale manner, and then presenting all the sites in a multi-screen layout of equal size. In the video interface.

However, in the implementation process, those skilled in the art find that if there are too many current conference venues in the video conference, the video screen is too small to be highlighted, and the conference site that needs to be focused on cannot be highlighted.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

This paper provides a video conference image presentation method and device thereof, which can solve the problem that the conference site that needs to be focused on cannot be highlighted.

A video conference image presentation method provided by the article includes:

Determining at least one site as a specific site for highlighting the specific site;

Displaying the specific venue in a first area of the video interface;

The remaining sites are displayed in the second area of the video interface, and the remaining sites include some or all of the meeting sites of the at least one site, and the area of the first area is larger than the second area.

Optionally, in the foregoing method, the displaying the remaining site in the second area of the video interface further includes:

The remaining venues are alternately displayed in turn in the second area of the video interface.

Optionally, in the foregoing method, after the determining that the at least one site is a specific site, the method further includes:

Determining that the first site is the specific site, and the first site is highlighted, and the first site is a site in the remaining site;

The first site is replaced with the second site in the specific site, and all the sites in the at least one site except the second site and the first site are highlighted.

Optionally, in the foregoing method, the determining that the at least one site is a specific site is used to highlight the specific site, including:

Obtaining a current conference mode, where the conference mode includes a voice excitation mode, a chairman mode, or a director mode;

Determining, according to the conference mode, the at least one site is the specific site.

Optionally, in the above method, the conference mode includes a voice excitation mode;

Determining, according to the conference mode, that the at least one site is the specific site, including:

Determining an active value of each of the participating venues according to an audio input voice value and/or a duration of voice duration of each participant site for a period of time;

And determining, according to the active value, at least one site with a high active value is the specific site.

Optionally, in the foregoing method, the conference mode includes a chairman mode or a director mode;

Determining the at least one venue as the specific venue according to a presidential instruction or a director instruction.

The present invention also provides a video conference image presentation device, including:

a determining module, configured to determine that at least one site is a specific site, to highlight the specific site;

a display module, configured to display the specific site in a first area of the video interface; display the remaining site in a second area of the video interface, where the remaining site includes some or all of the participants in the at least one site The area of the first area is larger than the second area.

Optionally, in the above device, the display module is further configured to alternate the remaining venues A stream is displayed in the second area of the video interface.

Optionally, in the foregoing apparatus, the determining module is further configured to: determine that the first site is the specific site, to highlight the first site, where the first site is a site in the remaining site And replacing the first site with the second site in the specific site.

Optionally, in the foregoing apparatus, the determining module may be configured to acquire a current conference mode, where the conference mode includes a voice excitation mode, a chair mode, or a director mode; and determining, according to the conference mode, the at least one site is Describe the specific venue.

Optionally, in the foregoing device, when the conference mode is a voice excitation mode, the determining module determines that the at least one site is the specific site, and includes: inputting an audio value according to an audio input time of each participant site for a duration And/or duration of the voice, determining an active value of each of the participating venues;

Optionally, in the foregoing device, when the conference mode is the chair mode or the director mode, the determining module, determining that the at least one site is the specific site comprises: determining the at least one according to a chairman command or a director command. The venue is the specific venue.

Compared with the related art, the technical solution of the present application includes: determining that at least one site is a specific site for highlighting the specific site; displaying the specific site in a first area of the video interface; and displaying the remaining sites in the The second area of the video interface, the remaining site includes a part or all of the meeting sites of the at least one site, and the area of the first area is larger than the second area. The meeting highlights the venues that need to be focused on, and reflects the effect of other venues focusing on specific venues, creating an atmosphere in which all participants participate in the conference.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

FIG. 1 is a schematic flowchart diagram of an embodiment of a video conference image presentation method;

2 is a schematic diagram of an initial state of an embodiment of a video conference image presentation method;

3 is a schematic diagram showing a single conference site highlighting in an embodiment of a video conference image presentation method;

FIG. 4 is a schematic diagram showing multiple highlights of a conference site in an embodiment of a video conference image presentation method; Figure

FIG. 5 is a schematic structural diagram of an embodiment of a video conference image presenting apparatus.

Embodiments of the invention

The embodiments herein will be described in detail below with reference to the accompanying drawings. It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments in the present application may be arbitrarily combined with each other.

The steps illustrated in the flowchart of the figures may be executed in a computer system such as a set of computer executable instructions. Also, although logical sequences are shown in the flowcharts, in some cases the steps shown or described may be performed in a different order than the ones described herein.

The video conference image presentation method and device thereof provided by the embodiment of the present invention can be applied to a video conference process, and the screen of at least one conference site in the conference site is highlighted. The video conference image presentation apparatus provided in this embodiment may be integrated with a Multi Control Unit (MCU) or a server of the conference terminal. The video conference image presentation apparatus may be implemented by using software and/or hardware. The video conference image presentation method and apparatus provided in this embodiment are described in detail below.

FIG. 1 is a schematic flowchart of a video conference image presentation method according to an embodiment of the present invention. As shown in FIG. 1 , the video conference image presentation method includes steps 101 to 102:

Step 101: Determine that at least one site is a specific site for highlighting the specific site.

Optionally, first, acquiring a current conference mode, where the conference mode includes a voice excitation mode, a chair mode, or a director mode; and then determining, according to the conference mode, the at least one site is the specific conference site

Step 102: Display the specific conference site in a first area of the video interface.

Optionally, the method for displaying the specific site in the first area of the video interface includes at least the following two implementation manners:

In a first implementation manner, the specific venue is displayed in an enlarged manner in a first area of the video interface.

In a second implementation manner, the screen displayed in the first area of the video interface of the specific site is highlighted by a frame.

It should be noted that, in this embodiment, the manner in which the specific site is displayed in the first area of the video interface is not limited, and may be any manner that can be implemented by those skilled in the art.

Step 103: Display the remaining sites in the second area of the video interface.

The remaining site in this embodiment includes some or all of the participating sites except the specific site, wherein the area of the first region is larger than the second region.

Optionally, for displaying the remaining sites in the second area of the video interface, the following two implementation manners are included:

In the first implementation manner, all the remaining sites are displayed in the second area of the video interface.

In a second implementation manner, the remaining sites are alternately displayed in the second area of the video interface, that is, first, some sites in the remaining sites are displayed in the second area of the video interface, at a certain time. Then, another part of the other site in the other site is displayed in the second area of the video interface, so that the second area of the alternately rotated video interface displays the remaining sites.

In this embodiment, the at least one site is determined to be a specific site for highlighting the specific site; the specific site is displayed in a first area of the video interface; and the remaining site is displayed on the video interface In the second area, the remaining site includes a part or all of the meeting sites except the specific meeting site, and the area of the first area is larger than the second area. The meeting highlights the venues that need to be focused on, and reflects the effect of other venues focusing on specific venues, creating an atmosphere in which all participants participate in the conference.

Optionally, on the basis of the foregoing embodiment, before the determining that the at least one site is a specific site for highlighting the specific site, the method further includes:

Display all participating venues in the same size as the video interface; or

All participating venues are sequentially displayed in the video interface in the same proportion as the size.

FIG. 2 is a schematic diagram of an initial state of an embodiment of a video conference image presentation method. As shown in FIG. 2, in this embodiment, a state in which each conference does not start speaking is an initial state. Each site can be automatically arranged on the video interface according to the preset image display scale. Figure 2 shows the initial video screen presentation mode of the following nine venues.

It should be noted that if there are more than nine venues in the conference venue, all conference venues can be displayed in the same image display ratio by rotating in turn.

Optionally, on the basis of the foregoing embodiment, the number of currently participating conference sites may be displayed at a position of a screen edge or a corner.

For obtaining the current conference mode, the conference mode includes a voice excitation mode, a chair mode, or a director mode; and determining, according to the conference mode, that the at least one site is the specific site, and at least includes the following two implementation manners:

In the first implementation manner, when the current conference mode is the voice excitation mode, the active value of each participant site may be determined according to the audio input voice value and/or voice duration of each participant site for a period of time; and then, And determining, according to the active value, at least one site with a high active value is the specific site. The method can include:

The audio processing module receives all the site audio streams. The execution body of this embodiment may be an MCU. Then, after decoding the audio code stream of each site into Pulse Code Modulation (PCM) PCM data, the voice activity detection VAD algorithm is used to calculate the audio input voice size of all the sites in the last second. And the duration of the voice duration. The volume and duration determine whether the current site is an active site, and some sites are mistakenly judged as active sites because of occasional short abnormal sounds. Then, a specific site is selected from the plurality of sites according to an active state of each site. The specific venue may be one or more. Then, the image of the specific site is displayed as a highlighted site. In this way, the venues that need to be focused by all participants are highlighted in real time according to the active state of each venue during the conference. The related technical solution can avoid only one site in the single-screen conference mode, and can not pay attention to other sites in the conference; in the multi-screen conference mode, the site that is participating in the discussion cannot be fully focused on, in this multi-picture mode. It can reflect the effect of other venues watching a particular venue, creating an atmosphere in which all participants participate in the conference.

In this embodiment, a specific site is selected from the active site in a plurality of manners. The following description is made by way of example. Other technical personnel in the art may select other sites in other manners, and the embodiment of the present invention does not limit the embodiment. .

The first two of the active conference sites in the current voice detection period are used as the specific conference site.

Manner 2: According to the site that is active in the previous N voice detection time periods, and the site that is active in the current voice detection time period, it is intelligently determined whether it is necessary to change the selection of a specific site.

In a second implementation manner, when the current conference mode is the chairman mode or the director mode, the at least one site is determined to be the specific site according to a chair instruction or a director command. The method can include:

For example, the MCU receives signaling such as broadcast, selection, name, and speech of the conference chairperson or conference director. Then, a specific site is selected from all the sites according to the signaling. The specific venue may be one or more. The specific site in this embodiment may be a chair site and a site that is broadcasted, selected, named, and spoken. Then, the image of the specific site to be appealed is displayed as a highlighted meeting place. In this way, according to the operation of the chairman or director of the conference, it is necessary to highlight the venues that need to be focused on all the venues, and solve the problem that the related technology can only see the video images of a single conference site in the chairman mode.

FIG. 3 is a schematic diagram of a single conference site highlighting of a video conference image presentation method according to an embodiment of the present invention. As shown in FIG. 3, in this embodiment, a specific conference site is a conference site. In the initial state, a total of six conference sites participate in the conference, and the conference video is used. The display of the interface is shown in the first figure in the upper left corner of Figure 3. When the conference site 4 is selected to present the conference site as a specific conference site, the conference video screen is displayed as shown in scenario 1 of FIG. When the site 4 is selected to be a site for a specific site, the other sites of the conference video screen are scrolled as shown in scenario 2 and scenario 3 of FIG. 3 . If the number of participants in the conference is less than 6, the other venues do not need to be scrolled. When the conference site 5 is selected to present the conference site as a specific conference site, the conference video screen is displayed as shown in scenario 4 of FIG. When the site 5 is selected to present the site as a specific site, the other sites of the conference video screen are scrolled as shown in scenario 5 of FIG.

FIG. 4 is a schematic diagram showing a plurality of conference sites highlighted in a video conference image presentation method according to an embodiment of the present invention. As shown in FIG. 4, in the embodiment, a specific conference site is two conference sites. In the initial state, a total of nine conference venues participate in the conference. The conference video screen is presented in the first figure in the upper left corner of Figure 4. When the conference site 4 and the conference site 5 are selected to present the conference site as a specific conference site, the conference video screen is displayed as shown in scenario 1 of FIG. When the site 4 and the site 5 are selected as the site to be presented as a specific site, the other sites of the conference video screen are scrolled as shown in scenario 2 and scenario 3 of FIG. 4 . If the number of venues participating in the conference is less than 7, the other venues do not need to be scrolled. Venue 4 and Venue 9 were selected When the conference site is presented as a specific venue, the conference video screen is presented as shown in scenario 4 of FIG. When the conference site 4 and the conference site 9 are selected to present the conference site as a specific conference site, the other conference sites of the conference video screen are scrolled as shown in scenario 5 of FIG. 4 .

FIG. 5 is a schematic structural diagram of a video conference image presenting apparatus according to an embodiment of the present invention. As shown in FIG. 5, the video conference image presenting apparatus includes: a determining module 51 and a display module 52. among them,

The determining module 51 is configured to determine that the at least one site is a specific site for highlighting the specific site;

The display module 52 is configured to display the specific site in the first area of the video interface, and display the remaining site in the second area of the video interface, where the remaining site includes some or all of the participants in the at least one site. In the conference site, the area of the first area is larger than the area of the second area.

In this embodiment, the at least one site is determined to be a specific site for highlighting the specific site; the specific site is displayed in a first area of the video interface; and the remaining site is displayed on the video interface The second area, the remaining meeting site includes a part or all of the meeting sites of the at least one meeting site, and the area of the first area is larger than the second area. The meeting highlights the venues that need to be focused on, and reflects the effect of other venues focusing on specific venues, creating an atmosphere in which all participants participate in the conference.

On the basis of the foregoing embodiment, the display module 52 is further configured to alternately display the remaining venues in the second area of the video interface.

In addition, on the basis of the foregoing embodiment, the determining module 51 is further configured to determine that the first site is the specific site, and replace the first site with the second site of the at least one site.

Optionally, on the basis of the foregoing embodiment, the determining module 51 may be configured to acquire a current conference mode, where the conference mode includes a voice excitation mode, a chair mode, or a director mode; and determining, according to the conference mode, the At least one venue is the specific venue.

Optionally, on the basis of the foregoing embodiment, the determining module 51 may be configured to determine, according to the audio input voice value and/or the duration of the voice duration of each participant site for a period of time, determine the location of each of the participating venues. An active value is determined, according to the active value, determining that at least one site with a high active value is the specific site.

Optionally, on the basis of the foregoing embodiment, the determining module 51 may be configured to be according to the main The instruction or the director instruction determines that the at least one site is the specific site.

One of ordinary skill in the art will appreciate that all or a portion of the above steps may be performed by a program to instruct related hardware, such as a processor, which may be stored in a computer readable storage medium, such as a read only memory, disk or optical disk. Wait. Alternatively, all or part of the steps of the above embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module/unit in the above embodiment may be implemented in the form of hardware, for example, by implementing an integrated circuit to implement its corresponding function, or may be implemented in the form of a software function module, for example, executing a program stored in the memory by a processor. Instructions to achieve their corresponding functions. This application is not limited to any specific combination of hardware and software.

Industrial applicability

The technical solution provided by the embodiment of the present invention realizes highlighting the venue that needs to be focused on, and reflects the effect of other venues focusing on a specific venue, thereby creating an atmosphere in which all participants participate in the conference.

Claims

A video conference image presentation method includes:

Determining at least one venue as a specific venue;

Displaying the specific venue in a first area of the video interface;

The remaining site is displayed in the second area of the video interface, and the remaining site includes some or all of the participant sites except the specific site, and the area of the first region is larger than the second region.
The method of claim 1, wherein the displaying the remaining venues in the second area of the video interface comprises:

The remaining venues are alternately displayed in turn in the second area of the video interface.
The method according to claim 1 or 2, wherein after the determining that the at least one site is a specific site, the method further includes:

Determining that the first site is the specific site, and the first site is a site in the remaining site;

The first site is replaced with the second site in the specific site.
The method of claim 3, wherein the determining the at least one venue as a specific venue comprises:

Obtaining a current conference mode, where the conference mode includes a voice excitation mode, a chairman mode, or a director mode;

Determining, according to the conference mode, the at least one site is the specific site.
The method according to claim 4, wherein, when the conference mode is a voice excitation mode, the determining, according to the conference mode, the at least one site is the specific site, including:

According to the audio input voice value and/or voice duration of each participant's venue for a period of time, Determining the active value of each participating venue;

And determining, according to the active value, that the at least one site with the high activity value is the specific site.
The method of claim 4, wherein when the conference mode is the chairman mode or the director mode, the determining the at least one site as the specific site according to the conference mode comprises:

Determining the at least one venue as the specific venue according to a presidential instruction or a director instruction.
A video conference image presentation device includes:

Determining a module, setting to determine that at least one site is a specific site;

a display module, configured to display the specific site in a first area of the video interface; display the remaining site in a second area of the video interface, where the remaining site includes some or all of the participating sites except the specific site The area of the first area is larger than the second area.
The apparatus according to claim 7, wherein the display module is further configured to alternately display the remaining venues in the second area of the video interface.
The device according to claim 7 or 8, wherein the determining module is further configured to determine that the first site is the specific site; and the first site is replaced with a second site in the specific site.
The device of claim 9, wherein the determining module determines that the at least one site is a specific site, comprising: acquiring a current conference mode, where the conference mode includes a voice excitation mode, a chair mode, or a director mode; The mode determines that the at least one site is the specific site.
The device according to claim 10, wherein, when the conference mode is a voice excitation mode, the determining module determines, according to the conference mode, that the at least one site is the specific site: according to each participant And determining, according to the active value, the at least one site with the high value of the active site is the specific site.
The device according to claim 10, wherein the determining module determines, according to the conference mode, that the at least one site is the specific site, according to the conference mode, The chairman instruction or the director instruction determines that the at least one venue is the specific venue.