CN106231233B - Real-time screen fusion method based on weight - Google Patents
Real-time screen fusion method based on weight Download PDFInfo
- Publication number
- CN106231233B CN106231233B CN201610634402.6A CN201610634402A CN106231233B CN 106231233 B CN106231233 B CN 106231233B CN 201610634402 A CN201610634402 A CN 201610634402A CN 106231233 B CN106231233 B CN 106231233B
- Authority
- CN
- China
- Prior art keywords
- participants
- weight
- conference
- participant
- weights
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/155—Conference systems involving storage of or access to video conference sessions
Abstract
The invention provides a real-time screen fusing method based on weight, which comprises the following steps: dynamically adjusting the weight of the participants in real time according to the conference form and the number of the participants; and setting the display image of each participant on the video screen according to the weight of the participant. The invention can dynamically adjust the display mode according to the number of people, and highlights key speakers aiming at different speaking modes, so that screen resources can be reasonably utilized, and the video conference is more intelligent.
Description
Technical Field
The invention belongs to the technical field of video communication, and particularly relates to a real-time screen fusion method based on weights.
Background
Video conferencing is an increasingly important way of communicating in people's work and life. However, the screen fusion algorithm for the video conference call in the market is static, and a screen segmentation mode is preset, and then video images are filled in the screen segmentation mode. In the case of an insufficient number of people, a black screen replacement or a picture (avatar) replacement is used. When the number of the participated people reaches the preset number, other people are prevented from entering again, or another video conference which can contain more participated people is applied for opening again, and the screen-fusing algorithm causes the user experience to be very poor.
Disclosure of Invention
In order to solve the problems, the invention provides a real-time screen fusion method based on the weight, which can dynamically adjust the display mode according to the number of people, so that the video conference is more intelligent.
According to an embodiment of the invention, a real-time screen fusing method based on a weight is provided, which includes:
dynamically adjusting the weight of the participants in real time according to the conference form and the number of the participants;
and setting the display image of each participant on the video screen according to the weight of the participant.
According to an embodiment of the present invention, setting the display image of each participant on the video screen according to the weight of the participant further comprises:
the display area of the conference participants on the video screen is represented as:
wherein S isiShowing the area of presentation, Q, of the participants iiWeight value of the participant iK represents the number of participants, and A represents the video screen area.
According to an embodiment of the present invention, setting the display image of each participant on the video screen according to the weight of the participant further comprises:
dividing the conference participants with the same weight into a group;
adding the weights of the participants in each group, and sequentially distributing the display images of the participants in each group from large to small according to the sum of the weights;
and distributing the display images of all groups of the conference participants to all the conference participants in the group according to the weight of the conference participants in the group.
According to an embodiment of the present invention, setting the display image of each participant on the video screen according to the weight of the participant further comprises:
dividing the entire video screen into a plurality of equal small screen blocks;
and distributing corresponding area blocks consisting of the number of the small screen blocks adjacent to each other according to different weights of the participants to serve as display images of the participants.
According to an embodiment of the present invention, allocating corresponding area blocks composed of the number of the adjacent small screen blocks according to different weights of the conference participants as the display images of the conference participants further comprises:
adding the weights of all the participants;
finding out a resultant p closest to the added value of the weights, and meeting the condition that p is n (n + k '), wherein 0 is more than k' < 3, n is a first parameter, k 'is a second parameter, and n and k' are integers;
and distributing the number of small screen blocks according to the weight of each participant.
According to an embodiment of the present invention, setting the display image of each participant on the video screen according to the weight of the participant further comprises:
setting the ratio of the longitudinal length to the transverse length of a video screen display area of a participant as a/b;
calculating the display image of each participant according to the weight of each participant and a simultaneous equation set of the ratio of the longitudinal length to the transverse length a/b:
wherein, TiTransverse length, Q, of presentation image representing participant iiThe weight of the conference participants i is shown, S is the sum of the weights of the conference participants,k represents the number of participants, A represents the area of a video screen;
and determining the display image of each participant according to the transverse length of the video screen and the display image of the participant.
According to one embodiment of the present invention, the video screen of the conference participants has a 3:4 ratio of vertical length to horizontal length.
According to one embodiment of the invention, the conference form comprises a discussion form in which the weight of each of the participating members is equal.
According to one embodiment of the invention, the conference form comprises a lecture form in which a speaker weight is greater than other non-speaker weights.
According to an embodiment of the present invention, the dynamically adjusting the weight of the participants in real time according to the conference style and the number of the participants further comprises:
determining the number of the weights according to the number of the participated people;
and determining the weight value according to the conference form and the participation mode of the participants.
The invention has the beneficial effects that:
the invention can dynamically adjust the display mode according to the number of participants, and highlight key speakers aiming at different speaking modes, so that screen resources can be reasonably utilized, and the video conference is more intelligent.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
In order to more clearly illustrate the technical solution in the embodiments of the present invention, the drawings required in the description of the embodiments will be briefly introduced as follows:
FIG. 1 is a flow diagram of a method according to one embodiment of the invention.
Detailed Description
The following detailed description of the embodiments of the present invention will be provided with reference to the drawings and examples, so that how to apply the technical means to solve the technical problems and achieve the technical effects can be fully understood and implemented. It should be noted that, as long as there is no conflict, the embodiments and the features of the embodiments of the present invention may be combined with each other, and the technical solutions formed are within the scope of the present invention.
In order to better adapt to various different video call states, for example, a video conference is a discussion form, the weight of each participant is the same, and the image size of each participant is the same; if the conference is in the form of a lecture, the speaker should have a larger presentation image, with higher weight, than the others. Therefore, the invention provides a method for increasing a weight variable for each participant and setting the display area of the participants on the video screen based on different weights and different numbers of the participants.
Fig. 1 shows a flow chart of a method according to an embodiment of the invention, which is described in detail below with reference to fig. 1.
Firstly, step S110, dynamically adjusting the weight of the participants in the conference in real time according to the conference style and the number of the participants in the conference. Specifically, the number of the weights is determined according to the number of the participants, and the size of the weights is determined according to the conference form and the participation mode of the participants. That is, the number of the people plus the conference is set as many as possible, and the number of the weights changes as the number of the people participating in the conference changes. The conference forms are different, and the participation modes of the participants are different, so that the corresponding weights of the participants are different, and the weights change at any time along with the change of the participation modes and the number of the participants.
For example, when the conference form is a discussion form, the weight of each participant is equal. And if the conference form is a lecture form, the speaker weight is greater than the other non-speaker weights. When the participation mode and the number of the participants are changed, the weight value is correspondingly changed.
Next, step S120 is performed, in which the display image of each participant on the video screen is set according to the weight of the participant.
Specifically, the setting of the display image of each participant on the video screen according to the weight of the participant includes the following three modes.
The first is a complete dynamic division based on weight, that is, the size of the image displayed by the conference participants is complete and the weight is hooked. The display area of the conference participants on the video screen is represented as:
wherein S isiShowing the area of presentation, Q, of the participants iiThe weight value of a participant i is shown, k is the number of participants, and A is the area of a video screen.
In order to display the persons with the same weight at the adjacent positions, the method further includes, when distributing the display images of the persons in the conference: the conference participants with the same weight are firstly grouped into one group, so that the conference participants with the same weight are distributed together in the whole. And then adding the weights of the participants in each group, and sequentially distributing the display images of the participants in each group from large to small according to the sum of the weights, so as to separate the participants with different weights. And finally, distributing the display images of all groups of the participants to all the participants in the group according to the weight of the participants in the group, so that the participants with the same weight are displayed at adjacent positions.
The second is based on the dynamic partition of the fence type pseudo weight, i.e. the whole screen is imagined to be a segmented large screen composed of a plurality of equal small screen blocks, and different numbers of small screen blocks are distributed for displaying according to different weights. For example, with a weight of 4, the image is presented with 4 small screens together.
Specifically, the whole video screen is first divided into a plurality of equal small screen blocks, and the number of the small screen blocks can be divided according to the number of the participants. And distributing corresponding area blocks consisting of the number of the small screen blocks adjacent to each other according to different weights of the participants to serve as display images of the participants.
In specific implementation, the weights of all the participants are added to obtain a weight sum S. Then finding out the nearest composite number p from the weight sum value S, and satisfying:
p＝n*(n+k') (2)
wherein, k ' is more than 0 and less than 3, n is a first parameter, k ' is a second parameter, and n and k ' are integers. Of course, other values for k 'may be selected here, but for display convention, 0 < k' < 3 is selected.
And finally, distributing the number of small screen blocks according to the weight of each participant.
And the third method is enhancement type pseudo weight dynamic division based on a fence, namely under the condition of ensuring the ratio of the lengthwise length to the transverse length of the image, area division is carried out according to the weight, and an equation set is solved.
Specifically, the ratio of the vertical length to the horizontal length of the area displayed on the video screen of the conference participants is set to be a/b, wherein a represents the vertical length and b represents the horizontal length. And then calculating the display image of each participant according to a simultaneous equation set of the weight of each participant and the longitudinal-transverse length ratio a/b:
wherein, TiTransverse length, Q, of presentation image representing participant iiThe weight of the conference participants i is shown, S is the sum of the weights of the conference participants,k represents the number of participants, A representsVideo screen area.
And finally, determining the display image of each participant according to the video screen and the length of the display image of the participant. The ratio of length to length can be limited to 3:4 for the reason that most display screens in real life are in the ratio of 3:4 or 9:16, and other ratios can be used according to actual needs.
The following description will be given by taking the video screen display of the conference participants with a longitudinal to lateral length ratio of 3:4 as an example. Let T be the lateral length of the image of person iiThen the longitudinal length isHas an area size ofA system of equations is established according to equation (3):
the weight sum S is:
the invention can dynamically adjust the display mode according to the number of people, and highlights key speakers aiming at different speaking modes, so that screen resources can be reasonably utilized, and the video conference is more intelligent.
Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (7)
1. A real-time screen fusion method based on weight comprises the following steps:
dynamically adjusting the weight of the participants in real time according to the conference form and the number of the participants;
setting display images of all the participants on a video screen according to the weights of the participants;
determining the display area of the conference participants on the video screen according to the following formula:
wherein S isiShowing the area of presentation, Q, of the participants iiThe weight value of a participant i is shown, k is the number of participants, and A is the area of a video screen.
2. The method of claim 1, wherein setting the display image of each participant on the video screen according to the weight of the participant further comprises:
dividing the conference participants with the same weight into a group;
adding the weights of the participants in each group, and sequentially distributing the display images of the participants in each group from large to small according to the sum of the weights;
and distributing the display images of all groups of the conference participants to all the conference participants in the group according to the weight of the conference participants in the group.
3. A real-time screen fusion method based on weight comprises the following steps:
dynamically adjusting the weight of the participants in real time according to the conference form and the number of the participants;
setting the ratio of the longitudinal length to the transverse length of a video screen display area of a participant as a/b;
calculating the display image of each participant according to the weight of each participant and a simultaneous equation set of the ratio of the longitudinal length to the transverse length a/b:
wherein, TiTransverse length, Q, of presentation image representing participant iiThe weight of the conference participants i is shown, S is the sum of the weights of the conference participants,k represents the number of participants, A represents the area of a video screen;
and determining the display image of each participant according to the transverse length of the video screen and the display image of the participant.
4. The method of claim 3 wherein the video screen presentation of the conference participants has a 3:4 ratio of vertical length to horizontal length.
5. The method of any of claims 1-4, wherein the conference form comprises a discussion form, wherein each participating member is weighted equally.
6. The method of any of claims 1-4, wherein the conference form comprises a lecture form in which a speaker weight is greater than other non-speaker weights.
7. The method of any one of claims 1-4, wherein dynamically adjusting the weight of the participants in real time according to the conference style and the number of the participants further comprises:
determining the number of the weights according to the number of the participated people;
and determining the weight value according to the conference form and the participation mode of the participants.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610634402.6A CN106231233B (en) | 2016-08-05 | 2016-08-05 | Real-time screen fusion method based on weight |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610634402.6A CN106231233B (en) | 2016-08-05 | 2016-08-05 | Real-time screen fusion method based on weight |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106231233A CN106231233A (en) | 2016-12-14 |
| CN106231233B true CN106231233B (en) | 2019-12-20 |
Family
ID=57547006
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610634402.6A Active CN106231233B (en) | 2016-08-05 | 2016-08-05 | Real-time screen fusion method based on weight |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106231233B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107734292A (en) * | 2017-09-19 | 2018-02-23 | 浙江大华技术股份有限公司 | A kind of method and apparatus for carrying out display channel adjustment |
| CN110837557B (en) * | 2019-11-05 | 2023-02-17 | 北京声智科技有限公司 | Abstract generation method, device, equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101360198A (en) * | 2007-08-02 | 2009-02-04 | 株式会社东芝 | Electronic apparatus and face image display method |
| CN101963906A (en) * | 2010-09-20 | 2011-02-02 | 宇龙计算机通信科技(深圳)有限公司 | Terminal and terminal function option display method |
| CN103838808A (en) * | 2012-11-26 | 2014-06-04 | 索尼公司 | Information processing apparatus and method, and program |
| CN104603778A (en) * | 2012-08-24 | 2015-05-06 | 索尼公司 | Information processing apparatus, information processing method, and program |
| CN105100677A (en) * | 2014-05-21 | 2015-11-25 | 华为技术有限公司 | Method for presenting video conference, devices for presenting video conference and system for presenting video conference |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011091604A1 (en) * | 2010-01-29 | 2011-08-04 | 华为终端有限公司 | Method, apparatus and system for video communication |
-
2016
- 2016-08-05 CN CN201610634402.6A patent/CN106231233B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101360198A (en) * | 2007-08-02 | 2009-02-04 | 株式会社东芝 | Electronic apparatus and face image display method |
| CN101963906A (en) * | 2010-09-20 | 2011-02-02 | 宇龙计算机通信科技(深圳)有限公司 | Terminal and terminal function option display method |
| CN104603778A (en) * | 2012-08-24 | 2015-05-06 | 索尼公司 | Information processing apparatus, information processing method, and program |
| CN103838808A (en) * | 2012-11-26 | 2014-06-04 | 索尼公司 | Information processing apparatus and method, and program |
| CN105100677A (en) * | 2014-05-21 | 2015-11-25 | 华为技术有限公司 | Method for presenting video conference, devices for presenting video conference and system for presenting video conference |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106231233A (en) | 2016-12-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8570359B2 (en) | Video region of interest features | |
| US9258339B2 (en) | Presenting data to electronic meeting participants | |
| EP2139235B1 (en) | Video selector | |
| CN105874506B (en) | With the image blurring of details reservation | |
| US8319819B2 (en) | Virtual round-table videoconference | |
| CN103606182B (en) | Method and device for image rendering | |
| US6330022B1 (en) | Digital processing apparatus and method to support video conferencing in variable contexts | |
| CN114946175A (en) | Dynamic configuration of communication video stream placement based on aspect ratio of available display area | |
| US8704867B2 (en) | Method and system for optimal balance and spatial consistency | |
| CN104869265B (en) | The implementation method and device of a kind of multimedia conferencing | |
| CN106851176A (en) | Video meeting implementing method based on wechat | |
| CN101395912A (en) | System and method for displaying participants in a videoconference between locations | |
| KR20100126812A (en) | Displaying panoramic video image streams | |
| CN105338287B (en) | A kind of control method and device of video conference | |
| CN106162046A (en) | A kind of video conference image rendering method and device thereof | |
| CN106231233B (en) | Real-time screen fusion method based on weight | |
| CN114868107A (en) | Dynamically controlled aspect ratio for a communication session video stream | |
| CN113556504A (en) | Video conference display image processing method and device and video conference system | |
| US11847825B2 (en) | Audio and video management for extended reality video conferencing | |
| Hou et al. | A novel hyper-cast approach to enable cloud-based virtual classroom applications | |
| US20210029327A1 (en) | Intelligent adaptive and corrective layout composition | |
| KR20150042628A (en) | Method and apparatus of providing a distributed telepresense service | |
| CN111935084A (en) | Communication processing method and device | |
| CN116366798A (en) | Method, device, equipment and medium for displaying video pictures in video conference | |
| CN106341647A (en) | Screen splitting method of multi-party video call window |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |