CN117041470A - Conference display method and device, conference system, storage medium and electronic device - Google Patents

Conference display method and device, conference system, storage medium and electronic device Download PDF

Info

Publication number
CN117041470A
CN117041470A CN202311008631.3A CN202311008631A CN117041470A CN 117041470 A CN117041470 A CN 117041470A CN 202311008631 A CN202311008631 A CN 202311008631A CN 117041470 A CN117041470 A CN 117041470A
Authority
CN
China
Prior art keywords
conference
picture
participant terminal
terminal
page layout
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311008631.3A
Other languages
Chinese (zh)
Inventor
孙俊伟
王克彦
曹亚曦
俞鸣园
吕少卿
费敏健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Huachuang Video Signal Technology Co Ltd
Original Assignee
Zhejiang Huachuang Video Signal Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Huachuang Video Signal Technology Co Ltd filed Critical Zhejiang Huachuang Video Signal Technology Co Ltd
Priority to CN202311008631.3A priority Critical patent/CN117041470A/en
Publication of CN117041470A publication Critical patent/CN117041470A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1822Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1083In-session procedures
    • H04L65/1089In-session procedures by adding media; by removing media
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/403Arrangements for multi-party communication, e.g. for conferences

Abstract

The embodiment of the invention provides a conference display method, a conference device, a conference system, a storage medium and an electronic device, wherein the method comprises the following steps: acquiring meeting attribute information of a target meeting; determining a meeting participant terminal list for participating in a target meeting based on the meeting attribute information; determining a first participant terminal with a fixed page layout identifier included in a participant terminal list and a second participant terminal except the first participant terminal; determining a first page layout mode corresponding to the fixed page layout identifier and a second page layout mode corresponding to the second participant terminal based on the conference attribute information; the first participant terminal is controlled to display a conference picture of the target conference according to a first page layout mode, and the conference picture displayed by the first participant terminal is sent to a monitoring screen to be displayed; and controlling the second participant terminal to display the conference picture according to the second page layout mode. The invention achieves the effect of improving the dispatching of the multiparty picture to the monitoring screen for display.

Description

Conference display method and device, conference system, storage medium and electronic device
Technical Field
The embodiment of the invention relates to the field of video conferences, in particular to a conference display method and device, a conference system, a storage medium and an electronic device.
Background
The video conference system comprises MCU (multipoint control unit, i.e. video conference server), soft and hard terminals, recording and playing server and other various participation devices. The terminal collects image and sound and sends the image and sound to the MCU through coding. The MCU fuses or does not fuse the images sent by the terminals according to meeting requirements, and sends the images to each participating terminal after sound mixing or unmixed sound mixing, so that the audio and video call of the multiparty meeting participants is realized. In video conference applications of public security systems or emergency command systems, clients often have audio and video communication requirements on one side, and video monitoring requirements on the other side. How to conveniently schedule multi-party pictures in a video conference system to a monitoring large screen picture becomes a technical problem. Particularly, in a cross-stage cross-domain multi-channel cascading video conference system, terminals are distributed in each stage of independent video conference system, and how to push cross-stage terminal pictures to a television wall is more troublesome.
Therefore, at least the problem of inefficiency in scheduling multi-party pictures in the video conference system to the monitoring large screen exists in the related art.
In view of the above problems in the related art, no effective solution has been proposed at present.
Disclosure of Invention
The embodiment of the invention provides a conference display method, a conference device, a conference system, a storage medium and an electronic device, which at least solve the problem that in the related technology, the efficiency of dispatching multiparty pictures in a video conference system to a monitoring large screen is low.
According to an embodiment of the present invention, there is provided a method for displaying a conference, including: acquiring meeting attribute information of a target meeting; determining a list of participant terminals participating in the target conference based on the conference attribute information; determining a first participant terminal with a fixed page layout identifier included in the participant terminal list and a second participant terminal except the first participant terminal; determining a first page layout mode corresponding to the fixed page layout identifier and a second page layout mode corresponding to the second participant terminal based on the conference attribute information; controlling the first participant terminal to display the conference picture of the target conference according to the first page layout mode, and sending the conference picture displayed by the first participant terminal to a monitoring screen for display; and controlling the second participant terminal to display the conference picture according to the second page layout mode.
According to another embodiment of the present invention, there is provided a display device for a conference, including: the acquisition module is used for acquiring conference attribute information of the target conference; a first determining module, configured to determine a participant terminal list participating in the target conference based on the conference attribute information; a second determining module, configured to determine a first participant terminal with a fixed page layout identifier and a second participant terminal except the first participant terminal, where the first participant terminal is included in the participant terminal list; the third determining module is used for determining a first page layout mode corresponding to the fixed page layout identifier and a second page layout mode corresponding to the second participant terminal based on the conference attribute information; the first control module is used for controlling the first participant terminal to display the conference picture of the target conference according to the first page layout mode, and sending the conference picture displayed by the first participant terminal to a monitoring screen for display; and the second control module is used for controlling the second participant terminal to display the conference picture according to the second page layout mode.
According to still another embodiment of the present invention, there is also provided a conference system including: the conference control service is used for determining conference attribute information of a target conference based on a selection instruction input through a conference control page and storing the conference attribute information into a database; the signaling service is used for acquiring conference attribute information of a target conference, determining a conference participant terminal list participating in the target conference based on the conference attribute information, determining a first conference participant terminal with a fixed page layout identifier and a second conference participant terminal except the first conference participant terminal, determining a first page layout mode corresponding to the fixed page layout identifier and a second page layout mode corresponding to the second conference participant terminal based on the conference attribute information, controlling the first conference participant terminal to display a conference picture of the target conference according to the first page layout mode, transmitting the conference picture displayed by the first conference participant terminal to a television wall for display, and controlling the second conference participant terminal to display the conference picture according to the second page layout mode; the first participant terminal is used for displaying the conference picture of the target conference according to the first page layout mode, and sending the conference picture displayed by the first participant terminal to a monitoring screen for display; the second participant terminal is used for displaying the conference picture according to the second page layout mode; the monitoring screen is connected with the first participant terminal and is used for displaying conference pictures displayed by the first participant terminal.
According to a further embodiment of the invention, there is also provided a computer readable storage medium having stored therein a computer program, wherein the computer program is arranged to perform the steps of any of the method embodiments described above when run.
According to a further embodiment of the invention, there is also provided an electronic device comprising a memory having stored therein a computer program and a processor arranged to run the computer program to perform the steps of any of the method embodiments described above.
According to the method and the device for determining the conference attribute information of the target conference, conference attribute information of the target conference is acquired, a conference participant terminal list participating in the target conference is determined according to the conference attribute information, and a first conference participant terminal with a fixed page layout identifier and a second conference participant terminal except the first conference participant terminal are determined. And determining a first page layout mode corresponding to the fixed page layout identification according to the conference attribute information, determining a second page layout mode corresponding to the second participant terminal, controlling the first participant terminal to display a conference picture of the target conference according to the first page layout mode, sending the conference picture displayed by the first participant terminal to a monitoring screen for display, and controlling the second participant terminal to display the conference picture according to the second page layout mode. The second participant terminal and the first participant terminal of the fixed page layout can be configured through the conference attribute information, so that the second participant terminal can display conference pictures according to the second page layout mode, the first participant terminal can display conference pictures according to the fixed page layout, and the conference pictures displayed by the first participant terminal are directly synchronized to the monitoring screen to be displayed, so that the conference pictures are displayed by the monitoring screen in the fixed page layout mode, and the second participant terminal displays conference pictures according to the configured second page layout mode. Therefore, the problem of low efficiency of scheduling the multiparty pictures in the video conference system on the monitoring large screen in the related technology can be solved, and the effect of scheduling the multiparty pictures on the monitoring screen is improved.
Drawings
Fig. 1 is a hardware block diagram of a mobile terminal of a conference display method according to an embodiment of the present invention;
fig. 2 is a flowchart of a method of displaying a conference according to an embodiment of the present invention;
fig. 3 is a schematic diagram of screen configuration for each participant terminal according to an exemplary embodiment of the invention;
FIG. 4 is a diagram of a controlled page according to an exemplary embodiment of the present invention;
FIG. 5 is a schematic diagram of a tandem gateway service according to an exemplary embodiment of the present invention;
FIG. 6 is a schematic diagram of a system architecture for operating a display method of a conference according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a cascade of multi-stage videoconferencing systems, according to a particular embodiment of the present invention;
fig. 8 is a schematic diagram of a multi-stage videoconference system conference service connection, according to an illustrative embodiment of the present invention;
fig. 9 is a schematic diagram of a multi-stage videoconference system signaling service connection, according to a particular embodiment of the present invention;
fig. 10 is a block diagram of a display device of a conference according to an embodiment of the present invention.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings in conjunction with the embodiments.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order.
The method embodiments provided in the embodiments of the present application may be performed in a mobile terminal, a computer terminal or similar computing device. Taking the operation on a mobile terminal as an example, fig. 1 is a block diagram of a hardware structure of a mobile terminal of a method for displaying a conference according to an embodiment of the present application. As shown in fig. 1, a mobile terminal may include one or more (only one is shown in fig. 1) processors 102 (the processor 102 may include, but is not limited to, a microprocessor MCU or a processing device such as a programmable logic device FPGA) and a memory 104 for storing data, wherein the mobile terminal may also include a transmission device 106 for communication functions and an input-output device 108. It will be appreciated by those skilled in the art that the structure shown in fig. 1 is merely illustrative and not limiting of the structure of the mobile terminal described above. For example, the mobile terminal may also include more or fewer components than shown in fig. 1, or have a different configuration than shown in fig. 1.
The memory 104 may be used to store a computer program, for example, a software program of application software and a module, such as a computer program corresponding to a method for displaying a conference in an embodiment of the present application, and the processor 102 executes the computer program stored in the memory 104, thereby performing various functional applications and data processing, that is, implementing the above-mentioned method. Memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory remotely located relative to the processor 102, which may be connected to the mobile terminal via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission means 106 is arranged to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, simply referred to as NIC) that can connect to other network devices through a base station to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used to communicate with the internet wirelessly.
In this embodiment, a method for displaying a conference is provided, and fig. 2 is a flowchart of a method for displaying a conference according to an embodiment of the present invention, as shown in fig. 2, where the flowchart includes the following steps:
step S202, meeting attribute information of a target meeting is obtained;
step S204, determining a meeting participant terminal list for participating in the target meeting based on the meeting attribute information;
step S206, a first participant terminal with a fixed page layout identifier and a second participant terminal except the first participant terminal are determined, wherein the first participant terminal is included in the participant terminal list;
step S208, determining a first page layout mode corresponding to the fixed page layout identifier and a second page layout mode corresponding to the second participant terminal based on the conference attribute information;
Step S210, controlling the first participant terminal to display the conference picture of the target conference according to the first page layout mode, and sending the conference picture displayed by the first participant terminal to a monitoring screen for display;
and step S212, controlling the second participant terminal to display the conference picture according to the second page layout mode.
In the above embodiment, the target conference may be a web conference held by a presenter, and the presenter may invite the participant terminal to participate in the target conference through a video conference holding page. And inputting a selection instruction through the video conference holding page, and configuring attribute information for each participant terminal. The conference control service may generate conference attribute information according to the input selection instruction and store the conference attribute information in the database. The signaling service may obtain conference attribute information from a database. And determining a meeting participant terminal list for participating in the target meeting according to the meeting attribute information. The meeting terminal list may include a page layout mode corresponding to each meeting terminal and an identifier of a fixed page layout of each meeting terminal. The page layout mode may be represented by a privateLayoutSSRC field, and the FixedPage layout identifier may be represented by an isPinned field. When the attribute value of the isPinned field is 1, the participant terminal is in a FixedPage layout. When the attribute value of the ispinided field is 0, the participant terminal is in a non-FixedPage layout.
In the above embodiment, the participant terminal whose FixedPage layout identifier is 1 may be determined as the first participant terminal. And determining the participant terminal with the fixed page layout mark of 0 as a second participant terminal. The first participant terminal may display the conference screen according to a first page layout mode corresponding to a pre-configured FixedPage layout. The second participant terminal may display the conference screen in a second page layout manner. The first page layout display mode and the second page layout display mode can be the same or different, the second page layout display mode can be changed, and the first page layout display mode can be fixed, so that conference pictures displayed by the first participant terminal can be synchronously displayed on a monitoring screen so as to monitor a target conference in the monitoring screen.
In the above embodiment, the conference screen may be a screen formed by stitching video screens acquired by the image capturing apparatuses of the plurality of participant terminals. The first page layout display mode and the second page layout display mode may be that a plurality of pictures are displayed on a screen in equal area, for example, when two meeting terminals exist, the pictures collected by the two meeting terminals may be displayed on a screen in equal area up and down and in equal area left and right. The three screens may be displayed in equal areas up and down and in equal areas left and right. The display lamp can also be a four-grid display lamp, a six-grid display lamp and a nine-grid display lamp. The multiple pictures can be displayed in different areas, such as a certain picture occupies a large area, other pictures occupy other areas, and other pictures occupy other areas. All the pictures can be displayed in different areas. The invention does not limit the page layout display mode.
According to the method and the device for determining the conference attribute information of the target conference, conference attribute information of the target conference is acquired, a conference participant terminal list participating in the target conference is determined according to the conference attribute information, and a first conference participant terminal with a fixed page layout identifier and a second conference participant terminal except the first conference participant terminal are determined. And determining a first page layout mode corresponding to the fixed page layout identification according to the conference attribute information, determining a second page layout mode corresponding to the second participant terminal, controlling the first participant terminal to display a conference picture of the target conference according to the first page layout mode, sending the conference picture displayed by the first participant terminal to a monitoring screen for display, and controlling the second participant terminal to display the conference picture according to the second page layout mode. The second participant terminal and the first participant terminal of the fixed page layout can be configured through the conference attribute information, so that the second participant terminal can display conference pictures according to the second page layout mode, the first participant terminal can display conference pictures according to the fixed page layout, and the conference pictures displayed by the first participant terminal are directly synchronized to the monitoring screen to be displayed, so that the conference pictures are displayed by the monitoring screen in the fixed page layout mode, and the second participant terminal displays conference pictures according to the configured second page layout mode. Therefore, the problem of low efficiency of scheduling the multiparty pictures in the video conference system on the monitoring large screen in the related technology can be solved, and the effect of scheduling the multiparty pictures on the monitoring screen is improved.
The execution subject of the above steps may be a signaling service, but is not limited thereto.
In one exemplary embodiment, acquiring meeting attribute information of a target meeting includes: and acquiring conference attribute information from a database, wherein the conference attribute information is information determined by a conference control service through a selection instruction input by a conference control page, and the conference attribute information comprises configuration information of all conference terminals participating in the target conference, layout information of pictures displayed on each conference terminal and round-robin configuration information of multi-picture layout of each conference terminal. In this embodiment, the signaling service may obtain conference attribute information from the database. The conference attribute information may be information determined by the conference control service through a selection instruction input by the conference control page. The conference control page may be opened by a browser. The target conference host can enter a conference control page through a browser, and configuration information is configured for each conference participant terminal in the conference control page in a clicking or supporting mode. The configuration information may include a page layout manner of the participant terminal, a video display resolution, a displayed content, and whether the participant terminal is a FixedPage. When the participant terminal is a FixedPage, the FixedPage layout of the participant terminal is identified as 1. The schematic diagram of the picture configuration for each participant terminal can be seen in fig. 3, and as shown in fig. 3, in the conference control page, a picture selection drop-down frame and a picture selection fixed frame for configuring "picture configuration" - "layout display" according to a single participant terminal are realized. The picture configuration 'layout display' can select what picture is watched by the conference participant terminal, for example, a conference fusion flow main flow, a fusion flow adapting flow is large, a fusion flow adapting flow is in, a fusion flow adapting flow is small, a conference is any conference participant single picture or a custom layout, and the like, and the field is defined as privateLayoutSSRC; the "fixed picture" checkbox then expresses whether the picture of the terminal is fixed, and designates this field as isPinned. When clicking to confirm, calling the conference control service to modify the conference interface and modifying the conference list information.
In the above embodiment, the conference attribute information may further include multi-frame layout of the polling configuration information of each participant terminal, and the multi-frame layout of the polling configuration information may include frame polling and frame non-polling. For example, when a target conference has nine participant terminals to participate, the page layout mode may be in a delta shape, that is, there are three lattices, each lattice fills up the pictures of three participant terminals, and assuming that the multi-picture round-robin interval is 10s, a multi-picture round-robin layout is formed, and the display effect is that the pictures of three terminals are alternately displayed for each 10 s. When needing to be described, the multi-picture layout is public and private, and is used for a plurality of participant terminals, and is private and used for only one participant terminal. The schematic view of the conference control page can be seen in fig. 4, and in the conference control page, a conference/modification conference page is created to realize conference place selection, multi-picture layout configuration and multi-picture round-robin configuration as shown in fig. 4. The multi-picture layout is a display picture shared by all meeting participants when default pictures are configured. When the confirmation is clicked, the conference creation/modification conference interface of the conference control service is invoked.
In the above embodiment, the conference control service may provide a create conference/modify conference interface, store the conference list information (including privateLayourSSRC and ispinided attribute), the round robin information, the conference site selection, and the multi-screen layout information as conference attributes in the database, and then call the create conference/modify conference interface of the signaling service.
In an exemplary embodiment, controlling the first participant terminal to display the conference screen of the target conference according to the first page layout manner includes: determining whether the first page layout mode is the same as the historical page layout mode of the first participant terminal; and under the condition of non-uniformity, sending a layout setting request to the first participant terminal so as to instruct the first participant terminal to send a video stream acquisition request to a media service based on the layout setting request, acquiring the conference picture, and displaying the conference picture according to the first page layout mode. In this embodiment, the signaling service may provide a conference creation/modification conference interface, to implement loading of the latest conference attribute from the database, including traversing the conference participant terminal list, determining whether a first page layout manner in the participant terminal list is the same as a history page layout manner of the first participant terminal, and if not, sending a layout setting request to the first participant terminal, where the first participant terminal sends a video stream acquisition request to the media service according to the layout setting request, to acquire a conference picture, and implementing the conference picture according to the first page layout manner.
In the above embodiment, the signaling service may further determine, according to the participant terminal list, whether the first page layout manner of the second participant terminal is the same as the history page layout manner of the second participant terminal, and when the first page layout manner is different from the history page layout manner of the second participant terminal, display the conference screen according to the second page layout manner.
In the above embodiment, the signaling service may load the latest conference attribute from the database, including traversing the conference participant list, and if the conference participant attribute isPinned is 1, adding the conference participant device number deviceID to a dynamic map table isPinnedMap of the conference. Judging whether the attribute of the meeting party list is changed, if so, traversing the meeting party list, requesting a SetPrivateLayoutSSRC from each meeting party, and sending the latest privateLayoutSSRC value to the terminal so as to switch the terminal to a corresponding picture. The participant terminal may respond to the SetPrivateLayoutSSRC request initiated from the signaling service, and initiate an acquisition request of the corresponding video stream to the media service, and decode and output the corresponding picture.
In an exemplary embodiment, the method further comprises: under the condition that a control picture operation instruction is received, determining a third page layout mode corresponding to the control picture operation instruction; and controlling the second participant terminal to display the conference picture according to the third page layout mode. In this embodiment, the host of the target conference may further input a conference control screen operation instruction from the conference control page, and the second and conference terminals may respond to the conference control screen operation instruction and display the conference screen according to the third page layout manner. At this time, since the conference attribute information of the first participant terminal includes the FixedPage layout identifier, the conference screen of the first participant terminal is not rearranged. Furthermore, the conference picture in the monitor is not rearranged, so that the aim of monitoring the target conference in real time is fulfilled.
In an exemplary embodiment, determining the third page layout mode corresponding to the conference control screen operation instruction includes: under the condition that the conference control picture operation instruction is a roll call instruction, determining a chairman terminal, a roll call terminal and other conference terminals included in the second conference terminal based on the roll call instruction, determining the third page layout mode corresponding to the chairman terminal to be a picture acquired by the roll call terminal, determining the third page layout mode corresponding to the roll call terminal to be a picture acquired by the chairman terminal, and determining the third page layout mode corresponding to the other conference terminals to be a picture acquired by the roll call terminal or displaying the picture acquired by the chairman terminal; under the condition that the controllable picture operation command is a viewing target terminal command, determining a target terminal included in the second participant terminal based on the viewing target terminal command, determining the third page layout mode corresponding to the target terminal to display pictures acquired by all participant terminals, and determining the third page layout modes corresponding to other terminals except the target terminal included in the second participant terminal to display the pictures acquired by the target terminal; under the condition that the conference control picture operation instruction is a demonstration instruction, determining that the third page layout mode of the second participant terminal is to display a demonstration picture and pictures acquired by all participant terminals; and under the condition that the conference control picture operation command is a viewing target picture command, determining that the third page layout mode of the second conference participant terminal is to display a target picture corresponding to the viewing target picture command. In this embodiment, the first participant terminal may be added to the isPinnedMap list, and the screen layout of the terminal in the isPinnedMap list is fixed and does not change with the screen layout of other terminals.
In the above embodiment, the operation of controlling the picture of all the conferees in the conference may be performed, and the primary participant terminals in the isPinnedMap may be filtered according to the device number deviceID, including:
a) The roll call talk can be controlled, and the default picture effect is that the roll call person looks at the chairman and the other people look at the roll call person. The terminal with fixed picture looks at the picture configured by the 'layout display' of the terminal;
b) The method is characterized in that a user can control a whole chairman, the default picture effect is that the chairman sees conference multi-picture fusion flow, other people see chairman, and a terminal with a fixed picture sees a picture configured by layout display;
c) The method can control the 'initiate demonstration', the default picture effect is double-flow picture 'auxiliary large and main small' or double-screen picture, and the terminal of the fixed picture looks at the picture configured by 'layout display' of the terminal;
d) The main flow of all meeting is controlled, the default picture effect is that all meeting person terminals see the main flow of multi-picture fusion of meeting, and the terminals with fixed pictures see the pictures configured by the layout display;
e) The method is characterized in that the whole auxiliary stream watching is controlled, the default picture effect is that all the conference participant terminals watch the conference auxiliary stream, and the terminals with fixed pictures watch the picture configured by the layout display;
f) Other pictures can control operations, such as 'normal display', and the terminal fixing the picture can see the picture configured by 'layout display'.
In the above embodiment, for each picture control operation, the signaling service traverses the filtered participant list, initiates a SetPrivateLayoutSSRC switching picture request to each participant terminal, and sends the video stream ssrc corresponding to the picture to be watched by the latest terminal to the terminal.
In an exemplary embodiment, after determining a first participant terminal having a FixedPage layout identification and a second participant terminal other than the first participant terminal included in the list of participant terminals, the method further comprises: and under the condition that a demonstration instruction is received, controlling the first participant terminal to display a picture corresponding to the demonstration instruction according to a fourth page layout mode. In this embodiment, the screen displayed by the first session and the human terminal may be changed according to the received instruction. For example, when the received instruction is a presentation instruction, the primary participant terminal may display all the pictures acquired by the participants, may display a presentation picture, or may display both the pictures.
In an exemplary embodiment, the fourth page layout manner includes one of: the total area of the video pictures collected by all the participant terminals participating in the target conference on the screen of the first participant terminal is larger than the area of the demonstration picture; the total area of the video pictures collected by all the participant terminals participating in the target conference on the screen of the first participant terminal is smaller than or equal to the area of the demonstration picture; video pictures collected by all participant terminals participating in the target conference are displayed in a full screen in the first participant terminal; the demonstration picture is displayed in a full screen in the primary participant terminal; and the video pictures collected by all the participant terminals participating in the target conference are displayed in a full screen mode in the first participant terminal, and the demonstration pictures are suspended on the video pictures collected by all the participant terminals. In this embodiment, for the presentation stream, a "main-auxiliary layout" configuration may be added to the meeting picture configuration of the "fixed picture", that is, the fourth page layout manner may include one of the following: major and minor, minor major and minor, main stream full screen, auxiliary stream full screen, etc. When no demonstration is performed, the terminal does not use the main and auxiliary layout, the main stream picture is directly displayed, and when the demonstration is initiated and the auxiliary stream is watched in the whole, the terminal with the 'fixed picture' automatically uses the 'main and auxiliary layout', thereby realizing the effect of simultaneous monitoring of the main stream picture and the auxiliary stream picture.
In the above embodiment, when the video frames collected by all the participant terminals participating in the target conference are displayed in the first participant terminal in a full screen manner, and the demonstration frames are suspended on the video frames collected by all the participant terminals, the transparency of the demonstration frames can be configured, so that the effect that the demonstration frames do not block the video frames collected by all the participant terminals is achieved.
In an exemplary embodiment, sending the conference screen displayed by the primary participant terminal to a monitor screen for display includes: and sending the conference picture to the monitoring screen for display through a target cable. In this embodiment, the primary participant terminal may use HDMI or other similar cable to dock the splice controller with a video wall or a large screen television or a tablet, for implementing video conference picture monitoring purposes.
In an exemplary embodiment, the participant terminal list includes different levels of participant terminals, and the different levels of participant terminals are invited to participate in the target conference through a cascading gateway service. In this embodiment, a schematic view of the tandem gateway service may be referred to fig. 5, and as shown in fig. 5, the tandem gateway service may invite different levels of conferee terminals to refer to the target conference. The cascade gateway service may include a main field simulation terminal for acquiring video in an upper video conference system, and may also include a passenger field simulation terminal for acquiring video in a lower video conference system. The main field simulation terminal and the passenger field simulation terminal can communicate with each other to mutually transmit videos in the upper and lower video conference systems.
In an exemplary embodiment, after controlling the first participant terminal to display the conference screen of the target conference according to the first page layout manner, the method further includes: and splicing video pictures acquired by each participant terminal participating in the target conference to obtain a target conference picture, and sending the target video picture to a television wall so as to display the target conference picture in the television wall. In this embodiment, the video frames collected by each participant terminal may be spliced by the splice controller, and the spliced frames are sent to the tv wall for display. Therefore, the spliced picture can be directly displayed in the television wall without setting decoding equipment, and the construction cost of the video conference is reduced.
The following describes a method for displaying a conference in combination with a specific embodiment:
fig. 6 is a schematic diagram of a system operation system of a conference display method according to an embodiment of the present invention, and as shown in fig. 6, the conference video structure includes a WEB browser, a conference control service, a signaling service, a media service, a terminal 1 (corresponding to the second participant terminal), a terminal 2 (corresponding to the first participant terminal), a cascade gateway service, a splice controller, a monitor television wall, and a monitor large screen (corresponding to the monitor screen).
Browser-side page logic:
1. in the conference control page, a screen selection drop-down frame and a fixed screen hooking frame are realized according to a single conference person configuration screen layout display screen. The picture configuration 'layout display' can select what picture is watched by the conference participant terminal, for example, a conference fusion flow main flow, a fusion flow adapting flow is large, a fusion flow adapting flow is in, a fusion flow adapting flow is small, a conference is any conference participant single picture or a custom layout, and the like, and the field is defined as privateLayoutSSRC; the "fixed picture" checkbox then expresses whether the picture of the terminal is fixed, and designates this field as isPinned. When clicking to confirm, calling the conference control service to modify the conference interface and modifying the conference list information.
2. In the meeting control page, creating a meeting/modifying meeting page to realize meeting place selection, multi-picture layout configuration and multi-picture round-robin configuration. The multi-picture layout is a display picture shared by all meeting participants when default pictures are configured. When the confirmation is clicked, the conference creation/modification conference interface of the conference control service is invoked.
And the service logic is controlled to:
1. providing a conference creation/modification interface, storing conference list information (comprising privatelayourSSRC and ispinied attribute), round-robin information, conference place selection and multi-picture layout information as conference attribute into a database, and calling the conference creation/modification interface of signaling service.
Signaling service logic:
1. a create conference/modify conference interface is provided,
a) The method comprises the steps of loading the latest conference attribute from a database, including traversing a conference participant list, and adding the conference participant equipment number deviceID to a dynamic map table isPinnedMap of the conference if the conference participant attribute isPinned is 1.
b) Judging whether the attribute of the meeting party list is changed, if so, traversing the meeting party list, requesting a SetPrivateLayoutSSRC from each meeting party, and sending the latest privateLayoutSSRC value to the terminal so as to switch the terminal to a corresponding picture.
2. For picture control operation of all meeting participants in a meeting, filtering terminals in an isPinnedMap according to a device number deviceID, including:
a) The roll call talk can be controlled, and the default picture effect is that the roll call person looks at the chairman and the other people look at the roll call person. The terminal with fixed picture looks at the picture configured by the 'layout display' of the terminal;
b) The method is characterized in that a user can control a whole chairman, the default picture effect is that the chairman sees conference multi-picture fusion flow, other people see chairman, and a terminal with a fixed picture sees a picture configured by layout display;
c) The method can control the 'initiate demonstration', the default picture effect is double-flow picture 'auxiliary large and main small' or double-screen picture, and the terminal of the fixed picture looks at the picture configured by 'layout display' of the terminal;
d) The main flow of all meeting is controlled, the default picture effect is that all meeting person terminals see the main flow of multi-picture fusion of meeting, and the terminals with fixed pictures see the pictures configured by the layout display;
e) The method is characterized in that the whole auxiliary stream watching is controlled, the default picture effect is that all the conference participant terminals watch the conference auxiliary stream, and the terminals with fixed pictures watch the picture configured by the layout display;
f) Other picture-controllable operations, e.g. "conventional display" or the like …
3. For each picture control operation, the signaling service traverses the filtered conference list, initiates a SetPrivateLayoutSSRC picture switching request to each of the conference terminals, and sends a video stream ssrc corresponding to the picture to be watched by the latest terminal to the terminal.
Terminal logic:
1. responding to a SetPrivateLayOutSSRC request initiated by the signaling service, initiating an acquisition request of a corresponding video stream to the media service, and decoding and outputting a corresponding picture.
2. The terminal uses HDMI or other similar cables to butt joint the splice controller and the television wall or the large-screen television or the flat panel for realizing video conference picture monitoring application.
Expansion logic:
for the presentation flow, a ' main and auxiliary layout ' configuration can be added in a fixed-screen ' meeting picture configuration, which comprises the following steps: major and minor, minor major and minor, main stream full screen, auxiliary stream full screen, etc. When no demonstration is performed, the terminal does not use the main and auxiliary layout, the main stream picture is directly displayed, and when the demonstration is initiated and the auxiliary stream is watched in the whole, the terminal with the 'fixed picture' automatically uses the 'main and auxiliary layout', thereby realizing the effect of simultaneous monitoring of the main stream picture and the auxiliary stream picture.
In the foregoing embodiment, a schematic cascading diagram of a multi-stage video conference system may be referred to fig. 7, a schematic connection diagram of a multi-stage video conference system session control service may be referred to fig. 8, a schematic connection diagram of a multi-stage video conference system signaling service may be referred to fig. 9, as shown in fig. 5 and fig. 7-9, a conference system running a conference display method may include a multi-stage system, a multi-stage service, and the multi-stage system and the multi-stage service may implement up-and-down communication through a cascading gateway service, so as to implement wall-mounted round inspection of a cross-stage cross-domain terminal on a video wall of a top-stage MCU in a cascading conference system of a tree network. The problem that the television wall inspection cannot be conducted through the step inspection is solved. Multiplexing of two kinds of round-robin pictures of multi-picture round-robin and television wall round-robin of the meeting is realized, and coding cost and network transmission bandwidth cost of an MCU end are greatly reduced.
For example, the provincial conference system a has terminals a1, a2, a3, a4, the city 1 conference system B has terminals B1, B2, and the city 2 conference system C has terminals C1, C2. The terminals a1, a2, b1, b2, c1, c2 establish a cascading video conference to play a meeting according to the requirements. The meeting person lists are a1, a2, b1, b2, c1 and c2. At this time, the user can additionally add a provincial terminal without meeting requirements as a meeting monitoring terminal, and supposing a3, the user only needs to set the layout display of a3 as the main stream of the fusion stream, select and select the fixed picture, then set the multi-picture layout on the modified meeting page, and start multi-picture round inspection. At this time, a3 can be used for video conference picture monitoring and conference sound can be heard. Because the conference multi-picture round robin has realized the cross-stage cross-domain round robin, and the round patrol video stream requests as required, the monitoring picture of a3 also naturally realizes the cross-stage cross-domain round robin effect. At the moment, multiplexing of the conference multi-picture fusion round and the video wall conference picture monitoring round is realized. If the multi-picture layout requirement of video wall conference picture monitoring is different from the conference multi-picture layout requirement, the custom layout can be configured aiming at a3, and special multi-picture layout and multi-picture round-robin parameters can be set for the custom layout. If there is a multi-party monitoring requirement, an idle terminal, such as a4, can be additionally added, and the picture is set as a 'fixed picture', so as to realize the multi-point picture monitoring requirement.
In the foregoing embodiment, the screen configuration of one or more idle terminals in the cascaded video conference is set to "fixed screen", and these terminals that are "fixed screen" are filtered in the screen conference control operation for the whole conference participants so as to always maintain one fixed screen output for realizing the video conference screen monitoring purpose. The video wall wheel inspection configuration is realized in the conference control page of the video conference system uniformly, a special configuration entrance when a conference picture is on the wall is removed, and the integral usability of the conference system is improved. The special decoding equipment for the television wall is removed, such as 'television wall terminal' or 'encoding and decoding matrix'. Any one or more idle terminals in the conference system can be used for conference picture monitoring. The system overall construction cost is saved, the flexibility of system resource calling is improved, and the complexity of system management and maintenance is reduced.
From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The present embodiment also provides a conference display device, which is used to implement the foregoing embodiments and preferred embodiments, and is not described in detail. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
Fig. 10 is a block diagram of a display device of a conference according to an embodiment of the present invention, and as shown in fig. 10, the device includes:
an obtaining module 1002, configured to obtain meeting attribute information of a target meeting;
a first determining module 1004, configured to determine a participant terminal list participating in the target conference based on the conference attribute information;
a second determining module 1006, configured to determine a first participant terminal with a FixedPage layout identifier and a second participant terminal except the first participant terminal included in the participant terminal list;
a third determining module 1008, configured to determine, based on the conference attribute information, a first page layout manner corresponding to the fixed page layout identifier and a second page layout manner corresponding to the second participant terminal;
A first control module 1010, configured to control the first participant terminal to display a conference picture of the target conference according to the first page layout manner, and send the conference picture displayed by the first participant terminal to a monitor screen for display;
and a second control module 1012, configured to control the second participant terminal to display the conference screen according to the second page layout manner.
In one exemplary embodiment, the obtaining module 1002 may implement obtaining meeting attribute information of the target meeting by: and acquiring conference attribute information from a database, wherein the conference attribute information is information determined by a conference control service through a selection instruction input by a conference control page, and the conference attribute information comprises configuration information of all conference terminals participating in the target conference, layout information of pictures displayed on each conference terminal and round-robin configuration information of multi-picture layout of each conference terminal.
In an exemplary embodiment, the first control module 1010 may implement controlling the first participant terminal to display the conference screen of the target conference according to the first page layout manner by: determining whether the first page layout mode is the same as the historical page layout mode of the first participant terminal; and under the condition of non-uniformity, sending a layout setting request to the first participant terminal so as to instruct the first participant terminal to send a video stream acquisition request to a media service based on the layout setting request, acquiring the conference picture, and displaying the conference picture according to the first page layout mode.
In an exemplary embodiment, the apparatus is further configured to determine, when the command for controlling the screen operation is received, a third page layout mode corresponding to the command for controlling the screen operation; and controlling the second participant terminal to display the conference picture according to the third page layout mode.
In an exemplary embodiment, the apparatus may determine a third page layout manner corresponding to the control screen operation instruction by: when the conference control picture operation command is a roll call command, determining a chairman terminal, a roll call terminal and other conference terminals included in the second conference participant terminal based on the roll call command, determining that the third page layout mode corresponding to the chairman terminal is to display a picture acquired by the roll call terminal, determining that the third page layout mode corresponding to the roll call terminal is to display a picture acquired by the chairman terminal, and determining that the third page layout mode corresponding to the other conference participant terminals is to display a picture acquired by the roll call terminal or display a picture acquired by the chairman terminal; under the condition that the controllable picture operation command is a viewing target terminal command, determining a target terminal included in the second participant terminal based on the viewing target terminal command, determining the third page layout mode corresponding to the target terminal to display pictures acquired by all participant terminals, and determining the third page layout modes corresponding to other terminals except the target terminal included in the second participant terminal to display the pictures acquired by the target terminal; under the condition that the conference control picture operation instruction is a demonstration instruction, determining that the third page layout mode of the second participant terminal is to display a demonstration picture and pictures acquired by all participant terminals; and under the condition that the conference control picture operation command is a viewing target picture command, determining that the third page layout mode of the second conference participant terminal is to display a target picture corresponding to the viewing target picture command.
In an exemplary embodiment, the apparatus is further configured to, after determining a first participant terminal with a fixed page layout identifier and a second participant terminal other than the first participant terminal included in the participant terminal list, control the first participant terminal to display a screen corresponding to the presentation instruction according to a fourth page layout manner if a presentation instruction is received.
In an exemplary embodiment, the fourth page layout manner includes one of: the total area of the video pictures collected by all the participant terminals participating in the target conference on the screen of the first participant terminal is larger than the area of the demonstration picture; the total area of the video pictures collected by all the participant terminals participating in the target conference on the screen of the first participant terminal is smaller than or equal to the area of the demonstration picture; video pictures collected by all participant terminals participating in the target conference are displayed in a full screen in the first participant terminal; the demonstration picture is displayed in a full screen in the primary participant terminal; and the video pictures collected by all the participant terminals participating in the target conference are displayed in a full screen mode in the first participant terminal, and the demonstration pictures are suspended on the video pictures collected by all the participant terminals.
In an exemplary embodiment, the first control module 1010 may send the conference picture displayed by the first participant terminal to the monitor screen for displaying in the following manner: and sending the conference picture to the monitoring screen for display through a target cable.
In an exemplary embodiment, the participant terminal list includes different levels of participant terminals, and the different levels of participant terminals are invited to participate in the target conference through a cascading gateway service.
It should be noted that each of the above modules may be implemented by software or hardware, and for the latter, it may be implemented by, but not limited to: the modules are all located in the same processor; alternatively, the above modules may be located in different processors in any combination.
The embodiment of the invention also provides a conference system, which comprises: the conference control service is used for determining conference attribute information of a target conference based on a selection instruction input through a conference control page and storing the conference attribute information into a database; the signaling service is used for acquiring conference attribute information of a target conference, determining a conference participant terminal list participating in the target conference based on the conference attribute information, determining a first conference participant terminal with a fixed page layout identifier and a second conference participant terminal except the first conference participant terminal, determining a first page layout mode corresponding to the fixed page layout identifier and a second page layout mode corresponding to the second conference participant terminal based on the conference attribute information, controlling the first conference participant terminal to display a conference picture of the target conference according to the first page layout mode, transmitting the conference picture displayed by the first conference participant terminal to a television wall for display, and controlling the second conference participant terminal to display the conference picture according to the second page layout mode; the first participant terminal is used for displaying the conference picture of the target conference according to the first page layout mode, and sending the conference picture displayed by the first participant terminal to a monitoring screen for display; the second participant terminal is used for displaying the conference picture according to the second page layout mode; the monitoring screen is connected with the first participant terminal and is used for displaying conference pictures displayed by the first participant terminal.
In the above embodiment, the target conference may be a web conference held by a presenter, and the presenter may invite the participant terminal to participate in the target conference through a video conference holding page. And inputting a selection instruction through the video conference holding page, and configuring attribute information for each participant terminal. The conference control service may generate conference attribute information according to the input selection instruction and store the conference attribute information in the database. The signaling service may obtain conference attribute information from a database. And determining a meeting participant terminal list for participating in the target meeting according to the meeting attribute information. The meeting terminal list may include a page layout mode corresponding to each meeting terminal and an identifier of a fixed page layout of each meeting terminal. The page layout mode may be represented by a privateLayoutSSRC field, and the FixedPage layout identifier may be represented by an isPinned field. When the attribute value of the isPinned field is 1, the participant terminal is in a FixedPage layout. When the attribute value of the ispinided field is 0, the participant terminal is in a non-FixedPage layout.
In the above embodiment, the participant terminal whose FixedPage layout identifier is 1 may be determined as the first participant terminal. And determining the participant terminal with the fixed page layout mark of 0 as a second participant terminal. The first participant terminal may display the conference screen according to a first page layout mode corresponding to a pre-configured FixedPage layout. The second participant terminal may display the conference screen in a second page layout manner. The first page layout display mode and the second page layout display mode can be the same or different, the second page layout display mode can be changed, and the first page layout display mode can be fixed, so that conference pictures displayed by the first participant terminal can be synchronously displayed on a monitoring screen so as to monitor a target conference in the monitoring screen.
In the above embodiment, the conference screen may be a screen formed by stitching video screens acquired by the image capturing apparatuses of the plurality of participant terminals. The first page layout display mode and the second page layout display mode may be that a plurality of pictures are displayed on a screen in equal area, for example, when two meeting terminals exist, the pictures collected by the two meeting terminals may be displayed on a screen in equal area up and down and in equal area left and right. The three screens may be displayed in equal areas up and down and in equal areas left and right. The display lamp can also be a four-grid display lamp, a six-grid display lamp and a nine-grid display lamp. The multiple pictures can be displayed in different areas, such as a certain picture occupies a large area, other pictures occupy other areas, and other pictures occupy other areas. All the pictures can be displayed in different areas. The invention does not limit the page layout display mode.
According to the method and the device for determining the conference attribute information of the target conference, conference attribute information of the target conference is acquired, a conference participant terminal list participating in the target conference is determined according to the conference attribute information, and a first conference participant terminal with a fixed page layout identifier and a second conference participant terminal except the first conference participant terminal are determined. And determining a first page layout mode corresponding to the fixed page layout identification according to the conference attribute information, determining a second page layout mode corresponding to the second participant terminal, controlling the first participant terminal to display a conference picture of the target conference according to the first page layout mode, sending the conference picture displayed by the first participant terminal to a monitoring screen for display, and controlling the second participant terminal to display the conference picture according to the second page layout mode. The second participant terminal and the first participant terminal of the fixed page layout can be configured through the conference attribute information, so that the second participant terminal can display conference pictures according to the second page layout mode, the first participant terminal can display conference pictures according to the fixed page layout, and the conference pictures displayed by the first participant terminal are directly synchronized to the monitoring screen to be displayed, so that the conference pictures are displayed by the monitoring screen in the fixed page layout mode, and the second participant terminal displays conference pictures according to the configured second page layout mode. Therefore, the problem of low efficiency of scheduling the multiparty pictures in the video conference system on the monitoring large screen in the related technology can be solved, and the effect of scheduling the multiparty pictures on the monitoring screen is improved.
In an exemplary embodiment, the conference system further comprises: and the browser enters the conference control page through the browser, and is used for determining the conference attribute information based on the selection instruction and sending the conference attribute information to the conference control service. The conference attribute information may be information determined by the conference control service through a selection instruction input by the conference control page. The conference control page may be opened by a browser. The target conference host can enter a conference control page through a browser, and configuration information is configured for each conference participant terminal in the conference control page in a clicking or supporting mode. The configuration information may include a page layout manner of the participant terminal, a video display resolution, a displayed content, and whether the participant terminal is a FixedPage. When the participant terminal is a FixedPage, the FixedPage layout of the participant terminal is identified as 1. The schematic diagram of the picture configuration for each participant terminal can be seen in fig. 3, and as shown in fig. 3, in the conference control page, a picture selection drop-down frame and a picture selection fixed frame for configuring "picture configuration" - "layout display" according to a single participant terminal are realized. The picture configuration 'layout display' can select what picture is watched by the conference participant terminal, for example, a conference fusion flow main flow, a fusion flow adapting flow is large, a fusion flow adapting flow is in, a fusion flow adapting flow is small, a conference is any conference participant single picture or a custom layout, and the like, and the field is defined as privateLayoutSSRC; the "fixed picture" checkbox then expresses whether the picture of the terminal is fixed, and designates this field as isPinned. When clicking to confirm, calling the conference control service to modify the conference interface and modifying the conference list information.
In the above embodiment, the conference attribute information may further include round configuration information of a multi-screen layout of each participant terminal. The schematic view of the conference control page can be seen in fig. 4, and in the conference control page, a conference/modification conference page is created to realize conference place selection, multi-picture layout configuration and multi-picture round-robin configuration as shown in fig. 4. The multi-picture layout is a display picture shared by all meeting participants when default pictures are configured. When the confirmation is clicked, the conference creation/modification conference interface of the conference control service is invoked.
In the above embodiment, the conference control service may provide a create conference/modify conference interface, store the conference list information (including privateLayourSSRC and ispinided attribute), the round robin information, the conference site selection, and the multi-screen layout information as conference attributes in the database, and then call the create conference/modify conference interface of the signaling service.
In an exemplary embodiment, the conference system further comprises: and the first participant terminal and the second participant terminal acquire the conference picture through the media service. In this embodiment, the service may load the latest conference attribute from the database, including traversing the conference participant list, and if the conference participant attribute isPinned is 1, adding the conference participant device number deviceID to a dynamic map table isPinnedMap of the conference. Judging whether the attribute of the meeting party list is changed, if so, traversing the meeting party list, requesting a SetPrivateLayoutSSRC from each meeting party, and sending the latest privateLayoutSSRC value to the terminal so as to switch the terminal to a corresponding picture. The participant terminal may respond to the SetPrivateLayoutSSRC request initiated from the signaling service, and initiate an acquisition request of the corresponding video stream to the media service, and decode and output the corresponding picture.
In an exemplary embodiment, the conference system further comprises: and the cascading gateway service is used for inviting the meeting participant terminals with different levels to participate in the target meeting. In this embodiment, a schematic view of the tandem gateway service may be referred to fig. 5, and as shown in fig. 5, the tandem gateway service may invite different levels of conferee terminals to refer to the target conference. The cascade gateway service may include a main field simulation terminal for acquiring video in an upper video conference system, and may also include a passenger field simulation terminal for acquiring video in a lower video conference system. The main field simulation terminal and the passenger field simulation terminal can communicate with each other to mutually transmit videos in the upper and lower video conference systems.
In an exemplary embodiment, the conference system further comprises: the splicing controller is connected with the first participant terminal and is used for splicing video pictures acquired by each participant terminal participating in the target conference to obtain target conference pictures; and the television wall is connected with the splicing controller and is used for displaying the target conference picture sent by the splicing controller. The video pictures collected by each participant terminal can be spliced through the splicing controller, and the spliced pictures are sent to the television wall for display. Therefore, the spliced picture can be directly displayed in the television wall without setting decoding equipment, and the construction cost of the video conference is reduced.
Embodiments of the present invention also provide a computer readable storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the method embodiments described above when run.
In one exemplary embodiment, the computer readable storage medium may include, but is not limited to: a usb disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing a computer program.
An embodiment of the invention also provides an electronic device comprising a memory having stored therein a computer program and a processor arranged to run the computer program to perform the steps of any of the method embodiments described above.
In an exemplary embodiment, the electronic apparatus may further include a transmission device connected to the processor, and an input/output device connected to the processor.
Specific examples in this embodiment may refer to the examples described in the foregoing embodiments and the exemplary implementation, and this embodiment is not described herein.
It will be appreciated by those skilled in the art that the modules or steps of the invention described above may be implemented in a general purpose computing device, they may be concentrated on a single computing device, or distributed across a network of computing devices, they may be implemented in program code executable by computing devices, so that they may be stored in a storage device for execution by computing devices, and in some cases, the steps shown or described may be performed in a different order than that shown or described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple modules or steps of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only of the preferred embodiments of the present invention and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the principle of the present invention should be included in the protection scope of the present invention.

Claims (17)

1. A method for displaying a conference, comprising:
Acquiring meeting attribute information of a target meeting;
determining a list of participant terminals participating in the target conference based on the conference attribute information;
determining a first participant terminal with a fixed page layout identifier included in the participant terminal list and a second participant terminal except the first participant terminal;
determining a first page layout mode corresponding to the fixed page layout identifier and a second page layout mode corresponding to the second participant terminal based on the conference attribute information;
controlling the first participant terminal to display the conference picture of the target conference according to the first page layout mode, and sending the conference picture displayed by the first participant terminal to a monitoring screen for display;
and controlling the second participant terminal to display the conference picture according to the second page layout mode.
2. The method of claim 1, wherein obtaining meeting attribute information for the target meeting comprises:
and acquiring conference attribute information from a database, wherein the conference attribute information is information determined by a conference control service through a selection instruction input by a conference control page, and the conference attribute information comprises configuration information of all conference terminals participating in the target conference, layout information of pictures displayed on each conference terminal and round-robin configuration information of multi-picture layout of each conference terminal.
3. The method of claim 1, wherein controlling the first participant terminal to display the conference screen of the target conference in the first page layout manner comprises:
determining whether the first page layout mode is the same as the historical page layout mode of the first participant terminal;
and under the condition of non-uniformity, sending a layout setting request to the first participant terminal so as to instruct the first participant terminal to send a video stream acquisition request to a media service based on the layout setting request, acquiring the conference picture, and displaying the conference picture according to the first page layout mode.
4. The method according to claim 1, wherein the method further comprises:
under the condition that a control picture operation instruction is received, determining a third page layout mode corresponding to the control picture operation instruction;
and controlling the second participant terminal to display the conference picture according to the third page layout mode.
5. The method of claim 4, wherein determining a third page layout mode corresponding to the command for the conference control screen comprises:
under the condition that the conference control picture operation instruction is a roll call instruction, determining a chairman terminal, a roll call terminal and other conference terminals included in the second conference terminal based on the roll call instruction, determining the third page layout mode corresponding to the chairman terminal to be a picture acquired by the roll call terminal, determining the third page layout mode corresponding to the roll call terminal to be a picture acquired by the chairman terminal, and determining the third page layout mode corresponding to the other conference terminals to be a picture acquired by the roll call terminal or displaying the picture acquired by the chairman terminal;
Under the condition that the controllable picture operation command is a viewing target terminal command, determining a target terminal included in the second participant terminal based on the viewing target terminal command, determining the third page layout mode corresponding to the target terminal to display pictures acquired by all participant terminals, and determining the third page layout modes corresponding to other terminals except the target terminal included in the second participant terminal to display the pictures acquired by the target terminal;
under the condition that the conference control picture operation instruction is a demonstration instruction, determining that the third page layout mode of the second participant terminal is to display a demonstration picture and pictures acquired by all participant terminals;
and under the condition that the conference control picture operation command is a viewing target picture command, determining that the third page layout mode of the second conference participant terminal is to display a target picture corresponding to the viewing target picture command.
6. The method of claim 1, wherein after determining a first participant terminal having a FixedPage layout identification included in the list of participant terminals and a second participant terminal other than the first participant terminal, the method further comprises:
And under the condition that a demonstration instruction is received, controlling the first participant terminal to display a picture corresponding to the demonstration instruction according to a fourth page layout mode.
7. The method of claim 6, wherein the fourth page layout means comprises one of:
the total area of the video pictures collected by all the participant terminals participating in the target conference on the screen of the first participant terminal is larger than the area of the demonstration picture;
the total area of the video pictures collected by all the participant terminals participating in the target conference on the screen of the first participant terminal is smaller than or equal to the area of the demonstration picture;
video pictures collected by all participant terminals participating in the target conference are displayed in a full screen in the first participant terminal;
the demonstration picture is displayed in a full screen in the primary participant terminal;
and the video pictures collected by all the participant terminals participating in the target conference are displayed in a full screen mode in the first participant terminal, and the demonstration pictures are suspended on the video pictures collected by all the participant terminals.
8. The method of claim 1, wherein transmitting the conference screen displayed by the primary participant terminal to a monitor screen for display comprises:
And sending the conference picture to the monitoring screen for display through a target cable.
9. The method of claim 1 wherein the list of participant terminals includes different levels of participant terminals, wherein the different levels of participant terminals are invited to participate in the target meeting via a cascading gateway service.
10. A display device for a conference, comprising:
the acquisition module is used for acquiring conference attribute information of the target conference;
a first determining module, configured to determine a participant terminal list participating in the target conference based on the conference attribute information;
a second determining module, configured to determine a first participant terminal with a fixed page layout identifier and a second participant terminal except the first participant terminal, where the first participant terminal is included in the participant terminal list;
the third determining module is used for determining a first page layout mode corresponding to the fixed page layout identifier and a second page layout mode corresponding to the second participant terminal based on the conference attribute information;
the first control module is used for controlling the first participant terminal to display the conference picture of the target conference according to the first page layout mode, and sending the conference picture displayed by the first participant terminal to a monitoring screen for display;
And the second control module is used for controlling the second participant terminal to display the conference picture according to the second page layout mode.
11. A conference system, comprising:
the conference control service is used for determining conference attribute information of a target conference based on a selection instruction input through a conference control page and storing the conference attribute information into a database;
the signaling service is used for acquiring conference attribute information of a target conference, determining a conference participant terminal list participating in the target conference based on the conference attribute information, determining a first conference participant terminal with a fixed page layout identifier and a second conference participant terminal except the first conference participant terminal, determining a first page layout mode corresponding to the fixed page layout identifier and a second page layout mode corresponding to the second conference participant terminal based on the conference attribute information, controlling the first conference participant terminal to display a conference picture of the target conference according to the first page layout mode, transmitting the conference picture displayed by the first conference participant terminal to a television wall for display, and controlling the second conference participant terminal to display the conference picture according to the second page layout mode;
The first participant terminal is used for displaying the conference picture of the target conference according to the first page layout mode, and sending the conference picture displayed by the first participant terminal to a monitoring screen for display;
the second participant terminal is used for displaying the conference picture according to the second page layout mode;
the monitoring screen is connected with the first participant terminal and is used for displaying conference pictures displayed by the first participant terminal.
12. The conference system of claim 11, wherein the conference system further comprises:
and the browser enters the conference control page through the browser, and is used for determining the conference attribute information based on the selection instruction and sending the conference attribute information to the conference control service.
13. The conference system of claim 11, wherein the conference system further comprises:
and the first participant terminal and the second participant terminal acquire the conference picture through the media service.
14. The conference system of claim 11, wherein the conference system further comprises:
And the cascading gateway service is used for inviting the meeting participant terminals with different levels to participate in the target meeting.
15. The conference system of claim 11, wherein the conference system further comprises:
the splicing controller is connected with the first participant terminal and is used for splicing video pictures acquired by each participant terminal participating in the target conference to obtain target conference pictures;
and the television wall is connected with the splicing controller and is used for displaying the target conference picture sent by the splicing controller.
16. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program, wherein the computer program is arranged to execute the method of any of the claims 1 to 9 when run.
17. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to run the computer program to perform the method of any of the claims 1 to 9.
CN202311008631.3A 2023-08-10 2023-08-10 Conference display method and device, conference system, storage medium and electronic device Pending CN117041470A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311008631.3A CN117041470A (en) 2023-08-10 2023-08-10 Conference display method and device, conference system, storage medium and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311008631.3A CN117041470A (en) 2023-08-10 2023-08-10 Conference display method and device, conference system, storage medium and electronic device

Publications (1)

Publication Number Publication Date
CN117041470A true CN117041470A (en) 2023-11-10

Family

ID=88631286

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311008631.3A Pending CN117041470A (en) 2023-08-10 2023-08-10 Conference display method and device, conference system, storage medium and electronic device

Country Status (1)

Country Link
CN (1) CN117041470A (en)

Similar Documents

Publication Publication Date Title
US8830294B2 (en) Method and system for video conference control, videoconferencing network equipment, and videoconferencing site
US8416279B2 (en) Method, device and computer system for processing images in a conference between a plurality of video conferencing terminals
RU2533304C2 (en) Conference call management method and related device and system
KR101696321B1 (en) Video conference control system and method for reservation video conference
US9332225B2 (en) Method, apparatus, and system for controlling conference including telepresence conferencing site
CN102177711B (en) Method, device and computer program for processing images during video conferencing
CN101291417B (en) Polling method and system for videoconference system
US9756286B1 (en) Communication event
KR20140098573A (en) Apparatus and Methd for Providing Video Conference
WO2015003532A1 (en) Multimedia conferencing establishment method, device and system
CN113542660A (en) Method, system and storage medium for realizing conference multi-picture high-definition display
TWI644565B (en) Video image processing method and system using the same
CN101345844A (en) Multimedia code stream transmission method and multi-point control cell
WO2014177082A1 (en) Video conference video processing method and terminal
CN108156413B (en) Video conference transmission method and device and MCU
CN105306872A (en) Method, apparatus and system for controlling multipoint video conference
WO2016206471A1 (en) Multimedia service processing method, system and device
US9232192B2 (en) Method and system for video conference snapshot presence
CN110708491A (en) Video conference display method, mobile terminal, and computer-readable storage medium
CN117041470A (en) Conference display method and device, conference system, storage medium and electronic device
CN110636244B (en) Video conference server, system, control method and storage medium
US11102451B2 (en) Videoconferencing server for providing multi-screen videoconferencing by using a plurality of videoconferencing terminals and method therefor
CN114449205B (en) Data processing method, terminal device, electronic device and storage medium
CN105227895B (en) Video layout and processing method in MCU (microprogrammed control Unit) stack
CN113810652A (en) Method and system for on-wall display of conference

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination