CN108574655B

CN108574655B - Conference monitoring and broadcasting method and device

Info

Publication number: CN108574655B
Application number: CN201710131800.0A
Authority: CN
Inventors: 杨春晖; 王艳辉; 胡宇惠; 孙志建
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2017-03-07
Filing date: 2017-03-07
Publication date: 2020-07-24
Anticipated expiration: 2037-03-07
Also published as: CN108574655A

Abstract

The embodiment of the invention provides a conference monitoring method and a conference monitoring device. The method comprises the following steps: providing display positions of a plurality of participants and a plurality of monitoring and broadcasting devices, wherein one monitoring and broadcasting device corresponds to the plurality of display positions; receiving a target party selected by a user from a plurality of parties and a selected target display position; acquiring a video image in real time from equipment corresponding to the target party; and sending the video image, the target party and the target display position which are acquired in real time to target monitoring equipment corresponding to the target display position, so that the target monitoring equipment can display the video image on the target display position, and correspondingly storing the target display position and the target party. Through the embodiment of the invention, a user can set the display images of the monitoring and broadcasting equipment through the control terminal, and each monitoring and broadcasting equipment can display the video images of a plurality of participants, so that the multi-path display of a conference is realized, and the requirement of the multi-path diversified and centralized display of videos is met.

Description

Conference monitoring and broadcasting method and device

Technical Field

The invention relates to the technical field of video networking, in particular to a conference monitoring and broadcasting method and a conference monitoring and broadcasting device.

Background

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

When a video conference is carried out, most of video equipment is in single-channel display at present, namely, one display only displays one single video, and along with the high-speed development of the video network, the requirement for diversified and centralized display of multiple audio and video channels is more and more extensive. The single-channel video cannot meet the requirement of the era at present.

Disclosure of Invention

In view of the above problems, embodiments of the present invention are proposed to provide a conference supervising method and a corresponding conference supervising apparatus that overcome or at least partially solve the above problems.

In order to solve the above problem, an embodiment of the present invention discloses a conference monitoring and broadcasting method, which is applied to a control end, and the method includes:

providing display positions of a plurality of participants and a plurality of monitoring and broadcasting devices, wherein one monitoring and broadcasting device corresponds to the plurality of display positions;

receiving a target party selected by a user from a plurality of parties and a selected target display position;

acquiring a video image in real time from equipment corresponding to the target party;

and sending the video image, the target party and the target display position which are acquired in real time to target monitoring equipment corresponding to the target display position, so that the target monitoring equipment can display the video image on the target display position, and correspondingly storing the target display position and the target party.

Optionally, before the providing the display locations of the plurality of participants and the plurality of monitoring devices, the method further comprises:

receiving a plurality of monitoring devices set by a user;

storing the plurality of monitoring devices set by the user into a monitoring device list;

and acquiring a display page list corresponding to each monitoring device and a participant list corresponding to each display page, which are configured in advance.

Optionally, the control end is provided with an operation interface, and the providing the display positions of the plurality of monitoring devices includes:

displaying the plurality of monitoring devices set by the user on the operation interface according to the monitoring device list;

displaying a plurality of display pages corresponding to each monitoring device on the operation interface according to the display page list;

and displaying the participants corresponding to the plurality of display positions in each display page on the operation interface according to the participant list.

Optionally, after receiving a target participant selected by the user from the multiple participants and the selected target display position, the method further includes:

storing the target display position into a display page corresponding to the target monitoring and broadcasting equipment;

and storing the target participant into a participant list corresponding to the target monitoring equipment.

Optionally, after the video image is obtained from the device corresponding to the target participant in real time, the method further includes:

and storing the acquired video image.

In order to solve the above problem, an embodiment of the present invention further discloses a conference monitoring and broadcasting method applied to a monitoring and broadcasting device, where the method includes:

receiving a video image, a target party and a target display position sent by a control end;

and displaying a video image according to the target display position, and correspondingly storing the target display position and the target party.

Optionally, the monitoring and broadcasting device presets a two-dimensional storage table, a first dimension of the two-dimensional storage table stores a plurality of display pages corresponding to the monitoring and broadcasting device, and a second dimension of the two-dimensional storage table stores a plurality of participants corresponding to each display page;

the displaying the video image according to the target display position and correspondingly storing the target display position and the target party comprises:

and storing the target display position into a corresponding display page, and storing the target party to a corresponding party.

And displaying the video image at the target display position.

In order to solve the above problem, an embodiment of the present invention further discloses a conference monitoring and broadcasting device disposed at a control end, where the device includes:

the system comprises a participant and display position providing module, a display position providing module and a display position display module, wherein the participant and display position providing module is used for providing display positions of a plurality of participants and a plurality of monitoring and broadcasting devices, and one monitoring and broadcasting device corresponds to a plurality of display positions;

the target party and target display position receiving module is used for receiving a target party selected by a user from a plurality of parties and a selected target display position;

the video image acquisition module is used for acquiring a video image in real time from the equipment corresponding to the target party;

and the video image sending module is used for sending the video image, the target party and the target display position which are acquired in real time to the target monitoring and broadcasting equipment corresponding to the target display position so that the target monitoring and broadcasting equipment can display the video image on the target display position, and correspondingly storing the target display position and the target party.

Optionally, before the participant and display position providing module, the apparatus further comprises:

the monitoring and broadcasting equipment receiving module is used for receiving a plurality of monitoring and broadcasting equipment set by a user;

the monitoring equipment storage module is used for storing the monitoring equipment set by the user into a monitoring equipment list;

and the list acquisition module is used for acquiring a display page list corresponding to each monitoring device and a participant list corresponding to each display page, which are configured in advance.

Optionally, the control end is provided with an operation interface, and the participant and display position providing module includes:

the broadcast monitoring equipment display submodule is used for displaying the plurality of broadcast monitoring equipment set by the user on the operation interface according to the broadcast monitoring equipment list;

the display page display sub-module is used for displaying a plurality of display pages corresponding to each monitoring and broadcasting device on the operation interface according to the display page list;

and the participant display submodule is used for displaying the participants corresponding to the display positions in each display page on the operation interface according to the participant list.

Optionally, after the target participant and the target display position receiving module, the apparatus further includes:

the target display position storage module is used for storing the target display position into a display page corresponding to the target monitoring and broadcasting equipment;

and the target participant storage module is used for storing the target participants into a participant list corresponding to the target monitoring equipment.

Optionally, after the video image obtaining module, the apparatus further includes:

and the video image storage module is used for storing the acquired video image.

In order to solve the above problem, an embodiment of the present invention further discloses a conference monitoring and broadcasting device disposed in a monitoring and broadcasting device, where the device includes:

the video image receiving module is used for receiving the video image, the target party and the target display position sent by the control end;

and the video image display module is used for displaying a video image according to the target display position and correspondingly storing the target display position and the target party.

the video image display module includes:

and the target display position and target participant storage submodule is used for storing the target display position into the corresponding display page and storing the target participant into the corresponding participant.

And the video image display sub-module is used for displaying the video image at the target display position.

The embodiment of the invention has the following advantages:

providing display positions of a plurality of participants and a plurality of monitoring and broadcasting devices, wherein one monitoring and broadcasting device corresponds to the plurality of display positions; receiving a target party selected by a user from a plurality of parties and a selected target display position; acquiring a video image in real time from equipment corresponding to a target party; and sending the video image, the target party and the target display position which are acquired in real time to target monitoring equipment corresponding to the target display position, so that the target monitoring equipment can display the video image on the target display position, and correspondingly storing the target display position and the target party. Through the embodiment of the invention, a user can set the display images of the monitoring and broadcasting equipment through the control terminal, and each monitoring and broadcasting equipment can display the video images of a plurality of participants, so that the multi-path display of a conference is realized, and the requirement of the multi-path diversified and centralized display of videos is met.

Drawings

FIG. 1 is a schematic networking diagram of a video network of the present invention;

FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present invention;

fig. 3 is a schematic diagram of a hardware structure of an access switch of the present invention;

fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present invention;

FIG. 5 is one of a flow chart of the steps of a conference monitoring embodiment of the present invention;

FIG. 6 is a flowchart illustrating a second step of the conference surveillance embodiment of the present invention;

FIG. 7 is a third flowchart illustrating the steps of the conference surveillance embodiment of the present invention;

fig. 8 is a block diagram of a control end of an embodiment of the conference monitoring device of the present invention;

fig. 9 is a block diagram of a monitoring end of an embodiment of the conference monitoring device of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

To better understand the embodiments of the present invention, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved over traditional Ethernet (Ethernet) to face the potentially enormous video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network circuit Switching (circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server Technology (Server Technology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 1, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.

Video networking device classification

1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: servers, switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node servers, access switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 2, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink network interface module 301 and an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the data packet coming from the CPU module 204 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues, which in this embodiment of the present invention is divided into two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate control module 208 is configured by the CPU module 204, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol conversion gateway：

As shown in fig. 4, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, and if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MACSA of the ethernet coordination gateway, and the ethernet length or frame type, and sends the packet.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the label is similar to that of a label of MP L S (Multi-Protocol L abel Switch), and assuming that there are two connections between device a and device B, there are 2 labels for a packet from device a to device B, and there are 2 labels for a packet from device B to device a. the label is divided into an incoming label and an outgoing label, and assuming that the label (incoming label) of a packet entering device a is 0x0000, the label (outgoing label) of the packet leaving device a may become 0x 0001.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

Based on the characteristics of the video network, the invention provides one of the core concepts of the embodiment of the invention, and the conference monitoring and broadcasting method is adopted to realize multi-path video display so as to meet the requirement of a user on diversified and centralized display of the audio and video paths.

Referring to fig. 5, a flowchart illustrating steps of an embodiment of a conference monitoring method according to the present invention is shown, and applied to a control end, the method specifically includes the following steps:

step 501, providing display positions of a plurality of participants and a plurality of monitoring devices, wherein one monitoring device corresponds to a plurality of display positions.

In this embodiment, when the video network is used for a video conference, the video network may include a plurality of participants and a plurality of monitoring devices, each monitoring device may have a plurality of display positions, and the plurality of monitoring devices may display video images of the plurality of participants. For example, the video network includes 20 participants and 2 monitoring devices, and the monitoring devices may be provided with 4 display positions or 6 display positions. The embodiment of the invention does not limit the number of the participants, the monitoring equipment and the display positions in detail, and can be set according to the actual situation.

And providing a plurality of participants and a plurality of display positions at the control end so that the user can select the target participants and the target display positions.

Step 502, receiving a target party selected by a user from a plurality of parties and a selected target display position.

In this embodiment, the user selects a target party from the plurality of parties, and selects a target display position from the plurality of display positions. For example, the user selects the party 1 from the 20 parties, and selects the display position of the party 1 from the number 1 monitoring and broadcasting equipment; it is also possible to select the 10 th party from the 20 th parties and select the 4 th display position from the 2 nd supervising device. The user may adopt a selection operation of dragging the target participant to the target display position, or may adopt other selection operations.

And after the user selects the target party and the target display position, the control end receives the target party and the target display position selected by the user.

Step 503, acquiring a video image in real time from the device corresponding to the target party.

In this embodiment, after receiving a target party selected by a user, the control end searches for a device corresponding to the target party, sends an instruction for acquiring a video image to the device corresponding to the target party, and after receiving the instruction for acquiring the video image, the device corresponding to the target party sends the video image to the control end. For example, after the user selects the party participating in number 1, the control terminal queries the device corresponding to the party participating in number 1, and obtains the video image from the party participating in number 1. And the video image acquired by the control end from the target party is a real-time video image.

Step 504, sending the video image, the target party and the target display position obtained in real time to a target monitoring device corresponding to the target display position, so that the target monitoring device displays the video image at the target display position, and correspondingly storing the target display position and the target party.

In this embodiment, the control end sends the acquired video image to the target monitoring device corresponding to the target display position, and simultaneously sends the target display position and the target participant to the target monitoring device. The target monitoring and broadcasting equipment displays the video image at the target display position and correspondingly stores the target display position and the target participant. For example, the target participant is the participant No. 1, the target display position is the display position No. 1 of the monitoring and broadcasting device No. 1, the target monitoring and broadcasting device corresponding to the target display position is the monitoring and broadcasting device No. 1, the control end sends the video image, the target display position and the target participant to the monitoring and broadcasting device No. 1, the monitoring and broadcasting device No. 1 receives the video image, the target display position and the target participant, displays the video image at the display position No. 1, and correspondingly stores the display position No. 1 and the participant No. 1 in the monitoring and broadcasting device.

In summary, in the embodiments of the present invention, display positions of a plurality of participants and a plurality of monitoring devices are provided, wherein one monitoring device corresponds to a plurality of display positions; receiving a target party selected by a user from a plurality of parties and a selected target display position; acquiring a video image in real time from equipment corresponding to a target party; and sending the video image, the target party and the target display position which are acquired in real time to target monitoring equipment corresponding to the target display position, so that the target monitoring equipment can display the video image on the target display position, and correspondingly storing the target display position and the target party. Through the embodiment of the invention, a user can set the display images of the monitoring and broadcasting equipment through the control terminal, each monitoring and broadcasting equipment can display the video images of a plurality of participants, and the monitoring and broadcasting equipment can display the video images of more participants, so that the multi-path display of a conference is realized, and the requirement of the multi-path diversified and centralized display of videos is met.

Referring to fig. 6, a flowchart illustrating steps of an embodiment of a conference monitoring method according to the present invention is shown, and applied to a control end, the method may specifically include the following steps:

step 601, receiving a plurality of monitoring devices set by a user.

In this embodiment, the control end receives the monitoring device set by the user before providing the plurality of monitoring devices. For example, there are 10 monitoring and broadcasting devices, and the user sets the monitoring and broadcasting device No. 1 and 2 for monitoring and broadcasting, and the control end receives the monitoring and broadcasting device No. 1 and 2 set by the user and then provides the monitoring and broadcasting device No. 1 and 2 for monitoring and broadcasting. The number of the monitoring and broadcasting equipment set by the user is not limited in detail in the embodiment of the invention, and the monitoring and broadcasting equipment can be set according to actual conditions.

Step 602, storing the plurality of monitoring devices set by the user into a monitoring device list.

In this embodiment, after receiving a plurality of monitoring devices set by a user, a control end stores the plurality of monitoring devices in a monitoring device list. For example, if the user sets the monitoring devices No. 1 and No. 2 for monitoring, the monitoring devices No. 1 and No. 2 are stored in the monitoring device list. The monitoring devices set by the user may be sorted according to the storage time or the serial number in the monitoring device list.

Step 603, obtaining a list of display pages corresponding to each monitoring device and a list of participants corresponding to each display page, which are configured in advance.

In this embodiment, the display page list corresponding to each monitoring device and the participant list corresponding to each display page may be preconfigured at the control end, and after receiving the monitoring device set by the user, the control end obtains the display page list corresponding to each monitoring device and the participant list corresponding to each display page. For example, if the user sets the number 1 and the number 2 monitoring devices for monitoring, two display pages in the display page list corresponding to the number 1 monitoring device, the number 2 and the number 3 parties corresponding to the number 1 display page, and the number 4, the number 5, the number 6 and the number 7 parties corresponding to the number 2 display page are obtained from the local database of the control end; and then acquiring a display page corresponding to the No. 2 monitoring and broadcasting equipment and a corresponding No. 8 participant in the display page. The embodiment of the invention does not limit the storage space of the display page list and the participant list in detail, and can be set according to the actual situation.

Preferably, the user can increase or decrease the display pages corresponding to the monitoring and broadcasting device, and increase or decrease the display pages. For example, the number 1 monitoring and broadcasting device corresponds to two display pages, and a user can add one display page, and then the number 1 monitoring and broadcasting device corresponds to 3 display pages. The user can also increase or decrease the number of display positions in the display page, increase the display positions in the display page, or decrease the display positions in the display page. For example, if the user adds 2 display positions to the display page 1 of the monitoring and broadcasting device 1, the display page 1 of the monitoring and broadcasting device 1 becomes 4 display positions; the user reduces 2 display positions in the No. 2 display page of the No. 1 monitoring and broadcasting device, and then the No. 2 display page of the No. 1 monitoring and broadcasting device becomes 4 display positions.

Step 604, displaying the plurality of monitoring devices set by the user on the operation interface according to the monitoring device list.

In this embodiment, the multiple monitoring devices set by the user are stored in the monitoring device list, the control end may preset an operation interface, and the multiple monitoring devices set by the user are displayed on the operation interface according to the monitoring device list. For example, the list of the monitoring devices may be displayed as a pull-down menu, and one monitoring device may be selected from the pull-down menu; the list of the monitoring devices can also be presented as a plurality of monitoring device images with reference to a chat tool. In the embodiment of the invention, how to display the monitoring and broadcasting equipment is not limited in detail, and the monitoring and broadcasting equipment can be set according to actual conditions.

Step 605, displaying a plurality of display pages corresponding to each monitoring device on the operation interface according to the display page list.

In this embodiment, the control end obtains the display page list corresponding to each monitoring device, and displays a plurality of display pages corresponding to each monitoring device on the operation interface according to the display page list. For example, the display page list corresponding to the number 1 monitoring and broadcasting device includes two display pages, and after the operation interface displays the number 1 monitoring and broadcasting device, the two display pages of the number 1 monitoring and broadcasting device can be displayed at the bottom of the operation interface. The embodiment of the invention does not limit in detail how the display page is displayed, and can be set according to actual conditions.

And 606, displaying the participants corresponding to the display positions in each display page on the operation interface according to the participant list.

In this embodiment, the control end obtains the participant list of each display page, and displays the participants corresponding to the plurality of display positions in each display page on the operation interface according to the participant list. For example, the number 1 monitoring and broadcasting device is displayed on the operation interface, two display pages are displayed at the bottom of the operation interface, when the number 1 display page is selected, 2 display positions can be displayed in the center area of the operation interface, and the 2 display positions respectively correspond to the number 2 parties and the number 3 parties; when 2 show pages were chosen, can 4 display position of operation interface central zone show, 4 display position correspond respectively No. 4, No. 5, No. 6, No. 7 party of participating in. The embodiment of the invention does not limit in detail how to display the plurality of display positions in each display page, and can be set according to actual conditions.

Step 607, receiving the target participant selected by the user from the multiple participants and the selected target display position.

In this embodiment, the user selects the target party and the target display position in the operation interface, and the control terminal receives the target party and the target display position selected by the user.

Step 608, storing the target display position in a display page corresponding to the target monitoring device.

In this embodiment, after the user selects the target display position, the control end stores the target display position in the display page corresponding to the target monitoring device. For example, the target monitoring device is the monitoring device No. 1, the target display position is the display position No. 1 of the display page No. 1 in the monitoring device No. 1, and the control end stores the target display position in the display page No. 1 of the monitoring device No. 1.

Step 609, storing the target participant into a participant list corresponding to the target monitoring device.

In this embodiment, after the user selects the target participant, the control end stores the target participant in the participant list corresponding to the target monitoring device. For example, if the target participant is the participant No. 1, and the target monitoring device is the monitoring device No. 1, the control end stores the participant No. 1 in the participant list corresponding to the monitoring device No. 1.

After the user selects the target display position and the target party, the control end performs storage operation, so that the user does not need to select the party corresponding to each display position every time, and can call the plurality of display positions and the corresponding party stored by the control end.

And step 610, acquiring a video image in real time from the equipment corresponding to the target party.

In this embodiment, the same as step 503 is not described herein.

Step 611, storing the obtained video image.

In this embodiment, after the video image is acquired, the acquired video image is stored in the local database. Video images during the conference are retained for subsequent inquiry viewing.

Step 612, sending the video image, the target party and the target display position obtained in real time to a target monitoring device corresponding to the target display position, so that the target monitoring device displays the video image at the target display position, and correspondingly stores the target display position and the target party.

In this embodiment, the same as step 504 is not described herein.

In summary, in the embodiment of the present invention, the control end receives a plurality of monitoring devices set by the user and stores the monitoring devices in the monitoring device list; the method comprises the steps of obtaining a display page list corresponding to each monitoring device and a participant list corresponding to each display page which are configured in advance, and displaying the monitoring devices, the display pages corresponding to the monitoring devices and the participants corresponding to the display pages on an operation interface; receiving a target party selected by a user and a target display position, and storing the target party and the target display position; acquiring a video image in real time from equipment corresponding to a target party and storing the video image; and sending the video image, the target party and the target display position to the target monitoring and broadcasting equipment so that the target monitoring and broadcasting equipment can display the video image at the target display position, and correspondingly storing the target display position and the target party. Through the embodiment of the invention, a user can set the display images of the monitoring and broadcasting equipment through the control terminal, each monitoring and broadcasting equipment can display the video images of a plurality of participants, and the monitoring and broadcasting equipment can display the video images of more participants, so that the multi-path display of a conference is realized, and the requirement of the multi-path diversified and centralized display of videos is met.

Referring to fig. 7, a flowchart illustrating steps of an embodiment of a conference monitoring method according to the present invention is shown, and the method is applied to a monitoring device, and specifically may include the following steps:

and step 701, receiving a video image, a target party and a target display position sent by a control end.

In this embodiment, the control terminal sends the video image obtained in real time, the target party and the target display position to the monitoring device, and the monitoring device receives the video image, the target party and the target display position sent by the control terminal.

And 702, displaying a video image according to the target display position, and correspondingly storing the target display position and the target party.

In this embodiment, after receiving the video image, the target party and the target display position, the monitoring device displays the video image at the target display position. Preferably, the displaying the video image according to the target display position, and the correspondingly storing the target display position and the target party may specifically include the following steps:

step one, storing the target display position into a corresponding display page, and storing the target party to a corresponding party.

In this embodiment, the monitoring and broadcasting device presets a two-dimensional storage table, a first dimension of the two-dimensional storage table stores a plurality of display pages corresponding to the monitoring and broadcasting device, and a second dimension of the two-dimensional storage table stores a plurality of participants corresponding to each display page. And after receiving the target display position, the monitoring equipment stores the target display position into the corresponding display page. For example, if the target display position is display position No. 1 of display page No. 1, display position No. 1 is stored as the target display position in display page No. 1. And after receiving the target participants, the monitoring equipment stores the target participants into the corresponding participants. For example, if the target party is party No. 1, the party at the display position No. 1 on the display page No. 1 is stored as party No. 1.

And step two, displaying the video image at the target display position.

In this embodiment, after receiving and storing the target display position, the video image of the target participant is displayed at the target display position. For example, the target display position is the display position No. 1 of the display page No. 1, the target party is the party No. 1, and the video image of the party No. 1 is displayed at the display position No. 1 of the display page No. 1.

In summary, in the embodiment of the present invention, the monitoring device receives the video image, the target party and the target display position sent by the control end. And displaying a video image according to the target display position, and correspondingly storing the target display position and the target party. According to the embodiment of the invention, the display images of the monitoring and broadcasting equipment are set by the control terminal, each monitoring and broadcasting equipment can display the video images of a plurality of participants, and a plurality of monitoring and broadcasting equipment can display the video images of more participants, so that the multi-path display of a conference is realized, and the requirement of the multi-path diversified and centralized display of videos is met.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 8, a block diagram of a control end of an embodiment of a conference monitoring apparatus according to the present invention is shown, where the apparatus includes:

a participant and display position providing module 801, configured to provide display positions of a plurality of participants and a plurality of monitoring devices, where one monitoring device corresponds to a plurality of display positions;

a target party and target display position receiving module 802, configured to receive a target party selected by a user from a plurality of parties and a selected target display position;

a video image obtaining module 803, configured to obtain a video image in real time from a device corresponding to the target party;

the video image sending module 804 is configured to send the video image, the target party and the target display position obtained in real time to the target monitoring and broadcasting device corresponding to the target display position, so that the target monitoring and broadcasting device displays the video image at the target display position, and correspondingly stores the target display position and the target party.

In this embodiment of the present invention, optionally, before the module 801 for providing the participant and the display position, the apparatus further includes:

In this embodiment of the present invention, optionally, the control end is provided with an operation interface, and the participant and display position providing module 801 includes:

In this embodiment of the present invention, optionally, after the target participant and target display position receiving module 802, the apparatus further includes:

In this embodiment of the present invention, optionally, after the video image obtaining module 703, the apparatus further includes:

In summary, in the embodiments of the present invention, a control end receives a plurality of monitoring devices set by a user and stores the monitoring devices in a monitoring device list, obtains a display page list corresponding to each monitoring device and a participant list corresponding to each display page, which are configured in advance, displays the monitoring devices, the display pages corresponding to each monitoring device, and the participants corresponding to each display page on an operation interface, receives a target participant and a target display position selected by the user and stores the target participant and the target display position, obtains a video image in real time from a device corresponding to the target participant and stores the video image, and sends the video image, the target participant and the target display position to the target monitoring device, so that the target monitoring device displays the video image at the target display position and correspondingly stores the target display position and the target participant. Through the embodiment of the invention, a user can set the display images of the monitoring and broadcasting equipment through the control terminal, each monitoring and broadcasting equipment can display the video images of a plurality of participants, and the monitoring and broadcasting equipment can display the video images of more participants, so that the multi-path display of a conference is realized, and the requirement of the multi-path diversified and centralized display of videos is met.

Referring to fig. 9, a block diagram of a monitoring device of an embodiment of a conference monitoring apparatus according to the present invention is shown, where the apparatus includes:

the video image receiving module 901 is used for receiving a video image, a target party and a target display position sent by the control end;

and the video image display module 902 is configured to display a video image according to the target display position, and correspondingly store the target display position and the target party.

In the embodiment of the present invention, optionally, the monitoring and broadcasting device presets a two-dimensional storage table, a first dimension of the two-dimensional storage table stores a plurality of display pages corresponding to the monitoring and broadcasting device, and a second dimension of the two-dimensional storage table stores a plurality of participants corresponding to each display page;

the video image display module 902 includes:

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The conference monitoring and broadcasting method and the conference monitoring and broadcasting device provided by the invention are introduced in detail, specific examples are applied in the text to explain the principle and the implementation mode of the invention, and the description of the examples is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A conference monitoring and broadcasting method is applied to a control terminal, and is characterized in that the method is applied to a video conference in a video network, the video network comprises a plurality of participants and a plurality of monitoring and broadcasting devices, each monitoring and broadcasting device is provided with a plurality of display positions, and the plurality of monitoring and broadcasting devices display video images of the participants, the method comprises the following steps:

receiving a plurality of monitoring devices set by a user;

acquiring a display page list corresponding to each monitoring device and a participant list corresponding to each display page which are configured in advance;

receiving increasing or decreasing operations of a user on a display page corresponding to the monitoring and broadcasting equipment, and acquiring a modified display page list corresponding to each monitoring and broadcasting equipment;

sending the video image, the target party and the target display position which are obtained in real time to target monitoring equipment corresponding to the target display position, so that the target monitoring equipment can display the video image on the target display position, and correspondingly storing the target display position and the target party;

the control end is provided with operation interface, the display position that provides a plurality of supervision broadcast equipment includes:

displaying a plurality of display pages corresponding to each monitoring and broadcasting device on the operation interface according to the modified display page list;

displaying the participants corresponding to the plurality of display positions in each display page on the operation interface according to the participant list;

the method for acquiring the video image in real time from the equipment corresponding to the target party comprises the following steps:

and searching equipment corresponding to the target party, sending a video image acquisition instruction to the equipment corresponding to the target party, and acquiring the video image sent by the equipment corresponding to the target party according to the instruction.

2. The method of claim 1, wherein after receiving a target participant selected by the user from the plurality of participants and the selected target display location, the method further comprises:

3. The method of claim 1, wherein after the obtaining video images from the devices corresponding to the target participants in real-time, the method further comprises:

and storing the acquired video image.

4. A conference monitoring and broadcasting method is applied to monitoring and broadcasting equipment and is characterized in that the method is applied to a video conference in a video network, the video network comprises a plurality of participants and a plurality of monitoring and broadcasting equipment, each monitoring and broadcasting equipment is provided with a plurality of display positions, and the plurality of monitoring and broadcasting equipment display video images of the participants, the method comprises the following steps:

receiving a video image, a target party and a target display position sent by a control end, wherein the video image is a video image sent by equipment corresponding to the target party searched by the control end, and after sending an instruction for obtaining the video image to the equipment corresponding to the target party, obtaining the video image sent by the equipment corresponding to the target party according to the instruction;

5. The method according to claim 4, wherein the monitoring device presets a two-dimensional storage table, a first dimension of the two-dimensional storage table stores a plurality of display pages corresponding to the monitoring device, and a second dimension of the two-dimensional storage table stores a plurality of participants corresponding to each display page;

storing the target display position into a corresponding display page, and storing the target party to a corresponding party;

and displaying the video image at the target display position.

6. A conference monitoring and broadcasting device is deployed at a control end and is applied to a video conference in a video network, wherein the video network comprises a plurality of participants and a plurality of monitoring and broadcasting devices, each monitoring and broadcasting device is provided with a plurality of display positions, and the plurality of monitoring and broadcasting devices display video images of the participants, the device comprises:

the list acquisition module is used for acquiring a display page list corresponding to each monitoring device and a participant list corresponding to each display page which are configured in advance;

the display page deleting module is used for receiving the increasing or decreasing operation of the user on the display page corresponding to the monitoring equipment and acquiring the modified display page list corresponding to each monitoring equipment;

the video image sending module is used for sending the video image, the target party and the target display position which are acquired in real time to target monitoring and broadcasting equipment corresponding to the target display position, so that the target monitoring and broadcasting equipment can display the video image on the target display position, and correspondingly stores the target display position and the target party;

the control end is provided with operation interface, party and display position provide the module and include:

the display page display sub-module is used for displaying a plurality of display pages corresponding to each monitoring and broadcasting device on the operation interface according to the modified display page list;

the participant display submodule is used for displaying the participants corresponding to the display positions in each display page on the operation interface according to the participant list;

the video image acquisition module is further configured to search for the device corresponding to the target participant, send an instruction for acquiring a video image to the device corresponding to the target participant, and acquire the video image sent by the device corresponding to the target participant according to the instruction.

7. The apparatus of claim 6, wherein after the target party and target display location receiving module, the apparatus further comprises:

8. The apparatus of claim 6, wherein after the video image acquisition module, the apparatus further comprises:

9. A conference monitoring and broadcasting device deployed in monitoring and broadcasting equipment, which is applied to a video conference in a video network, wherein the video network comprises a plurality of participants and a plurality of monitoring and broadcasting equipment, each monitoring and broadcasting equipment is provided with a plurality of display positions, and the plurality of monitoring and broadcasting equipment display video images of the plurality of participants, the device comprises:

the video image receiving module is used for receiving a video image, a target party and a target display position sent by a control end, wherein the video image is a device corresponding to the target party searched by the control end, and after an instruction for obtaining the video image is sent to the device corresponding to the target party, the video image sent by the device corresponding to the target party according to the instruction is obtained;

10. The apparatus according to claim 9, wherein the monitoring device presets a two-dimensional storage table, a first dimension of the two-dimensional storage table stores a plurality of display pages corresponding to the monitoring device, and a second dimension of the two-dimensional storage table stores a plurality of participants corresponding to each display page;

the video image display module includes:

the target display position and target participant storage submodule is used for storing the target display position into a corresponding display page and storing the target participant into a corresponding participant;