CN112714274A

CN112714274A - Video conference method and video conference resource management method

Info

Publication number: CN112714274A
Application number: CN202011595957.7A
Authority: CN
Inventors: 高越寒; 鲍捷; 韦国华; 胡小鹏
Original assignee: Suzhou Keda Technology Co Ltd
Current assignee: Suzhou Keda Technology Co Ltd
Priority date: 2020-12-29
Filing date: 2020-12-29
Publication date: 2021-04-27
Anticipated expiration: 2040-12-29
Also published as: CN112714274B

Abstract

The invention provides a video conference method and a video conference resource management method, and the video conference method applied to a terminal comprises the following steps: the step of registering the terminal to a multipoint control unit comprises: allocating terminal registration resources and terminal transmission resources at a terminal, wherein the terminal registration resources and the terminal transmission resources are associated with each other; sending registration information to a multipoint control unit through the terminal transmission resource, wherein the registration information is generated according to the terminal registration resource; receiving registration reply information sent by the multipoint control unit through the terminal transmission resource; searching the terminal registration resource according to the registration reply information; and the terminal registration resource stores the registration reply information. The method provided by the invention realizes the connection stability between the terminal and the multipoint control unit for the user perception.

Description

Video conference method and video conference resource management method

Technical Field

The invention relates to the field of video conferences, in particular to a video conference method and a video conference resource management method.

Background

At present, with the development of the internet, the video conference is more and more commonly used in work and study. Therefore, in the use of the video conference, higher requirements are also put forward on the aspects of stability, reliability, safety and the like of the video conference.

In the course of the actual use of video conferencing, various problems are encountered. Among all the problems, the more prominent and serious problem is that the terminal in the conference is absent from the conference, and due to the poor network condition, the disconnection condition occurs, so that the experience effect of the user is poor, and the normal operation of the video conference is influenced.

Therefore, how to implement a video conference and manage video conference resources so as to improve the stability of video conference connection to user perception is a problem that needs to be solved urgently by technical personnel in the field.

Disclosure of Invention

In order to overcome the defects in the prior art, the invention provides a video conference method and a video conference resource management method, and the stability of the video conference connection for the perception of users is improved through the resource allocation and the resource management of the video conference.

According to an aspect of the present invention, there is provided a video conference method applied to a terminal, including: the step of registering the terminal to a multipoint control unit comprises: allocating terminal registration resources and terminal transmission resources at a terminal, wherein the terminal registration resources and the terminal transmission resources are associated with each other; sending registration information to a multipoint control unit through the terminal transmission resource, wherein the registration information is generated according to the terminal registration resource; receiving registration reply information sent by the multipoint control unit through the terminal transmission resource; searching the terminal registration resource according to the registration reply information; and the terminal registration resource stores the registration reply information.

In some embodiments of the present invention, the associating a terminal transmission handle with the terminal transmission resource, where the terminal transmission handle is used to search the terminal transmission resource, and the allocating the terminal registration resource and the terminal transmission resource at the terminal further includes: calculating a multipoint control hash value according to the address information of the multipoint control unit; and associating the multipoint control hash value with the terminal transmission handle and storing the multipoint control hash value in a terminal hash table.

In some embodiments of the present invention, the step of registering the terminal with a multipoint control unit further comprises: the step of the terminal and the multipoint control unit executing the call comprises the following steps: receiving call information sent by the multipoint control unit; calculating the multipoint control hash value according to the address information of the multipoint control unit; searching the terminal transmission handle in the terminal hash table according to the multipoint control hash value; searching the terminal transmission resource according to the terminal transmission handle; searching a terminal calling resource according to the calling information, wherein the terminal calling resource is associated with the terminal transmission resource; processing the call information through the terminal call resource to generate call reply information; searching the terminal transmission resource according to the terminal call resource; and sending call reply information to the multipoint control unit according to the terminal transmission resource.

In some embodiments of the present invention, after the terminal allocates the terminal registration resource and the terminal transmission resource, in response to the terminal being disconnected from the multipoint control unit, the method further includes: clearing the terminal transmission resources and clearing the multipoint control hash value in the terminal hash table; reallocating terminal transmission resources at the terminal and performing one or more of the following steps; sending registration information to the multipoint control unit through the terminal transmission resource in response to the terminal sending registration information to the multipoint control unit; and responding to the call reply information sent by the terminal to the multipoint control unit, and sending the call reply information to the multipoint control unit through the terminal call resource.

According to another aspect of the present invention, there is also provided a video conference method applied to a multipoint control unit, including: the step of registering the terminal to the multipoint control unit comprises the following steps: receiving registration information sent by the terminal; distributing multipoint control registration resources and multipoint control transmission resources for the terminal sending the registration information in the multipoint control unit, wherein the multipoint control registration resources and the multipoint control transmission resources are associated with each other; processing the registration information through the multi-point control registration resource and generating registration reply information; searching the multi-point control transmission resource through the multi-point control registration resource; and sending the registration reply information to the terminal through the multipoint control transmission resource.

In some embodiments of the present invention, the allocating the coordinated multiple point control registration resource and the coordinated multiple point control transmission resource at the coordinated multiple point control unit further comprises: calculating a terminal hash value according to the address information of the terminal; and associating the terminal hash value with the multipoint control transmission handle and storing the terminal hash value in a multipoint control hash table.

In some embodiments of the present invention, the step of registering the terminal with the multipoint control unit further comprises: the step of the terminal and the multipoint control unit executing the call comprises the following steps: calculating the hash value of the terminal according to the address information of the terminal to be called; searching the multipoint control transmission handle in the multipoint control hash table according to the terminal hash value; searching the multi-point control transmission resource according to the multi-point control transmission handle; applying for a multi-point control call resource at the multi-point control unit, the multi-point control call resource being associated with the multi-point control transmission resource; generating a call message through the multi-point control call resource; sending the call information to the terminal through the multi-point control transmission resource; receiving a call reply message sent by a terminal through the multi-point control transmission resource; searching the multipoint control call resource according to the call reply information; the multi-point control call resource stores the call reply information.

In some embodiments of the present invention, after the multipoint control unit allocates the multipoint control registration resource and the multipoint control transmission resource, in response to the terminal being disconnected from the multipoint control unit, the method further includes: clearing the multipoint control transmission resource and clearing a terminal hash value in the multipoint control hash table; reallocating multipoint control transmission resources at the multipoint control unit and performing one or more of the following steps; responding to the multipoint control unit to send registration reply information to the terminal, and sending the registration reply information to the terminal through the multipoint control transmission resource; and responding to the multipoint control unit to send the call information to the terminal, and sending the call information to the terminal through the multipoint control transmission resource.

According to another aspect of the present invention, there is also provided a video conference resource management method, including: the method comprises the steps of managing multipoint control transmission resources by a multipoint control unit, and managing multipoint control registration resources and/or multipoint control call resources, wherein the multipoint control registration resources are used for storing information registered by a multipoint control unit side, the multipoint control transmission resources are used for information transmission between a terminal and the multipoint control unit, the multipoint control call resources are used for storing information called by the multipoint control unit side, the multipoint control registration resources are associated with the multipoint control transmission resources, and the multipoint control call resources are associated with the multipoint control transmission resources.

According to still another aspect of the present invention, there is also provided an electronic apparatus, including: a processor; a storage medium having stored thereon a computer program which, when executed by the processor, performs one or more of the following methods: a video conference method executed at a terminal side; a video conference resource management method executed at a terminal side; a video conference method performed at a multipoint control unit side; a video conference resource management method is performed at a multipoint control unit side.

According to yet another aspect of the present invention, there is also provided a storage medium having stored thereon a computer program which, when executed by a processor, performs one or more of the following methods: a video conference method executed at a terminal side; a video conference resource management method executed at a terminal side; a video conference method performed at a multipoint control unit side; a video conference resource management method is performed at a multipoint control unit side.

Therefore, compared with the prior art, the scheme provided by the invention has the following advantages:

the method comprises the steps of distributing terminal registration resources and terminal transmission resources which are mutually associated at a terminal, so that the terminal side multi-point control unit registration can be realized based on the terminal registration resources and the terminal transmission resources, the terminal registration resources and the terminal transmission resources are mutually associated, the management and the registration steps are convenient to realize, and meanwhile, the connection stability of the terminal side and the multi-point control unit for user perception in the registration stage can be ensured through the distributed terminal registration resources and the terminal transmission resources;

the multi-point control registration resource and the multi-point control transmission resource which are mutually associated are distributed in the multi-point control unit, so that the step of registering the terminal side to the multi-point control unit can be realized based on the multi-point control registration resource and the multi-point control transmission resource;

the terminal transmission resources are managed at the terminal, and the terminal registration resources and/or the terminal calling resources are associated with the terminal transmission resources, so that the management of the video conference resources at the video conference registration stage and/or the calling stage at the terminal side is facilitated, and the connection stability of the terminal and the multi-point control unit for user perception is realized;

the multipoint control transmission resources are managed in the multipoint control unit, and the multipoint control registration resources and/or the multipoint control call resources are/is associated with the multipoint control transmission resources, so that the management of the video conference resources in a video conference registration stage and/or a call stage at the side of the multipoint control unit is facilitated, and the connection stability of the terminal and the multipoint control unit for user perception is realized.

Drawings

The above and other features and advantages of the present invention will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings.

Fig. 1 shows a schematic diagram of a video conference resource at a terminal side according to an embodiment of the invention.

Fig. 2 shows a schematic diagram of a video conferencing resource at the multipoint control unit side according to an embodiment of the invention.

Fig. 3 shows a flow chart of the terminal registering at the terminal side with a multipoint control unit according to an embodiment of the invention.

Fig. 4 shows a flow chart for allocating terminal transmission resources on the terminal side according to an embodiment of the invention.

Fig. 5 shows a flow chart of a call phase at a terminal side according to an embodiment of the invention.

Fig. 6 shows a flowchart of processing steps after a terminal-side disconnection according to an embodiment of the present invention.

Fig. 7 shows a flowchart of the terminal registering to a multipoint control unit at the multipoint control unit side according to an embodiment of the present invention.

Fig. 8 shows a flow chart for allocating terminal transmission resources at the multipoint control unit side according to an embodiment of the invention.

Fig. 9 shows a flow chart of a call phase at the multipoint control unit side according to an embodiment of the invention.

FIG. 10 shows a flowchart of processing steps after a multipoint control unit side disconnect in accordance with an embodiment of the present invention.

FIG. 11 schematically illustrates a computer-readable storage medium in an exemplary embodiment of the disclosure.

Fig. 12 schematically illustrates an electronic device in an exemplary embodiment of the disclosure.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

Furthermore, the drawings are merely schematic illustrations of the invention and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.

The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the steps. For example, some steps may be decomposed, and some steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.

In order to overcome the defects in the prior art, the invention provides a video conference method and a video conference resource management method, which improve the stability of user perception of video conference connection through the resource allocation and resource management of a video conference.

In various embodiments of the present invention, the scheme provided by the present invention may be applied to a multipoint video conference, an end-to-end video conference, and a multipoint control unit cascade video conference. Specifically, although the interaction between the terminal and the multipoint control unit is described in the embodiments of the present invention, the terminal in the embodiments of the present invention may also be used as the multipoint control unit, and the multipoint control unit may also be used as the terminal, and the present invention is not limited thereto.

Referring first to fig. 1, fig. 1 shows a schematic diagram of a video conference resource at a terminal side according to an embodiment of the present invention. The terminal-side resources 10 managed on the terminal side may includeTerminal transmission resource Mt_TpFurther, the method can also comprise the step of registering the resource Mt by the terminal_RegAnd/or terminal call resources Mt_Call. Therefore, the invention can provide a video conference resource management method at the terminal side, which comprises the step that the terminal manages the transmission resource Mt of the terminal_TpAnd terminal registration resource Mt_RegAnd/or terminal call resources Mt_Call. Wherein the terminal registers the resource Mt_RegFor storing information on registration at the terminal side, which transmits resources Mt_TpFor information transmission between the terminal and a multipoint control unit, the terminal calls a resource Mt_CallFor storing information about calls on the terminal side, which registers resources Mt_RegTransmitting resource Mt with the terminal_TpAssociated, said terminal call resource Mt_CallTransmitting resource Mt with the terminal_TpAnd (4) associating.

In the method for managing the video conference resources at the terminal side, provided by the invention, the terminal transmission resources are managed at the terminal, and the terminal registration resources and/or the terminal calling resources are/is associated with the terminal transmission resources, so that the management of the video conference resources at the video conference registration stage and/or the calling stage at the terminal side is facilitated, and the connection stability perceived by the terminal and the multipoint control unit for the user is realized.

The terminal transmission resource Mt will be described in detail below with reference to fig. 1_TpTerminal registration resource Mt_RegAnd terminal call resources Mt_Call。

Specifically, when the terminal registers with the MCU (multipoint control unit), the terminal may locally apply for a terminal registration resource Mt_RegAnd one terminal transmission resource Mt_Tp. Terminal registration resource Mt_RegFor storing and processing registration information. Terminal transmission resource Mt_TpThe terminal is used for receiving and sending data information. Terminal registration resource Mt_RegAnd terminal transmission resource Mt_TpThe resources respectively allocated by the terminal for the registration and the transmission are used.

Terminal noteBook resources Mt_RegIn addition to the registration information to be stored, a terminal registration handle h is included_regAnd terminal transmission resource Mt_Tp，Mt_Reg＝{h_reg，Mt_Tp}. Terminal registration handle h_regFor finding corresponding terminal registration resources Mt_Reg. Terminal registration resource Mt_RegIncluding terminal transmission resources Mt_TpMay not include terminal transmission resource Mt_TpBut only the terminal registration resource Mt_RegAnd terminal transmission resource Mt_TpThe association relationship between the two is used for facilitating the search. Terminal transmission resource Mt_TpIn addition to information to be stored for Transmission (such as creating TCP (Transmission Control Protocol) sockets, binding, listening to ports, sending and receiving data, etc., which is not limited by the present invention), a terminal Transmission handle h is also included_TpAnd terminal registration resource Mt_Reg，Mt_Tp＝{h_Tp，Mt_Reg}. Terminal transmission handle h_TpFor finding corresponding terminal transmission resources Mt_Tp. Terminal transmission resource Mt_TpIncluded terminal registration resources Mt_RegMay not include terminal registration resource Mt_RegBut only the terminal transmission resource Mt_TpAnd terminal registration resource Mt_RegThe association relationship between the two is used for facilitating the search.

In this embodiment, the terminal registers the resource Mt_RegAnd terminal transmission resource Mt_TpAnd storing the data of the other party mutually so as to realize resource association.

In this embodiment, the terminal may be based on the multipoint control unit's address information Mcu_addr(the address information of the multipoint control unit may include, for example, an ip address and a port number of the multipoint control unit, but the present invention is not limited thereto) performing a hash calculation to generate a multipoint control hash value Mt_key. Then adding the generated multipoint control hash value into the terminal hash table Mt_tableIn (1). Terminal hash table Mt_tableThe hash value Mt can be controlled by multiple points_keyAnd a terminal hash index value Mt_indexIs composed ofPoint control hash value Mt_keyAnd a terminal hash index value Mt_indexAnd correspond to each other. Wherein, the terminal hash index value Mt_indexI.e. the terminal transmission resource Mt_TpIndex value of (Mt)_TpIndex(i.e., terminal transmission handle h)_Tp). Transmission of resources Mt by terminals_TpIndex value of (Mt)_TpIndexCan uniquely correspond to one terminal transmission resource Mt_Tp. Wherein, the terminal hash table Mt_tableHas a structure Mt_table＝{Mt_key，Mt_TpIndex}，Mt_TpIndex＝h_Tp。

Specifically, the terminal sends registration and call information to be unified by the allocated terminal transmission resource Mt_TpAnd carrying out data receiving and sending. Therefore, the terminal can also apply for the terminal call resource Mt in the call phase_call. Further, when the terminal receives the call information of the mcu, the address information Mcu of the mcu can be calculated_addrMulti-point control hash value Mt_keyAnd controlling the hash value Mt according to the multiple points_keyAt terminal hash table Mt_tableFinding the multi-point control hash value Mt_keyIndex value of (Mt)_TpIndexThus, can be based on Mt_TpIndexFinding terminal transmission resource Mt_TpAnd allocating terminal call resources Mt for the terminal call_call. Terminal call resource Mt_callIs allocated for the call flow after the terminal. After the terminal has processed the registration and call flow, the terminal transmits the resource Mt_TpWill save the terminal registration resource Mt_RegAnd terminal call resource Mt_callSo that the resource Mt can be registered by the terminal_RegOr terminal call resource Mt_callFind out terminal transmission resource Mt_Tp. Otherwise, the resource Mt is transmitted through the terminal_TpThe corresponding terminal registration resource Mt can also be found_RegAnd terminal call resource Mt_callNamely: mt_Tp＝{h_Tp，Mt_Reg，Mt_call}。

In particular, terminal call resources Mt_callMay contain a terminal call handle h_callAnd associated terminal transmission resources Mt_TpI.e. Mt_call＝{h_call，Mt_Tp}. Terminal call handle h_callFor finding corresponding terminal call resources Mt_call. Terminal call handle h_callFor example, may be generated by a call ID. The calling information sent by the multi-point control unit contains a calling ID for uniquely identifying the calling, so that the calling ID can be used for searching a corresponding terminal calling handle h_callThereby finding out the corresponding terminal call resource Mt_call。

The above description is only illustrative of the video conference resources and the management thereof on the terminal side, and the present invention is not limited thereto.

Referring now to fig. 2, fig. 2 illustrates a schematic diagram of a video conferencing resource at the multipoint control unit side in accordance with an embodiment of the present invention.

The terminal-side resources 20 managed at the multipoint control element side may include multipoint control transmission resources Mcu_TpFurther, a multi-point control registration resource Mcu may be included_RegAnd/or a multi-point control call resource Mcu_Call. Thus, the present invention can provide a method for managing resources of a video conference at a side of a multipoint control unit, comprising managing Mcu multipoint control transmission resources by the multipoint control unit_TpAnd a multipoint control registration resource Mcu_RegAnd/or a multi-point control call resource Mcu_Call. Wherein the multipoint control registration resource Mcu_RegFor storing information on registration at the multipoint control unit side, said multipoint control transmission resource Mcu_TpFor information transfer between the terminal and a multipoint control unit, the multipoint control call resource Mcu_CallFor storing information on the multicast control unit side about calls, said multicast control registration resource Mcu_RegWith the multicast transmission resource Mcu_TpAssociated, said multipoint control call resource Mt_CallWith the multicast transmission resource Mcu_TpAnd (4) associating.

In the method for managing the video conference resources at the multipoint control unit side, provided by the invention, the multipoint control transmission resources and the multipoint control registration resources and/or the multipoint control call resources are managed at the multipoint control unit, the multipoint control registration resources are associated with the multipoint control transmission resources, and the multipoint control call resources are associated with the multipoint control transmission resources, so that the management of the video conference resources at the video conference registration stage and/or the call stage at the multipoint control unit side is facilitated, and the connection stability perceived by a terminal and the multipoint control unit for a user is realized at the same time.

The following will specifically describe the multicast control transmission resource Mcu in conjunction with fig. 2_TpMultipoint control registration resource Mcu_RegAnd a multi-point control call resource Mcu_Call。

Specifically, when the multipoint control unit receives information (for example, registration information or call information) transmitted by the terminal, each piece of the specific information may be parsed. Thus, each terminal may be allocated a single coordinated multi-point transmission resource Mcu_Tp. For example, when a terminal registers with a multipoint control unit for the first time to send registration information to the multipoint control unit, the multipoint control unit may allocate a multipoint control transmission resource Mcu for the terminal_Tp. The multicast transmission resource Mcu_TpFor later transceiving information between the multipoint control unit and the terminal. Meanwhile, the MCU will allocate a MCU registration resource Mcu for the terminal_Reg. Multipoint control transmission resource Mcu allocated by multipoint control unit for terminal_TpAnd a multipoint control registration resource Mcu_RegAre resources allocated separately for this registration and transmission.

Multi-point control registration resource Mcu_RegIn addition to the registration information to be stored (e.g., the registration IDMt in the registration information may be saved_RegID。Mt_RegIDGlobally unique throughout the video conference, i.e. Mt per terminal_RegIDDifferent), a multi-point control registration handle h is also included_regAnd a multicast control transmission resource Mcu_Tp，Mcu_Reg＝{h_reg，Mcu_Tp}. Multi-point control registration handle h_regFor finding corresponding multipoint control registration resources Mcu_Reg. Multi-point control registration resource Mcu_RegIncluding a multicast control transmission resource Mcu_TpTo indicate that the multipoint control registers the resource Mcu_RegAnd a multicast control transmission resource Mcu_TpThe association relationship between them. Multi-point control transmission resource Mcu_TpIn addition to information to be stored for transmission (such as creating TCP sockets, binding, listening to ports, sending and receiving data, etc., to which the present invention is not limited), a multicast control transport handle h is included_TpAnd a multipoint control registration resource Mcu_Reg，Mcu_Tp＝{h_Tp，Mcu_Reg}. Multi-point control transmission handle h_TpFor finding corresponding multicast transmission resources Mcu_Tp. Multi-point control transmission resource Mcu_TpIncluded multipoint control registration resource Mcu_RegTo indicate the multipoint control transmission resource Mt_TpAnd a multipoint control registration resource Mcu_RegThe association relationship between them. Wherein, the multi-point control registration handle h at the multi-point control unit side_regMay be consistent with the terminal registration handle at the terminal side. Multi-point control transmission handle h of multi-point control unit side_TpMay be consistent with the terminal transmission handle at the terminal side. In some variations, the multi-point control registration handle h on the multi-point control unit side_regThe terminal registration handle may be converted by the same data source (e.g., registration ID) as the terminal side terminal registration handle. Multi-point control transmission handle h of multi-point control unit side_regThe data source can be converted into the same data source as the terminal transmission handle on the terminal side. The present invention is not limited thereto, and different handles on the terminal side and the mcu side corresponding to the resources are also within the scope of the present invention.

In this embodiment, the multipoint control registration resource Mcu_RegAnd a multicast control transmission resource Mcu_TpAnd storing the data of the other party mutually so as to realize resource association.

In this embodiment, after receiving the registration information of the terminal, the mcu may determine the address information Mt of the terminal_addr(the address information of the terminal may include, for example, the ip address and the port number of the terminal, but the invention is not limited thereto), parallel hash calculation, and generating a terminal hash value Mcu_keyTerminal hash value Mcu to be generated_keyAdd Multi-drop control Hash Table Mcu_tableIn (1). Specifically, the multipoint control unit may receive registration of a plurality of terminals, may hash address information for each terminal, and may generate different terminal hash values Mcu_key1、Mcu_key2。。。。。。Mcu_keyN. Eventually adding all terminal hash values to the multipoint control hash table Mcu_tableIn (1). Multi-point control hash table Mcu_tableMay be represented by a terminal hash value Mcu_keyAnd a multi-point control hash index value Mcu_indexFormed, and terminal hash value Mcu_keyAnd a multi-point control hash index value Mcu_indexAnd correspond to each other. Wherein the multi-point control hash index value Mcu_indexI.e., the multicast control transmission resource Mcu_TpIndex value Mcu of_TpIndex(i.e., the multi-point control transport handle h)_Tp). Transmission resource Mcu through multipoint control_TpIndex value Mcu of_TpIndexMay uniquely correspond to one multicast transmission resource Mcu_Tp. Wherein the multipoint control hash table Mcu_tableStructure is Mcu_table＝{Mcu_key，Mcu_TpIndex}，Mcu_TpIndex＝h_Tp。

Specifically, when the mcu makes a call to the terminal, the corresponding mcu Mcu can be found from the hash value of the address information of the terminal_TpSo that the transmission resource Mcu can be controlled by multipoint_TpThe terminal is called to join the video conference. The address information of the multipoint control unit calling terminal is included in the registration information sent by the terminal to the multipoint control unit.

Specifically, when the MCU calls a terminal, the MCU allocates the MCU call resources Mcu for the terminal_Call. Multi-point control call resource Mcu_CallMay include a multi-point control call handle h_CallAnd a multicast control transmission resource Mcu_TpI.e. Mcu_call＝{h_call，Mcu_Tp}. Multi-point control call handle h_callFor finding corresponding multipoint control calling resourcesSource Mcu_Call. Multi-point control call handle h_callSender-side lookup for a multipoint control unit to pass the found multipoint control transmission resource Mcu_TpAnd sending the information. Further, the multi-point control call resource Mcu_CallCall IDMcu may also be obtained_CallID，Mcu_CallIDFor finding corresponding multicast call resources Mcu_CallFor receiver-side lookup of the multipoint control unit to pass the call IDMcu in the received message_CallIDFinding multipoint control call resources Mcu_Call. The call IDs of different terminals are all different and unique. Wherein, the multi-point control call handle h at the multi-point control unit side_callMay be consistent with the terminal call handle at the terminal side. In some variations, the multi-point control call handle h on the multi-point control unit side_callCan be translated by the same data source (e.g., call ID) as the terminal call handle on the terminal side. The present invention is not limited thereto, and different handles on the terminal side and the mcu side corresponding to the resources are also within the scope of the present invention.

The above description is only illustrative of the video conference resources and their management at the multipoint control unit side, and the present invention is not limited thereto.

In particular, in some embodiments, the same TCP may be used for the connection between the terminal and the multipoint control unit. The TCP connection is established when the terminal registers with the multipoint control unit and the multipoint control unit then calls the terminal into the meeting via this TCP connection. When the TCP connection between the terminal and the multi-point control unit is disconnected (for example, due to poor Network status or an intermediary device such as NAT (Network Address Translation) or a switch), the terminal side may actively reconnect to the multi-point control unit.

In this embodiment, during the period from TCP disconnection between the terminal and the multipoint control unit to successful reconnection, registration and call resources Mt on the terminal and the multipoint control unit side_Reg、Mt_call、Mcu_Reg、Mcu_CallThe last state is kept, the cleaning is not carried out,clearing respective hash tables Mt only_tableOr Mcu_tableData in (2) and transmission resources Mt_TpAnd Mcu_Tp. Therefore, the terminal side and the multipoint control unit side cannot sense the phenomenon of disconnection and drop.

In this embodiment, after the TCP connection between the terminal and the multipoint control unit is disconnected, the TCP reconnection automatically connects the peer multipoint control unit when the terminal sends information next time. The TCP connection is disconnected between the terminal and the multipoint control unit, when the terminal sends the registration or call information, the resource allocated for the registration or call is searched, and then the corresponding transmission resource Mt is searched according to the hash value of the address information of the multipoint control unit_TpWhen not found, a terminal transmission resource Mt is reallocated_TpAdding the address hash value of the multipoint control unit into a terminal hash table, and transmitting the resource Mt through the newly allocated terminal_TpAnd re-performing TCP connection to the multipoint control unit and sending the registration information.

In this embodiment, after the TCP connection between the terminal and the mcu is successfully established again, the mcu receives the registration or call information of the terminal, and can find out the corresponding mcu call resource Mcu through the registration ID in the registration or call information_CallThen find corresponding multicast transmission resource Mcu_TpAnd, if not found, reallocates a multicast transmission resource Mcu_TpAnd adds the hash value of the terminal address information to the multipoint control hash table Mcu_tableIn (1). Transmission resource Mcu through multipoint control_TpObtain data sent over the TCP connection and register with the resource Mcu via the multipoint control_RegOr multipoint control call resource Mcu_CallAnd transmitting the data to the upper layer service of the terminal to complete the whole TCP disconnection reconnection process.

In the above, the video conference resources and the management methods thereof according to the terminal side and the multipoint control unit side are only schematically described, and the resource management and reconnection methods of the terminal side and the multipoint control unit side after the disconnection occurs are not limited in this way.

The invention also provides a video conference resource management method, which comprises the steps that the terminal executes the video conference resource management method executed at the terminal side; and executing the video conference resource management method executed on the side of the multipoint control unit by the multipoint control unit. Therefore, the terminal side and the multipoint control unit side can be matched together, and a corresponding resource management mode is realized.

The invention also provides a terminal corresponding to the video conference resource management method. The terminal comprises a terminal resource management module configured to manage terminal transmission resources, and terminal registration resources and/or terminal call resources. The terminal registration resource is used for storing terminal side registration information, the terminal transmission resource is used for information transmission between the terminal and the multipoint control unit, the terminal call resource is used for storing terminal side call information, the terminal registration resource is associated with the terminal transmission resource, and the terminal call resource is associated with the terminal transmission resource.

Corresponding to the video conference resource management method, the invention also provides a multipoint control unit. The multipoint control unit comprises a multipoint control resource management module configured to manage multipoint control transmission resources, and multipoint control registration resources and/or multipoint control call resources. The multipoint control registration resource is used for storing information registered at a multipoint control unit side, the multipoint control transmission resource is used for information transmission between the terminal and the multipoint control unit, the multipoint control call resource is used for storing information called at the multipoint control unit side, the multipoint control registration resource is associated with the multipoint control transmission resource, and the multipoint control call resource is associated with the multipoint control transmission resource.

The specific management manner and usage manner of each resource are as described in the video conference resource management method, and are not described herein again. The invention can realize the terminal and the multipoint control unit by software, hardware, firmware and any combination thereof. The splitting, merging and adding of modules are within the protection scope of the invention without departing from the concept of the invention.

Specifically, the invention also provides a terminal side video conference method which comprises the step that the terminal registers to a multipoint control unit. Referring now to fig. 3, fig. 3 illustrates a flow chart of the terminal registering with a multipoint control unit at the terminal side in accordance with an embodiment of the present invention. Fig. 3 shows the following steps in total:

step S111: and allocating terminal registration resources and terminal transmission resources at the terminal, wherein the terminal registration resources and the terminal transmission resources are associated with each other.

Specifically, the terminal registration resource and the terminal transmission resource have been described in fig. 1, and are not described herein again.

In a specific embodiment of the present invention, the terminal transmission resource is associated with a terminal transmission handle, and the terminal transmission handle is used for searching the terminal transmission resource. Thus, the step of allocating terminal transmission resources at the terminal in step S111 can be implemented by the flow shown in fig. 4: step S1111: calculating a multipoint control hash value according to the address information of the multipoint control unit; step S1112: and associating the multipoint control hash value with the terminal transmission handle and storing the multipoint control hash value in a terminal hash table.

Step S112: and sending registration information to a multipoint control unit through the terminal transmission resource, wherein the registration information is generated according to the terminal registration resource.

Step S113: and receiving the registration reply information sent by the multipoint control unit through the terminal transmission resource.

Step S114: and searching the terminal registration resource according to the registration reply information.

Step S115: and the terminal registration resource stores the registration reply information.

Therefore, in the terminal side video conference method provided by the invention, the terminal registration resources and the terminal transmission resources which are mutually associated are distributed at the terminal, so that the step of registering the terminal side multi-point control unit can be realized based on the terminal registration resources and the terminal transmission resources.

Specifically, in the registration phase, after the terminal is disconnected from the multipoint control unit, the step of disconnecting and reconnecting may be described with reference to fig. 6:

step S131: clearing the terminal transmission resources and clearing the multipoint control hash value in the terminal hash table;

step S132: reallocating terminal transmission resources at the terminal, sending registration information to the multipoint control unit via the terminal transmission resources in response to the terminal sending registration information to the multipoint control unit.

The registration phase in the terminal-side video conferencing method is described below in conjunction with fig. 1, 3, 4, and 6.

Firstly, each participating terminal registers the multi-point control unit first, the terminal carries the terminal address and registers IDMt in the register information sent by the terminal to the multi-point register unit_RegIDAnd so on.

When the terminal side registers with the multipoint control unit for the first time, the terminal can locally apply for a terminal registration resource Mt_RegIn which the information required for this registration can be stored, and a terminal registration handle h can be assigned_regFor finding allocated terminal registration resources Mt_Reg。

The terminal side registration information can transmit the resource Mt through the terminal_TpSending to the multipoint control unit, when finding that there is no terminal transmission resource Mt according to the address information of the multipoint control unit_TpWhen the terminal side locally applies for a terminal transmission resource Mt_TpAnd according to the address information of the multipoint control unit, calculating the multipoint control hash value thereof, and then associating the multipoint control hash value with the terminal transmission handle h_TpAdding terminal hash table Mt_tableSo as to pass through the terminal hash table Mt when information is transmitted and received later_tableInquiring terminal transmission resource Mt_Tp。

Terminal side through terminal transmission resource Mt_TpWill register according to the terminalResource Mt_RegThe generated registration information is sent to the multipoint control unit.

After receiving the registration reply message from the multipoint control unit, the terminal side can register the IDMt_RegIDFinding corresponding terminal registration resource Mt_RegAnd the information which is registered and replied by the multi-point control unit is stored and then is sent to the upper layer service for processing.

When the terminal actively sends the registration information to the multi-point control unit again after the disconnection, the terminal can register the handle h_regFind out terminal registration resource Mt_RegAnd storing the registration information data of the upper layer service in the terminal registration resource Mt_RegIn (1), registering resource Mt through terminal_RegFinding out terminal transmission resource Mt_Tp(when there is no terminal transmission resource Mt_TpOr terminal transmission resource Mt_TpWhen invalid, a terminal transmission resource Mt can be reallocated_Tp) Finally, the resource Mt is transmitted through the terminal_TpAnd sending the registration information to the multipoint control unit side.

Specifically, in the terminal-side video conference method of the present invention. The step of the terminal registering to a multipoint control unit also comprises the step of the terminal executing the call with the multipoint control unit. Referring now to fig. 5, fig. 5 illustrates a flow chart of a call phase at a terminal side according to an embodiment of the present invention. Fig. 5 shows the following steps:

step S121: and receiving the call information sent by the multipoint control unit. Step S122: and calculating the multipoint control hash value according to the address information of the multipoint control unit. Step S123: and searching the terminal transmission handle in the terminal hash table according to the multipoint control hash value. Step S124: and searching the terminal transmission resource according to the terminal transmission handle. Step S125: and searching a terminal calling resource according to the calling information, wherein the terminal calling resource is associated with the terminal transmission resource. Step S126: and processing the call information through the terminal call resource to generate call reply information. Step S127: and searching the terminal transmission resource according to the terminal call resource. Step S128: and sending call reply information to the multipoint control unit according to the terminal transmission resource.

Specifically, in the call phase, after the terminal is disconnected from the multipoint control unit, the disconnection reconnection procedure may be described with reference to fig. 6:

step S131: and clearing the terminal transmission resources and clearing the multipoint control hash value in the terminal hash table. Step S133: reallocating terminal transmission resources at the terminal, responding to the terminal sending call reply information to the multipoint control unit, and sending the call reply information to the multipoint control unit through the terminal call resources.

The call phase in the terminal-side video conferencing method is described below in conjunction with fig. 1, 5, and 6.

When the terminal receives a call from the multipoint control unit, address information Mcu for the multipoint control unit may be calculated_addrMulti-point control hash value Mt_keyAnd controlling the hash value Mt according to the multiple points_keyAt terminal hash table Mt_tableFinding the multi-point control hash value Mt_keyIndex value of (Mt)_TpIndexThus, can be based on Mt_TpIndexFinding terminal transmission resource Mt_Tp。

Then, the terminal searches the corresponding terminal call handle h according to the call ID in the call information of the multi-point control unit_callWhen the search is not available, the call is considered to be coming of a new call, and a terminal call handle h is allocated_callAnd corresponding terminal call resources Mt_call。

Then, the terminal analyzes the call information and stores the call information in the terminal call resource Mt_callMiddle and terminal call resource Mt_callAnd terminal transmission resource Mt_TpStoring data information of each other, and calling resource Mt via terminal_callAnd sending the data to an upper layer service.

When the upper layer service processes the call information and prepares to reply the call information of the multi-point control unit, the call handle h used by the upper layer is used_callThe corresponding terminal call resource Mt can be found_callAnd storing the call information replied by the upper layer service. Then calling resource Mt through terminal_callFinding corresponding terminal transmission resource Mt_TpFinally, the resource Mt is transmitted through the terminal_TpAnd returning the upper layer calling information to the multipoint control unit side.

When the TCP connection is disconnected due to poor network condition or intermediate equipment (route or switch, etc.) after the call is completed, i.e. the terminal has entered the multipoint control unit conference, the terminal and the multipoint control unit side correspond to the transmission resource Mt of the TCP connection_Tp、Mcu_TpAll clear and from the respective hash table Mt_table、Mcu_tableDeleting the data of the transmission resource, and reserving the registration and call resources (Mt) of the terminal and the multipoint control unit side_Reg、Mt_call、Mcu_Reg、Mcu_Call) Data on registrations and calls.

After the TCP connection between the terminal and the platform is disconnected, the terminal sends information next time to trigger the establishment of the TCP connection between the terminal and the multipoint control unit, and if the terminal sends the registration information, the whole process is the above-mentioned process of the terminal and the multipoint control unit registration, which is not described in detail.

When the terminal sends the call related information, the handle h can be called through the terminal_callFind out the corresponding terminal call resource Mt_callAnd stores the call information of the upper layer. Then, calling the resource Mt through the terminal_callSearching terminal transmission resource Mt_TpWhen the terminal can not be found, a transmission handle h is transmitted for reassigning a terminal_TpAnd creates a corresponding terminal transmission resource Mt_Tp. Recalculating multipoint control hash value Mt for address information of multipoint control unit_keyAdding terminal hash table Mt_tableIn (1).

Finally, the resources Mt are transmitted by the terminal_TpSending the call related information to the multi-point control unit side, and calling the resource Mt by the terminal_callAnd terminal transmission resource Mt_TpThe storage partner data are updated with each other.

Specifically, the invention also provides a multipoint control unit side video conference method, which comprises the step that the terminal registers to a multipoint control unit. Referring now to fig. 7, fig. 7 shows a flowchart of the terminal registering with a multipoint control unit at the multipoint control unit side according to an embodiment of the present invention. Fig. 7 shows the following steps in total:

step S211: and receiving the registration information sent by the terminal.

Step S212: and distributing a multipoint control registration resource and a multipoint control transmission resource for the terminal sending the registration information in the multipoint control unit, wherein the multipoint control registration resource and the multipoint control transmission resource are associated with each other.

Specifically, the coordinated multipoint control registration resource and coordinated multipoint control transmission resource have been described in fig. 2, and are not described herein again.

In some embodiments of the present invention, the multiple point control transmission resource is associated with a multiple point control transmission handle, and the multiple point control transmission handle is used for searching the multiple point control transmission resource. Thus, the step S212 of allocating the multi-point control transmission resource to the terminal sending the registration information in the multi-point control unit may be implemented according to the flow shown in fig. 8: step S2121: and calculating the hash value of the terminal according to the address information of the terminal. Step S2122: and associating the terminal hash value with the multipoint control transmission handle and storing the terminal hash value in a multipoint control hash table.

Step S213: and processing the registration information through the multipoint control registration resource and generating registration reply information.

Step S214: and searching the multipoint control transmission resource through the multipoint control registration resource.

Step S215: and sending the registration reply information to the terminal through the multipoint control transmission resource.

Therefore, in the multi-point control unit side video conference method provided by the invention, the multi-point control registration resource and the multi-point control transmission resource which are mutually associated are distributed in the multi-point control unit, so that the step of registering the terminal side to the multi-point control unit can be realized based on the multi-point control registration resource and the multi-point control transmission resource.

Specifically, in the registration phase, after the terminal is disconnected from the multipoint control unit, the disconnection reconnection procedure may be described with reference to fig. 10: step S231: and clearing the multipoint control transmission resource and clearing the terminal hash value in the multipoint control hash table. Step S232: and reallocating the multipoint control transmission resources at the multipoint control unit, responding to the multipoint control unit sending registration reply information to the terminal, and sending the registration reply information to the terminal through the multipoint control transmission resources.

The registration phase in the multipoint control unit side video conferencing method is described below in conjunction with fig. 2, 7, 8 and 10.

When the multipoint control unit receives the registration request of the terminal, it first judges whether the information is the registration information, if yes, it calculates the terminal hash value Mcu of the address information of the terminal_keyAt the multipoint control hash table Mcu_tableMiddle lookup terminal hash value Mcu_keyIf not, the MCU allocates a transmission resource Mcu for the terminal_TpAnd the terminal hash value Mcu is added_keyAssociated multipoint control transfer handle h_TpAdd-to-multipoint control hash table Mcu_tableIn (1).

Then, a multi-point control registration resource Mcu is allocated for the terminal registration_RegRegistering the resource Mcu by multipoint control_RegAnd analyzing and storing the registration information of the terminal, and finally sending the registration information to the upper layer service processing of the multipoint control unit side.

After the upper layer service of the multipoint control unit is processed, the registration reply information is sent to the terminal, and the registration reply information is stored in the multipoint control registration resource Mcu_RegIn (1), register handle h through multi-point control_regFinding corresponding multipoint control registration resource Mcu_RegThen is further prepared byMulti-point control registration resource Mcu_RegFind corresponding multicast transmission resource Mcu_TpFinally, the transmission resource Mcu is controlled by the multipoint_TpAnd sending the registration reply information of the multipoint control unit to the terminal side.

When the TCP connection is completed in the registration phase, i.e. between the terminal and the platform, the TCP connection is disconnected due to the current poor network condition or the intermediate device (such as a router or a switch), then the terminal and the multi-point control unit side correspond to the transmission resource Mt of the TCP connection at this time_Tp、Mcu_TpAll clear and from the respective hash table Mt_table、Mcu_tableDeletes the data of the current transmission resource and reserves the registration resource of the terminal and the multipoint control unit side (Mcu)_Reg、Mt_Reg) Data on the registration.

After receiving the registration-related information, the mcu will go to the current mcu Mcu_tableFinds existing multicast transmission resources Mcu_TpIf not, then allocating a multicast transmission resource Mcu for this message_TpAnd hash the address Mcu of the terminal side_keyAdd to the multipoint control hash table Mcu_tableIn (1). Parsing the registration ID in the registration information, and copying the multi-point control registration resource Mcu according to the registration ID_RegRegistering the registration information with the multipoint control registration resource Mcu_RegAnd sending the data to an upper layer service. Finally, the multipoint control registration resource is updated Mcu_RegMedium multipoint control transmission resource Mcu_TpThe data of (1).

Specifically, in the video conference method on the multipoint control unit side of the present invention. The step of the terminal registering to a multipoint control unit also comprises the step of the terminal executing the call with the multipoint control unit. Referring now to fig. 9, fig. 9 illustrates a flow diagram of a call phase at the multipoint control unit side in accordance with an embodiment of the present invention. Fig. 9 shows the following steps:

step S231: and calculating the hash value of the terminal according to the address information of the terminal to be called. Step S232: and searching the multipoint control transmission handle in the multipoint control hash table according to the terminal hash value. Step S233: and searching the multi-point control transmission resource according to the multi-point control transmission handle. Step S234: applying for a multi-point control call resource at the multi-point control unit, the multi-point control call resource being associated with the multi-point control transmission resource. Step S235: and generating a call message through the multipoint control call resource. Step S236: and sending the call information to the terminal through the multipoint control transmission resource. Step S237: and receiving the call reply information sent by the terminal through the multipoint control transmission resource. Step S238: and searching the multipoint control call resource according to the call reply information. Step 239: the multi-point control call resource stores the call reply information.

Specifically, in the call phase, after the terminal is disconnected from the multipoint control unit, the disconnection reconnection procedure may be described with reference to fig. 10: step S221: and clearing the multipoint control transmission resource and clearing the terminal hash value in the multipoint control hash table. Step S223: and reallocating the multipoint control transmission resources at the multipoint control unit, responding to the multipoint control unit sending the call information to the terminal, and sending the call information to the terminal through the multipoint control transmission resources.

The call phase in the multipoint control unit side video conferencing method is described below in conjunction with fig. 2, 9 and 10.

First, the mcu finds the address of the terminal to be called and calculates the terminal hash Mcu of the address information of the terminal_keyThereafter, the hash table Mcu is controlled at multiple points_tableFinding out the corresponding multi-point control transmission resource Mcu_Tp。

Then, when calling, the multi-point control unit allocates multi-point control calling handle h for the terminal_callAnd creates corresponding multi-point control call resources Mcu_CallBy multipoint controlling the call handler h_callStoring upper layer call information in a multi-point control call resource Mcu_CallIn (1). Finally, the transmission resource Mcu is controlled by multipoint_TpThe call information is transmitted to the terminal side.

When the multipoint control unit receives the call reply message from the terminal side, the terminal address information is calculated first, and the terminal hash value Mcu of the address information of the terminal is calculated_keyAt the multipoint control hash table Mcu_tableFinding the corresponding multicast transmission resource Mcu_Tp. Then, the corresponding multi-point control call handle h is searched by the call ID in the call information_callBy multipoint controlling the call handler h_callFinding multipoint control call resources Mcu_Call. Multi-point control call resource Mcu_CallAnd a multicast control transmission resource Mcu_TpRespectively storing the data of each other for searching the data of each other. Finally, the multicast control transmission resource Mcu_TpThe received data is stored in the multicast call resource Mcu_CallAnd the call resource Mcu is controlled by the multipoint_CallAnd sending the data to an upper layer service.

When MCU receives the information related to terminal call, it finds out the corresponding multi-point control call handle h by the call ID_callBy multipoint controlling the call handler h_callFinding multipoint control call resources Mcu_CallThen calculates the terminal hash Mcu according to the address information of the terminal_keyAt the multipoint control hash table Mcu_tableFinding the corresponding multicast transmission resource Mcu_Tp. If no available multicast transmission resource Mcu is found_TpThen, the multi-point control unit allocates a multi-point control transmission resource handle h for the terminal_TpAnd correspondingMulti-point control transmission resource Mcu_TpAnd the terminal hash value Mcu is added_keyAssociated multipoint control transmission resource handle h_TpLocal storage to multipoint control hash table Mcu_tableAnd updates the next multicast call resource Mcu_CallMedium multipoint control transmission resource Mcu_Tp. The call resource Mcu is then controlled by the multipoint_CallAnd sending the received call information to an upper layer service.

When the upper layer service replies the call information to the terminal, the multi-point control unit finds out the corresponding multi-point control call handle h through the call ID_callBy multipoint controlling the call handler h_callFinding multipoint control call resources Mcu_CallAnd controlling the call resources Mcu by the multipoint_CallStoring upper layer call information, the multipoint control unit controlling the call resource Mcu through the multipoint_CallFinding corresponding multicast transmission resource Mcu_TpFinally, through a multicast control transmission resource Mcu_TpThe call information is transmitted to the terminal side.

Therefore, in the registration or calling stage, even if TCP is abnormally disconnected between the terminal and the multipoint control unit, the participant can not sense the disconnection of the conference, and the stability and the continuity of the conference are ensured.

The foregoing is merely an illustrative description of various specific implementations of the invention and the invention is not limited thereto.

The invention also provides a terminal corresponding to the method for executing the video conference. The terminal includes a terminal registration module configured to register the terminal with a multipoint control unit. The step of registering the terminal with a multipoint control unit comprises: allocating terminal registration resources and terminal transmission resources at a terminal, wherein the terminal registration resources and the terminal transmission resources are associated with each other; sending registration information to a multipoint control unit through the terminal transmission resource, wherein the registration information is generated according to the terminal registration resource; receiving registration reply information sent by the multipoint control unit through the terminal transmission resource; searching the terminal registration resource according to the registration reply information; and the terminal registration resource stores the registration reply information.

Corresponding to the method for executing the video conference, the invention also provides a multipoint control unit. The multipoint control unit comprises a multipoint control registration module configured to register a terminal to the multipoint control unit. The step of registering a terminal to the multipoint control unit comprises: receiving registration information sent by the terminal; distributing multipoint control registration resources and multipoint control transmission resources for the terminal sending the registration information in the multipoint control unit, wherein the multipoint control registration resources and the multipoint control transmission resources are associated with each other; processing the registration information through the multi-point control registration resource and generating registration reply information; searching the multi-point control transmission resource through the multi-point control registration resource; and sending the registration reply information to the terminal through the multipoint control transmission resource.

The specific management manner and usage manner of each resource are as described in the method for performing the video conference, and are not described herein again. The invention can realize the terminal and the multipoint control unit by software, hardware, firmware and any combination thereof. The splitting, merging and adding of modules are within the protection scope of the invention without departing from the concept of the invention.

The invention also provides a video conference method, which comprises the steps that the terminal executes the video conference method executed on the terminal side; the above-described video conference method performed at the multipoint control unit side is performed by the multipoint control unit.

The invention also provides a video conference system, which comprises a terminal for executing the video conference method executed at the terminal side and/or executing the video conference resource management method executed at the terminal side; and a multipoint control unit for executing the video conference method executed at the multipoint control unit side and/or executing the video conference resource management method executed at the multipoint control unit side.

The invention can realize the video conference device by software, hardware, firmware and any combination thereof. The splitting, merging and adding of modules are within the protection scope of the invention without departing from the concept of the invention.

In an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium, on which a computer program is stored, which when executed by, for example, a processor, may implement the video conference method performed on the terminal side in any one of the above embodiments; a video conference resource management method executed at a terminal side; a video conference method performed at a multipoint control unit side; one or more of the video conference resource management methods performed at the multipoint control unit side. The step (2). In some possible embodiments, the aspects of the present invention may also be implemented in the form of a program product, which includes program code for causing a terminal device to execute the video conference method executed on the terminal side as described above in this specification, if the program product runs on the terminal device; a video conference resource management method executed at a terminal side; a video conference method performed at a multipoint control unit side; one or more of the video conference resource management methods performed at the multipoint control unit side. Steps according to various exemplary embodiments of the present invention are described in the sections.

Referring to fig. 11, a program product 800 for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the tenant computing device, partly on the tenant device, as a stand-alone software package, partly on the tenant computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing devices may be connected to the tenant computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).

In an exemplary embodiment of the present disclosure, there is also provided an electronic device, which may include a processor, and a memory for storing executable instructions of the processor. Wherein the processor is configured to execute the video conference method executed on the terminal side in any of the above embodiments via execution of the executable instructions; a video conference resource management method executed at a terminal side; a video conference method performed at a multipoint control unit side; one or more of the video conference resource management methods performed at the multipoint control unit side. The step (2).

As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.

An electronic device 600 according to this embodiment of the invention is described below with reference to fig. 12. The electronic device 600 shown in fig. 12 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.

As shown in fig. 12, the electronic device 600 is embodied in the form of a general purpose computing device. The components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one storage unit 620, a bus 630 that connects the various system components (including the storage unit 620 and the processing unit 610), a display unit 640, and the like.

Wherein the storage unit stores program codes, which can be executed by the processing unit 610, so that the processing unit 610 executes the video conference method executed on the terminal side as described above in this specification; a video conference resource management method executed at a terminal side; a video conference method performed at a multipoint control unit side; one or more of the video conference resource management methods performed at the multipoint control unit side. Steps according to various exemplary embodiments of the present invention are described in the sections. For example, the processing unit 610 may perform the steps as shown in any one or more of fig. 1-10.

The storage unit 620 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM)6201 and/or a cache memory unit 6202, and may further include a read-only memory unit (ROM) 6203.

The memory unit 620 may also include a program/utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.

Bus 630 may be one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a tenant to interact with the electronic device 600, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 600 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 650. Also, the electronic device 600 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via the network adapter 660. The network adapter 660 may communicate with other modules of the electronic device 600 via the bus 630. It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, or a network device, etc.) to execute the video conference method executed on the terminal side according to the embodiments of the present disclosure; a video conference resource management method executed at a terminal side; a video conference method performed at a multipoint control unit side; one or more of the video conference resource management methods performed at the multipoint control unit side.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims

1. A video conference method is applied to a terminal and comprises the following steps:

the step of registering the terminal to a multipoint control unit comprises:

allocating terminal registration resources and terminal transmission resources at a terminal, wherein the terminal registration resources and the terminal transmission resources are associated with each other;

sending registration information to a multipoint control unit through the terminal transmission resource, wherein the registration information is generated according to the terminal registration resource;

receiving registration reply information sent by the multipoint control unit through the terminal transmission resource;

searching the terminal registration resource according to the registration reply information;

and the terminal registration resource stores the registration reply information.

2. The video conferencing method of claim 1, wherein the terminal transmission resource is associated with a terminal transmission handle, the terminal transmission handle being used to locate the terminal transmission resource,

the allocating terminal registration resources and terminal transmission resources at the terminal further comprises:

calculating a multipoint control hash value according to the address information of the multipoint control unit;

and associating the multipoint control hash value with the terminal transmission handle and storing the multipoint control hash value in a terminal hash table.

3. The video conferencing method of claim 2, wherein the step of registering the terminal with a multipoint control unit further comprises:

the step of the terminal and the multipoint control unit executing the call comprises the following steps:

receiving call information sent by the multipoint control unit;

calculating the multipoint control hash value according to the address information of the multipoint control unit;

searching the terminal transmission handle in the terminal hash table according to the multipoint control hash value;

searching the terminal transmission resource according to the terminal transmission handle;

searching a terminal calling resource according to the calling information, wherein the terminal calling resource is associated with the terminal transmission resource;

processing the call information through the terminal call resource to generate call reply information;

searching the terminal transmission resource according to the terminal call resource;

and sending call reply information to the multipoint control unit according to the terminal transmission resource.

4. The video conferencing method of claim 3, wherein the responding to the disconnection between the terminal and the multipoint control unit after the terminal allocates the terminal registration resources and the terminal transmission resources, further comprises:

clearing the terminal transmission resources and clearing the multipoint control hash value in the terminal hash table;

reallocating terminal transmission resources at the terminal and performing one or more of the following steps;

sending registration information to the multipoint control unit through the terminal transmission resource in response to the terminal sending registration information to the multipoint control unit;

and responding to the call reply information sent by the terminal to the multipoint control unit, and sending the call reply information to the multipoint control unit through the terminal call resource.

5. A video conference method applied to a multipoint control unit includes:

the step of registering the terminal to the multipoint control unit comprises the following steps:

receiving registration information sent by the terminal;

distributing multipoint control registration resources and multipoint control transmission resources for the terminal sending the registration information in the multipoint control unit, wherein the multipoint control registration resources and the multipoint control transmission resources are associated with each other;

processing the registration information through the multi-point control registration resource and generating registration reply information;

searching the multi-point control transmission resource through the multi-point control registration resource;

and sending the registration reply information to the terminal through the multipoint control transmission resource.

6. The video conferencing method of claim 5, wherein the multi-point control transmission resource is associated with a multi-point control transmission handle, the multi-point control transmission handle being used to locate the multi-point control transmission resource,

the allocating, at the multipoint control unit, a multipoint control registration resource and a multipoint control transmission resource for the terminal sending the registration information further includes:

calculating a terminal hash value according to the address information of the terminal;

and associating the terminal hash value with the multipoint control transmission handle and storing the terminal hash value in a multipoint control hash table.

7. The video conferencing method of claim 6, wherein the step of the terminal registering with the multipoint control unit further comprises, after:

calculating the hash value of the terminal according to the address information of the terminal to be called;

searching the multipoint control transmission handle in the multipoint control hash table according to the terminal hash value;

searching the multi-point control transmission resource according to the multi-point control transmission handle;

applying for a multi-point control call resource at the multi-point control unit, the multi-point control call resource being associated with the multi-point control transmission resource;

generating a call message through the multi-point control call resource;

sending the call information to the terminal through the multi-point control transmission resource;

receiving a call reply message sent by a terminal through the multi-point control transmission resource;

searching the multipoint control call resource according to the call reply information;

the multi-point control call resource stores the call reply information.

8. The video conferencing method of claim 7, wherein the responding to the disconnection between the terminal and the multipoint control unit after the multipoint control unit allocates the multipoint control registration resources and the multipoint control transmission resources, further comprises:

clearing the multipoint control transmission resource and clearing a terminal hash value in the multipoint control hash table;

reallocating multipoint control transmission resources at the multipoint control unit and performing one or more of the following steps;

responding to the multipoint control unit to send registration reply information to the terminal, and sending the registration reply information to the terminal through the multipoint control transmission resource;

and responding to the multipoint control unit to send the call information to the terminal, and sending the call information to the terminal through the multipoint control transmission resource.

9. A method for managing video conference resources, comprising:

managing terminal transmission resources by the terminal, and terminal registration resources and/or terminal call resources,

the terminal registration resource is used for storing information about registration of a terminal side, the terminal transmission resource is used for information transmission between the terminal and a multipoint control unit, the terminal call resource is used for storing information about call of the terminal side, the terminal registration resource is associated with the terminal transmission resource, and the terminal call resource is associated with the terminal transmission resource.

10. A method for managing video conference resources, comprising:

managing, by the multipoint control unit, multipoint control transmission resources, and multipoint control registration resources and/or multipoint control call resources,

the multipoint control registration resource is used for storing information about registration at the multipoint control unit side, the multipoint control transmission resource is used for information transmission between the terminal and the multipoint control unit, the multipoint control call resource is used for storing information about call at the multipoint control unit side, the multipoint control registration resource is associated with the multipoint control transmission resource, and the multipoint control call resource is associated with the multipoint control transmission resource.