TW201320746A - Video conferencing connection system and method - Google Patents

Abstract

The invention proposes a video conferencing connection system and method, comprising an authentication device for allowing a user end device to send requests for connecting a video conferencing, a strategy device for detecting the network connection capability and further analyzing the connection quality of the user end device so as to decide a common connection mode for each user-end device to conduct video conferencing accordingly, wherein the connection mode includes a direct point-to-point mode, an indirect point-to-point mode or a multiple point control mode, thereby providing greater flexibility in choosing a desirable connection mode as required to avoid wastefulness of hardware resources and high band width networks using only multiple point control unit in prior techniques.

Description

Video connection system and method

The present invention relates to a video connection system and method, and more particularly to a video connection system and method for selecting a connection mode according to the network connection capability and quality of a client device.

The video conference system provides a way for a plurality of users to participate in a conference at a long distance, so that the user can interact with each other without being limited to space. In the current video conferencing system, the user can usually use a client device (such as a computer) to connect to the network through a network and a multi-point control unit (MCU) for video interaction. However, when more users use the client device to connect to the multipoint control unit to participate in the conference, the load on the hardware resources or the network bandwidth of the multipoint control unit is heavier.

As shown in FIG. 1, FIG. 1 is a basic structural diagram of a conventional video conferencing system 1. The video conferencing system 1 includes a multipoint control unit 11 and a first client device 10a, a second client device 10b, and a third client device 10c that are respectively connected to the multipoint control unit 11 via a network. Since the conventional video conferencing system 1 is balanced for the transmission data of the respective conference points (ie, the first client device 10a, the second client device 10b, and the third client device 10c), the multipoint control unit 11 The transmission of the first client device 10a, the second client device 10b, and the third client device 10c needs to be coordinated and controlled. For example, as illustrated by the first client device 10a, the multipoint control unit 11 needs to receive the uploaded video material from the first client device 10a and transmit the uploaded by the second client device 10b and the third client device 10c. Video, audio or other information is sent to the first client device 10a. That is, the multipoint control unit 11 needs to process the transmission data of the three routes only for a single conference point (for example, the first client device 10a), and for the three conference points as shown in FIG. The point control unit 11 needs to process transmission data of at least nine routes. Therefore, the load of the multipoint control unit is increased as the number of users participating in the video conference increases.

One of the existing solutions is to expand the hardware device of the multipoint control unit or increase the network bandwidth. However, this method not only increases the cost but also wastes the hardware resources and network bandwidth of the multipoint control unit. On the other hand, if you want to use a peer-to-peer method for video conferencing without going through the multipoint control unit, it will be blocked by the network environment of each user's client device (such as a firewall). Each of the client devices is connected to each other.

In view of the above disadvantages of the prior art, the present invention aims to provide a video connection system and method, which can reduce the waste of hardware resources and network bandwidth of a multi-point control unit, and is not limited to the network of each user equipment. Road environment.

To achieve the foregoing and other objects, the present invention provides a video connection system, which mainly includes: an authentication device and a decision device. The authentication device is configured to connect a plurality of client devices through a network to request a video connection; the decision device includes a detection module, an analysis module, and a decision module. The detection module is configured to detect a network connection capability of each of the client devices connected to the authentication device; the analysis module is configured to analyze a network of each client device connected to the authentication device The connection quality is used to determine the common connection mode of each of the client devices to perform the video connection according to the network connection capability and the network connection quality of each of the client devices.

The connection mode includes a direct point-to-point mode, an indirect point-to-point mode, or a multi-point control mode.

In an embodiment, the video connection system of the present invention further includes a multipoint control unit, wherein when the connection mode is the multipoint control mode, the multipoint control unit can be used for each of the client devices. Line to execute the video connection.

The detection of the network connection capability includes detection of a network type, a firewall, a network address conversion device, and a proxy device, wherein the network type includes a regional network, a virtual private network, or the Internet. Types of. The detection of the firewall includes detection of connection capabilities of a user data protocol, a hypertext transfer protocol, and a hypertext transfer security protocol.

To achieve the foregoing and other objects, the present invention further provides a video connection method, including the following steps: a plurality of user equipments requesting a video connection; and detecting and analyzing each of the user equipments that request video communication The network connection capability and the quality of the network connection; determining the common connection mode of each of the client devices to perform the video connection according to the network connection capability of each of the client devices and the quality of the network connection.

The step of detecting and analyzing the network connection capability and the network connection quality of each of the client devices that request the video connection may include detecting the network type of each of the client devices as a regional network. Types such as roads, virtual private networks, or the Internet. In addition, the network connection quality of the network type of each of the client devices may be analyzed, and when two or more identical network types belong to each of the client devices, the two or more identical networks are analyzed. The type of network connection of the road type to determine the type of network to be used preferentially. Furthermore, the firewall, the network address translation device, or the proxy device for detecting each of the client devices may be further included. Finally, the network bandwidth and the hardware load of each of the client devices can be further analyzed.

Compared with the conventional video connection technology, the video connection system and method of the present invention can flexibly select the connection mode to reduce the network bandwidth or hardware load of the multipoint control unit.

In the following, the technical content of the present invention will be described by a specific embodiment, and those skilled in the art can easily understand other advantages and effects of the present invention by the contents disclosed in the present specification, and can also be implemented by other different embodiments. Or application.

Referring to FIG. 2A, the video connection system 2 of the present invention includes an authentication device 21, a decision device 22, and client devices 20a, 20b, 20c, wherein the client devices 20a, 20b, 20c can be authenticated by the network 25 and The device 21 and the decision device 22 are connected. In addition, the video connection system 2 can be applied to a video conference.

The authentication device 21 can be used for the client devices 20a, 20b, 20c to be connected via the network 25 to request the video connection. In other words, the client devices 20a, 20b, 20c can log in to the authentication device 21 via the network 25 and register the request for registration of the video connection. It should be noted that the authentication device 21 can be a centralized or distributed server. In addition, the authentication device 21 can be, for example, a real or virtual server, which can be in a single computer room, dispersed in different computer rooms, or dispersed in different geographic locations, and the like.

The decision device 22 can include a detection module 221, an analysis module 222, and a decision module 223. It should be noted that the modules may include software, hardware or a combination of the foregoing. The software may be, for example, a machine code, a firmware, an embedded code, an application software, or a combination of the foregoing, and the hardware may be, for example, a circuit, a processor, a computer, an integrated circuit, an integrated circuit core, or a combination thereof. Further, the authentication device 21 and the decision device 22 may be the same or different devices.

The detection module 221 can be used to detect the network connection capability of the client devices 20a, 20b, and 20c. The detection module 221 can detect the network connection capability of the client devices 20a, 20b, and 20c. Including network type, firewall, network address translation (NAT) device, proxy device detection.

Specifically, the network type includes a network type such as a local area network (LAN), a virtual private network (VPN), or an internet. The detection of the network type means that the detection module 221 can detect that the network type of the client device 20a, 20b, 20c belongs to at least one network type of a regional network, a virtual private network or an internet. If the client devices 20a, 20b, 20c belong to the same network type (for example, a virtual private network) in a regional network, a virtual private network, or the Internet, the network type is preferentially used to connect. On the other hand, if the client devices 20a, 20b, 20c belong to any two or more network types (for example, a virtual private network and an Internet) in a local area network, a virtual private network, or the Internet, The analysis module 222 analyzes the network connection quality of the network type of the same type between the client devices 20a, 20b, and 20c for the network connection of the determination module 223 according to the client devices 20a, 20b, and 20c. The ability and network connection quality determine the preferred type of network to determine the connection mode. Generally speaking, the priority is in the order of regional network, virtual private network, and internet. However, if the quality of the Internet connection is better than the connection quality of the virtual private network, then the Internet is preferred. Similarly, if the connection quality of the virtual private network is better than the connection quality of the regional network, the virtual private network is preferred.

The detection of the firewall means that the detection module 221 can detect that the user equipment 20a, 20b, 20c has a user datagram protocol (UDP) and a hypertext transfer protocol (HTTP). ), the hypertext transfer secure protocol (HTTPS) connection capability. If the client devices 20a, 20b, 20c can use one of the aforementioned three protocols, the client devices 20a, 20b, 20c preferentially use the protocol to connect. In addition, if two or more of the same protocols can be used between the client devices 20a, 20b, and 20c, the analysis module 222 analyzes the connection quality of the two or more identical protocols for the decision module 223 to be based on the user. The network connection capability of the end devices 20a, 20b, and 20c and the agreement for preferential use of the network connection quality determine the connection mode.

The detection of the NAT device means that the detection module 221 can separately record the address and connection port of the Internet Protocol (IP) before and after the client device 20a, 20b, 20c is converted via the NAT device, and detect the NAT. The type of device and the session keep alive mechanism.

The detection of the Proxy device means that the detection module 221 can detect whether the client device 20a, 20b, 20c uses the proxy device to establish an HTTPS tunnel based on the usage status of the proxy device and enable the hold session mechanism.

The analysis module 222 can be used to analyze the network bandwidth and hardware load of the client devices 20a, 20b, 20c. The analysis module 222 can further analyze the network connection capability and network of each client device 20a, 20b, 20c when a plurality of client devices 20a, 20b, 20c are changed, for example, adding or deleting user devices. The connection quality is determined by the decision module 223 to determine the connection mode of each of the client devices 20a, 20b, and 20c.

The determining module 223 can be configured to determine a connection mode common to the client devices 20a, 20b, and 20c to perform the video connection according to the network connection capability of the client devices 20a, 20b, and 20c and the network connection quality. The connection mode may include a direct point-to-point mode, an indirect point-to-point mode, or a multi-point control mode. Specifically, the direct peer-to-peer mode is such that the client devices 20a, 20b, 20c are connected to each other through a common network type or protocol to perform the video connection. The indirect peer-to-peer mode selects one of the client devices (for example, the client device 20b) according to the network connection capability and the network connection quality of the client devices 20a, 20b, and 20c between the client devices 20a, 20b, and 20c. And the remaining unselected client devices (e.g., client devices 20a and 20c) are connected to the selected client device (e.g., client device 20b) to perform the video connection. These modes will be detailed in subsequent Figures 4A and 4B.

In addition, as shown in FIG. 2B, the video connection system 2' of the present invention may further include a multipoint control unit 23, and when the decision module 223 is based on the network connection capability and network of the client devices 20a, 20b, and 20c. When the connection mode determines that the connection mode common to the client devices 20a, 20b, 20c is the multi-point control mode (this mode will be detailed in the subsequent FIG. 4C), the multi-point control unit 23 can be used for the client device. 20a, 20b, 20c are connected to perform the video connection.

It should be understood that the client devices 20a, 20b, 20c can be any computing device, such as a computer, a notebook computer or a tablet computer. Network 25 can be any network, and can include, for example, a wireless network, a wired network, optical, ultrasonic, or a combination of the foregoing. The wireless network can be, for example, GPRS, Bluetooth, WiFi, WiMAX. The wired network may be, for example, an Ethernet, a digital subscriber line (DSL), or a fiber to the home (FTTH) or a combination of the foregoing.

As can be seen from the figures 2A and 2B, the video connection system (2 or 2') of the present invention does not provide the connection through the multipoint control unit 23 for the user equipment 20a, 20b, 20c to perform video connection, but through The authentication device 21 and the decision device 22 provide the client devices 20a, 20b, and 20c with the requirements of the video connection, and detect and analyze the network connection capability and the network connection quality of the client devices 20a, 20b, and 20c. The connection mode common to the client devices 20a, 20b, and 20c is determined, and it is determined whether or not the multipoint control unit 23 is used depending on the connection mode determined by the determined client devices 20a, 20b, and 20c. Therefore, the video connection system of the present invention can greatly reduce the hardware load and resource consumption of the multi-point control unit, and determine the connection mode with better network connection capability and network connection quality to provide better connection. Internet connection.

Please refer to FIG. 3, which is a basic flowchart of the video connection method of the present invention.

In step S31, a plurality of client devices request a video connection. For example, a plurality of client devices can log in and register a video connection request. In a specific implementation, a server can be set in the network for connecting a plurality of client devices. Then it proceeds to step S32.

In step S32, the network connection capability and the network connection quality of each of the client devices are detected and analyzed. In a specific implementation, a server (which may be the same or different server as step S31) may be set in the network to detect and analyze the network connection capability and network connection quality of each of the client devices. In detail, the complex includes detecting the network type of each of the client devices as a network type such as a regional network, a virtual private network, or an Internet. In addition, the recombining includes analyzing the network connection quality of each network type of the client device, and wherein the two or more identical network types belong to each of the client devices, analyzing the two or more identical The network connection quality of the network type to determine the type of network to be used preferentially. Furthermore, the complex includes detecting a firewall, a network address translation device, or a proxy device of each of the client devices. In addition, the complex includes analyzing the network bandwidth and the hardware load of the client device. Then it proceeds to step S33.

In step S33, determining a connection mode common to each of the client devices to perform the video connection according to the network connection capability and the network connection quality of each of the client devices, wherein the connection mode includes direct Point-to-point mode, indirect point-to-point mode, or multipoint control mode. Specifically, the direct peer-to-peer mode is that each of the client devices is connected to each other to perform the video connection; the indirect peer-to-peer mode is based on the network connection capability of the user equipment between the plurality of client devices. And the network connection quality selects one of the client devices, and the remaining unselected client devices are connected to the selected client device to perform the video connection; the multi-point control mode is each of the user terminals The devices are all connected to the multipoint control unit to perform the video connection.

Moreover, during the execution of the video connection, when there is a change in the plurality of client devices, for example, when adding or deleting a certain client device, steps S32 and S33 are performed again.

As can be seen from FIG. 3, the video connection method of the present invention can determine the connection mode common to each client device according to the network connection capability of each client device and the quality of the network connection, and thus it is not necessary to utilize the conventional The multi-point control unit is used to connect the various client devices, thereby improving the flexibility of the connection mode and reducing the hardware cost, load and network bandwidth of the multi-point control unit.

Referring to FIGS. 4A, 4B and 4C, respectively, the direct point-to-point mode, the indirect point-to-point mode, and the multi-point control unit mode of the video connection system of the present invention are respectively illustrated by way of example.

First embodiment

As shown in FIG. 4A, the client devices 44a and 44b respectively request the authentication device 41 for the video connection. The determining device 42 detects the network connection capability of the client devices 44a, 44b and detects that the network types of the client devices 44a and 44b are all the Internet 45, and the client device 44a has the HTTPS connection capability. The client device 44b has a connection capability of UDP, HTTP, and HTTPS. Since the client device 44a and the client device 44b have the HTTPS connection capability at the same time, the client devices 44a and 44b can perform video communication through HTTPS using the direct peer-to-peer mode.

Second embodiment

As shown in FIG. 4B, the client device 44c requests the authentication device 41 for the video connection. The decision device 42 detects the network connection capability of the client device 44c and detects that the connection type of the client device 44c is the Internet 45 and has the connection capability of UDP. In this embodiment, as described in the first embodiment, the client device 44a has the connection capability of HTTPS, and the client device 44b has the connection capability of UDP, HTTP, and HTTPS. Therefore, the client devices 44a and 44b have the connection capability of HTTPS at the same time, and the client devices 44b and 44c have the connection capability of UDP at the same time. However, the client devices 44a, 44b, and 44c do not have a common connection capability, and since the client device 44b has a connection capability with the client device 44a and the client device 44c, respectively, the client devices 44a, 44b The client device 44b is selected as the client multi-point control unit (client MCU), that is, the client devices 44a and 44c are both connected to the client device 44b to perform video connection in an indirect point-to-point mode.

In addition, when the client device 44c exits the video connection, the determining device 42 detects that there is a change in the user device, and re-detects the network connection capability and quality of the client device 44a, 44b, and then returns to the first The direct point-to-point mode described in the embodiments.

Third embodiment

As shown in FIG. 4C, the decision device 42 detects that the network types of the client devices 44d and 44e are all the Internet 45. The client devices 44d and 44e may perform the video connection in the direct peer-to-peer mode with the Internet 45 before the client device 44f has joined. After the client device 44f joins, the decision device 42 detects that the network type of the client device 44f is the virtual private network 46. Therefore, the client devices 44d, 44e, and 44f do not have the same connection capability. Thus, the client devices 44d, 44e, and 44f are all connected to the multipoint control unit 43, and the multipoint control unit 43 is responsible for transmitting video data and the like to cause the client devices 44d, 44e, and 44f to perform video communication.

In summary, the video connection system and method of the present invention can detect the network connection capability of the client device, such as network type, firewall, network address conversion device or proxy device detection, and analysis network. The quality of the connection, for example, the quality of the network connection of each network type or the network bandwidth and hardware load of each client device to determine the connection type of the priority connection (such as regional network, private virtual network) Road or internet), protocol (such as UDP, HTTP or HTTPS protocol), or push-selected as a multi-point control client device, which in turn determines the common connection mode of each client device, such as direct peer-to-peer mode, indirect peer-to-peer mode, and Multi-point control unit mode.

Therefore, the video connection system and method of the present invention can detect a plurality of client devices that require video connection to detect whether the client devices can utilize direct point-to-point and indirect point-to-point (that is, the foregoing user terminals are more The point control mode is connected to each other, and the user terminal devices are connected by a conventional multipoint control unit. In addition, when the client device is increased or decreased or changed, the network connection capability and quality of the client device are re-detected to re-determine the connection mode. Therefore, the video connection system and method of the present invention can reduce the waste of hardware resources and network bandwidth of the multi-point control unit, and can be applied to video conferences.

The above embodiments are merely illustrative of the principles and effects of the invention and are not intended to limit the invention. Modifications and variations of the above-described embodiments can be made by those skilled in the art without departing from the spirit and scope of the invention. Therefore, the scope of protection of the present invention should be as set forth in the scope of the claims described below.

1. . . Video conferencing system

11. . . Multipoint control unit

10a, 10b, 10c. . . Client device

2, 2’. . . Video connection system

20a, 20b, 20c. . . Client device

twenty one. . . Authentication device

twenty two. . . Decision device

221. . . Detection module

222. . . Analysis module

223. . . Decision module

twenty three. . . Multipoint control unit

25. . . network

41. . . Authentication device

42. . . Decision device

43. . . Multipoint control unit

44a, 44b, 44c, 44d, 44e, 44f. . . Client device

45. . . Internet

46. . . Virtual private network

S31~S33. . . step

Figure 1 is a basic architectural diagram of a conventional video conferencing system;

2A is a block diagram showing the basic structure of the video connection system of the present invention;

2B is a block diagram showing the basic structure of an embodiment of the video connection system of the present invention;

Figure 3 is a basic flow chart of the video connection method of the present invention;

4A is a schematic diagram of a first embodiment of a video connection system of the present invention;

4B is a schematic diagram of a second embodiment of the video connection system of the present invention;

4C is a schematic diagram of a third embodiment of the video connection system of the present invention.

2. . . Video connection system

twenty one. . . Authentication device

twenty two. . . Decision device

221. . . Detection module

222. . . Analysis module

223. . . Decision module

20a, 20b, 20c. . . Client device

25. . . network

Claims (20)

A video connection system includes: a plurality of client devices; an authentication device for connecting the plurality of client devices via a network to request a video connection; and a decision device comprising: The detection module is configured to detect the network connection capability of each of the client devices connected to the authentication device; the analysis module is configured to analyze each of the client devices connected to the authentication device The quality of the network connection; and the determining module is used to determine the common connection mode of each of the user devices according to the network connection capability and the network connection quality of the user equipment to perform the video connection. . The video connection system of claim 1, wherein the connection mode comprises a direct point-to-point mode, an indirect point-to-point mode or a multi-point control mode. For example, the video connection system described in claim 2 includes a multi-point control unit, and the multi-point control unit is used for each of the user equipments when the connection mode is the multi-point control mode. Line to execute the video connection. The video connection system of claim 2, wherein the direct peer-to-peer mode is that each of the client devices is connected to each other to perform the video connection; and the indirect peer-to-peer mode is the plurality of client devices. Selecting one of the client devices according to the network connection capability and the network connection quality of each of the client devices, and the remaining unselected client devices are connected to the selected client device to perform the Video connection. The video connection system of claim 1, wherein the detection module detects network connection capability of each of the client devices, including a network type, a firewall, and a network address conversion device. Detection of proxy devices. The video connection system of claim 5, wherein the network type comprises a regional network, a virtual private network or an internet. The video connection system of claim 6, wherein the analysis module analyzes the network connection quality of each of the network devices of the client device, and wherein, between the user devices When there are more than two identical network types, the analysis module analyzes and calculates the network connection quality of the two or more identical network types to determine the preferred network type. The video connection system of claim 5, wherein the detection module detects the firewall of each of the client devices, including user data protocol, hypertext transfer protocol, and hypertext transfer security. Detection of the connection capacity of the agreement. The video connection system of claim 5, wherein the detection module detects the type of the network address translation device of each of the client devices and enables the hold dialog mechanism. The video connection system of claim 5, wherein the detection module detects the usage status of the proxy device of each of the client devices and enables the hold dialog mechanism. The video connection system of claim 1, wherein the analysis module analyzes a network bandwidth and a hardware load of each of the client devices, wherein the determining module determines each of the user devices. Common connection mode. The video connection system of claim 1, wherein the analysis module re-analyzes the network connection capability and the network connection of each of the user devices when the plurality of client devices are changed. The quality of the line is used for the decision module to re-determine the connection mode common to each of the client devices. A video connection method includes the following steps: (1) a plurality of client devices requesting a video connection; and (2) detecting and analyzing a network connection of each of the client devices that request a video connection. The capability and the quality of the network connection; and (3) determining the common connection mode of each of the client devices to perform the video connection according to the network connection capability of each of the client devices and the quality of the network connection. The video connection method of claim 13, wherein during the execution of the video connection, when the plurality of client devices are changed, the steps (2) and (3) are performed again. The video connection method of claim 13 or 14, wherein the connection mode comprises a direct point-to-point mode, an indirect point-to-point mode or a multi-point control mode. The video connection method of claim 15, wherein the direct peer-to-peer mode is that each of the client devices is connected to each other to perform the video connection; the indirect peer-to-peer mode is for the plurality of client devices One of the client devices is selected according to the network connection capability and the network connection quality of each of the client devices, and the remaining unselected client devices are connected to the selected client device to perform the video. The multi-point control mode is that each of the client devices is connected to the multipoint control unit to perform the video connection. The video connection method of claim 13 or 14, wherein in step (2), detecting, detecting, determining, by the network type of each of the client devices, a local area network, a virtual private network, or an internet network. The video connection method of claim 17, wherein in step (2), the network connection quality of each network type of the client device is analyzed, and wherein each user is When two or more identical network types exist between the end devices, analyze the network connection quality of the two or more identical network types to determine the preferred network type. The video connection method of claim 13 or 14, wherein in step (2), the firewall, the network address translation device, or the proxy device of each of the client devices is detected. The video connection method of claim 13 or 14, wherein in step (2), the network bandwidth and the hardware load of the client device are analyzed.