CN112653661B

CN112653661B - Media recovery method and system under VoIP network limitation

Info

Publication number: CN112653661B
Application number: CN202010932067.4A
Authority: CN
Inventors: 林炎章; 陈凤琴
Original assignee: Xiamen Yealink Network Technology Co Ltd
Current assignee: Xiamen Yealink Network Technology Co Ltd
Priority date: 2020-09-08
Filing date: 2020-09-08
Publication date: 2023-04-07
Anticipated expiration: 2040-09-08
Also published as: CN112653661A

Abstract

The invention discloses a media recovery method and a media recovery system under the limitation of a VoIP (voice over Internet protocol) network, and belongs to the technical field of video conferences. Aiming at the problems that the private network and the public network are limited in the prior art, and the use is influenced because the network change can generate limited service due to port switching. The invention avoids the limited port or IP, and ensures normal interaction between conversation and media through the limitation of the router and the firewall. According to the invention, the cluster module is used for constructing the terminal equipment cluster, and through mutual interaction of the terminal equipment in the terminal equipment cluster, the unrestricted network is found in the environment with local limitation of the network, the public network server is registered for use, and the network deployment is not required to be changed in use, so that the stability of the call can be ensured, and the optimal VoIP call experience can be achieved.

Description

Media recovery method and system under VoIP network limitation

Technical Field

The present invention relates to the field of video conferencing technologies, and in particular, to a media recovery method and system under the limitation of a VoIP network.

Background

From the mode of the conference, the traditional conference is more complicated to hold, and has the mode of poorer communication ratio and lower efficiency, while the teleconference can stride over the limitation in space and the obstacle in time, and can adopt a more flexible mode to hold the conference, record the website content of the conference, and ensure the high efficiency, accuracy and completeness of the conference. Compared with the traditional point-to-point telephone service, the teleconference breaks through the limit that the conversation can only be limited to two parties from the aspect of function, and has the characteristics of smoother communication, more real information, wider range and the like, which cannot be realized by the telephone. The teleconference system has a recording function, and accuracy and integrity of a conference are guaranteed. And more convenient communication is provided, communication can be carried out with multiple people by only one telephone, and the fact that a master can control the whole situation is ensured.

The basic principle of VoIP is to compress the voice data by the voice compression algorithm, then pack the voice data, send the data packet to the receiving place through IP network, then string the voice data packets, and recover the original voice signal after decompression processing, thereby achieving the purpose of transmitting voice through Internet. VoIP can be used for a plurality of Internet access devices including VoIP phones, smart phones and personal computers, and calls and short messages are sent through cellular networks and Wi-Fi. The VoIP network conference can effectively reduce the cost and save the time.

Routers and firewalls between a private network and a public network in the existing network set security restrictions, such as port restrictions or IP address restrictions, and operations such as periodically switching an outlet may cause network changes and restrict VoIP services. Therefore, how to query the available outlets in a limited network is beneficial to fully utilize the current network environment without changing the network deployment in use.

Disclosure of Invention

1. Technical problem to be solved

Aiming at the problems that the private network and the public network are limited in the prior art, and the use is influenced because the network change can generate limited service due to port switching, the invention provides the media recovery method and the media recovery system under the VoIP network limitation.

2. Technical scheme

The purpose of the invention is realized by the following technical scheme.

Between private and public networks, routers and firewalls often set port restrictions, data restrictions, IP restriction rules, causing media disruption in private network devices when restriction rules take effect. And port limitation and IP limitation, wherein the two conditions are network environment aiming at limitation, the limitation port and IP are avoided, and the media can be recovered to be normal. The two solutions ensure normal interaction between conversation and media by renegotiating other port numbers and packaging VCS clusters into other IPs and by the limitation of a router and a firewall.

A media recovery method under VoIP network limitation, when the terminal device causes media interruption due to network environment limitation, the media can recover the conversation by avoiding the limitation port or IP address.

Further, when the port a has data restriction causing media interruption, the terminal device a sends a re-call signaling through the port b, establishes a new media channel through the port b, and resumes the call.

Further, the terminal device monitors the sending and receiving conditions of the RTP data of the terminal device through an RTP monitoring module, and the RTP monitoring module initiates a re-calling signaling if the RTP monitoring module cannot monitor the receiving data of the terminal device within a fixed time.

When the router port is limited, media service intercommunication is guaranteed, namely the router or a firewall outlet has data limitation on the port, and the terminal equipment sends a signaling to obtain a new port again to ensure normal continuation of the conversation.

The signaling interaction of the terminal equipment during port restriction is as follows:

step 11, the terminal device A initiates a registration signaling to register to the server through the router;

and step 12, the terminal device A initiates a call signaling to carry port a information to be sent to the terminal device X through the router and the server, the terminal device X responds to the call and replies the IP address of the terminal device X, the call flow is completed until the terminal device X receives the confirmation signaling, and the terminal device A directly carries out RTP protocol transmission with the terminal device X.

Step 13, establishing a call between the terminal device A and the terminal device X;

step 14, the terminal device a performs RTP detection through an RTP monitoring module, if receiving RTP data from the terminal device X, the terminal device a directly interacts with media of the terminal device X, otherwise, the terminal device a initiates a re-call signaling;

step 15, the terminal device a initiates a re-calling signaling, the terminal device a changes the port in the calling signaling into a port b, and sends the port b to the terminal device X through the router until the re-calling signaling of the terminal device a reaches the terminal device X and the terminal device a receives the confirmation signaling again, and the re-calling is completed at this moment;

step 16, terminal a sends RTP to terminal X, using the new media channel established by the new call. The effect of reusing the available port to ensure the conversation is achieved.

Further, when the terminal device a does not receive a response due to the fact that the IP address IP1 is limited by the network, the terminal device integrates the terminal devices in the network into a cluster through a cluster module in the terminal device, the terminal device a is connected with a terminal device B in the terminal device cluster, and the terminal device a establishes a new media channel through the IP address IP2 of the terminal device B to recover the call.

Further, the terminal device cluster is successfully constructed, and the media control module controls data to be sent through the terminal device cluster.

Further, the terminal device monitors data sent by the terminal device cluster through the RTP monitoring module, and the media forwarding module controls forwarding of the corresponding data.

When the router IP is limited, the intercommunication of media services is ensured, namely, under the condition that the IP1 is limited by the network and can not be intercommunicated with other networks, the conversation experience is ensured by the forwarding of the IP 2.

The signaling interaction of the terminal equipment during the IP limitation is as follows:

step 21, the terminal device a pushes the account registration information to the private network outlet to the public network server, and the terminal device a does not receive a response due to IP restriction.

Step 22, connecting the terminal device A to the terminal device B, and constructing a terminal device cluster: the terminal device A is connected to the terminal device B;

and step 23, the terminal device A sends the account registration information to the terminal device B. The terminal device B will forward the account registration information of the terminal device a to the public network server. The terminal device A tries to send account registration information to all other terminal devices of the terminal device cluster one by one until a confirmation signaling is received;

step 24, the terminal device a carries IP1 to send a call signaling to the terminal device B, after receiving the call signaling of IP1, the terminal device B carries IP2 to send a call signaling to the terminal device X, the terminal device X responds to the call and replies its IP address, until the terminal device X receives the confirmation signaling, the call flow is completed, and the terminal device B directly interacts with the media of the terminal device X;

step 25, the terminal device A carries IP1 to send RTP to the terminal device B, after receiving the RTP of IP1, the terminal device B forwards the RTP to the terminal device X with IP2, establishes a call with the terminal device X, and forwards media of the terminal device A and the terminal device X through a third-party server;

the third party server transfers the RTP to the terminal device X, namely the terminal device A sends the RTP to the terminal device X, a new media channel established by the terminal device cluster is used, and the effect of using the available IP to guarantee the conversation is achieved.

The media recovery method of the invention mainly aims at the media interruption generated by the limitation of the network environment, avoids the limited port or IP, recovers the media call and ensures the stability of the media call.

The media recovery system under the VoIP network limitation comprises a plurality of terminal devices, a switch, a router and a server, wherein the terminal devices are connected to the server through the switch and the router.

Further, the terminal device includes an RTP monitoring module, the RTP monitoring module monitors the RTP data sending and receiving conditions of the terminal device, and the RTP monitoring module initiates a call again if the RTP monitoring module cannot monitor that the terminal device receives the data within a fixed time.

Furthermore, the terminal equipment also comprises a cluster module, a media control module and a media forwarding module, wherein the cluster module, the media control module and the media forwarding module are connected in pairs; when the IP is limited, the cluster module integrates terminal equipment in the network into a cluster, the terminal equipment in the terminal equipment cluster performs joint communication, the media control module controls whether media is sent by the terminal equipment cluster, and the media forwarding module controls whether received media data is forwarded.

Further, the RTP monitoring module is further connected to the cluster module, when the terminal device cluster is successfully constructed, the terminal device monitors through the RTP monitoring module, and if the RTP monitoring module monitors that the terminal device cluster sends data, the media forwarding module controls forwarding of the corresponding data.

The media recovery system constructs the terminal equipment cluster through the cluster module, and the terminal equipment cluster can normally use the external network only by one terminal equipment of the terminal equipment cluster successfully interacting with the external network without all terminal equipment having high-level network authority to access the external network. The terminal equipment cluster of the invention searches for an interactive method using an available network under a limited network system, and fully realizes media service communication.

3. Advantageous effects

Compared with the prior art, the invention has the advantages that:

the system equipment of the invention divides the conversation limitation into two situations: the first is that the terminal device selects an IP address restriction solution under the condition of no response of signaling interaction, performs cluster integration of the terminal device, and forwards signaling and media data through the cluster of the terminal device. The second is a strategy that the terminal device selects a port restriction solution under the condition of network data restriction and automatically performs call re-switching under the condition of not receiving RTP.

The RTP monitoring module, the cluster module, the media control module and the media forwarding module in the terminal equipment are mutually interacted, the terminal equipment enables different terminal equipment to establish a cluster relation through the cluster module, and after the cluster module establishes a terminal equipment cluster, the cluster module informs the RTP monitoring module to be responsible for monitoring data. The RTP monitoring module monitors media data sent by the terminal device cluster, and notifies the media control module and the media forwarding module to forward the corresponding media data to a destination, such as a VCS cluster device or a media server.

Drawings

FIG. 1 is a schematic diagram of a system for reacquiring a new port when a VoIP network port is restricted according to the present invention;

FIG. 2 is a schematic diagram of a system for ensuring media service interworking during VoIP network router restriction according to the present invention;

FIG. 3 is an interaction diagram illustrating that a new port signaling is reacquired when a VoIP network port is restricted according to the present invention;

FIG. 4 is a schematic diagram of signaling interaction for ensuring media service interworking when limited by a VoIP network router according to the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some embodiments of the present invention, but not all embodiments; moreover, the embodiments are not independent, and can be combined with each other according to requirements, so that a better effect is achieved. Thus, the following detailed description of the embodiments of the present invention, as presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be obtained by a person skilled in the art without inventive step based on the embodiments of the present invention, are within the scope of protection of the present invention.

The invention is described in detail below with reference to the drawings and specific examples.

Some of the terms that may appear in the description of the embodiments are explained first:

and (2) the VCS: a video conference telephone apparatus having a VoIP service.

The VCS cluster is as follows: all devices with VoIP service, that is, all VCSs perform service association by network technology, and perform communication with each other, and the cluster after association is a VCS cluster. VCS clusters are IP restriction rules that jointly integrate VCS clusters via servers, and then internally interact to replace source IP, either through routers or firewalls.

RTP: real-time transport protocol, media protocol for VoIP call.

RTP P2P: the media is point-to-point, namely the media of the two terminals are directly interacted, the real-time performance is high, and risks such as time delay and the like do not exist.

RTP Relay: media forwarding, that is, media of two terminals are forwarded through a third-party server, and because of the forwarding, there are risks such as media jitter, delay or packet loss.

Example 1

Between private and public networks, routers and firewalls often set various restriction rules, such as port restrictions, data restrictions, IP restrictions. The setting of the restriction rule results in a media disruption when the private network device appears when the restriction rule is in effect. In the foregoing restriction rule, both the port restriction and the IP restriction are the network environment-specific restrictions, and if the restricted ports and the IP are avoided, the media can be recovered to normal.

This embodiment specifically describes a method for ensuring media service interworking and reacquiring a new port when a VoIP network port is limited. That is, when the router or firewall outlet has data limitation on the port, the VCS device uses the invite instruction to reacquire a new port to ensure normal continuation of the call.

The network system shown in fig. 1 has five VCS device terminals, which are shown as solid line portions in the figure, and are a device VCS1, a device VCS2, a device VCS3, a device VCS4, and a device VCS5, respectively. The equipment VCS1, the equipment VCS2 and the equipment VCS3 are connected with the router 1 through the switch 1 and connected to the server through the firewall; the equipment VCS4 and the equipment VCS5 are connected to the router 2 through the switch 2 and are connected to the server, and the router 2 can pass through a firewall or does not pass through the firewall when being connected to the server, so that no influence is caused on the embodiment, and only the network to which the router 1 belongs is considered in the embodiment.

The equipment VCS comprises a cluster module, an RTP monitoring module, a media control module and a media forwarding module, wherein the cluster module is connected with the RTP monitoring module, and the RTP monitoring module is also connected with the media control module and the media forwarding module. The cluster module establishes the VCS equipment as a VCS cluster, integrates the VCS equipment in the network into a cluster when the IP is limited, and performs combined communication in the VCS cluster. The RTP monitoring module can continuously monitor the sending and receiving conditions of RTP data, and 5s no data receiving can initiate REINVITE, the response time of the RTP monitoring module is set to 5s in the embodiment, which is mainly used for preventing frequent network recovery triggered by network packet loss and the like and preventing long-time screen blacking caused by network limitation, and the RTP monitoring module is determined as 5s no data triggering according to a limited test result. The media control module controls whether the media transmission purpose passes through the VCS cluster, and after the VCS cluster is successfully established, the media control module controls the data to be transmitted through the VCS cluster; if the construction of the VCS cluster fails, the media control does not pass through the VCS cluster. The media forwarding module controls whether the received media data needs to be forwarded, and when the RTP detection module detects the data sent by the VCS cluster, the media forwarding module controls the forwarded data to be forwarded to a destination.

When the port of the router 1 is limited and normal conversation is affected, the equipment VCS1 equipment sends a REINVITE instruction to obtain a new port again, and normal conversation is ensured to continue. At this time, the signaling interaction flow is shown in fig. 3, and includes the following steps:

step 11: the terminal initiates an instruction to re-register;

the device VCS1 initiates REG signaling to re-register to the SERVER through the router 1. When the equipment VCS1 successfully re-registers in the SERVER through the router 1, the SERVER returns an acknowledgement signaling to the router 1, and the router 1 returns an acknowledgement signaling to the equipment VCS1 again to confirm that the re-registration is successful.

Step 12: the terminal initiates a signaling recall;

as shown by the dotted line in fig. 1, the device VCS1 initiates an INVITE signaling carrying IP1: port1 passes through routers and servers. The SERVER sends the signaling to the equipment VCS4, the equipment VCS4 responds to the call and replies the IP address of the equipment VCS4, namely, the IP4, and the information replied by the equipment VCS4 is returned to the router 1 through the SERVER and then returned to the equipment VCS1. Then, the equipment VCS1 sends an ACK signaling to the SERVER through the router 1, the SERVER sends the ACK signaling to the equipment VCS4, until the equipment VCS4 receives the ACK signaling, the call flow is completed, and the equipment VCS1 directly performs RTP protocol transmission with the equipment VCS 4.

Step 13: the terminal establishes a call;

the device VCS1 and the device VCS4 establish a call, which is based on the IP address IP4 of the device VCS 4.

Step 14: the terminal maintains the call;

the equipment VCS1 uses the RTP monitoring module to perform RTP detection, and if the RTP monitoring module of the equipment VCS1 receives RTP data from the equipment VCS4, the equipment VCS1 continues to perform RTP P2P with the equipment VCS4, that is, media of two terminals are directly interacted, and a call between the equipment VCS1 and the equipment VCS4 is maintained. If the RTP monitoring module of the device VCS1 does not receive the RTP from the device VCS4, the device VCS1 initiates a REINVITE signaling, and reacquires a new media channel through a new port, thereby ensuring normal continuation of the call.

Step 15: the terminal initiates a signaling call again;

if the port is limited and the call is limited, the device VCS1 initiates a REINVITE signaling. In the REINVITE signaling, the device VCS1 changes port1 of the INVITE signaling into port2, and sends the port2 to the device VCS4 through the router 1 and the SERVER until the REINVITE request of the device VCS1 reaches the device VCS4, the message replied by the device VCS4 returns to the router 1 through the SERVER, and the equipment VCS1 receives the 200OK response again, then the equipment VCS1 sends an ACK signaling to the SERVER through the router 1, and the SERVER sends the ACK signaling to the equipment VCS4 until the equipment VCS4 receives the ACK confirmation signaling, and at this time, the re-INVITE is called and completed again.

Step 16: the terminal establishes a new call;

the device VCS1 sends RTP to the device VCS4 using the new media channel established by the invite. The effect of reusing the available port to guarantee the conversation is achieved.

In this embodiment, the RTP detection module continuously detects the RTP data sending and receiving condition, and when no data is received, the terminal initiates a REINVITE signaling to reestablish the communication channel, and under the condition of port restriction, the terminal is switched to call again, a new media channel is reestablished, and normal media interaction is ensured.

Example 2

This embodiment describes a method for ensuring media service interworking signaling when the router is limited. When the router IP is limited, the media service intercommunication is ensured, namely, under the condition that the IP1 of the router 1 is limited by the network and can not be intercommunicated with other networks, the conversation experience is ensured through IP2 forwarding.

As in embodiment 1, the system shown in fig. 2 also has five VCS device terminals, i.e., a device VCS1 to a device VCS5, and as shown by the solid line part in the figure, the device VCS1, the device VCS2, and the device VCS3 are connected to the router 1 through the switch 1, and further connected to the server through the firewall; the device VCS4 and the device VCS5 are connected to the router 2 via the switch 2 and further to the server. Similarly, when the router 2 is connected to the server, it may or may not pass through the firewall, and there is no influence on this embodiment, and this embodiment only considers the network to which the router 1 belongs.

When the address IP1 of the router 1 is limited and normal conversation among the devices is influenced, the system ensures the conversation by forwarding the IP 2. At this time, the signaling interaction flow is shown in fig. 4, and includes the following steps:

step 21: the terminal initiates an instruction to re-register;

the equipment VCS1 pushes account registration information to a private network outlet to a public network SERVER, and specifically, a signaling REG is sent to the SERVER through the router 1, and the equipment VCS1 does not receive the corresponding signaling REG due to the limitation of the IP1 of the router 1 at this time.

Step 22: establishing connection between terminals;

the equipment VCS1 is connected to the equipment VCS2 through a method for constructing a VCS network cluster system, and the equipment VCS1 and the equipment VCS2 which form the VCS cluster carry out information interaction. The equipment VCS1 and the equipment VCS2 construct a VCS cluster through private signaling.

Step 23: the third-party server forwards the terminal information;

here, the third-party server refers to other VCS devices of the VCS cluster, and in this embodiment, the device VCS2 is the third-party server. The equipment VCS1 sends account registration information REG to the equipment VCS2, the equipment VCS2 forwards the account registration information REG of the equipment VCS1, and the account registration information REG is sent to a public network SERVER SERVER through the router 1;

when the VCS cluster in which the system is located has multiple devices, the device VCS1 tries to send account registration information REG to all other devices of the VCS cluster one by one, the registration information REG forwarded by the third party SERVER is sent to the SERVER via the router 1 until a 200OK response of the SERVER is received.

And step 24: the terminal initiates a signaling re-call;

the equipment VCS1 carries the IP1 to send an INVITE message to the equipment VCS2, after the equipment VCS2 receives the INVITE message of the address IP1, the equipment VCS4 carries the address IP2 to send the INVITE message to the equipment VCS4, the equipment VCS4 responds to the conversation and replies the IP address of the equipment VCS4, namely the IP4 address, information replied by the equipment VCS4 is returned to the router 1 through the SERVER SERVER, and then returned to the equipment VCS1 through the equipment VCS 2. Then, the equipment VCS1 sends an ACK signaling to the SERVER via the equipment VCS2 and the router 1, until the equipment VCS4 receives the ACK response, the call flow is completed, and the equipment VCS2 directly performs RTP P2P protocol transmission with the equipment VCS 4.

Step 25: the terminal establishes a call;

the device VCS1 carries the IP1 to send the RTP to the device VCS2, after receiving the RTP of the IP1, the device VCS2 carries the IP2 and forwards the RTP to the device VCS4, a call is established with the device VCS4, and the device VCS1 continues to perform RTP Relay with the device VCS 4. At this time, media interaction between the equipment VCS1 and the equipment VCS4 is transferred through the equipment VCS2, and due to the transfer of the third-party server, there are risks such as media jitter, delay or packet loss.

The equipment VCS1 sends the RTP to the equipment VCS4, and a new media channel established by the VCS cluster is used, so that the effect of using the available IP to guarantee the conversation is achieved. In this embodiment, media service communication is realized through establishment of the VCS cluster, and all devices in the VCS cluster can perform media interaction normally by connecting with VCS devices under other routers in the VCS cluster, thereby ensuring stable interaction of media services under the condition of IP limitation.

The invention and its embodiments have been described above schematically, without limitation, and the invention can be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The embodiment shown in the drawings is only one of the embodiments of the invention, the actual structure is not limited to the embodiment, and any reference signs in the claims shall not limit the claims. Therefore, if a person skilled in the art receives the teachings of the present invention, without inventive design, a similar structure and an embodiment to the above technical solution should be covered by the protection scope of the present patent. Furthermore, the word "comprising" does not exclude other elements or steps, and the word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. Several elements recited in the product claims may also be implemented by one element in software or hardware. The terms first, second, etc. are used to denote names, but not to denote any particular order.

Claims

1. A media recovery method under VoIP network limitation is characterized in that when media interruption is caused by network environment limitation, a terminal device avoids a limitation port or an IP address, and the media recovers conversation;

when the port a has data limitation to cause media interruption, the terminal device sends a re-calling signaling through the port b, establishes a new media channel through the port b, and resumes the call;

when the terminal device A does not receive a response because the IP address IP1 is limited by the network, the terminal device integrates the terminal devices in the network into a cluster through a cluster module in the terminal device, the terminal device A is connected with a terminal device B in the terminal device cluster, and the terminal device A establishes a new media channel through the IP address IP2 of the terminal device B to recover the conversation.

2. The method as claimed in claim 1, wherein the terminal device monitors the RTP data transmission and reception condition of the terminal device through an RTP monitoring module, and the RTP monitoring module initiates a re-call signaling if the RTP monitoring module does not monitor the data received by the terminal device within a fixed time.

3. The method of claim 1, wherein the terminal device cluster is successfully constructed, and the media control module controls data transmission through the terminal device cluster.

4. The method as claimed in claim 3, wherein the terminal device monitors the data from the terminal device cluster through an RTP monitoring module, and the media forwarding module controls forwarding of the corresponding data.

5. A system for media recovery under VoIP network restrictions, characterized in that a method for media recovery under VoIP network restrictions according to any of claims 1-4 is used, said system comprising a number of terminal devices, switches, routers, and servers, the terminal devices being connected to the servers through the switches and routers.

6. The system for media recovery under the limitation of VoIP network according to claim 5, wherein the terminal device includes an RTP monitoring module, the RTP monitoring module monitors the RTP data transmission and reception condition of the terminal device, and the RTP monitoring module initiates the re-call if it cannot monitor the data received by the terminal device within a fixed time.

7. The system for media recovery under the limitation of the VoIP network according to claim 6, wherein the terminal device further comprises a cluster module, a media control module and a media forwarding module, and the cluster module, the media control module and the media forwarding module are connected in pairs; when the IP is limited, the cluster module integrates terminal equipment in the network into a cluster, the terminal equipment in the terminal equipment cluster performs joint communication, the media control module controls whether media is sent by the terminal equipment cluster, and the media forwarding module controls whether received media data is forwarded.

8. The system of claim 7, wherein the RTP monitoring module is further connected to the cluster module, and when the cluster of the terminal device is successfully constructed, the terminal device is monitored by the RTP monitoring module, and if the RTP monitoring module monitors data sent from the cluster of the terminal device, the media forwarding module controls forwarding of the corresponding data.