CN116319698A

CN116319698A - Terminal connection method, electronic device and storage medium

Info

Publication number: CN116319698A
Application number: CN202211094390.4A
Authority: CN
Inventors: 刘顶
Original assignee: Hangzhou Huacheng Software Technology Co Ltd
Current assignee: Hangzhou Huacheng Software Technology Co Ltd
Priority date: 2022-09-07
Filing date: 2022-09-07
Publication date: 2023-06-23

Abstract

The invention discloses a terminal connection method, electronic equipment and a storage medium, wherein the terminal connection method comprises the following steps: the user terminal generates a connection request containing the identification information of the target equipment terminal and sends the connection request to the server so that the server judges whether the target equipment terminal is registered in the server or not based on the identification information of the target equipment terminal; responding to the registration of a target equipment terminal in a server, and establishing forwarding service communication connection between a user terminal and the target equipment terminal through the server; the user terminal requests local area network communication connection or network penetration communication detection to the target equipment terminal; and switching the forwarding service communication connection between the user terminal and the target equipment terminal to a successful local area network connection or network penetration communication connection in response to the local area network connection success or network penetration communication detection success. Through the mode, the invention can ensure the connection speed and save the cost of the server and the network flow.

Description

Terminal connection method, electronic device and storage medium

Technical Field

The present invention relates to the field of terminal connection, and in particular, to a terminal connection method, an electronic device, and a storage medium.

Background

The media stream refers to a multimedia application in which video, sound and other data are carried by a real-time transmission protocol and are transmitted from a source end to a destination end in a continuous stream form, and the destination end can play the data after receiving certain cached data.

When implementing media stream transmission, a network penetration auxiliary server is generally set up on a public network to provide network penetration auxiliary service for a source terminal and a destination terminal of each media stream transmission, and after successful penetration, the source terminal can directly send media streams to the destination terminal source.

However, the success rate of network penetration by the method is not reliable, and the penetration takes a lot of time, so that when the source terminal is connected with the destination terminal source, the source terminal waits for a long time, and the experience is relatively poor.

Disclosure of Invention

The invention provides a terminal connection method, electronic equipment and a storage medium, which are used for solving the problem of slower connection between terminals.

In order to solve the above technical problems, the present invention provides a method for connecting terminals, including: the user terminal generates a connection request containing the identification information of the target equipment terminal and sends the connection request to the server so that the server judges whether the target equipment terminal is registered in the server or not based on the identification information of the target equipment terminal; responding to the registration of a target equipment terminal in a server, and establishing forwarding service communication connection between a user terminal and the target equipment terminal through the server; the user terminal requests local area network communication connection or network penetration communication detection to the target equipment terminal; and switching the forwarding service communication connection between the user terminal and the target equipment terminal to a successful local area network connection or network penetration communication connection in response to the local area network connection success or network penetration communication detection success.

The user terminal generates a connection request including identification information of the target device terminal, and sends the connection request to the server, so that the server judges whether the target device terminal is registered in the server based on the identification information of the target device terminal, and the method comprises the following steps: the logic processing module of the user terminal generates a connection request containing the identification information of the target equipment terminal and sends the connection request to the transmission module of the user terminal; the transmission module of the user terminal transmits a connection request to the server so that the server judges whether the target equipment terminal is registered in the server based on the identification information of the target equipment terminal.

Wherein, in response to registering the target device terminal in the server, the user terminal establishes a forwarding service communication connection with the target device terminal through the server, comprising: responding to the target equipment terminal registered in the server, and receiving forwarding service resources sent by the server by the user terminal; the user terminal establishes a forwarding service communication connection with the target device terminal based on the forwarding service resource.

The user terminal establishes forwarding service communication connection with the target equipment terminal based on the forwarding service resource, and the method comprises the following steps: the user terminal sends a first connection packet to the target equipment terminal based on the forwarding service resource, and receives a second connection packet sent by the target equipment terminal based on the forwarding service resource so as to establish forwarding service communication connection.

Wherein the user terminal requests the target device terminal for local area network communication connection or network penetration communication detection, comprising: the user terminal multicasts the local area network where the user terminal is located based on the identification information of the target equipment terminal, and the responding target equipment terminal is located in the local area network and is connected with the target equipment terminal in the local area network based on the identification information of the target equipment terminal; in response to the target device terminal not being located within the local area network, the user terminal requests network penetration communication probes from the target device terminal.

Wherein the user terminal requests network penetration communication probe from the target device terminal, comprising: the user terminal requests the network penetrating equipment address of the target equipment terminal from the server and receives the network penetrating equipment address of the target equipment terminal; and the user terminal performs multiple network penetration communication detection on the network penetration equipment of the target equipment terminal based on the network penetration equipment address of the target equipment terminal until the network penetration communication detection is successful.

The terminal connection method further comprises the following steps: after the user terminal and the target equipment terminal are successfully connected, the protocol stack module of the user terminal establishes target protocol communication with the protocol stack module of the target equipment terminal by utilizing a connection relation so as to send and/or receive transmission information to the target equipment terminal by utilizing a target protocol; the connection relationship includes one or more of a forwarding service communication connection relationship, a local area network connection relationship, and a network penetration communication relationship.

In order to solve the technical problem, the invention also provides a method for connecting terminals, which comprises the following steps: the target equipment terminal registers the identification information of the target equipment terminal to the server; responding to a connection request which is generated by a server and contains identification information of a target equipment terminal at a receiving user terminal, and establishing forwarding service communication connection between the target equipment terminal and the user terminal through the server; the target equipment terminal requests local area network connection or network penetration communication detection to the user terminal; and switching the forwarding service communication connection between the user terminal and the target equipment terminal to a successful local area network connection or network penetration communication connection in response to the local area network connection success or network penetration communication detection success.

The target device terminal registers the identification information of the target device terminal to the server, and the method comprises the following steps: the logic processing module of the target equipment terminal generates registration information containing identification information of the target equipment terminal and sends the registration information to the transmission module of the target equipment terminal; and the transmission module of the target equipment terminal sends the registration information to the server for registration.

Wherein, in response to the server receiving a connection request containing identification information of a target device terminal generated by a user terminal, the target device terminal establishes a forwarding service communication connection with the user terminal through the server, including: and responding to the connection request which is generated by the user terminal and contains the identification information of the target equipment terminal by the server, receiving the forwarding service resource sent by the server by the target equipment terminal, and establishing forwarding service communication connection with the user terminal based on the forwarding service resource.

Wherein, based on the forwarding service resource, establishing forwarding service communication connection with the user terminal, comprising: the target equipment terminal sends a second connection packet to the user terminal based on the forwarding service resource, and receives the first connection packet sent by the user terminal based on the forwarding service resource so as to establish forwarding service communication connection.

After the user terminal and the target equipment terminal are successfully connected, the protocol stack module of the target equipment terminal establishes target protocol communication with the protocol stack module of the user terminal by utilizing a connection relation so as to send and/or receive transmission information to the user terminal by utilizing the target protocol; the connection relationship includes one or more of a forwarding service communication connection relationship, a local area network connection relationship, and a network penetration communication relationship.

In order to solve the technical problem, the invention also provides a method for connecting terminals, which comprises the following steps: the server receives the identification information of at least one equipment terminal to register; the method comprises the steps that a server receives a connection request which is sent by a user terminal and contains identification information of a target equipment terminal, and judges whether the target equipment terminal is registered in the server or not based on the identification information of the target equipment terminal; establishing forwarding service communication connection between the user terminal and the target equipment terminal in response to the registration of the target equipment terminal in the server; and switching the forwarding service communication connection between the user terminal and the target equipment terminal to a successful local area network connection or network penetration communication connection in response to the successful local area network connection or network penetration communication detection between the user terminal and the target equipment terminal.

Wherein establishing a forwarding service communication connection between the user terminal and the target device terminal in response to registering the target device terminal in the server, comprises: and in response to the registration of the target equipment terminal in the server, the server generates forwarding service resources and respectively transmits the forwarding service resources to the user terminal and the target equipment terminal so that the user terminal and the target equipment terminal establish forwarding service communication connection based on the forwarding service resources.

The server receives a connection request including identification information of a target device terminal sent by a user terminal, and judges whether the target device terminal is registered therein based on the identification information of the target device terminal, and the method includes: the signaling server of the server receives a connection request which is sent by the user terminal and contains the identification information of the target equipment terminal, and the signaling server judges whether the target equipment terminal is registered or not based on the identification information of the target equipment terminal; generating a forwarding service resource in response to registering a target device terminal in a server, and respectively transmitting the forwarding service resource to a user terminal and the target device terminal, so that the user terminal and the target device terminal establish forwarding service communication connection based on the forwarding service resource, including: responding to the signaling server registered with the target equipment terminal, and the signaling server transmits an allocation instruction to a forwarding server of the server; and the forwarding server generates forwarding service resources after receiving the allocation instruction, and respectively transmits the forwarding service resources to the user terminal and the target equipment terminal so as to enable the user terminal and the target equipment terminal to establish forwarding service communication connection based on the forwarding service resources.

In order to solve the technical problem, the present invention further provides an electronic device, including: the memory and the processor are coupled to each other, and the processor is configured to execute program instructions stored in the memory to implement the method for connecting terminals according to any one of the above.

To solve the above technical problem, the present invention also provides a computer-readable storage medium storing program data that can be executed to implement a method of terminal connection as any one of the above.

The beneficial effects of the invention are as follows: in the invention, the user terminal requests the server to connect with the target equipment terminal, when the target equipment terminal is registered in the server, the user terminal establishes forwarding service communication connection with the target equipment terminal through the server; and the user terminal also requests the local area network communication connection or network penetration communication detection to the target equipment terminal; in response to successful local area network connection or successful network penetration communication detection, the forwarding service communication connection between the user terminal and the target equipment terminal is switched to successful local area network connection or network penetration communication connection, so that quick establishment of the communication connection can be guaranteed through forwarding service communication, waiting time is reduced, the user terminal also requests the local area network communication connection or network penetration communication detection to the target equipment terminal, when the local area network connection or network penetration communication detection is successful, the service communication connection is switched to successful local area network connection or network penetration communication connection, and therefore after the local area network connection or network penetration communication connection, the use of a server is avoided, the cost of the server and the cost of the network flow are saved, and the connection speed can be guaranteed while the cost of the server and the cost of the network flow can be saved.

Drawings

Fig. 1 is a schematic flow chart of a first embodiment of a method for terminal connection provided by the present invention;

fig. 2 is a schematic flow chart of a second embodiment of a method for terminal connection provided by the present invention;

fig. 3 is a schematic flow chart of a third embodiment of a method for terminal connection provided by the present invention;

fig. 4 is a flowchart of a fourth embodiment of a method for terminal connection provided by the present invention;

FIG. 5 is a schematic diagram of a configuration of one implementation of the terminal connection system of the example of FIG. 4;

fig. 6 is a schematic flow chart of a fifth embodiment of a method for terminal connection provided by the present invention;

fig. 7 is a flowchart of a sixth embodiment of a method for terminal connection provided by the present invention;

fig. 8 is a data flow chart of data transmission by each terminal in the terminal connection system in the embodiments of fig. 4, 5 and 6;

FIG. 9 is a schematic diagram of an embodiment of an electronic device according to the present invention;

fig. 10 is a schematic structural diagram of an embodiment of a computer readable storage medium provided by the present invention.

Detailed Description

The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

Referring to fig. 1, fig. 1 is a flowchart of a first embodiment of a method for terminal connection according to the present invention. The embodiment is applied to an application scenario in which an execution subject is a user terminal.

Step S11: the user terminal generates a connection request including identification information of the target device terminal, and transmits the connection request to the server so that the server judges whether the target device terminal is registered therein based on the identification information of the target device terminal.

The user terminal may include an intelligent terminal such as a mobile terminal, a desktop terminal, a home terminal, and a PC terminal, and the specific type is not limited herein.

The user terminal generates a connection request containing identification information of the target device terminal. The target equipment terminal is other terminals with which the user terminal wishes to perform communication connection. The target device terminal may include an intelligent terminal such as a monitoring device, other user terminals, and the like, which is not limited herein. The identification information of the target device terminal may include one or more of a network address, a serial number, or a communication port of the target device terminal, which is not limited herein.

The user terminal transmits a connection request to the server so that the server judges whether the target device terminal is registered in the server based on the identification information of the target device terminal.

In a specific application scenario, if the target device terminal is not registered in the server, the user terminal may directly request the communication connection from the target device terminal. For example, by requesting a lan communication connection or network penetration communication probe.

Step S12: in response to registering the target device terminal in the server, the user terminal establishes a forwarding service communication connection with the target device terminal through the server.

When the server judges whether the target equipment terminal is registered in the server, the user terminal establishes forwarding service communication connection with the target equipment terminal through the server.

The forwarding service communication connection can realize quick connection communication between the user terminal and the target equipment terminal, so that the communication connection can be quickly established during streaming media transmission, the waiting time is effectively shortened, and the transmission efficiency is improved.

Step S13: the user terminal requests the target device terminal for a local area network communication connection or a network penetration communication probe, and in response to the local area network connection success or the network penetration communication probe success, the forwarding service communication connection between the user terminal and the target device terminal is switched to the successful local area network connection or the network penetration communication connection.

The user terminal can request the local area network communication connection or the network penetration communication detection to the target equipment terminal while the user terminal and the target equipment terminal are connected through forwarding service communication, and the target equipment terminal can request the local area network communication connection or the network penetration communication detection to the user terminal.

In a specific application scenario, when the user terminal and the target device terminal are in the same lan, they may communicate with each other through a lan communication connection. In another specific application scenario, when the user terminal and the target device terminal are in different local area networks, communication can be performed between each other through network penetration communication detection.

In response to the successful lan connection or unsuccessful network penetration communication probe, the user terminal continues to request the target device terminal for the lan communication connection or network penetration communication probe.

And switching the forwarding service communication connection between the user terminal and the target equipment terminal to a successful local area network connection or network penetration communication connection in response to the local area network connection success or network penetration communication detection success. The successful connection of the local area network or the successful detection of the network penetration communication can include the successful connection request initiated by the user terminal and/or the successful connection request initiated by the target equipment terminal.

Because the forwarding service communication needs to be assisted by using a server, a certain cost of server and network traffic is generated in the forwarding service communication, and as the user terminal and the target device terminal increase, the cost of consumed server and network traffic is high. Therefore, the user terminal of the embodiment also requests the local area network communication connection or the network penetration communication detection from the target equipment terminal, and switches the service communication connection to the successful local area network connection or the network penetration communication connection when the local area network connection or the network penetration communication detection is successful, thereby saving the cost of the server and the network flow.

Through the steps, the terminal connection method of the embodiment requests the server to connect with the target equipment terminal through the user terminal, and when the target equipment terminal is registered in the server, the user terminal establishes forwarding service communication connection with the target equipment terminal through the server; and the user terminal also requests the local area network communication connection or network penetration communication detection to the target equipment terminal; in response to successful local area network connection or successful network penetration communication detection, the forwarding service communication connection between the user terminal and the target equipment terminal is switched to successful local area network connection or network penetration communication connection, so that quick establishment of the communication connection can be ensured through forwarding service communication, waiting time is reduced, when the local area network connection or network penetration communication detection is successful, the service communication connection is switched to successful local area network connection or network penetration communication connection, and therefore the use of a server is avoided after the local area network connection or network penetration communication connection is achieved, the cost of server and network traffic is saved, and the cost of server and network traffic can be saved while the connection speed is ensured.

Referring to fig. 2, fig. 2 is a flowchart of a second embodiment of a method for terminal connection according to the present invention. The embodiment is applied to an application scene with an execution subject as a target device terminal.

Step S21: the target device terminal registers the identification information of the target device terminal to the server.

The target device terminal registers the identification information of the target device terminal in the server. Wherein the registration step may be performed before the user terminal initiates the request.

The target device terminal may include an intelligent terminal such as a monitoring device, other user terminals, and the like, which is not limited herein. The identification information of the target device terminal may include one or more of a network address, a serial number, or a communication port of the target device terminal, which is not limited herein.

After receiving the identification information of the target equipment terminal for registration sent by the target equipment terminal, the server stores the identification information so as to judge whether the target equipment terminal is registered in the server or not when receiving a connection request containing the identification information of the target equipment terminal generated by the user terminal.

Step S22: and responding to the connection request which is generated by the server and contains the identification information of the target equipment terminal at the receiving user terminal, and establishing forwarding service communication connection between the target equipment terminal and the user terminal through the server.

Because the target equipment terminal is registered in the server, when the server receives a connection request containing the identification information of the target equipment terminal generated by the user terminal, the server can determine that the target equipment terminal is registered on the server, and the target equipment terminal can establish forwarding service communication connection with the user terminal through the server.

Step S23: the target equipment terminal requests local area network connection or network penetration communication detection to the user terminal; and switching the forwarding service communication connection between the user terminal and the target equipment terminal to a successful local area network connection or network penetration communication connection in response to the local area network connection success or network penetration communication detection success.

The target equipment terminal receives the local area network communication connection or the network penetration communication detection sent by the user terminal while the user terminal and the target equipment terminal are connected through forwarding service communication, and the target equipment terminal can also request the local area network communication connection or the network penetration communication detection from the user terminal. That is, the user terminal and the target device terminal may request the lan communication connection or the network penetration communication probe from each other until the lan communication connection or the network penetration communication connection is successful, respectively.

In a specific application scenario, when the target device terminal and the user terminal are in the same lan, they may communicate with each other through a lan communication connection. In another specific application scenario, when the target device terminal and the user terminal are in different local area networks, the target device terminal and the user terminal can communicate with each other through network penetration communication detection.

In response to the successful LAN connection or unsuccessful network penetration communication probe, the target device terminal continues to request the LAN communication connection or network penetration communication probe from the user terminal.

And in response to successful local area network connection or successful network penetration communication detection performed by the target equipment terminal and any one of the user terminals, the target equipment terminal switches forwarding service communication connection with the user terminals to successful local area network connection or network penetration communication connection.

Because the forwarding service communication needs to be assisted by using a server, a certain cost of server and network traffic is generated in the forwarding service communication, and as the user terminal and the target device terminal increase, the cost of consumed server and network traffic is high. Therefore, the target device terminal of the embodiment also requests the local area network communication connection or the network penetration communication detection from the user terminal, and switches the service communication connection to the successful local area network connection or the network penetration communication connection when the local area network connection or the network penetration communication detection is successful, thereby saving the cost of the server and the network flow.

Through the steps, the method for terminal connection of the embodiment registers the identification information of the target equipment terminal to the server through the target equipment terminal, and when the server receives the connection request containing the identification information of the target equipment terminal generated by the user terminal, the target equipment terminal establishes forwarding service communication connection with the user terminal through the server; the target equipment terminal receives local area network communication connection or network penetration communication detection sent by the user terminal, and requests the local area network connection or network penetration communication detection from the user terminal; in response to successful local area network connection or successful network penetration communication detection, the forwarding service communication connection between the user terminal and the target equipment terminal is switched to successful local area network connection or network penetration communication connection, so that quick establishment of the communication connection can be ensured through forwarding service communication, waiting time is reduced, and after the local area network connection or network penetration communication connection, the use of a server is avoided, so that the cost of the server and the cost of the network flow are saved, and the connection speed can be ensured, and meanwhile, the cost of the server and the cost of the network flow can be saved.

Referring to fig. 3, fig. 3 is a flowchart illustrating a third embodiment of a method for terminal connection according to the present invention. The embodiment is applied to an application scenario in which an execution subject is a server.

Step S31: the server receives identification information of at least one device terminal to register.

The server receives identification information of at least one device terminal to register. Specifically, the server receives identification information of at least one device terminal, and stores it for registration.

The number of the device terminals received by the server may be 1 or more, and may be specifically determined according to the actual technical requirements, which is not limited herein.

The server is loaded on a cloud end of the public network to assist communication among different terminals.

Step S32: the server receives a connection request containing identification information of the target equipment terminal sent by the user terminal, and judges whether the target equipment terminal is registered or not based on the identification information of the target equipment terminal.

The server receives a connection request containing identification information of the target device terminal sent by the user terminal, wherein the user terminal wishes to perform communication connection with the target device terminal, and sends the connection request containing the identification information of the target device terminal to the server, so that the server judges whether the target device terminal is registered or not based on the identification information of the target device terminal.

The target equipment terminal is the equipment terminal which the user terminal wants to connect.

Step S33: and establishing forwarding service communication connection between the user terminal and the target equipment terminal in response to the registration of the target equipment terminal in the server.

And because the server receives the identification information of the target equipment terminal for registration, the forwarding service communication connection between the user terminal and the target equipment terminal is established through the server.

Step S34: and switching the forwarding service communication connection between the user terminal and the target equipment terminal to a successful local area network connection or network penetration communication connection in response to the successful local area network connection or network penetration communication detection between the user terminal and the target equipment terminal.

And switching the forwarding service communication connection between the user terminal and the target equipment terminal to a successful local area network connection or network penetration communication connection in response to the local area network connection success or network penetration communication detection success.

Because the forwarding service communication needs to be assisted by using a server, a certain cost of server and network traffic is generated in the forwarding service communication, and as the user terminal and the target device terminal increase, the cost of consumed server and network traffic is high. Therefore, when the local area network connection is successful or the network penetration communication detection is successful, the service communication connection is switched to the successful local area network connection or the network penetration communication connection, so that the cost of the server and the network traffic is saved.

Through the steps, the method for terminal connection of the embodiment ensures the quick establishment of the communication connection through forwarding service communication, reduces waiting time, and switches the service communication connection into successful local area network connection or network penetration communication connection when the local area network connection or network penetration communication detection is successful, so that the use of a server is avoided after the local area network connection or network penetration communication connection, the cost of the server and the cost of the network flow are saved, and the connection speed is ensured, and meanwhile the cost of the server and the cost of the network flow are saved.

Referring to fig. 4-5, fig. 4 is a flowchart illustrating a fourth embodiment of a method for terminal connection according to the present invention, where the embodiment is applied to an application scenario in which an execution body is a user terminal. Fig. 5 is a schematic structural diagram of an implementation of the terminal connection system in the embodiment of fig. 4. The method of terminal connection of the embodiment of fig. 4 may be applied to the terminal connection system 50. In other embodiments, the method for terminal connection of the present embodiment may also be applied to terminal connection systems with other structures, which is not limited herein.

The terminal connection system 50 of the present embodiment includes a user terminal 51, a target device terminal 52, a server 53, a first network penetrating device 54, and a second network penetrating device 55. The number of the user terminal 51, the target device terminal 52, and the server 53 may be one or more, which is not limited herein. While the first network penetrating means 54 corresponds to the user terminals 51 and the second network penetrating means 55 corresponds to the target device terminals 52, i.e. one first network penetrating means 54 per user terminal 51 and one second network penetrating means 55 per target device terminal 52.

The user terminal 51 comprises a first transmission module 511, a first protocol stack module 512 and a first logic processing module 513, wherein the first transmission module 511 is in communication connection with the first protocol stack module 512, and the first transmission module 511 is in communication connection with the first logic processing module 513.

The target device terminal 52 includes a second transmission module 521, a second protocol stack module 522, and a second logic processing module 523, where the second transmission module 521 is communicatively connected to the second protocol stack module 522, and the second transmission module 521 is communicatively connected to the second logic processing module 523.

The server 53 comprises a signaling server 531 and a forwarding server 532, wherein the signaling server 531 is communicatively connected to the forwarding server 532.

The first network penetrating apparatus 54 and the second network penetrating apparatus 55 may be network connecting apparatuses provided for a communication carrier. Which may enable information transfer between the server 53, the user terminal 51 and the target device terminal 52. Specifically, the first network penetrating apparatus 54 is communicatively connected to the first transmission module 511 and the signaling server 531, respectively, and the second network penetrating apparatus 55 is communicatively connected to the second transmission module 521 and the signaling server 531, respectively.

The method of terminal connection in the embodiment of fig. 4 will be described in connection with the terminal connection system 50:

step S41: the logic processing module of the user terminal generates a connection request containing the identification information of the target equipment terminal and sends the connection request to the transmission module of the user terminal; the transmission module of the user terminal transmits a connection request to the server so that the server judges whether the target device terminal is registered therein based on the identification information of the target device terminal.

The user terminal of the embodiment comprises a first transmission module, a first protocol stack module and a first logic processing module, wherein the first transmission module is in communication connection with the first protocol stack module, and the first transmission module is in communication connection with the first logic processing module.

The logic processing module of the user terminal generates a connection request containing the identification information of the target equipment terminal, and sends the connection request to the transmission module of the user terminal.

In a specific application scenario, the logic processing module may include a P2P (peer-to-peer) client module, which may be configured to parse the P2P protocol, process P2P client service logic, such as a hole request/reply, and the like.

The transmission module is used for data transmission and can support a plurality of data transmission formats. In a specific application scenario, the transmission module may include a UDP (User Datagram Protocol) transmission module, applied to the P2P format and the QUIC format, and responsible for UDP data transmission with the P2P service or after network address conversion.

The identification information of the target equipment terminal may include a serial number, a subnet address and a communication port of the target equipment terminal, and may further include other service information such as an equipment type of the target equipment terminal.

The transmission module of the user terminal sends the connection request to the server, so that the server judges whether the target equipment terminal is registered in the server or not based on the identification information of the target equipment terminal.

In a specific application scenario, if the server does not have the target device terminal registered therein, the user terminal may directly request the communication connection from the target device terminal. For example, by requesting a lan communication connection or network penetration communication probe.

In a specific embodiment, the first logic processing module 513 of the user terminal 51 generates a connection request containing the identification information of the target device terminal 52, and sends the connection request to the first transmission module 511 of the user terminal 51; the first transmission module 511 of the user terminal 51 transmits a connection request to the server 53 to cause the server 53 to determine whether the target device terminal 52 is registered therein based on the identification information of the target device terminal 52.

Specifically, the first transmission module 511 of the user terminal 51 may send the connection request to the first network penetration device 54, and then transmit the connection request to the server 53 through the first network penetration device 54.

The network penetrating equipment can translate the subnet IP address of the terminal into a legal public network IP address.

Step S42: responding to the target equipment terminal registered in the server, and receiving forwarding service resources sent by the server by the user terminal; the user terminal establishes a forwarding service communication connection with the target device terminal based on the forwarding service resource.

When the server judges whether the target equipment terminal is registered in the server, the server transmits forwarding service resources to the user terminal and the target equipment terminal.

And the user terminal receives the forwarding service resource sent by the server. The forwarding service resource may include an intermediate connection address generated by the server and used for connecting the user terminal and the target device terminal, or may be a network protocol address and a port address of the server itself, or may be an address of a network address conversion device of the target device terminal and/or the user terminal, which is not limited herein.

The user terminal establishes a forwarding service communication connection with the target device terminal based on the forwarding service resource. In a specific application scenario, the user terminal and the target device terminal may be simultaneously connected to each other based on the forwarding service resource until the forwarding service communication connection is established.

In a specific application scenario, a user terminal sends a first connection packet to a target device terminal based on a forwarding service resource, and receives a second connection packet sent by the target device terminal based on the forwarding service resource, so as to establish a forwarding service communication connection. The first connection packet and the second connection packet may include UDP packets, which may include data such as a source IP address, a destination IP address, and/or a protocol field of an IP packet, which are not limited herein.

In a specific embodiment, in response to the registration of the target device terminal 52 in the server 53, the user terminal 51 receives the forwarding service resource sent by the server 53; the user terminal 51 establishes a forwarding service communication connection with the target device terminal 52 based on the forwarding service resources.

In a specific application scenario, after the forwarding service communication connection is successful, the protocol stack module of the user terminal may establish a target protocol communication with the protocol stack module of the target device terminal by using the connection relationship of the forwarding service communication, so as to send and/or receive transmission information to the target device terminal by using the target protocol. The target protocol communication may include, among other things, a QUIC protocol communication. The QUIC protocol communication can support the transmission of various media streams, such as video streams, and the transmission of the media streams based on the QUIC protocol is realized without providing a complex protocol conversion agent for the user terminal and the target equipment terminal, and only the transmission based on the QUIC protocol is required, so that the transmission efficiency of the media streams is improved. And the QUIC protocol-based communication connection can seamlessly switch the communication connection mode, and the phenomenon of blocking and delay during the switching of the communication connection mode is avoided.

In a specific embodiment, after the forwarding service communication connection is successful, the first protocol stack module 512 of the user terminal 51 may establish a target protocol communication with the second protocol stack module 522 of the target device terminal 52 by using the connection relationship of the forwarding service communication, so as to send and/or receive transmission information to the target device terminal 52 by using the target protocol. Specifically, the connection channel 56 for forwarding service communications is formed by sequentially connecting the first transmission module 511, the first network penetrating apparatus 54, the server 53, the second network penetrating apparatus 55, and the second transmission module 521.

Step S43: the user terminal multicasts the local area network where the user terminal is located based on the identification information of the target equipment terminal, and the responding target equipment terminal is located in the local area network and is connected with the target equipment terminal in the local area network based on the identification information of the target equipment terminal; in response to the target device terminal not being located within the local area network, the user terminal requests network penetration communication probes from the target device terminal.

And the user terminal also multicasts the local area network where the user terminal is positioned based on the identification information of the target equipment terminal when forwarding the service communication connection so as to determine whether the target equipment terminal is positioned in the local area network where the user terminal is positioned. When the target equipment terminal is not located in the local area network where the user terminal is located, the target equipment terminal cannot receive the multicast of the user terminal, and cannot reply to the multicast of the user terminal.

And the responding target equipment terminal is positioned in the local area network, namely the user terminal and the target equipment terminal are positioned in the same local area network, and local area network connection is carried out with the target equipment terminal based on the identification information of the target equipment terminal.

When the local area network is successfully connected, the protocol stack module of the user terminal can establish target protocol communication with the protocol stack module of the target equipment terminal by utilizing the connection relation of the local area network so as to send and/or receive transmission information to the target equipment terminal by utilizing the target protocol. The target protocol communication may include, among other things, a QUIC protocol communication. The QUIC protocol communication can support the transmission of various media streams, such as video streams, and the transmission of the media streams based on the QUIC protocol is realized without providing a complex protocol conversion agent for the user terminal and the target equipment terminal, and only the transmission based on the QUIC protocol is required, so that the transmission efficiency of the media streams is improved.

In a specific embodiment, after the lan connection is successful, the first protocol stack module 512 of the user terminal 51 may establish a target protocol communication with the second protocol stack module 522 of the target device terminal 52 by using the connection relationship of the lan, so as to send and/or receive transmission information to the target device terminal 52 by using the target protocol. Specifically, the connection channel 58 of the lan is formed by the communication of the first transmission module 511 and the second transmission module 521.

In response to the target device terminal not being located within the local area network, the user terminal requests network penetration communication probes from the target device terminal.

The user terminal may request the network penetrating device address of the target device terminal from the server, and receive the network penetrating device address of the target device terminal; and the user terminal performs multiple network penetration communication detection on the network penetration equipment of the target equipment terminal based on the network penetration equipment address of the target equipment terminal until the network penetration communication detection is successful.

Specifically, the user terminal may know the network penetrating device address of the target device terminal through the server, and perform penetrating detection on the network penetrating device address. That is, the network penetrating equipment address of the target equipment terminal maps the subnet address of the target equipment terminal to the public network address, and the network penetrating equipment of the user terminal detects the public network address until the detection is successful.

In a specific application scenario, the network penetration device may include a NAT (Network Address Translation) device, and the network penetration probe may include NAT penetration, through which the user terminal performs multiple network penetration probes on the network penetration device of the target device terminal using multiple UDP sockets, where each penetration probe may use one UDP socket. Because the network penetration detection has the problem of success rate, the success rate of the network penetration detection is improved by improving the frequency of the network penetration detection.

When the network penetration detection is successful, the protocol stack module of the user terminal can establish target protocol communication with the protocol stack module of the target equipment terminal by utilizing the connection relation of the network penetration communication so as to send and/or receive transmission information to the target equipment terminal by utilizing the target protocol. The target protocol communication may include, among other things, a QUIC protocol communication. The QUIC protocol communication can support the transmission of various media streams, such as video streams, and the transmission of the media streams based on the QUIC protocol is realized without providing a complex protocol conversion agent for the user terminal and the target equipment terminal, and only the transmission based on the QUIC protocol is required, so that the transmission efficiency of the media streams is improved.

In a specific embodiment, after the network penetration probe is successful, the first protocol stack module 512 of the user terminal 51 may establish the target protocol communication with the second protocol stack module 522 of the target device terminal 52 by using the connection relationship of the network penetration communication, so as to send and/or receive the transmission information to the target device terminal 52 by using the target protocol. Specifically, the connection channel 57 of the network penetration communication is formed by sequentially connecting the first transmission module 511, the first network penetration device 54, the second network penetration device 55, and the second transmission module 521.

That is, after the user terminal and the target equipment terminal are successfully connected, the protocol stack module of the user terminal establishes target protocol communication with the protocol stack module of the target equipment terminal by using the connection relationship, so as to send and/or receive transmission information to the target equipment terminal by using the target protocol. The connection relationship includes one or more of a forwarding service communication connection relationship, a local area network connection relationship, and a network penetration communication relationship.

By the mode, the QUIC protocol of the embodiment is realized without loading the QUIC protocol stack module on the server, but the corresponding protocol stack module is arranged in each terminal and realized by means of the connection channel constructed by the transmission module, so that the cost and the flow of the server are saved.

Step S44: and switching the forwarding service communication connection between the user terminal and the target equipment terminal to a successful local area network connection or network penetration communication connection in response to the local area network connection success or network penetration communication detection success.

And switching the forwarding service communication connection between the user terminal and the target equipment terminal into a successful local area network connection or network penetration communication connection after the local area network connection or network penetration communication detection is successful.

Through the steps, the terminal connection method of the embodiment ensures the quick establishment of the communication connection by constructing the forwarding service communication, reduces the waiting time, and the user terminal also requests the local area network communication connection or the network penetration communication detection to the target equipment terminal, and when the local area network connection or the network penetration communication detection is successful, the service communication connection is switched to the successful local area network connection or the network penetration communication connection, so that after the local area network connection or the network penetration communication connection, the communication mode is seamlessly integrated, the use of a server is avoided, the cost of the server and the network flow is saved, and the cost of the server and the network flow is saved while the connection speed is ensured. In this embodiment, after the user terminal and the target device terminal are successfully connected, the protocol stack module of the user terminal establishes target protocol communication with the protocol stack module of the target device terminal by using a connection relationship, so as to send and/or receive transmission information to the target device terminal by using the target protocol, and then the transmission media stream is transmitted based on the QUIC protocol without providing a complex protocol conversion agent for the user terminal and the target device terminal, and only the transmission is performed based on the QUIC protocol, so that the transmission efficiency of the media stream is improved, and the QUIC protocol is realized without loading the QUIC protocol stack module on the server, but the corresponding protocol stack module is set in each terminal to be realized by means of a connection channel constructed by the transmission module, thereby saving the cost and the traffic usage of the server. In addition, the method combines service forwarding communication, local area network communication and network penetration communication, introduces the QUIC protocol, and more effectively realizes seamless integration of service forwarding communication and network penetration communication.

Referring to fig. 6, fig. 6 is a flowchart of a fifth embodiment of a method for terminal connection according to the present invention, where the embodiment is applied to an application scenario in which an execution subject is a target device terminal. The method of terminal connection of the embodiment of fig. 6 may be applied to the terminal connection system 50. In other embodiments, the method for terminal connection of the present embodiment may also be applied to terminal connection systems with other structures, which is not limited herein.

The method of terminal connection in the embodiment of fig. 6 will be described in connection with the terminal connection system 50:

step S61: the logic processing module of the target equipment terminal generates registration information containing identification information of the target equipment terminal and sends the registration information to the transmission module of the target equipment terminal; and the transmission module of the target equipment terminal sends the registration information to the server for registration.

The target equipment terminal of the embodiment comprises a transmission module, a protocol stack module and a logic processing module, wherein the transmission module is in communication connection with the protocol stack module, and the transmission module is in communication connection with the logic processing module.

The logic processing module of the target equipment terminal generates registration information containing the identification information of the target equipment terminal, and sends the registration information to the transmission module of the target equipment terminal. In a specific application scenario, the logic processing module may include a P2P (peer-to-peer) client module, which may be configured to parse a P2P protocol, process P2P client service logic, such as a hole request/reply, and the like.

The identification information of the target equipment terminal may include a serial number, a subnet address and a communication port of the target equipment terminal, and may further include other service information such as an equipment type of the target equipment terminal. The logic processing module generates a data message in a registration format based on the identification information of the target equipment terminal, takes the data message in the registration format as registration information and sends the data message to the transmission module of the target equipment terminal.

And the transmission module of the target equipment terminal sends the registration information to the server for registration.

In a specific embodiment, the second logic processing module 523 of the target device terminal 52 generates registration information including the identification information of the target device terminal 52, and sends the registration information to the second transmission module 521 of the target device terminal 52; the second transmission module 521 of the target device terminal 52 transmits the registration information to the server 53 for registration.

Specifically, the second transmission module 521 of the target device terminal 52 may send the registration information to the second network penetrating device 55, and then transmit the registration information to the server 53 via the second network penetrating device 55.

Step S62: and responding to the connection request which is generated by the user terminal and contains the identification information of the target equipment terminal by the server, receiving the forwarding service resource sent by the server by the target equipment terminal, and establishing forwarding service communication connection with the user terminal based on the forwarding service resource.

After the server receives the registration information containing the identification information of the target equipment terminal generated by the user terminal, the server can judge that the target equipment terminal is registered in the server after the target equipment terminal is registered in the server, and the server transmits forwarding service resources to the user terminal and the target equipment terminal.

And the target equipment terminal receives the forwarding service resource sent by the server and establishes forwarding service communication connection with the user terminal based on the forwarding service resource. The forwarding service resource may include an intermediate connection address generated by the server and used for connecting the user terminal and the target device terminal, or may be a network protocol address and a port address of the server itself, or may be an address of a network address conversion device of the target device terminal and/or the user terminal, which is not limited herein.

The target device terminal establishes a forwarding service communication connection with the user terminal based on the forwarding service resource. In a specific application scenario, the user terminal and the target device terminal may be simultaneously connected to each other based on the forwarding service resource until the forwarding service communication connection is established.

In a specific application scenario, the target device terminal sends a first connection packet to the user terminal based on the forwarding service resource, and receives a second connection packet sent by the user terminal based on the forwarding service resource, so as to establish a forwarding service communication connection. The first connection packet and the second connection packet may include UDP packets, which may include data such as a source IP address, a destination IP address, and/or a protocol field of an IP packet, which are not limited herein.

In a specific embodiment, in response to the server 53 generating a connection request including identification information of the target device terminal 52 at the receiving user terminal 51, the target device terminal 52 receives the forwarding service resource sent by the server 53 and establishes a forwarding service communication connection with the user terminal 51 based on the forwarding service resource.

In a specific application scenario, after the forwarding service communication connection is successful, the protocol stack module of the target device terminal may establish a target protocol communication with the protocol stack module of the user terminal by using the connection relationship of the forwarding service communication, so as to send and/or receive transmission information to the user terminal by using the target protocol. The target protocol communication may include, among other things, a QUIC protocol communication. The QUIC protocol communication can support the transmission of various media streams, such as video streams, and the transmission of the media streams based on the QUIC protocol is realized without providing a complex protocol conversion agent for the user terminal and the target equipment terminal, and only the transmission based on the QUIC protocol is required, so that the transmission efficiency of the media streams is improved.

In a specific embodiment, after the forwarding service communication connection is successful, the second protocol stack module 522 of the target device terminal 52 may establish a target protocol communication with the first protocol stack module 512 of the user terminal 51 by using the connection relationship of the forwarding service communication, so as to send and/or receive transmission information to the user terminal 51 by using the target protocol. Specifically, the connection channel 56 for forwarding service communications is formed by sequentially connecting the first transmission module 511, the first network penetrating apparatus 54, the server 53, the second network penetrating apparatus 55, and the second transmission module 521.

Step S63: the target equipment terminal requests local area network connection or network penetration communication detection to the user terminal; and switching the forwarding service communication connection between the user terminal and the target equipment terminal to a successful local area network connection or network penetration communication connection in response to the local area network connection success or network penetration communication detection success.

The target device terminal requests the local area network connection or the network penetration communication detection from the user terminal, specifically, forwards the service communication connection, and meanwhile, the target device terminal also multicasts the local area network where the target device terminal is located based on the identification information of the user terminal so as to determine whether the user terminal is located in the local area network where the target device terminal is located. When the user terminal is not located in the local area network with the target equipment terminal, the user terminal cannot receive the multicast of the target equipment terminal, and cannot reply the multicast of the target equipment terminal.

And the responded user terminal is positioned in the local area network, namely the user terminal and the target equipment terminal are positioned in the same local area network, and local area network connection is carried out with the target equipment terminal based on the identification information of the user terminal.

The identification information of the user terminal may include one or more of a serial number, a subnet address, and a communication port of the user terminal, and may further include other service information such as a device type of the target device terminal, which is not limited herein.

When the local area network is successfully connected, the protocol stack module of the target equipment terminal can establish target protocol communication with the protocol stack module of the user terminal by utilizing the connection relation of the local area network so as to send and/or receive transmission information to the user terminal by utilizing the target protocol. The target protocol communication may include, among other things, a QUIC protocol communication. The QUIC protocol communication can support the transmission of various media streams, such as video streams, and the transmission of the media streams based on the QUIC protocol is realized without providing a complex protocol conversion agent for the user terminal and the target equipment terminal, and only the transmission based on the QUIC protocol is required, so that the transmission efficiency of the media streams is improved.

In a specific embodiment, after the lan connection is successful, the second protocol stack module 522 of the target device terminal 52 may establish a target protocol communication with the first protocol stack module 512 of the user terminal 51 by using the connection relationship of the lan, so as to send and/or receive transmission information to the user terminal 51 by using the target protocol. Specifically, the connection channel 58 of the lan is formed by the communication of the first transmission module 511 and the second transmission module 521.

In response to the user terminal not being located within the local area network, the target device terminal requests a local area network connection or network penetration communication probe from the user terminal.

The target device terminal may request the network penetrating device address of the user terminal from the server, and receive the network penetrating device address of the user terminal; and the target equipment terminal performs multiple network penetration communication detection on the network penetration equipment of the user terminal based on the network penetration equipment address of the user terminal until the network penetration communication detection is successful.

Specifically, the target device terminal may know the network penetrating device address of the user terminal through the server, and perform penetrating detection on the network penetrating device address. That is, the network penetrating equipment address of the user terminal maps the subnet address of the user terminal to the public network address, and the network penetrating equipment of the target equipment terminal detects the public network address until the detection is successful.

In a specific application scenario, the network penetration device may include a NAT (Network Address Translation) device, and the network penetration probe may include NAT penetration, where the target device terminal performs multiple network penetration probes on the network penetration device of the user terminal through its network penetration device using multiple UDP sockets, where each penetration probe may use one UDP socket. Because the network penetration detection has the problem of success rate, the success rate of the network penetration detection is improved by improving the frequency of the network penetration detection.

When the network penetration detection is successful, the protocol stack module of the target equipment terminal can establish target protocol communication with the protocol stack module of the user terminal by utilizing the connection relation of the network penetration communication so as to send and/or receive transmission information to the user terminal by utilizing the target protocol. The target protocol communication may include, among other things, a QUIC protocol communication. The QUIC protocol communication can support the transmission of various media streams, such as video streams, and the transmission of the media streams based on the QUIC protocol is realized without providing a complex protocol conversion agent for the user terminal and the target equipment terminal, and only the transmission based on the QUIC protocol is required, so that the transmission efficiency of the media streams is improved.

In a specific embodiment, after the network penetration probe is successful, the second protocol stack module 522 of the target device terminal 52 may establish the target protocol communication with the first protocol stack module 512 of the user terminal 51 by using the connection relationship of the network penetration communication, so as to send and/or receive the transmission information to the user terminal 51 by using the target protocol. Specifically, the connection channel 57 of the network penetration communication is formed by sequentially connecting the first transmission module 511, the first network penetration device 54, the second network penetration device 55, and the second transmission module 521.

That is, after the user terminal and the target device terminal are successfully connected, the protocol stack module of the target device terminal and the protocol stack module of the user terminal respectively establish target protocol communication to each other by using the connection relationship, so as to send and/or receive transmission information to the target device terminal by using the target protocol. The connection relationship includes one or more of a forwarding service communication connection relationship, a local area network connection relationship, and a network penetration communication relationship.

Because the forwarding service communication needs to be assisted by using a server, a certain cost of server and network traffic is generated in the forwarding service communication, and as the user terminal and the target device terminal increase, the cost of consumed server and network traffic is high. Therefore, the user terminal and the target device terminal in this embodiment request the lan communication connection or the network penetration communication probe to each other, respectively, and when the lan connection or the network penetration communication probe is successful, switch the service communication connection to the successful lan connection or the network penetration communication connection, thereby saving the cost of the server and the network traffic.

Through the steps, the terminal connection method of the embodiment ensures the quick establishment of the communication connection by constructing the forwarding service communication, reduces the waiting time, and the user terminal and the target equipment terminal respectively request the local area network communication connection or the network penetration communication detection to each other. In the embodiment, after the user terminal and the target equipment terminal are successfully connected, the protocol stack module of the target equipment terminal and the protocol stack module of the user terminal respectively establish target protocol communication to each other by utilizing a connection relation, so that transmission information is sent and/or received to the target equipment terminal by utilizing the target protocol, and transmission of the media stream based on the QUIC protocol is realized without providing a complex protocol conversion agent for the user terminal and the target equipment terminal and only by transmitting the media stream based on the QUIC protocol, so that the transmission efficiency of the media stream is improved, the QUIC protocol is realized without loading the QUIC protocol stack module on a server, and the corresponding protocol stack modules are arranged in each terminal to be realized by means of a connection channel constructed by the transmission module, thereby saving the cost and the traffic use of the server.

Referring to fig. 7, fig. 7 is a flowchart of a sixth embodiment of a method for terminal connection according to the present invention, where the embodiment is applied to an application scenario in which an execution subject is a server. The method of terminal connection of the embodiment of fig. 7 may be applied to the terminal connection system 50. In other embodiments, the method for terminal connection of the present embodiment may also be applied to terminal connection systems with other structures, which is not limited herein.

The method of terminal connection in the embodiment of fig. 7 will be described in connection with the terminal connection system 50:

step S71: the server receives identification information of at least one device terminal to register.

The server of the present embodiment includes a signaling server and a forwarding server that are communicatively connected to each other. The signaling server assists the user terminal and the equipment terminal in making holes and distributing forwarding service resources. The forwarding server is used for being responsible for forwarding network data between the user terminal and the equipment terminal.

The server receives identification information of at least one device terminal to register. Specifically, the signaling server of the server receives the identification information of at least one device terminal and stores it for registration.

The device terminal transmission modules transmit the identification information to the corresponding network penetration devices, and the network penetration devices transmit the connection request to the signaling server of the server for registration.

In a specific embodiment, the signaling server 531 of the server 53 receives the identification information of at least one device terminal and stores it for registration.

Step S72: the signaling server of the server receives a connection request which is sent by the user terminal and contains the identification information of the target equipment terminal, and the signaling server judges whether the target equipment terminal is registered in the server or not based on the identification information of the target equipment terminal.

The signaling server of the server receives a connection request which is sent by the user terminal and contains the identification information of the target equipment terminal, and the signaling server judges whether the target equipment terminal is registered in the server or not based on the identification information of the target equipment terminal.

The target device terminal is a device terminal to which the user terminal wishes to connect.

Specifically, the transmission module of the user terminal transmits the connection request to the corresponding network penetration device, and then transmits the connection request to the signaling server of the server through the network penetration device.

In a specific embodiment, the signaling server 531 of the server 53 receives a connection request including the identification information of the target device terminal 52 transmitted by the user terminal 51, and the signaling server 531 determines whether the target device terminal 52 is registered therein based on the identification information of the target device terminal 52.

Step S73: responding to the signaling server registered with the target equipment terminal, and the signaling server transmits an allocation instruction to a forwarding server of the server; and the forwarding server generates forwarding service resources after receiving the allocation instruction, and respectively transmits the forwarding service resources to the user terminal and the target equipment terminal so as to enable the user terminal and the target equipment terminal to establish forwarding service communication connection based on the forwarding service resources.

When the target equipment terminal is registered in the signaling server, the signaling server issues an allocation instruction to a forwarding server of the server.

And the forwarding server generates forwarding service resources after receiving the allocation instruction and respectively transmits the forwarding service resources to the user terminal and the target equipment terminal. In a specific application scenario, the forwarding service resource may include a port address and an IP address of the forwarding server itself, so that the user terminal and the target device terminal respectively go to the forwarding server to perform forwarding communication.

In a specific embodiment, in response to the signaling server 531 registering the target device terminal 52, the signaling server 531 issues an allocation instruction to the forwarding server 532 of the server 53; the forwarding server 532 generates forwarding service resources after receiving the allocation instruction, and transmits the forwarding service resources to the user terminal 51 and the target device terminal 52, respectively, so that the user terminal 51 and the target device terminal 52 establish a forwarding service communication connection based on the forwarding service resources.

In a specific embodiment, after the forwarding service communication connection is successful, the first protocol stack module 512 of the user terminal 51 and the second protocol stack module 522 of the target device terminal 52 may establish the target protocol communication with each other by using the connection relationship of the forwarding service communication. Specifically, the connection channel 56 for forwarding service communication is formed by sequentially connecting the first transmission module 511, the first network penetrating apparatus 54, the forwarding server 532 of the server 53, the second network penetrating apparatus 55, and the second transmission module 521.

Step S74: and switching the forwarding service communication connection between the user terminal and the target equipment terminal to a successful local area network connection or network penetration communication connection in response to the successful local area network connection or network penetration communication detection between the user terminal and the target equipment terminal.

After the user terminal and the target equipment terminal are successfully connected, the protocol stack module of the user terminal establishes target protocol communication with the protocol stack module of the target equipment terminal by utilizing the connection relation so as to send and/or receive transmission information to the target equipment terminal by utilizing the target protocol. The connection relationship includes one or more of a forwarding service communication connection relationship, a local area network connection relationship, and a network penetration communication relationship.

Through the steps, the terminal connection method of the embodiment ensures the quick establishment of the communication connection by constructing the forwarding service communication, reduces the waiting time, and switches the service communication connection into the successful local area network connection or the network penetration communication connection when the local area network connection or the network penetration communication detection is successful, thereby avoiding the use of a server after the local area network connection or the network penetration communication connection, saving the cost of the server and the network flow, and further ensuring the connection speed and saving the cost of the server and the network flow. In this embodiment, after the user terminal and the target device terminal are successfully connected, the protocol stack module of the user terminal establishes target protocol communication with the protocol stack module of the target device terminal by using a connection relationship, so as to send and/or receive transmission information to the target device terminal by using the target protocol, and then the transmission media stream is transmitted based on the QUIC protocol without providing a complex protocol conversion agent for the user terminal and the target device terminal, and only the transmission is performed based on the QUIC protocol, so that the transmission efficiency of the media stream is improved, and the QUIC protocol is realized without loading the QUIC protocol stack module on the server, but the corresponding protocol stack module is set in each terminal to be realized by means of a connection channel constructed by the transmission module, thereby saving the cost and the traffic usage of the server.

Referring to fig. 8, fig. 8 is a data flow diagram of data transmission performed by each terminal in the terminal connection system in the embodiments of fig. 4, 5 and 6.

a: the second logic processing module 523 generates a data packet in a registration format based on the identification information of the target device terminal 52, and sends the data packet in the registration format as registration information to the second transmission module 521 of the target device terminal 52.

b: the second transmission module 521 transmits the registration information to the second network penetrating apparatus 55.

c: the second network penetration device 55 transmits the registration information to the signaling server 531 of the server 53.

d: the signaling server 531 stores registration information of the target device terminal 52.

e: the first logic processing module 513 of the user terminal 51 generates a connection request containing the identification information of the target device terminal 52 and transmits the connection request to the first transmission module 511 of the user terminal 51.

f: the first transmission module 511 of the user terminal 51 sends a connection request to the first network penetrating apparatus 54.

g: the first network penetration device 54 sends a connection request to the signaling server 531 of the server 53.

h: the signaling server 531 determines, based on the connection request, whether the target device terminal corresponding to the connection request is registered in the signaling server 531.

i: when the signaling server 531 determines that the target device terminal 52 corresponding to the connection request is registered in the signaling server 531, an allocation instruction is issued to the forwarding server 532 of the server 53.

j: the forwarding server 532 generates forwarding service resources upon receiving the allocation instruction. The forwarding service resource includes a port address and an ip address of the forwarding server 532.

k: the forwarding server 532 issues forwarding service resources to the second network penetrating device 55.

l: the second network penetrating device 55 issues forwarding service resources to the second transmission module 521 of the target device terminal 52.

m: the second transmission module 521 communicates with the forwarding server 532 based on the port address and ip address of the forwarding server 532 indicated in the forwarding service resource. Specifically, communication may be through the second network penetration device 55 to the forwarding server 532.

n: the forwarding server 532 issues forwarding service resources to the first network penetrating device 54.

o: the first network penetration device 54 issues forwarding service resources to the first transmission module 511 of the user terminal 51.

And p: the first transmission module 511 communicates with the forwarding server 532 based on the port address and ip address of the forwarding server 532 indicated in the forwarding service resource. In particular, forwarding service communication between the second transport module 521 and the first transport module 511 may be implemented at the forwarding server 532 by the first network penetrating device 54 communicating to the forwarding server 532.

When the connection of the forwarding service communication is successful, the first protocol stack module 512 may establish a target protocol communication with the second protocol stack module 522 by using the connection relationship of the forwarding service communication, so as to send and/or receive transmission information to the transmission module of the other party by using the target protocol. The target protocol communication may include, among other things, a QUIC protocol communication. Specifically, the connection channel 56 for forwarding service communications is formed by sequentially connecting the first transmission module 511, the first network penetrating apparatus 54, the server 53, the second network penetrating apparatus 55, and the second transmission module 521.

q: after the forwarding service communication connection is successful, the second transmission module 521 performs multicast to perform local area network connection with the first transmission module 511 located in the same local area network.

r: after the forwarding service communication connection is successful, the first transmission module 511 performs multicast to perform local area network connection with the second transmission module 521 located in the same local area network.

After the lan communication connection is successful, the communication connection manner between the first transmission module 511 and the second transmission module 521 is switched from forwarding service communication to lan communication.

When the lan connection is successful, the first protocol stack module 512 may establish a target protocol communication with the second protocol stack module 522 by using the connection relationship of the lan, so as to send and/or receive transmission information to the transmission module of the other party by using the target protocol. The target protocol communication may include, among other things, a QUIC protocol communication. Specifically, the connection channel 58 of the lan is formed by the communication of the first transmission module 511 and the second transmission module 521.

The execution sequence of the steps r and q is not sequential, and can also be performed simultaneously.

s: the second transmission module 521 performs network penetrating communication probe to the first network penetrating equipment 54. Specifically, the second transmission module 521 may obtain the address of the first network penetrating apparatus 54 from the signaling server 531, and perform network penetrating communication probing based on the address.

And when the local area network connection fails, network penetration communication detection is carried out.

t: the first transmission module 511 performs network penetrating communication probe to the second network penetrating device 55. Specifically, the first transmission module 511 may obtain an address of the second network penetrating device 55 from the signaling server 531, and perform network penetrating communication probing based on the address.

After the network penetration communication connection is successful, the communication connection mode between the first transmission module 511 and the second transmission module 521 is switched from forwarding service communication to network penetration communication.

When the network penetrating communication connection is successful, the first protocol stack module 512 may establish the target protocol communication with the second protocol stack module 522 by using the connection relationship of the network penetrating communication, so as to send and/or receive the transmission information to the transmission module of the other party by using the target protocol. The target protocol communication may include, among other things, a QUIC protocol communication. The connection channel 57 for network penetration communication is formed by sequentially connecting the first transmission module 511, the first network penetration device 54, the second network penetration device 55, and the second transmission module 521.

The execution sequence of the steps s and t is not sequential, and can also be performed simultaneously.

Based on the same inventive concept, the present invention also proposes an electronic device, which can be executed to implement the method for terminal connection of any of the above embodiments, referring to fig. 9, fig. 9 is a schematic structural diagram of an embodiment of the electronic device provided by the present invention, where the electronic device includes a processor 91 and a memory 92.

The processor 91 is configured to execute program instructions stored in the memory 92 to implement the steps of the method of any of the terminal connections described above. In one particular implementation scenario, an electronic device may include, but is not limited to: the microcomputer and the server, and the electronic device may also include mobile devices such as a notebook computer and a tablet computer, which are not limited herein.

In particular, the processor 91 is operative to control itself and the memory 92 to implement the steps of any of the embodiments described above. The processor 91 may also be referred to as a CPU (Central Processing Unit ). The processor 91 may be an integrated circuit chip with signal processing capabilities. The processor 91 may also be a general purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a Field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. In addition, the processor 91 may be commonly implemented by an integrated circuit chip.

The scheme can ensure the connection speed and save the cost of the server and the network flow.

Based on the same inventive concept, the present invention also provides a computer readable storage medium, please refer to fig. 10, fig. 10 is a schematic structural diagram of an embodiment of the computer readable storage medium provided by the present invention. The computer-readable storage medium 100 stores therein at least one program data 101, the program data 101 for implementing any of the methods described above. In one embodiment, the computer readable storage medium 100 includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

In the several embodiments provided in the present invention, it should be understood that the disclosed method and apparatus may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of modules or units is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.

In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on this understanding, the technical solution of the invention, in essence or a part contributing to the prior art or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium.

The foregoing is only the embodiments of the present invention, and therefore, the patent scope of the invention is not limited thereto, and all equivalent structures or equivalent processes using the descriptions of the present invention and the accompanying drawings, or direct or indirect application in other related technical fields, are included in the scope of the invention.

If the technical scheme of the application relates to personal information, the product applying the technical scheme of the application clearly informs the personal information processing rule before processing the personal information, and obtains independent consent of the individual. If the technical scheme of the application relates to sensitive personal information, the product applying the technical scheme of the application obtains individual consent before processing the sensitive personal information, and simultaneously meets the requirement of 'explicit consent'. For example, a clear and remarkable mark is set at a personal information acquisition device such as a camera to inform that the personal information acquisition range is entered, personal information is acquired, and if the personal voluntarily enters the acquisition range, the personal information is considered as consent to be acquired; or on the device for processing the personal information, under the condition that obvious identification/information is utilized to inform the personal information processing rule, personal authorization is obtained by popup information or a person is requested to upload personal information and the like; the personal information processing rule may include information such as a personal information processor, a personal information processing purpose, a processing mode, and a type of personal information to be processed.

Claims

1. A method for terminal connection, comprising:

the user terminal generates a connection request containing the identification information of the target equipment terminal and sends the connection request to a server so that the server judges whether the target equipment terminal is registered in the server or not based on the identification information of the target equipment terminal;

responding to the server to register the target equipment terminal, and establishing forwarding service communication connection between the user terminal and the target equipment terminal through the server;

the user terminal requests local area network communication connection or network penetration communication detection to the target equipment terminal; and switching forwarding service communication connection between the user terminal and the target equipment terminal to a successful local area network connection or network penetration communication connection in response to the successful local area network connection or network penetration communication detection.

2. The method of terminal connection according to claim 1, wherein the user terminal generates a connection request including identification information of a target device terminal, and transmits the connection request to a server, so that the server judges whether the target device terminal is registered in the server based on the identification information of the target device terminal, comprising:

The logic processing module of the user terminal generates a connection request containing the identification information of the target equipment terminal and sends the connection request to the transmission module of the user terminal;

and the transmission module of the user terminal sends the connection request to the server so that the server judges whether the target equipment terminal is registered in the server or not based on the identification information of the target equipment terminal.

3. The method of terminal connection according to claim 1, wherein the user terminal establishes a forwarding service communication connection with the target device terminal through the server in response to the target device terminal being registered in the server, comprising:

responding to the server registered with the target equipment terminal, and receiving forwarding service resources sent by the server by the user terminal;

and the user terminal establishes forwarding service communication connection with the target equipment terminal based on the forwarding service resource.

4. A method of terminal connection according to claim 3, wherein the user terminal establishes a forwarding service communication connection with the target device terminal based on the forwarding service resource, comprising:

And the user terminal sends a first connection packet to the target equipment terminal based on the forwarding service resource and receives a second connection packet sent by the target equipment terminal based on the forwarding service resource so as to establish the forwarding service communication connection.

5. The method of terminal connection according to claim 1, wherein the user terminal requesting a local area network communication connection or a network penetration communication probe from the target device terminal comprises:

the user terminal performs multicast in a local area network where the user terminal is located based on the identification information of the target equipment terminal, and performs local area network connection with the target equipment terminal based on the identification information of the target equipment terminal in response to the target equipment terminal being located in the local area network;

6. The method of terminal connection according to claim 5, wherein the user terminal requesting network penetration communication probe from the target device terminal comprises:

the user terminal requests the network penetrating equipment address of the target equipment terminal from the server and receives the network penetrating equipment address of the target equipment terminal;

And the user terminal performs multiple network penetration communication detection on the network penetration equipment of the target equipment terminal based on the network penetration equipment address of the target equipment terminal until the network penetration communication detection is successful.

7. The method of terminal connection according to claim 1, wherein the method of terminal connection further comprises:

after the user terminal is successfully connected with the target equipment terminal, the protocol stack module of the user terminal establishes target protocol communication with the protocol stack module of the target equipment terminal by utilizing a connection relation so as to send and/or receive transmission information to the target equipment terminal by utilizing a target protocol;

wherein the connection relationship includes one or more of a forwarding service communication connection relationship, a local area network connection relationship, and a network penetration communication relationship.

8. A method for terminal connection, comprising:

the target equipment terminal registers the identification information of the target equipment terminal to a server;

responding to a connection request which is generated by the server and contains the identification information of the target equipment terminal by the user terminal, and establishing forwarding service communication connection between the target equipment terminal and the user terminal through the server;

The target equipment terminal requests local area network connection or network penetration communication detection to the user terminal; and switching forwarding service communication connection between the user terminal and the target equipment terminal to a successful local area network connection or network penetration communication connection in response to the successful local area network connection or network penetration communication detection.

9. The method of terminal connection according to claim 8, wherein the target device terminal registers identification information of the target device terminal to a server, comprising:

the logic processing module of the target equipment terminal generates registration information containing the identification information of the target equipment terminal and sends the registration information to the transmission module of the target equipment terminal;

10. The method for connecting terminals according to claim 8, wherein the responding to the connection request generated by the server and containing the identification information of the target equipment terminal by the user terminal, the target equipment terminal establishes a forwarding service communication connection with the user terminal through the server, includes:

And responding to the connection request which is generated by the server and contains the identification information of the target equipment terminal by the user terminal, receiving forwarding service resources sent by the server by the target equipment terminal, and establishing forwarding service communication connection with the user terminal based on the forwarding service resources.

11. The method of terminal connection according to claim 10, wherein said establishing a forwarding service communication connection with said user terminal based on said forwarding service resources comprises:

and the target equipment terminal sends a second connection packet to the user terminal based on the forwarding service resource and receives a first connection packet sent by the user terminal based on the forwarding service resource so as to establish the forwarding service communication connection.

12. The method of terminal connection according to claim 8, wherein the method of terminal connection further comprises:

after the user terminal is successfully connected with the target equipment terminal, the protocol stack module of the target equipment terminal establishes target protocol communication with the protocol stack module of the user terminal by utilizing a connection relation so as to send and/or receive transmission information to the user terminal by utilizing a target protocol;

13. A method for terminal connection, comprising:

the server receives the identification information of at least one equipment terminal to register;

the server receives a connection request which is sent by a user terminal and contains the identification information of a target equipment terminal, and judges whether the target equipment terminal is registered in the server or not based on the identification information of the target equipment terminal;

establishing a forwarding service communication connection between the user terminal and the target equipment terminal in response to the registration of the target equipment terminal in the server;

and switching forwarding service communication connection between the user terminal and the target equipment terminal into successful local area network connection or network penetration communication connection in response to successful local area network connection or network penetration communication detection between the user terminal and the target equipment terminal.

14. The method of terminal connection according to claim 13, wherein said establishing a forwarding service communication connection between said user terminal and said target device terminal in response to said target device terminal being registered in said server comprises:

And in response to the registration of the target equipment terminal in the server, the server generates the forwarding service resource and respectively sends the forwarding service resource to the user terminal and the target equipment terminal so that the user terminal and the target equipment terminal establish forwarding service communication connection based on the forwarding service resource.

15. The method for connecting terminals according to claim 13, wherein the server receiving a connection request including identification information of a target device terminal transmitted from a user terminal and judging whether the target device terminal is registered therein based on the identification information of the target device terminal, comprises:

the signaling server of the server receives a connection request which is sent by a user terminal and contains the identification information of a target equipment terminal, and the signaling server judges whether the target equipment terminal is registered or not based on the identification information of the target equipment terminal;

the responding to the server registering the target equipment terminal, generating the forwarding service resource, and respectively sending the forwarding service resource to the user terminal and the target equipment terminal, so that the user terminal and the target equipment terminal establish forwarding service communication connection based on the forwarding service resource, including:

Responding to the signaling server registered with the target equipment terminal, and the signaling server issues an allocation instruction to a forwarding server of the server;

and the forwarding server generates the forwarding service resources after receiving the allocation instruction, and respectively sends the forwarding service resources to the user terminal and the target equipment terminal so that the user terminal and the target equipment terminal establish forwarding service communication connection based on the forwarding service resources.

16. An electronic device, the electronic device comprising: a memory and a processor coupled to each other for executing program instructions stored in the memory to implement the method of terminal connection of any one of claims 1 to 7 or the method of terminal connection of any one of claims 8 to 12 or the method of terminal connection of any one of claims 13 to 15.

17. A computer readable storage medium storing program data executable to implement the method of terminal connection of any one of claims 1 to 7 or the method of terminal connection of any one of claims 8 to 12 or the method of terminal connection of any one of claims 13 to 15.