CN116668454B - Point-to-point transmission system and method based on cloud handshake - Google Patents

Point-to-point transmission system and method based on cloud handshake Download PDF

Info

Publication number
CN116668454B
CN116668454B CN202310716158.8A CN202310716158A CN116668454B CN 116668454 B CN116668454 B CN 116668454B CN 202310716158 A CN202310716158 A CN 202310716158A CN 116668454 B CN116668454 B CN 116668454B
Authority
CN
China
Prior art keywords
information transmission
transmission box
code rate
glasses
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310716158.8A
Other languages
Chinese (zh)
Other versions
CN116668454A (en
Inventor
姜公略
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xingzhe Wujiang Technology Co ltd
Original Assignee
Beijing Xingzhe Wujiang Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xingzhe Wujiang Technology Co ltd filed Critical Beijing Xingzhe Wujiang Technology Co ltd
Priority to CN202310716158.8A priority Critical patent/CN116668454B/en
Publication of CN116668454A publication Critical patent/CN116668454A/en
Application granted granted Critical
Publication of CN116668454B publication Critical patent/CN116668454B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/104Peer-to-peer [P2P] networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/398Synchronisation thereof; Control thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention discloses a point-to-point transmission system and a point-to-point transmission method based on cloud handshake, wherein an information transmission box and AR glasses respectively send a connection application to a cloud server, public network IP addresses of the information transmission box and the AR glasses are verified on the cloud server, and if the verification is passed, equipment information of the AR glasses is used as a connection permission to establish connection with the information transmission box; the AR glasses send data packets to the information transmission box, so that feedback information sent by the information transmission box is obtained; the AR glasses dynamically adjust the sending code rate through feedback information, further encode the control instruction to obtain an encoded data packet, send the encoded data packet to the information transmission box, and decode the encoded data packet by the information transmission box to obtain the control instruction, so that remote control of the AR glasses is finally realized.

Description

Point-to-point transmission system and method based on cloud handshake
Technical Field
The present invention relates to the field of mobile communications, and in particular, to a point-to-point transmission system and method based on cloud handshake.
Background
In the traditional wide area network transmission mode, a cloud server is mostly used for realizing auxiliary point-to-point transmission, for example, AR (augmented reality) glasses are connected with the cloud server, the cloud server is provided with a fixed public network IP, the cloud server is connected with a PC (personal computer) through a router, the router is also provided with the fixed public network IP, after the AR glasses and the PC are subjected to first cloud handshake, corresponding communication protocols are built in each other, and finally remote point-to-point signal transmission of the AR glasses to the PC on the cloud server is realized;
However, in reality, many families do not have a public network IP, and then need to connect through a dynamic public network IP, connect to a cloud server through AR glasses, then connect to a local area network server through the cloud server, the local area network server has a fixed public network IP, connect to a router through the local area network server, the router has a dynamic IP distributed by the local area network server, and finally connect to a PC through the router, so as to realize remote point-to-point signal transmission of the AR glasses to the PC;
the repeated signal forwarding results in slow connection speed, network attack can occur in connection, data threat is caused, and packet loss phenomenon easily occurs in the connection process;
when the AR glasses are remotely controlled, data loss of different degrees can be caused by the receiving code rate of the network information transmission box, the network load level, the packet loss trend level and the code rate of the data packet sent by the AR glasses, so that corresponding control cannot be obtained.
Disclosure of Invention
The invention aims to provide a point-to-point transmission system and method based on cloud handshake, which solve the technical problems pointed out in the prior art.
The invention provides a point-to-point transmission system based on cloud handshake, which comprises an information transmission box, a cloud server and AR glasses;
The information transmission box is connected with the AR glasses through the cloud server;
the information transmission box comprises a feedback module, a receiving code rate monitoring module and a decoding module;
the AR glasses comprise a sending module, a coding module, a sending code rate monitoring module and a sending code rate adjusting module;
the cloud server comprises a verification module;
the verification module is used for establishing a public network list, acquiring a transmission request of the information transmission box, acquiring a public network IP address of the information transmission box according to the transmission request, and acquiring a plurality of AR glasses public network IP addresses associated with the public network IP address of the information transmission box;
the verification module is further configured to obtain a connection request of the current AR glasses, and obtain a public network IP address of the current AR glasses and device information of the current AR glasses according to the connection request;
the verification module is further configured to verify a plurality of AR glasses public network IP addresses associated with the information transmission box public network IP address with the current AR glasses public network IP address, write the current AR glasses device information into a list if the verification is passed, and use the current AR glasses device information as a connection permission to connect with the information transmission box;
The coding module is used for coding the control instruction to obtain coded data;
the sending code rate monitoring module is used for monitoring the actual sending code rate of each data packet;
the sending module is used for sending a data packet to the information transmission box according to the sending code rate of the sending code rate adjusting module;
the decoding module is used for decoding the data packet to obtain a control instruction, and the AR glasses are used for remotely controlling the PC which is also connected with the information transmission box locally;
the feedback module is used for sending feedback information to the AR glasses after receiving the data packet; the feedback information comprises a data packet arrival result and a data packet arrival time;
the sending code rate adjusting module is used for calculating a dynamically adjusted sending code rate according to the feedback information of the feedback module and the receiving code rate of the information transmission box in the receiving code rate monitoring module;
the receiving code rate monitoring module is used for monitoring the receiving code rate of the information transmission box.
Preferably, the device information of the AR glasses includes device code, device model and number information of the AR glasses.
Preferably, the remote control of the PC corresponding to the information transmission box on the cloud server by the AR glasses through the information transmission box includes the following operation steps:
The AR glasses dynamically adjust the code rate according to the estimated receiving code rate, the network load level and the packet loss trend level;
coding the control instruction according to the code rate to obtain a coded data packet;
and sending the encoded data packet to an information transmission box, decoding by the information transmission box, and obtaining a control instruction to finally realize remote control of the PC.
Correspondingly, the invention also provides a point-to-point transmission method based on cloud handshake, which comprises the following operation steps:
the information transmission box sends a signal transmission request to a cloud server through point-to-point transmission, and the cloud server acquires the public network IP address of the information transmission box and records the public network IP address of the information transmission box in a public network list; the cloud server interacts with a public network list, and acquires an AR glasses public network IP address associated with the information transmission box public network IP address according to the information transmission box public network IP address;
the AR glasses send a connection request to a cloud server through point-to-point transmission, the cloud server obtains an AR glasses public network IP address and equipment information of the AR glasses, and verification is carried out according to the AR glasses public network IP address associated with the information transmission box public network IP address;
If the public network IP address passes verification, the cloud server writes the equipment information of the AR glasses into a public network list, and takes the equipment information as a connection permission;
and the cloud server establishes connection with the information transmission box through point-to-point transmission by using the connection permission, and remotely controls a PC (personal computer) which is also locally connected with the information transmission box through the information transmission box connected with the cloud server through the AR glasses by dynamically adjusting the code rate.
Preferably, the AR glasses dynamically adjust the code rate according to the estimated receiving code rate, the network load level, and the packet loss trend level, and the method comprises the following steps:
firstly, calculating an estimated receiving code rate of an information transmission box according to the receiving code rate of the information transmission box;
the AR glasses send data packets to the information transmission box, record the sizes of the data packets and acquire the sending code rate of the current data packets; the information transmission box acquires the data packet and then sends feedback information to the AR glasses, wherein the feedback information comprises a data packet arrival result and the arrival time of the data packet; calculating a sample value of the receiving code rate of the information transmission box in a preset time period according to the size of the data packet and feedback information;
Estimating the estimated receiving code rate of the information transmission box through a Bayesian estimation algorithm based on the sample value of the receiving code rate of the information transmission box;
the AR glasses estimate network load levels;
the AR glasses calculate the packet loss trend grade;
calculating according to the estimated receiving code rate, the network load level and the packet loss trend level of the information transmission box to obtain an AR glasses sending code rate estimated value;
and taking the AR glasses sending the code rate estimated value as the code rate which is dynamically adjusted in real time.
Preferably, the estimated receiving code rate of the information transmission box is estimated according to the receiving code rate of the information transmission box in a time period;
the preset time period is a time period used by the AR glasses to receive feedback information after the AR glasses send a plurality of data packets to the information transmission box.
Preferably, the estimating the estimated receiving code rate of the information transmission box by using a bayesian estimating algorithm based on the sample value of the receiving code rate of the information transmission box specifically includes the following operation steps:
presetting a receiving code rate sample value of the information transmission box and an estimated receiving code rate difference absolute value threshold value a of the information transmission box; calculating the estimated receiving code rate of the information transmission box;
Calculating the absolute value of the actual difference between the sample value of the receiving code rate of the information transmission box and the estimated receiving code rate of the information transmission box; and if the actual difference absolute value is larger than the difference absolute value threshold value a, screening out the current estimated receiving code rate of the information transmission box, and recalculating to obtain the new estimated receiving code rate of the information transmission box.
Preferably, the calculation mode of the estimated receiving code rate of the information transmission box is as follows:
probability in the case of receiving a sample value of the code rate;
p (BA) is the probability of the information transmission box receiving code rate sample value under the condition of the obtained estimated receiving code rate of the information transmission box;
p (A) is the prior probability of the estimated receiving code rate of the information transmission box;
p (B) is the prior probability of the information transmission box receiving the code rate sample value.
Compared with the prior art, the embodiment of the invention has at least the following technical advantages:
according to analysis of the point-to-point transmission system and the point-to-point transmission method based on the cloud handshake, when the system and the method are specifically applied, a connection request is sent to a cloud server through an information transmission box, and the cloud server acquires an information transmission box public network IP address and a plurality of AR glasses public network IP addresses associated with the information transmission box public network IP address;
The AR glasses send a connection request to a cloud server, and the cloud server acquires a public network IP address of the AR glasses and equipment information of the AR glasses; the method comprises the steps that a public network IP address of an information transmission box and a public network IP address of AR glasses are verified through a verification module, when verification is successful, equipment information of the AR glasses is used as connection permission to be connected with the information transmission box, and finally a control instruction is sent to the information transmission box through the AR glasses, so that a PC (personal computer) for locally connecting the information transmission box is remotely controlled; the two are connected separately, so that the information transmission box is connected with the corresponding AR glasses (terminal equipment) more favorably, the privacy is guaranteed, the stability of signal transmission can be improved, and the packet loss rate is reduced.
In the specific implementation, each information transmission box corresponds to one or a plurality of AR glasses, and in the public network list, the information transmission boxes are associated with the public network IP addresses of the AR glasses, so that when the AR glasses send out an AR glasses connection application associated with a signal transmission request to a cloud server, whether the public network IP addresses of the AR glasses are consistent with the public network IP addresses of a certain terminal device in a plurality of AR glasses associated with the information transmission boxes in the public network list can be verified, and the authenticity of connection data is ensured; writing the terminal equipment identifier into a list of the public network, establishing an association relation with the public network IP address of the information transmission box, namely locking the uniqueness of the terminal equipment identifier, and enabling the public network IP address of the information transmission box to be used for subsequent verification so as to avoid the possibility of identity impersonation; the public key and the private key are used for encryption, so that the safety performance is further improved, and information leakage or connection by other devices in the information transmission process is avoided;
When the AR glasses are specifically controlled remotely, after the AR glasses send data packets to the information transmission boxes, the information transmission boxes want the AR glasses to send feedback information, the AR glasses acquire the information transmission box receiving code rate, the network load level and the packet loss trend according to the feedback information, and dynamically adjust the sending coding code rate according to the information transmission box receiving code rate, the network load level and the packet loss trend, so that the packet loss rate can be greatly reduced, and the data transmission stability is ensured; and encoding the control instruction according to the transmission code rate to obtain encoded data, transmitting the encoded data to the information transmission box through the cloud server, and decoding the encoded data by the information transmission box to obtain the control instruction, thereby finally realizing remote control of the AR glasses.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the present invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
Fig. 1 is a diagram of an overall architecture of a point-to-point transmission system based on cloud handshake according to a first embodiment of the present invention;
fig. 2 is a schematic operation flow diagram of a point-to-point transmission method based on cloud handshake according to a second embodiment of the present invention;
fig. 3 is a schematic operation flow diagram of AR remote control in a point-to-point transmission method based on cloud handshake according to a second embodiment of the present invention;
fig. 4 is a schematic operation flow diagram of dynamically adjusting code rate in a point-to-point transmission method based on cloud handshake according to a second embodiment of the present invention;
fig. 5 is a schematic diagram of a flow chart of estimating a receiving code rate of an estimated information transmission box in a point-to-point transmission method based on cloud handshake according to a second embodiment of the present invention.
Reference numerals: an information transmission box 10; cloud server 20; AR glasses 30; a feedback module 11; a receiving code rate monitoring module 12; a decoding module 13; a transmission module 31; an encoding module 32; a transmission code rate monitoring module 33; a transmission code rate adjustment module 34; a verification module 21.
Detailed Description
The following description of the embodiments of the present invention will be made apparent and fully in view of the accompanying drawings, in which some, but not all embodiments of the invention are shown. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The invention will now be described in further detail with reference to specific examples thereof in connection with the accompanying drawings.
Example 1
As shown in fig. 1, the present invention provides a point-to-point transmission system based on cloud handshake, which includes an information transmission box 10, a cloud server 20, and AR glasses 30;
the information transmission box 10 is connected 30 with the AR glasses through the cloud server 20;
the information transmission box 10 comprises a feedback module 11, a receiving code rate monitoring module 12 and a decoding module 13;
the AR glasses 30 comprise a sending module 31, a coding module 32, a sending code rate monitoring module 33 and a sending code rate adjusting module 34;
the cloud server 20 comprises a verification module 21;
the verification module 21 is configured to establish a public network list, obtain a transmission request of the information transmission box 10, obtain a public network IP address of the information transmission box according to the transmission request, and obtain a plurality of AR glasses public network IP addresses associated with the public network IP address of the information transmission box;
the verification module 21 is further configured to obtain a connection request of the current AR glasses 30, and obtain a public IP address of the current AR glasses and device information of the current AR glasses according to the connection request;
The verification module 21 is further configured to verify that the public network IP addresses of the plurality of AR glasses 30 associated with the public network IP address of the information transmission box 10 and the public network IP address of the current AR glasses 30, write the device information of the current AR glasses into a list if the verification is passed, and use the device information of the current AR glasses as a connection permission to connect with the information transmission box;
the encoding module 32 is configured to encode the control instruction to obtain encoded data;
the sending code rate monitoring module 33 is configured to monitor an actual sending code rate of each data packet;
the sending module 31 is configured to send a data packet to the information transmission box according to a sending code rate of the sending code rate adjusting module;
the decoding module 13 is configured to decode the data packet to obtain a control instruction, so as to implement remote control of a PC that is also locally connected to the information transmission box by the AR glasses;
the feedback module 11 is configured to send feedback information to the AR glasses after receiving the data packet; the feedback information comprises a data packet arrival result and a data packet arrival time;
the sending code rate adjusting module 34 is configured to calculate a dynamically adjusted sending code rate according to feedback information of the feedback module and a receiving code rate of the information transmission box in the receiving code rate monitoring module 12;
The receiving code rate monitoring module 12 is configured to monitor a receiving code rate of the information transmission box.
In summary, in the point-to-point transmission system based on the cloud handshake provided by the invention, when the system is specifically applied, a connection request is sent to a cloud server through an information transmission box, and the cloud server acquires an information transmission box public network IP address and a plurality of AR glasses public network IP addresses associated with the information transmission box public network IP address;
the AR glasses send a connection request to a cloud server, and the cloud server acquires a public network IP address of the AR glasses and equipment information of the AR glasses; the method comprises the steps that a public network IP address of an information transmission box and a public network IP address of AR glasses are verified through a verification module, when verification is successful, equipment information of the AR glasses is used as connection permission to be connected with the information transmission box, and finally, a control instruction is sent to the information transmission box through the AR glasses, so that a remote control PC is realized; the two are connected separately, so that the information transmission box is connected with the corresponding AR glasses (terminal equipment) more favorably, the privacy is guaranteed, the stability of signal transmission can be improved, and the packet loss rate is reduced.
In the specific implementation, each information transmission box corresponds to one or a plurality of AR glasses, and in the public network list, the information transmission boxes are associated with the public network IP addresses of the AR glasses, so that when the AR glasses send out an AR glasses connection application associated with a signal transmission request to a cloud server, whether the public network IP addresses of the AR glasses are consistent with the public network IP addresses of a certain terminal device in a plurality of AR glasses associated with the information transmission boxes in the public network list can be verified, and the authenticity of connection data is ensured; writing the terminal equipment identifier into a list of the public network, establishing an association relation with the public network IP address of the information transmission box, namely locking the uniqueness of the terminal equipment identifier, and enabling the public network IP address of the information transmission box to be used for subsequent verification so as to avoid the possibility of identity impersonation; the public key and the private key are used for encryption, so that the safety performance is further improved, and information leakage or connection by other devices in the information transmission process is avoided;
When the AR glasses are specifically controlled remotely, after the AR glasses send data packets to the information transmission boxes, the information transmission boxes send feedback information to the AR glasses, the AR glasses obtain the information transmission box receiving code rate, the network load level and the packet loss trend according to the feedback information, and dynamically adjust the sending coding code rate according to the information transmission box receiving code rate, the network load level and the packet loss trend, so that the packet loss rate can be greatly reduced, and the data transmission stability is ensured; and coding the control instruction according to the sending code rate to obtain coded data, after the coded data is sent to the information transmission box through the cloud server, decoding the coded data by the information transmission box to obtain the control instruction, and finally realizing remote control of a PC (personal computer) which is also locally connected with the information transmission box through the information transmission box connected with the cloud server through the AR glasses (terminal equipment) by dynamically adjusting the code rate.
Example two
As shown in fig. 2, correspondingly, the invention further provides a point-to-point transmission method based on cloud handshake, which comprises the following operation steps:
step S10: the information transmission box sends a signal transmission request to a cloud server through point-to-point transmission, and the cloud server acquires the public network IP address of the information transmission box and records the public network IP address of the information transmission box in a public network list; the cloud server interacts with the public network list, and obtains the AR glasses (terminal equipment) public network IP address associated with the information transmission box public network IP address according to the information transmission box public network IP address. The public network list stores the association relation between the information transmission box and a plurality of additionally associated AR glasses, wherein the association relation is that the public network IP address of the information transmission box corresponds to the public network IP addresses of a plurality of AR glasses; when the AR glasses and the information transmission box establish initial handshake, the association relationship of the public network IP addresses of the AR glasses can be uploaded to a public network list of the cloud server;
In general, the information transmission box has a plurality of associated AR glasses (terminal devices), so when the cloud server verifies the public IP address of the information transmission box, the public IP address of the AR glasses (terminal devices) associated with the information transmission box and built in the information transmission box is obtained;
in specific implementation, point-to-point transmission is a communication protocol, two parties requiring information interaction have fixed public network IP addresses and ports and are in one-to-one correspondence with local terminals, so that the public network IP addresses of the information transmission boxes are fixed under the condition that the point-to-point transmission protocol is applicable to a cloud server, thereby writing the public network IP addresses of all effective information transmission boxes into a public network list, and the cloud server can verify the authenticity of the public network IP addresses of the information transmission boxes through interaction with the public network list when the information transmission boxes perform signal transmission requests, so that the possibility of identity impersonation is avoided.
Step S20: the method comprises the steps that an AR (terminal equipment) sends a connection request to a cloud server through point-to-point transmission (the connection request refers to the fact that the AR (terminal equipment) sends a connection request with a current information transmission box to the cloud server), the cloud server obtains an AR (terminal equipment) public network IP address and equipment information of the AR (terminal equipment), and verification is carried out according to the AR (terminal equipment) public network IP address associated with the AR (terminal equipment) public network IP address and the information transmission box public network IP address;
The equipment information of the AR glasses (of the terminal equipment) comprises equipment codes, equipment models and number information of the AR glasses;
in particular implementations, in order to avoid identity impersonation caused by disclosure of the public network IP address of the information transmission boxes, the public network IP address of each information transmission box is associated with a public network IP address of an AR glasses (terminal device), and the AR glasses (terminal device) are mainly devices attached to the information transmission boxes, that is, the information transmission boxes are mainly used for providing connection of the AR glasses (terminal device), for example, the public network IP, the device model, the number, and the like of the AR glasses, and the AR glasses (terminal device) are mainly used for remotely controlling the PC through the information transmission boxes. The two are connected separately, so that the information transmission box is connected with the corresponding AR glasses (terminal equipment) more favorably, the privacy is guaranteed, the stability of signal transmission can be improved, and the packet loss rate is reduced.
In a specific implementation, each information transmission box corresponds to one or a plurality of AR glasses (terminal equipment), and in the public network list, the information transmission boxes and the public network IP addresses of the AR glasses (terminal equipment) are associated, so when the AR glasses (terminal equipment) send out an AR glasses (terminal equipment) connection application associated with a signal transmission request to a cloud server, whether the public network IP addresses of the AR glasses (terminal equipment) are consistent with the public network IP addresses of one terminal equipment in a plurality of AR glasses (terminal equipment) associated with the information transmission boxes in the public network list can be verified, and the authenticity of connection data is ensured.
In the embodiment of the invention, the signal transmission request comprises a terminal equipment identifier (the terminal equipment identifier is terminal equipment information), the information transmission box encrypts the signal transmission request by using a public key and then sends the encrypted signal transmission request to the cloud server, and the AR glasses (terminal equipment) decrypt by using a corresponding private key; the information transmission box encrypts the public network IP address of the information transmission box, the connection request of the information transmission box, the PC related to the information transmission box and the like through a public key, the AR glasses encrypt the public network IP address of the AR glasses and the equipment information (the equipment model, the number and other information) of the AR glasses through a private key, the information encrypted by the AR glasses decrypts the information encrypted by the information transmission box, namely, the information transmission box is matched, and the AR glasses can be connected with the information transmission box after the decryption is successful.
In the embodiment of the invention, after the information transmission box and the IP address of the AR glasses (terminal equipment) pass verification, the cloud server interacts with the public network, the identification of the AR glasses (terminal equipment) is written into the list, and the association relation between the AR glasses (terminal equipment) and the IP address of the information transmission box is established.
In a specific implementation, the main body actually performing the IO processing is not an information transmission box, or the user does not typically perform the IO processing through the information transmission box, but typically performs the IO processing through a PC device connected to the information transmission box, and the terminal device identifier refers to a specific identifier of a non-PC device used by the user to process a service, for example, an AR glasses (terminal device) code, where the code has uniqueness. Writing the terminal equipment identifier into a list of the public network, establishing an association relation with the public network IP address of the information transmission box, namely locking the uniqueness of the terminal equipment identifier, and enabling the public network IP address of the information transmission box to be used for subsequent verification, thereby avoiding the possibility of identity impersonation.
In the implementation, the public key and the private key are used for encryption, so that the safety performance is further improved, and information leakage or connection by other devices in the information transmission process is avoided.
Step S30: if the verification of the public network IP address (the public network IP address of the information transmission box and the public network IP address of the AR glasses (terminal equipment)) is passed, the cloud server writes the equipment information (namely equipment codes, equipment models and serial numbers of the AR glasses) of the AR glasses (the terminal equipment) into a public network list, and takes the equipment information as a connection permission;
the equipment information of the AR glasses (terminal equipment) comprises equipment codes, equipment models and number information of the AR glasses;
step S40: and the cloud server establishes connection with the information transmission box through point-to-point transmission by the connection permission, and remotely controls a PC (personal computer) which is also locally connected with the information transmission box through the information transmission box connected with the cloud server through the AR (terminal equipment) by dynamically adjusting the code rate.
In summary, a connection request is sent to a cloud server through an information transmission box, and the cloud server acquires an information transmission box public network IP address and a plurality of AR glasses public network IP addresses associated with the information transmission box public network IP address;
The AR glasses send a connection request to a cloud server, and the cloud server acquires a public network IP address of the AR glasses and equipment information of the AR glasses; the method comprises the steps that a public network IP address of an information transmission box and a public network IP address of AR glasses are verified through a verification module, when verification is successful, equipment information of the AR glasses is used as connection permission to be connected with the information transmission box, and finally, a control instruction is sent to the information transmission box through the AR glasses, so that a remote control PC is realized;
it should be noted that, when the AR glasses send information to the information transmission box, the information sent by the AR glasses will have more or less packet loss rate due to the sending code rate of the AR glasses under the condition of different receiving code rates of the information transmission box, different network loads and different packet loss trends; in the embodiment of the invention, the sending code rate of the AR glasses is dynamically adjusted according to the estimated receiving code rate, the network load level and the packet loss trend of the information transmission box, so that the technical effect of reducing the packet loss rate is achieved.
Specifically, as shown in fig. 3, in step S40, the AR glasses (terminal device) remotely control the PC connected locally to the information transmission box by dynamically adjusting the code rate at the information transmission box connected to the cloud server, including the following steps:
Step S41: the AR glasses dynamically adjust the code rate according to the estimated receiving code rate, the network load level and the packet loss trend level;
step S42: coding the control instruction according to the code rate to obtain a coded data packet;
step S43: and sending the encoded data packet to an information transmission box, decoding by the information transmission box, and obtaining a control instruction to finally realize remote control of the PC.
Specifically, as shown in fig. 4, in step S41, the AR glasses dynamically adjust the code rate according to the estimated receiving code rate, the network load level, and the packet loss trend level, and the method includes the following steps:
step S411: firstly, calculating an estimated receiving code rate of an information transmission box according to the receiving code rate of the information transmission box;
the AR glasses send data packets to the information transmission box, record the sizes of the data packets (the sizes of the data packets refer to the sizes of memory spaces occupied by the data packets), and acquire the current data packet sending code rate; the information transmission box acquires the data packet and then sends feedback information to the AR glasses, wherein the feedback information comprises the arrival result (the arrival result comprises arrival and non-arrival) of the data packet and the arrival time of the data packet; calculating a sample value of the receiving code rate of the information transmission box in a preset time period according to the size of the data packet and feedback information;
Step S412: estimating the estimated receiving code rate of the information transmission box through a Bayesian estimation algorithm based on the sample value of the receiving code rate of the information transmission box;
the data packet sending code rate is a real-time sending code rate, and when the sending code rate is estimated subsequently, the sending code rate is required to be used as a reference value; the estimated receiving code rate of the information transmission box is estimated according to the receiving code rate of the information transmission box in a time period; the preset time period refers to a time period used by the AR glasses to receive feedback after the information transmission box sends the data packets to the information transmission box in a preset mode;
the Bayesian estimation (Bayesian estimation) combines new evidence with previous prior probabilities using Bayesian theorem to obtain new probabilities. The Bayesian algorithm is a classification method of statistics, and the receiving code rate of the information transmission box is estimated through the known receiving code rate of the information transmission box; meanwhile, if the estimated receiving code rate of the information transmission box is calculated to be far different from the current receiving code rate of the information transmission box, the estimated receiving code rate of the information transmission box is screened out (the estimated receiving code rate of the information transmission box is occasionally subjected to other factors to cause that the estimated value is greatly different from the actual value, and the estimated receiving code rate of the information transmission box is screened out because the estimated receiving code rate of the information transmission box is not influenced by the other factors under normal conditions).
Step S413: the AR glasses estimate network load levels;
it should be noted that, in the embodiment of the present invention, the AR glasses group the transmitted data to obtain a plurality of data packet groups, send the data packet groups to the information transmission box to obtain feedback information of the information transmission box, and estimate the network load condition by a trend linear algorithm according to the transmission delay of two adjacent data packet groups in the feedback information of the information transmission box (the transmission delay is calculated by the time of the two adjacent data packet groups in the feedback of the information transmission box from the AR glasses to the information transmission box); the network load levels are respectively as follows: high load, normal, low load;
step S414: the AR glasses calculate the packet loss trend grade;
it should be noted that, in the embodiment of the present invention, the AR glasses acquire the feedback information, and calculate the packet loss rate according to the arrival result of the packet in the feedback information; calculating a packet loss trend grade according to the packet loss rate and the data packet sending code rate; the packet loss trend grades are respectively as follows: the packet loss is increased, the packet loss is maintained and the packet loss is reduced;
step S415: calculating according to the estimated receiving code rate, the network load level and the packet loss trend level of the information transmission box to obtain an AR glasses sending code rate estimated value;
Step S415: and taking the AR glasses sending the code rate estimated value as the code rate which is dynamically adjusted in real time.
It should be noted that, the sending code rate of the AR glasses refers to the code rate of the data packet to be sent, which is an estimated value obtained by calculating according to the estimated receiving code rate, the network load level, and the packet loss trend level of the information transmission box, and is used for the code rate when the data packet to be sent is sent, and is dynamically adjusted according to the receiving code rate, the network load level, and the packet loss trend level of the information transmission box.
In the embodiment of the invention, the estimated receiving code rate of the information transmission box is an estimated value obtained by using a Bayesian estimation algorithm through the receiving code rate of the information transmission box; the network load level is an estimated value obtained by estimating the time of each data packet in feedback information of the information transmission box through a trend linear algorithm; the packet loss trend is an accurate value obtained by calculating the arrival result of each data packet and the sending code rate of the data packet in the feedback information of the information transmission box; therefore, the sending code rate of the AR glasses obtained by calculating the estimated receiving code rate, the estimated network load level and the packet loss trend level of the information transmission box is taken as an estimated value.
Specifically, as shown in fig. 5, in step S412, the estimated reception code rate of the information transmission box is estimated by a bayesian estimation algorithm based on the sample value of the reception code rate of the information transmission box, and specifically includes the following steps:
step S4121: presetting a receiving code rate sample value of the information transmission box and an estimated receiving code rate difference absolute value threshold value a of the information transmission box; calculating the estimated receiving code rate of the information transmission box;
step S4122: calculating the absolute value of the actual difference between the sample value of the receiving code rate of the information transmission box and the estimated receiving code rate of the information transmission box; and if the actual difference absolute value is larger than the difference absolute value threshold value a, screening out the current estimated receiving code rate of the information transmission box, and recalculating to obtain the new estimated receiving code rate of the information transmission box.
The calculation mode of the estimated receiving code rate of the information transmission box is as follows:
probability in the case of receiving a sample value of the code rate; (namely, the posterior probability is calculated, under the condition that the sample value of the information transmission box receiving code rate is already obtained, the probability of the estimated receiving code rate of the information transmission box is calculated, and under the condition that the sample value of the information transmission box receiving code rate is obtained;
P (BA) is the probability of the information transmission box receiving code rate sample value under the condition of the obtained estimated receiving code rate of the information transmission box; (namely likelihood probability, under the condition that the estimated receiving code rate of the information transmission box is calculated, the probability that the information transmission box receives the code rate sample value is calculated, and under the condition that the estimated receiving code rate of the information transmission box is calculated;
p (A) is the prior probability of the estimated receiving code rate of the information transmission box;
p (B) is the prior probability of the code rate sample value received by the information transmission box;
it should be noted that, based on the sample value of the information transmission box receiving code rate, estimating the estimated receiving code rate of the information transmission box by using a bayesian estimation algorithm, taking into account a receiving code rate monitoring module built in the information transmission box, obtaining the actual information transmission box receiving code rate through the receiving code rate monitoring module, that is, obtaining the sample value of the information transmission box receiving code rate, and estimating the estimated receiving code rate of the subsequent information transmission box through the sample value of the information transmission box receiving code rate, thereby using the estimated receiving code rate as a reference value of the estimated value of the AR glasses sending code rate in the subsequent step; and after the subsequent receiving code rate monitoring module obtains the new receiving code rate of the information transmission box, comparing the new receiving code rate with the estimated receiving code rate of the information transmission box, if the estimated receiving code rate of the information transmission box is far away, screening the estimated receiving code rate of the information transmission box, and recalculating the estimated receiving code rate of the information transmission box according to the sample value of the new receiving code rate of the information transmission box.
In summary, according to the point-to-point transmission system and method based on the cloud handshake provided by the embodiment of the invention, a connection request is sent to a cloud server through an information transmission box, and the cloud server acquires an information transmission box public network IP address and a plurality of AR glasses public network IP addresses associated with the information transmission box public network IP address;
the AR glasses send a connection request to a cloud server, and the cloud server acquires a public network IP address of the AR glasses and equipment information of the AR glasses; the method comprises the steps that a public network IP address of an information transmission box and a public network IP address of AR glasses are verified through a verification module, when verification is successful, equipment information of the AR glasses is used as connection permission to be connected with the information transmission box, and finally, a control instruction is sent to the information transmission box through the AR glasses, so that a remote control PC is realized; the two are connected separately, so that the information transmission box is connected with the corresponding AR glasses (terminal equipment) more favorably, the privacy is guaranteed, the stability of signal transmission can be improved, and the packet loss rate is reduced.
In the specific implementation, each information transmission box corresponds to one or a plurality of AR glasses, and in the public network list, the information transmission boxes are associated with the public network IP addresses of the AR glasses, so that when the AR glasses send out an AR glasses connection application associated with a signal transmission request to a cloud server, whether the public network IP addresses of the AR glasses are consistent with the public network IP addresses of a certain terminal device in a plurality of AR glasses associated with the information transmission boxes in the public network list can be verified, and the authenticity of connection data is ensured; writing the terminal equipment identifier into a list of the public network, establishing an association relation with the public network IP address of the information transmission box, namely locking the uniqueness of the terminal equipment identifier, and enabling the public network IP address of the information transmission box to be used for subsequent verification so as to avoid the possibility of identity impersonation; the public key and the private key are used for encryption, so that the safety performance is further improved, and information leakage or connection by other devices in the information transmission process is avoided;
When the AR glasses are specifically controlled remotely, after the AR glasses send data packets to the information transmission boxes, the information transmission boxes want the AR glasses to send feedback information, the AR glasses acquire the information transmission box receiving code rate, the network load level and the packet loss trend according to the feedback information, and dynamically adjust the sending coding code rate according to the information transmission box receiving code rate, the network load level and the packet loss trend, so that the packet loss rate can be greatly reduced, and the data transmission stability is ensured; and encoding the control instruction according to the transmission code rate to obtain encoded data, transmitting the encoded data to the information transmission box through the cloud server, and decoding the encoded data by the information transmission box to obtain the control instruction, thereby finally realizing remote control of the AR glasses.
The transmission coding rate refers to the ratio of the coding rate (also called coding rate or coding efficiency) to the useful part (non-redundancy) of the data stream; that is, if the encoding rate of the AR glasses is k/n, for every k bits of useful information, the encoder generates n bits of data in total, where n-k is redundant;
in general, the larger the encoding rate is, the higher the information transmission efficiency is; when the information transmission box has lower receiving code rate, higher network load level (namely network load is overlarge) and serious packet loss trend (namely packet loss rate is large), more redundant information is needed to be added to ensure that a receiving end can correctly demodulate signals, the more redundant information means low coding rate, and the lowest coding rate is that one code needs to be added with 3 redundant codes, namely 1/4 code; when the information transmission box has higher receiving code rate, lower network load level (namely small network load or no load) and better packet loss trend (namely small packet loss rate or no packet loss), the information transmission box can demodulate the information with fewer redundancy check bits, so that the coding rate can be improved; the system can select proper coding rate according to actual condition change, so that users with good channel quality can obtain higher rate, average throughput rate is improved, and further packet loss rate is guaranteed to be reduced and information transmission is stable.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; modifications of the technical solutions described in the foregoing embodiments, or equivalent substitutions of some or all of the technical features thereof, may be made by those of ordinary skill in the art; such modifications and substitutions do not depart from the spirit of the invention.

Claims (7)

1. The point-to-point transmission system based on the cloud handshake is characterized by comprising an information transmission box, a cloud server and AR glasses;
the information transmission box is connected with the AR glasses through the cloud server;
the information transmission box comprises a feedback module, a receiving code rate monitoring module and a decoding module;
the AR glasses comprise a sending module, a coding module, a sending code rate monitoring module and a sending code rate adjusting module;
the cloud server comprises a verification module;
the verification module is used for establishing a public network list, acquiring a transmission request of the information transmission box, acquiring a public network IP address of the information transmission box according to the transmission request, and acquiring a plurality of AR glasses public network IP addresses associated with the public network IP address of the information transmission box;
The verification module is further configured to obtain a connection request of the current AR glasses, and obtain a public network IP address of the current AR glasses and device information of the current AR glasses according to the connection request;
the verification module is further configured to verify a plurality of AR glasses public network IP addresses associated with the information transmission box public network IP address with the current AR glasses public network IP address, write the current AR glasses device information into a list if the verification is passed, and use the current AR glasses device information as a connection permission to connect with the information transmission box;
the coding module is used for coding the control instruction to obtain coded data;
the sending code rate monitoring module is used for monitoring the actual sending code rate of each data packet;
the sending module is used for sending a data packet to the information transmission box according to the sending code rate of the sending code rate adjusting module;
the decoding module is used for decoding the data packet to obtain a control instruction, and the AR glasses are used for remotely controlling the PC which is also connected with the information transmission box locally;
the feedback module is used for sending feedback information to the AR glasses after receiving the data packet; the feedback information comprises a data packet arrival result and a data packet arrival time;
The sending code rate adjusting module is used for calculating a dynamically adjusted sending code rate according to the feedback information of the feedback module and the receiving code rate of the information transmission box in the receiving code rate monitoring module;
the receiving code rate monitoring module is used for monitoring the receiving code rate of the information transmission box.
2. The point-to-point transmission method based on the cloud handshake is characterized by comprising the following operation steps:
the information transmission box sends a signal transmission request to a cloud server through point-to-point transmission, and the cloud server acquires a public network IP address of the information transmission box and records the public network IP address of the information transmission box in a public network list; the cloud server accesses the public network list, and obtains an AR glasses public network IP address associated with the information transmission box public network IP address according to the information transmission box public network IP address;
the AR glasses send a connection request to a cloud server through point-to-point transmission, the cloud server obtains an AR glasses public network IP address and equipment information of the AR glasses, and verification is carried out according to the AR glasses public network IP address associated with the information transmission box public network IP address;
if the AR glasses public network IP address passes verification, the cloud server writes equipment information of the AR glasses into a public network list, and takes the equipment information as a connection permission;
The cloud server establishes connection between the AR glasses corresponding to the connection permission and the information transmission box through point-to-point transmission, and remotely controls a PC (personal computer) which is also locally connected with the information transmission box through the AR glasses and the information transmission box connected with the cloud server through dynamic adjustment of code rate;
the remote control of the PC corresponding to the information transmission box is carried out on the cloud server by the AR glasses through the information transmission box, and the remote control method comprises the following operation steps:
the AR glasses dynamically adjust the code rate according to the estimated receiving code rate, the network load level and the packet loss trend level of the information transmission box;
coding the control instruction according to the code rate to obtain a coded data packet;
and sending the encoded data packet to an information transmission box, decoding by the information transmission box, and obtaining a control instruction to finally realize remote control of the PC.
3. The point-to-point transmission method based on cloud handshake according to claim 2, wherein the device information of the AR glasses includes device code, device model and number information of the AR glasses.
4. The point-to-point transmission method based on cloud handshake according to claim 3, wherein the AR glasses dynamically adjust the code rate according to the estimated receiving code rate, the network load level and the packet loss trend level of the information transmission box, comprising the following operation steps:
Firstly, calculating an estimated receiving code rate of an information transmission box according to the receiving code rate of the information transmission box;
the AR glasses send data packets to the information transmission box, record the sizes of the data packets and acquire the sending code rate of the current data packets; the information transmission box acquires the data packet and then sends feedback information to the AR glasses, wherein the feedback information comprises a data packet arrival result and the arrival time of the data packet; calculating a sample value of the receiving code rate of the information transmission box in a preset time period according to the size of the data packet and feedback information;
estimating the estimated receiving code rate of the information transmission box through a Bayesian estimation algorithm based on the sample value of the receiving code rate of the information transmission box;
the AR glasses estimate network load levels;
the AR glasses calculate the packet loss trend grade;
calculating according to the estimated receiving code rate, the network load level and the packet loss trend level of the information transmission box to obtain an AR glasses sending code rate estimated value;
and taking the AR glasses sending the code rate estimated value as the code rate which is dynamically adjusted in real time.
5. The point-to-point transmission method based on cloud handshake according to claim 4, wherein the estimated reception code rate of the information transmission box is estimated according to the reception code rate of the information transmission box in a time period;
The preset time period is a time period used by the AR glasses to receive feedback information after the AR glasses send a plurality of data packets to the information transmission box.
6. The point-to-point transmission method based on cloud handshake according to claim 5, wherein the estimating the estimated receiving code rate of the information transmission box by using a bayesian estimation algorithm based on the sample value of the receiving code rate of the information transmission box specifically comprises the following operation steps:
presetting a receiving code rate sample value of the information transmission box and an estimated receiving code rate difference absolute value threshold value a of the information transmission box; calculating the estimated receiving code rate of the information transmission box;
calculating the absolute value of the actual difference between the sample value of the receiving code rate of the information transmission box and the estimated receiving code rate of the information transmission box; and if the actual difference absolute value is larger than the difference absolute value threshold value a, screening out the current estimated receiving code rate of the information transmission box, and recalculating to obtain the new estimated receiving code rate of the information transmission box.
7. The point-to-point transmission method based on cloud handshake according to claim 6, wherein the estimated receiving code rate calculation mode of the information transmission box is:
P()=/>
Wherein P is%) To obtain estimated received codes of information transmission boxesProbability of rate in case the information transmission box receives a sample value of code rate; />The probability of receiving code rate sample values for the information transmission boxes under the condition of the obtained estimated receiving code rate of the information transmission boxes is calculated;
p (A) is the prior probability of the estimated receiving code rate of the information transmission box;
p (B) is the prior probability of the information transmission box receiving the code rate sample value.
CN202310716158.8A 2023-06-16 2023-06-16 Point-to-point transmission system and method based on cloud handshake Active CN116668454B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310716158.8A CN116668454B (en) 2023-06-16 2023-06-16 Point-to-point transmission system and method based on cloud handshake

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310716158.8A CN116668454B (en) 2023-06-16 2023-06-16 Point-to-point transmission system and method based on cloud handshake

Publications (2)

Publication Number Publication Date
CN116668454A CN116668454A (en) 2023-08-29
CN116668454B true CN116668454B (en) 2024-03-19

Family

ID=87724063

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310716158.8A Active CN116668454B (en) 2023-06-16 2023-06-16 Point-to-point transmission system and method based on cloud handshake

Country Status (1)

Country Link
CN (1) CN116668454B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107995128A (en) * 2017-12-11 2018-05-04 日立楼宇技术(广州)有限公司 Data access method, device, host and the storage medium of fully mechanized mining centralized control system
CN108449362A (en) * 2018-05-02 2018-08-24 成都云门金兰科技有限公司 Interactive system based on virtual reality imaging
CN115981845A (en) * 2022-12-14 2023-04-18 西安万像电子科技有限公司 Cloud multi-person collaboration and AR real-time collaboration method, device, medium and equipment
CN116017454A (en) * 2022-12-30 2023-04-25 中国联合网络通信集团有限公司 Authentication method, device, equipment and storage medium based on service access

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11893698B2 (en) * 2020-11-04 2024-02-06 Samsung Electronics Co., Ltd. Electronic device, AR device and method for controlling data transfer interval thereof

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107995128A (en) * 2017-12-11 2018-05-04 日立楼宇技术(广州)有限公司 Data access method, device, host and the storage medium of fully mechanized mining centralized control system
CN108449362A (en) * 2018-05-02 2018-08-24 成都云门金兰科技有限公司 Interactive system based on virtual reality imaging
CN115981845A (en) * 2022-12-14 2023-04-18 西安万像电子科技有限公司 Cloud multi-person collaboration and AR real-time collaboration method, device, medium and equipment
CN116017454A (en) * 2022-12-30 2023-04-25 中国联合网络通信集团有限公司 Authentication method, device, equipment and storage medium based on service access

Also Published As

Publication number Publication date
CN116668454A (en) 2023-08-29

Similar Documents

Publication Publication Date Title
CN101098478B (en) Device and method for providing video stream with integrity
US7463735B2 (en) Encoding and decoding methods for secure scalable streaming and related systems
JP4233876B2 (en) Method and system for transcoding secure and scalable packets on the midstream side according to downstream requirements
EP1107504B1 (en) Method of updating encryption keys in a data communication system
KR100770485B1 (en) Automatic resynchronization of crypto-sync information
CN103841118B (en) Method for constructing reliable two-way covert channel based on TCP effective loads
US5841864A (en) Apparatus and method for authentication and session key exchange in a communication system
US7581094B1 (en) Cryptographic checksums enabling data manipulation and transcoding
CN110557680B (en) Audio and video data frame transmission method and system
JPH11331310A (en) Data transmission control method and data transmission system
Hussain et al. Security enhancement for video transmission via noise aggregation in immersive systems
US10530574B2 (en) Secure network coding for multi-description wireless transmission
WO2016015222A1 (en) Data encryption and transmission method and device
US9002000B2 (en) Method for conversion of a first encryption into a second encryption
CN111641503A (en) Trusted data transmission method for multiple unmanned platforms
CN110719247B (en) Terminal network access method and device
CN116668454B (en) Point-to-point transmission system and method based on cloud handshake
CN111327631B (en) Secret information transmission method and system based on TCP and UDP
US7203834B1 (en) Method of updating encryption keys in a data communication system
CN111641500B (en) Encryption and decryption method for wireless video transmission safety of unmanned aerial vehicle
CN109996025B (en) Quantum communication-based adaptive audio and video communication method, device and system
CA2619811C (en) Signal watermarking in the presence of encryption
CN111988288B (en) Key exchange method, system, equipment and storage medium based on network time delay
CN110049007B (en) Video networking transmission method and device
CN109698966B (en) Method and device for logging in streaming media and interactively encrypting data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant