WO2019056863A1 - 一种数据传输方法、处理方法及装置 - Google Patents

一种数据传输方法、处理方法及装置 Download PDF

Info

Publication number
WO2019056863A1
WO2019056863A1 PCT/CN2018/098166 CN2018098166W WO2019056863A1 WO 2019056863 A1 WO2019056863 A1 WO 2019056863A1 CN 2018098166 W CN2018098166 W CN 2018098166W WO 2019056863 A1 WO2019056863 A1 WO 2019056863A1
Authority
WO
WIPO (PCT)
Prior art keywords
packet
message
tunnel
original
current reference
Prior art date
Application number
PCT/CN2018/098166
Other languages
English (en)
French (fr)
Inventor
郑自永
胡呈欣
Original Assignee
京信通信系统（中国）有限公司
京信通信系统（广州）有限公司
京信通信技术(广州)有限公司
天津京信通信系统有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京信通信系统（中国）有限公司, 京信通信系统（广州）有限公司, 京信通信技术(广州)有限公司, 天津京信通信系统有限公司 filed Critical 京信通信系统（中国）有限公司
Priority to US16/649,414 priority Critical patent/US11251992B2/en
Publication of WO2019056863A1 publication Critical patent/WO2019056863A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W28/00—Network traffic management; Network resource management
    • H04W28/02—Traffic management, e.g. flow control or congestion control
    • H04W28/06—Optimizing the usage of the radio link, e.g. header compression, information sizing, discarding information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/46—Interconnection of networks
    • H04L12/4633—Interconnection of networks using encapsulation techniques, e.g. tunneling
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04—Protocols for data compression, e.g. ROHC
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/22—Parsing or analysis of headers

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to a data transmission method, a processing method, and an apparatus.
  • tunnel technology In the field of communication technology, tunnel technology is often involved.
  • a virtual private network VPN
  • 2G/3G/4G communication access network and the like, and tunnel technology is used.
  • the tunneling technology can be used to encapsulate the original packets of different protocols and then send them through the tunnel.
  • the packet encapsulated by the tunneling protocol contains routing information for network transmission.
  • the original packet is compressed first and then encapsulated by the tunnel protocol. Save bandwidth resources.
  • the compression effect of the original message such as the compression ratio, mostly depends on the specific content of the original message. The higher the specific content is, the lower the information entropy is, and the better the compression effect is, such as the original message with all the characters identical. The compression effect is the best. On the contrary, the lower the specific content regularity, the higher the information entropy, the worse the compression effect, such as the random number can hardly be compressed.
  • the uncertainty of the specific content of an original message is very high, so the compression effect is not ideal, and the bandwidth resource cannot be effectively saved.
  • the invention provides a data transmission method, a processing method and a device for improving the compression effect of the original message in the tunnel message.
  • An embodiment of the present invention provides a data transmission method, including:
  • the current reference packet and the original packet are the packets transmitted in the same tunnel;
  • the tunneling packet includes a compression information header, where the compression information header includes a reference packet identifier corresponding to the current reference packet;
  • the method further includes:
  • it also includes:
  • the current reference message is updated according to the original message, and the reference message identifier of the current reference message is updated;
  • the tunnel message is used to encapsulate the original packet to generate a tunnel packet.
  • the tunnel packet includes a compressed information header, and the compressed information header includes a reference packet identifier corresponding to the current reference packet.
  • the compressed information header further includes an update identifier, where the update identifier is used to indicate that the original packet corresponding to the tunnel packet is a current reference packet.
  • the embodiment of the invention provides a data processing method, including:
  • the method further includes:
  • the tunnel packet is decapsulated to obtain the information packet.
  • it also includes:
  • the tunnel packet is decapsulated, the original packet is obtained, and the original packet and the compression are associated and saved.
  • the reference message identifier in the header is not the set value
  • An embodiment of the present invention provides a data transmission apparatus, including:
  • a processing unit configured to obtain, by the transceiver unit, the original message to be transmitted and the current reference message; the current reference message and the original message are messages transmitted in the same tunnel;
  • the processing unit is further configured to perform differentiating and compressing the original packet and the current reference packet to obtain an information packet;
  • the processing unit is further configured to: use a tunneling protocol to encapsulate the information packet to generate a tunnel packet; the tunneling packet includes a compression information header, where the compression information header includes a reference packet corresponding to the current reference packet.
  • Text identification to encapsulate the information packet to generate a tunnel packet; the tunneling packet includes a compression information header, where the compression information header includes a reference packet corresponding to the current reference packet.
  • the processing unit is further configured to control the transceiver unit to send the tunnel message.
  • processing unit is further configured to:
  • processing unit is further configured to:
  • the current reference message is updated according to the original message, and the reference message identifier of the current reference message is updated;
  • the tunnel message is used to encapsulate the original packet to generate a tunnel packet.
  • the tunnel packet includes a compressed information header, and the compressed information header includes a reference packet identifier corresponding to the current reference packet.
  • the compressed information header further includes an update identifier, where the update identifier is used to indicate that the original packet corresponding to the tunnel packet is a current reference packet.
  • An embodiment of the present invention provides a data processing apparatus, including:
  • a transceiver unit configured to receive a tunnel message
  • a processing unit configured to decapsulate the tunnel packet, and obtain an information packet, where the information packet is obtained by performing differential compression on the original packet and the reference packet; and the reference packet and the original packet a message transmitted in the same tunnel;
  • the processing unit is further configured to acquire the reference packet according to the reference packet identifier included in the compressed information header of the tunnel packet;
  • the processing unit is further configured to obtain the original packet according to the information packet and the reference packet.
  • processing unit is further configured to:
  • the tunnel packet is decapsulated to obtain the information packet.
  • processing unit is further configured to:
  • the tunnel packet is decapsulated, the original packet is obtained, and the original packet and the compression are associated and saved.
  • the reference message identifier in the header is not the set value
  • An embodiment of the present invention provides a computer readable storage medium storing computer executable instructions for causing the computer to execute the data transmission method according to any one of the above .
  • An embodiment of the present invention provides a computing device, including:
  • a memory for storing program instructions
  • a processor configured to invoke a program instruction stored in the memory, and execute the data transmission method according to any one of the above items according to the obtained program.
  • An embodiment of the present invention provides a computer readable storage medium storing computer executable instructions for causing the computer to execute the data processing method according to any one of the above .
  • An embodiment of the present invention provides a computing device, including:
  • a memory for storing program instructions
  • a processor configured to invoke a program instruction stored in the memory, and execute the data processing method according to any one of the above items according to the obtained program.
  • Embodiments of the present invention also provide a computer program product comprising a computing program stored on a non-transitory computer readable storage medium, the computer program comprising the computer executable instructions, when the computer When the executable instructions are executed by the computer, the computer is caused to execute the data transmission method or the data processing method of the embodiment of the present invention.
  • the embodiment of the present invention provides a data transmission method, a processing method, and a device, where the data transmission method includes: acquiring an original message to be transmitted and a current reference message; the current reference message and the original report.
  • the message is a packet transmitted in the same tunnel; the original packet is compared with the current reference packet and then compressed to obtain an information packet; the tunnel protocol is used to encapsulate the information packet to generate a tunnel packet; the tunnel packet includes a compression information header.
  • the compressed information header includes the reference packet identifier corresponding to the current reference packet, and the tunnel packet is sent.
  • the packets in the same tunnel have a certain correlation. Since the original packet and the current reference packet are packets in the same tunnel, the original packet and the current reference packet are differentiated. The difference result is more regular than the original message, and its information entropy is smaller than the original message. Therefore, the compression of the difference result can be better compared with the prior art.
  • the compression effect is.
  • FIG. 1 is a schematic diagram of tunnel transmission interaction according to an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of a data transmission method according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a format of a conventional tunnel message frame
  • FIG. 4 is a schematic diagram of a tunnel message frame format according to an embodiment of the present disclosure.
  • FIG. 5 is a schematic diagram of a difference process according to an embodiment of the present invention.
  • FIG. 6 is a schematic flowchart of a data processing method according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of an inverse difference process according to an embodiment of the present invention.
  • FIG. 8 is a schematic flowchart of a feasible data transmission method according to an embodiment of the present invention.
  • FIG. 9 is a schematic flowchart diagram of a feasible data processing method according to an embodiment of the present invention.
  • FIG. 10 is a schematic structural diagram of a data transmission apparatus according to an embodiment of the present disclosure.
  • FIG. 11 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present disclosure.
  • FIG. 12 is a schematic structural diagram of a computing device according to an embodiment of the present disclosure.
  • FIG. 13 is a schematic structural diagram of a computing device according to an embodiment of the present invention.
  • FIG. 1 is a schematic diagram of tunnel transmission interaction according to an embodiment of the present invention.
  • a tunnel device such as a VPN
  • User N provides a tunneling service
  • data of N users accesses the network server through the tunneling device.
  • the tunnel device assigns different IP addresses to the N users. These IP addresses are different, but have certain similarities.
  • the user constructs the original packet and sends the original packet to the tunnel device.
  • the original packet is
  • the packet header contains the IP address information assigned by the tunnel device to the user.
  • the original packets in the same tunnel have at least the same or similar IP address information, so the original packets in the same tunnel have a certain correlation.
  • IP address the Transmission Control Protocol
  • UDP User Datagram Protocol
  • FIG. 2 is a schematic flowchart of a data transmission method according to an embodiment of the present invention. As shown in FIG. 2, the method includes the following steps:
  • S201 Acquire the original packet to be transmitted and the current reference packet; the current reference packet and the original packet are the packets transmitted in the same tunnel.
  • S202 Differentiate and compress the original packet from the current reference packet to obtain an information packet.
  • the tunneling protocol encapsulates the information packet to generate a tunnel packet.
  • the tunneling packet includes a compression information header, and the compression information header includes a reference packet identifier corresponding to the current reference packet.
  • the current reference message may be a historical original message transmitted in the tunnel, or may be a reference message specially designed according to the original message feature in the tunnel, so that the current reference message and the original to be transmitted are There is sufficient correlation between the messages.
  • the current reference packet is the original original packet transmitted in the tunnel, in order to improve the correlation between the current reference packet and the original packet to be transmitted, optionally, according to the preset reference packet
  • the text update condition continuously updates the current reference message. Specifically, before acquiring the current reference message in S201, the method further includes: confirming whether the original message meets the update condition of the reference message, and if not, obtaining the current reference message.
  • the current reference message is updated according to the original message.
  • the update condition of the reference packet can be determined according to the actual application environment. For example, an original packet can be determined as a reference packet every three original packets.
  • the original packet if the original packet does not meet the update condition of the reference packet, the original packet is compared with the current reference packet, and the original packet and the reference packet are the packets transmitted in the same tunnel. There is a certain correlation between the two, and the difference result is more regular. Taking the difference or difference as an example, the difference result will be 0 characters, and only a few characters will be 1.
  • the compression of the difference result can be performed by using a compression algorithm such as the conventional lzo or zlib, and a better compression effect is obtained, that is, the ratio of the compressed file size to the size of the difference result is lower, so the information in the embodiment of the present invention The size of the message will be much smaller than the file size compressed in the prior art for direct original files.
  • the tunneling protocol used may be a Point-to-Point Tunneling Protocol (PPTP), a Layer 2 Tunneling Protocol (L2TP), an IP Security Protocol (IPSec), or the like.
  • the tunneling protocol is not limited in this embodiment of the present invention.
  • the tunnel packet is used to encapsulate the information packet obtained in S202, and when the original packet satisfies the update condition of the reference packet, the tunnel packet is used to encapsulate the original packet to generate the original packet.
  • Tunnel message further includes a compressed information header, and the compressed information header includes a reference packet identifier corresponding to the current reference packet used in S202.
  • the current reference packet is updated according to the original packet, and the reference packet identifier of the current reference packet is updated, and the original packet is encapsulated by the tunnel protocol.
  • the reference packet identifier included in the compressed packet header is the reference packet identifier corresponding to the original packet.
  • FIG. 3 is a schematic diagram of a conventional tunnel message frame format
  • FIG. 4 is a schematic diagram of a tunnel message frame format according to an embodiment of the present invention.
  • the frame format of the different tunnel protocols provided by the embodiment of the present invention is similar to the existing frame format.
  • the frame format of the PPTP protocol both have an IP header and a generic routing encapsulation (Generic Route). Encapsulation (GRE) header, point-to-point protocol (PPP) header, etc.
  • GRE generic routing encapsulation
  • PPP point-to-point protocol
  • the frame format both of which have an IP header, an Authentication Header (AH), an Encapsulating Security Protocol (ESP) header, an ESP trailer, and the like.
  • AH Authentication Header
  • ESP Encapsulating Security Protocol
  • the frame format of the embodiment of the present invention carries the compressed information header and the information packet (or the original packet as the reference packet).
  • the tunnel message provided by the embodiment of the present invention can be used to send a tunnel message according to the existing tunnel message in S204.
  • the packets in the same tunnel have a certain correlation. Since the original packet and the current reference packet are packets in the same tunnel, the original packet and the current reference packet are differentiated. The difference result is more regular than the original message, and its information entropy is smaller than the original message. Therefore, the compression of the difference result can be better compared with the prior art. The compression effect.
  • An embodiment of the present invention provides a method for implementing a difference between a feasible original packet and a current reference packet.
  • FIG. 5 it is a schematic diagram of a difference process according to an embodiment of the present invention.
  • the original message and the reference message do not necessarily have the same length.
  • the reference message is padded with zeros to achieve the same length as the original message.
  • the reference message is long.
  • the low bit truncates the reference message to the length consistent with the original message. After that, the original message and the same bit of the reference message are subtracted to obtain a difference result that is consistent with the original message length.
  • FIG. 6 is a schematic flowchart of a data processing method according to an embodiment of the present invention. As shown in FIG. 6, the method includes the following steps:
  • S601 Receive a tunnel message.
  • S602 Unblock the tunnel packet and obtain the information packet.
  • the information packet is obtained by compressing the original packet and the reference packet.
  • the reference packet and the original packet are the packets transmitted in the same tunnel.
  • S603 Acquire a reference packet according to the reference packet identifier included in the compression information header of the tunnel packet.
  • the tunnel message can be decapsulated by using an operation similar to the prior art to remove the packet header of the tunnel packet, such as the IP header, the GRE header, the PPP header, and the like in the PPTP frame format in FIG. Text.
  • the original packet as the reference packet may be included, and the original packet in the tunnel packet may be obtained after the tunnel packet is decapsulated.
  • the receiver of the tunnel packet can determine whether the packet obtained after the tunnel packet is decapsulated is an information packet or an original packet according to whether the identifier of the reference packet in the compressed information header changes. Specifically, If the reference packet identifier does not change the reference packet identifier in the last received tunnel packet, the information obtained after the decapsulation is obtained is the information packet. If the reference packet identifier is the reference in the tunnel packet received last time. The packet identifier has changed, indicating that the original packet obtained as the reference packet is obtained after the decapsulation.
  • the receiving sequence of the tunnel packets may not be consistent with the sending sequence. That is, the tunnel packets sent after the packets are received first, and a judgment error occurs.
  • the compressed information header further includes an update identifier, where the update identifier is used to indicate whether the original packet corresponding to the tunnel packet is a reference packet. For example, if the update identifier is 0, the tunnel report is used.
  • the original packet corresponding to the text is a reference packet.
  • the original packet that is the reference packet is obtained after the tunnel packet is decapsulated.
  • the original packet corresponding to the tunnel packet is not the reference packet. At this time, the information packet obtained after the tunnel message is unsealed is obtained.
  • the original packet and the reference packet identifier in the compressed header are recorded in association, and when the reference packet is inversely differentiated, The corresponding reference message can be obtained directly according to the reference message identifier.
  • the information packet is obtained after the tunnel message is decapsulated, it needs to be decompressed and inversely differentiated. Therefore, it is determined according to the reference message identifier in the compressed information header to determine when the information message is generated.
  • Reference message used. The receiver can directly query the correspondence between the original packet and the reference packet identifier saved in the local area.
  • the original packet pointed to by the reference packet identifier in the compression header is the reference packet corresponding to the information packet.
  • the information message needs to be decompressed first, and then the inverse difference operation is performed according to the reference message determined in S603.
  • the compression information header further includes a compression algorithm identifier
  • the receiver may determine the compression algorithm corresponding to the information packet according to the compression algorithm identifier and perform a decompression operation, so as to obtain a difference result between the original packet and the reference packet.
  • the original message is obtained by performing an inverse differential operation based on the reference message and the difference result.
  • the embodiment of the present invention further provides a feasible inverse differential implementation manner, as shown in FIG. 7 , which is a schematic diagram of an inverse differential process according to an embodiment of the present invention. As shown in Figure 7, the differential result and the reference packet do not necessarily have the same length.
  • the reference packet When the reference packet is short, the reference packet is padded with zeros to achieve the same length as the difference result. When the message is long, the reference message is truncated from the low bit to reach the length consistent with the difference result. Then, the difference result and the same bit of the reference message are added to obtain the original message with the same length as the difference result.
  • the compression algorithm identifiers include the following cases: 0 (no compression), 1 (lzo algorithm), 2 (zlib algorithm), and 3 (other algorithms).
  • the update identifier includes the following cases: 0 (original message) and 1 (information message).
  • FIG. 8 is a schematic flowchart of a feasible data transmission method according to an embodiment of the present invention. As shown in FIG. 8, the method includes the following steps:
  • S802 Determine whether the original message is used as a reference message, that is, whether the reference message update condition is met; if yes, execute S807, if no, execute S803.
  • S803 Perform differential processing on the original packet and the current reference packet.
  • S804 Perform a compression process on the difference result to obtain an information message according to a preset compression algorithm.
  • S805 Encapsulating a compression information header for the information packet, where the compression information header includes a reference packet identifier, a compression algorithm identifier, and an update identifier.
  • the compression algorithm used in S804 is the lzo algorithm, and the compression algorithm is identified as 1.
  • the update identifier is 1, indicating that the tunnel message includes an information message.
  • S806 Encapsulate the remaining layer header information according to the tunnel protocol to obtain a tunnel packet.
  • the compression algorithm identifier in the compressed information header is 0, indicating that the original packet is uncompressed, and the update identifier is 0, indicating that the tunnel packet includes the original packet as the reference packet.
  • S810 Send a tunnel packet.
  • FIG. 9 is a schematic flowchart of a feasible data processing method according to an embodiment of the present invention. As shown in FIG. 9 , the following steps are included:
  • S901 Receive a tunnel message.
  • S902 Deleting the header information of each layer of the tunnel except the compressed information header in the tunnel message.
  • S903 Determine, according to the update identifier in the compressed information header, whether the information included in the tunnel message is a reference message; if yes, execute S907; if not, execute S904.
  • S905 Select a corresponding compression algorithm according to the compressed message identifier in the compressed information header, and perform decompression processing on the information packet obtained by the decapsulation.
  • S906 Determine a reference packet according to the reference packet identifier in the compressed information header, and perform inverse differentiation on the differential result obtained by decompressing according to the reference packet, thereby obtaining the original packet.
  • the data transmission method and the data processing method provided by the embodiments of the present invention make full use of the correlation between the original packets transmitted in the tunnel, and adopt the method of compressing and compressing similar packets to improve the compression ratio from the time dimension and improve the tunnel transmission efficiency. , to ensure greater quality of bandwidth services.
  • FIG. 10 is a schematic structural diagram of a data transmission apparatus according to an embodiment of the present invention.
  • the apparatus 1000 includes a transceiver unit 1001 and a processing unit 1002, where:
  • the processing unit 1002 is configured to obtain, by the transceiver unit 1001, the original packet to be transmitted and the current reference packet; the current reference packet and the original packet are the packets transmitted in the same tunnel;
  • the processing unit 1002 is further configured to perform differential processing on the original packet and the current reference packet to obtain an information packet.
  • the processing unit 1002 is further configured to: use a tunneling protocol to encapsulate the information packet to generate a tunnel packet; the tunneling packet includes a compression information header, where the compression information header includes a reference packet identifier corresponding to the current reference packet;
  • the processing unit 1002 is further configured to control the transceiver unit 1001 to send a tunnel message.
  • processing unit 1002 is further configured to:
  • processing unit 1002 is further configured to:
  • the current reference packet is updated according to the original packet, and the reference packet identifier of the current reference packet is updated;
  • the tunnel packet is used to encapsulate the original packet to generate a tunnel packet.
  • the tunnel packet includes a compression header, and the compression header includes a reference packet identifier corresponding to the current reference packet.
  • the compressed information header further includes an update identifier, where the update identifier is used to indicate that the original packet corresponding to the tunnel packet is the current reference packet.
  • FIG. 11 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention.
  • the apparatus 1100 includes a transceiver unit 1101 and a processing unit 1102, where:
  • the transceiver unit 1101 is configured to receive a tunnel message.
  • the processing unit 1102 is configured to decapsulate the tunnel packet and obtain the information packet, where the information packet is obtained by compressing the original packet and the current reference packet, and the current reference packet and the original packet are the same tunnel. a message transmitted in the middle;
  • the processing unit 1102 is further configured to obtain a current reference packet according to the reference packet identifier included in the compressed information header of the tunnel packet.
  • the processing unit 1102 is further configured to obtain the original packet according to the information packet and the current reference packet.
  • processing unit 1102 is further configured to:
  • the tunnel packet is decapsulated to obtain an information packet.
  • processing unit 1102 is further configured to:
  • the tunnel packet is decapsulated, the original packet is obtained, and the current reference packet is updated according to the original packet.
  • FIG. 12 is a schematic structural diagram of a computing device according to an embodiment of the present invention.
  • the computing device may include a central processing unit (CPU), a memory 1202, an input device 1203, an output device 1204, and the like.
  • the device 1203 may include a keyboard, a mouse, a touch screen, etc.
  • the output device 1204 may include a display device such as a liquid crystal display (LCD), a cathode ray tube (CRT), or the like.
  • LCD liquid crystal display
  • CRT cathode ray tube
  • the memory 1202 can include read only memory (ROM) and random access memory (RAM) and provides program instructions and data stored in the memory to the processor.
  • ROM read only memory
  • RAM random access memory
  • the memory may be used to store a program of the data transmission method provided by the embodiment of the present invention, and the processor executes the data transmission according to any one of the above items according to the obtained program instruction by calling a program instruction stored in the memory. method.
  • an embodiment of the present invention further provides a computer readable storage medium for storing computer program instructions used by the computing device, including a program for executing the data transmission method according to any one of the above .
  • the computer storage medium can be any available media or data storage device accessible by a computer, including but not limited to magnetic storage (eg, floppy disk, hard disk, magnetic tape, magneto-optical disk (MO), etc.), optical storage (eg, CD, DVD, BD, HVD, etc.), and semiconductor memories (for example, ROM, EPROM, EEPROM, non-volatile memory (NAND FLASH), solid-state hard disk (SSD)).
  • magnetic storage eg, floppy disk, hard disk, magnetic tape, magneto-optical disk (MO), etc.
  • optical storage eg, CD, DVD, BD, HVD, etc.
  • semiconductor memories for example, ROM, EPROM, EEPROM, non-volatile memory (NAND FLASH), solid-state hard disk (SSD)).
  • FIG. 13 is a schematic structural diagram of a computing device according to an embodiment of the present invention.
  • the computing device may include a central processing unit (CPU), a memory 1302, an input device 1303, an output device 1304, and the like.
  • the device 1303 may include a keyboard, a mouse, a touch screen, etc.
  • the output device 1304 may include a display device such as a liquid crystal display (LCD), a cathode ray tube (CRT), or the like.
  • LCD liquid crystal display
  • CRT cathode ray tube
  • Memory 1302 can include read only memory (ROM) and random access memory (RAM) and provides program instructions and data stored in the memory to the processor.
  • the memory may be used to store a program of the data processing method provided by the embodiment of the present invention, and the processor executes the data processing according to any one of the above items according to the obtained program instruction by calling a program instruction stored in the memory. method.
  • an embodiment of the present invention further provides a computer readable storage medium for storing computer program instructions used by the computing device, including a program for executing the data verification method according to any one of the above items. .
  • the computer storage medium can be any available media or data storage device accessible by a computer, including but not limited to magnetic storage (eg, floppy disk, hard disk, magnetic tape, magneto-optical disk (MO), etc.), optical storage (eg, CD, DVD, BD, HVD, etc.), and semiconductor memories (for example, ROM, EPROM, EEPROM, non-volatile memory (NAND FLASH), solid-state hard disk (SSD)).
  • magnetic storage eg, floppy disk, hard disk, magnetic tape, magneto-optical disk (MO), etc.
  • optical storage eg, CD, DVD, BD, HVD, etc.
  • semiconductor memories for example, ROM, EPROM, EEPROM, non-volatile memory (NAND FLASH), solid-state hard disk (SSD)).
  • the present application provides a computer program product comprising a computing program stored on a non-transitory computer readable storage medium, the computer program comprising the computer executable instructions
  • the computer executable instructions When executed by a computer, the computer is caused to execute the data transfer method or the data processing method in any of the above embodiments.
  • the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple physical units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that instructions stored in the computer readable memory produce an article of manufacture including an instruction system.
  • the system implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of a flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Transfer Between Computers (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Communication Control (AREA)

Abstract

本发明公开了一种数据传输方法、处理方法及装置，用以提高隧道传输中对原始报文的压缩效果，其中，数据传输方法包括：获取待传输的原始报文和当前的参考报文；当前的参考报文和原始报文为同一隧道中传输的报文；对原始报文与当前的参考报文进行差分后压缩，获得信息报文；利用隧道协议封装信息报文生成隧道报文；隧道报文包括压缩信息头，压缩信息头中包括当前的参考报文对应的参考报文标识；发送隧道报文。同一隧道内的各个报文之间具有一定的相关性，因此对原始报文和当前的参考报文进行差分后所获得的差分结果具有更高的规律性，其信息熵更小，能够获得更好的压缩效果。

Description

一种数据传输方法、处理方法及装置
本申请要求在2017年09月21日提交中国专利局、申请号为201710860616.X、发明名称为“一种数据传输方法、处理方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及通信技术领域，尤其涉及一种数据传输方法、处理方法及装置。
背景技术
在通信技术领域经常涉及隧道技术，如虚拟专用网络(Virtual Private Network，VPN)被广泛应用在互联网、2G/3G/4G通信接入网等等，其使用的便是隧道技术。使用隧道技术，可以将不同协议的原始报文经隧道协议封装后通过隧道发送，经隧道协议封装后的报文头部包含有路由信息，以供网络传输。
在数据传输过程中，常常会遇到带宽资源紧张的情况，人为增加带宽资源的成本有时较为昂贵，因此，现有隧道技术中，一般先对原始报文进行压缩后再通过隧道协议封装，以节省带宽资源。然而，原始报文的压缩效果，如压缩比，大多依赖于原始报文的具体内容，其具体内容规律性越高，信息熵越低，压缩效果越好，如全部字符完全相同的原始报文压缩效果最好，反之，具体内容规律性越低，信息熵越高，压缩效果越差，如随机数几乎无法压缩。对于现有的隧道技术，一个原始报文的具体内容的不确定性非常高，因此其压缩效果并不理想，无法有效地节省带宽资源。
发明内容
本发明提供一种数据传输方法、处理方法及装置，用以提高隧道报文中 对原始报文的压缩效果。
本发明实施例提供一种数据传输方法，包括：
获取待传输的原始报文和当前的参考报文；所述当前的参考报文和所述原始报文为同一隧道中传输的报文；
对所述原始报文与所述当前的参考报文进行差分后压缩，获得信息报文；
利用隧道协议封装所述信息报文生成隧道报文；所述隧道报文包括压缩信息头，所述压缩信息头中包括所述当前的参考报文对应的参考报文标识；
发送所述隧道报文。
可选的，获取当前的参考报文之前，还包括：
确认所述原始报文是否满足参考报文更新条件，若不满足则获取所述当前的参考报文。
可选的，还包括：
若所述原始报文满足参考报文更新条件，则根据所述原始报文更新所述当前的参考报文并更新所述当前的参考报文的参考报文标识；
利用所述隧道协议封装所述原始报文生成隧道报文；所述隧道报文包括压缩信息头，所述压缩信息头中包括所述当前的参考报文对应的参考报文标识。
可选的，所述压缩信息头中还包括更新标识，所述更新标识用于指示所述隧道报文对应的原始报文为当前的参考报文。
本发明实施例提供一种数据处理方法，包括：
接收隧道报文；
解封所述隧道报文，得到信息报文，所述信息报文为对原始报文与参考报文进行差分后压缩得到的；所述参考报文和所述原始报文为同一隧道中传输的报文；
根据所述隧道报文的压缩信息头中包括的参考报文标识，获取所述参考报文；
根据所述信息报文和所述参考报文，获得所述原始报文。
可选的，解封所述隧道报文，得到信息报文之前，还包括：
确认所述隧道报文的压缩信息头中的更新标识是否为设定值；
若所述隧道报文的压缩信息头中的更新标识是所述设定值，则对所述隧道报文解封，得到所述信息报文。
可选的，还包括：
若所述隧道报文的压缩信息头中的更新标识不是所述设定值，则对所述隧道报文解封，获取所述原始报文，并关联保存所述原始报文和所述压缩信息头中的参考报文标识。
本发明实施例提供一种数据传输装置，包括：
处理单元，用于通过收发单元获取待传输的原始报文和当前的参考报文；所述当前的参考报文和所述原始报文为同一隧道中传输的报文；
所述处理单元，还用于对所述原始报文与所述当前的参考报文进行差分后压缩，获得信息报文；
所述处理单元，还用于利用隧道协议封装所述信息报文生成隧道报文；所述隧道报文包括压缩信息头，所述压缩信息头中包括所述当前的参考报文对应的参考报文标识；
所述处理单元，还用于控制所述收发单元发送所述隧道报文。
可选的，所述处理单元还用于：
确认所述原始报文是否满足参考报文更新条件，若不满足则获取所述当前的参考报文。
可选的，所述处理单元还用于：
若所述原始报文满足参考报文更新条件，则根据所述原始报文更新所述当前的参考报文并更新所述当前的参考报文的参考报文标识；
利用所述隧道协议封装所述原始报文生成隧道报文；所述隧道报文包括压缩信息头，所述压缩信息头中包括所述当前的参考报文对应的参考报文标识。
可选的，所述压缩信息头中还包括更新标识，所述更新标识用于指示所 述隧道报文对应的原始报文为当前的参考报文。
本发明实施例提供一种数据处理装置，包括：
收发单元，用于接收隧道报文；
处理单元，用于解封所述隧道报文，得到信息报文，所述信息报文为对原始报文与参考报文进行差分后压缩得到的；所述参考报文和所述原始报文为同一隧道中传输的报文；
所述处理单元，还用于根据所述隧道报文的压缩信息头中包括的参考报文标识，获取所述参考报文；
所述处理单元，还用于根据所述信息报文和所述参考报文，获得所述原始报文。
可选的，所述处理单元还用于：
确认所述隧道报文的压缩信息头中的更新标识是否为设定值；
若所述隧道报文的压缩信息头中的更新标识是所述设定值，则对所述隧道报文解封，得到所述信息报文。
可选的，所述处理单元还用于：
若所述隧道报文的压缩信息头中的更新标识不是所述设定值，则对所述隧道报文解封，获取所述原始报文，并关联保存所述原始报文和所述压缩信息头中的参考报文标识。
本发明实施例提供一种计算机可读存储介质，所述计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于使所述计算机执行上述任一项所述的数据传输方法。
本发明实施例提供一种计算设备，包括：
存储器，用于存储程序指令；
处理器，用于调用所述存储器中存储的程序指令，按照获得的程序执行上述任一项所述的数据传输方法。
本发明实施例提供一种计算机可读存储介质，所述计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于使所述计算机执行上 述任一项所述的数据处理方法。
本发明实施例提供一种计算设备，包括：
存储器，用于存储程序指令；
处理器，用于调用所述存储器中存储的程序指令，按照获得的程序执行上述任一项所述的数据处理方法。
本发明实施例还提供了一种计算机程序产品，所述计算机程序产品包括存储在非暂态计算机可读存储介质上的计算程序，所述计算机程序包括所述计算机可执行指令，当所述计算机可执行指令被计算机执行时，使所述计算机执行本发明实施例的数据传输方法或数据处理方法。
综上所述，本发明实施例提供一种数据传输方法、处理方法及装置，其中，数据传输方法包括：获取待传输的原始报文和当前的参考报文；当前的参考报文和原始报文为同一隧道中传输的报文；对原始报文与当前的参考报文进行差分后压缩，获得信息报文；利用隧道协议封装信息报文生成隧道报文；隧道报文包括压缩信息头，压缩信息头中包括当前的参考报文对应的参考报文标识；发送隧道报文。同一隧道内的各个报文之间具有一定的相关性，由于原始报文和当前的参考报文是同一隧道内的报文，因此对原始报文和当前的参考报文进行差分后所获得的差分结果相较于原始报文具有更高的规律性，其信息熵相较于原始报文更小，因此对差分结果进行压缩相较于现有技术直接对原始报文的压缩能够获得更好的压缩效果。
附图说明
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简要介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域的普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为本发明实施例提供的一种隧道传输交互示意图；
图2为本发明实施例提供的一种数据传输方法流程示意图；
图3为一种现有的隧道报文帧格式示意图；
图4为本发明实施例提供的一种隧道报文帧格式示意图；
图5为本发明实施例提供的一种差分过程示意图；
图6为本发明实施例提供的一种数据处理方法流程示意图；
图7为本发明实施例提供的一种逆差分过程示意图；
图8为本发明实施例提供的一种可行的数据传输方法流程示意图；
图9为本发明实施例提供一种可行的数据处理方法流程示意图；
图10为本发明实施例提供的一种数据传输装置结构示意图；
图11为本发明实施例提供的一种数据处理装置结构示意图；
图12为本发明实施例提供的一种计算设备结构示意图；
图13为本发明实施例提供的一种计算设备结构示意图。
具体实施方式
为了使本发明的目的、技术方案和优点更加清楚，下面将结合附图对本发明作进一步地详细描述，显然，所描述的实施例仅仅是本发明一部份实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例，都属于本发明保护的范围。
隧道传输技术是一种常见的网络传输技术，图1为本发明实施例提供的一种隧道传输交互示意图，如图1所示，隧道设备(如VPN)为用户1、用户2、……、用户N提供隧道传输服务，N个用户的数据通过隧道设备访问网络服务器。具体应用过程中，隧道设备分别为N个用户分配不同的IP地址，这些IP地址虽然不同，但具有一定的相似性，用户构建原始报文并将原始报文发送给隧道设备，原始报文的报文头中便包含有隧道设备分配给用户的IP地址信息。由此可见，同一隧道内的原始报文至少具有相同或相似的IP地址信息，因此同一隧道内的原始报文具有一定的相关性。当然，以上只是以IP地址为例，具体实施过程中，原始报文中的传输控制协议(Transmission Control  Protocol，TCP)和用户数据报协议(User Datagram Protocol，UDP)信息也同样具有一定的相关性。
图2为本发明实施例提供的一种数据传输方法流程示意图，如图2所示，包括以下步骤：
S201：获取待传输的原始报文和当前的参考报文；当前的参考报文和原始报文为同一隧道中传输的报文。
S202：对原始报文与当前的参考报文进行差分后压缩，获得信息报文。
S203：利用隧道协议封装信息报文生成隧道报文；隧道报文包括压缩信息头，压缩信息头中包括当前的参考报文对应的参考报文标识。
S204：发送隧道报文。
在S201中，当前的参考报文可以是隧道中传输过的历史原始报文，也可以是根据隧道中原始报文特征而专门设计的参考报文，使得当前的参考报文与待传输的原始报文之间具有足够的相关性。在当前的参考报文是隧道中传输过的历史原始报文的情况下，为了提高当前的参考报文与待传输的原始报文之间的相关性，可选的，根据预设的参考报文更新条件不断更新当前的参考报文。具体来说，在S201中获取当前的参考报文之前，还包括：确认原始报文是否满足参考报文更新条件，若不满足则获取当前的参考报文。若原始报文满足参考报文更新条件，则根据原始报文更新当前的参考报文。参考报文的更新条件可根据实际应用环境确定，例如，可以每隔3个原始报文，确定一个原始报文为参考报文。
在S202中，在原始报文不满足参考报文更新条件的情况下，对原始报文与当前的参考报文进行差分，由于原始报文和参考报文为同一隧道中传输的报文，因此二者之间具有一定的相关性，其差分结果规律性更强，以异或差分为例，差分结果中将以0字符为主，只有少部分字符为1。对差分结果进行压缩，可以采用传统的lzo、zlib等压缩算法进行压缩，将获得更好的压缩效果，即压缩后的文件大小与差分结果的大小之比更低，因此本发明实施例中信息报文的大小将远远小于现有技术中对直接原始文件压缩后的文件大小。
在S203中，所使用的隧道协议可以是点对点隧道协议(Point-to-Point Tunneling Protocol，PPTP)、第二层隧道协议(Layer 2Tunneling Protocol，L2TP)、IP安全协议(IP Security Protocol，IPSec)等隧道传输协议，本发明实施例对此不多作限定。可选的，在原始报文不满足参考报文更新条件时，采用隧道协议封装S202中获得的信息报文，在原始报文满足参考报文更新条件时，采用隧道协议封装原始报文以生成隧道报文。在隧道报文中，还包括压缩信息头，压缩信息头包括了S202中所使用的当前参考报文对应的参考报文标识。可选的，在原始报文满足参考报文更新条件时，根据原始报文更新当前的参考报文的同时更新当前的参考报文的参考报文标识，在对原始报文采用隧道协议封装后生成的隧道报文中，其压缩信息头中所包括的参考报文标识为该原始报文对应的参考报文标识。
图3为一种现有的隧道报文帧格式示意图，图4为本发明实施例提供的一种隧道报文帧格式示意图。如图3和图4示，本发明实施例所提供的不同隧道协议下帧格式与现有的帧格式类似，对于PPTP协议下的帧格式，二者都具有IP头、通用路由封装(Generic Route Encapsulation，GRE)头、点到点协议(Point-to-Point Protocol，PPP)头等，对于L2TP协议下的帧格式，二者都具有IP头、UDP头、L2TP头、PPP头等，对于IPSec协议下的帧格式，二者都具有IP头、认证头(Authentication Header，AH)、封装安全协议(Encapsulating Security Protocol，ESP)头、ESP尾等。区别在于现有技术直接对原始报文进行了压缩和封装，而本发明实施例的帧格式中携带了压缩信息头和信息报文(或作为参考报文的原始报文)。
采用本发明实施例所提供的隧道报文可以在S204中按照现有的隧道报文发送隧道报文。
同一隧道内的各个报文之间具有一定的相关性，由于原始报文和当前的参考报文是同一隧道内的报文，因此对原始报文和当前的参考报文进行差分后所获得的差分结果相较于原始报文具有更高的规律性，其信息熵相较于原始报文更小，因此对差分结果进行压缩相较于现有技术直接对原始报文的压 缩能够获得更好的压缩效果。
在S202中，需要对不满足参考报文更新条件的原始报文进行差分。本发明实施例提供一种可行的原始报文和当前的参考报文进行差分的实现方式，请参考图5，为本发明实施例提供的一种差分过程示意图，如图5所示，进行差分的原始报文和参考报文并不一定具有相同的长度，在参考报文较短时对参考报文低位补零使其达到与原始报文一致的长度，在参考报文较长时，从低位截短参考报文使其达到与原始报文一致的长度。之后，原始报文和参考报文相同位的字符进行减法处理，获得与原始报文长度一致的差分结果。
与上述数据传输方法相对应的，本发明实施例还提供一种数据处理方法，可以处理通过上述数据传输方法传输的隧道报文。图6为本发明实施例提供的一种数据处理方法流程示意图，如图6所示，包括以下步骤：
S601：接收隧道报文。
S602：解封隧道报文，得到信息报文，信息报文为对原始报文与参考报文进行差分后压缩得到的；参考报文和原始报文为同一隧道中传输的报文。
S603：根据隧道报文的压缩信息头中包括的参考报文标识，获取参考报文。
S604：根据信息报文和参考报文，获得原始报文。
在S602中，可采用与现有技术类似的操作解封隧道报文，去除隧道报文的报文头，如图4中PPTP帧格式中的IP头、GRE头、PPP头等，从而获得信息报文。在本发明实施例所提供的隧道报文中还有可能包括作为参考报文的原始报文，则解封隧道报文后还可能获得隧道报文中的原始报文。
在理想的情况下，隧道报文接收方可根据压缩信息头中参考报文标识是否发生变化来判断对隧道报文解封后获得的报文是信息报文还是原始报文，具体来说，若参考报文标识较上一次接收的隧道报文中的参考报文标识未发生变化，说明解封后获得的是信息报文，若参考报文标识较上一次接收的隧道报文中的参考报文标识发生了变化，说明解封后获得的是作为参考报文的原始报文。但是在实际操作过程中，隧道报文的接收顺序可能与发送顺序不 一致，即后发送的隧道报文被率先接收的情况，此时便会出现判断错误。为了避免这种情况的发生，可选的，压缩信息头中还包括更新标识，更新标识用于指示隧道报文对应的原始报文是否为参考报文，例如，更新标识为0时说明隧道报文对应的原始报文为参考报文，此时对隧道报文解封后获得的是作为参考报文的原始报文，更新标识为1时说明隧道报文对应的原始报文不是参考报文，此时对隧道报文解封后获得的是信息报文。可选的，在确认隧道报文解封后获得的是作为参考报文的原始报文时，关联记录该原始报文和压缩信息头中参考报文标识，在利用参考报文逆差分时，便可直接根据参考报文标识获取对应的参考报文。
在603中，若隧道报文解封后获得的是信息报文，则还需对其进行解压和逆差分操作，因此需要根据压缩信息头中的参考报文标识确定生成该信息报文时所使用的参考报文。接收方可直接查询本地中保存的原始报文与参考报文标识间的对应关系，压缩信息头中的参考报文标识所指向的原始报文即是该信息报文所对应的参考报文。
在S604中，需要先对信息报文解压缩，再根据S603中所确定参考报文对其进行逆差分操作。可选的，压缩信息头中还包括压缩算法标识，接收方可根据压缩算法标识确定信息报文所对应的压缩算法并进行解压缩操作，从而获得原始报文与参考报文的差分结果。之后，根据参考报文和差分结果进行逆差分操作，便可获得原始报文。与图5所示的差分过程相对应的，本发明实施例还提供一种可行的逆差分实施方式，如图7所示，为本发明实施例提供的一种逆差分过程示意图。如图7所示，进行逆差分的差分结果和参考报文并不一定具有相同的长度，在参考报文较短时对参考报文低位补零使其达到与差分结果一致的长度，在参考报文较长时，从低位截短参考报文使其达到与差分结果一致的长度。之后，差分结果和参考报文相同位的字符进行加法处理，获得与差分结果长度一致的原始报文。
本发明实施例提供以下两种可行的实现方式，以分别说明本发明实施例所提供的数据传输方法和数据处理方法。应理解，以下两种可行的实现方式 仅为举例说明，并不代表本发明实施例仅包括或仅适用于以下两种情况。
假设压缩算法标识分别包括以下几种情况：0(无压缩)、1(lzo算法)、2(zlib算法)、3(其它算法)。更新标识包括以下几种情况：0(原始报文)、1(信息报文)。
图8为本发明实施例提供的一种可行的数据传输方法流程示意图，如图8所示，包括以下步骤：
S801：接收待发送原始报文。
S802：判断原始报文是否作为参考报文，即是否满足参考报文更新条件；若是，则执行S807，若否，则执行S803。
S803：将原始报文与当前参考报文做差分处理。
S804：根据预设的压缩算法，将差分结果执行压缩处理获取信息报文。
S805：为信息报文封装压缩信息头，压缩信息头中包括参考报文标识、压缩算法标识、更新标识。
假设S804中采用的压缩算法为lzo算法，此时压缩算法标识为1。同时，也可确定更新标识为1，指示隧道报文中包括的是信息报文。
S806：根据隧道协议封装其余各层头部信息，获得隧道报文。
S807：根据原始报文更新当前参考报文。
S808：更新参考报文标识。例如，可以直接在前一个参考报文标识的基础上加1。
S809：为原始报文封装压缩信息头。
压缩信息头中压缩算法标识为0，表示原始报文未经压缩，更新标识为0，指示隧道报文中包括的是作为参考报文的原始报文。
S810：发送隧道报文。
基于相同的假设，与图8向对应的，图9为本发明实施例提供一种可行的数据处理方法流程示意图，如图9所示，包括以下步骤：
S901：接收隧道报文。
S902：拆除隧道报文中除压缩信息头之外的隧道各层头部信息。
S903：根据压缩信息头中的更新标识判断隧道报文中包括的是否是参考报文；若是，则执行S907；若否，则执行S904。
S904：拆除压缩信息头内容。
S905：根据压缩信息头中的压缩报文标识选择相应的压缩算法，对解封获得的信息报文进行解压处理。
S906：根据压缩信息头中的参考报文标识确定参考报文，将解压后获得的差分结果根据参考报文进行逆差分，从而获得原始报文。
S907：更新存储参考报文(原始报文)及其参考报文标识。
S908：拆除压缩信息头内容。
S909：将原始报文发往下游。
本发明实施例所提供的数据传输方法和数据处理方法充分利用隧道内所传输原始报文间的相关性，采用相近报文差分后再压缩的方法，从时间维度提升压缩率，提升隧道传输效率，更大程度保障带宽服务质量。
基于相同的技术构思，本发明实施例还提供一种数据传输装置，该装置能够实现上述任一实施例所提供的数据传输方法。图10为本发明实施例提供的一种数据传输装置结构示意图，如图10所示，装置1000包括收发单元1001和处理单元1002，其中：
处理单元1002，用于通过收发单元1001获取待传输的原始报文和当前的参考报文；当前的参考报文和原始报文为同一隧道中传输的报文；
处理单元1002，还用于对原始报文与当前的参考报文进行差分后压缩，获得信息报文；
处理单元1002，还用于利用隧道协议封装信息报文生成隧道报文；隧道报文包括压缩信息头，压缩信息头中包括当前的参考报文对应的参考报文标识；
处理单元1002，还用于控制收发单元1001发送隧道报文。
可选的，处理单元1002还用于：
确认原始报文是否满足参考报文更新条件，若不满足则获取当前的参考 报文。
可选的，处理单元1002还用于：
若原始报文满足参考报文更新条件，则根据原始报文更新当前的参考报文并更新当前的参考报文的参考报文标识；
利用隧道协议封装原始报文生成隧道报文；隧道报文包括压缩信息头，压缩信息头中包括当前的参考报文对应的参考报文标识。
可选的，压缩信息头中还包括更新标识，更新标识用于指示隧道报文对应的原始报文为当前的参考报文。
基于相同的技术构思，本发明实施例还提供一种数据处理装置，该装置能够实现上述任一实施例所提供的数据处理方法。图11为本发明实施例提供的一种数据处理装置结构示意图，如图11所示，装置1100包括收发单元1101和处理单元1102，其中：
收发单元1101，用于接收隧道报文；
处理单元1102，用于解封隧道报文，得到信息报文，信息报文为对原始报文与当前的参考报文进行差分后压缩得到的；当前的参考报文和原始报文为同一隧道中传输的报文；
处理单元1102，还用于根据隧道报文的压缩信息头中包括的参考报文标识，获取当前的参考报文；
处理单元1102，还用于根据信息报文和当前的参考报文，获得原始报文。
可选的，处理单元1102还用于：
确认隧道报文的压缩信息头中的更新标识是否为设定值；
若隧道报文的压缩信息头中的更新标识是设定值，则对隧道报文解封，得到信息报文。
可选的，处理单元1102还用于：
若隧道报文的压缩信息头中的更新标识不是设定值，则对隧道报文解封，获取原始报文，并根据原始报文更新当前的参考报文。
基于相同的技术构思，本发明实施例还提供一种计算设备，该计算设备 具体可以为桌面计算机、便携式计算机、智能手机、平板电脑、个人数字助理(Personal Digital Assistant，PDA)等。如图12所示，为本发明实施例提供的一种计算设备结构示意图，该计算设备可以包括中央处理器1201(Center Processing Unit，CPU)、存储器1202、输入设备1203、输出设备1204等，输入设备1203可以包括键盘、鼠标、触摸屏等，输出设备1204可以包括显示设备，如液晶显示器(Liquid Crystal Display，LCD)、阴极射线管(Cathode Ray Tube，CRT)等。
存储器1202可以包括只读存储器(ROM)和随机存取存储器(RAM)，并向处理器提供存储器中存储的程序指令和数据。在本发明实施例中，存储器可以用于存储本发明实施例所提供的数据传输方法的程序，处理器通过调用存储器存储的程序指令，按照获得的程序指令执行上述任一项所述的数据传输方法。
基于相同的技术构思，本发明实施例还提供一种计算机可读存储介质，用于存储为上述计算设备所用的计算机程序指令，其包含用于执行上述任一项所述的数据传输方法的程序。
所述计算机存储介质可以是计算机能够存取的任何可用介质或数据存储设备，包括但不限于磁性存储器(例如软盘、硬盘、磁带、磁光盘(MO)等)、光学存储器(例如CD、DVD、BD、HVD等)、以及半导体存储器(例如ROM、EPROM、EEPROM、非易失性存储器(NAND FLASH)、固态硬盘(SSD))等。
基于相同的技术构思，本发明实施例还提供一种计算设备，该计算设备具体可以为桌面计算机、便携式计算机、智能手机、平板电脑、个人数字助理(Personal Digital Assistant，PDA)等。如图13所示，为本发明实施例提供的一种计算设备结构示意图，该计算设备可以包括中央处理器1301(Center Processing Unit，CPU)、存储器1302、输入设备1303、输出设备1304等，输入设备1303可以包括键盘、鼠标、触摸屏等，输出设备1304可以包括显示设备，如液晶显示器(Liquid Crystal Display，LCD)、阴极射线管(Cathode  Ray Tube，CRT)等。
存储器1302可以包括只读存储器(ROM)和随机存取存储器(RAM)，并向处理器提供存储器中存储的程序指令和数据。在本发明实施例中，存储器可以用于存储本发明实施例所提供的数据处理方法的程序，处理器通过调用存储器存储的程序指令，按照获得的程序指令执行上述任一项所述的数据处理方法。
基于相同的技术构思，本发明实施例还提供一种计算机可读存储介质，用于存储为上述计算设备所用的计算机程序指令，其包含用于执行上述任一项所述的数据验证方法的程序。
所述计算机存储介质可以是计算机能够存取的任何可用介质或数据存储设备，包括但不限于磁性存储器(例如软盘、硬盘、磁带、磁光盘(MO)等)、光学存储器(例如CD、DVD、BD、HVD等)、以及半导体存储器(例如ROM、EPROM、EEPROM、非易失性存储器(NAND FLASH)、固态硬盘(SSD))等。
基于相同的发明构思，本申请提供一种计算机程序产品，所述计算机程序产品包括存储在非暂态计算机可读存储介质上的计算程序，所述计算机程序包括所述计算机可执行指令，当所述计算机可执行指令被计算机执行时，使所述计算机执行上述任一实施方式中的数据传输方法或数据处理方法。
以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个物理单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下，即可以理解并实施。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件。基于这样的理解，上述技术方案本质上或者说对现有技术做出贡献的部 分可以以软件产品的形式体现出来，该计算机软件产品可以存储在计算机可读存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机装置(可以是个人计算机，服务器，或者网络装置等)执行各个实施例或者实施例的某些部分所述的方法。
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的系统。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令系统的制造品，该指令系统实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管已描述了本发明的优选实施例，但本领域内的技术人员一旦得知了基本创造性概念，则可对这些实施例作出另外的变更和修改。所以，所附权利要求意欲解释为包括优选实施例以及落入本发明范围的所有变更和修改。显然，本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样，倘若本发明的这些修改和变型属于本发明权利要求及
其等同技术的范围之内，则本发明也意图包含这些改动和变型在内。

Claims (19)

  1. 一种数据传输方法，其特征在于，包括：
    获取待传输的原始报文和当前的参考报文；所述当前的参考报文和所述原始报文为同一隧道中传输的报文；
    对所述原始报文与所述当前的参考报文进行差分后压缩，获得信息报文；
    利用隧道协议封装所述信息报文生成隧道报文；所述隧道报文包括压缩信息头，所述压缩信息头中包括所述当前的参考报文对应的参考报文标识；
    发送所述隧道报文。
  2. 如权利要求1所述的方法，其特征在于，获取当前的参考报文之前，还包括：
    确认所述原始报文是否满足参考报文更新条件，若不满足则获取所述当前的参考报文。
  3. 如权利要求2所述的方法，其特征在于，还包括：
    若所述原始报文满足参考报文更新条件，则根据所述原始报文更新所述当前的参考报文并更新所述当前的参考报文的参考报文标识；
    利用所述隧道协议封装所述原始报文生成隧道报文；所述隧道报文包括压缩信息头，所述压缩信息头中包括所述当前的参考报文对应的参考报文标识。
  4. 如权利要求3所述的方法，其特征在于，所述压缩信息头中还包括更新标识，所述更新标识用于指示所述隧道报文对应的原始报文为当前的参考报文。
  5. 一种数据处理方法，其特征在于，包括：
    接收隧道报文；
    解封所述隧道报文，得到信息报文，所述信息报文为对原始报文与参考报文进行差分后压缩得到的；所述参考报文和所述原始报文为同一隧道中传输的报文；
    根据所述隧道报文的压缩信息头中包括的参考报文标识，获取所述参考报文；
    根据所述信息报文和所述参考报文，获得所述原始报文。
  6. 如权利要求5所述的方法，其特征在于，解封所述隧道报文，得到信息报文之前，还包括：
    确认所述隧道报文的压缩信息头中的更新标识是否为设定值；
    若所述隧道报文的压缩信息头中的更新标识是所述设定值，则对所述隧道报文解封，得到所述信息报文。
  7. 如权利要求6所述的方法，其特征在于，还包括：
    若所述隧道报文的压缩信息头中的更新标识不是所述设定值，则对所述隧道报文解封，获取所述原始报文，并关联保存所述原始报文和所述压缩信息头中的参考报文标识。
  8. 一种数据传输装置，其特征在于，包括：
    处理单元，用于通过收发单元获取待传输的原始报文和当前的参考报文；所述当前的参考报文和所述原始报文为同一隧道中传输的报文；
    所述处理单元，还用于对所述原始报文与所述当前的参考报文进行差分后压缩，获得信息报文；
    所述处理单元，还用于利用隧道协议封装所述信息报文生成隧道报文；所述隧道报文包括压缩信息头，所述压缩信息头中包括所述当前的参考报文对应的参考报文标识；
    所述处理单元，还用于控制所述收发单元发送所述隧道报文。
  9. 如权利要求8所述的装置，其特征在于，所述处理单元还用于：
    确认所述原始报文是否满足参考报文更新条件，若不满足则获取所述当前的参考报文。
  10. 如权利要求9所述的装置，其特征在于，所述处理单元还用于：
    若所述原始报文满足参考报文更新条件，则根据所述原始报文更新所述当前的参考报文并更新所述当前的参考报文的参考报文标识；
    利用所述隧道协议封装所述原始报文生成隧道报文；所述隧道报文包括压缩信息头，所述压缩信息头中包括所述当前的参考报文对应的参考报文标识。
  11. 如权利要求10所述的装置，其特征在于，所述压缩信息头中还包括更新标识，所述更新标识用于指示所述隧道报文对应的原始报文为当前的参考报文。
  12. 一种数据处理装置，其特征在于，包括：
    收发单元，用于接收隧道报文；
    处理单元，用于解封所述隧道报文，得到信息报文，所述信息报文为对原始报文与参考报文进行差分后压缩得到的；所述参考报文和所述原始报文为同一隧道中传输的报文；
    所述处理单元，还用于根据所述隧道报文的压缩信息头中包括的参考报文标识，获取所述参考报文；
    所述处理单元，还用于根据所述信息报文和所述参考报文，获得所述原始报文。
  13. 如权利要求12所述的装置，其特征在于，所述处理单元还用于：
    确认所述隧道报文的压缩信息头中的更新标识是否为设定值；
    若所述隧道报文的压缩信息头中的更新标识是所述设定值，则对所述隧道报文解封，得到所述信息报文。
  14. 如权利要求13所述的装置，其特征在于，所述处理单元还用于：
    若所述隧道报文的压缩信息头中的更新标识不是所述设定值，则对所述隧道报文解封，获取所述原始报文，并关联保存所述原始报文和所述压缩信息头中的参考报文标识。
  15. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于使所述计算机执行权利要求1至4任一项所述的数据传输方法。
  16. 一种计算设备，其特征在于，包括：
    存储器，用于存储程序指令；
    处理器，用于调用所述存储器中存储的程序指令，按照获得的程序执行如权利要求1至4中任一项所述的数据传输方法。
  17. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于使所述计算机执行如权利要求5至7中任一项所述的数据处理方法。
  18. 一种计算设备，其特征在于，包括：
    存储器，用于存储程序指令；
    处理器，用于调用所述存储器中存储的程序指令，按照获得的程序执行如权利要求5至7中任一项所述的数据处理方法。
  19. 一种计算机程序产品，其特征在于，所述计算机程序产品包括存储在非暂态计算机可读存储介质上的计算程序，所述计算机程序包括所述计算机可执行指令，当所述计算机可执行指令被计算机执行时，使所述计算机执行权利要求1-4中任一项所述的数据传输方法或权利要求5-7中任一项所述的数据处理方法。
PCT/CN2018/098166 2017-09-21 2018-08-01 一种数据传输方法、处理方法及装置 WO2019056863A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/649,414 US11251992B2 (en) 2017-09-21 2018-08-01 Data transmission method and processing method, and device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710860616.X 2017-09-21
CN201710860616.XA CN107749815B (zh) 2017-09-21 2017-09-21 一种数据传输方法、处理方法及装置

Publications (1)

Publication Number Publication Date
WO2019056863A1 true WO2019056863A1 (zh) 2019-03-28

Family

ID=61254989

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/098166 WO2019056863A1 (zh) 2017-09-21 2018-08-01 一种数据传输方法、处理方法及装置

Country Status (3)

Country Link
US (1) US11251992B2 (zh)
CN (1) CN107749815B (zh)
WO (1) WO2019056863A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114598374A (zh) * 2020-12-07 2022-06-07 千寻位置网络有限公司 数据处理方法、装置、电子设备及计算机可读介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107749815B (zh) 2017-09-21 2020-02-18 京信通信系统（中国）有限公司 一种数据传输方法、处理方法及装置
CN110830437B (zh) * 2019-09-25 2022-06-10 平安科技（深圳）有限公司 高频业务数据的数据压缩方法、装置、设备及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050138186A1 (en) * 1999-12-02 2005-06-23 Lambertus Hesselink Managed peer-to-peer applications, systems and methods for distributed data access and storage
US20050149481A1 (en) * 1999-12-02 2005-07-07 Lambertus Hesselink Managed peer-to-peer applications, systems and methods for distributed data access and storage
CN101034956A (zh) * 2007-02-15 2007-09-12 华为技术有限公司 一种脉冲调制编、解码的方法、设备及系统
US20080046616A1 (en) * 2006-08-21 2008-02-21 Citrix Systems, Inc. Systems and Methods of Symmetric Transport Control Protocol Compression
CN103618903A (zh) * 2013-12-10 2014-03-05 天津大学 高速低功耗无线传感网络视频压缩采样方法及装置
CN107749815A (zh) * 2017-09-21 2018-03-02 京信通信系统（中国）有限公司 一种数据传输方法、处理方法及装置

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8976798B2 (en) * 2002-01-28 2015-03-10 Hughes Network Systems, Llc Method and system for communicating over a segmented virtual private network (VPN)
US7529933B2 (en) * 2002-05-30 2009-05-05 Microsoft Corporation TLS tunneling
US7420992B1 (en) * 2005-03-17 2008-09-02 Packeteer, Inc. Adaptive network traffic compression mechanism including dynamic selection of compression algorithms
US20060244587A1 (en) * 2005-04-28 2006-11-02 Mci, Inc. Method and apparatus for providing transmission of compressed telemetry data in a tracking system
US7649909B1 (en) * 2006-06-30 2010-01-19 Packeteer, Inc. Adaptive tunnel transport protocol
US10075182B2 (en) * 2006-10-13 2018-09-11 Qualcomm Incorporated Message compression
US8165124B2 (en) * 2006-10-13 2012-04-24 Qualcomm Incorporated Message compression methods and apparatus
US8418244B2 (en) * 2007-04-27 2013-04-09 Yahoo! Inc. Instant communication with TLS VPN tunnel management
CN101616081A (zh) * 2009-07-30 2009-12-30 杭州华三通信技术有限公司 一种基于隧道的报文转发方法及路由器
CN101827031A (zh) * 2010-04-22 2010-09-08 中兴通讯股份有限公司 一种用户数据包协议udp隧道中传输报文的方法及装置
US8467415B2 (en) * 2010-12-31 2013-06-18 Michelle M. Antonelli System and method for dynamic template updating for compressed messages
US9277493B2 (en) * 2013-08-12 2016-03-01 Intel Corporation Managing communications in multiple radio access networks
CN104426680B (zh) * 2013-09-03 2018-03-16 华为技术有限公司 数据传输方法、装置和系统
WO2015180084A1 (zh) * 2014-05-29 2015-12-03 华为技术有限公司 一种报文转发方法和VxLAN网关
GB201518327D0 (en) * 2015-10-16 2015-12-02 Netiquet Labs Ltd Messaging Security
US20170126845A1 (en) * 2015-10-29 2017-05-04 VTX Holdings (Singapore) Pte. Ltd. Network communication system
US10234885B2 (en) * 2016-06-13 2019-03-19 Sun Electric Digital Stream Ltd. Method and system for facilitating auditing of power generation and allocation thereof to consumption loads
US10567466B2 (en) * 2017-04-06 2020-02-18 Microsoft Technology Licensing, Llc Co-streaming within a live interactive video game streaming service

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050138186A1 (en) * 1999-12-02 2005-06-23 Lambertus Hesselink Managed peer-to-peer applications, systems and methods for distributed data access and storage
US20050149481A1 (en) * 1999-12-02 2005-07-07 Lambertus Hesselink Managed peer-to-peer applications, systems and methods for distributed data access and storage
US20080046616A1 (en) * 2006-08-21 2008-02-21 Citrix Systems, Inc. Systems and Methods of Symmetric Transport Control Protocol Compression
CN101034956A (zh) * 2007-02-15 2007-09-12 华为技术有限公司 一种脉冲调制编、解码的方法、设备及系统
CN103618903A (zh) * 2013-12-10 2014-03-05 天津大学 高速低功耗无线传感网络视频压缩采样方法及装置
CN107749815A (zh) * 2017-09-21 2018-03-02 京信通信系统（中国）有限公司 一种数据传输方法、处理方法及装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114598374A (zh) * 2020-12-07 2022-06-07 千寻位置网络有限公司 数据处理方法、装置、电子设备及计算机可读介质
CN114598374B (zh) * 2020-12-07 2023-08-29 千寻位置网络有限公司 数据处理方法、装置、电子设备及计算机可读介质

Also Published As

Publication number Publication date
CN107749815B (zh) 2020-02-18
US20200304339A1 (en) 2020-09-24
US11251992B2 (en) 2022-02-15
CN107749815A (zh) 2018-03-02

Similar Documents

Publication Publication Date Title
US10587544B2 (en) Message processing method, processing server, terminal, and storage medium
US20200159955A1 (en) Data Privacy Opt In/Out Solution
US10958416B2 (en) Encrypted and compressed data transmission with padding
US9253061B2 (en) Tunnel health check mechanism in overlay network
CN110708393A (zh) 用于传输数据的方法、装置和系统
WO2016101288A1 (zh) 一种远程直接数据存取方法、设备和系统
TW201644252A (zh) 用於經由代理伺服器之安全視訊、影像、音訊及其他媒體訊務之接收及傳輸最佳化的系統及方法
WO2019056863A1 (zh) 一种数据传输方法、处理方法及装置
US10983810B2 (en) Implementing web browser in virtual machine
CN109154968B (zh) 用于组织内的安全且高效的通信的系统和方法
CN105659560A (zh) 使用自适应数据压缩的安全通信
WO2018161802A1 (zh) 一种业务流的控制方法及装置
TW201627875A (zh) 資料分享方法及裝置
WO2016127796A1 (zh) 信息交互方法及服务器
EP3324292B1 (en) Method and apparatus for cloud streaming service
CN113595927A (zh) 一种旁路模式下镜像流量的处理方法和装置
CN113162836B (zh) 虚拟局域网联通方法、装置、云服务器、介质和电子设备
CN111163102B (zh) 数据处理方法及装置、网络设备、可读存储介质
US10231004B2 (en) Network recording service
CN115766628A (zh) 报文组合方法、装置、设备及存储介质
EP4183115A1 (en) Enabling vertical application layer server for peer-to-peer media parameter negotiation
US10958423B2 (en) Automated changeover of transfer encryption key
US10218576B1 (en) Controlled bandwidth expansion in compressed disaggregated storage systems
CN109933960A (zh) 服务调用控制方法、服务调用方法、装置及终端
US11431492B2 (en) Mutable encrypted system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18859670

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 08/09/2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18859670

Country of ref document: EP

Kind code of ref document: A1