CN117319509A - Network data processing method, device and computer readable storage medium - Google Patents

Network data processing method, device and computer readable storage medium Download PDF

Info

Publication number
CN117319509A
CN117319509A CN202210724332.9A CN202210724332A CN117319509A CN 117319509 A CN117319509 A CN 117319509A CN 202210724332 A CN202210724332 A CN 202210724332A CN 117319509 A CN117319509 A CN 117319509A
Authority
CN
China
Prior art keywords
network
data
compression ratio
information
forwarding path
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210724332.9A
Other languages
Chinese (zh)
Inventor
林宁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN202210724332.9A priority Critical patent/CN117319509A/en
Priority to PCT/CN2023/082851 priority patent/WO2023246203A1/en
Publication of CN117319509A publication Critical patent/CN117319509A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/565Conversion or adaptation of application format or content
    • H04L67/5651Reducing the amount or size of exchanged application data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04Protocols for data compression, e.g. ROHC

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention discloses a network data processing method, a device and a computer readable storage medium, which are used for determining a forwarding path for forwarding a data message; determining the health degree of the forwarding path according to the network parameters of the forwarding path, wherein the health degree is used for evaluating the network quality of the forwarding path; determining compression ratio information of the data message according to the health degree; and compressing the data message according to the compression ratio information. Based on the above, when the network device receives the data to be transferred, the network device can perform intelligent compression ratio selection according to the network condition, and perform compression transfer on the data to be transferred on the network device according to the corresponding compression ratio so as to automatically adapt to different network environments. Therefore, the invention can improve the utilization rate of network bandwidth, improve the intelligent capability of the whole network and improve the effect perception of the network transmission data presentation by the user.

Description

网络数据处理方法、装置和计算机可读存储介质Network data processing method, device and computer-readable storage medium

技术领域Technical field

本发明实施例涉及但不限于网络设备技术领域,特别是涉及一种网络数据处理方法、装置和计算机可读存储介质。Embodiments of the present invention relate to, but are not limited to, the technical field of network equipment, and in particular, to a network data processing method, device and computer-readable storage medium.

背景技术Background technique

目前网络设备传输的需要被压缩的数据主要是视频业务,视频业务根据不同的用户需要和网络质量的变化情况,可以分为浅压缩和深压缩,并且各种不同的压缩算法也可以对应这不同的压缩比。Currently, the data that needs to be compressed transmitted by network equipment is mainly video services. Video services can be divided into shallow compression and deep compression according to different user needs and changes in network quality, and various compression algorithms can also correspond to these differences. compression ratio.

在相关技术中,通常是在数据到达网络设备之前,就已经完成了压缩的操作,网络设备作为传输设备,并不直接参与数据的压缩处理。因此,需要被压缩的数据在网络设备中进行传输的时候,无法根据网络情况进行自动调整,一旦数据的压缩模式被选择,则不可能再进行调整。并且网络设备在整个传输的过程中,不感知此数据的任何信息,也不对此数据的压缩比进行任何的干预和处理。。In related technologies, the compression operation is usually completed before the data reaches the network device. The network device, as a transmission device, does not directly participate in the compression processing of the data. Therefore, when the data that needs to be compressed is transmitted in the network device, it cannot be automatically adjusted according to the network conditions. Once the data compression mode is selected, it is impossible to adjust it. And the network device does not perceive any information about this data during the entire transmission process, nor does it perform any intervention or processing on the compression ratio of this data. .

发明内容Contents of the invention

以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。The following is an overview of the topics described in detail in this article. This summary is not intended to limit the scope of the claims.

本发明实施例提供了一种网络数据处理方法、装置和计算机可读存储介质,能够有效提升网络的利用率,提升整体网络的智能化能力,提升用户对网络传输数据呈现的效果感知。Embodiments of the present invention provide a network data processing method, device and computer-readable storage medium, which can effectively improve network utilization, enhance the intelligence capability of the overall network, and improve users' perception of the effects of network transmission data presentation.

第一方面,本发明实施例提供了一种网络数据处理方法,应用于网络设备,所述方法包括:In a first aspect, embodiments of the present invention provide a network data processing method, which is applied to network equipment. The method includes:

确定转发数据报文的转发路径;Determine the forwarding path for forwarding data packets;

根据转发路径的网络参数来确定所述转发路径的健康度,所述健康度用于评价所述转发路径的网络质量;Determine the health of the forwarding path according to the network parameters of the forwarding path, and the health is used to evaluate the network quality of the forwarding path;

根据所述健康度确定所述数据报文的压缩比信息;Determine the compression ratio information of the data message according to the health degree;

根据所述压缩比信息对所述数据报文进行压缩。The data message is compressed according to the compression ratio information.

第二方面,本发明实施例提供了一种网络数据处理装置,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如上第一方面所述的网络数据处理方法。In a second aspect, embodiments of the present invention provide a network data processing device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, The network data processing method described in the first aspect above.

第三方面,本发明实施例提供了一种电子设备,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如上第一方面所述的网络数据处理方法。In a third aspect, embodiments of the present invention provide an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the above mentioned steps are implemented. The network data processing method described in one aspect.

第四方面,本发明实施例提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机可执行程序,所述计算机可执行程序用于使计算机执行如上第一方面所述的网络数据处理方法。In a fourth aspect, embodiments of the present invention provide a computer-readable storage medium that stores a computer-executable program. The computer-executable program is used to cause a computer to execute the method described in the first aspect. Network data processing methods.

本发明实施例包括:通过确定转发数据报文的转发路径;根据转发路径的网络参数来确定转发路径的健康度,健康度用于评价转发路径的网络质量;根据健康度确定数据报文的压缩比信息;根据压缩比信息对数据报文进行压缩。基于此,网络设备在接收到需要传递的数据时,可以根据网络的情况进行智能的压缩比选择,对需要在网络设备上传输的数据根据相应的压缩比来进行压缩传递,以自动适应不同的网络环境。因此,本发明可以提高网络带宽的利用率,提升整体网络的智能化能力,提升用户对网络传输数据呈现的效果感知。Embodiments of the present invention include: determining the forwarding path for forwarding data messages; determining the health of the forwarding path according to the network parameters of the forwarding path, and the health is used to evaluate the network quality of the forwarding path; and determining the compression of the data message according to the health. ratio information; compress the data packet according to the compression ratio information. Based on this, when the network device receives the data that needs to be transmitted, it can intelligently select the compression ratio according to the network conditions, and compress and transmit the data that needs to be transmitted on the network device according to the corresponding compression ratio to automatically adapt to different conditions. Web environment. Therefore, the present invention can improve the utilization rate of network bandwidth, enhance the intelligence capability of the overall network, and improve users' perception of the effect of network transmission data presentation.

本发明的其它特征和优点将在随后的说明书中阐述,并且,部分地从说明书中变得显而易见,或者通过实施本发明而了解。本发明的目的和其他优点可通过在说明书、权利要求书以及附图中所特别指出的结构来实现和获得。Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention may be realized and obtained by the structure particularly pointed out in the written description, claims and appended drawings.

附图说明Description of drawings

附图用来提供对本发明技术方案的进一步理解,并且构成说明书的一部分,与本发明的实施例一起用于解释本发明的技术方案,并不构成对本发明技术方案的限制。The accompanying drawings are used to provide a further understanding of the technical solutions of the present invention, and constitute a part of the description. Together with the embodiments of the present invention, they are used to explain the technical solutions of the present invention, and do not constitute a limitation of the technical solutions of the present invention.

图1是本发明一个实施例提供的一种网络数据处理方法的主流程图;Figure 1 is a main flow chart of a network data processing method provided by an embodiment of the present invention;

图2是本发明一个实施例提供的网络设备结构示意图;Figure 2 is a schematic structural diagram of a network device provided by an embodiment of the present invention;

图3是本发明一个实施例提供的网络设备对数据报文压缩处理示意图;Figure 3 is a schematic diagram of data packet compression processing by a network device according to an embodiment of the present invention;

图4是本发明一个实施例提供的网络设备对数据报文压缩处理示意图;Figure 4 is a schematic diagram of data packet compression processing by a network device according to an embodiment of the present invention;

图5是本发明一个实施例提供的网络设备对数据报文压缩处理示意图;Figure 5 is a schematic diagram of data packet compression processing by a network device according to an embodiment of the present invention;

图6是本发明一个实施例提供的网络数据处理装置结构示意图;Figure 6 is a schematic structural diagram of a network data processing device provided by an embodiment of the present invention;

图7是本发明一个实施例提供的电子设备结构示意图。Figure 7 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention.

具体实施方式Detailed ways

为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本发明,并不用于限定本发明。In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention and are not intended to limit the present invention.

应了解,在本发明实施例的描述中,多个(或多项)的含义是两个以上,大于、小于、超过等理解为不包括本数,以上、以下、以内等理解为包括本数。如果有描述到“第一”、“第二”等只是用于区分技术特征为目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量或者隐含指明所指示的技术特征的先后关系。It should be understood that in the description of the embodiments of the present invention, the meaning of multiple (or multiple items) is two or more. Greater than, less than, more than, etc. are understood as excluding the number, and above, below, within, etc. are understood as including the number. If there are descriptions of "first", "second", etc., they are only used for the purpose of distinguishing technical features and cannot be understood as indicating or implying the relative importance or implicitly indicating the number of technical features indicated or implicitly indicating the indicated technical features. The sequence relationship of technical features.

针对现有技术存在网络设备仅作为传输设备并不直接参与数据的压缩处理的问题,本发明实施例提供了一种网络数据处理方法、装置和计算机可读存储介质,通过确定转发数据报文的转发路径;根据转发路径的网络参数来确定转发路径的健康度,健康度用于评价转发路径的网络质量;根据健康度确定数据报文的压缩比信息;根据压缩比信息对数据报文进行压缩。基于此,网络设备在接收到需要传递的数据时,可以根据网络的情况进行智能的压缩比选择,对需要在网络设备上传输的数据根据相应的压缩比来进行压缩传递,以自动适应不同的网络环境。因此,本发明可以提高网络带宽的利用率,提升整体网络的智能化能力,提升用户对网络传输数据呈现的效果感知。In view of the problem in the existing technology that network equipment only serves as transmission equipment and does not directly participate in data compression processing, embodiments of the present invention provide a network data processing method, device and computer-readable storage medium, by determining the method of forwarding data messages Forwarding path; determine the health of the forwarding path based on the network parameters of the forwarding path, and the health is used to evaluate the network quality of the forwarding path; determine the compression ratio information of the data packet based on the health; compress the data packet based on the compression ratio information . Based on this, when the network device receives the data that needs to be transmitted, it can intelligently select the compression ratio according to the network conditions, and compress and transmit the data that needs to be transmitted on the network device according to the corresponding compression ratio to automatically adapt to different conditions. Web environment. Therefore, the present invention can improve the utilization rate of network bandwidth, enhance the intelligence capability of the overall network, and improve users' perception of the effect of network transmission data presentation.

如图1所示,图1是本发明一个实施例提供的一种网络数据处理方法的流程图。网络数据处理方法包括但不限于如下步骤:As shown in Figure 1, Figure 1 is a flow chart of a network data processing method provided by an embodiment of the present invention. Network data processing methods include but are not limited to the following steps:

步骤S101,确定转发数据报文的转发路径;Step S101, determine the forwarding path for forwarding the data message;

步骤S102,根据转发路径的网络参数来确定转发路径的健康度,健康度用于评价转发路径的网络质量;Step S102: Determine the health of the forwarding path based on the network parameters of the forwarding path. The health is used to evaluate the network quality of the forwarding path;

步骤S103,根据健康度确定数据报文的压缩比信息;Step S103, determine the compression ratio information of the data message according to the health degree;

步骤S104,根据压缩比信息对数据报文进行压缩。Step S104: Compress the data message according to the compression ratio information.

在一示例性的实施方式中,本方法可以适用于网络设备,网络设备可以包括但不限于交换机和路由器。In an exemplary implementation, this method may be applied to network equipment, which may include but is not limited to switches and routers.

在一示例性的实施方式中,利用网络设备对网络质量进行及时判断。针对需要转发的数据流的出口信息进行判断,确定网络的转发路径的健康度,通过综合给出一个健康分数来反应转发路径的健康度。再基于健康分数选择对应的压缩比,例如,如果网络状态好,可以选择不压缩,如果状态一般可以使用浅压缩类算法,如果状态很差可以进行深压缩类算法。In an exemplary implementation, network equipment is used to make timely judgments on network quality. Determine the exit information of the data flow that needs to be forwarded, determine the health of the forwarding path of the network, and give a comprehensive health score to reflect the health of the forwarding path. Then select the corresponding compression ratio based on the health score. For example, if the network status is good, you can choose not to compress, if the status is generally shallow compression algorithm, if the status is very poor, you can use deep compression algorithm.

在一示例性的实施方式中,如图2所示,网络设备100可以集成有转发模块110和压缩模块120。转发模块110将携带了压缩比信息的数据报文转发到压缩模块120。压缩模块120可以进行多种压缩比的算法选择,并且输出压缩后的数据。基于转发路径的健康分数,对应选择好需要压缩的压缩比要求,网络设备100将原始数据流增加需要的压缩比信息之后,通过转发模块110重定向到压缩模块120中进行处理,压缩模块120根据收到的压缩比信息对原始数据流进行对应的压缩比处理后,将数据报文还原并回传给转发模块110,转发模块110按照报文的原路径将压缩后的报文转发出去。In an exemplary implementation, as shown in FIG. 2 , the network device 100 may be integrated with a forwarding module 110 and a compression module 120 . The forwarding module 110 forwards the data packet carrying the compression ratio information to the compression module 120 . The compression module 120 can select algorithms for multiple compression ratios and output compressed data. Based on the health score of the forwarding path, corresponding to the selected compression ratio requirement to be compressed, the network device 100 adds the required compression ratio information to the original data stream, and then redirects it to the compression module 120 for processing through the forwarding module 110. The compression module 120 performs processing according to the After performing corresponding compression ratio processing on the original data stream based on the received compression ratio information, the data message is restored and sent back to the forwarding module 110. The forwarding module 110 forwards the compressed message according to the original path of the message.

在一示例性的实施方式中,网络的转发路径的健康度可以根据网络参数来判断,例如根据端口带宽、拥塞程度、丢包率、光模块传输长度、限速或整形等QOS(Quality ofService,服务质量)设置等信息的一项或者几项进行综合判定,最终根据用户的需要或者网络的设置,确定网络设备100的转发路径的健康参数对数据的压缩比要求。In an exemplary implementation, the health of the forwarding path of the network can be determined based on network parameters, such as port bandwidth, congestion level, packet loss rate, optical module transmission length, rate limiting or shaping, etc. QOS (Quality of Service, Quality of Service) settings and other information are comprehensively judged, and finally the data compression ratio requirements of the health parameters of the forwarding path of the network device 100 are determined according to the needs of the user or the network settings.

在一示例性的实施方式中,对于网络设备100内集成的压缩模块120,可以使用网络处理器芯片或FPGA芯片进行实现,具备可识别网络设备100对需要进行压缩处理的数据的携带信息进行识别并且选择相应的压缩比算法进行压缩的能力。In an exemplary embodiment, the compression module 120 integrated in the network device 100 can be implemented using a network processor chip or an FPGA chip, and is capable of identifying the network device 100 to identify the information carried by the data that needs to be compressed. And the ability to select the corresponding compression ratio algorithm for compression.

在一示例性的实施方式中,对于压缩比信息的确定过程,网络设备100识别到需要进行智能压缩比处理的数据报文,具体的方式可以通过用户配置或者报文特征等方式对数据报文进行识别。网络设备100确定好需要进行智能压缩比处理的数据报文需要转发的网络路径,并且确定此转发路径的网络参数,例如端口参数、QOS数据、带宽以及光模块等信息的情况,基于此情况结合用户配置,计算出此转发路径的健康分数。以端口参数为例,丢包率越高,健康分数越低。以QOS数据为例,限速值越高,健康分数越低。以带宽为例,带宽值越小,健康分数越低。以光模块为例,光模块的型号决定传输路径,传输路径越长,健康分数越低;光模块的光功率越稳定,健康分数越高。需要指出的是,健康分数可以根据上述网络参数的一项或者几项进行综合判定。网络设备100再基于此健康分数,确定好压缩比信息。In an exemplary embodiment, for the determination process of compression ratio information, the network device 100 identifies data packets that require intelligent compression ratio processing. The specific method may be to use user configuration or packet characteristics to process the data packets. to identify. The network device 100 determines the network path that needs to be forwarded for data packets that require intelligent compression ratio processing, and determines the network parameters of this forwarding path, such as port parameters, QOS data, bandwidth, optical modules and other information, and combines it based on this situation User configuration to calculate the health score of this forwarding path. Taking port parameters as an example, the higher the packet loss rate, the lower the health score. Taking QOS data as an example, the higher the speed limit value, the lower the health score. Taking bandwidth as an example, the smaller the bandwidth value, the lower the health score. Taking optical modules as an example, the model of the optical module determines the transmission path. The longer the transmission path, the lower the health score; the more stable the optical power of the optical module, the higher the health score. It should be pointed out that the health score can be comprehensively determined based on one or more of the above network parameters. The network device 100 then determines the compression ratio information based on the health score.

在一示例性的实施方式中,对于转发路径的健康分数的确定可以根据转发路径网络参数的一项或者几项进行综合判定。以端口参数作为健康分数的判定依据为例,当网络设备检测到丢包率为10%,则可以确定转发路径的健康分数为90分;当网络设备检测到丢包率为20%,则可以确定转发路径的健康分数为80分。以QOS数据作为健康分数的判定依据为例,当限速值为带宽值的五分之四,则可以确定转发路径的健康分数为80分;当限速值为带宽值的五分之三,则可以确定转发路径的健康分数为60分。以端口参数和QOS数据综合起来作为健康分数的判定依据为例,当网络设备检测到丢包率为10%,且限速值为带宽值的五分之四,则可以确定转发路径的健康分数为85分;当网络设备检测到丢包率为20%,且限速值为带宽值的五分之三,则可以确定转发路径的健康分数为70分。需要说明的是,上述计算转发路径健康分数的数值仅仅是示例性说明,不应该理解为对本发明实施例的限定。In an exemplary implementation, the health score of the forwarding path may be determined based on a comprehensive determination based on one or several network parameters of the forwarding path. Taking port parameters as the basis for determining the health score as an example, when the network device detects that the packet loss rate is 10%, it can be determined that the health score of the forwarding path is 90 points; when the network device detects that the packet loss rate is 20%, it can Determine the health score of the forwarding path to be 80 points. Taking QOS data as the basis for determining the health score as an example, when the speed limit value is four-fifths of the bandwidth value, it can be determined that the health score of the forwarding path is 80 points; when the speed limit value is three-fifths of the bandwidth value, Then it can be determined that the health score of the forwarding path is 60 points. Taking port parameters and QOS data as an example to determine the health score, when the network device detects that the packet loss rate is 10% and the speed limit value is four-fifths of the bandwidth value, the health score of the forwarding path can be determined. is 85 points; when the network device detects that the packet loss rate is 20% and the speed limit value is three-fifths of the bandwidth value, it can be determined that the health score of the forwarding path is 70 points. It should be noted that the above values for calculating the forwarding path health score are only illustrative and should not be understood as limiting the embodiment of the present invention.

在一示例性的实施方式中,对于转发路径的健康分数与压缩比之间的对应关系,健康分数越高,压缩比越小;反之,健康分数越低,压缩比越大。假设压缩比从无压缩到深压缩一共分为0-10级压缩比,以转发路径的健康分数为90分为例,表明此时转发路径的网络状态较佳,可以采用1级压缩比对数据报文进行浅压缩;以转发路径的健康分数为20分为例,表明此时转发路径的网络状态不佳,可以采用8级压缩比对数据报文进行深压缩。需要说明的是,上述转发路径的健康分数与压缩比之间的数值对应关系仅仅是示例性说明,不应该理解为对本发明实施例的限定。In an exemplary implementation, regarding the correspondence between the health score of the forwarding path and the compression ratio, the higher the health score, the smaller the compression ratio; conversely, the lower the health score, the greater the compression ratio. Assume that the compression ratio is divided into 0-10 levels from no compression to deep compression. Taking the health score of the forwarding path as 90 points as an example, it indicates that the network status of the forwarding path is better at this time, and level 1 compression can be used to compare the data. The packets are shallowly compressed; taking the health score of the forwarding path as 20 points as an example, it indicates that the network status of the forwarding path is not good at this time, and an 8-level compression ratio can be used to deeply compress the data packets. It should be noted that the above numerical correspondence between the health score of the forwarding path and the compression ratio is only an illustrative description and should not be understood as limiting the embodiment of the present invention.

在一示例性的实施方式中,网络设备100可以基于自身的转发路径进行健康分数的判断,并且根据此判断选择对应的数据的压缩比,通过传递压缩比要求给压缩模块120进行处理,压缩模块120处理完毕之后,重新进入转发模块110中按照原始路径要求进行转发,从而实现根据路径健康情况智能调整数据压缩比的功能。In an exemplary implementation, the network device 100 can determine the health score based on its own forwarding path, and select the compression ratio of the corresponding data based on this determination, and pass the compression ratio request to the compression module 120 for processing. The compression module After 120 is processed, it re-enters the forwarding module 110 to forward according to the original path requirements, thereby realizing the function of intelligently adjusting the data compression ratio according to the health of the path.

在一示例性的实施方式中,本发明的主要目的在于提出一种可以让网络设备100参与数据压缩比的选择和决定的方法,利用此方法,可以将网络设备100对于网络的状态感知进行非常详细的评估,并且给出相应的评估结果,利用此评估结果,对于此数据流的压缩比需求进行智能的选择,并且在网络环境变化的状态下,此数据流的压缩比还可以进行相应的变化。利用本方法,既可以提升数据的传输效率,又可以结合网络变化情况最大效率的利用网络带宽,并且对网络中的故障或者变化可以做到及时的响应。提高网络带宽的利用率,提升用户对网络传输数据呈现的效果感知。In an exemplary embodiment, the main purpose of the present invention is to propose a method that allows the network device 100 to participate in the selection and decision of the data compression ratio. Using this method, the network device 100 can greatly improve the network status awareness. Detailed evaluation, and corresponding evaluation results are given. Using this evaluation result, the compression ratio requirements of this data flow can be intelligently selected, and in the changing state of the network environment, the compression ratio of this data flow can also be adjusted accordingly. Variety. Using this method, the data transmission efficiency can be improved, the network bandwidth can be utilized with maximum efficiency in combination with network changes, and timely response to faults or changes in the network can be achieved. Improve the utilization of network bandwidth and improve users' perception of the effect of network transmission data presentation.

在步骤S104之前可以包括但不限于如下步骤:Before step S104, it may include but is not limited to the following steps:

对数据报文进行信息标记,以使数据报文携带所述压缩比信息。The data packet is marked with information so that the data packet carries the compression ratio information.

在一示例性的实施方式中,对数据报文进行信息标记,使得数据报文可以携带有压缩比信息。具体地,可以通过修改传输报文的头部信息,在其中增加需要进行压缩比选择处理的内容,其修改方式可以包括但不限于修改vlan(Virtual Local Area Network,虚拟局域网),修改IP头部,修改报文优先级字段等方式进行。In an exemplary implementation, the data packet is marked with information so that the data packet can carry compression ratio information. Specifically, the header information of the transmission message can be modified to add content that requires compression ratio selection processing. The modification method can include but is not limited to modifying vlan (Virtual Local Area Network, virtual LAN), modifying the IP header , modify the packet priority field, etc.

在一示例性的实施方式中,网路设备将转发路径的健康分数转换为压缩比信息携带至数据报文中,并且发送到压缩模块120,对数据报文进行信息标记可以包括但不限于以下几种:In an exemplary implementation, the network device converts the health score of the forwarding path into compression ratio information and carries it into the data packet, and sends it to the compression module 120. Information marking of the data packet may include but is not limited to the following: Several types:

1、增加报文头部信息,增加一个可以重定向到压缩模块120的报文头部,报文头部包含需要进行压缩的压缩比控制信息。1. Add message header information and add a message header that can be redirected to the compression module 120. The message header contains compression ratio control information that needs to be compressed.

2、增加报文vlan信息,增加一个可以洪泛到压缩模块120的报文vlan,报文vlan包含需要进行压缩的压缩比控制信息。2. Add message vlan information and add a message vlan that can be flooded to the compression module 120. The message vlan contains compression ratio control information that needs to be compressed.

3、增加报文优先级信息,利用ACL(Access Control List,访问控制列表)技术识别对应的报文优先级信息重定向到压缩模块120,优先级信息中包含压缩比控制信息。3. Add packet priority information, and use ACL (Access Control List) technology to identify the corresponding packet priority information and redirect it to the compression module 120. The priority information includes compression ratio control information.

4、增加其他的表示压缩比控制的报文信息,利用ACL技术识别对应的报文信息重定向到压缩模块120。4. Add other message information indicating compression ratio control, and use ACL technology to identify the corresponding message information and redirect it to the compression module 120 .

在步骤S104之后可以包括但不限于如下步骤:After step S104, it may include but is not limited to the following steps:

在完成压缩后去除信息标记,向转发路径转发所述数据报文。After the compression is completed, the information mark is removed, and the data packet is forwarded to the forwarding path.

在一示例性的实施方式中,压缩模块120在完成压缩后去除信息标记,转发模块110向转发路径转发所述数据报文。具体地,转发模块110将携带了压缩比信息的数据报文转发到压缩模块120,例如,可以通过ACL重定向技术,镜像技术或者直接使用修改后的报文头部进行转发。压缩模块120基于报文头部信息选择压缩比后,将数据进行相应的压缩操作,并将被修改的数据信息做好处理,例如可以将被修改的数据信息还原或者丢弃,再把数据报文回传给转发模块110。转发模块110将压缩后的数据报文按照原转发路径发出。In an exemplary implementation, the compression module 120 removes the information mark after completing the compression, and the forwarding module 110 forwards the data packet to the forwarding path. Specifically, the forwarding module 110 forwards the data packet carrying the compression ratio information to the compression module 120. For example, the data packet may be forwarded through ACL redirection technology, mirroring technology or directly using the modified packet header. After selecting a compression ratio based on the message header information, the compression module 120 performs a corresponding compression operation on the data, and processes the modified data information. For example, the modified data information can be restored or discarded, and then the data message can be processed. back to the forwarding module 110. The forwarding module 110 sends the compressed data message according to the original forwarding path.

在一示例性的实施方式中,本发明首先利用网络设备100自身对于网络路径的健康度的判断,综合网络设备100的路径的各种信息,综合得出一个网络路径健康分数,并基于此分数选择对应的压缩比,如果网络状态好,可以选择不压缩,如果状态一般可以使用浅压缩类算法,如果状态很差可以进行深压缩类算法。再将需要进行智能压缩处理的数据报文进行修改,使其携带对应的压缩比数据,并且转发到压缩模块120中进行压缩处理,压缩模块120根据其报文中携带的压缩比信息进行压缩处理,并且将携带压缩比的报文头部进行压缩处理,把修改过的报文头部信息丢弃或者还原,并传回转发模块110进行报文转发。报文转发模块110将报文按照原路径进行转发,完成数据的智能压缩处理。In an exemplary implementation, the present invention first uses the network device 100's own judgment on the health of the network path, integrates various information on the path of the network device 100, and comprehensively obtains a network path health score, and based on this score Select the corresponding compression ratio. If the network status is good, you can choose not to compress. If the status is general, you can use a shallow compression algorithm. If the status is poor, you can use a deep compression algorithm. Then the data message that needs to be intelligently compressed is modified so that it carries the corresponding compression ratio data, and is forwarded to the compression module 120 for compression processing. The compression module 120 performs compression processing according to the compression ratio information carried in the message. , and compress the message header carrying the compression ratio, discard or restore the modified message header information, and send it back to the forwarding module 110 for message forwarding. The message forwarding module 110 forwards the message according to the original path to complete intelligent compression processing of data.

在一示例性的实施方式中,在网络的传输条件进行变化的时候,网络的健康分数也可以随之进行变化,并且在压缩比的选择中也可以进行相应的变化,因此,这样的方法可以适应网络的各种变化和故障,根据不同的状态进行实际的调整。In an exemplary implementation, when the transmission conditions of the network change, the health score of the network can also change accordingly, and corresponding changes can also be made in the selection of the compression ratio. Therefore, such a method can Adapt to various changes and failures in the network and make actual adjustments according to different states.

在一示例性的实施方式中,通过网络设备100对网络路径的健康度分析,就可以根据网络转发路径的健康度智能选择对数据的压缩比,通过将需要压缩的压缩比信息携带到报文内部,并转发给压缩模块120进行压缩处理,处理后将修改的报文进行恢复,并回传给转发模块110,即可完成在网络设备100内部完成对数据的智能压缩处理。应用此方法,既可以提升数据的传输效率,又可以结合网络变化情况最大效率的利用网络带宽,并且对网络中的故障或者变化可以做到及时的响应。提高网络带宽的利用率,提升用户对网络传输数据呈现的效果感知。In an exemplary embodiment, by analyzing the health of the network path by the network device 100, the compression ratio for the data can be intelligently selected according to the health of the network forwarding path, and the compression ratio information that needs to be compressed can be carried into the message. Internally, it is forwarded to the compression module 120 for compression processing. After processing, the modified message is restored and sent back to the forwarding module 110, thereby completing the intelligent compression processing of data within the network device 100. Applying this method can not only improve data transmission efficiency, but also utilize network bandwidth with maximum efficiency based on network changes, and can respond in a timely manner to faults or changes in the network. Improve the utilization of network bandwidth and improve users' perception of the effect of network transmission data presentation.

以下结合具体实施例进一步介绍本发明提供的网络数据处理方法。The network data processing method provided by the present invention will be further introduced below with reference to specific embodiments.

例如,网络设备需要传递一个视频数据,压缩模块中有从无压缩到深压缩的0-10级压缩比的压缩算法。For example, the network device needs to transmit a video data. The compression module has compression algorithms with compression ratios of 0-10 levels from no compression to deep compression.

实施例一:通过对数据报文增加头部信息,头部信息包含压缩比信息Embodiment 1: By adding header information to the data packet, the header information contains compression ratio information

如图3所示,网络设备先确定转发视频数据的转发路径,然后根据转发路径的网络参数(包括端口带宽、拥塞程度、丢包率、光模块传输长度、限速或整形等QOS设置等信息的一项或者几项)确定转发路径的健康分数为80分,并根据该健康分数确定采用采用2级压缩比的浅压缩算法对视频数据进行压缩处理。网络设备对视频数据的头部增加一个头部信息,该头部信息为一个IP头部,形成GRE(Generic Routing Encapsulation,通用路由封装)报文,在IP头部增加目的IP为指向压缩模块所在的端口,IP为X.X.X.2最后一个数据表示此视频数据流需要2级压缩比的压缩。网络设备中的转发模块查询目的IP地址,将此视频数据转发到压缩模块中,压缩模块将视频数据按照2级压缩比进行压缩。在视频数据压缩完毕后,压缩模块将视频数据中新增的IP头部丢弃,并转发回转发模块中。转发模块将压缩后的视频数据向转发路径正常发出。As shown in Figure 3, the network device first determines the forwarding path for forwarding video data, and then based on the network parameters of the forwarding path (including port bandwidth, congestion level, packet loss rate, optical module transmission length, speed limit or shaping and other QOS settings and other information (one or several items) determines that the health score of the forwarding path is 80 points, and determines based on the health score to use a shallow compression algorithm with a 2-level compression ratio to compress the video data. The network device adds header information to the header of the video data. The header information is an IP header to form a GRE (Generic Routing Encapsulation) message. The destination IP is added to the IP header to point to the location of the compression module. The port, IP is X.X.X.2 and the last data indicates that this video data stream requires compression with a level 2 compression ratio. The forwarding module in the network device queries the destination IP address and forwards the video data to the compression module. The compression module compresses the video data according to the level 2 compression ratio. After the video data is compressed, the compression module discards the new IP header in the video data and forwards it back to the forwarding module. The forwarding module sends the compressed video data to the forwarding path normally.

实施例二:通过对数据报文增加vlan信息,vlan信息包含压缩比信息Embodiment 2: By adding vlan information to the data packet, the vlan information contains compression ratio information

如图4所示,网络设备先确定转发视频数据的转发路径,然后根据转发路径的网络参数(包括端口带宽、拥塞程度、丢包率、光模块传输长度、限速或整形等QOS设置等信息的一项或者几项)确定转发路径的健康分数为80分,并根据该健康分数确定采用采用2级压缩比的浅压缩算法对视频数据进行压缩处理。网络设备对视频数据的头部增加一个vlan字段,形成QinQ报文,用vlan4010-vlan4020分别表示0-10级压缩比,设定此视频数据头部vlan为4012表示此数据流需要2级压缩比的压缩。转发模块按照此vlan4012查找vlan转发表,将此视频数据洪泛流转发到压缩模块中,压缩模块将此视频数据按照2级压缩比进行压缩。在视频数据压缩完毕后,压缩模块将视频数据中新增的vlan字段丢弃,并转发回转发模块中。转发模块将压缩后的视频数据向转发路径正常发出。As shown in Figure 4, the network device first determines the forwarding path for forwarding video data, and then based on the network parameters of the forwarding path (including port bandwidth, congestion level, packet loss rate, optical module transmission length, speed limit or shaping and other QOS settings and other information (one or more items) determines the health score of the forwarding path to be 80 points, and determines based on the health score to use a shallow compression algorithm with a 2-level compression ratio to compress the video data. The network device adds a vlan field to the header of the video data to form a QinQ message. Use vlan4010-vlan4020 to represent the 0-10 level compression ratio respectively. Setting the vlan in the video data header to 4012 indicates that this data stream requires a level 2 compression ratio. of compression. The forwarding module searches the vlan forwarding table according to this vlan4012, and forwards the flood of video data to the compression module. The compression module compresses the video data according to the level 2 compression ratio. After the video data is compressed, the compression module discards the new vlan field in the video data and forwards it back to the forwarding module. The forwarding module sends the compressed video data to the forwarding path normally.

实施例三:通过对数据报文增加优先级信息,优先级信息包含压缩比信息Embodiment 3: By adding priority information to the data packet, the priority information includes compression ratio information

如图5所示,网络设备先确定转发视频数据的转发路径,然后根据转发路径的网络参数(包括端口带宽、拥塞程度、丢包率、光模块传输长度、限速或整形等QOS设置等信息的一项或者几项)确定转发路径的健康分数为80分,并根据该健康分数确定采用采用2级压缩比的浅压缩算法对视频数据进行压缩处理。网络设备将此视频数据的头部增加一个优先级信息(此处假定其他所有不需要压缩的数据,均不携带优先级信息),形成携带优先级的报文,用优先级0-7分别表示0-7级压缩比,设定此视频数据头部优先级为2,2表示此视频数据需要2级压缩比的压缩(由于优先级字段只有3个bit,因此只能表示0-7,但修改报文的字段的方式很多,不限于此方式)。网络设备预置ACL规则,匹配所有带优先级字段报文转发到压缩模块中,转发模块按照此ACL规则,将此视频数据洪泛流转发到压缩模块中,压缩模块将此数据按照2级压缩比进行压缩。在视频数据压缩完毕后,压缩模块将视频数据中优先级字段还原为0,并转发回转发模块中。转发模块将压缩后的视频数据向转发路径正常发出。As shown in Figure 5, the network device first determines the forwarding path for forwarding video data, and then based on the network parameters of the forwarding path (including port bandwidth, congestion level, packet loss rate, optical module transmission length, speed limit or shaping and other QOS settings and other information (one or more items) determines the health score of the forwarding path to be 80 points, and determines based on the health score to use a shallow compression algorithm with a 2-level compression ratio to compress the video data. The network device adds priority information to the header of this video data (it is assumed here that all other data that does not need to be compressed does not carry priority information) to form a packet carrying priority, represented by priorities 0-7 respectively. 0-7 level compression ratio, set the priority of this video data header to 2, 2 means that this video data requires compression with level 2 compression ratio (since the priority field only has 3 bits, it can only represent 0-7, but There are many ways to modify the fields of the message, not limited to this method). The network device presets ACL rules to match all packets with priority fields and forwards them to the compression module. The forwarding module forwards the flood of video data to the compression module according to this ACL rule. The compression module compresses this data according to level 2. than compression. After the video data is compressed, the compression module restores the priority field in the video data to 0 and forwards it back to the forwarding module. The forwarding module sends the compressed video data to the forwarding path normally.

由上述实施例可知,与现有的网络设备对数据压缩的报文转发机制相比,本发明可以使得网络设备不再是一个透明的传输设备,网络设备可以结合自身对网络状态更加清楚掌握的优势,将传输链路的健康程度与数据压缩比结合,从而形成根据网络传输链路的健康程度,按需进行数据压缩。并且在处理的过程中,网络设备可以通过修改报文的字段进行实现,整体的处理过程可以芯片化硬件化,最终可以完成在网络设备内部实现所有的数据压缩比智能处理的全过程。运用此方法可以有效的提升网络的利用率,提升整体网络的智能化能力,提升用户对于全网传输效果的体验感知。As can be seen from the above embodiments, compared with the existing network device's message forwarding mechanism for data compression, the present invention can make the network device no longer a transparent transmission device, and the network device can have a clearer grasp of the network status based on its own The advantage is that it combines the health of the transmission link with the data compression ratio, thereby enabling on-demand data compression based on the health of the network transmission link. And during the processing process, the network equipment can be implemented by modifying the fields of the message. The overall processing process can be implemented as chip hardware, and finally the entire process of intelligent processing of all data compression ratios can be completed within the network equipment. Using this method can effectively improve network utilization, enhance the intelligence capabilities of the overall network, and improve users' experience and perception of the transmission effect of the entire network.

如图6所示,本发明实施例还提供了一种网络数据处理装置。As shown in Figure 6, an embodiment of the present invention also provides a network data processing device.

具体地,该网络数据处理装置包括:一个或多个处理器和存储器,图6中以一个处理器及存储器为例。处理器和存储器可以通过总线或者其他方式连接,图6中以通过总线连接为例。Specifically, the network data processing device includes: one or more processors and memories. In FIG. 6 , one processor and memory are taken as an example. The processor and memory can be connected through a bus or other means. Figure 6 takes the connection through a bus as an example.

存储器作为一种非暂态计算机可读存储介质,可用于存储非暂态软件程序以及非暂态性计算机可执行程序,如上述本发明实施例中的网络数据处理方法。处理器通过运行存储在存储器中的非暂态软件程序以及程序,从而实现上述本发明实施例中的网络数据处理方法。As a non-transitory computer-readable storage medium, the memory can be used to store non-transitory software programs and non-transitory computer executable programs, such as the network data processing method in the above embodiment of the present invention. The processor implements the network data processing method in the above embodiment of the present invention by running non-transient software programs and programs stored in the memory.

存储器可以包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需要的应用程序;存储数据区可存储执行上述本发明实施例中的网络数据处理方法所需的数据等。此外,存储器可以包括高速随机存取存储器,还可以包括非暂态存储器,例如至少一个磁盘存储器件、闪存器件、或其他非暂态固态存储器件。在一些实施方式中,存储器可选包括相对于处理器远程设置的存储器,这些远程存储器可以通过网络连接至该网络数据处理装置。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory may include a storage program area and a storage data area, wherein the storage program area may store an operating system and an application program required for at least one function; the storage data area may store data required to execute the network data processing method in the embodiment of the present invention. Data etc. In addition, the memory may include high-speed random access memory and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, the memory may optionally include memory located remotely relative to the processor, and these remote memories may be connected to the network data processing device through a network. Examples of the above-mentioned networks include but are not limited to the Internet, intranets, local area networks, mobile communication networks and combinations thereof.

实现上述本发明实施例中的网络数据处理方法所需的非暂态软件程序以及程序存储在存储器中,当被一个或者多个处理器执行时,执行上述本发明实施例中的网络数据处理方法,例如,执行以上描述的图1中的方法步骤S101至步骤S104,通过确定转发数据报文的转发路径;根据转发路径的网络参数来确定转发路径的健康度,健康度用于评价转发路径的网络质量;根据健康度确定数据报文的压缩比信息;根据压缩比信息对数据报文进行压缩。基于此,网络设备在接收到需要传递的数据时,可以根据网络的情况进行智能的压缩比选择,对需要在网络设备上传输的数据根据相应的压缩比来进行压缩传递,以自动适应不同的网络环境。利用本方法,既可以提升数据的传输效率,又可以结合网络变化情况最大效率的利用网络带宽,并且对网络中的故障或者变化可以做到及时的响应。提高网络带宽的利用率,提升用户对网络传输数据呈现的效果感知。The non-transient software programs and programs required to implement the above-mentioned network data processing method in the embodiment of the present invention are stored in the memory. When executed by one or more processors, the above-mentioned network data processing method in the embodiment of the present invention is executed. , for example, perform the above-described method steps S101 to S104 in Figure 1 to determine the forwarding path for forwarding the data message; determine the health of the forwarding path according to the network parameters of the forwarding path, and the health is used to evaluate the forwarding path. Network quality; determine the compression ratio information of data packets based on health; compress data packets based on the compression ratio information. Based on this, when the network device receives the data that needs to be transmitted, it can intelligently select the compression ratio according to the network conditions, and compress and transmit the data that needs to be transmitted on the network device according to the corresponding compression ratio to automatically adapt to different conditions. Web environment. Using this method, the data transmission efficiency can be improved, the network bandwidth can be utilized with maximum efficiency in combination with network changes, and timely response to faults or changes in the network can be achieved. Improve the utilization of network bandwidth and improve users' perception of the effect of network transmission data presentation.

如图7所示,本发明实施例还提供了一种电子设备。As shown in Figure 7, an embodiment of the present invention also provides an electronic device.

具体地,该电子设备包括:一个或多个处理器和存储器,图7中以一个处理器及存储器为例。处理器和存储器可以通过总线或者其他方式连接,图7中以通过总线连接为例。Specifically, the electronic device includes: one or more processors and memories. In FIG. 7 , one processor and memory are taken as an example. The processor and memory can be connected through a bus or other means. Figure 7 takes the connection through a bus as an example.

存储器作为一种非暂态计算机可读存储介质,可用于存储非暂态软件程序以及非暂态性计算机可执行程序,如上述本发明实施例中的网络数据处理方法。处理器通过运行存储在存储器中的非暂态软件程序以及程序,从而实现上述本发明实施例中的网络数据处理方法。As a non-transitory computer-readable storage medium, the memory can be used to store non-transitory software programs and non-transitory computer executable programs, such as the network data processing method in the above embodiment of the present invention. The processor implements the network data processing method in the above embodiment of the present invention by running non-transient software programs and programs stored in the memory.

存储器可以包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需要的应用程序;存储数据区可存储执行上述本发明实施例中的网络数据处理方法所需的数据等。此外,存储器可以包括高速随机存取存储器,还可以包括非暂态存储器,例如至少一个磁盘存储器件、闪存器件、或其他非暂态固态存储器件。在一些实施方式中,存储器可选包括相对于处理器远程设置的存储器,这些远程存储器可以通过网络连接至该网络数据处理装置。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory may include a storage program area and a storage data area, wherein the storage program area may store an operating system and an application program required for at least one function; the storage data area may store data required to execute the network data processing method in the embodiment of the present invention. Data etc. In addition, the memory may include high-speed random access memory and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, the memory may optionally include memory located remotely relative to the processor, and these remote memories may be connected to the network data processing device through a network. Examples of the above-mentioned networks include but are not limited to the Internet, intranets, local area networks, mobile communication networks and combinations thereof.

实现上述本发明实施例中的网络数据处理方法所需的非暂态软件程序以及程序存储在存储器中,当被一个或者多个处理器执行时,执行上述本发明实施例中的网络数据处理方法,例如,执行以上描述的图1中的方法步骤S101至步骤S104,通过确定转发数据报文的转发路径;根据转发路径的网络参数来确定转发路径的健康度,健康度用于评价转发路径的网络质量;根据健康度确定数据报文的压缩比信息;根据压缩比信息对数据报文进行压缩。基于此,网络设备在接收到需要传递的数据时,可以根据网络的情况进行智能的压缩比选择,对需要在网络设备上传输的数据根据相应的压缩比来进行压缩传递,以自动适应不同的网络环境。利用本方法,既可以提升数据的传输效率,又可以结合网络变化情况最大效率的利用网络带宽,并且对网络中的故障或者变化可以做到及时的响应。提高网络带宽的利用率,提升用户对网络传输数据呈现的效果感知。The non-transient software programs and programs required to implement the above-mentioned network data processing method in the embodiment of the present invention are stored in the memory. When executed by one or more processors, the above-mentioned network data processing method in the embodiment of the present invention is executed. , for example, perform the above-described method steps S101 to S104 in Figure 1 to determine the forwarding path for forwarding the data message; determine the health of the forwarding path according to the network parameters of the forwarding path, and the health is used to evaluate the forwarding path. Network quality; determine the compression ratio information of data packets based on health; compress data packets based on the compression ratio information. Based on this, when the network device receives the data that needs to be transmitted, it can intelligently select the compression ratio according to the network conditions, and compress and transmit the data that needs to be transmitted on the network device according to the corresponding compression ratio to automatically adapt to different conditions. Web environment. Using this method, the data transmission efficiency can be improved, the network bandwidth can be utilized with maximum efficiency in combination with network changes, and timely response to faults or changes in the network can be achieved. Improve the utilization of network bandwidth and improve users' perception of the effect of network transmission data presentation.

此外,本发明实施例还提供了一种计算机可读存储介质,该计算机可读存储介质存储有计算机可执行程序,该计算机可执行程序被一个或多个控制处理器执行,例如,被图7中的一个处理器执行,可使得上述一个或多个处理器执行上述本发明实施例中的网络数据处理方法,例如,执行以上描述的图1中的方法步骤S101至步骤S104,通过确定转发数据报文的转发路径;根据转发路径的网络参数来确定转发路径的健康度,健康度用于评价转发路径的网络质量;根据健康度确定数据报文的压缩比信息;根据压缩比信息对数据报文进行压缩。基于此,网络设备在接收到需要传递的数据时,可以根据网络的情况进行智能的压缩比选择,对需要在网络设备上传输的数据根据相应的压缩比来进行压缩传递,以自动适应不同的网络环境。利用本方法,既可以提升数据的传输效率,又可以结合网络变化情况最大效率的利用网络带宽,并且对网络中的故障或者变化可以做到及时的响应。提高网络带宽的利用率,提升用户对网络传输数据呈现的效果感知。In addition, embodiments of the present invention also provide a computer-readable storage medium that stores a computer-executable program, and the computer-executable program is executed by one or more control processors, for example, as shown in FIG. 7 Execution by one of the processors may cause the one or more processors to execute the network data processing method in the above embodiment of the present invention, for example, execute the method steps S101 to S104 in Figure 1 described above, and forward the data by determining The forwarding path of the packet; determine the health of the forwarding path based on the network parameters of the forwarding path, and the health is used to evaluate the network quality of the forwarding path; determine the compression ratio information of the data packet based on the health; compress the data packet based on the compression ratio information Compress the text. Based on this, when the network device receives the data that needs to be transmitted, it can intelligently select the compression ratio according to the network conditions, and compress and transmit the data that needs to be transmitted on the network device according to the corresponding compression ratio to automatically adapt to different conditions. Web environment. Using this method, the data transmission efficiency can be improved, the network bandwidth can be utilized with maximum efficiency in combination with network changes, and timely response to faults or changes in the network can be achieved. Improve the utilization of network bandwidth and improve users' perception of the effect of network transmission data presentation.

本领域普通技术人员可以理解,上文中所公开方法中的全部或某些步骤、系统可以被实施为软件、固件、硬件及其适当的组合。某些物理组件或所有物理组件可以被实施为由处理器,如中央处理器、数字信号处理器或微处理器执行的软件,或者被实施为硬件,或者被实施为集成电路,如专用集成电路。这样的软件可以分布在计算机可读介质上,计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的,术语计算机存储介质包括在用于存储信息(诸如计算机可读程序、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外,本领域普通技术人员公知的是,通信介质通常包含计算机可读程序、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据,并且可包括任何信息递送介质。Those of ordinary skill in the art can understand that all or some steps and systems in the methods disclosed above can be implemented as software, firmware, hardware, and appropriate combinations thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit . Such software may be distributed on computer-readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As is known to those of ordinary skill in the art, the term computer storage media includes volatile and nonvolatile media implemented in any method or technology for storage of information such as computer readable programs, data structures, program modules or other data. removable, removable and non-removable media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disk (DVD) or other optical disk storage, magnetic cassettes, tapes, disk storage or other magnetic storage devices, or may Any other medium used to store the desired information and that can be accessed by a computer. Additionally, it is known to those of ordinary skill in the art that communication media typically embodies a computer-readable program, data structure, program module or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .

以上是对本发明的较佳实施进行了具体说明,但本发明并不局限于上述实施方式,熟悉本领域的技术人员在不违背本发明精神的共享条件下还可作出种种等同的变形或替换,这些等同的变形或替换均包括在本发明权利要求所限定的范围内。The above is a detailed description of the preferred implementation of the present invention, but the present invention is not limited to the above-mentioned embodiments. Those skilled in the art can also make various equivalent modifications or substitutions without violating the spirit of the present invention. These equivalent modifications or substitutions are included within the scope defined by the claims of the present invention.

Claims (10)

1. A network data processing method applied to a network device, the method comprising:
determining a forwarding path for forwarding the data message;
determining the health degree of a forwarding path according to the network parameters of the forwarding path, wherein the health degree is used for evaluating the network quality of the forwarding path;
determining compression ratio information of the data message according to the health degree;
and compressing the data message according to the compression ratio information.
2. The method of claim 1, further comprising, prior to said compressing said data message according to said compression ratio information:
and marking the information of the data message so that the data message carries the compression ratio information.
3. The method according to claim 2, wherein the information marking the data packet so that the data packet carries the compression ratio information includes:
adding header information to the data message, wherein the header information comprises the compression ratio information.
4. The method according to claim 2, wherein the information marking the data packet so that the data packet carries the compression ratio information includes:
and adding virtual local area network information to the data message, wherein the virtual local area network information comprises the compression ratio information.
5. The method according to claim 2, wherein the information marking the data packet so that the data packet carries the compression ratio information includes:
and adding priority information to the data message, wherein the priority information comprises the compression ratio information.
6. The method according to claim 2, further comprising, after said compressing said data message according to said compression ratio information:
and removing the information mark after compression is completed, and forwarding the data message to the forwarding path.
7. The method according to any one of claims 1 to 6, wherein the network parameters comprise at least one of:
network port bandwidth;
the degree of network congestion;
network packet loss rate;
the optical module transmission length;
quality of service setting information.
8. A network data processing apparatus comprising: memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the network data processing method according to any of claims 1 to 7 when executing the computer program.
9. An electronic device, comprising: memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the network data processing method according to any of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium storing a computer-executable program for causing a computer to execute the network data processing method according to any one of claims 1 to 7.
CN202210724332.9A 2022-06-24 2022-06-24 Network data processing method, device and computer readable storage medium Pending CN117319509A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202210724332.9A CN117319509A (en) 2022-06-24 2022-06-24 Network data processing method, device and computer readable storage medium
PCT/CN2023/082851 WO2023246203A1 (en) 2022-06-24 2023-03-21 Network data processing method and apparatus, and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210724332.9A CN117319509A (en) 2022-06-24 2022-06-24 Network data processing method, device and computer readable storage medium

Publications (1)

Publication Number Publication Date
CN117319509A true CN117319509A (en) 2023-12-29

Family

ID=89295931

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210724332.9A Pending CN117319509A (en) 2022-06-24 2022-06-24 Network data processing method, device and computer readable storage medium

Country Status (2)

Country Link
CN (1) CN117319509A (en)
WO (1) WO2023246203A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118945238A (en) * 2024-10-14 2024-11-12 杭州数云信息技术有限公司 Sensor network equipment data return dimension reduction compression method, device and equipment

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100596108C (en) * 2007-04-20 2010-03-24 杭州华三通信技术有限公司 Data transmission method and device
US8831041B2 (en) * 2011-06-27 2014-09-09 Citrix Systems, Inc. Prioritizing highly compressed traffic to provide a predetermined quality of service
CN105744342B (en) * 2016-01-28 2019-04-12 腾讯科技(深圳)有限公司 The data transmission method and device of mobile terminal
WO2020040939A1 (en) * 2018-08-20 2020-02-27 Sony Corporation Method and system for utilizing event specific priority in a network controlled uplink media transmission for a collaborative media production
CN113472718A (en) * 2020-03-30 2021-10-01 中兴通讯股份有限公司 Service processing method, device, equipment and storage medium
WO2021231072A1 (en) * 2020-05-15 2021-11-18 Amazon Technologies, Inc. Iterative media object compression algorithm optimization using decoupled calibration of perceptual quality algorithms

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118945238A (en) * 2024-10-14 2024-11-12 杭州数云信息技术有限公司 Sensor network equipment data return dimension reduction compression method, device and equipment
CN118945238B (en) * 2024-10-14 2025-01-28 杭州数云信息技术有限公司 Sensor network equipment data return dimension reduction compression method, device and equipment

Also Published As

Publication number Publication date
WO2023246203A1 (en) 2023-12-28

Similar Documents

Publication Publication Date Title
US11646967B2 (en) Packet control method and network apparatus
CN107005485B (en) A method, corresponding device and system for determining routing
CN103476062B (en) Data flow scheduling method, equipment and system
CN102984077B (en) The control method of network congestion and system
WO2020063339A1 (en) Method, device and system for realizing data transmission
CN114079638B (en) Data transmission method, device and storage medium for multi-protocol hybrid network
US8787160B2 (en) Method, apparatus, and system for judging path congestion
CN101656674A (en) Congestion control method and network nodes
CN116055415B (en) Data packet transmission control method and device
CN111224889A (en) A method and device for data transmission
CN108667746B (en) Method for realizing service priority in deep space delay tolerant network
CN111614556A (en) BIER-based bidirectional forwarding detection session creation method and related equipment
US11070386B2 (en) Controlling an aggregate number of unique PIM joins in one or more PIM join/prune messages received from a PIM neighbor
CN111262792B (en) Message forwarding method, device, network equipment and storage medium
US20220070736A1 (en) Traffic steering device
CN111447114A (en) Data packet transmission method and device, electronic equipment and storage medium
CN107135164A (en) Congestion control method and device
WO2023246203A1 (en) Network data processing method and apparatus, and computer readable storage medium
CN103166872B (en) In network flow forward method and the network equipment
CN106656807A (en) Message forwarding method and SDN switch
CN111431812A (en) Message forwarding control method and device
CN112671662B (en) Data stream acceleration method, electronic device and storage medium
CN108063732A (en) Message transmitting method, equipment and system
CN103907318B (en) Method and device for refreshing flow table
CN117914797A (en) Data transmission delay adjusting method and data transmission delay adjusting device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination