CN117319509A - Network data processing method, device and computer readable storage medium - Google Patents
Network data processing method, device and computer readable storage medium Download PDFInfo
- Publication number
- CN117319509A CN117319509A CN202210724332.9A CN202210724332A CN117319509A CN 117319509 A CN117319509 A CN 117319509A CN 202210724332 A CN202210724332 A CN 202210724332A CN 117319509 A CN117319509 A CN 117319509A
- Authority
- CN
- China
- Prior art keywords
- network
- data
- compression ratio
- information
- compression
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 29
- 238000007906 compression Methods 0.000 claims abstract description 173
- 230000006835 compression Effects 0.000 claims abstract description 172
- 230000036541 health Effects 0.000 claims abstract description 75
- 230000005540 biological transmission Effects 0.000 claims abstract description 30
- 238000000034 method Methods 0.000 claims description 30
- 238000012545 processing Methods 0.000 claims description 24
- 230000003287 optical effect Effects 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 8
- 230000000694 effects Effects 0.000 abstract description 10
- 230000008447 perception Effects 0.000 abstract description 10
- 238000012546 transfer Methods 0.000 abstract description 6
- 230000008569 process Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 238000012986 modification Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 5
- 238000013144 data compression Methods 0.000 description 5
- 230000004044 response Effects 0.000 description 5
- 238000007493 shaping process Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000005538 encapsulation Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000006424 Flood reaction Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
- H04L67/5651—Reducing the amount or size of exchanged application data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/04—Protocols for data compression, e.g. ROHC
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a network data processing method, a device and a computer readable storage medium, which are used for determining a forwarding path for forwarding a data message; determining the health degree of the forwarding path according to the network parameters of the forwarding path, wherein the health degree is used for evaluating the network quality of the forwarding path; determining compression ratio information of the data message according to the health degree; and compressing the data message according to the compression ratio information. Based on the above, when the network device receives the data to be transferred, the network device can perform intelligent compression ratio selection according to the network condition, and perform compression transfer on the data to be transferred on the network device according to the corresponding compression ratio so as to automatically adapt to different network environments. Therefore, the invention can improve the utilization rate of network bandwidth, improve the intelligent capability of the whole network and improve the effect perception of the network transmission data presentation by the user.
Description
Technical Field
Embodiments of the present invention relate to, but are not limited to, the field of network devices, and in particular, to a network data processing method, apparatus, and computer readable storage medium.
Background
The data to be compressed transmitted by the network device at present is mainly video service, the video service can be divided into shallow compression and deep compression according to different user requirements and network quality changes, and various compression algorithms can also correspond to different compression ratios.
In the related art, the compression operation is usually completed before the data arrives at the network device, and the network device serves as a transmission device and does not directly participate in the compression process of the data. Therefore, when data to be compressed is transmitted in the network device, automatic adjustment cannot be performed according to the network condition, and once the compression mode of the data is selected, further adjustment is impossible. And the network device does not sense any information of the data in the whole transmission process, and does not perform any intervention and processing on the compression ratio of the data. .
Disclosure of Invention
The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.
The embodiment of the invention provides a network data processing method, a device and a computer readable storage medium, which can effectively improve the utilization rate of a network, improve the intelligent capability of the whole network and improve the effect perception of a user on network transmission data presentation.
In a first aspect, an embodiment of the present invention provides a network data processing method, applied to a network device, where the method includes:
determining a forwarding path for forwarding the data message;
determining the health degree of a forwarding path according to the network parameters of the forwarding path, wherein the health degree is used for evaluating the network quality of the forwarding path;
determining compression ratio information of the data message according to the health degree;
and compressing the data message according to the compression ratio information.
In a second aspect, an embodiment of the present invention provides a network data processing apparatus, including: a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the network data processing method as described in the first aspect above when executing the computer program.
In a third aspect, an embodiment of the present invention provides an electronic device, including: a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the network data processing method as described in the first aspect above when executing the computer program.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium storing a computer-executable program for causing a computer to execute the network data processing method according to the first aspect.
The embodiment of the invention comprises the following steps: determining a forwarding path for forwarding the data message; determining the health degree of the forwarding path according to the network parameters of the forwarding path, wherein the health degree is used for evaluating the network quality of the forwarding path; determining compression ratio information of the data message according to the health degree; and compressing the data message according to the compression ratio information. Based on the above, when the network device receives the data to be transferred, the network device can perform intelligent compression ratio selection according to the network condition, and perform compression transfer on the data to be transferred on the network device according to the corresponding compression ratio so as to automatically adapt to different network environments. Therefore, the invention can improve the utilization rate of network bandwidth, improve the intelligent capability of the whole network and improve the effect perception of the network transmission data presentation by the user.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate and do not limit the invention.
FIG. 1 is a main flow chart of a network data processing method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a network device according to an embodiment of the present invention;
fig. 3 is a schematic diagram of compression processing of a data packet by a network device according to an embodiment of the present invention;
fig. 4 is a schematic diagram of compression processing of a data packet by a network device according to an embodiment of the present invention;
fig. 5 is a schematic diagram of compression processing of a data packet by a network device according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a network data processing apparatus according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
It should be understood that in the description of the embodiments of the present invention, plural (or multiple) means two or more, and that greater than, less than, exceeding, etc. are understood to not include the present number, and that greater than, less than, within, etc. are understood to include the present number. If any, the terms "first," "second," etc. are used for distinguishing between technical features only, and should not be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated or implicitly indicating the precedence of the technical features indicated.
Aiming at the problem that the network equipment is only used as the transmission equipment and does not directly participate in the compression processing of data in the prior art, the embodiment of the invention provides a network data processing method, a device and a computer readable storage medium, and a forwarding path for forwarding a data message is determined; determining the health degree of the forwarding path according to the network parameters of the forwarding path, wherein the health degree is used for evaluating the network quality of the forwarding path; determining compression ratio information of the data message according to the health degree; and compressing the data message according to the compression ratio information. Based on the above, when the network device receives the data to be transferred, the network device can perform intelligent compression ratio selection according to the network condition, and perform compression transfer on the data to be transferred on the network device according to the corresponding compression ratio so as to automatically adapt to different network environments. Therefore, the invention can improve the utilization rate of network bandwidth, improve the intelligent capability of the whole network and improve the effect perception of the network transmission data presentation by the user.
Referring to fig. 1, fig. 1 is a flowchart of a network data processing method according to an embodiment of the present invention. The network data processing method includes, but is not limited to, the following steps:
step S101, determining a forwarding path for forwarding a data message;
step S102, determining the health degree of the forwarding path according to the network parameters of the forwarding path, wherein the health degree is used for evaluating the network quality of the forwarding path;
step S103, determining compression ratio information of the data message according to the health degree;
step S104, compressing the data message according to the compression ratio information.
In an exemplary embodiment, the method may be applied to network devices, which may include, but are not limited to, switches and routers.
In an exemplary embodiment, the network quality is determined in time by the network device. Judging the exit information of the data flow to be forwarded, determining the health degree of the forwarding path of the network, and reflecting the health degree of the forwarding path by comprehensively giving a health score. The corresponding compression ratio is selected based on the health score, for example, if the network state is good, no compression may be selected, if the state is generally a shallow compression class algorithm, and if the state is poor, a deep compression class algorithm may be performed.
In an exemplary embodiment, as shown in fig. 2, network device 100 may be integrated with forwarding module 110 and compression module 120. The forwarding module 110 forwards the data message carrying the compression ratio information to the compression module 120. The compression module 120 may make various algorithm selections of compression ratios and output compressed data. Based on the health score of the forwarding path, the network device 100 correspondingly selects the compression ratio requirement to be compressed, after the original data stream is increased by the needed compression ratio information, the network device redirects the original data stream to the compression module 120 for processing through the forwarding module 110, the compression module 120 restores and returns the data message to the forwarding module 110 after carrying out the corresponding compression ratio processing on the original data stream according to the received compression ratio information, and the forwarding module 110 forwards the compressed message according to the original path of the message.
In an exemplary embodiment, the health of the forwarding path of the network may be determined according to network parameters, for example, comprehensively determined according to one or several items of information such as port bandwidth, congestion degree, packet loss rate, optical module transmission length, QOS (Quality of Service ) settings such as speed limit or shaping, etc., and finally, the compression ratio requirement of the health parameter of the forwarding path of the network device 100 on the data is determined according to the needs of the user or the settings of the network.
In an exemplary embodiment, the compression module 120 integrated in the network device 100 may be implemented using a network processor chip or an FPGA chip, which has the capability of identifying information carried by data to be compressed by the network device 100 and selecting a corresponding compression ratio algorithm for compression.
In an exemplary embodiment, for the process of determining the compression ratio information, the network device 100 identifies the data packet that needs to be intelligently compressed, and the specific manner may identify the data packet through user configuration or a packet feature or the like. The network device 100 determines a network path on which a data packet that needs to be intelligently compressed and processed needs to be forwarded, and determines network parameters of the forwarding path, such as port parameters, QOS data, bandwidth, and information of an optical module, and calculates a health score of the forwarding path based on the determined network parameters and information of the optical module in combination with user configuration. Taking the port parameter as an example, the higher the packet loss rate, the lower the health score. Taking QOS data as an example, the higher the speed limit value, the lower the health score. Taking bandwidth as an example, the smaller the bandwidth value, the lower the health score. Taking an optical module as an example, the model of the optical module determines a transmission path, and the longer the transmission path is, the lower the health score is; the more stable the optical power of the optical module, the higher the health score. It should be noted that the health score may be determined synthetically based on one or more of the above-mentioned network parameters. The network device 100 then determines good compression ratio information based on this health score.
In an exemplary embodiment, the determination of the health score for a forwarding path may be based on a comprehensive determination of one or more forwarding path network parameters. Taking the port parameter as the judging basis of the health score as an example, when the network equipment detects that the packet loss rate is 10%, the health score of the forwarding path can be determined to be 90; when the network device detects that the packet loss rate is 20%, it may determine that the health score of the forwarding path is 80 points. Taking QOS data as a judging basis of the health score as an example, when the speed limit value is four fifths of the bandwidth value, determining that the health score of the forwarding path is 80; when the speed limit value is three-fifths of the bandwidth value, the health score of the forwarding path may be determined to be 60 points. Taking port parameters and QOS data as the judgment basis of health score as an example, when the network equipment detects that the packet loss rate is 10% and the speed limit value is four fifths of the bandwidth value, the health score of the forwarding path can be determined to be 85 points; when the network device detects that the packet loss rate is 20% and the speed limit value is three fifths of the bandwidth value, it may be determined that the health score of the forwarding path is 70 points. It should be noted that the above-mentioned numerical values for calculating the forwarding path health score are merely exemplary, and should not be construed as limiting the embodiments of the present invention.
In an exemplary embodiment, for the correspondence between the health score and the compression ratio of the forwarding path, the higher the health score, the smaller the compression ratio; conversely, the lower the health score, the greater the compression ratio. Assuming that the compression ratio is totally divided into 0-10 stages of compression ratios from no compression to deep compression, taking the health score of the forwarding path as 90 as an example, indicating that the network state of the forwarding path is better at this time, the data message can be subjected to shallow compression by adopting the 1-stage compression ratio; taking the health score of the forwarding path as 20 as an example, the network state of the forwarding path is not good at this time, and the data message can be deeply compressed by adopting 8-stage compression ratio. It should be noted that, the numerical correspondence between the health score and the compression ratio of the forwarding path is merely an exemplary illustration, and should not be construed as limiting the embodiments of the present invention.
In an exemplary embodiment, the network device 100 may determine the health score based on its forwarding path, and select the compression ratio of the corresponding data according to the determination, and process the data by transmitting the compression ratio requirement to the compression module 120, and after the compression module 120 processes the data, re-enter the forwarding module 110 to forward the data according to the original path requirement, so as to implement a function of intelligently adjusting the data compression ratio according to the path health condition.
In an exemplary embodiment, the main purpose of the present invention is to propose a method that allows the network device 100 to participate in the selection and decision of the data compression ratio, by which the network device 100 can evaluate the state awareness of the network in a very detailed manner, and give a corresponding evaluation result, by which the compression ratio requirement of the data stream can be intelligently selected, and the compression ratio of the data stream can be correspondingly changed in a state where the network environment is changed. By utilizing the method, the transmission efficiency of data can be improved, the network bandwidth can be utilized with the maximum efficiency in combination with the network change condition, and timely response to faults or changes in the network can be realized. The utilization rate of network bandwidth is improved, and the effect perception of the network transmission data presentation by the user is improved.
The following steps may be included but are not limited to before step S104:
and marking the information of the data message so that the data message carries the compression ratio information.
In an exemplary embodiment, the data packets are information tagged such that the data packets may carry compression ratio information. Specifically, the content required for the compression ratio selection process may be added by modifying header information of the transmission message, and the modification manner may include, but is not limited to, modification of vlan (Virtual Local Area Network ), modification of IP header, modification of message priority field, and the like.
In an exemplary embodiment, the network device converts the health score of the forwarding path into compression ratio information, carries the compression ratio information into a data packet, and sends the data packet to the compression module 120, and the information marking of the data packet may include, but is not limited to, the following:
1. the message header information is added, and a message header which can be redirected to the compression module 120 is added, wherein the message header contains compression ratio control information which needs to be compressed.
2. The message vlan information is added, and a message vlan capable of being flooded to the compression module 120 is added, where the message vlan contains compression ratio control information that needs to be compressed.
3. The message priority information is added, the corresponding message priority information is identified by using ACL (Access Control List ) technology and redirected to the compression module 120, and the priority information contains compression ratio control information.
4. Other message information representing compression ratio control is added, and the corresponding message information is identified and redirected to the compression module 120 by using an ACL technology.
The following steps may be included after step S104, but are not limited to:
and after the compression is completed, the information mark is removed, and the data message is forwarded to a forwarding path.
In an exemplary embodiment, compression module 120 removes the information tag after compression is completed and forwarding module 110 forwards the data packet to the forwarding path. Specifically, the forwarding module 110 forwards the data packet carrying the compression ratio information to the compression module 120, for example, the forwarding may be performed by ACL redirection technology, mirroring technology or directly using the modified packet header. After selecting the compression ratio based on the header information of the packet, the compression module 120 performs a corresponding compression operation on the data, and benefits the modified data information, for example, the modified data information may be restored or discarded, and then the data packet is returned to the forwarding module 110. Forwarding module 110 sends out the compressed data message according to the original forwarding path.
In an exemplary embodiment, the present invention first utilizes the determination of the health of the network device 100 itself for the network path, synthesizes various information of the path of the network device 100, synthesizes a network path health score, and selects a corresponding compression ratio based on the score, if the network state is good, it can select to not compress, if the state is generally a shallow compression algorithm, and if the state is poor, it can perform a deep compression algorithm. And modifying the data message needing intelligent compression processing to enable the data message to carry corresponding compression ratio data, forwarding the data message to the compression module 120 for compression processing, compressing the compression module 120 according to compression ratio information carried in the message, compressing the message header carrying the compression ratio, discarding or restoring the modified message header information, and forwarding the message to the transmitting module 110. The message forwarding module 110 forwards the message according to the original path to complete intelligent compression processing of the data.
In an exemplary embodiment, the health score of the network may be changed when the transmission condition of the network is changed, and the compression ratio may be correspondingly changed in the selection, so that the method may adapt to various changes and faults of the network, and actual adjustment is performed according to different states.
In an exemplary embodiment, the network device 100 analyzes the health of the network path, and then intelligently selects the compression ratio of the data according to the health of the network forwarding path, and the compression ratio information to be compressed is carried into the message and forwarded to the compression module 120 for compression processing, and the modified message is recovered after the compression processing and returned to the forwarding module 110, so that the intelligent compression processing of the data in the network device 100 can be completed. By applying the method, the transmission efficiency of data can be improved, the network bandwidth can be utilized with the maximum efficiency in combination with the network change condition, and timely response to faults or changes in the network can be realized. The utilization rate of network bandwidth is improved, and the effect perception of the network transmission data presentation by the user is improved.
The network data processing method provided by the invention is further described below with reference to the specific embodiment.
For example, the network device needs to deliver a video data, and the compression module has a compression algorithm with a compression ratio of 0-10 stages from no compression to deep compression.
Embodiment one: by adding header information to a data message, the header information contains compression ratio information
As shown in fig. 3, the network device determines a forwarding path for forwarding video data, then determines that the health score of the forwarding path is 80 minutes according to network parameters (including one or more of port bandwidth, congestion degree, packet loss rate, optical module transmission length, QOS setting such as speed limit or shaping, etc.) of the forwarding path, and determines to compress the video data by adopting a shallow compression algorithm adopting a 2-level compression ratio according to the health score. The network device adds a header information to the header of the video data, wherein the header information is an IP header, a GRE (Generic Routing Encapsulation, general routing encapsulation) message is formed, the IP header is added with a destination IP as a port pointing to the compression module, and the last data with an IP of x.x.x.2 indicates that the video data stream needs compression with a 2-level compression ratio. The forwarding module in the network device queries the destination IP address, forwards the video data to the compression module, and the compression module compresses the video data according to the 2-level compression ratio. After the video data is compressed, the compression module discards the newly added IP header in the video data and forwards the newly added IP header back to the forwarding module. And the forwarding module normally sends the compressed video data to a forwarding path.
Embodiment two: by adding vlan information to the data message, the vlan information contains compression ratio information
As shown in fig. 4, the network device determines a forwarding path for forwarding video data, then determines that the health score of the forwarding path is 80 minutes according to network parameters (including one or more of port bandwidth, congestion degree, packet loss rate, optical module transmission length, QOS setting such as speed limit or shaping, etc.) of the forwarding path, and determines to compress the video data by adopting a shallow compression algorithm adopting a 2-level compression ratio according to the health score. The network device adds a vlan field to the header of the video data to form a QinQ packet, and uses vlan4010-vlan4020 to represent the 0-10 level compression ratio, and sets the vlan header of the video data to 4012 to represent that the data stream needs compression with 2 level compression ratio. The forwarding module searches a vlan forwarding table according to the vlan4012, floods and forwards the video data to the compression module, and the compression module compresses the video data according to a 2-level compression ratio. After the video data is compressed, the compression module discards the newly added vlan field in the video data and forwards the newly added vlan field back to the forwarding module. And the forwarding module normally sends the compressed video data to a forwarding path.
Embodiment III: by adding priority information to the data message, the priority information contains compression ratio information
As shown in fig. 5, the network device determines a forwarding path for forwarding video data, then determines that the health score of the forwarding path is 80 minutes according to network parameters (including one or more of port bandwidth, congestion degree, packet loss rate, optical module transmission length, QOS setting such as speed limit or shaping, etc.) of the forwarding path, and determines to compress the video data by adopting a shallow compression algorithm adopting a 2-level compression ratio according to the health score. The network device adds a priority information to the header of the video data (it is assumed that all other data not needing compression do not carry priority information here), forms a message carrying priority, uses priorities 0-7 to represent 0-7 compression ratios respectively, sets the priority of the header of the video data to 2, and sets the priority of the header of the video data to 2 to represent that the video data needs compression of 2 compression ratios (the priority field has only 3 bits and therefore can only represent 0-7, but the mode of modifying the field of the message is many and is not limited to this mode). The network equipment presets an ACL rule, matches all messages with priority fields and forwards the messages to the compression module, the forwarding module forwards the video data flooding stream to the compression module according to the ACL rule, and the compression module compresses the data according to a 2-level compression ratio. After the video data is compressed, the compression module restores the priority field in the video data to 0 and forwards the video data back to the forwarding module. And the forwarding module normally sends the compressed video data to a forwarding path.
Compared with the existing message forwarding mechanism of the network equipment for data compression, the method and the device can enable the network equipment not to be transparent transmission equipment, and the network equipment can combine the advantage of the network equipment for clearly grasping the network state, combine the health degree of the transmission link with the data compression ratio, and accordingly form the health degree of the transmission link according to the network and compress the data according to the requirement. In the processing process, the network equipment can be realized by modifying the fields of the message, the whole processing process can be chipped and hardware, and finally the whole process of realizing intelligent processing of all data compression ratios in the network equipment can be completed. By the method, the utilization rate of the network can be effectively improved, the intelligent capability of the whole network is improved, and the experience perception of a user on the whole network transmission effect is improved.
As shown in fig. 6, the embodiment of the invention further provides a network data processing device.
Specifically, the network data processing apparatus includes: one or more processors and memory, one processor and memory being illustrated in fig. 6. The processor and the memory may be connected by a bus or otherwise, for example in fig. 6.
The memory is used as a non-transitory computer readable storage medium for storing a non-transitory software program and a non-transitory computer executable program, such as the network data processing method in the above-described embodiments of the invention. The processor implements the network data processing method in the above-described embodiments of the present invention by running a non-transitory software program stored in a memory and the program.
The memory may include a memory program area and a memory data area, wherein the memory program area may store an operating system, at least one application program required for a function; the storage data area may store data and the like required for performing the network data processing method in the above-described embodiment of the present invention. In addition, the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory may optionally include memory located remotely from the processor, the remote memory being connectable to the network data processing device through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The non-transitory software program and the program required for implementing the network data processing method in the above-described embodiments of the present invention are stored in the memory, and when executed by one or more processors, the network data processing method in the above-described embodiments of the present invention is executed, for example, the method steps S101 to S104 in fig. 1 described above are executed, by determining a forwarding path for forwarding a data packet; determining the health degree of the forwarding path according to the network parameters of the forwarding path, wherein the health degree is used for evaluating the network quality of the forwarding path; determining compression ratio information of the data message according to the health degree; and compressing the data message according to the compression ratio information. Based on the above, when the network device receives the data to be transferred, the network device can perform intelligent compression ratio selection according to the network condition, and perform compression transfer on the data to be transferred on the network device according to the corresponding compression ratio so as to automatically adapt to different network environments. By utilizing the method, the transmission efficiency of data can be improved, the network bandwidth can be utilized with the maximum efficiency in combination with the network change condition, and timely response to faults or changes in the network can be realized. The utilization rate of network bandwidth is improved, and the effect perception of the network transmission data presentation by the user is improved.
As shown in fig. 7, the embodiment of the invention further provides an electronic device.
Specifically, the electronic device includes: one or more processors and memory, one processor and memory being illustrated in fig. 7. The processor and the memory may be connected by a bus or otherwise, for example in fig. 7.
The memory is used as a non-transitory computer readable storage medium for storing a non-transitory software program and a non-transitory computer executable program, such as the network data processing method in the above-described embodiments of the invention. The processor implements the network data processing method in the above-described embodiments of the present invention by running a non-transitory software program stored in a memory and the program.
The memory may include a memory program area and a memory data area, wherein the memory program area may store an operating system, at least one application program required for a function; the storage data area may store data and the like required for performing the network data processing method in the above-described embodiment of the present invention. In addition, the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory may optionally include memory located remotely from the processor, the remote memory being connectable to the network data processing device through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The non-transitory software program and the program required for implementing the network data processing method in the above-described embodiments of the present invention are stored in the memory, and when executed by one or more processors, the network data processing method in the above-described embodiments of the present invention is executed, for example, the method steps S101 to S104 in fig. 1 described above are executed, by determining a forwarding path for forwarding a data packet; determining the health degree of the forwarding path according to the network parameters of the forwarding path, wherein the health degree is used for evaluating the network quality of the forwarding path; determining compression ratio information of the data message according to the health degree; and compressing the data message according to the compression ratio information. Based on the above, when the network device receives the data to be transferred, the network device can perform intelligent compression ratio selection according to the network condition, and perform compression transfer on the data to be transferred on the network device according to the corresponding compression ratio so as to automatically adapt to different network environments. By utilizing the method, the transmission efficiency of data can be improved, the network bandwidth can be utilized with the maximum efficiency in combination with the network change condition, and timely response to faults or changes in the network can be realized. The utilization rate of network bandwidth is improved, and the effect perception of the network transmission data presentation by the user is improved.
Furthermore, an embodiment of the present invention provides a computer-readable storage medium storing a computer-executable program that is executed by one or more control processors, for example, by one processor in fig. 7, and that causes the one or more processors to perform the network data processing method in the embodiment of the present invention, for example, to perform the method steps S101 to S104 in fig. 1 described above, by determining a forwarding path for forwarding a data packet; determining the health degree of the forwarding path according to the network parameters of the forwarding path, wherein the health degree is used for evaluating the network quality of the forwarding path; determining compression ratio information of the data message according to the health degree; and compressing the data message according to the compression ratio information. Based on the above, when the network device receives the data to be transferred, the network device can perform intelligent compression ratio selection according to the network condition, and perform compression transfer on the data to be transferred on the network device according to the corresponding compression ratio so as to automatically adapt to different network environments. By utilizing the method, the transmission efficiency of data can be improved, the network bandwidth can be utilized with the maximum efficiency in combination with the network change condition, and timely response to faults or changes in the network can be realized. The utilization rate of network bandwidth is improved, and the effect perception of the network transmission data presentation by the user is improved.
Those of ordinary skill in the art will appreciate that all or some of the steps, systems, and methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable programs, data structures, program modules or other data, as known to those skilled in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. Furthermore, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable programs, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
While the preferred embodiment of the present invention has been described in detail, the present invention is not limited to the above embodiments, and those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit and scope of the present invention, and these equivalent modifications or substitutions are included in the scope of the present invention as defined in the appended claims.
Claims (10)
1. A network data processing method applied to a network device, the method comprising:
determining a forwarding path for forwarding the data message;
determining the health degree of a forwarding path according to the network parameters of the forwarding path, wherein the health degree is used for evaluating the network quality of the forwarding path;
determining compression ratio information of the data message according to the health degree;
and compressing the data message according to the compression ratio information.
2. The method of claim 1, further comprising, prior to said compressing said data message according to said compression ratio information:
and marking the information of the data message so that the data message carries the compression ratio information.
3. The method according to claim 2, wherein the information marking the data packet so that the data packet carries the compression ratio information includes:
adding header information to the data message, wherein the header information comprises the compression ratio information.
4. The method according to claim 2, wherein the information marking the data packet so that the data packet carries the compression ratio information includes:
and adding virtual local area network information to the data message, wherein the virtual local area network information comprises the compression ratio information.
5. The method according to claim 2, wherein the information marking the data packet so that the data packet carries the compression ratio information includes:
and adding priority information to the data message, wherein the priority information comprises the compression ratio information.
6. The method according to claim 2, further comprising, after said compressing said data message according to said compression ratio information:
and removing the information mark after compression is completed, and forwarding the data message to the forwarding path.
7. The method according to any one of claims 1 to 6, wherein the network parameters comprise at least one of:
network port bandwidth;
the degree of network congestion;
network packet loss rate;
the optical module transmission length;
quality of service setting information.
8. A network data processing apparatus comprising: memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the network data processing method according to any of claims 1 to 7 when executing the computer program.
9. An electronic device, comprising: memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the network data processing method according to any of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium storing a computer-executable program for causing a computer to execute the network data processing method according to any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210724332.9A CN117319509A (en) | 2022-06-24 | 2022-06-24 | Network data processing method, device and computer readable storage medium |
| PCT/CN2023/082851 WO2023246203A1 (en) | 2022-06-24 | 2023-03-21 | Network data processing method and apparatus, and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210724332.9A CN117319509A (en) | 2022-06-24 | 2022-06-24 | Network data processing method, device and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117319509A true CN117319509A (en) | 2023-12-29 |
Family
ID=89295931
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210724332.9A Pending CN117319509A (en) | 2022-06-24 | 2022-06-24 | Network data processing method, device and computer readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN117319509A (en) |
| WO (1) | WO2023246203A1 (en) |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100596108C (en) * | 2007-04-20 | 2010-03-24 | 杭州华三通信技术有限公司 | Data transfer method and device |
| US9130864B2 (en) * | 2011-06-27 | 2015-09-08 | Citrix Systems, Inc. | Prioritizing classes of network traffic to provide a predetermined quality of service |
| CN105744342B (en) * | 2016-01-28 | 2019-04-12 | 腾讯科技（深圳）有限公司 | The data transmission method and device of mobile terminal |
| EP3841721A1 (en) * | 2018-08-20 | 2021-06-30 | Sony Corporation | Method and system for utilizing event specific priority in a network controlled uplink media transmission for a collaborative media production |
| CN113472718A (en) * | 2020-03-30 | 2021-10-01 | 中兴通讯股份有限公司 | Service processing method, device, equipment and storage medium |
| WO2021231072A1 (en) * | 2020-05-15 | 2021-11-18 | Amazon Technologies, Inc. | Iterative media object compression algorithm optimization using decoupled calibration of perceptual quality algorithms |
-
2022
- 2022-06-24 CN CN202210724332.9A patent/CN117319509A/en active Pending
-
2023
- 2023-03-21 WO PCT/CN2023/082851 patent/WO2023246203A1/en unknown
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023246203A1 (en) | 2023-12-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10135740B2 (en) | Method and apparatus for limiting rate by means of token bucket, and computer storage medium | |
| US7180857B2 (en) | Apparatus and method for flow control | |
| US20070183332A1 (en) | System and method for backward congestion notification in network | |
| CN103269260A (en) | Data transmission method, data receiving terminal, data sending terminal and data transmission system | |
| CN102368736A (en) | Message sending method and equipment | |
| CN111447114A (en) | Data packet transmission method and device, electronic equipment and storage medium | |
| CN107547425B (en) | Convergence layer data transmission method and system | |
| CN107222403A (en) | A kind of data transmission method, system and electronic equipment | |
| CN106656807A (en) | Message forwarding method and SDN switch | |
| CN116582493A (en) | Data center network link selection method and device and electronic equipment | |
| CN105763375B (en) | A kind of data packet sending method, method of reseptance and microwave station | |
| CN112468405B (en) | Data center network congestion control method based on credit and reaction type | |
| CN111262792B (en) | Message forwarding method, device, network equipment and storage medium | |
| CN113612698A (en) | Data packet sending method and device | |
| CN109547352B (en) | Dynamic allocation method and device for message buffer queue | |
| CN117319509A (en) | Network data processing method, device and computer readable storage medium | |
| US8554860B1 (en) | Traffic segmentation | |
| CN107612829B (en) | Method and device for acquiring path information of data message | |
| CN115086253A (en) | Ethernet switching chip and high-bandwidth message forwarding method | |
| CN113742055B (en) | Method, device and system for adjusting memory management unit waterline | |
| CN108322395A (en) | A kind of message processing method, device and computer storage media, terminal device | |
| CN107222299A (en) | A kind of data transmission method, system and electronic equipment | |
| CN114070795A (en) | Congestion threshold determination method, device, equipment and storage medium | |
| CN112291166A (en) | Method, system and related device for processing discarded message | |
| US7859997B2 (en) | Packet handling on a network device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication |