WO2022001213A1 - Congestion control method and corresponding device - Google Patents

Congestion control method and corresponding device Download PDF

Info

Publication number
WO2022001213A1
WO2022001213A1 PCT/CN2021/082120 CN2021082120W WO2022001213A1 WO 2022001213 A1 WO2022001213 A1 WO 2022001213A1 CN 2021082120 W CN2021082120 W CN 2021082120W WO 2022001213 A1 WO2022001213 A1 WO 2022001213A1
Authority
WO
WIPO (PCT)
Prior art keywords
congestion
application
parameter
evaluation value
adjusted
Prior art date
Application number
PCT/CN2021/082120
Other languages
French (fr)
Chinese (zh)
Inventor
徐威旺
胡新宇
程剑
张亮
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022001213A1 publication Critical patent/WO2022001213A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W28/00Network traffic management; Network resource management
    • H04W28/02Traffic management, e.g. flow control or congestion control
    • H04W28/0289Congestion control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W28/00Network traffic management; Network resource management
    • H04W28/02Traffic management, e.g. flow control or congestion control

Definitions

  • the present application relates to the technical field of computer networks, and in particular, to a congestion control method and corresponding device.
  • Transmission Control Protocol As the most widely used transmission protocol in the network, can provide connection-oriented and reliable data transmission services, and the TCP congestion control mechanism is the core of TCP.
  • the currently widely used TCP congestion control algorithm still uses a relatively fixed window adjustment strategy.
  • different services have different requirements on transmission performance indicators, for example, some applications have higher requirements on transmission performance indicators, while some applications have lower requirements on transmission performance indicators
  • the TCP congestion control algorithm uses a relatively fixed window adjustment strategy , it is impossible to adaptively adjust the congestion parameters according to the dynamically changing network services, it is difficult to meet the respective requirements of different applications for transmission performance indicators, and it is impossible to effectively control the congestion of the traffic data of different applications, which will affect the user experience and cause inevitable consequences. waste of network resources.
  • the embodiments of the present application provide a congestion control method and a corresponding device, which are used to effectively perform congestion control on traffic data of different applications, which can improve the utilization rate of network bandwidth resources without affecting the user experience of using applications.
  • an embodiment of the present application provides a congestion control method, the method includes: obtaining a first application type of a first application; further, according to the first application type, obtaining a corresponding a first congestion parameter, where the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control algorithm is used to perform congestion control on the traffic data of the first application.
  • the first congestion parameter is determined based on the first application type of the first application, it can be ensured that the first congestion control algorithm obtained based on the first congestion parameter is suitable for the traffic of the first application Congestion control is performed on the data, so that the traffic data of the first application can be effectively controlled. Furthermore, limited network bandwidth resources can be allocated on the basis of not affecting the user's experience of using the first application, which can improve network performance. Utilization of bandwidth resources.
  • the method further includes: acquiring the first congestion control algorithm based on the first congestion parameter; Congestion control is performed on the traffic data of the first application based on the first congestion control algorithm.
  • the method further includes: acquiring the traffic of the first application based on the first congestion control algorithm The first transmission performance index corresponding to the data when congestion control is performed; the first congestion parameter is adjusted according to the first transmission performance index.
  • the limited network bandwidth resources can be allocated without affecting the user's experience of using the first application, which can improve the utilization rate of the network bandwidth resources.
  • adjusting the first congestion parameter according to the first transmission performance index includes: obtaining, according to the first transmission performance index, a requirement of the first application for the transmission performance index; The first congestion parameter is adjusted according to the requirements of the first application for transmission performance indicators.
  • the adjusted first congestion control obtained based on the adjusted first congestion parameter
  • the algorithm performs congestion control on the traffic data of the first application, it can meet the requirements of the first application for transmission performance indicators, so that it can effectively perform congestion control on the traffic data of the first application.
  • allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
  • adjusting the first congestion parameter according to the requirements of the first application on the transmission performance index includes: inputting the first transmission performance index into an objective function to obtain a first evaluation value; The objective function is used to evaluate the requirements of the first application on the transmission performance index; based on the first evaluation value, the first congestion parameter is adjusted.
  • the objective function can be used to evaluate the requirements of the first application on the transmission performance index
  • the adjusted first congestion control algorithm obtained from the first congestion parameter of the first application performs congestion control on the traffic data of the first application, it can meet the requirements of the first application for transmission performance indicators, so that the traffic of the first application can be effectively controlled.
  • Data congestion control is performed, and further, limited network bandwidth resources can be allocated without affecting the user's experience of using the first application, which can improve the utilization rate of network bandwidth resources.
  • the first transmission performance indicator may include at least two performance indicators, such as throughput and delay; the first application may perform at least one of the at least two performance indicators.
  • the first congestion parameter may be adjusted in the following manner: adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter;
  • the first congestion parameter obtains the adjusted first congestion control algorithm; performs congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm, and obtains the first congestion control algorithm based on the adjusted first congestion control algorithm.
  • a second transmission performance index corresponding to the traffic data of the first application when congestion control is performed; inputting the second transmission performance index into the objective function to obtain a second evaluation value;
  • the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions.
  • a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than
  • the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value.
  • the second evaluation value return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction
  • the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  • the first congestion parameter corresponding to the first application type of the first application is obtained through reinforcement learning, based on the requirements of the first application for transmission performance indicators and the traffic data of the first application, it can be guaranteed that The first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application, and can effectively perform congestion control on the traffic data of the first application. Based on the experience of the first application, allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
  • the transmission performance indicator may include at least two performance indicators, such as throughput rate and delay; when the first application has low requirements for the at least two performance indicators, it may include Adjusting the first congestion parameter in the following manner includes: adjusting the first congestion parameter according to a first adjustment direction among a plurality of adjustment directions to obtain an adjusted first congestion parameter; obtaining an adjustment based on the adjusted first congestion parameter performing congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm, and obtaining the traffic data of the first application based on the adjusted first congestion control algorithm a second transmission performance index corresponding to the congestion control; inputting the second transmission performance index into the objective function to obtain a second evaluation value;
  • a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value.
  • the second evaluation value return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction
  • the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  • the first congestion parameter corresponding to the first application type of the first application is obtained through reinforcement learning, based on the requirements of the first application for transmission performance indicators and the traffic data of the first application, it can be guaranteed that The first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application, and can effectively perform congestion control on the traffic data of the first application. Based on the experience of the first application, allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
  • the first congestion parameter may include at least a first sub-parameter and a second sub-parameter; the multiple adjustment directions may include the following four adjustment directions, and the first adjustment direction may be the following Any one of four adjustment directions: increase the first sub-parameter and the second sub-parameter; increase the first sub-parameter, decrease the second sub-parameter; decrease the first sub-parameter sub-parameter, increase the second sub-parameter; decrease the first sub-parameter and the second sub-parameter.
  • the first congestion control algorithm includes a window-up algorithm and a window-down algorithm
  • the first sub-parameter is a parameter corresponding to the window-up algorithm
  • the second sub-parameter is the window-down algorithm
  • the window raising algorithm is characterized as:
  • cwnd is used to represent the congestion window value
  • is the first sub-parameter
  • is the second sub-parameter
  • acquiring the first congestion parameter corresponding to the first application type according to the first application type includes: acquiring a mapping relationship between the application type and the congestion parameter; based on the mapping relationship and For the first application type, obtain a first congestion parameter corresponding to the first application type.
  • the mapping relationship may be stored in, but not limited to, a local storage of the network device, an external storage connected to the network device, and the cloud.
  • the mapping relationship may include multiple application types and congestion parameters corresponding to the multiple application types; for any application type in at least one application type in the mapping relationship, the The congestion parameter corresponding to the application type is determined in the following manner: obtaining the initial congestion parameter corresponding to the application type, and obtaining the initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type;
  • the initial congestion control algorithm corresponding to the type performs congestion control on the traffic data of at least one application corresponding to the application type, and obtains the initial transmission performance index corresponding to the at least one application;
  • the performance indicator is input into an objective function to obtain at least one initial evaluation value, and the objective function is used to evaluate the respective requirements of the at least one application for the transmission performance indicator; a reinforcement learning method is adopted based on the at least one initial evaluation value and the at least one
  • the respective traffic data is used for training to obtain the congestion parameter corresponding to the application type.
  • acquiring the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type includes: if the mapping relationship does not include the first application type, obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or, if the mapping relationship includes the first application type, the first congestion parameter corresponding to the first application type is acquired according to the first application type and the mapping relationship.
  • the second congestion parameter corresponding to the second application type of the first application can be obtained through the mapping relationship, so that the first application of the first application can be obtained according to the second congestion parameter corresponding to the second application type of the first application type, thereby ensuring that the first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application.
  • acquiring the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship includes: according to the first application type the second application type to which the first application type belongs and the mapping relationship, obtain a second congestion parameter corresponding to the second application type to which the first application type belongs, and obtain a second congestion control algorithm based on the second congestion parameter;
  • the third transmission performance index corresponding to when the second congestion control algorithm performs congestion control on the traffic data of the first application is input into an objective function to obtain a third evaluation value; the objective function is used to evaluate The requirements of the first application for transmission performance indicators;
  • the reinforcement learning method is used to perform training based on the third evaluation value and the traffic data of the first application to obtain a first congestion parameter corresponding to the first application type.
  • the first congestion parameter corresponding to the first application type of the first application adopts the reinforcement learning method, training is performed based on the second congestion parameter corresponding to the second application type of the first application and the traffic data of the first application obtained, it can be guaranteed that the first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application.
  • the method further includes: updating the mapping relationship based on the adjusted first congestion parameter.
  • an embodiment of the present application provides a congestion control method, the method includes: acquiring a first transmission performance indicator corresponding to the congestion control of traffic data of a first application based on a first congestion control algorithm; further, according to The first transmission performance indicator adjusts the first congestion parameter corresponding to the first application type of the first application, the adjusted first congestion parameter is used to obtain an adjusted first congestion control algorithm, and the adjusted first congestion The control algorithm is used to perform congestion control on the traffic data of the first application.
  • the first congestion parameter corresponding to the first application type is adjusted based on the first transmission performance index corresponding to the traffic data of the first application, the first application can be effectively congested under different network environments Control, further, on the basis of not affecting the user's experience of using the first application, the limited network bandwidth resources can be allocated, which can improve the utilization rate of the network bandwidth resources.
  • adjusting the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator includes: obtaining the first congestion parameter according to the first transmission performance indicator Applying requirements for transmission performance indicators; adjusting the first congestion parameter according to the requirements of the first application for transmission performance indicators.
  • the adjusted first congestion control obtained based on the adjusted first congestion parameter
  • the algorithm performs congestion control on the traffic data of the first application, it can meet the requirements of the first application for transmission performance indicators, so that it can effectively perform congestion control on the traffic data of the first application.
  • allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
  • adjusting the first congestion parameter according to the requirements of the first application on the transmission performance index includes: inputting the first transmission performance index into an objective function to obtain a first evaluation value; The objective function is used to evaluate the requirements of the first application on the transmission performance index; based on the first evaluation value, the first congestion parameter is adjusted.
  • the objective function can be used to evaluate the requirements of the first application on the transmission performance index
  • the adjusted first congestion control algorithm obtained from the first congestion parameter of the first application performs congestion control on the traffic data of the first application, it can meet the requirements of the first application for transmission performance indicators, so that the traffic of the first application can be effectively controlled.
  • Data congestion control is performed, and further, limited network bandwidth resources can be allocated without affecting the user's experience of using the first application, which can improve the utilization rate of network bandwidth resources.
  • the first congestion control algorithm may include a window-up algorithm and a window-down algorithm
  • the first sub-parameter may be a parameter corresponding to the window-up algorithm
  • the second sub-parameter may be Parameters corresponding to the window reduction algorithm.
  • the window raising algorithm is characterized as:
  • cwnd is used to represent the congestion window value
  • is the first sub-parameter
  • is the second sub-parameter
  • the first transmission performance indicator may include at least two performance indicators, such as throughput and delay; the first application may perform at least one of the at least two performance indicators.
  • the first congestion parameter can be adjusted in the following manner:
  • the first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
  • the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions.
  • a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than
  • the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value.
  • the second evaluation value return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction
  • the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  • the first congestion parameter corresponding to the first application type of the first application is obtained through reinforcement learning, based on the requirements of the first application for transmission performance indicators and the traffic data of the first application, it can be guaranteed that The first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application, and can effectively perform congestion control on the traffic data of the first application. Based on the experience of the first application, allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
  • the transmission performance indicator may include at least two performance indicators, such as throughput rate and delay; when the first application has low requirements for the at least two performance indicators, it may include Adjusting the first congestion parameter in the following manner includes:
  • the first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
  • a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value.
  • the second evaluation value return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction
  • the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  • the first congestion parameter corresponding to the first application type of the first application is obtained through reinforcement learning, based on the requirements of the first application for transmission performance indicators and the traffic data of the first application, it can be guaranteed that The first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application, and can effectively perform congestion control on the traffic data of the first application. Based on the experience of the first application, allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
  • the first congestion parameter may include at least a first sub-parameter and a second sub-parameter; the multiple adjustment directions may include the following four adjustment directions, and the first adjustment direction may be the following Any one of four adjustment directions: increase the first sub-parameter and the second sub-parameter; increase the first sub-parameter, decrease the second sub-parameter; decrease the first sub-parameter sub-parameter, increase the second sub-parameter; decrease the first sub-parameter and the second sub-parameter.
  • the method may further include: acquiring a mapping relationship between the application type and the congestion parameter ; based on the mapping relationship and the first application type, obtain a first congestion parameter corresponding to the first application type.
  • the mapping relationship may be stored in, but not limited to, the local memory of the adjustment device, an external memory connected to the adjustment device, other devices (eg, network devices) connected to the adjustment device, and the cloud.
  • the mapping relationship may include multiple application types and congestion parameters corresponding to the multiple application types; for any application type in at least one application type in the mapping relationship, the The congestion parameter corresponding to the application type is determined in the following manner: obtaining the initial congestion parameter corresponding to the application type, and obtaining the initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type;
  • the initial congestion control algorithm corresponding to the type performs congestion control on the traffic data of at least one application corresponding to the application type, and obtains the initial transmission performance index corresponding to the at least one application;
  • the performance indicator is input into an objective function to obtain at least one initial evaluation value, and the objective function is used to evaluate the respective requirements of the at least one application for the transmission performance indicator; a reinforcement learning method is adopted based on the at least one initial evaluation value and the at least one
  • the respective traffic data is used for training to obtain the congestion parameter corresponding to the application type.
  • acquiring the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type includes: if the mapping relationship does not include the first application type, obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or, if the mapping relationship includes the first application type, the first congestion parameter corresponding to the first application type is acquired according to the first application type and the mapping relationship.
  • the second congestion parameter corresponding to the second application type of the first application can be obtained through the mapping relationship, so that the first application of the first application can be obtained according to the second congestion parameter corresponding to the second application type of the first application type, thereby ensuring that the first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application.
  • acquiring the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship includes: according to the first application type the second application type to which the first application type belongs and the mapping relationship, obtain a second congestion parameter corresponding to the second application type to which the first application type belongs, and obtain a second congestion control algorithm based on the second congestion parameter; 2.
  • the first congestion parameter corresponding to the first application type of the first application adopts the reinforcement learning method, training is performed based on the second congestion parameter corresponding to the second application type of the first application and the traffic data of the first application obtained, it can be guaranteed that the first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application.
  • an embodiment of the present application provides a network device, including:
  • the obtaining unit configured to obtain the first application type of the first application
  • the processing unit is configured to obtain, according to the first application type, a first congestion parameter corresponding to the first application type, where the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control
  • the algorithm is used to perform congestion control on the traffic data of the first application.
  • the processing unit may be further configured to: acquire based on the first congestion parameter the first congestion control algorithm; and performing congestion control on the traffic data of the first application based on the first congestion control algorithm.
  • the processing unit may be further configured to: obtain information based on the first congestion control algorithm The first transmission performance index corresponding to the congestion control is performed on the traffic data of the first application; and the first congestion parameter is adjusted according to the first transmission performance index.
  • the processing unit when the processing unit is configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, the processing unit may be specifically configured to: A transmission performance indicator, obtaining the requirements of the first application on the transmission performance indicators; adjusting the first congestion parameter according to the requirements of the first application on the transmission performance indicators.
  • the processing unit is configured to adjust the first congestion parameter according to the requirements of the first application on the transmission performance index, which may be specifically used to: input the first transmission performance index an objective function to obtain a first evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index; based on the first evaluation value, the first congestion parameter is adjusted.
  • the first transmission performance indicator may include at least two performance indicators, such as throughput and delay; the first application may perform at least one of the at least two performance indicators.
  • the processing unit may adjust the first congestion parameter in the following manner:
  • the first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
  • the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions.
  • a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than
  • the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value.
  • the second evaluation value return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction
  • the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  • the transmission performance indicators may include at least two performance indicators, such as throughput and delay; when the first application has low requirements for the at least two performance indicators, all The processing unit may adjust the first congestion parameter in the following manner:
  • the first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
  • a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value.
  • the second evaluation value return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction
  • the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  • the first congestion parameter may include at least a first sub-parameter and a second sub-parameter; the multiple adjustment directions may include the following four adjustment directions, and the first adjustment direction may be the following Any one of four adjustment directions: increase the first sub-parameter and the second sub-parameter; increase the first sub-parameter, decrease the second sub-parameter; decrease the first sub-parameter sub-parameter, increase the second sub-parameter; decrease the first sub-parameter and the second sub-parameter.
  • the first congestion control algorithm may include a window-up algorithm and a window-down algorithm
  • the first sub-parameter may be a parameter corresponding to the window-up algorithm
  • the second sub-parameter may be Parameters corresponding to the window reduction algorithm.
  • the window raising algorithm is characterized as:
  • cwnd is used to represent the congestion window value
  • is the first sub-parameter
  • is the second sub-parameter
  • the processing unit when the processing unit is configured to obtain the first congestion parameter corresponding to the first application type according to the first application type, the processing unit may be configured to: obtain the difference between the application type and the congestion parameter.
  • a mapping relationship based on the mapping relationship and the first application type, obtain a first congestion parameter corresponding to the first application type.
  • the mapping relationship may be stored in, but not limited to, a local storage of the network device, an external storage connected to the network device, and the cloud.
  • the mapping relationship may include multiple application types and congestion parameters corresponding to the multiple application types; for any application type in at least one application type in the mapping relationship, the The processing unit may determine the congestion parameter corresponding to the application type in the following manner: acquiring the initial congestion parameter corresponding to the application type, and acquiring the initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type; Based on the initial congestion control algorithm corresponding to the application type, congestion control is performed on the traffic data of at least one application corresponding to the application type, and initial transmission performance indicators corresponding to the at least one application are obtained; The corresponding initial transmission performance index is input into the objective function, and at least one initial evaluation value is obtained, and the objective function is used to evaluate the respective requirements of the at least one application on the transmission performance index; the reinforcement learning method is adopted based on the at least one initial evaluation value and The at least one application is trained with respective traffic data to obtain a congestion parameter corresponding to the application type.
  • the processing unit when the processing unit is configured to obtain the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type, the processing unit may be specifically configured to: if the If the mapping relationship does not include the first application type, then obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or, if the If the mapping relationship includes the first application type, the first congestion parameter corresponding to the first application type is acquired according to the first application type and the mapping relationship.
  • the processing unit when the processing unit is configured to acquire the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship, the processing unit may specifically is used for: obtaining a second congestion parameter corresponding to the second application type to which the first application type belongs, according to the second application type to which the first application type belongs and the mapping relationship, and obtaining based on the second congestion parameter a second congestion control algorithm; a third transmission performance index corresponding to when performing congestion control on the traffic data of the first application based on the second congestion control algorithm; inputting the third performance index into an objective function to obtain a third evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index; the reinforcement learning method is used to perform training based on the third evaluation value and the traffic data of the first application to obtain the first application The first congestion parameter corresponding to the type.
  • the processing unit may also be configured to: update the mapping based on the adjusted first congestion parameter relation.
  • an embodiment of the present application provides a network device, including:
  • the obtaining unit configured to obtain the first transmission performance index corresponding to the congestion control of the traffic data of the first application based on the first congestion control algorithm
  • the processing unit is configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, and the adjusted first congestion parameter is used to obtain an adjusted first congestion control
  • the adjusted first congestion control algorithm is used to perform congestion control on the traffic data of the first application.
  • the processing unit when the processing unit is configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, the processing unit may be specifically configured to: A transmission performance indicator, obtaining the requirements of the first application on the transmission performance indicators; adjusting the first congestion parameter according to the requirements of the first application on the transmission performance indicators.
  • the processing unit when configured to adjust the first congestion parameter according to the requirements of the first application on the transmission performance indicator, it may be specifically configured to: input the first transmission performance indicator an objective function to obtain a first evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index; based on the first evaluation value, the first congestion parameter is adjusted.
  • the first congestion control algorithm may include a window-up algorithm and a window-down algorithm
  • the first sub-parameter may be a parameter corresponding to the window-up algorithm
  • the second sub-parameter may be Parameters corresponding to the window reduction algorithm.
  • the window raising algorithm is characterized as:
  • cwnd is used to represent the congestion window value
  • is the first sub-parameter
  • is the second sub-parameter
  • the first transmission performance indicator may include at least two performance indicators, such as throughput and delay; the first application may perform at least one of the at least two performance indicators.
  • the processing unit may adjust the first congestion parameter in the following manner:
  • the first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
  • the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions.
  • a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than
  • the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value.
  • the second evaluation value return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction
  • the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  • the transmission performance indicators may include at least two performance indicators, such as throughput and delay; when the first application has low requirements for the at least two performance indicators, all The processing unit may adjust the first congestion parameter in the following manner:
  • the first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
  • a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value.
  • the second evaluation value return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction
  • the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  • the first congestion parameter includes at least a first sub-parameter and a second sub-parameter; the multiple adjustment directions include the following four adjustment directions, and the first adjustment direction is the following four adjustment directions any one of the directions: increase the first sub-parameter and the second sub-parameter; increase the first sub-parameter, decrease the second sub-parameter; decrease the first sub-parameter, Increase the second sub-parameter; decrease the first sub-parameter and the second sub-parameter.
  • the processing unit before the processing unit is configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, the processing unit may also be configured to: obtain the application type and A mapping relationship between congestion parameters; based on the mapping relationship and the first application type, obtain a first congestion parameter corresponding to the first application type.
  • the mapping relationship may be stored in, but not limited to, the local memory of the adjustment device, an external memory connected to the adjustment device, other devices (eg, network devices) connected to the adjustment device, and the cloud.
  • the mapping relationship may include multiple application types and congestion parameters corresponding to the multiple application types; for any application type in at least one application type in the mapping relationship, the The processing unit may determine the congestion parameter corresponding to the application type in the following manner: acquiring the initial congestion parameter corresponding to the application type, and acquiring the initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type; Based on the initial congestion control algorithm corresponding to the application type, congestion control is performed on the traffic data of at least one application corresponding to the application type, and initial transmission performance indicators corresponding to the at least one application are obtained; The corresponding initial transmission performance index is input into the objective function, and at least one initial evaluation value is obtained, and the objective function is used to evaluate the respective requirements of the at least one application on the transmission performance index; the reinforcement learning method is adopted based on the at least one initial evaluation value and The at least one application is trained with respective traffic data to obtain a congestion parameter corresponding to the application type.
  • the processing unit when the processing unit is configured to obtain the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type, the processing unit may be specifically configured to: if the If the mapping relationship does not include the first application type, then obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or, if the If the mapping relationship includes the first application type, the first congestion parameter corresponding to the first application type is acquired according to the first application type and the mapping relationship.
  • the processing unit when the processing unit is configured to acquire the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship, the processing unit may specifically is used for: obtaining a second congestion parameter corresponding to the second application type to which the first application type belongs, according to the second application type to which the first application type belongs and the mapping relationship, and obtaining based on the second congestion parameter a second congestion control algorithm; a third transmission performance index corresponding to when performing congestion control on the traffic data of the first application based on the second congestion control algorithm; inputting the third performance index into an objective function to obtain a third evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index; the reinforcement learning method is used to perform training based on the third evaluation value and the traffic data of the first application to obtain the first application The first congestion parameter corresponding to the type.
  • an embodiment of the present application provides a network device, including: at least one processor and a memory; the memory stores one or more computer programs; when the one or more computer programs stored in the memory are stored by the at least one When executed by one processor, the network device is caused to execute the method involved in any one of the foregoing first aspects.
  • an embodiment of the present application provides an adjustment device, comprising: at least one processor and a memory; the memory stores one or more computer programs; when the one or more computer programs stored in the memory are stored by the at least one When executed by one processor, the network device is caused to execute the method involved in any one of the foregoing second aspects.
  • an embodiment of the present application provides a computer storage medium, where the computer-readable storage medium is used to store a computer program, and when the computer program runs on a computer, the computer is made to execute the first aspect or the first aspect above.
  • an embodiment of the present application provides a network system, including: an adjustment device and a network device;
  • the adjustment device is configured to obtain a first transmission performance index corresponding to the traffic data of the first application; adjust the first congestion parameter corresponding to the application type of the first application according to the first transmission performance index; sending the first congestion parameter to the network device;
  • the network device is configured to obtain an adjusted first congestion control algorithm according to the adjusted first congestion parameter, and perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm.
  • the network device before the adjustment device is configured to acquire the first transmission performance indicator corresponding to the traffic data of the first application, the network device is further configured to: acquire the first application type of the first application; obtaining the first congestion parameter according to the first application type; obtaining a first congestion control algorithm based on the first congestion parameter;
  • the adjustment device When the adjustment device is configured to acquire the first transmission performance index corresponding to the traffic data of the first application, it is specifically configured to: acquire the congestion of the traffic data of the first application by the network device based on the first congestion control algorithm The first transmission performance index corresponding to the control.
  • the adjustment device is further configured to: obtain the network device according to the adjustment The second transmission performance index corresponding to when the second congestion control algorithm performs congestion control on the traffic data of the first application.
  • an embodiment of the present application provides a network system, characterized in that it includes: an identification device and a network device;
  • the identifying device configured to identify the first application type of the first application; sending the first application type to the network device;
  • the network device is configured to obtain, according to the first application type, a first congestion parameter corresponding to the first application type, where the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control
  • the algorithm is used to perform congestion control on the traffic data of the first application.
  • the network device after obtaining the first congestion parameter corresponding to the first application type according to the first application type, is further configured to: obtain the first congestion parameter based on the first congestion parameter. the first congestion control algorithm; and based on the first congestion control algorithm, congestion control is performed on the traffic data of the first application.
  • the network system further includes an adjustment device, and the adjustment device is used for:
  • the network device is configured to: obtain an adjusted first congestion control algorithm according to the adjusted first congestion parameter, and perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm.
  • FIG. 1 is a schematic diagram of the architecture of a network system provided by an embodiment of the present application
  • FIG. 2 is a schematic structural diagram of a network system provided by an embodiment of the present application.
  • FIG. 3 is a schematic structural diagram of a network system provided by an embodiment of the present application.
  • FIG. 4 is a schematic structural diagram of a network system provided by an embodiment of the present application.
  • FIG. 5 is a schematic flowchart of a congestion control method provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a process for a network device to obtain a congestion parameter corresponding to an application type a according to an embodiment of the present application
  • FIG. 7 is a schematic diagram of a process for a network device to obtain a congestion parameter corresponding to an application type a according to an embodiment of the present application
  • FIG. 8 is a schematic diagram of a process for a network device to obtain a congestion parameter corresponding to an application type a according to an embodiment of the present application
  • FIG. 9 is a schematic diagram of a process for a network device to adjust a first congestion parameter corresponding to a first application type of a first application according to an embodiment of the present application;
  • FIG. 10 is a schematic diagram of a process in which a network device adjusts a first congestion parameter corresponding to a first application type of a first application based on a first evaluation value according to an embodiment of the present application;
  • FIG. 11 is a schematic diagram of a process in which a network device adjusts a first congestion parameter corresponding to a first application type of a first application based on a first evaluation value according to an embodiment of the present application;
  • FIG. 12 is a schematic flowchart of a congestion control method provided by an embodiment of the present application.
  • FIG. 13 is a schematic structural diagram of a network device according to an embodiment of the present application.
  • FIG. 15 is a schematic structural diagram of a network device according to an embodiment of the present application.
  • FIG. 16 is a schematic structural diagram of an adjustment device provided by an embodiment of the present application.
  • FIG. 1 is a schematic structural diagram of a network system according to an embodiment of the present application.
  • the network system may include at least one terminal 101 and a network device 102 .
  • the network system provided by the embodiments of the present application may be applicable to both a low frequency scenario (sub 6G) and a high frequency scenario (above 6G).
  • Application scenarios of the network system provided by the embodiments of the present application include, but are not limited to, a global system of mobile communication (GSM) system, a code division multiple access (CDMA) system, a wideband code division multiple access (wideband) system code division multiple access (WCDMA) system, general packet radio service (GPRS), long term evolution (LTE) system, LTE frequency division duplex (FDD) system, LTE time division dual time division duplex (TDD), universal mobile telecommunication system (UMTS), worldwide interoperability for microwave access (WiMAX) network system, future fifth generation (5th generation, 5G) system or a new radio (NR) network system, etc.
  • GSM global system of mobile communication
  • CDMA code division multiple access
  • WCDMA wideband code division multiple access
  • WCDMA wideband code division multiple access
  • GPRS general packet radio service
  • the terminal 101 may be a device with a wireless transceiver function, and may be deployed on land, including indoor or outdoor, handheld or vehicle-mounted; it may also be deployed on water (such as a ship, etc.); it may also be deployed In the air (eg in airplanes, balloons, satellites, etc.).
  • the terminal 101 can communicate with one or more network devices 102 in one or more network systems, and receive network services provided by the network devices 102 .
  • the terminal 101 in this embodiment of the present application may be a mobile phone (or referred to as a "cellular" phone), a session initiation protocol (SIP) phone, or a wireless local loop (WLL) station , personal digital assistant (PDA), computer with mobile terminal, etc.
  • a mobile phone or referred to as a "cellular" phone
  • SIP session initiation protocol
  • WLL wireless local loop
  • PDA personal digital assistant
  • the terminal 101 may also be a user equipment (user equipment, UE), a terminal (terminal), a mobile station (mobile station, MS), a mobile phone (mobile phone), a tablet computer (pad), a computer with a wireless transceiver function, a virtual reality ( virtual reality (VR) terminal, augmented reality (AR) terminal, wireless terminal in industrial control, wireless terminal in self driving, wireless terminal in remote medical , wireless terminal in smart grid, wireless terminal in transportation safety, wireless terminal in smart city, wireless terminal in smart home, etc.
  • the terminal 101 may also be a communication chip with a communication module.
  • the network device 102 includes but is not limited to: an access network (access network, AN) device, a radio network controller (radio network controller, RNC), a node B (node B, NB), a base station Controller (base station controller, BSC), base transceiver station (base transceiver station, BTS), home base station (for example, home evolved nodeB, or home node B, HNB), baseband unit (baseBand unit, BBU), transmission point ( transmitting and receiving point, TRP), transmitting point (transmitting point, TP), mobile switching center, etc.
  • RNC radio network controller
  • RNC radio network controller
  • node B node B
  • BSC base station Controller
  • base transceiver station base transceiver station
  • BTS home base station
  • home base station for example, home evolved nodeB, or home node B, HNB
  • baseband unit baseBand unit, BBU
  • TRP transmitting and receiving point
  • TP transmitting point
  • mobile switching center etc.
  • Network equipment 102 may be used to interconvert received air frames and Internet Protocol (IP) packets, acting as a router between terminal 101 and the rest of the access network, which may include an IP network.
  • the network device 102 may also coordinate attribute management for the air interface.
  • the network device 102 may include an evolved base station (NodeB or eNB or e-NodeB, evolutional Node B) in a long term evolution (long term evolution, LTE) system or an evolved LTE system (LTE-Advanced, LTE-A), Alternatively, it may also include the next generation node B (gNB) in the 5G NR system, or may also include the centralized unit (CU) in the cloud radio access network (CloudRAN) system.
  • NodeB or eNB or e-NodeB, evolutional Node B in a long term evolution (long term evolution, LTE) system or an evolved LTE system (LTE-Advanced, LTE-A)
  • LTE-A evolved LTE system
  • gNB next generation no
  • the network device 102 may also be an access point (access point, AP) such as a wireless AP, or a switch, or a firewall, etc.
  • AP access point
  • the embodiment of the present application does not limit the specific form of the network device 102 .
  • the terminal 101 and the network device 102 may communicate directly or communicate through forwarding by other devices, which is not specifically limited in the embodiment of the present application. in:
  • the terminal 101 is used for running the first application.
  • the network device 102 is configured to acquire a first application type of the first application; further, acquire a first congestion parameter corresponding to the first application type of the first application according to the first application type of the first application.
  • the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control algorithm is used to perform congestion control on the traffic data of the first application.
  • the network device can obtain a first congestion control algorithm suitable for performing congestion control on the traffic data of the first application, thereby effectively Congestion control is performed on the traffic data of the first application, and further, limited network bandwidth resources can be allocated on the basis of not affecting the user's experience of using the first application, and the utilization rate of network bandwidth resources can be improved.
  • FIG. 2 it is a schematic diagram of the architecture of a network system provided in the implementation of the present application.
  • the network system may also include a device 103 for adjusting the congestion parameter.
  • the name of the device for adjusting the congestion parameter is used herein. It is an example of adjusting equipment.
  • the adjustment device 103 can be used for:
  • the adjustment device 103 can send the adjusted first congestion parameter to the network device 102 in addition to the above functions, so that the network device 102 can obtain the adjusted first congestion control based on the adjusted first congestion parameter
  • the algorithm based on the adjusted first congestion control algorithm, performs congestion control on the traffic data of the first application.
  • the foregoing network device 102 and adjustment device 103 may be integrated on the same device, or may be two independent devices, which are not limited in this embodiment of the present application.
  • the adjustment device 103 may include, but is not limited to, any device having the function of adjusting the congestion parameter, such as a switch, a firewall, and the like.
  • the adjustment device 103 and the network device 102 are integrated on the same device, for example, when the adjustment device 103 is integrated on the network device 102, the adjustment device 103 may be a device installed on the network device 102 that can be used to adjust the congestion parameter A software program, or a hardware circuit or the like set on the network device 102 that can be used to adjust the congestion parameter, in this case, the network device 102 may have the function of adjusting the congestion parameter.
  • the embodiment of the present application does not limit the specific form of the adjustment device 103 .
  • the first congestion parameter corresponding to the first application is adjusted by the adjustment device according to the first transmission performance index corresponding to the congestion control of the traffic data of the first application based on the first congestion control algorithm, so that the network device It can effectively perform congestion control on the traffic data of the first application in different network environments, and further, on the basis of not affecting the user's experience of using the first application, limited network bandwidth resources can be allocated to improve network bandwidth resources. utilization rate.
  • the network system may also include a device 104 for identifying the application type of the application.
  • the application type for identifying the application is used herein.
  • the name of the device is to identify the device as an example.
  • the identification device 104 may be used to identify the first application type of the first application.
  • the identification device 104 can send the first application type to the network device 102 in addition to the above functions.
  • the foregoing network device 102 and identification device 104 may be integrated on the same device, or may be two independent devices, which are not limited in this embodiment of the present application.
  • the identification device 104 may include, but is not limited to, any device having the function of identifying the application type of the application, such as a switch and a firewall.
  • the identification device 104 and the network device 102 are integrated on the same device, for example, when the identification device 104 is integrated on the network device 102, the identification device 104 may be an application type installed on the network device 102 that can be used to identify the application.
  • the embodiment of the present application does not limit the specific form of the identification device 104 .
  • the network device obtains the first congestion parameter corresponding to the first application type by identifying the first application type of the first application identified by the device, and further, can obtain traffic data suitable for the first application
  • a first congestion control algorithm for congestion control so that congestion control can be effectively performed on the traffic data of the first application, and further, limited network bandwidth resources can be allocated on the basis of not affecting the user's experience of using the first application , to improve the utilization of network bandwidth resources.
  • the network system shown in FIG. 4 may include at least one terminal 101 and network device 102 shown in FIG. 1-FIG. device 103 and identification device 104 shown in FIG. 4 . in:
  • the terminal 101 is used for running the first application.
  • the identification device 104 is configured to identify the first application type of the first application; further, send the first application type of the first application to the network device 102 .
  • the network device 102 is configured to acquire, according to the first application type of the first application; further, acquire the first congestion parameter corresponding to the first application type according to the first application type of the first application.
  • the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control algorithm is used to perform congestion control on the traffic data of the first application.
  • the adjustment device 103 is configured to obtain a first transmission performance index corresponding to the congestion control of the traffic data of the first application based on the first congestion control algorithm; further, adjust the first application type of the first application according to the first transmission performance index the corresponding first congestion parameter; sending the adjusted first congestion parameter to the network device 102 .
  • the network device 102 is further configured to obtain an adjusted first congestion control algorithm according to the adjusted first congestion parameter, and perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm.
  • the network device 102, the adjustment device 103, and the identification device 104 shown in FIG. 4 may be integrated on the same device, for example, the identification device 104 and/or the adjustment device 103 may be integrated in the network device 102, at this time, the network device 102 may have the function of identifying the application type of the application and/or adjusting the congestion parameter, or the identifying device 104 and the adjusting device 103 may be integrated on the same device, at this time, the device has the function of identifying the application. The type of application and the function to adjust the congestion parameters.
  • the network device 102 , the adjustment device 103 , and the identification device 104 shown in FIG. 4 may also be independent devices, which are not limited in this embodiment of the present application.
  • the network device can obtain the first congestion parameter corresponding to the first application type by identifying the first application type of the first application by the identifying device. Further, the network device can also adjust the device according to the first congestion control algorithm based on The first transmission performance index corresponding to the traffic data of the first application when congestion control is performed, and the first congestion parameter corresponding to the first application is adjusted, so that the first congestion suitable for performing congestion control on the traffic data of the first application can be obtained.
  • the control algorithm is used to effectively perform congestion control on the traffic data of the first application in different network environments. Further, on the basis of not affecting the user's experience of using the first application, limited network bandwidth resources can be allocated well, Improve the utilization of network bandwidth resources.
  • the first application involved in the embodiments of the present application may be any software program (application, APP for short) installed in the terminal that can realize one or more specific functions by connecting to a network.
  • the first application may be: a game application, such as King of Glory, Peace Hero, etc., or may also be a communication application, such as WeChat (WeChat), Tencent Chat Software (QQ), DingTalk, etc., or, you can also It is a short video application, such as Douyin short video, Kuaishou short video, etc., or it can also be an online video application, such as Youku, iQiyi, Tencent Video, etc., and it can also be a web application, such as Baidu, Sohu, etc. , it may also be a virtual reality (virtual reality, VR) application type, etc., which is not specifically limited in this embodiment of the present application.
  • VR virtual reality
  • ordinal numbers such as “first” and “second” mentioned in the embodiments of the present application are used to distinguish multiple objects, and are not used to limit the order, sequence, priority or priority of multiple objects. Importance.
  • the first application and the second application are only used to distinguish different applications, but do not indicate the difference in priority or importance of the two applications.
  • references to “one embodiment” or “some embodiments” and the like described in the embodiments of the present application mean that specific features described in connection with the embodiments are included in one or more embodiments of the present application , structure or characteristics.
  • appearances of the phrases “in one embodiment,” “in some embodiments,” “in other embodiments,” “in other embodiments,” etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean “one or more but not all embodiments” unless specifically emphasized otherwise.
  • the terms “including”, “including”, “having” and their variants mean “including but not limited to” unless specifically emphasized otherwise.
  • FIG. 5 it is a schematic flowchart of a congestion control method provided by an embodiment of the present application .
  • the method flow includes the following steps:
  • the terminal when the terminal is connected to the network through the network device, the terminal can perform various learning or entertainment activities by using the network. For example, if the first application is an online video application, the terminal can play the video by using the network when running the first application, or, if the first application is a game application, the terminal can display the game operation screen by using the network when running the first application ,etc.
  • the identification device may acquire the traffic data of the first application, and based on the traffic data of the first application, identify the first application type of the first application by using a corresponding identification method. As an example, the identification device may identify the first application type of the first application based on the traffic data of the first application by using a port number classification identification method.
  • the identification device may identify the first application type of the first application by adopting a deep packet inspection (deep packet inspection, DPI) identification method based on the traffic data of the first application.
  • the identification device may identify the first application type of the first application by adopting a deep flow inspection (deep flow inspection, DFI) identification method based on the flow data of the first application.
  • the identification device may identify the first application type of the first application by using a machine learning identification method based on the traffic data of the first application, and so on.
  • the identification device may also identify the first application type of the first application based on the traffic data of the first application by combining the above identification methods, which is not specifically limited in this embodiment of the present application.
  • the first application type may also be referred to as a sub-type application type in this application.
  • the first application type of the first application may be the King of Glory application type.
  • the identification device may send the identified first application type of the first application to the network device, and in addition, the identification device may also forward traffic data of the first application to the network device.
  • the network device may obtain the first application type of the first application sent by the identification device, and obtain the traffic data of the first application forwarded by the identification device.
  • the network device can identify the first application type of different applications based on the respective traffic data of different applications by identifying the device, so that when the network device performs congestion control on the respective traffic data of different applications, it can be based on
  • the respective first application types of different applications select appropriate congestion control algorithms for different applications, which are used to perform congestion control on the respective traffic data of different applications, so as to effectively perform congestion control on the respective traffic data of different applications, and further, can On the basis of not affecting the user's experience of using these applications, allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
  • the network device may obtain the first congestion control algorithm based on the first congestion parameter, and may perform the first congestion control algorithm on the traffic data of the first application based on the first congestion control algorithm. Congestion control is performed.
  • the first congestion parameter is determined based on the first application type of the first application, it can be ensured that the first congestion control algorithm obtained by the network device based on the first congestion parameter is suitable for
  • the traffic data of the first application is subject to congestion control, so that congestion control can be effectively performed on the traffic data of the first application, and further, limited network bandwidth can be allocated on the basis of not affecting the user's experience of using the first application resources, which can improve the utilization of network bandwidth resources.
  • the network device may acquire a pre-stored mapping relationship between application types and congestion parameters.
  • the mapping relationship may include multiple application types and respective congestion parameters corresponding to the multiple application types.
  • the mapping relationship may be one or any combination of a network device stored in a local storage, an external storage connected to the network device, a cloud, and the like, which is not specifically limited in this embodiment of the present application.
  • the multiple application types included in the mapping relationship may include multiple second application types (this application may also be referred to as broad application types), and may also include at least one of the multiple second application types
  • Each of the second application types includes at least one first application type, that is, the first application type belongs to the second application type.
  • the multiple second application types may include, but are not limited to: game application types, online video application types, short video application types, online music application types, VR application types, and web page application types, etc. This is not specifically limited in the application examples.
  • the second application type may include the first application type such as the King of Glory application type or the Peace Hero application type.
  • the above-mentioned first congestion parameter may be obtained by the network device based on the first application type of the first application and the mapping relationship.
  • the application type is called application type a as an example.
  • the application type a generally refers to the second application type.
  • the congestion parameter corresponding to the application type a may be obtained by training the adjustment device based on the traffic data of at least one application corresponding to the application type a by using reinforcement learning.
  • the congestion parameter corresponding to the application type a may be obtained by the network device using reinforcement learning through training based on the traffic data of at least one application corresponding to the application type a.
  • the network device may acquire the congestion parameter corresponding to the application type a obtained by the adjustment device based on reinforcement learning training.
  • the adjustment device is integrated on the network device, that is, the network device has the function of adjusting the congestion parameter.
  • FIG. 6 is a schematic diagram of a process for a network device to obtain a congestion parameter corresponding to an application type a according to an embodiment of the present application.
  • FIG. 6 takes the execution subject as a network device as an example. As shown in Figure 6, the process may include the following steps:
  • the congestion control algorithm may include, but is not limited to, the following two mechanisms: a congestion reduction window mechanism and a window recovery mechanism.
  • the window raising algorithm can be characterized as:
  • cwnd is used to represent the congestion window value
  • ⁇ and ⁇ are coefficients, that is, congestion parameters.
  • different values of ⁇ and ⁇ can correspond to different congestion control algorithms, and different congestion control algorithms also have different effects on the transmission performance index of the application.
  • the network device may initialize the congestion parameter corresponding to the application type a to obtain the initial congestion parameter corresponding to the application type a.
  • the initial congestion parameter may include a first sub-parameter and a second sub-parameter.
  • the first sub-parameter may be a parameter corresponding to the window-up algorithm, for example, the first sub-parameter may be ⁇
  • the second sub-parameter may be a parameter corresponding to the window-down algorithm, for example, the second sub-parameter may be ⁇ .
  • the network device may initialize the first sub-parameter ⁇ in the congestion parameter corresponding to the application type a to 1, and the second sub-parameter ⁇ to 0.5, that is, obtain the first sub-parameter in the initial congestion parameter corresponding to the application type a as 1,
  • the second subparameter is 0.5.
  • the network device may obtain the initial congestion control algorithm corresponding to the application type a based on the initial congestion parameter corresponding to the application type a. For example, when the first sub-parameter ⁇ of the initial congestion parameters corresponding to the application type a is 1 and the second sub-parameter ⁇ is 0.5, the initial congestion control algorithm corresponding to the application type a may be an early reno algorithm.
  • the network device may perform congestion control on the traffic data of at least one application (hereinafter referred to as the at least one application) corresponding to the application type a based on the obtained initial congestion control algorithm corresponding to the application type a, to obtain Each corresponding initial transmission performance index of the at least one application.
  • the network device may perform congestion control on the traffic data of the at least one application based on the reno algorithm, and obtain the initial transmission corresponding to the at least one application. Performance.
  • the network device may perform congestion control on the traffic data of the at least one application by using the above-mentioned window-up algorithm and the above-mentioned window-down algorithm.
  • the network device may record the initial transmission performance index corresponding to the congestion control of the traffic data of the at least one application based on the initial congestion control algorithm corresponding to the application type a. In other words, the network device may obtain the corresponding initial transmission performance index based on the application type a.
  • the initial congestion control algorithm corresponds to the initial transmission performance index when congestion control is performed on the traffic data of the at least one application.
  • the network device may obtain an objective function, and the objective function may be used to evaluate the respective requirements of the at least one application on the transmission performance index. It can be understood that the objective function may be used to measure the initial congestion corresponding to the application type a
  • the control algorithm the effect of performing congestion control on the traffic data of the at least one application, is to measure whether the initial congestion control algorithm corresponding to the application type a can better meet the respective requirements of the at least one application for transmission performance indicators.
  • the network device can obtain the objective function to measure whether the initial congestion control algorithm corresponding to application type a can be better The respective requirements of the at least one application on the transmission performance index are met, so that the respective requirements of the at least one application on the transmission performance index can be met.
  • the transmission performance indicators may include at least two performance indicators.
  • Applications of different application types have different requirements for transmission performance indicators. It can be understood that applications of different application types may have different performance indicators for at least two performance indicators. Require. For example, applications of some application types have high requirements on at least one performance index of at least two performance indicators, and other applications have low requirements on at least two performance indicators, and so on.
  • the at least two performance indicators may include latency and throughput.
  • Applications of different application types can have different requirements for throughput and latency. For example, if the application type a is a game application type, since the delay has a greater impact on the game application, and the throughput rate has a small impact on the game application, the network device can determine the impact of the at least one application on the delay based on the application type a. For high requirements, low throughput requirements.
  • the application type a is a VR application type, since both the delay and the throughput rate have a great impact on the VR type application, the network device can apply the type a to determine that the at least one application has high requirements on the throughput rate and delay.
  • the network device can determine the at least one application based on the application type a.
  • the throughput rate is high, and the delay is low.
  • the network device may determine, based on the application type a, that the at least one application has low requirements for the throughput rate and the delay. ,etc.
  • the at least one application has high requirements on throughput rate and/or delay, which may be understood as the traffic data of the at least one application requires low delay and/or high throughput rate, and the at least one application has high requirements on throughput rate and/or high throughput rate.
  • the latency is a low requirement, which can be understood as requiring high latency and low throughput for the traffic data of the at least one second application.
  • the objective function can be characterized as:
  • x represents the inverse of the delay corresponding to the traffic data of the at least one application based on the initial congestion control algorithm
  • y represents the congestion control of the traffic data of the at least one application based on the initial congestion control algorithm.
  • represents the balance parameter of the corresponding throughput rate and delay when performing congestion control on the traffic data of the at least one application based on the initial congestion control algorithm
  • U(x) is used to indicate that x is normalized Value
  • U(y) is used to indicate the normalized value of y.
  • the network device can input the initial transmission performance index corresponding to the at least one application into the objective function to obtain at least one initial evaluation value .
  • the network device may use reinforcement learning to perform training based on the at least one initial evaluation value and the respective traffic data of the at least one application to obtain the congestion parameter corresponding to the application type a.
  • the network device may adjust the initial congestion parameter corresponding to the application type a to obtain the adjusted initial congestion control algorithm.
  • the network device may perform congestion control on the traffic data of the at least one application based on the adjusted initial congestion control algorithm, and obtain a fourth corresponding to when performing congestion control on the traffic data of the at least one application based on the adjusted initial congestion control algorithm.
  • transmission performance index, and at least one fourth evaluation value of the objective function can be obtained based on the fourth transmission performance index.
  • the network device can adjust the initial congestion corresponding to the application type a according to the corresponding adjustment method by judging the magnitude relationship between the at least one fourth evaluation value and the at least one initial evaluation value, and the respective requirements of the at least one application for the transmission performance index.
  • parameter obtain the maximum evaluation value or the minimum evaluation value of the objective function, and obtain the congestion parameter corresponding to the application type a.
  • the network device may apply the initial congestion parameter corresponding to type a to obtain an adjusted initial congestion control algorithm, and may obtain an initial congestion control algorithm based on the adjusted initial congestion control algorithm.
  • the fourth transmission performance index corresponding to the congestion control of the traffic data of the second application.
  • the network device inputs the fourth transmission performance index into the objective function, and can obtain a fourth evaluation value of the objective function.
  • the network device can adjust the initial congestion corresponding to the application type a according to the corresponding adjustment method by judging the magnitude relationship between the fourth evaluation value and the initial evaluation value corresponding to the application type a and the requirements of the second application on the transmission performance index parameter, obtain the maximum evaluation value or the minimum evaluation value of the objective function, and obtain the congestion parameter corresponding to the application type a.
  • the network device may acquire the requirements of the second application for the transmission performance index based on the fourth transmission performance index of the second application. For example, the network device may obtain the requirements of the second application on the transmission performance index by analyzing the fourth transmission performance index. Alternatively, the network device may determine, based on the application type a, the second application's requirement on the transmission performance indicator, which is not limited in this embodiment of the present application. After the network device determines the requirements of the second application for the transmission performance indicators, it can use the corresponding reinforcement learning method to perform training based on the initial evaluation value corresponding to the application type a and the traffic data of the second application, and obtain the congestion parameter corresponding to the training application type a. .
  • FIG. 7 it is a schematic diagram of a process for a network device to acquire a congestion parameter corresponding to an application type a according to an embodiment of the present application.
  • the execution subject is the network device
  • the second application has a high requirement on at least one of the at least two performance indicators included in the transmission performance indicator as an example.
  • the process may include the following steps:
  • the initial evaluation value corresponding to the network device application type a in step S401 is similar to that obtained by the network device shown in FIG. 6 to obtain at least one initial evaluation value. This will not be repeated here.
  • the multiple adjustment directions may include four adjustment directions, for example, including increasing the first sub-parameter and the second sub-parameter in the initial congestion parameter corresponding to the application type a, and increasing the initial congestion parameter corresponding to the application type a.
  • increasing the first sub-parameter decrease the second sub-parameter in the initial congestion parameter corresponding to application type a, or decrease the first sub-parameter in the initial congestion parameter corresponding to application type a, and increase the initial congestion parameter corresponding to application type a
  • the second sub-parameter in the parameter, or the first sub-parameter and the second sub-parameter in the initial congestion parameter corresponding to the application type a are reduced.
  • the network device can obtain the adjusted initial congestion control algorithm based on the window raising algorithm and the window lowering algorithm in S301 above, which will not be repeated here.
  • S409 Determine whether there is at least one fourth evaluation value in the plurality of fourth evaluation values that is greater than the initial evaluation value corresponding to the application type a. If it exists, execute S410, otherwise, execute S411.
  • FIG. 8 it is a schematic diagram of a process for a network device to acquire a congestion parameter corresponding to an application type a according to an embodiment of the present application.
  • FIG. 8 takes the execution subject as the network device, and takes as an example that the second application has low requirements for at least two performance indicators included in the transmission performance indicator.
  • the process may include the following steps:
  • steps S501-S505 are similar to steps S401-S405 shown in FIG. 7 above.
  • steps S501-S505 are similar to steps S401-S405 shown in FIG. 7 above.
  • S509 Determine whether there is at least one fourth evaluation value in the plurality of fourth evaluation values that is smaller than the initial evaluation value corresponding to the application type a. If it exists, execute S510, otherwise, execute S511.
  • the network device may select an application among the multiple applications, and obtain the application in the manner shown in FIG. 7 or FIG. 8 .
  • Congestion parameter corresponding to type a the network device may obtain multiple congestion parameters corresponding to application type a in the manner shown in FIG. 7 or FIG. 8 based on multiple applications.
  • the final congestion parameter corresponding to the application type a can be obtained in the following way. For example, the average value of multiple congestion parameters corresponding to the application type a can be taken as the final congestion parameter corresponding to the application type a.
  • the congestion parameter corresponding to the application type a in the above-mentioned mapping relationship may be obtained by training the network device offline through the test network in the manner shown in FIG. 7 or FIG. 8 .
  • the network device may determine, according to the second application type and the mapping relationship to which the first application type belongs, to determine The first congestion parameter corresponding to the first application type. Afterwards, the network device may update the mapping relationship according to the first congestion parameter corresponding to the first application type of the first application.
  • the network device can determine the King of Glory application type according to the game application type and the mapping relationship. The corresponding first congestion parameter.
  • the following specifically describes the process of acquiring the first congestion parameter corresponding to the first application type of the first application by the network device according to the second application type of the first application and the mapping relationship between the application type and the congestion parameter.
  • the network device may determine the second application type of the first application according to the first application type of the first application. Afterwards, the network device may acquire the second congestion parameter corresponding to the second application type of the first application according to the second application type of the first application and the mapping relationship. At this time, the second congestion parameter corresponding to the second application type of the first application obtained by the network device can be understood as initializing the value of the first congestion parameter corresponding to the first application type of the first application, that is, the mapping The value of the second congestion parameter corresponding to the second application type of the first application included in the relationship is the initial value of the first congestion parameter corresponding to the first application type of the first application.
  • the network device may use reinforcement learning to perform training based on the second congestion parameter corresponding to the second application type of the first application and the traffic data of the first application to obtain the first congestion parameter corresponding to the first application type of the first application parameter. For example, the network device may obtain the second congestion control algorithm based on the second congestion parameter corresponding to the second application type of the first application, and may obtain the second congestion control algorithm corresponding to the congestion control of the traffic data of the first application based on the second congestion control algorithm. Three transmission performance indicators, the third transmission performance indicator may be input into the objective function to obtain a third evaluation value.
  • the network device may perform training based on the third evaluation value and the traffic data of the first application in a reinforcement learning manner to obtain a first congestion parameter corresponding to the first application type of the first application.
  • the network device may perform training based on the third evaluation value and the traffic data of the first application in a reinforcement learning manner to obtain a first congestion parameter corresponding to the first application type of the first application.
  • the network device can obtain the first application type as shown in FIG. 7 or FIG. 8 .
  • the first congestion parameter corresponding to the first application type of an application and/or the second congestion parameter corresponding to the second application type please refer to steps S401-S411 shown in FIG. 7 or steps S501-S511 shown in FIG. 8 for details. The related descriptions are not repeated here.
  • the first congestion parameter corresponding to the first application type of the first application may be It is obtained by training the network equipment online in the manner shown in FIG. 7 or FIG. 8 , that is, the network equipment is trained in the manner shown in FIG. 7 or FIG. 8 when the first application is used.
  • the first congestion parameter corresponding to the first application type of the first application is the network device using the reinforcement learning method to perform training based on the first application's requirements for transmission performance indicators and the traffic data of the first application obtained, it can be ensured that the first congestion control algorithm obtained by the network device based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application, and can effectively perform congestion control on the traffic data of the first application, and further , the limited network bandwidth resources can be allocated on the basis of not affecting the user's experience of using the first application, and the utilization rate of the network bandwidth resources can be improved.
  • the network device since the network environment may change, during the process of running the first application on the terminal, the network device may adjust the first congestion parameter corresponding to the first application type of the first application to apply to different network environments, Therefore, the limited network bandwidth resources can be allocated without affecting the user's experience of using the first application, and the utilization rate of the network bandwidth resources can be improved.
  • FIG. 9 is a schematic diagram of a process for a network device to adjust a first congestion parameter corresponding to a first application type of a first application according to an embodiment of the present application.
  • FIG. 9 takes the execution subject as a network device as an example. As shown in Figure 9, the process may include the following steps:
  • the network device when the network device performs congestion control on the traffic data of the first application based on the first congestion control algorithm, the network device may obtain the corresponding information when performing congestion control on the traffic data of the first application based on the first congestion control algorithm.
  • the first transmission performance index For the specific process, reference may be made to the relevant descriptions of steps S301-S302 shown in FIG. 6 above, which will not be repeated here.
  • the network device may acquire the requirements of the first application for the transmission performance index according to the first transmission performance index. For example, the network device may obtain the requirements of the first application for the transmission performance indicator by analyzing the first transmission performance indicator. Alternatively, the network device may determine, based on the first application type of the first application, the requirement of the first application on the transmission performance indicator, which is not limited in this embodiment of the present application. Afterwards, the network device may adjust the first congestion parameter corresponding to the first application type of the first application based on the first application's requirement for the transmission performance indicator. For example, the network device can evaluate the requirements of the first application on the transmission performance index by acquiring the objective function.
  • the objective function can be used to measure the effect of the first congestion control algorithm on the congestion control of the traffic data of the first application, that is, to measure whether the first congestion control algorithm can meet the requirements of the first application for transmission performance indicators.
  • the network device may input the first transmission performance index into the objective function to obtain the first evaluation value.
  • the network device may adjust the first congestion parameter based on the first evaluation value.
  • FIG. 10 a schematic diagram of a process in which a network device adjusts a first congestion parameter corresponding to a first application type of a first application based on a first evaluation value according to an embodiment of the present application.
  • the execution subject is the network device
  • the first application has a high requirement on at least one performance indicator of the at least two performance indicators included in the transmission performance indicator as an example.
  • the process may include the following steps:
  • S708. Determine whether at least one second evaluation value is greater than the first evaluation value among the plurality of second evaluation values. If it exists, execute S709, otherwise, execute S710.
  • steps S701 to S710 are similar to steps S402 to S411 shown in FIG. 7 above, and the specific process can refer to the relevant descriptions of the above steps S402 to S411, which will not be repeated here.
  • FIG. 11 a schematic diagram of a process in which a network device adjusts a first congestion parameter corresponding to a first application type of a first application based on a first evaluation value according to an embodiment of the present application.
  • the execution subject is the network device, and it is taken as an example that the first application has low requirements for at least two performance indicators included in the transmission performance indicator.
  • the process may include the following steps:
  • the steps S801 to S810 are similar to the steps S502 to S511 shown in FIG. 8 above, and the specific process can refer to the relevant descriptions of the above steps S502 to S511 , which will not be repeated here.
  • the network device may update the mapping relationship between the application type and the congestion parameter based on the adjusted first congestion parameter, to The network device can subsequently perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm obtained based on the adjusted first congestion parameter, so that the network device can effectively control the first application in different network environments.
  • congestion control further, limited network bandwidth resources can be allocated without affecting the user's experience of using the first application, which can improve the utilization rate of network bandwidth resources.
  • the first congestion parameter of the first congestion control algorithm used by the network device to perform congestion control on the traffic data of different applications is determined based on the respective first application types of different applications, it can effectively Congestion control is performed on the traffic data of the first application, and further, limited network bandwidth resources can be allocated without affecting the user's experience of using different applications, which can improve the utilization rate of network bandwidth resources.
  • the network device can also adjust the first congestion parameters corresponding to the first application types of different applications, so that they can be applied to different network environments.
  • FIG. 12 a flowchart of a congestion control method provided by this embodiment of the present application is shown. Schematic. Among them, Fig. 12 takes the execution subject as the adjustment device as an example. As shown in Figure 12, the method flow includes the following steps:
  • the adjustment device may monitor the first transmission performance index corresponding to when the network device performs congestion control on the traffic data of the first application based on the first congestion control algorithm, that is, the adjustment device may actively obtain the first congestion control algorithm based on the first transmission performance index.
  • the first transmission performance index corresponding to the congestion control of the traffic data of the first application may acquire the first transmission performance indicator that is sent by the network device and corresponds to when it performs congestion control on the traffic data of the first application based on the first congestion control algorithm.
  • the network device may record the corresponding first transmission performance index when it performs congestion control on the traffic data of the first application based on the first congestion control algorithm. Afterwards, the network device may send the recorded first transmission performance index corresponding to when the traffic data of the first application is subjected to congestion control based on the first congestion control algorithm to the adjustment device.
  • the adjusted first congestion parameter is used to obtain an adjusted first congestion control algorithm, and the adjusted first congestion control algorithm is used to perform congestion control on the traffic data of the first application.
  • the adjustment device may acquire the first congestion parameter corresponding to the first application type of the first application.
  • the adjustment device may acquire the mapping relationship between the application type and the congestion parameter, and may acquire the first congestion parameter corresponding to the first application type of the first application based on the mapping relationship and the first application type of the first application.
  • the mapping relationship may include multiple application types and respective congestion parameters corresponding to the multiple application types.
  • the multiple application types included in the mapping relationship may include multiple second application types, and may also include at least one first application type included in at least one second application type among the multiple second application types. An application type, that is, the first application type belongs to the second application type.
  • the multiple second application types may include, but are not limited to: game application types, online video application types, short video application types, online music application types, VR application types, and web page application types, etc. This is not specifically limited in the application examples.
  • the second application type may include the first application type such as the King of Glory application type or the Peace Hero application type.
  • the adjustment device may acquire the first congestion parameter corresponding to the first application type of the first application based on the first application type of the first application and the mapping relationship.
  • the mapping relationship may be one or any combination of the adjustment device stored in the local storage, the external storage connected to the adjustment device, other devices (such as network devices) connected to the adjustment device, the cloud, and the like. There is no specific limitation.
  • the application type is called application type b as an example, the congestion corresponding to the application type b
  • the parameter may be obtained by training the adjustment device based on the traffic data of at least one application corresponding to the application type b by means of reinforcement learning.
  • the application type b generally refers to the second application type.
  • the process of obtaining the congestion parameter corresponding to application type b by the adjustment device is similar to the process of obtaining the congestion parameter corresponding to application type a by the network device shown in FIG. 7 or FIG. 8 .
  • steps S401-S411 shown in FIG. or the related descriptions of steps S501-S511 shown in FIG. 8 will not be repeated here.
  • the adjustment device can select an application among the multiple applications, and the adjustment device can select one of the multiple applications.
  • the shown network device obtains the congestion parameter corresponding to the application type a.
  • the adjustment device may, based on multiple applications, adopt the method of obtaining multiple congestion parameters corresponding to the application type a as shown in the above-mentioned FIG. 7 or FIG. 8 by the network device , to obtain multiple congestion parameters corresponding to the application type a.
  • the adjustment device can obtain the final congestion parameter corresponding to application type b in a corresponding manner. For example, the average value of multiple congestion parameters corresponding to application type b can be taken as the final congestion parameter corresponding to application type b.
  • the congestion parameter corresponding to the application type b in the above mapping relationship can be obtained by adjusting the device offline through the test network to obtain the application type a by training the network device as shown in Figure 7 or Figure 8. .
  • the adjustment device may determine the first application type according to the second application type of the first application and the mapping relationship A first congestion parameter corresponding to an application type. Afterwards, the adjustment device may update the mapping relationship according to the first congestion parameter corresponding to the first application type of the first application. For example, taking the first application as the King of Glory as an example, when the mapping relationship only includes the game application type, that is, does not include the King of Glory application type, the adjustment device can determine the King of Glory application according to the game application type and the mapping relationship. The first congestion parameter corresponding to the type.
  • the following specifically describes a process for the adjustment device to acquire the first congestion parameter corresponding to the first application type according to the second application type and the mapping relationship of the first application.
  • the adjustment device may determine the second application type of the first application according to the first application type of the first application. Afterwards, the adjustment device may acquire the second congestion parameter corresponding to the second application type of the first application according to the second application type of the first application and the mapping relationship. At this time, adjusting the second congestion parameter corresponding to the second application type of the first application obtained by the device can be understood as initializing the value of the first congestion parameter corresponding to the first application type of the first application, that is, the mapping The value of the second congestion parameter corresponding to the second application type of the first application included in the relationship is the initial value of the first congestion parameter corresponding to the first application type of the first application.
  • the adjustment device may use reinforcement learning to perform training based on the second congestion parameter corresponding to the second application type of the first application and the traffic data of the first application to obtain the first congestion corresponding to the first application type of the first application.
  • parameter For example, the adjustment device may obtain the second congestion control algorithm based on the second congestion parameter corresponding to the second application type of the first application, and may obtain the second congestion control algorithm corresponding to the congestion control of the traffic data of the first application based on the second congestion control algorithm.
  • the third transmission performance index is input into the objective function to obtain the third evaluation value.
  • the adjustment device may perform training based on the third evaluation value and the traffic data of the first application in a reinforcement learning manner to obtain the first congestion parameter corresponding to the first application type.
  • the process for the adjustment device to obtain the first congestion parameter corresponding to the first application type is similar, and the process for the network device to obtain the first congestion parameter corresponding to the first application type is similar.
  • steps S401-S411 shown in FIG. The related descriptions of steps S501-S511 shown in FIG. 8 will not be repeated here.
  • the adjustment device can obtain the first application in the manner shown in FIG. 7 or FIG. 8
  • the first congestion parameter corresponding to the first application type and/or the second congestion parameter corresponding to the second application type can refer to steps S401-S411 shown in FIG. 7 or steps S501-S511 shown in FIG. 8 . Relevant descriptions are not repeated here.
  • the first congestion parameter corresponding to the first application type of the first application may be It is obtained by training the adjustment device online in the manner shown in FIG. 7 or FIG. 8 , that is, the adjustment device is trained in the manner shown in FIG. 7 or FIG. 8 when the first application is used.
  • the adjustment device adopts the reinforcement learning method to perform training based on the requirements of the first application for transmission performance indicators and the traffic data of the first application obtained, it can be guaranteed that the first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application, and can effectively perform congestion control on the traffic data of the first application, and further,
  • the limited network bandwidth resources can be allocated on the basis of not affecting the user's experience of using the first application, which can improve the utilization rate of the network bandwidth resources.
  • the adjustment device may further acquire the first application type of the first application.
  • the network device sends the first application type of the first application identified by the identification device to the adjustment device.
  • the adjustment device may acquire the first application type of the first application.
  • the identification device is integrated on the network device
  • the adjustment device may acquire the first application type of the first application identified by the network device.
  • the adjustment device can identify the first application type of the first application. For the specific process of identifying the first application type of the first application, reference may be made to the process of identifying the first application type of the first application shown in the above S201, which will not be repeated here.
  • the adjustment device may adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator.
  • the adjustment device may acquire the requirements of the first application for the transmission performance index according to the first transmission performance index.
  • the specific implementation process for the adjustment device to acquire the requirements of the first application for transmission performance indicators is similar to the specific implementation process for the network device to acquire the requirements of the first application for transmission performance indicators. The relevant descriptions of the requirements of the transmission performance indicators will not be repeated here.
  • the adjustment device may adjust the first congestion parameter corresponding to the first application type of the first application based on the first application's requirement for the transmission performance indicator. For example, the adjustment device can evaluate the requirements of the first application on the transmission performance index by acquiring the objective function.
  • the objective function can be used to measure the effect of the first congestion control algorithm on the congestion control of the traffic data of the first application, that is, to measure whether the first congestion control algorithm can meet the requirements of the first application for transmission performance indicators.
  • the adjustment device may input the first transmission performance index into the objective function to obtain the first evaluation value.
  • the adjusting device may adjust the first congestion parameter based on the first evaluation value.
  • the process of adjusting the first congestion parameter by the adjusting device based on the first evaluation value is similar to the process of adjusting the first congestion parameter by the network device based on the first evaluation value.
  • steps S701-S710 shown in FIG. 10 or FIG. 11 refer to steps S801-S810 .
  • the adjustment device may adjust the first congestion parameter corresponding to the first application type of the first application, so that the network device can operate in different It can effectively control the congestion of the traffic data of the first application in the network environment of the first application. Furthermore, on the basis of not affecting the user's experience of using the first application, limited network bandwidth resources can be allocated, which can improve the utilization of network bandwidth resources. Rate.
  • the adjustment device may update the mapping relationship between the application type and the congestion parameter based on the adjusted first congestion parameter.
  • the adjustment device may also send the adjusted first congestion parameter to the network device, so that the network device can subsequently perform the first application traffic data based on the adjusted first congestion control algorithm obtained based on the adjusted first congestion parameter.
  • Congestion control so that the network device can effectively perform congestion control on the traffic data of the first application in different network environments, and further, can allocate a limited network on the basis of not affecting the user's experience of using the first application Bandwidth resources can improve the utilization of network bandwidth resources.
  • the network device or the adjustment device may perform some or all of the steps in the embodiments of the present application, these steps are only examples, and the embodiments of the present application may also perform other steps or variations of various steps. In addition, various steps may be performed in different orders presented in the embodiments of the present application, and it may not be necessary to perform all the steps in the embodiments of the present application.
  • the network device or the adjustment device includes corresponding hardware structures and/or software modules for executing each function.
  • the present application can be implemented in hardware or a combination of hardware and computer software with the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.
  • the network device or the adjustment device can be divided into functional modules according to the above method examples.
  • each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. It should be noted that, the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.
  • FIG. 13 shows a schematic structural diagram of a network device provided by an embodiment of the present application.
  • the network device 1000 may include: an obtaining unit 1001 and a processing unit 1002 .
  • the obtaining unit 1001 is configured to support the network device 1000 to obtain the first application type of the first application. Specifically, when the network device 1000 obtains the first application type of the first application from other devices, the obtaining unit 1001 may support communication between the network device and other devices, such as communication with the identification device.
  • the processing unit 1002 is used to control and manage the actions of the network device 1000, for example, the processing unit 1002 is used to support the network device 1000 to perform the processes shown in FIGS. other processes. Specifically, you can refer to the following description:
  • an obtaining unit 1001 configured to obtain a first application type of a first application
  • a processing unit 1002 configured to obtain, according to the first application type, a first congestion parameter corresponding to the first application type, where the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control algorithm for performing congestion control on the traffic data of the first application.
  • the processing unit 1002 may also be configured to: obtain the first congestion parameter based on the first congestion parameter. the first congestion control algorithm; and based on the first congestion control algorithm, congestion control is performed on the traffic data of the first application.
  • the processing unit 1002 may also be configured to: obtain a pair of data based on the first congestion control algorithm.
  • the processing unit 1002 when the processing unit 1002 is configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, the processing unit 1002 may be specifically configured to: according to the first The transmission performance indicator is to obtain the requirements of the first application for the transmission performance indicator; and the first congestion parameter is adjusted according to the requirements of the first application for the transmission performance indicator.
  • the processing unit 1002 is configured to adjust the first congestion parameter according to the requirements of the first application on the transmission performance indicator, which may be specifically used to: input the first transmission performance indicator into a target function to obtain a first evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index; and based on the first evaluation value, the first congestion parameter is adjusted.
  • the first transmission performance indicator may include at least two performance indicators, such as throughput and delay; the first application may perform at least one of the at least two performance indicators.
  • the processing unit 1002 may adjust the first congestion parameter in the following manner:
  • the first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
  • the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions.
  • a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than
  • the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value.
  • the second evaluation value return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction
  • the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  • the transmission performance indicator may include at least two performance indicators, such as throughput and delay; when the first application has low requirements for the at least two performance indicators, processing Unit 1002 may adjust the first congestion parameter in the following manner:
  • the first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
  • a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value.
  • the second evaluation value return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction
  • the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  • the first congestion parameter may include at least a first sub-parameter and a second sub-parameter; the multiple adjustment directions may include the following four adjustment directions, and the first adjustment direction may be the following Any one of four adjustment directions: increase the first sub-parameter and the second sub-parameter; increase the first sub-parameter, decrease the second sub-parameter; decrease the first sub-parameter sub-parameter, increase the second sub-parameter; decrease the first sub-parameter and the second sub-parameter.
  • the first congestion control algorithm may include a window-up algorithm and a window-down algorithm
  • the first sub-parameter may be a parameter corresponding to the window-up algorithm
  • the second sub-parameter may be Parameters corresponding to the window reduction algorithm.
  • the window raising algorithm is characterized as:
  • cwnd is used to represent the congestion window value
  • is the first sub-parameter
  • is the second sub-parameter
  • the processing unit 1002 when the processing unit 1002 is configured to acquire the first congestion parameter corresponding to the first application type according to the first application type, the processing unit 1002 may be configured to: acquire the mapping between the application type and the congestion parameter relationship; based on the mapping relationship and the first application type, obtain a first congestion parameter corresponding to the first application type.
  • the mapping relationship may be, but not limited to, stored in the local storage of the network device 1000, an external storage connected to the network device 1000, and the cloud.
  • the mapping relationship may include multiple application types and congestion parameters corresponding to the multiple application types; for any application type in the at least one application type in the mapping relationship, the processing unit 1002 may determine the congestion parameter corresponding to the application type in the following manner: obtain the initial congestion parameter corresponding to the application type, and obtain the initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type; The initial congestion control algorithm corresponding to the application type performs congestion control on the traffic data of at least one application corresponding to the application type, and obtains the initial transmission performance index corresponding to the at least one application; The initial transmission performance index is input into the objective function, and at least one initial evaluation value is obtained, and the objective function is used to evaluate the respective requirements of the at least one application on the transmission performance index; the reinforcement learning method is adopted based on the at least one initial evaluation value and all The traffic data of the at least one application is trained to obtain a congestion parameter corresponding to the application type.
  • the processing unit 1002 when configured to obtain the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type, it may be specifically configured to: if the mapping If the relationship does not include the first application type, then obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or, if the If the mapping relationship includes the first application type, the first congestion parameter corresponding to the first application type is acquired according to the first application type and the mapping relationship.
  • the processing unit 1002 when the processing unit 1002 is configured to obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship, the processing unit 1002 may specifically use In: obtaining a second congestion parameter corresponding to the second application type to which the first application type belongs, according to the second application type to which the first application type belongs and the mapping relationship, and obtaining the second congestion parameter based on the second congestion parameter Two congestion control algorithms; a third transmission performance index corresponding to when congestion control is performed on the traffic data of the first application based on the second congestion control algorithm; inputting the third performance index into an objective function to obtain a third evaluation value ; The objective function is used to evaluate the requirements of the first application to the transmission performance index; The reinforcement learning method is used to train based on the third evaluation value and the traffic data of the first application to obtain the first application type The corresponding first congestion parameter.
  • the processing unit 1002 may also be configured to: update the mapping relationship based on the adjusted first congestion parameter .
  • each module in the network device 1000 is respectively to implement the corresponding processes of the congestion control methods shown in FIGS.
  • FIG. 14 shows a schematic structural diagram of a network device provided by an embodiment of the present application.
  • the adjustment device 1100 may include: an acquisition unit 1101 and a processing unit 1102 .
  • the obtaining unit 1101 is configured to support the adjustment device 1100 to obtain the first application type of the first application. Specifically, when the adjustment device 1100 obtains the first application type of the first application from other devices, the obtaining unit 1101 may support communication between the adjustment device and other devices, such as communication with the identification device and/or the network device.
  • the processing unit 1102 is used to control and manage the actions of the adjustment device 1100. For example, the processing unit 1102 is used to support the adjustment device 1100 to perform the process shown in FIG. 12, and/or other processes for the techniques described herein. Specifically, you can refer to the following description:
  • An obtaining unit 1101 configured to obtain a first transmission performance indicator corresponding to when congestion control is performed on the traffic data of the first application based on the first congestion control algorithm;
  • a processing unit 1102 configured to adjust a first congestion parameter corresponding to a first application type of the first application according to the first transmission performance index, and the adjusted first congestion parameter is used to obtain an adjusted first congestion control algorithm , and the adjusted first congestion control algorithm is used to perform congestion control on the traffic data of the first application.
  • the processing unit 1102 when configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, it may be specifically configured to: according to the first The transmission performance indicator is to obtain the requirements of the first application for the transmission performance indicator; and the first congestion parameter is adjusted according to the requirements of the first application for the transmission performance indicator.
  • the processing unit 1102 when configured to adjust the first congestion parameter according to the requirements of the first application on the transmission performance indicator, it may be specifically configured to: input the first transmission performance indicator into a target function to obtain a first evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index; and based on the first evaluation value, the first congestion parameter is adjusted.
  • the first congestion control algorithm may include a window-up algorithm and a window-down algorithm
  • the first sub-parameter may be a parameter corresponding to the window-up algorithm
  • the second sub-parameter may be Parameters corresponding to the window reduction algorithm.
  • the window raising algorithm is characterized as:
  • cwnd is used to represent the congestion window value
  • is the first sub-parameter
  • is the second sub-parameter
  • the first transmission performance indicator may include at least two performance indicators, such as throughput and delay; the first application may perform at least one of the at least two performance indicators.
  • the processing unit 1102 may adjust the first congestion parameter in the following manner:
  • the first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
  • the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions.
  • a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than
  • the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value.
  • the second evaluation value return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction
  • the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  • the transmission performance indicator may include at least two performance indicators, such as throughput and delay; when the first application has low requirements for the at least two performance indicators, processing
  • the unit 1102 may adjust the first congestion parameter in the following manner, including:
  • the first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
  • a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value.
  • the second evaluation value return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction
  • the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  • the first congestion parameter includes at least a first sub-parameter and a second sub-parameter; the multiple adjustment directions include the following four adjustment directions, and the first adjustment direction is the following four adjustment directions any one of the directions: increase the first sub-parameter and the second sub-parameter; increase the first sub-parameter, decrease the second sub-parameter; decrease the first sub-parameter, Increase the second sub-parameter; decrease the first sub-parameter and the second sub-parameter.
  • the processing unit 1102 may also be configured to: obtain the application type and the congestion parameter A mapping relationship between parameters; based on the mapping relationship and the first application type, obtain a first congestion parameter corresponding to the first application type.
  • the mapping relationship may be, but not limited to, stored in the local memory of the adjustment device 1100, an external memory connected to the adjustment device 1100, other devices (eg, network devices) connected to the adjustment device 1100, and the cloud.
  • the mapping relationship may include multiple application types and congestion parameters corresponding to the multiple application types; for any application type in the at least one application type in the mapping relationship, the processing unit 1102 may determine the congestion parameter corresponding to the application type in the following manner: obtain the initial congestion parameter corresponding to the application type, and obtain the initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type; The initial congestion control algorithm corresponding to the application type performs congestion control on the traffic data of at least one application corresponding to the application type, and obtains the initial transmission performance index corresponding to the at least one application; The initial transmission performance index is input into the objective function, and at least one initial evaluation value is obtained, and the objective function is used to evaluate the respective requirements of the at least one application on the transmission performance index; the reinforcement learning method is adopted based on the at least one initial evaluation value and all The traffic data of the at least one application is trained to obtain a congestion parameter corresponding to the application type.
  • the processing unit 1102 when the processing unit 1102 is configured to acquire the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type, the processing unit 1102 may be specifically configured to: if the mapping If the relationship does not include the first application type, then obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or, if the If the mapping relationship includes the first application type, the first congestion parameter corresponding to the first application type is acquired according to the first application type and the mapping relationship.
  • the processing unit 1102 when the processing unit 1102 is configured to acquire the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship, the processing unit 1102 may specifically use In: obtaining a second congestion parameter corresponding to the second application type to which the first application type belongs, according to the second application type to which the first application type belongs and the mapping relationship, and obtaining the second congestion parameter based on the second congestion parameter Two congestion control algorithms; a third transmission performance index corresponding to when congestion control is performed on the traffic data of the first application based on the second congestion control algorithm; inputting the third performance index into an objective function to obtain a third evaluation value ; The objective function is used to evaluate the requirements of the first application to the transmission performance index; The reinforcement learning method is used to train based on the third evaluation value and the traffic data of the first application to obtain the first application type The corresponding first congestion parameter.
  • FIG. 15 shows a schematic structural diagram of a network device provided by an embodiment of the present application.
  • the network device 1200 may include at least one processor 1201 and a memory 1202 ; the memory 1202 stores one or more computer programs, such as for storing one or more computer programs necessary for the network device 1200 .
  • the at least one processor 1201 is configured to support the network device 1200 to implement the above congestion control method.
  • the network device 1200 may implement any of the possibilities shown in Figures 5-11, and/or be used to implement other embodiments described herein.
  • FIG. 16 shows a schematic structural diagram of an adjustment device provided by an embodiment of the present application.
  • the adjustment device 1300 may include at least one processor 1301 and a memory 1302 ; the memory 1302 stores one or more computer programs, for example, for storing one or more computer programs necessary for the adjustment device 1300 .
  • the at least one processor 1301 is configured to support the adjustment device 1300 to implement the above-mentioned congestion control method.
  • the adjustment device 1300 may implement any of the possibilities shown in FIG. 12, and/or be used to implement other embodiments described herein.
  • the embodiments of the present application further provide a computer-readable storage medium or a non-volatile storage medium, where the computer-readable storage medium or the non-volatile storage medium stores computer instructions or A computer program, when the computer instructions or computer programs are run on a computer, causing the computer to execute the above-mentioned embodiments of the congestion control method, any possible implementation of the embodiments, or when the computer instructions or computer programs are executed.
  • the network device or adjustment device including the one or more processors is made to execute the embodiments of the congestion control method and any possible implementation manners of the embodiments, such as the execution diagram of the 5—Any steps of the embodiments of the congestion control method shown in FIG. 11 or FIG. 12, and/or other processes that perform the techniques described herein.
  • the embodiments of the present application also provide a program product, the computer program product is used to store a computer program, and when the computer program runs on a computer, the computer is made to execute the above congestion Embodiments of the control method, any possible implementations of the embodiments, or when the computer instructions or computer programs run on one or more processors, make a network device including the one or more processors Or adjust the device to perform the above-mentioned embodiment of the congestion control method and any possible implementation manner of the embodiment, for example, perform any step of the embodiment of the congestion control method shown in FIG. 5-FIG. 11 or FIG. 12 , and/or perform Other procedures for the techniques described herein.
  • the processor in the embodiment of the present application may be an integrated circuit chip, which has the capability of processing signals.
  • each step of the above-mentioned embodiment of the congestion control method may be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software.
  • the above-mentioned processor can be a general-purpose central processing unit (central processing unit, CPU), a general-purpose processor, a digital signal processing (digital signal processing, DSP), an application specific integrated circuit (application specific integrated circuits, ASIC), a field programmable gate array (field programmable gate array, FPGA) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof; it may also be a combination that implements computing functions, such as a combination of one or more microprocessors, DSP and microprocessor combination of devices, etc.
  • a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
  • the memory in this embodiment of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory .
  • the non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically programmable Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory.
  • Volatile memory may be random access memory (RAM), which acts as an external cache.
  • RAM random access memory
  • DRAM dynamic random access memory
  • SDRAM synchronous DRAM
  • SDRAM double data rate synchronous dynamic random access memory
  • ESDRAM enhanced synchronous dynamic random access memory
  • SLDRAM synchronous link dynamic random access memory
  • direct rambus RAM direct rambus RAM
  • a general-purpose processor may be a microprocessor, or alternatively, the general-purpose processor may be any conventional processor, controller, microcontroller, or state machine.
  • a processor may also be implemented by a combination of computing devices, such as a digital signal processor and a microprocessor, multiple microprocessors, one or more microprocessors in combination with a digital signal processor core, or any other similar configuration. accomplish.
  • the steps of the method or algorithm described in the embodiments of this application may be directly embedded in hardware, a software unit executed by a processor, or a combination of the two.
  • the software unit may be stored in RAM, flash memory, ROM, EPROM, EEPROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.
  • a storage medium may be coupled to the processor such that the processor may read information from, and store information in, the storage medium.
  • the storage medium can also be integrated into the processor.
  • the processor and the storage medium may be provided in an ASIC, which may be provided in the network device or the adjustment device, for example, in different components of the network device or the adjustment device.
  • the computer program product includes one or more computer programs or instructions.
  • the computer may be a general purpose computer, special purpose computer, computer network, or other programmable device.
  • the computer program or instructions may be stored in or transmitted over a computer-readable storage medium.
  • the computer-readable storage medium can be any available media that can be accessed by a computer or a data storage device such as a server that integrates one or more available media.
  • the usable media may be magnetic media, such as floppy disks, hard disks, magnetic tapes; optical media, such as DVDs; and semiconductor media, such as solid state disks (SSD).
  • These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions
  • the apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

Provided in the present application are a congestion control method and a corresponding device, which are used to effectively carry out congestion control on traffic data of different applications, and can improve the utilization rate of network bandwidth resources on the basis of not affecting the experience of a user using the applications. The method may comprise: obtaining a first application type of a first application; further, according to the first application type, obtaining a first congestion parameter corresponding to the first application type, the first congestion parameter being used for obtaining a first congestion control algorithm, and the first congestion control algorithm being used for performing congestion control on traffic data of the first application.

Description

一种拥塞控制方法及相应设备Congestion control method and corresponding device
相关申请的交叉引用CROSS-REFERENCE TO RELATED APPLICATIONS
本申请要求在2020年06月30日提交中国专利局、申请号为202010630381.7、申请名称为“一种拥塞控制方法及相应设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number 202010630381.7 and the application title "A Congestion Control Method and Corresponding Device" filed with the China Patent Office on June 30, 2020, the entire contents of which are incorporated herein by reference middle.
技术领域technical field
本申请涉及计算机网络技术领域,尤其涉及一种拥塞控制方法及相应设备。The present application relates to the technical field of computer networks, and in particular, to a congestion control method and corresponding device.
背景技术Background technique
传输控制协议(transmission control protocol,TCP)作为网络中使用最广泛的传输协议,它可以提供面向连接、可靠的数据传输服务,而TCP拥塞控制机制又是TCP的核心。Transmission Control Protocol (TCP), as the most widely used transmission protocol in the network, can provide connection-oriented and reliable data transmission services, and the TCP congestion control mechanism is the core of TCP.
目前广泛使用的TCP拥塞控制算法仍然使用相对固定的窗口调节策略。然而,由于不同业务对传输性能指标的要求不同,例如有些应用对传输性能指标的要求较高,而有些应用对传输性能指标的要求较低,当TCP拥塞控制算法使用相对固定的窗口调节策略时,无法根据动态变化的网络业务自适应地调整拥塞参数,难以满足不同应用各自对传输性能指标的要求,无法有效的对不同应用的流量数据进行拥塞控制,导致在影响用户体验的同时造成不可避免的网络资源浪费。The currently widely used TCP congestion control algorithm still uses a relatively fixed window adjustment strategy. However, because different services have different requirements on transmission performance indicators, for example, some applications have higher requirements on transmission performance indicators, while some applications have lower requirements on transmission performance indicators, when the TCP congestion control algorithm uses a relatively fixed window adjustment strategy , it is impossible to adaptively adjust the congestion parameters according to the dynamically changing network services, it is difficult to meet the respective requirements of different applications for transmission performance indicators, and it is impossible to effectively control the congestion of the traffic data of different applications, which will affect the user experience and cause inevitable consequences. waste of network resources.
发明内容SUMMARY OF THE INVENTION
本申请实施例提供一种拥塞控制方法及相应设备,用于有效的对不同应用的流量数据进行拥塞控制,可以在不影响用户使用应用的体验基础上,提高网络带宽资源的利用率。The embodiments of the present application provide a congestion control method and a corresponding device, which are used to effectively perform congestion control on traffic data of different applications, which can improve the utilization rate of network bandwidth resources without affecting the user experience of using applications.
第一方面,本申请实施例提供一种拥塞控制方法,所述方法包括:获取第一应用的第一应用类型;进一步的,根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,所述第一拥塞参数用于得到第一拥塞控制算法,所述第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。In a first aspect, an embodiment of the present application provides a congestion control method, the method includes: obtaining a first application type of a first application; further, according to the first application type, obtaining a corresponding a first congestion parameter, where the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control algorithm is used to perform congestion control on the traffic data of the first application.
采用上述设计,由于第一拥塞参数是基于第一应用的第一应用类型来确定的,从而可以保障基于第一拥塞参数获取到的第一拥塞控制算法,是适合用于对第一应用的流量数据进行拥塞控制的,从而可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。With the above design, since the first congestion parameter is determined based on the first application type of the first application, it can be ensured that the first congestion control algorithm obtained based on the first congestion parameter is suitable for the traffic of the first application Congestion control is performed on the data, so that the traffic data of the first application can be effectively controlled. Furthermore, limited network bandwidth resources can be allocated on the basis of not affecting the user's experience of using the first application, which can improve network performance. Utilization of bandwidth resources.
在一种可能的设计中,根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数之后,还包括:基于所述第一拥塞参数获取所述第一拥塞控制算法;基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制。In a possible design, after acquiring the first congestion parameter corresponding to the first application type according to the first application type, the method further includes: acquiring the first congestion control algorithm based on the first congestion parameter; Congestion control is performed on the traffic data of the first application based on the first congestion control algorithm.
在一种可能的设计中,基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制之后,还包括:获取基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;根据所述第一传输性能指标,调整所述第一拥塞参数。In a possible design, after performing congestion control on the traffic data of the first application based on the first congestion control algorithm, the method further includes: acquiring the traffic of the first application based on the first congestion control algorithm The first transmission performance index corresponding to the data when congestion control is performed; the first congestion parameter is adjusted according to the first transmission performance index.
采用上述设计,通过基于第一应用的流量数据对应的第一传输性能指标,调整第一应用类型对应的第一拥塞参数,可以在不同的网络环境下有效的对第一应用进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。With the above design, by adjusting the first congestion parameter corresponding to the first application type based on the first transmission performance index corresponding to the traffic data of the first application, it is possible to effectively control the congestion of the first application in different network environments, and further Yes, the limited network bandwidth resources can be allocated without affecting the user's experience of using the first application, which can improve the utilization rate of the network bandwidth resources.
在一种可能的设计中,根据所述第一传输性能指标,调整所述第一拥塞参数,包括:根据所述第一传输性能指标,获取所述第一应用对传输性能指标的要求;根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数。In a possible design, adjusting the first congestion parameter according to the first transmission performance index includes: obtaining, according to the first transmission performance index, a requirement of the first application for the transmission performance index; The first congestion parameter is adjusted according to the requirements of the first application for transmission performance indicators.
采用上述设计,由于第一应用类型对应的第一拥塞参数,是基于第一应用对传输性能指标的要求进行调整的,使得基于调整后的第一拥塞参数获取到的调整后的第一拥塞控制算法对第一应用的流量数据进行拥塞控制时,可以满足第一应用对传输性能指标的要求,从而可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。With the above design, since the first congestion parameter corresponding to the first application type is adjusted based on the requirements of the first application on the transmission performance index, the adjusted first congestion control obtained based on the adjusted first congestion parameter When the algorithm performs congestion control on the traffic data of the first application, it can meet the requirements of the first application for transmission performance indicators, so that it can effectively perform congestion control on the traffic data of the first application. Based on the experience of an application, allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
在一种可能的设计中,根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数,包括:将所述第一传输性能指标输入目标函数,得到第一评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;基于所述第一评估值,调整所述第一拥塞参数。In a possible design, adjusting the first congestion parameter according to the requirements of the first application on the transmission performance index includes: inputting the first transmission performance index into an objective function to obtain a first evaluation value; The objective function is used to evaluate the requirements of the first application on the transmission performance index; based on the first evaluation value, the first congestion parameter is adjusted.
采用上述设计,由于目标函数可以用于评估第一应用对传输性能指标的要求,当基于目标函数和第一传输性能指标,调整第一应用类型对应的第一拥塞参数时,可以使得基于调整后的第一拥塞参数获取到的调整后的第一拥塞控制算法对第一应用的流量数据进行拥塞控制时,可以满足第一应用对传输性能指标的要求,从而可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。With the above design, since the objective function can be used to evaluate the requirements of the first application on the transmission performance index, when the first congestion parameter corresponding to the first application type is adjusted based on the objective function and the first transmission performance index, the adjusted When the adjusted first congestion control algorithm obtained from the first congestion parameter of the first application performs congestion control on the traffic data of the first application, it can meet the requirements of the first application for transmission performance indicators, so that the traffic of the first application can be effectively controlled. Data congestion control is performed, and further, limited network bandwidth resources can be allocated without affecting the user's experience of using the first application, which can improve the utilization rate of network bandwidth resources.
在一种可能的设计中,所述第一传输性能指标可以包括至少两个性能指标,例如可以包括吞吐率和时延;所述第一应用对所述至少两个性能指标中的至少一个性能指标为高要求时,可以采用以下方式调整所述第一拥塞参数:按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;将所述第二传输性能指标输入所述目标函数,得到第二评估值;In a possible design, the first transmission performance indicator may include at least two performance indicators, such as throughput and delay; the first application may perform at least one of the at least two performance indicators. When the index is of high requirement, the first congestion parameter may be adjusted in the following manner: adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter; The first congestion parameter obtains the adjusted first congestion control algorithm; performs congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm, and obtains the first congestion control algorithm based on the adjusted first congestion control algorithm. a second transmission performance index corresponding to the traffic data of the first application when congestion control is performed; inputting the second transmission performance index into the objective function to obtain a second evaluation value;
若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值大于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最大的第二评估值对应的调整方向,将所述第一评估值替换为所述最大 的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均小于所述第一评估值时,则确定所述第一评估值为所述目标函数的最大评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than When the first evaluation value is used, the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
采用上述设计,由于第一应用的第一应用类型对应的第一拥塞参数,是采用强化学习方式,基于第一应用对传输性能指标的要求和第一应用的流量数据进行训练得到的,可以保障基于第一拥塞参数获取到的第一拥塞控制算法,适用于对第一应用的流量数据进行拥塞控制,可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。With the above design, since the first congestion parameter corresponding to the first application type of the first application is obtained through reinforcement learning, based on the requirements of the first application for transmission performance indicators and the traffic data of the first application, it can be guaranteed that The first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application, and can effectively perform congestion control on the traffic data of the first application. Based on the experience of the first application, allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
在一种可能的设计中,所述传输性能指标可以包括至少两个性能指标,例如可以包括吞吐率和时延;所述第一应用对所述至少两个性能指标均为低要求时,可以采用以下方式调整所述第一拥塞参数包括:按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;将所述第二传输性能指标输入所述目标函数,得到第二评估值;In a possible design, the transmission performance indicator may include at least two performance indicators, such as throughput rate and delay; when the first application has low requirements for the at least two performance indicators, it may include Adjusting the first congestion parameter in the following manner includes: adjusting the first congestion parameter according to a first adjustment direction among a plurality of adjustment directions to obtain an adjusted first congestion parameter; obtaining an adjustment based on the adjusted first congestion parameter performing congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm, and obtaining the traffic data of the first application based on the adjusted first congestion control algorithm a second transmission performance index corresponding to the congestion control; inputting the second transmission performance index into the objective function to obtain a second evaluation value;
若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值小于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最小的第二评估值对应的调整方向,将所述第一评估值替换为所述最小的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均大于所述第一评估值时,则确定所述第一评估值为所述目标函数的最小评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
采用上述设计,由于第一应用的第一应用类型对应的第一拥塞参数,是采用强化学习方式,基于第一应用对传输性能指标的要求和第一应用的流量数据进行训练得到的,可以保障基于第一拥塞参数获取到的第一拥塞控制算法,适用于对第一应用的流量数据进行拥塞控制,可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。With the above design, since the first congestion parameter corresponding to the first application type of the first application is obtained through reinforcement learning, based on the requirements of the first application for transmission performance indicators and the traffic data of the first application, it can be guaranteed that The first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application, and can effectively perform congestion control on the traffic data of the first application. Based on the experience of the first application, allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
在一种可能的设计中,所述第一拥塞参数可以至少包括第一子参数和第二子参数;所述多个调整方向可以包括以下四个调整方向,所述第一调整方向可以为以下四个调整方向中的任意一种:增大所述第一子参数和所述第二子参数;增大所述第一子参数,减小所述 第二子参数;减小所述第一子参数,增大所述第二子参数;减小所述第一子参数和所述第二子参数。In a possible design, the first congestion parameter may include at least a first sub-parameter and a second sub-parameter; the multiple adjustment directions may include the following four adjustment directions, and the first adjustment direction may be the following Any one of four adjustment directions: increase the first sub-parameter and the second sub-parameter; increase the first sub-parameter, decrease the second sub-parameter; decrease the first sub-parameter sub-parameter, increase the second sub-parameter; decrease the first sub-parameter and the second sub-parameter.
在一种可能的设计中,所述第一拥塞控制算法包括升窗算法和降窗算法,所述第一子参数为所述升窗算法对应的参数,所述第二子参数为所述降窗算法对应的参数。具体的,所述升窗算法表征为:In a possible design, the first congestion control algorithm includes a window-up algorithm and a window-down algorithm, the first sub-parameter is a parameter corresponding to the window-up algorithm, and the second sub-parameter is the window-down algorithm The parameters corresponding to the window algorithm. Specifically, the window raising algorithm is characterized as:
Figure PCTCN2021082120-appb-000001
Figure PCTCN2021082120-appb-000001
所述降窗算法表征为:The window reduction algorithm is characterized as:
cwnd=cwnd(1-β)cwnd=cwnd(1-β)
其中,cwnd用于表示拥塞窗口值,α为所述第一子参数,β为所述第二子参数。Wherein, cwnd is used to represent the congestion window value, α is the first sub-parameter, and β is the second sub-parameter.
在一种可能的设计中,根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,包括:获取应用类型与拥塞参数之间的映射关系;基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数。其中,所述映射关系可以但不限于存储于网络设备的本地存储器、与网络设备连接的外部存储器、云端。In a possible design, acquiring the first congestion parameter corresponding to the first application type according to the first application type includes: acquiring a mapping relationship between the application type and the congestion parameter; based on the mapping relationship and For the first application type, obtain a first congestion parameter corresponding to the first application type. Wherein, the mapping relationship may be stored in, but not limited to, a local storage of the network device, an external storage connected to the network device, and the cloud.
在一种可能的设计中,所述映射关系可以包括多个应用类型和所述多个应用类型对应的拥塞参数;对于所述映射关系中的至少一个应用类型中的任一应用类型,可以采用以下方式确定所述应用类型对应的拥塞参数:获取所述应用类型对应的初始拥塞参数,基于所述应用类型对应的初始拥塞参数,获取所述应用类型对应的初始拥塞控制算法;基于所述应用类型对应的初始拥塞控制算法,对所述应用类型对应的至少一个应用的流量数据进行拥塞控制,获得所述至少一个应用各自对应的初始传输性能指标;将所述至少一个应用各自对应的初始传输性能指标输入目标函数,得到至少一个初始评估值,所述目标函数用于评估所述至少一个应用各自对传输性能指标的要求;采用强化学习方式基于所述至少一个初始评估值和所述至少一个应用各自的流量数据进行训练,得到所述应用类型对应的拥塞参数。In a possible design, the mapping relationship may include multiple application types and congestion parameters corresponding to the multiple application types; for any application type in at least one application type in the mapping relationship, the The congestion parameter corresponding to the application type is determined in the following manner: obtaining the initial congestion parameter corresponding to the application type, and obtaining the initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type; The initial congestion control algorithm corresponding to the type, performs congestion control on the traffic data of at least one application corresponding to the application type, and obtains the initial transmission performance index corresponding to the at least one application; The performance indicator is input into an objective function to obtain at least one initial evaluation value, and the objective function is used to evaluate the respective requirements of the at least one application for the transmission performance indicator; a reinforcement learning method is adopted based on the at least one initial evaluation value and the at least one The respective traffic data is used for training to obtain the congestion parameter corresponding to the application type.
在一种可能的设计中,基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,包括:若所述映射关系中不包括所述第一应用类型,则根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数;或者,若所述映射关系中包括所述第一应用类型,则根据所述第一应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数。In a possible design, acquiring the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type includes: if the mapping relationship does not include the first application type, obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or, if the mapping relationship includes the first application type, the first congestion parameter corresponding to the first application type is acquired according to the first application type and the mapping relationship.
采用上述设计,通过映射关系可以获取第一应用的第二应用类型对应的第二拥塞参数,从而可以根据第一应的第二应用类型对应的第二拥塞参数,获取第一应用的第一应用类型,从而可以保障基于第一拥塞参数获取到的第一拥塞控制算法,适用于对第一应用的流量数据进行拥塞控制。With the above design, the second congestion parameter corresponding to the second application type of the first application can be obtained through the mapping relationship, so that the first application of the first application can be obtained according to the second congestion parameter corresponding to the second application type of the first application type, thereby ensuring that the first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application.
在一种可能的设计中,根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数,包括:根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型所属的第二应用类型对应的第二拥塞参数,基于所述第二拥塞参数获取第二拥塞控制算法;获取基于所述第二拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第三传输性能指标;将所述第三性能指标输入目标函数,得到第三评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;采用强化学习方式基于所述第三评估值和所述第一应用的流量数据进行训练,得到所述第 一应用类型对应的第一拥塞参数。In a possible design, acquiring the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship includes: according to the first application type the second application type to which the first application type belongs and the mapping relationship, obtain a second congestion parameter corresponding to the second application type to which the first application type belongs, and obtain a second congestion control algorithm based on the second congestion parameter; The third transmission performance index corresponding to when the second congestion control algorithm performs congestion control on the traffic data of the first application; the third performance index is input into an objective function to obtain a third evaluation value; the objective function is used to evaluate The requirements of the first application for transmission performance indicators; the reinforcement learning method is used to perform training based on the third evaluation value and the traffic data of the first application to obtain a first congestion parameter corresponding to the first application type.
采用上述设计,由于第一应用的第一应用类型对应的第一拥塞参数,是采用强化学习方式,基于第一应用的第二应用类型对应的第二拥塞参数和第一应用的流量数据进行训练得到的,可以保障基于第一拥塞参数获取到的第一拥塞控制算法,适用于对第一应用的流量数据进行拥塞控制。With the above design, since the first congestion parameter corresponding to the first application type of the first application adopts the reinforcement learning method, training is performed based on the second congestion parameter corresponding to the second application type of the first application and the traffic data of the first application obtained, it can be guaranteed that the first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application.
在一种可能的设计中,根据所述第一传输性能指标,调整所述第一拥塞参数之后,还包括:基于调整后的第一拥塞参数,更新所述映射关系。In a possible design, after adjusting the first congestion parameter according to the first transmission performance index, the method further includes: updating the mapping relationship based on the adjusted first congestion parameter.
第二方面,本申请实施例提供一种拥塞控制方法,所述方法包括:获取基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;进一步的,根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数,调整后的第一拥塞参数用于得到调整后的第一拥塞控制算法,调整后的第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。In a second aspect, an embodiment of the present application provides a congestion control method, the method includes: acquiring a first transmission performance indicator corresponding to the congestion control of traffic data of a first application based on a first congestion control algorithm; further, according to The first transmission performance indicator adjusts the first congestion parameter corresponding to the first application type of the first application, the adjusted first congestion parameter is used to obtain an adjusted first congestion control algorithm, and the adjusted first congestion The control algorithm is used to perform congestion control on the traffic data of the first application.
采用上述设计,由于第一应用类型对应的第一拥塞参数,是基于第一应用的流量数据对应的第一传输性能指标进行调整的,可以在不同的网络环境下有效的对第一应用进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。With the above design, since the first congestion parameter corresponding to the first application type is adjusted based on the first transmission performance index corresponding to the traffic data of the first application, the first application can be effectively congested under different network environments Control, further, on the basis of not affecting the user's experience of using the first application, the limited network bandwidth resources can be allocated, which can improve the utilization rate of the network bandwidth resources.
在一种可能的设计中,根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数,包括:根据所述第一传输性能指标,获取所述第一应用对传输性能指标的要求;根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数。In a possible design, adjusting the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator includes: obtaining the first congestion parameter according to the first transmission performance indicator Applying requirements for transmission performance indicators; adjusting the first congestion parameter according to the requirements of the first application for transmission performance indicators.
采用上述设计,由于第一应用类型对应的第一拥塞参数,是基于第一应用对传输性能指标的要求进行调整的,使得基于调整后的第一拥塞参数获取到的调整后的第一拥塞控制算法对第一应用的流量数据进行拥塞控制时,可以满足第一应用对传输性能指标的要求,从而可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。With the above design, since the first congestion parameter corresponding to the first application type is adjusted based on the requirements of the first application on the transmission performance index, the adjusted first congestion control obtained based on the adjusted first congestion parameter When the algorithm performs congestion control on the traffic data of the first application, it can meet the requirements of the first application for transmission performance indicators, so that it can effectively perform congestion control on the traffic data of the first application. Based on the experience of an application, allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
在一种可能的设计中,根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数,包括:将所述第一传输性能指标输入目标函数,得到第一评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;基于所述第一评估值,调整所述第一拥塞参数。In a possible design, adjusting the first congestion parameter according to the requirements of the first application on the transmission performance index includes: inputting the first transmission performance index into an objective function to obtain a first evaluation value; The objective function is used to evaluate the requirements of the first application on the transmission performance index; based on the first evaluation value, the first congestion parameter is adjusted.
采用上述设计,由于目标函数可以用于评估第一应用对传输性能指标的要求,当基于目标函数和第一传输性能指标,调整第一应用类型对应的第一拥塞参数时,可以使得基于调整后的第一拥塞参数获取到的调整后的第一拥塞控制算法对第一应用的流量数据进行拥塞控制时,可以满足第一应用对传输性能指标的要求,从而可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。With the above design, since the objective function can be used to evaluate the requirements of the first application on the transmission performance index, when the first congestion parameter corresponding to the first application type is adjusted based on the objective function and the first transmission performance index, the adjusted When the adjusted first congestion control algorithm obtained from the first congestion parameter of the first application performs congestion control on the traffic data of the first application, it can meet the requirements of the first application for transmission performance indicators, so that the traffic of the first application can be effectively controlled. Data congestion control is performed, and further, limited network bandwidth resources can be allocated without affecting the user's experience of using the first application, which can improve the utilization rate of network bandwidth resources.
在一种可能的设计中,所述第一拥塞控制算法可以包括升窗算法和降窗算法,所述第一子参数可以为所述升窗算法对应的参数,所述第二子参数可以为所述降窗算法对应的参数。具体的,所述升窗算法表征为:In a possible design, the first congestion control algorithm may include a window-up algorithm and a window-down algorithm, the first sub-parameter may be a parameter corresponding to the window-up algorithm, and the second sub-parameter may be Parameters corresponding to the window reduction algorithm. Specifically, the window raising algorithm is characterized as:
Figure PCTCN2021082120-appb-000002
Figure PCTCN2021082120-appb-000002
所述降窗算法表征为:The window reduction algorithm is characterized as:
cwnd=cwnd(1-β)cwnd=cwnd(1-β)
其中,cwnd用于表示拥塞窗口值,α为所述第一子参数,β为所述第二子参数。Wherein, cwnd is used to represent the congestion window value, α is the first sub-parameter, and β is the second sub-parameter.
在一种可能的设计中,所述第一传输性能指标可以包括至少两个性能指标,例如可以包括吞吐率和时延;所述第一应用对所述至少两个性能指标中的至少一个性能指标为高要求时,可以采用以下方式调整所述第一拥塞参数:In a possible design, the first transmission performance indicator may include at least two performance indicators, such as throughput and delay; the first application may perform at least one of the at least two performance indicators. When the index is high, the first congestion parameter can be adjusted in the following manner:
按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;将所述第二传输性能指标输入所述目标函数,得到第二评估值;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter; obtain the adjusted first congestion control algorithm based on the adjusted first congestion parameter; The first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值大于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最大的第二评估值对应的调整方向,将所述第一评估值替换为所述最大的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均小于所述第一评估值时,则确定所述第一评估值为所述目标函数的最大评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than When the first evaluation value is used, the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
采用上述设计,由于第一应用的第一应用类型对应的第一拥塞参数,是采用强化学习方式,基于第一应用对传输性能指标的要求和第一应用的流量数据进行训练得到的,可以保障基于第一拥塞参数获取到的第一拥塞控制算法,适用于对第一应用的流量数据进行拥塞控制,可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。With the above design, since the first congestion parameter corresponding to the first application type of the first application is obtained through reinforcement learning, based on the requirements of the first application for transmission performance indicators and the traffic data of the first application, it can be guaranteed that The first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application, and can effectively perform congestion control on the traffic data of the first application. Based on the experience of the first application, allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
在一种可能的设计中,所述传输性能指标可以包括至少两个性能指标,例如可以包括吞吐率和时延;所述第一应用对所述至少两个性能指标均为低要求时,可以采用以下方式调整所述第一拥塞参数包括:In a possible design, the transmission performance indicator may include at least two performance indicators, such as throughput rate and delay; when the first application has low requirements for the at least two performance indicators, it may include Adjusting the first congestion parameter in the following manner includes:
按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;将所述第二传输性能指标输入所述目标函数,得到第二评估值;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter; obtain the adjusted first congestion control algorithm based on the adjusted first congestion parameter; The first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第 一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值小于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最小的第二评估值对应的调整方向,将所述第一评估值替换为所述最小的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均大于所述第一评估值时,则确定所述第一评估值为所述目标函数的最小评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
采用上述设计,由于第一应用的第一应用类型对应的第一拥塞参数,是采用强化学习方式,基于第一应用对传输性能指标的要求和第一应用的流量数据进行训练得到的,可以保障基于第一拥塞参数获取到的第一拥塞控制算法,适用于对第一应用的流量数据进行拥塞控制,可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。With the above design, since the first congestion parameter corresponding to the first application type of the first application is obtained through reinforcement learning, based on the requirements of the first application for transmission performance indicators and the traffic data of the first application, it can be guaranteed that The first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application, and can effectively perform congestion control on the traffic data of the first application. Based on the experience of the first application, allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
在一种的可能设计中,所述第一拥塞参数可以至少包括第一子参数和第二子参数;所述多个调整方向可以包括以下四个调整方向,所述第一调整方向可以为以下四个调整方向中的任意一种:增大所述第一子参数和所述第二子参数;增大所述第一子参数,减小所述第二子参数;减小所述第一子参数,增大所述第二子参数;减小所述第一子参数和所述第二子参数。In a possible design, the first congestion parameter may include at least a first sub-parameter and a second sub-parameter; the multiple adjustment directions may include the following four adjustment directions, and the first adjustment direction may be the following Any one of four adjustment directions: increase the first sub-parameter and the second sub-parameter; increase the first sub-parameter, decrease the second sub-parameter; decrease the first sub-parameter sub-parameter, increase the second sub-parameter; decrease the first sub-parameter and the second sub-parameter.
在一种可能的设计中,根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数之前,还可以包括:获取应用类型与拥塞参数之间的映射关系;基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数。其中,所述映射关系可以但不限于存储于调整设备的本地存储器、与调整设备连接的外部存储器、与调整设备连接的其他设备(如网络设备)、云端。In a possible design, before adjusting the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, the method may further include: acquiring a mapping relationship between the application type and the congestion parameter ; based on the mapping relationship and the first application type, obtain a first congestion parameter corresponding to the first application type. Wherein, the mapping relationship may be stored in, but not limited to, the local memory of the adjustment device, an external memory connected to the adjustment device, other devices (eg, network devices) connected to the adjustment device, and the cloud.
在一种可能的设计中,所述映射关系可以包括多个应用类型和所述多个应用类型对应的拥塞参数;对于所述映射关系中的至少一个应用类型中的任一应用类型,可以采用以下方式确定所述应用类型对应的拥塞参数:获取所述应用类型对应的初始拥塞参数,基于所述应用类型对应的初始拥塞参数,获取所述应用类型对应的初始拥塞控制算法;基于所述应用类型对应的初始拥塞控制算法,对所述应用类型对应的至少一个应用的流量数据进行拥塞控制,获得所述至少一个应用各自对应的初始传输性能指标;将所述至少一个应用各自对应的初始传输性能指标输入目标函数,得到至少一个初始评估值,所述目标函数用于评估所述至少一个应用各自对传输性能指标的要求;采用强化学习方式基于所述至少一个初始评估值和所述至少一个应用各自的流量数据进行训练,得到所述应用类型对应的拥塞参数。In a possible design, the mapping relationship may include multiple application types and congestion parameters corresponding to the multiple application types; for any application type in at least one application type in the mapping relationship, the The congestion parameter corresponding to the application type is determined in the following manner: obtaining the initial congestion parameter corresponding to the application type, and obtaining the initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type; The initial congestion control algorithm corresponding to the type, performs congestion control on the traffic data of at least one application corresponding to the application type, and obtains the initial transmission performance index corresponding to the at least one application; The performance indicator is input into an objective function to obtain at least one initial evaluation value, and the objective function is used to evaluate the respective requirements of the at least one application for the transmission performance indicator; a reinforcement learning method is adopted based on the at least one initial evaluation value and the at least one The respective traffic data is used for training to obtain the congestion parameter corresponding to the application type.
在一种可能的设计中,基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,包括:若所述映射关系中不包括所述第一应用类型,则根据所述 第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数;或者,若所述映射关系中包括所述第一应用类型,则根据所述第一应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数。In a possible design, acquiring the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type includes: if the mapping relationship does not include the first application type, obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or, if the mapping relationship includes the first application type, the first congestion parameter corresponding to the first application type is acquired according to the first application type and the mapping relationship.
采用上述设计,通过映射关系可以获取第一应用的第二应用类型对应的第二拥塞参数,从而可以根据第一应的第二应用类型对应的第二拥塞参数,获取第一应用的第一应用类型,从而可以保障基于第一拥塞参数获取到的第一拥塞控制算法,适用于对第一应用的流量数据进行拥塞控制。With the above design, the second congestion parameter corresponding to the second application type of the first application can be obtained through the mapping relationship, so that the first application of the first application can be obtained according to the second congestion parameter corresponding to the second application type of the first application type, thereby ensuring that the first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application.
在一种可能的设计中,根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数,包括:根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型所属的第二应用类型对应的第二拥塞参数,基于所述第二拥塞参数获取第二拥塞控制算法;基于所述第二拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第三传输性能指标;将所述第三性能指标输入目标函数,得到第三评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;采用强化学习方式基于所述第三评估值和所述第一应用的流量数据进行训练,得到所述第一应用类型对应的第一拥塞参数。In a possible design, acquiring the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship includes: according to the first application type the second application type to which the first application type belongs and the mapping relationship, obtain a second congestion parameter corresponding to the second application type to which the first application type belongs, and obtain a second congestion control algorithm based on the second congestion parameter; 2. The third transmission performance index corresponding to when the congestion control algorithm performs congestion control on the traffic data of the first application; the third performance index is input into an objective function to obtain a third evaluation value; the objective function is used to evaluate all The requirements of the first application on the transmission performance index; the reinforcement learning method is used to perform training based on the third evaluation value and the traffic data of the first application to obtain a first congestion parameter corresponding to the first application type.
采用上述设计,由于第一应用的第一应用类型对应的第一拥塞参数,是采用强化学习方式,基于第一应用的第二应用类型对应的第二拥塞参数和第一应用的流量数据进行训练得到的,可以保障基于第一拥塞参数获取到的第一拥塞控制算法,适用于对第一应用的流量数据进行拥塞控制。With the above design, since the first congestion parameter corresponding to the first application type of the first application adopts the reinforcement learning method, training is performed based on the second congestion parameter corresponding to the second application type of the first application and the traffic data of the first application obtained, it can be guaranteed that the first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application.
第三方面,本申请实施例提供一种网络设备,包括:In a third aspect, an embodiment of the present application provides a network device, including:
所述获取单元,用于获取第一应用的第一应用类型;the obtaining unit, configured to obtain the first application type of the first application;
所述处理单元,用于根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,所述第一拥塞参数用于得到第一拥塞控制算法,所述第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。The processing unit is configured to obtain, according to the first application type, a first congestion parameter corresponding to the first application type, where the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control The algorithm is used to perform congestion control on the traffic data of the first application.
在一种可能的设计中,所述处理单元用于根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数之后,还可以用于:基于所述第一拥塞参数获取所述第一拥塞控制算法;基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制。In a possible design, after the processing unit is configured to acquire the first congestion parameter corresponding to the first application type according to the first application type, the processing unit may be further configured to: acquire based on the first congestion parameter the first congestion control algorithm; and performing congestion control on the traffic data of the first application based on the first congestion control algorithm.
在一种可能的设计中,所述处理单元用于基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制之后,还可以用于:获取基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;根据所述第一传输性能指标,调整所述第一拥塞参数。In a possible design, after the processing unit is configured to perform congestion control on the traffic data of the first application based on the first congestion control algorithm, the processing unit may be further configured to: obtain information based on the first congestion control algorithm The first transmission performance index corresponding to the congestion control is performed on the traffic data of the first application; and the first congestion parameter is adjusted according to the first transmission performance index.
在一种可能设计中,所述处理单元用于根据所述第一传输性能指标,调整所述第一应用的第一应用类型对应的第一拥塞参数时,可以具体用于:根据所述第一传输性能指标,获取所述第一应用对传输性能指标的要求;根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数。In a possible design, when the processing unit is configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, the processing unit may be specifically configured to: A transmission performance indicator, obtaining the requirements of the first application on the transmission performance indicators; adjusting the first congestion parameter according to the requirements of the first application on the transmission performance indicators.
在一种可能的设计中,所述处理单元用于根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数是,可以具体用于:将所述第一传输性能指标输入目标函数,得到第一评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;基于所述第一评估值,调整所述第一拥塞参数。In a possible design, the processing unit is configured to adjust the first congestion parameter according to the requirements of the first application on the transmission performance index, which may be specifically used to: input the first transmission performance index an objective function to obtain a first evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index; based on the first evaluation value, the first congestion parameter is adjusted.
在一种可能的设计中,所述第一传输性能指标可以包括至少两个性能指标,例如可以 包括吞吐率和时延;所述第一应用对所述至少两个性能指标中的至少一个性能指标为高要求时,所述处理单元可以采用以下方式调整所述第一拥塞参数:In a possible design, the first transmission performance indicator may include at least two performance indicators, such as throughput and delay; the first application may perform at least one of the at least two performance indicators. When the indicator is high demand, the processing unit may adjust the first congestion parameter in the following manner:
按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;将所述第二传输性能指标输入所述目标函数,得到第二评估值;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter; obtain the adjusted first congestion control algorithm based on the adjusted first congestion parameter; The first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值大于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最大的第二评估值对应的调整方向,将所述第一评估值替换为所述最大的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均小于所述第一评估值时,则确定所述第一评估值为所述目标函数的最大评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than When the first evaluation value is used, the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
在一种可能的设计中,所述传输性能指标可以包括至少两个性能指标,例如可以包括吞吐率和时延;所述第一应用对所述至少两个性能指标均为低要求时,所述处理单元可以采用以下方式调整所述第一拥塞参数:In a possible design, the transmission performance indicators may include at least two performance indicators, such as throughput and delay; when the first application has low requirements for the at least two performance indicators, all The processing unit may adjust the first congestion parameter in the following manner:
按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;将所述第二传输性能指标输入所述目标函数,得到第二评估值;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter; obtain the adjusted first congestion control algorithm based on the adjusted first congestion parameter; The first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值小于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最小的第二评估值对应的调整方向,将所述第一评估值替换为所述最小的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得 到调整后的第一拥塞参数;当所述多个第二评估值均大于所述第一评估值时,则确定所述第一评估值为所述目标函数的最小评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
在一种可能的设计中,所述第一拥塞参数可以至少包括第一子参数和第二子参数;所述多个调整方向可以包括以下四个调整方向,所述第一调整方向可以为以下四个调整方向中的任意一种:增大所述第一子参数和所述第二子参数;增大所述第一子参数,减小所述第二子参数;减小所述第一子参数,增大所述第二子参数;减小所述第一子参数和所述第二子参数。In a possible design, the first congestion parameter may include at least a first sub-parameter and a second sub-parameter; the multiple adjustment directions may include the following four adjustment directions, and the first adjustment direction may be the following Any one of four adjustment directions: increase the first sub-parameter and the second sub-parameter; increase the first sub-parameter, decrease the second sub-parameter; decrease the first sub-parameter sub-parameter, increase the second sub-parameter; decrease the first sub-parameter and the second sub-parameter.
在一种可能的设计中,所述第一拥塞控制算法可以包括升窗算法和降窗算法,所述第一子参数可以为所述升窗算法对应的参数,所述第二子参数可以为所述降窗算法对应的参数。具体的,所述升窗算法表征为:In a possible design, the first congestion control algorithm may include a window-up algorithm and a window-down algorithm, the first sub-parameter may be a parameter corresponding to the window-up algorithm, and the second sub-parameter may be Parameters corresponding to the window reduction algorithm. Specifically, the window raising algorithm is characterized as:
Figure PCTCN2021082120-appb-000003
Figure PCTCN2021082120-appb-000003
所述降窗算法表征为:The window reduction algorithm is characterized as:
cwnd=cwnd(1-β)cwnd=cwnd(1-β)
其中,cwnd用于表示拥塞窗口值,α为所述第一子参数,β为所述第二子参数。Wherein, cwnd is used to represent the congestion window value, α is the first sub-parameter, and β is the second sub-parameter.
在一种可能的设计中,所述处理单元用于根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数时,可以用于:获取应用类型与拥塞参数之间的映射关系;基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数。其中,所述映射关系可以但不限于存储于网络设备的本地存储器、与网络设备连接的外部存储器、云端。In a possible design, when the processing unit is configured to obtain the first congestion parameter corresponding to the first application type according to the first application type, the processing unit may be configured to: obtain the difference between the application type and the congestion parameter. A mapping relationship; based on the mapping relationship and the first application type, obtain a first congestion parameter corresponding to the first application type. Wherein, the mapping relationship may be stored in, but not limited to, a local storage of the network device, an external storage connected to the network device, and the cloud.
在一种可能的设计中,所述映射关系可以包括多个应用类型和所述多个应用类型对应的拥塞参数;对于所述映射关系中的至少一个应用类型中的任一应用类型,所述处理单元可以采用以下方式确定所述应用类型对应的拥塞参数:获取所述应用类型对应的初始拥塞参数,基于所述应用类型对应的初始拥塞参数,获取所述应用类型对应的初始拥塞控制算法;基于所述应用类型对应的初始拥塞控制算法,对所述应用类型对应的至少一个应用的流量数据进行拥塞控制,获得所述至少一个应用各自对应的初始传输性能指标;将所述至少一个应用各自对应的初始传输性能指标输入目标函数,得到至少一个初始评估值,所述目标函数用于评估所述至少一个应用各自对传输性能指标的要求;采用强化学习方式基于所述至少一个初始评估值和所述至少一个应用各自的流量数据进行训练,得到所述应用类型对应的拥塞参数。In a possible design, the mapping relationship may include multiple application types and congestion parameters corresponding to the multiple application types; for any application type in at least one application type in the mapping relationship, the The processing unit may determine the congestion parameter corresponding to the application type in the following manner: acquiring the initial congestion parameter corresponding to the application type, and acquiring the initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type; Based on the initial congestion control algorithm corresponding to the application type, congestion control is performed on the traffic data of at least one application corresponding to the application type, and initial transmission performance indicators corresponding to the at least one application are obtained; The corresponding initial transmission performance index is input into the objective function, and at least one initial evaluation value is obtained, and the objective function is used to evaluate the respective requirements of the at least one application on the transmission performance index; the reinforcement learning method is adopted based on the at least one initial evaluation value and The at least one application is trained with respective traffic data to obtain a congestion parameter corresponding to the application type.
在一种可能的设计中,所述处理单元用于基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数时,可以具体用于:若所述映射关系中不包括所述第一应用类型,则根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数;或者,若所述映射关系中包括所述第一应用类型,则根据所述第一应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数。In a possible design, when the processing unit is configured to obtain the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type, the processing unit may be specifically configured to: if the If the mapping relationship does not include the first application type, then obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or, if the If the mapping relationship includes the first application type, the first congestion parameter corresponding to the first application type is acquired according to the first application type and the mapping relationship.
在一种可能的设计中,所述处理单元用于根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数时,可以具体用于:根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型所属的第二应用类型对应的第二拥塞参数,基于所述第二拥塞参数获取第二拥塞控制算法;基于所述 第二拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第三传输性能指标;将所述第三性能指标输入目标函数,得到第三评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;采用强化学习方式基于所述第三评估值和所述第一应用的流量数据进行训练,得到所述第一应用类型对应的第一拥塞参数。In a possible design, when the processing unit is configured to acquire the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship, the processing unit may specifically is used for: obtaining a second congestion parameter corresponding to the second application type to which the first application type belongs, according to the second application type to which the first application type belongs and the mapping relationship, and obtaining based on the second congestion parameter a second congestion control algorithm; a third transmission performance index corresponding to when performing congestion control on the traffic data of the first application based on the second congestion control algorithm; inputting the third performance index into an objective function to obtain a third evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index; the reinforcement learning method is used to perform training based on the third evaluation value and the traffic data of the first application to obtain the first application The first congestion parameter corresponding to the type.
在一种可能的设计中,所述处理单元用于根据所述第一传输性能指标,调整所述第一拥塞参数之后,还可以用于:基于调整后的第一拥塞参数,更新所述映射关系。In a possible design, after the processing unit is configured to adjust the first congestion parameter according to the first transmission performance indicator, the processing unit may also be configured to: update the mapping based on the adjusted first congestion parameter relation.
上述第三方面及其可能的设计中的有益效果可以参考上述对第一方面及其任意一种可能的设计中所述方法的有益效果的描述。For the beneficial effects of the third aspect and its possible designs, reference may be made to the foregoing descriptions of the beneficial effects of the methods described in the first aspect and any of its possible designs.
第四方面,本申请实施例提供一种网络设备,包括:In a fourth aspect, an embodiment of the present application provides a network device, including:
所述获取单元,用于获取基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;the obtaining unit, configured to obtain the first transmission performance index corresponding to the congestion control of the traffic data of the first application based on the first congestion control algorithm;
所述处理单元,用于根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数,调整后的第一拥塞参数用于得到调整后的第一拥塞控制算法,调整后的第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。The processing unit is configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, and the adjusted first congestion parameter is used to obtain an adjusted first congestion control The adjusted first congestion control algorithm is used to perform congestion control on the traffic data of the first application.
在一种可能的设计中,所述处理单元用于根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数时,可以具体用于:根据所述第一传输性能指标,获取所述第一应用对传输性能指标的要求;根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数。In a possible design, when the processing unit is configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, the processing unit may be specifically configured to: A transmission performance indicator, obtaining the requirements of the first application on the transmission performance indicators; adjusting the first congestion parameter according to the requirements of the first application on the transmission performance indicators.
在一种可能的设计中,所述处理单元用于根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数时,可以具体用于:将所述第一传输性能指标输入目标函数,得到第一评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;基于所述第一评估值,调整所述第一拥塞参数。In a possible design, when the processing unit is configured to adjust the first congestion parameter according to the requirements of the first application on the transmission performance indicator, it may be specifically configured to: input the first transmission performance indicator an objective function to obtain a first evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index; based on the first evaluation value, the first congestion parameter is adjusted.
在一种可能的设计中,所述第一拥塞控制算法可以包括升窗算法和降窗算法,所述第一子参数可以为所述升窗算法对应的参数,所述第二子参数可以为所述降窗算法对应的参数。具体的,所述升窗算法表征为:In a possible design, the first congestion control algorithm may include a window-up algorithm and a window-down algorithm, the first sub-parameter may be a parameter corresponding to the window-up algorithm, and the second sub-parameter may be Parameters corresponding to the window reduction algorithm. Specifically, the window raising algorithm is characterized as:
Figure PCTCN2021082120-appb-000004
Figure PCTCN2021082120-appb-000004
所述降窗算法表征为:The window reduction algorithm is characterized as:
cwnd=cwnd(1-β)cwnd=cwnd(1-β)
其中,cwnd用于表示拥塞窗口值,α为所述第一子参数,β为所述第二子参数。Wherein, cwnd is used to represent the congestion window value, α is the first sub-parameter, and β is the second sub-parameter.
在一种可能的设计中,所述第一传输性能指标可以包括至少两个性能指标,例如可以包括吞吐率和时延;所述第一应用对所述至少两个性能指标中的至少一个性能指标为高要求时,所述处理单元可以采用以下方式调整所述第一拥塞参数:In a possible design, the first transmission performance indicator may include at least two performance indicators, such as throughput and delay; the first application may perform at least one of the at least two performance indicators. When the indicator is high demand, the processing unit may adjust the first congestion parameter in the following manner:
按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;将所述第二传输性能指标输入所述目标函数,得到第二评估值;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter; obtain the adjusted first congestion control algorithm based on the adjusted first congestion parameter; The first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第 一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值大于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最大的第二评估值对应的调整方向,将所述第一评估值替换为所述最大的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均小于所述第一评估值时,则确定所述第一评估值为所述目标函数的最大评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than When the first evaluation value is used, the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
在一种可能的设计中,所述传输性能指标可以包括至少两个性能指标,例如可以包括吞吐率和时延;所述第一应用对所述至少两个性能指标均为低要求时,所述处理单元可以采用以下方式调整所述第一拥塞参数包括:In a possible design, the transmission performance indicators may include at least two performance indicators, such as throughput and delay; when the first application has low requirements for the at least two performance indicators, all The processing unit may adjust the first congestion parameter in the following manner:
按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;将所述第二传输性能指标输入所述目标函数,得到第二评估值;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter; obtain the adjusted first congestion control algorithm based on the adjusted first congestion parameter; The first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值小于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最小的第二评估值对应的调整方向,将所述第一评估值替换为所述最小的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均大于所述第一评估值时,则确定所述第一评估值为所述目标函数的最小评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
在一种的可能设计中,所述第一拥塞参数至少包括第一子参数和第二子参数;所述多个调整方向包括以下四个调整方向,所述第一调整方向为以下四个调整方向中的任意一种:增大所述第一子参数和所述第二子参数;增大所述第一子参数,减小所述第二子参数;减小所述第一子参数,增大所述第二子参数;减小所述第一子参数和所述第二子参数。In a possible design, the first congestion parameter includes at least a first sub-parameter and a second sub-parameter; the multiple adjustment directions include the following four adjustment directions, and the first adjustment direction is the following four adjustment directions any one of the directions: increase the first sub-parameter and the second sub-parameter; increase the first sub-parameter, decrease the second sub-parameter; decrease the first sub-parameter, Increase the second sub-parameter; decrease the first sub-parameter and the second sub-parameter.
在一种可能的设计中,所述处理单元用于根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数之前,还可以用于:获取应用类型与拥塞参数之间 的映射关系;基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数。其中,所述映射关系可以但不限于存储于调整设备的本地存储器、与调整设备连接的外部存储器、与调整设备连接的其他设备(如网络设备)、云端。In a possible design, before the processing unit is configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, the processing unit may also be configured to: obtain the application type and A mapping relationship between congestion parameters; based on the mapping relationship and the first application type, obtain a first congestion parameter corresponding to the first application type. Wherein, the mapping relationship may be stored in, but not limited to, the local memory of the adjustment device, an external memory connected to the adjustment device, other devices (eg, network devices) connected to the adjustment device, and the cloud.
在一种可能的设计中,所述映射关系可以包括多个应用类型和所述多个应用类型对应的拥塞参数;对于所述映射关系中的至少一个应用类型中的任一应用类型,所述处理单元可以采用以下方式确定所述应用类型对应的拥塞参数:获取所述应用类型对应的初始拥塞参数,基于所述应用类型对应的初始拥塞参数,获取所述应用类型对应的初始拥塞控制算法;基于所述应用类型对应的初始拥塞控制算法,对所述应用类型对应的至少一个应用的流量数据进行拥塞控制,获得所述至少一个应用各自对应的初始传输性能指标;将所述至少一个应用各自对应的初始传输性能指标输入目标函数,得到至少一个初始评估值,所述目标函数用于评估所述至少一个应用各自对传输性能指标的要求;采用强化学习方式基于所述至少一个初始评估值和所述至少一个应用各自的流量数据进行训练,得到所述应用类型对应的拥塞参数。In a possible design, the mapping relationship may include multiple application types and congestion parameters corresponding to the multiple application types; for any application type in at least one application type in the mapping relationship, the The processing unit may determine the congestion parameter corresponding to the application type in the following manner: acquiring the initial congestion parameter corresponding to the application type, and acquiring the initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type; Based on the initial congestion control algorithm corresponding to the application type, congestion control is performed on the traffic data of at least one application corresponding to the application type, and initial transmission performance indicators corresponding to the at least one application are obtained; The corresponding initial transmission performance index is input into the objective function, and at least one initial evaluation value is obtained, and the objective function is used to evaluate the respective requirements of the at least one application on the transmission performance index; the reinforcement learning method is adopted based on the at least one initial evaluation value and The at least one application is trained with respective traffic data to obtain a congestion parameter corresponding to the application type.
在一种可能的设计中,所述处理单元用于基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数时,可以具体用于:若所述映射关系中不包括所述第一应用类型,则根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数;或者,若所述映射关系中包括所述第一应用类型,则根据所述第一应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数。In a possible design, when the processing unit is configured to obtain the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type, the processing unit may be specifically configured to: if the If the mapping relationship does not include the first application type, then obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or, if the If the mapping relationship includes the first application type, the first congestion parameter corresponding to the first application type is acquired according to the first application type and the mapping relationship.
在一种可能的设计中,所述处理单元用于根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数时,可以具体用于:根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型所属的第二应用类型对应的第二拥塞参数,基于所述第二拥塞参数获取第二拥塞控制算法;基于所述第二拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第三传输性能指标;将所述第三性能指标输入目标函数,得到第三评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;采用强化学习方式基于所述第三评估值和所述第一应用的流量数据进行训练,得到所述第一应用类型对应的第一拥塞参数。In a possible design, when the processing unit is configured to acquire the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship, the processing unit may specifically is used for: obtaining a second congestion parameter corresponding to the second application type to which the first application type belongs, according to the second application type to which the first application type belongs and the mapping relationship, and obtaining based on the second congestion parameter a second congestion control algorithm; a third transmission performance index corresponding to when performing congestion control on the traffic data of the first application based on the second congestion control algorithm; inputting the third performance index into an objective function to obtain a third evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index; the reinforcement learning method is used to perform training based on the third evaluation value and the traffic data of the first application to obtain the first application The first congestion parameter corresponding to the type.
上述第四方面及其可能的设计中的有益效果可以参考上述对第二方面及其任意一种可能的设计中所述方法的有益效果的描述。For the beneficial effects of the fourth aspect and its possible designs, reference may be made to the foregoing description of the beneficial effects of the methods described in the second aspect and any of its possible designs.
第五方面,本申请实施例提供一种网络设备,包括:至少一个处理器和存储器;所述存储器存储一个或多个计算机程序;当所述存储器存储的一个或多个计算机程序被所述至少一个处理器执行时,使得所述网络设备执行上述第一方面中的任意一方面所涉及的方法。In a fifth aspect, an embodiment of the present application provides a network device, including: at least one processor and a memory; the memory stores one or more computer programs; when the one or more computer programs stored in the memory are stored by the at least one When executed by one processor, the network device is caused to execute the method involved in any one of the foregoing first aspects.
第六方面,本申请实施例提供一种调整设备,包括:至少一个处理器和存储器;所述存储器存储一个或多个计算机程序;当所述存储器存储的一个或多个计算机程序被所述至少一个处理器执行时,使得所述网络设备执行上述第二方面中的任意一方面所涉及的方法。In a sixth aspect, an embodiment of the present application provides an adjustment device, comprising: at least one processor and a memory; the memory stores one or more computer programs; when the one or more computer programs stored in the memory are stored by the at least one When executed by one processor, the network device is caused to execute the method involved in any one of the foregoing second aspects.
第七方面,本申请实施例提供一种计算机存储介质,所述计算机可读存储介质用于存储计算机程序,当所述计算机程序在计算机上运行时,使得所述计算机执行上述第一方面或者第二方面中的任意一方面所涉及的方法。In a seventh aspect, an embodiment of the present application provides a computer storage medium, where the computer-readable storage medium is used to store a computer program, and when the computer program runs on a computer, the computer is made to execute the first aspect or the first aspect above. The method involved in any one of the two aspects.
第八方面,本申请实施例提供一种网络系统,包括:调整设备和网络设备;In an eighth aspect, an embodiment of the present application provides a network system, including: an adjustment device and a network device;
所述调整设备,用于获取第一应用的流量数据对应的第一传输性能指标;根据所述第一传输性能指标调整所述第一应用的应用类型对应的第一拥塞参数;将调整后的第一拥塞 参数发送给所述网络设备;The adjustment device is configured to obtain a first transmission performance index corresponding to the traffic data of the first application; adjust the first congestion parameter corresponding to the application type of the first application according to the first transmission performance index; sending the first congestion parameter to the network device;
所述网络设备,用于根据调整后的第一拥塞参数获取调整后的第一拥塞控制算法,基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制。The network device is configured to obtain an adjusted first congestion control algorithm according to the adjusted first congestion parameter, and perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm.
在一种可能的设计中,所述调整设备用于获取第一应用的流量数据对应的第一传输性能指标之前,所述网络设备还用于:获取所述第一应用的第一应用类型;根据所述第一应用类型,获取所述第一拥塞参数;基于所述第一拥塞参数获取第一拥塞控制算法;In a possible design, before the adjustment device is configured to acquire the first transmission performance indicator corresponding to the traffic data of the first application, the network device is further configured to: acquire the first application type of the first application; obtaining the first congestion parameter according to the first application type; obtaining a first congestion control algorithm based on the first congestion parameter;
所述调整设备用于获取第一应用的流量数据对应的第一传输性能指标时,具体用于:获取所述网络设备基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第一传输性能指标。When the adjustment device is configured to acquire the first transmission performance index corresponding to the traffic data of the first application, it is specifically configured to: acquire the congestion of the traffic data of the first application by the network device based on the first congestion control algorithm The first transmission performance index corresponding to the control.
在一种可能的设计中,所述网络设备用于基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制之后,调整设备还用于:获取所述网络设备根据调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标。In a possible design, after the network device is configured to perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm, the adjustment device is further configured to: obtain the network device according to the adjustment The second transmission performance index corresponding to when the second congestion control algorithm performs congestion control on the traffic data of the first application.
第九方面,本申请实施例提供一种网络系统,其特征在于,包括:识别设备和网络设备;In a ninth aspect, an embodiment of the present application provides a network system, characterized in that it includes: an identification device and a network device;
所述识别设备,用于识别第一应用的第一应用类型;将所述第一应用类型发送给所述网络设备;the identifying device, configured to identify the first application type of the first application; sending the first application type to the network device;
所述网络设备,用于根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,所述第一拥塞参数用于得到第一拥塞控制算法,所述第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。The network device is configured to obtain, according to the first application type, a first congestion parameter corresponding to the first application type, where the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control The algorithm is used to perform congestion control on the traffic data of the first application.
在一种可能的设计中,所述网络设备用于根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数之后,还用于:基于所述第一拥塞参数获取所述第一拥塞控制算法;基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制。In a possible design, after obtaining the first congestion parameter corresponding to the first application type according to the first application type, the network device is further configured to: obtain the first congestion parameter based on the first congestion parameter. the first congestion control algorithm; and based on the first congestion control algorithm, congestion control is performed on the traffic data of the first application.
在一种可能设计中,所述网络系统还包括调整设备,所述调整设备用于:In a possible design, the network system further includes an adjustment device, and the adjustment device is used for:
获取所述网络设备基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;根据所述第一传输性能指标调整所述第一应用类型对应的第一拥塞参数;将调整后的第一拥塞参数发送给所述网络设备;Acquire a first transmission performance index corresponding to when the network device performs congestion control on the traffic data of the first application based on the first congestion control algorithm; adjust the corresponding first application type according to the first transmission performance index The first congestion parameter of ; send the adjusted first congestion parameter to the network device;
所述网络设备用于:根据调整后的第一拥塞参数获取调整后的第一拥塞控制算法,基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制。The network device is configured to: obtain an adjusted first congestion control algorithm according to the adjusted first congestion parameter, and perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm.
附图说明Description of drawings
图1为本申请实施例提供的一种网络系统的架构示意图;FIG. 1 is a schematic diagram of the architecture of a network system provided by an embodiment of the present application;
图2为本申请实施例提供的一种网络系统的架构示意图;FIG. 2 is a schematic structural diagram of a network system provided by an embodiment of the present application;
图3为本申请实施例提供的一种网络系统的架构示意图;FIG. 3 is a schematic structural diagram of a network system provided by an embodiment of the present application;
图4为本申请实施例提供的一种网络系统的架构示意图;FIG. 4 is a schematic structural diagram of a network system provided by an embodiment of the present application;
图5为本申请实施例提供的一种拥塞控制方法的流程示意图;FIG. 5 is a schematic flowchart of a congestion control method provided by an embodiment of the present application;
图6为本申请实施例提供的一种网络设备获取应用类型a对应的拥塞参数的过程示意图;6 is a schematic diagram of a process for a network device to obtain a congestion parameter corresponding to an application type a according to an embodiment of the present application;
图7为本申请实施例提供的一种网络设备获取应用类型a对应的拥塞参数的过程示意图;FIG. 7 is a schematic diagram of a process for a network device to obtain a congestion parameter corresponding to an application type a according to an embodiment of the present application;
图8为本申请实施例提供的一种网络设备获取应用类型a对应的拥塞参数的过程示意 图;8 is a schematic diagram of a process for a network device to obtain a congestion parameter corresponding to an application type a according to an embodiment of the present application;
图9为本申请实施例提供的一种网络设备调整第一应用的第一应用类型对应的第一拥塞参数的过程示意图;9 is a schematic diagram of a process for a network device to adjust a first congestion parameter corresponding to a first application type of a first application according to an embodiment of the present application;
图10为本申请实施例提供的一种网络设备基于第一评估值调整第一应用的第一应用类型对应的第一拥塞参数的过程示意图;10 is a schematic diagram of a process in which a network device adjusts a first congestion parameter corresponding to a first application type of a first application based on a first evaluation value according to an embodiment of the present application;
图11为本申请实施例提供的一种网络设备基于第一评估值调整第一应用的第一应用类型对应的第一拥塞参数的过程示意图;11 is a schematic diagram of a process in which a network device adjusts a first congestion parameter corresponding to a first application type of a first application based on a first evaluation value according to an embodiment of the present application;
图12为本申请实施例提供的一种拥塞控制方法的流程示意图;12 is a schematic flowchart of a congestion control method provided by an embodiment of the present application;
图13为本申请实施例提供的一种网络设备的结构示意图;FIG. 13 is a schematic structural diagram of a network device according to an embodiment of the present application;
图14为本申请实施例提供的一种调整设备的结构示意图;14 is a schematic structural diagram of an adjustment device provided by an embodiment of the application;
图15为本申请实施例提供的一种网络设备的结构示意图;FIG. 15 is a schematic structural diagram of a network device according to an embodiment of the present application;
图16为本申请实施例提供的一种调整设备的结构示意图。FIG. 16 is a schematic structural diagram of an adjustment device provided by an embodiment of the present application.
具体实施方式detailed description
为了使本申请的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行详尽描述。In order to make the objectives, technical solutions and advantages of the present application clearer, the technical solutions in the embodiments of the present application will be described in detail below with reference to the accompanying drawings in the embodiments of the present application.
请参考图1所示,为本申请实施例提供的一种网络系统的架构示意图。其中,该网络系统可以包括至少一个终端101和网络设备102。Please refer to FIG. 1 , which is a schematic structural diagram of a network system according to an embodiment of the present application. Wherein, the network system may include at least one terminal 101 and a network device 102 .
应理解,本申请实施例提供的网络系统,即可适用于低频场景(sub 6G),也适用于高频场景(above6G)。本申请实施例提供的网络系统的应用场景包括但不限于全球移动通讯(global system of mobile communication,GSM)系统、码分多址(code division multiple access,CDMA)系统、宽带码分多址(wideband code division multiple access,WCDMA)系统、通用分组无线业务(general packet radio service,GPRS)、长期演进(long term evolution,LTE)系统、LTE频分双工(frequency division duplex,FDD)系统、LTE时分双工(time division duplex,TDD)、通用移动网络系统(universal mobile telecommunication system,UMTS)、全球互联微波接入(worldwide interoperability for microwave access,WiMAX)网络系统、未来的第五代(5th generation,5G)系统或新无线(new radio,NR)网络系统等。It should be understood that the network system provided by the embodiments of the present application may be applicable to both a low frequency scenario (sub 6G) and a high frequency scenario (above 6G). Application scenarios of the network system provided by the embodiments of the present application include, but are not limited to, a global system of mobile communication (GSM) system, a code division multiple access (CDMA) system, a wideband code division multiple access (wideband) system code division multiple access (WCDMA) system, general packet radio service (GPRS), long term evolution (LTE) system, LTE frequency division duplex (FDD) system, LTE time division dual time division duplex (TDD), universal mobile telecommunication system (UMTS), worldwide interoperability for microwave access (WiMAX) network system, future fifth generation (5th generation, 5G) system or a new radio (NR) network system, etc.
应理解,本申请实施例中,终端101可以是具有无线收发功能的装置,可以部署在陆地上,包括室内或室外、手持或车载;也可以部署在水面上(如轮船等);还可以部署在空中(例如飞机、气球和卫星上等)。终端101能够与一个或多个网络系统中的一个或多个网络设备102进行通信,并接收网络设备102提供的网络服务。举例来说,本申请实施例中的终端101可以是移动电话(或称为“蜂窝”电话)、会话启动协议(session initiation protocol,SIP)电话、无线本地环路(wireless local loop,WLL)站、个人数字处理(personal digital assistant,PDA)、具有移动终端的计算机等。终端101还可以是用户设备(user equipment,UE)、终端(terminal)、移动台(mobile station,MS)、手机(mobile phone)、平板电脑(pad)、带无线收发功能的电脑、虚拟现实(virtual reality,VR)终端、增强现实(augmented reality,AR)终端、工业控制(industrial control)中的无线终端、无人驾驶(self driving)中的无线终端、远程医疗(remote medical)中的无线终端、智能电网(smart grid)中的无线终端、运输安全(transportation safety)中的无线终端、智慧城市(smart city)中的无线终端、智慧家庭(smart home)中的无线终端等。终端101也可以是具有通信模 块的通信芯片。It should be understood that in this embodiment of the present application, the terminal 101 may be a device with a wireless transceiver function, and may be deployed on land, including indoor or outdoor, handheld or vehicle-mounted; it may also be deployed on water (such as a ship, etc.); it may also be deployed In the air (eg in airplanes, balloons, satellites, etc.). The terminal 101 can communicate with one or more network devices 102 in one or more network systems, and receive network services provided by the network devices 102 . For example, the terminal 101 in this embodiment of the present application may be a mobile phone (or referred to as a "cellular" phone), a session initiation protocol (SIP) phone, or a wireless local loop (WLL) station , personal digital assistant (PDA), computer with mobile terminal, etc. The terminal 101 may also be a user equipment (user equipment, UE), a terminal (terminal), a mobile station (mobile station, MS), a mobile phone (mobile phone), a tablet computer (pad), a computer with a wireless transceiver function, a virtual reality ( virtual reality (VR) terminal, augmented reality (AR) terminal, wireless terminal in industrial control, wireless terminal in self driving, wireless terminal in remote medical , wireless terminal in smart grid, wireless terminal in transportation safety, wireless terminal in smart city, wireless terminal in smart home, etc. The terminal 101 may also be a communication chip with a communication module.
应理解,本申请实施例中,网络设备102包括但不限于:接入网(access network,AN)设备、无线网络控制器(radio network controller,RNC)、节点B(node B,NB)、基站控制器(base station controller,BSC)、基站收发台(base transceiver station,BTS)、家庭基站(例如,home evolved nodeB,或home node B,HNB)、基带单元(baseBand unit,BBU)、传输点(transmitting and receiving point,TRP)、发射点(transmitting point,TP)、移动交换中心等。网络设备102可用于将收到的空中帧与网际协议(IP)分组进行相互转换,作为终端101与接入网的其余部分之间的路由器,其中接入网的其余部分可包括IP网络。网络设备102还可协调对空口的属性管理。例如,网络设备102可以包括长期演进(long term evolution,LTE)系统或演进的LTE系统(LTE-Advanced,LTE-A)中的演进型基站(NodeB或eNB或e-NodeB,evolutional Node B),或者也可以包括5G NR系统中的下一代节点B(next generation node B,gNB),或者也可以包括云接入网(cloud radio access network,CloudRAN)系统中的集中式单元(centralized unit,CU)和分布式单元(distributed unit,DU)等等。网络设备102还可以是接入点(access point,AP)例如无线AP,或者交换机,或者防火墙等等,本申请实施例并不限定网络设备102的具体形态。It should be understood that in this embodiment of the present application, the network device 102 includes but is not limited to: an access network (access network, AN) device, a radio network controller (radio network controller, RNC), a node B (node B, NB), a base station Controller (base station controller, BSC), base transceiver station (base transceiver station, BTS), home base station (for example, home evolved nodeB, or home node B, HNB), baseband unit (baseBand unit, BBU), transmission point ( transmitting and receiving point, TRP), transmitting point (transmitting point, TP), mobile switching center, etc. Network equipment 102 may be used to interconvert received air frames and Internet Protocol (IP) packets, acting as a router between terminal 101 and the rest of the access network, which may include an IP network. The network device 102 may also coordinate attribute management for the air interface. For example, the network device 102 may include an evolved base station (NodeB or eNB or e-NodeB, evolutional Node B) in a long term evolution (long term evolution, LTE) system or an evolved LTE system (LTE-Advanced, LTE-A), Alternatively, it may also include the next generation node B (gNB) in the 5G NR system, or may also include the centralized unit (CU) in the cloud radio access network (CloudRAN) system. And distributed unit (distributed unit, DU) and so on. The network device 102 may also be an access point (access point, AP) such as a wireless AP, or a switch, or a firewall, etc. The embodiment of the present application does not limit the specific form of the network device 102 .
应理解,本申请实施例中,终端101和网络设备102之间可以直接通信,也可以通过其他设备的转发进行通信,本申请实施例对此不做具体限定。其中:It should be understood that, in the embodiment of the present application, the terminal 101 and the network device 102 may communicate directly or communicate through forwarding by other devices, which is not specifically limited in the embodiment of the present application. in:
终端101,用于运行第一应用。The terminal 101 is used for running the first application.
网络设备102,用于获取第一应用的第一应用类型;进一步的,根据第一应用的第一应用类型,获取第一应用的第一应用类型对应的第一拥塞参数。其中,第一拥塞参数用于得到第一拥塞控制算法,第一拥塞控制算法用于对第一应用的流量数据进行拥塞控制。The network device 102 is configured to acquire a first application type of the first application; further, acquire a first congestion parameter corresponding to the first application type of the first application according to the first application type of the first application. The first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control algorithm is used to perform congestion control on the traffic data of the first application.
本申请实施例中,网络设备通过获取第一应用的第一应用类型对应的第一拥塞参数,可以得到适合用于对第一应用的流量数据进行拥塞控制的第一拥塞控制算法,从而可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,提高网络带宽资源的利用率。In this embodiment of the present application, by acquiring the first congestion parameter corresponding to the first application type of the first application, the network device can obtain a first congestion control algorithm suitable for performing congestion control on the traffic data of the first application, thereby effectively Congestion control is performed on the traffic data of the first application, and further, limited network bandwidth resources can be allocated on the basis of not affecting the user's experience of using the first application, and the utilization rate of network bandwidth resources can be improved.
如图2所示,为本申请实施提供的一种网络系统的架构示意图。其中,该网络系统除了可以包括图1所示的至少一个终端101和网络设备102之外,还可以包括用于调整拥塞参数的设备103,为了简便,本文以用于调整拥塞参数的设备的名称是调整设备为例。其中,调整设备103可以用于:As shown in FIG. 2 , it is a schematic diagram of the architecture of a network system provided in the implementation of the present application. Wherein, in addition to the at least one terminal 101 and the network device 102 shown in FIG. 1, the network system may also include a device 103 for adjusting the congestion parameter. For simplicity, the name of the device for adjusting the congestion parameter is used herein. It is an example of adjusting equipment. Among them, the adjustment device 103 can be used for:
获取基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;进一步的,根据第一传输性能指标调整第一应用的第一应用类型对应的第一拥塞参数。Obtain a first transmission performance index corresponding to the congestion control of the traffic data of the first application based on the first congestion control algorithm; further, adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance index .
此外,调整设备103除了具备上述功能之外,还可以将调整后的第一拥塞参数发送给网络设备102,以使网络设备102可以基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,基于调整后的第一拥塞控制算法对第一应用的流量数据进行拥塞控制。In addition, the adjustment device 103 can send the adjusted first congestion parameter to the network device 102 in addition to the above functions, so that the network device 102 can obtain the adjusted first congestion control based on the adjusted first congestion parameter The algorithm, based on the adjusted first congestion control algorithm, performs congestion control on the traffic data of the first application.
需要说明的是,上述网络设备102和调整设备103可以集成在同一设备上,也可以是两个独立的设备,本申请实施例对此不进行限定。其中,当网络设备102和调整设备103为两个独立设备时,调整设备103可以包括但不限于:交换机、防火墙等任何具备调整拥塞参数的功能的设备。或者,当调整设备103与网络设备102集成在同一个设备上时,例如调整设备103集成在网络设备102上时,调整设备103可以是安装在网络设备102上的 一个可以用于调整拥塞参数的软件程序,或者设置在网络设备102上可以用于调整拥塞参数的硬件电路等,此时,网络设备102可以具备调整拥塞参数的功能。本申请实施例并不限定调整设备103的具体形态。It should be noted that, the foregoing network device 102 and adjustment device 103 may be integrated on the same device, or may be two independent devices, which are not limited in this embodiment of the present application. Wherein, when the network device 102 and the adjustment device 103 are two independent devices, the adjustment device 103 may include, but is not limited to, any device having the function of adjusting the congestion parameter, such as a switch, a firewall, and the like. Alternatively, when the adjustment device 103 and the network device 102 are integrated on the same device, for example, when the adjustment device 103 is integrated on the network device 102, the adjustment device 103 may be a device installed on the network device 102 that can be used to adjust the congestion parameter A software program, or a hardware circuit or the like set on the network device 102 that can be used to adjust the congestion parameter, in this case, the network device 102 may have the function of adjusting the congestion parameter. The embodiment of the present application does not limit the specific form of the adjustment device 103 .
本申请实施例中,通过调整设备根据基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标,调整第一应用对应的第一拥塞参数,以使网络设备可以在不同的网络环境下有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,提高网络带宽资源的利用率。In the embodiment of the present application, the first congestion parameter corresponding to the first application is adjusted by the adjustment device according to the first transmission performance index corresponding to the congestion control of the traffic data of the first application based on the first congestion control algorithm, so that the network device It can effectively perform congestion control on the traffic data of the first application in different network environments, and further, on the basis of not affecting the user's experience of using the first application, limited network bandwidth resources can be allocated to improve network bandwidth resources. utilization rate.
如图3所示,为本申请实施提供的一种网络系统的架构示意图。其中,该网络系统除了可以包括图1所示的至少一个终端101和网络设备102之外,还可以包括用于识别应用的应用类型的设备104,为了简便,本文以用于识别应用的应用类型的设备的名称是识别设备为例。其中,识别设备104可以用于识别第一应用的第一应用类型。As shown in FIG. 3 , it is a schematic diagram of the architecture of a network system provided in the implementation of the present application. Wherein, in addition to the at least one terminal 101 and the network device 102 shown in FIG. 1, the network system may also include a device 104 for identifying the application type of the application. For simplicity, the application type for identifying the application is used herein. The name of the device is to identify the device as an example. Wherein, the identification device 104 may be used to identify the first application type of the first application.
此外,识别设备104除了具备上述功能之外,还可以将第一应用类型发送给网络设备102。In addition, the identification device 104 can send the first application type to the network device 102 in addition to the above functions.
需要说明的是,上述网络设备102和识别设备104可以集成在同一个设备上,也可以是两个独立的设备,本申请实施例对此不进行限定。其中,当网络设备102和识别设备104为两个独立设备时,识别设备104可以包括但不限于:交换机、防火墙等任何具备识别应用的应用类型的功能的设备。当识别设备104与网络设备102集成在同一个设备上时,例如识别设备104集成在网络设备102上时,识别设备104可以是安装在网络设备102上的一个可以用于识别应用的应用类型的软件程序,或者设置在网络设备102上可以用于识别应用的应用类型的硬件电路等,此时,网络设备102可以具备识别应用的应用类型的功能。本申请实施例并不限定识别设备104的具体形态。It should be noted that, the foregoing network device 102 and identification device 104 may be integrated on the same device, or may be two independent devices, which are not limited in this embodiment of the present application. Wherein, when the network device 102 and the identification device 104 are two independent devices, the identification device 104 may include, but is not limited to, any device having the function of identifying the application type of the application, such as a switch and a firewall. When the identification device 104 and the network device 102 are integrated on the same device, for example, when the identification device 104 is integrated on the network device 102, the identification device 104 may be an application type installed on the network device 102 that can be used to identify the application. A software program, or a hardware circuit or the like set on the network device 102 that can be used to identify the application type of the application, in this case, the network device 102 can have the function of identifying the application type of the application. The embodiment of the present application does not limit the specific form of the identification device 104 .
本申请实施例中,网络设备通过识别设备识别到的第一应用的第一应用类型,获取第一应用类型对应的第一拥塞参数,进一步的,可以得到适合用于对第一应用的流量数据进行拥塞控制的第一拥塞控制算法,从而可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,提高网络带宽资源的利用率。In the embodiment of the present application, the network device obtains the first congestion parameter corresponding to the first application type by identifying the first application type of the first application identified by the device, and further, can obtain traffic data suitable for the first application A first congestion control algorithm for congestion control, so that congestion control can be effectively performed on the traffic data of the first application, and further, limited network bandwidth resources can be allocated on the basis of not affecting the user's experience of using the first application , to improve the utilization of network bandwidth resources.
以图1-图3适用于图4所示的网络系统为例,图4所示的网络系统可以包括图1-图3所示的至少一个终端101、网络设备102,图3所示的调整设备103和图4所示的识别设备104。其中:Taking FIG. 1-FIG. 3 applicable to the network system shown in FIG. 4 as an example, the network system shown in FIG. 4 may include at least one terminal 101 and network device 102 shown in FIG. 1-FIG. device 103 and identification device 104 shown in FIG. 4 . in:
终端101,用于运行第一应用。The terminal 101 is used for running the first application.
识别设备104,用于识别第一应用的第一应用类型;进一步的,将第一应用的第一应用类型发送给网络设备102。The identification device 104 is configured to identify the first application type of the first application; further, send the first application type of the first application to the network device 102 .
网络设备102,用于根据获取第一应用的第一应用类型;进一步的,根据第一应用的第一应用类型,获取第一应用类型对应的第一拥塞参数。其中,第一拥塞参数用于得到第一拥塞控制算法,第一拥塞控制算法用于对第一应用的流量数据进行拥塞控制。The network device 102 is configured to acquire, according to the first application type of the first application; further, acquire the first congestion parameter corresponding to the first application type according to the first application type of the first application. The first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control algorithm is used to perform congestion control on the traffic data of the first application.
调整设备103,用于获取基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;进一步的,根据第一传输性能指标调整第一应用的第一应用类型对应的第一拥塞参数;将调整后的第一拥塞参数发送给网络设备102。The adjustment device 103 is configured to obtain a first transmission performance index corresponding to the congestion control of the traffic data of the first application based on the first congestion control algorithm; further, adjust the first application type of the first application according to the first transmission performance index the corresponding first congestion parameter; sending the adjusted first congestion parameter to the network device 102 .
网络设备102,还用于根据调整后的第一拥塞参数获取调整后的第一拥塞控制算法,基于调整后的第一拥塞控制算法对第一应用的流量数据进行拥塞控制。The network device 102 is further configured to obtain an adjusted first congestion control algorithm according to the adjusted first congestion parameter, and perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm.
需要说明的是,图4所示的网络设备102、调整设备103、识别设备104中的至少两个设备可以集成在同一个设备上,例如识别设备104和/或调整设备103可以集成在网络设备102上,此时,网络设备102可以具备识别应用的应用类型和/或调整拥塞参数的功能,或者,识别设备104和调整设备103可以集成在同一个设备上,此时,该设备具备识别应用的应用类型和调整拥塞参数的功能。当然,图4所示的网络设备102、调整设备103、识别设备104也可以分别是独立的设备,本申请实施例对此不进行限定。It should be noted that at least two of the network device 102, the adjustment device 103, and the identification device 104 shown in FIG. 4 may be integrated on the same device, for example, the identification device 104 and/or the adjustment device 103 may be integrated in the network device 102, at this time, the network device 102 may have the function of identifying the application type of the application and/or adjusting the congestion parameter, or the identifying device 104 and the adjusting device 103 may be integrated on the same device, at this time, the device has the function of identifying the application. The type of application and the function to adjust the congestion parameters. Certainly, the network device 102 , the adjustment device 103 , and the identification device 104 shown in FIG. 4 may also be independent devices, which are not limited in this embodiment of the present application.
本申请实施例中,网络设备通过识别设备识别第一应用的第一应用类型,可以获取第一应类型对应的第一拥塞参数,进一步的,网络设备还通过调整设备根据基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标,调整第一应用对应的第一拥塞参数,从而可以得到适合用于对第一应用的流量数据进行拥塞控制的第一拥塞控制算法,用于在不同的网络环境下有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,提高网络带宽资源的利用率。In the embodiment of the present application, the network device can obtain the first congestion parameter corresponding to the first application type by identifying the first application type of the first application by the identifying device. Further, the network device can also adjust the device according to the first congestion control algorithm based on The first transmission performance index corresponding to the traffic data of the first application when congestion control is performed, and the first congestion parameter corresponding to the first application is adjusted, so that the first congestion suitable for performing congestion control on the traffic data of the first application can be obtained. The control algorithm is used to effectively perform congestion control on the traffic data of the first application in different network environments. Further, on the basis of not affecting the user's experience of using the first application, limited network bandwidth resources can be allocated well, Improve the utilization of network bandwidth resources.
下面将结合附图详细介绍本申请实施例提供的各种技术方案。Various technical solutions provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.
在介绍本申请实施例之前,首先对本申请中的部分用语进行解释说明,以便于本领域技术人员理解。Before introducing the embodiments of the present application, some terms in the present application will be explained first, so as to facilitate the understanding of those skilled in the art.
1)本申请实施例中所涉及的第一应用,可以为终端中安装的可以通过连接网络实现某项或多项特定功能的任意软件程序(application,简称APP)。其中,第一应用可以为:游戏类应用,例如王者荣耀、和平英雄等,或者,还可以为通讯类应用,例如微信(WeChat)、腾讯聊天软件(QQ)、钉钉等,或者,还可以为短视频类应用,例如抖音短视频、快手短视频等,或者,还可以为在线视频类应用,例如优酷、爱奇艺、腾讯视频等,还可以为网页类应用,例如百度、搜狐等,还可以是虚拟现实(virtual reality,VR)类应用类型,等等,本申请实施例对此不作具体限定。1) The first application involved in the embodiments of the present application may be any software program (application, APP for short) installed in the terminal that can realize one or more specific functions by connecting to a network. Among them, the first application may be: a game application, such as King of Glory, Peace Hero, etc., or may also be a communication application, such as WeChat (WeChat), Tencent Chat Software (QQ), DingTalk, etc., or, you can also It is a short video application, such as Douyin short video, Kuaishou short video, etc., or it can also be an online video application, such as Youku, iQiyi, Tencent Video, etc., and it can also be a web application, such as Baidu, Sohu, etc. , it may also be a virtual reality (virtual reality, VR) application type, etc., which is not specifically limited in this embodiment of the present application.
2)本申请实施例中的术语“至少一个”是指一个或者多个,“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B的情况,其中A,B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。单数表达形式“一个”、“一种”、“所述”、“上述”、“该”和“这一”旨在也包括例如“一个或多个”这种表达形式,除非其上下文中明确地有相反指示。以及,除非有相反的说明,本申请实施例提及“第一”、“第二”等序数词是用于对多个对象进行区分,不用于限定多个对象的顺序、时序、优先级或者重要程度。例如,第一应用和第二应用,只是为了区分不同的应用,而并不是表示这两个应用的优先级或者重要程度等的不同。2) The term "at least one" in the embodiments of the present application refers to one or more, and "a plurality" refers to two or more. "And/or", which describes the association relationship of the associated objects, indicates that there can be three kinds of relationships, for example, A and/or B, which can indicate: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A, B can be singular or plural. The character "/" generally indicates that the associated objects are an "or" relationship. The singular expressions "a", "an", "the", "above", "the" and "the" are intended to also include such expressions as "one or more" unless the context clearly dictates otherwise. to the contrary. And, unless stated to the contrary, the ordinal numbers such as “first” and “second” mentioned in the embodiments of the present application are used to distinguish multiple objects, and are not used to limit the order, sequence, priority or priority of multiple objects. Importance. For example, the first application and the second application are only used to distinguish different applications, but do not indicate the difference in priority or importance of the two applications.
另外,需要理解的是,在本申请实施例中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此,在本说明书中的不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同的实施例,而是意味着“一个或多个但不是所有的实施例”,除非是以其他方式另外特别强调。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”,除非是以其他方式另外特别 强调。In addition, it should be understood that references to "one embodiment" or "some embodiments" and the like described in the embodiments of the present application mean that specific features described in connection with the embodiments are included in one or more embodiments of the present application , structure or characteristics. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in other embodiments," etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless specifically emphasized otherwise. The terms "including", "including", "having" and their variants mean "including but not limited to" unless specifically emphasized otherwise.
下面将结合图1-4对本申请实施例提供的拥塞控制方法进行具体阐述。The congestion control method provided by the embodiment of the present application will be described in detail below with reference to FIGS. 1-4 .
在一些实施例中,以图1-3所示的网络系统应用于如图4所示的网络系统为例,如图5所示,为本申请实施例提供的一种拥塞控制方法的流程示意图。其中,该方法流程包括如下步骤:In some embodiments, taking the network system shown in FIGS. 1-3 applied to the network system shown in FIG. 4 as an example, as shown in FIG. 5 , it is a schematic flowchart of a congestion control method provided by an embodiment of the present application . Wherein, the method flow includes the following steps:
S201、获取第一应用的第一应用类型。S201. Acquire a first application type of a first application.
在一些实施例中,当终端通过网络设备连接到网络时,终端可以通过使用网络进行各项的学习或者娱乐活动。比如,若第一应用为在线视频类应用,终端运行第一应用时通过使用网络可以播放视频,或者,若第一应用为游戏类应用,终端运行第一应用时通过使用网络可以显示游戏操作画面,等等。在此过程中,识别设备可以获取第一应用的流量数据,并基于第一应用的流量数据,通过采用相应的识别方法识别第一应用的第一应用类型。作为一种示例,识别设备可以基于第一应用的流量数据,通过采用端口号的分类识别方法识别第一应用的第一应用类型。或者,识别设备可以基于第一应用的流量数据,通过采用深度报文检测(deep packet inspection,DPI)的识别方法识别第一应用的第一应用类型。或者,识别设备可以基于第一应用的流量数据,通过采用深度流检测(deep flow inspection,DFI)的识别方法识别第一应用的第一应用类型。或者,识别设备可以基于第一应用的流量数据,通过采用机器学习的识别方法识别第一应用的第一应用类型,等等。在具体的实现过程中,识别设备还可以基于第一应用的流量数据,通过结合上述各个识别方法识别第一应用的第一应用类型,本申请实施例对此不作具体限定。In some embodiments, when the terminal is connected to the network through the network device, the terminal can perform various learning or entertainment activities by using the network. For example, if the first application is an online video application, the terminal can play the video by using the network when running the first application, or, if the first application is a game application, the terminal can display the game operation screen by using the network when running the first application ,etc. In this process, the identification device may acquire the traffic data of the first application, and based on the traffic data of the first application, identify the first application type of the first application by using a corresponding identification method. As an example, the identification device may identify the first application type of the first application based on the traffic data of the first application by using a port number classification identification method. Alternatively, the identification device may identify the first application type of the first application by adopting a deep packet inspection (deep packet inspection, DPI) identification method based on the traffic data of the first application. Alternatively, the identification device may identify the first application type of the first application by adopting a deep flow inspection (deep flow inspection, DFI) identification method based on the flow data of the first application. Alternatively, the identification device may identify the first application type of the first application by using a machine learning identification method based on the traffic data of the first application, and so on. In a specific implementation process, the identification device may also identify the first application type of the first application based on the traffic data of the first application by combining the above identification methods, which is not specifically limited in this embodiment of the present application.
其中,第一应用类型本申请又可以称为小类应用类型,例如,若第一应用为王者荣耀,第一应用的第一应用类型可以是王者荣耀应用类型。The first application type may also be referred to as a sub-type application type in this application. For example, if the first application is the King of Glory, the first application type of the first application may be the King of Glory application type.
在一些实施例中,识别设备可以将识别到的第一应用的第一应用类型发送给网络设备,此外,识别设备还可以将第一应用的流量数据转发给网络设备。相应的,网络设备可以获取识别设备发送的第一应用的第一应用类型,以及获取识别设备转发的第一应用的流量数据。In some embodiments, the identification device may send the identified first application type of the first application to the network device, and in addition, the identification device may also forward traffic data of the first application to the network device. Correspondingly, the network device may obtain the first application type of the first application sent by the identification device, and obtain the traffic data of the first application forwarded by the identification device.
本申请实施例中,网络设备可以通过识别设备基于不同应用各自的流量数据,识别不同应用各自的第一应用类型,从而可以在后续网络设备对不同应用各自的流量数据进行拥塞控制时,可以基于不同应用各自的第一应用类型为不同应用选择合适的拥塞控制算法,用于对不同应用各自的流量数据进行拥塞控制,从而可以有效的对不同应用各自的流量数据进行拥塞控制,进一步的,可以在不影响用户使用这些应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。In this embodiment of the present application, the network device can identify the first application type of different applications based on the respective traffic data of different applications by identifying the device, so that when the network device performs congestion control on the respective traffic data of different applications, it can be based on The respective first application types of different applications select appropriate congestion control algorithms for different applications, which are used to perform congestion control on the respective traffic data of different applications, so as to effectively perform congestion control on the respective traffic data of different applications, and further, can On the basis of not affecting the user's experience of using these applications, allocating limited network bandwidth resources can improve the utilization rate of network bandwidth resources.
S202、根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,所述第一拥塞参数用于得到第一拥塞控制算法,所述第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。S202. Acquire a first congestion parameter corresponding to the first application type according to the first application type, where the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control algorithm is used to The traffic data of the first application is used for congestion control.
在一些实施例中,网络设备获取到第一应用类型对应的第一拥塞参数后,可以基于第一拥塞参数获取第一拥塞控制算法,并可以基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制。In some embodiments, after obtaining the first congestion parameter corresponding to the first application type, the network device may obtain the first congestion control algorithm based on the first congestion parameter, and may perform the first congestion control algorithm on the traffic data of the first application based on the first congestion control algorithm. Congestion control is performed.
在本申请实施例中,由于第一拥塞参数是基于第一应用的第一应用类型来确定的,从而可以保障网络设备基于第一拥塞参数获取到的第一拥塞控制算法,是适合用于对第一应用的流量数据进行拥塞控制的,从而可以有效的对第一应用的流量数据进行拥塞控制,进 一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。In this embodiment of the present application, since the first congestion parameter is determined based on the first application type of the first application, it can be ensured that the first congestion control algorithm obtained by the network device based on the first congestion parameter is suitable for The traffic data of the first application is subject to congestion control, so that congestion control can be effectively performed on the traffic data of the first application, and further, limited network bandwidth can be allocated on the basis of not affecting the user's experience of using the first application resources, which can improve the utilization of network bandwidth resources.
在一些实施例中,网络设备可以获取预存的应用类型与拥塞参数之间的映射关系。可选的,该映射关系可以包括多个应用类型和多个应用类型各自对应的拥塞参数。其中,该映射关系可以是网络设备存储于本地存储器、与网络设备连接的外部存储器、云端等中的一个或者任意组合,本申请实施例对此不作具体限定。在具体的实现过程中,该映射关系包括的多个应用类型,可以包括多个第二应用类型(本申请又可以称为大类应用类型),还可以包括多个第二应用类型中的至少一个第二应用类型各自所包含的至少一个第一应用类型,即第一应用类型属于第二应用类型。具体的,多个第二应用类型可以包括但不限于:游戏类应用类型、在线视频类应用类型、短视频类应用类型、在线音乐类应用类型、VR类应用类型以及网页类应用类型等,本申请实施例对此不作具体限定。作为一种示例,以多个第二应用类型中的某个第二应用类型为游戏类应用类型为例,该第二应用类型可以包含王者荣耀应用类型或者和平英雄应用类型等第一应用类型。In some embodiments, the network device may acquire a pre-stored mapping relationship between application types and congestion parameters. Optionally, the mapping relationship may include multiple application types and respective congestion parameters corresponding to the multiple application types. The mapping relationship may be one or any combination of a network device stored in a local storage, an external storage connected to the network device, a cloud, and the like, which is not specifically limited in this embodiment of the present application. In a specific implementation process, the multiple application types included in the mapping relationship may include multiple second application types (this application may also be referred to as broad application types), and may also include at least one of the multiple second application types Each of the second application types includes at least one first application type, that is, the first application type belongs to the second application type. Specifically, the multiple second application types may include, but are not limited to: game application types, online video application types, short video application types, online music application types, VR application types, and web page application types, etc. This is not specifically limited in the application examples. As an example, taking a second application type among the plurality of second application types as an example of a game application type, the second application type may include the first application type such as the King of Glory application type or the Peace Hero application type.
在一些实施例中,上述第一拥塞参数,可以是网络设备基于第一应用的第一应用类型和该映射关系获取到的。In some embodiments, the above-mentioned first congestion parameter may be obtained by the network device based on the first application type of the first application and the mapping relationship.
在具体的实现过程中,对于应用类型与拥塞参数之间的映射关系中的至少一个应用类型中的任一应用类型,为了简便,以该应用类型称为应用类型a为例。其中,应用类型a通常指第二应用类型。其中,应用类型a对应的拥塞参数,可以是调整设备采用强化学习的方式基于对应用类型a对应的至少一个应用的流量数据进行训练得到的。具体的,当调整设备集成在网络设备上时,应用类型a对应的拥塞参数,可以是网络设备采用强化学习的方式基于对应用类型a对应的至少一个应用的流量数据进行训练得到的。当调整设备与网络设备为独立设备时,网络设备可以获取调整设备基于强化学习训练得到的应用类型a对应的拥塞参数。In a specific implementation process, for any application type in at least one application type in the mapping relationship between the application type and the congestion parameter, for simplicity, the application type is called application type a as an example. Wherein, the application type a generally refers to the second application type. The congestion parameter corresponding to the application type a may be obtained by training the adjustment device based on the traffic data of at least one application corresponding to the application type a by using reinforcement learning. Specifically, when the adjustment device is integrated on the network device, the congestion parameter corresponding to the application type a may be obtained by the network device using reinforcement learning through training based on the traffic data of at least one application corresponding to the application type a. When the adjustment device and the network device are independent devices, the network device may acquire the congestion parameter corresponding to the application type a obtained by the adjustment device based on reinforcement learning training.
下面以调整设备集成在网络设备上为例,即网络设备具备调整拥塞参数的功能为例,结合图5-6具体介绍网络设备获取应用类型a对应的拥塞参数的过程。The following takes the example that the adjustment device is integrated on the network device, that is, the network device has the function of adjusting the congestion parameter.
请参考图6所示,为本申请实施例提供的一种网络设备获取应用类型a对应的拥塞参数的过程示意图。其中,图6以执行主体为网络设备为例。如图6所示,该过程可以包括如下步骤:Please refer to FIG. 6 , which is a schematic diagram of a process for a network device to obtain a congestion parameter corresponding to an application type a according to an embodiment of the present application. Wherein, FIG. 6 takes the execution subject as a network device as an example. As shown in Figure 6, the process may include the following steps:
S301、获取应用类型a对应的初始拥塞参数,基于该初始拥塞参数获取初始拥塞控制算法。S301. Obtain an initial congestion parameter corresponding to the application type a, and obtain an initial congestion control algorithm based on the initial congestion parameter.
在一些实施例中,拥塞控制算法可以包括但不限于以下两种机制:拥塞降窗机制和窗口恢复机制。其中,在拥塞窗口机制和窗口恢复机制中,升窗算法可以表征为:In some embodiments, the congestion control algorithm may include, but is not limited to, the following two mechanisms: a congestion reduction window mechanism and a window recovery mechanism. Among them, in the congestion window mechanism and window recovery mechanism, the window raising algorithm can be characterized as:
Figure PCTCN2021082120-appb-000005
Figure PCTCN2021082120-appb-000005
降窗算法可以表征为:The window reduction algorithm can be characterized as:
cwnd=cwnd(1-β)cwnd=cwnd(1-β)
其中,在上述升窗算法和降窗算法中,cwnd用于表示拥塞窗口值,α、β为系数即拥塞参数。其中,α和β的不同取值可以对应不同的拥塞控制算法,而不同的拥塞控制算法对应用的传输性能指标也有着不同的影响。Among them, in the above window up algorithm and window down algorithm, cwnd is used to represent the congestion window value, and α and β are coefficients, that is, congestion parameters. Among them, different values of α and β can correspond to different congestion control algorithms, and different congestion control algorithms also have different effects on the transmission performance index of the application.
在一些实施例中,网络设备在对应用类型a对应的至少一个应用的流量数据进行训练之前,可以将应用类型a对应的拥塞参数进行初始化取值,得到应用类型a对应的初始拥 塞参数。具体的,该初始拥塞参数可以包括第一子参数和第二子参数。作为一种示例,第一子参数可以为升窗算法对应的参数,例如第一子参数可以为α,第二子参数可以为降窗算法对应的参数,例如第二子参数可以为β。网络设备可以将应用类型a对应的拥塞参数中的第一子参数α初始化为1、第二子参数β初始化为0.5,即获得应用类型a对应的初始拥塞参数中的第一子参数为1,第二子参数为0.5。In some embodiments, before training the traffic data of at least one application corresponding to the application type a, the network device may initialize the congestion parameter corresponding to the application type a to obtain the initial congestion parameter corresponding to the application type a. Specifically, the initial congestion parameter may include a first sub-parameter and a second sub-parameter. As an example, the first sub-parameter may be a parameter corresponding to the window-up algorithm, for example, the first sub-parameter may be α, and the second sub-parameter may be a parameter corresponding to the window-down algorithm, for example, the second sub-parameter may be β. The network device may initialize the first sub-parameter α in the congestion parameter corresponding to the application type a to 1, and the second sub-parameter β to 0.5, that is, obtain the first sub-parameter in the initial congestion parameter corresponding to the application type a as 1, The second subparameter is 0.5.
在一些实施例中,网络设备可以基于应用类型a对应的初始拥塞参数,获得应用类型a对应的初始拥塞控制算法。比如,当应用类型a对应的初始拥塞参数中的第一子参数α为1、第二子参数β为0.5时,应用类型a对应的初始拥塞控制算法可以为早期的reno算法。In some embodiments, the network device may obtain the initial congestion control algorithm corresponding to the application type a based on the initial congestion parameter corresponding to the application type a. For example, when the first sub-parameter α of the initial congestion parameters corresponding to the application type a is 1 and the second sub-parameter β is 0.5, the initial congestion control algorithm corresponding to the application type a may be an early reno algorithm.
S302、基于应用类型a对应的初始拥塞控制算法,对应用类型a对应的至少一个应用的流量数据进行拥塞控制,获得所述至少一个应用各自对应的初始传输性能指标。S302. Based on the initial congestion control algorithm corresponding to the application type a, perform congestion control on the traffic data of at least one application corresponding to the application type a, and obtain the initial transmission performance index corresponding to the at least one application.
在一些实施例中,网络设备可以基于获取到的应用类型a对应的初始拥塞控制算法,对应用类型a对应的至少一个应用(下文称为所述至少一个应用)的流量数据进行拥塞控制,获得所述至少一个应用各自对应的初始传输性能指标。例如,当应用类型a对应的初始拥塞控制算法为早期的reno算法时,网络设备可以基于该reno算法对所述至少一个应用的流量数据进行拥塞控制,获得所述至少一个应用各自对应的初始传输性能指标。具体的,网络设备可以采用上述升窗算法和上述降窗算法对所述至少一个应用的流量数据进行拥塞控制。在此过程中,网络设备可以记录基于应用类型a对应的初始拥塞控制算法对所述至少一个应用的流量数据进行拥塞控制时对应的初始传输性能指标,换言之,网络设备可以获取基于应用类型a对应的初始拥塞控制算法对所述至少一个应用的流量数据进行拥塞控制时对应的初始传输性能指标。In some embodiments, the network device may perform congestion control on the traffic data of at least one application (hereinafter referred to as the at least one application) corresponding to the application type a based on the obtained initial congestion control algorithm corresponding to the application type a, to obtain Each corresponding initial transmission performance index of the at least one application. For example, when the initial congestion control algorithm corresponding to the application type a is an early reno algorithm, the network device may perform congestion control on the traffic data of the at least one application based on the reno algorithm, and obtain the initial transmission corresponding to the at least one application. Performance. Specifically, the network device may perform congestion control on the traffic data of the at least one application by using the above-mentioned window-up algorithm and the above-mentioned window-down algorithm. During this process, the network device may record the initial transmission performance index corresponding to the congestion control of the traffic data of the at least one application based on the initial congestion control algorithm corresponding to the application type a. In other words, the network device may obtain the corresponding initial transmission performance index based on the application type a. The initial congestion control algorithm corresponds to the initial transmission performance index when congestion control is performed on the traffic data of the at least one application.
S303、将所述至少一个应用各自对应的初始传输性能指标输入目标函数,得到至少一个初始评估值,所述目标函数用于评估所述至少一个应用各自对传输性能指标的要求。S303. Input the respective initial transmission performance indicators corresponding to the at least one application into an objective function to obtain at least one initial evaluation value, where the objective function is used to evaluate the respective requirements of the at least one application for the transmission performance indicators.
在一些实施例中,网络设备可以获取目标函数,该目标函数可以用于评估所述至少一个应用各自对传输性能指标的要求,可以理解为,目标函数可以用于衡量应用类型a对应的初始拥塞控制算法,对所述至少一个应用的流量数据进行拥塞控制的效果,即衡量应用类型a对应的初始拥塞控制算法,是否可以较好的满足所述至少一个应用各自对传输性能指标的要求。In some embodiments, the network device may obtain an objective function, and the objective function may be used to evaluate the respective requirements of the at least one application on the transmission performance index. It can be understood that the objective function may be used to measure the initial congestion corresponding to the application type a The control algorithm, the effect of performing congestion control on the traffic data of the at least one application, is to measure whether the initial congestion control algorithm corresponding to the application type a can better meet the respective requirements of the at least one application for transmission performance indicators.
本申请实施例中,由于网络带宽资源有限,且不同应用类型的应用对传输性能指标有着不同的要求,网络设备通过获取目标函数,可以衡量应用类型a对应的初始拥塞控制算法是否可以较好的满足所述至少一个应用各自对传输性能指标的要求,从而可以满足所述至少一个应用各自对传输性能指标的要求。In this embodiment of the present application, since network bandwidth resources are limited, and applications of different application types have different requirements for transmission performance indicators, the network device can obtain the objective function to measure whether the initial congestion control algorithm corresponding to application type a can be better The respective requirements of the at least one application on the transmission performance index are met, so that the respective requirements of the at least one application on the transmission performance index can be met.
在一些实施例中,传输性能指标可以包括至少两个性能指标,不同应用类型的应用对传输性能指标有着不同的要求,可以理解为,不同应用类型的应用可以对至少两个性能指标有着不同的要求。例如,一些应用类型的应用对至少两个性能指标中的至少一个性能指标为高要求,另一些应用对至少两个性能指标为低要求等。In some embodiments, the transmission performance indicators may include at least two performance indicators. Applications of different application types have different requirements for transmission performance indicators. It can be understood that applications of different application types may have different performance indicators for at least two performance indicators. Require. For example, applications of some application types have high requirements on at least one performance index of at least two performance indicators, and other applications have low requirements on at least two performance indicators, and so on.
作为一种示例,至少两个性能指标可以包括时延和吞吐率。不同应用类型的应用可以对吞吐率和时延有着不同的要求。比如,若应用类型a为游戏类应用类型,由于时延对游戏类应用影响较大,吞吐率对游戏类应用影响较小,网络设备则可以基于应用类型a判断所述至少一个应用对时延为高要求、对吞吐率为低要求。或者,若应用类型a为VR类应 用类型,由于时延和吞吐率对VR类应用影响都较大,网络设备则可以应用类型a判断所述至少一个应用对吞吐率和时延为高要求。或者,若应用类型a为在线视频类应用类型,由于时延对在线视频类应用影响较小,吞吐率对在线视频类应用影响较大,网络设备则可以基于应用类型a判断所述至少一个应用对吞吐率为高要求,对时延为低要求。或者,若应用类型a为网页类应用类型,由于时延和吞吐率对网页类应用影响都较小,网络设备则可以基于应用类型a判断所述至少一个应用对吞吐率和时延为低要求,等等。其中,所述至少一个应用对吞吐率和/或时延为高要求,可以理解为所述至少一个应用的流量数据要求低时延和/或高吞吐率,所述至少一个应用对吞吐率和时延为低要求,可以理解为所述至少一个第二应用的流量数据要求高时延和低吞吐率。As an example, the at least two performance indicators may include latency and throughput. Applications of different application types can have different requirements for throughput and latency. For example, if the application type a is a game application type, since the delay has a greater impact on the game application, and the throughput rate has a small impact on the game application, the network device can determine the impact of the at least one application on the delay based on the application type a. For high requirements, low throughput requirements. Alternatively, if the application type a is a VR application type, since both the delay and the throughput rate have a great impact on the VR type application, the network device can apply the type a to determine that the at least one application has high requirements on the throughput rate and delay. Alternatively, if the application type a is an online video application type, since the delay has little impact on the online video application and the throughput rate has a greater impact on the online video application, the network device can determine the at least one application based on the application type a. The throughput rate is high, and the delay is low. Alternatively, if the application type a is a web page application type, since the delay and throughput rate have little impact on the web page application, the network device may determine, based on the application type a, that the at least one application has low requirements for the throughput rate and the delay. ,etc. Wherein, the at least one application has high requirements on throughput rate and/or delay, which may be understood as the traffic data of the at least one application requires low delay and/or high throughput rate, and the at least one application has high requirements on throughput rate and/or high throughput rate. The latency is a low requirement, which can be understood as requiring high latency and low throughput for the traffic data of the at least one second application.
作为一种示例,当至少两个传输性能指标包括吞吐率和时延时,目标函数可以表征为:As an example, when the at least two transmission performance indicators include throughput and delay, the objective function can be characterized as:
R(x,y)=η*U(x)+(1-η)*U(y)R(x,y)=η*U(x)+(1-η)*U(y)
其中,x表示基于初始拥塞控制算法对所述至少一个应用各自的流量数据进行拥塞控制时对应的时延的倒数,y表示基于初始拥塞控制算法对所述至少一个应用各自的流量数据进行拥塞控制时对应的吞吐率,η表示基于初始拥塞控制算法对所述至少一个应用各自的流量数据进行拥塞控制时对应的吞吐率和时延的平衡参数,U(x)用于表示x进行归一化取值,U(y)用于表示y进行归一化取值。Wherein, x represents the inverse of the delay corresponding to the traffic data of the at least one application based on the initial congestion control algorithm, and y represents the congestion control of the traffic data of the at least one application based on the initial congestion control algorithm. is the corresponding throughput rate, η represents the balance parameter of the corresponding throughput rate and delay when performing congestion control on the traffic data of the at least one application based on the initial congestion control algorithm, and U(x) is used to indicate that x is normalized Value, U(y) is used to indicate the normalized value of y.
在具体的实现过程中,当网络设备获取到所述至少一个应用各自对应的初始传输性能指标后,可以将所述至少一个应用各自对应的初始传输性能指标输入目标函数,获得至少一个初始评估值。In a specific implementation process, after acquiring the initial transmission performance index corresponding to the at least one application, the network device can input the initial transmission performance index corresponding to the at least one application into the objective function to obtain at least one initial evaluation value .
S304、采用强化学习方式基于所述至少一个初始评估值和所述至少一个应用各自的流量数据进行训练,得到所述应用类型a对应的拥塞参数。S304. Use reinforcement learning to perform training based on the at least one initial evaluation value and the respective traffic data of the at least one application, to obtain a congestion parameter corresponding to the application type a.
在一些实施例中,网络设备获得至少一个初始评估值后,可以采用强化学习方式基于至少一个初始评估值和所述至少一个应用各自的流量数据进行训练,得到应用类型a对应的拥塞参数。In some embodiments, after obtaining the at least one initial evaluation value, the network device may use reinforcement learning to perform training based on the at least one initial evaluation value and the respective traffic data of the at least one application to obtain the congestion parameter corresponding to the application type a.
比如,网络设备获得至少一个初始评估值后,可以调整应用类型a对应的初始拥塞参数,得到调整后的初始拥塞控制算法。网络设备可以基于调整后的初始拥塞控制算法对所述至少一个应用的流量数据进行拥塞控制,获取基于调整后的初始拥塞控制算法对所述至少一个应用的流量数据进行拥塞控制时对应的第四传输性能指标,并可以基于所述第四传输性能指标,获得目标函数的至少一个第四评估值。网络设备通过判断至少一个第四评估值和至少一个初始评估值之间的大小关系,以及所述至少一个应用各自对传输性能指标的要求,可以按照相应的调整方式调整应用类型a对应的初始拥塞参数,获得目标函数的最大评估值或者最小评估值,得到应用类型a对应的拥塞参数。For example, after obtaining at least one initial evaluation value, the network device may adjust the initial congestion parameter corresponding to the application type a to obtain the adjusted initial congestion control algorithm. The network device may perform congestion control on the traffic data of the at least one application based on the adjusted initial congestion control algorithm, and obtain a fourth corresponding to when performing congestion control on the traffic data of the at least one application based on the adjusted initial congestion control algorithm. transmission performance index, and at least one fourth evaluation value of the objective function can be obtained based on the fourth transmission performance index. The network device can adjust the initial congestion corresponding to the application type a according to the corresponding adjustment method by judging the magnitude relationship between the at least one fourth evaluation value and the at least one initial evaluation value, and the respective requirements of the at least one application for the transmission performance index. parameter, obtain the maximum evaluation value or the minimum evaluation value of the objective function, and obtain the congestion parameter corresponding to the application type a.
示例性的,以所述至少一个应用中的第二应用为例,网络设备可以应用类型a对应的初始拥塞参数,得到调整后的初始拥塞控制算法,并可以获取基于调整后的初始拥塞控制算法对第二应用的流量数据进行拥塞控制时对应的第四传输性能指标。网络设备将第四传输性能指标输入目标函数,可以获得目标函数的一个第四评估值。之后,网络设备通过判断该第四评估值与应用类型a对应的初始评估值之间的大小关系以及第二应用对传输性能指标的要求,可以按照相应的调整方式调整应用类型a对应的初始拥塞参数,获得目标函数的最大评估值或者最小评估值,得到应用类型a对应的拥塞参数。Exemplarily, taking the second application in the at least one application as an example, the network device may apply the initial congestion parameter corresponding to type a to obtain an adjusted initial congestion control algorithm, and may obtain an initial congestion control algorithm based on the adjusted initial congestion control algorithm. The fourth transmission performance index corresponding to the congestion control of the traffic data of the second application. The network device inputs the fourth transmission performance index into the objective function, and can obtain a fourth evaluation value of the objective function. After that, the network device can adjust the initial congestion corresponding to the application type a according to the corresponding adjustment method by judging the magnitude relationship between the fourth evaluation value and the initial evaluation value corresponding to the application type a and the requirements of the second application on the transmission performance index parameter, obtain the maximum evaluation value or the minimum evaluation value of the objective function, and obtain the congestion parameter corresponding to the application type a.
下面结合图5-8对网络设备采用强化学习方式应用类型a对应的初始评估值和第二应 用的流量数据进行训练,获得训练应用类型a对应的拥塞参数的过程进行详细介绍。The following describes in detail the process of obtaining the congestion parameter corresponding to the training application type a by training the network device using the reinforcement learning method corresponding to the initial evaluation value corresponding to the application type a and the traffic data of the second application with reference to Figures 5-8.
在一些实施例中,网络设备可以基于第二应用的第四传输性能指标,获取第二应用对传输性能指标的要求。比如,网络设备可以通过分析第四传输性能指标,获取第二应用对传输性能指标的要求。或者,网络设备可以基于应用类型a确定第二应用对传输性能指标的要求,本申请实施例对此不作限定。网络设备确定第二应用对传输性能指标的要求后,可以采用相应的强化学习方式,基于应用类型a对应的初始评估值和第二应用的流量数据进行训练,获得训练应用类型a对应的拥塞参数。In some embodiments, the network device may acquire the requirements of the second application for the transmission performance index based on the fourth transmission performance index of the second application. For example, the network device may obtain the requirements of the second application on the transmission performance index by analyzing the fourth transmission performance index. Alternatively, the network device may determine, based on the application type a, the second application's requirement on the transmission performance indicator, which is not limited in this embodiment of the present application. After the network device determines the requirements of the second application for the transmission performance indicators, it can use the corresponding reinforcement learning method to perform training based on the initial evaluation value corresponding to the application type a and the traffic data of the second application, and obtain the congestion parameter corresponding to the training application type a. .
示例性的,如图7所示,为本申请实施例提供的一种网络设备获取应用类型a对应的拥塞参数的过程示意图。其中,图7以执行主体为网络设备,以第二应用对传输性能指标包括的至少两个性能指标中的至少一个性能指标为高要求为例。如图7所示,该过程可以包括如下步骤:Exemplarily, as shown in FIG. 7 , it is a schematic diagram of a process for a network device to acquire a congestion parameter corresponding to an application type a according to an embodiment of the present application. In FIG. 7 , the execution subject is the network device, and the second application has a high requirement on at least one of the at least two performance indicators included in the transmission performance indicator as an example. As shown in Figure 7, the process may include the following steps:
S401、获取应用类型a对应的初始拥塞参数,基于应用类型a对应的初始拥塞参数,获得应用类型a对应的初始评估值。S401. Obtain an initial congestion parameter corresponding to the application type a, and obtain an initial evaluation value corresponding to the application type a based on the initial congestion parameter corresponding to the application type a.
在具体的实现过程中,步骤S401中网络设备应用类型a对应的初始评估值,与图6所示的网络设备得到至少一个初始评估值类似,具体过程可以参考上述S301至S303的相关描述,在此不再赘述。In the specific implementation process, the initial evaluation value corresponding to the network device application type a in step S401 is similar to that obtained by the network device shown in FIG. 6 to obtain at least one initial evaluation value. This will not be repeated here.
S402、按照多个调整方向中的第一调整方向调整应用类型a对应的初始拥塞参数,得到调整后的初始拥塞参数。S402. Adjust the initial congestion parameter corresponding to the application type a according to the first adjustment direction among the plurality of adjustment directions, to obtain the adjusted initial congestion parameter.
具体的,多个调整方向可以包括四个调整方向,例如包括增大应用类型a对应的初始拥塞参数中的第一子参数和第二子参数,增大应用类型a对应的初始拥塞参数中的第一子参数,减小应用类型a对应的初始拥塞参数中的第二子参数,或者,减小应用类型a对应的初始拥塞参数中的第一子参数,增大应用类型a对应的初始拥塞参数中的第二子参数,或者,减小应用类型a对应的初始拥塞参数中的第一子参数和第二子参数。Specifically, the multiple adjustment directions may include four adjustment directions, for example, including increasing the first sub-parameter and the second sub-parameter in the initial congestion parameter corresponding to the application type a, and increasing the initial congestion parameter corresponding to the application type a. For the first sub-parameter, decrease the second sub-parameter in the initial congestion parameter corresponding to application type a, or decrease the first sub-parameter in the initial congestion parameter corresponding to application type a, and increase the initial congestion parameter corresponding to application type a The second sub-parameter in the parameter, or the first sub-parameter and the second sub-parameter in the initial congestion parameter corresponding to the application type a are reduced.
S403、基于调整后的初始拥塞参数获取调整后的初始拥塞控制算法。S403. Obtain an adjusted initial congestion control algorithm based on the adjusted initial congestion parameter.
在具体的实现过程中,网络设备获取到调整后的初始拥塞参数后,可以基于上述S301中的升窗算法和降窗算法获取调整后的初始拥塞控制算法,在此不再赘述。In a specific implementation process, after obtaining the adjusted initial congestion parameters, the network device can obtain the adjusted initial congestion control algorithm based on the window raising algorithm and the window lowering algorithm in S301 above, which will not be repeated here.
S404,基于调整后的初始拥塞控制算法对第二应用的流量数据进行拥塞控制,并获取基于调整后的初始拥塞控制算法对第二应用的流量数据进行拥塞控制时对应的第四传输性能指标。S404 , perform congestion control on the traffic data of the second application based on the adjusted initial congestion control algorithm, and obtain a fourth transmission performance index corresponding to the time when congestion control is performed on the traffic data of the second application based on the adjusted initial congestion control algorithm.
S405、将第四传输性能指标输入目标函数,获得第四评估值。S405. Input the fourth transmission performance index into the objective function to obtain a fourth evaluation value.
S406、判断第四评估值是否大于应用类型a对应的初始评估值。若是,执行S407,否则,执行S408。S406. Determine whether the fourth evaluation value is greater than the initial evaluation value corresponding to the application type a. If yes, execute S407, otherwise, execute S408.
S407、将初始拥塞参数替换为调整后的初始拥塞参数,将应用类型a对应的初始评估值替换为第四评估值,返回S402。S407. Replace the initial congestion parameter with the adjusted initial congestion parameter, replace the initial evaluation value corresponding to the application type a with the fourth evaluation value, and return to S402.
S408、将初始拥塞参数替换为调整后的初始拥塞参数,按照多个调整方向中的其他调整方向分别调整初始拥塞参数,得到多个调整后的初始拥塞参数,其他调整方向为多个调整方向中除去第一调整方向之外的调整方向;基于多个调整后的初始拥塞参数,分别返回执行S403-S405,获得多个第四评估值,然后执行S409。S408. Replace the initial congestion parameter with the adjusted initial congestion parameter, adjust the initial congestion parameter according to other adjustment directions among the multiple adjustment directions, and obtain multiple adjusted initial congestion parameters, and the other adjustment directions are among the multiple adjustment directions. Adjustment directions other than the first adjustment direction; based on the plurality of adjusted initial congestion parameters, return to execute S403-S405 respectively, obtain a plurality of fourth evaluation values, and then execute S409.
S409、判断多个第四评估值中是否存在至少一个第四评估值大于应用类型a对应的初始评估值。若存在,执行S410,否则,执行S411。S409: Determine whether there is at least one fourth evaluation value in the plurality of fourth evaluation values that is greater than the initial evaluation value corresponding to the application type a. If it exists, execute S410, otherwise, execute S411.
S410、将第一调整方向替换为至少一个第四评估值中最大的第四评估值对应的调整方向,将应用类型a对应的评估值替换为最大的第四评估值,返回执行S402。S410. Replace the first adjustment direction with the adjustment direction corresponding to the largest fourth evaluation value among the at least one fourth evaluation value, replace the evaluation value corresponding to the application type a with the largest fourth evaluation value, and return to executing S402.
S411、确定应用类型a对应的初始评估值为目标函数的最大评估值,将应用类型a对应的初始评估值当前对应的初始拥塞参数作为应用类型a最终对应的拥塞参数。S411. Determine the initial evaluation value corresponding to the application type a is the maximum evaluation value of the objective function, and use the initial congestion parameter currently corresponding to the initial evaluation value corresponding to the application type a as the final congestion parameter corresponding to the application type a.
示例性的,如图8所示,为本申请实施例提供的一种网络设备获取应用类型a对应的拥塞参数的过程示意图。其中,图8以执行主体为网络设备,以第二应用对传输性能指标包括的至少两个性能指标均为低要求为例。如图8所示,该过程可以包括如下步骤:Exemplarily, as shown in FIG. 8 , it is a schematic diagram of a process for a network device to acquire a congestion parameter corresponding to an application type a according to an embodiment of the present application. Wherein, FIG. 8 takes the execution subject as the network device, and takes as an example that the second application has low requirements for at least two performance indicators included in the transmission performance indicator. As shown in Figure 8, the process may include the following steps:
S501、获取应用类型a对应的初始拥塞参数,基于应用类型a对应的初始拥塞参数,获得应用类型a对应的初始评估值。S501. Obtain an initial congestion parameter corresponding to the application type a, and obtain an initial evaluation value corresponding to the application type a based on the initial congestion parameter corresponding to the application type a.
S502、按照多个调整方向中的第一调整方向调整应用类型a对应的初始拥塞参数,得到调整后的初始拥塞参数。S502. Adjust the initial congestion parameter corresponding to the application type a according to the first adjustment direction among the plurality of adjustment directions, to obtain the adjusted initial congestion parameter.
S503、基于调整后的初始拥塞参数获取调整后的初始拥塞控制算法。S503. Obtain an adjusted initial congestion control algorithm based on the adjusted initial congestion parameter.
S504、基于调整后的初始拥塞控制算法对第二应用的流量数据进行拥塞控制,并获取基于调整后的初始拥塞控制算法对第二应用的流量数据进行拥塞控制时对应的第四传输性能指标。S504. Perform congestion control on the traffic data of the second application based on the adjusted initial congestion control algorithm, and obtain a fourth transmission performance index corresponding to the congestion control on the traffic data of the second application based on the adjusted initial congestion control algorithm.
S505、将第四传输性能指标输入目标函数,获得第四评估值。S505. Input the fourth transmission performance index into the objective function to obtain a fourth evaluation value.
在具体的实现过程中,步骤S501-S505与上述图7所示的步骤S401-S405类似,具体可以参考上述S401-S405的相关描述,在此不再赘述。In a specific implementation process, steps S501-S505 are similar to steps S401-S405 shown in FIG. 7 above. For details, reference may be made to the relevant descriptions of the above-mentioned S401-S405, which will not be repeated here.
S506、判断第四评估值是否小于应用类型a对应的初始评估值。若是,执行S507,否则,执行S508。S506. Determine whether the fourth evaluation value is smaller than the initial evaluation value corresponding to the application type a. If yes, execute S507, otherwise, execute S508.
S507、将初始拥塞参数替换为调整后的初始拥塞参数,将应用类型a对应的初始评估值替换为第四评估值,返回S502。S507. Replace the initial congestion parameter with the adjusted initial congestion parameter, replace the initial evaluation value corresponding to the application type a with the fourth evaluation value, and return to S502.
S508、将初始拥塞参数替换为调整后的初始拥塞参数,按照多个调整方向中的其他调整方向分别调整初始拥塞参数,得到多个调整后的初始拥塞参数;基于多个调整后的初始拥塞参数,分别返回执行S503-S505,获得多个第四评估值,然后执行S509。S508. Replace the initial congestion parameters with the adjusted initial congestion parameters, adjust the initial congestion parameters according to other adjustment directions in the multiple adjustment directions, and obtain multiple adjusted initial congestion parameters; based on the multiple adjusted initial congestion parameters , respectively return to execute S503-S505, obtain a plurality of fourth evaluation values, and then execute S509.
S509、判断多个第四评估值中是否存在至少一个第四评估值小于应用类型a对应的初始评估值。若存在,执行S510,否则,执行S511。S509: Determine whether there is at least one fourth evaluation value in the plurality of fourth evaluation values that is smaller than the initial evaluation value corresponding to the application type a. If it exists, execute S510, otherwise, execute S511.
S510、将第一调整方向替换为至少一个第四评估值中最小的第四评估值对应的调整方向,将应用类型a对应的初始评估值替换为最小的第四评估值,返回执行S502。S510. Replace the first adjustment direction with the adjustment direction corresponding to the smallest fourth evaluation value among the at least one fourth evaluation value, replace the initial evaluation value corresponding to the application type a with the smallest fourth evaluation value, and return to executing S502.
S511、确定应用类型a对应的初始评估值为目标函数的最小评估值,将应用类型a对应的初始评估值当前对应的初始拥塞参数作为应用类型a最终对应的拥塞参数。S511. Determine the initial evaluation value corresponding to the application type a is the minimum evaluation value of the objective function, and use the initial congestion parameter currently corresponding to the initial evaluation value corresponding to the application type a as the final congestion parameter corresponding to the application type a.
其中,由于应用类型a可以对应至少一个应用,当所述至少一个应用包括多个应用时,网络设备可以选取多个应用中的某个应用,采用与图7或图8所示的方式获得应用类型a对应的拥塞参数。或者,由于不同应用对传输性能指标可能存在较小的差异,网络设备可以基于多个应用,采用与图7或图8所示的方式获得应用类型a对应的多个拥塞参数,通过采用相应的方式得到应用类型a最终对应的拥塞参数,例如,可以取应用类型a对应的多个拥塞参数的平均值作为应用类型a最终对应的拥塞参数。Wherein, since the application type a may correspond to at least one application, when the at least one application includes multiple applications, the network device may select an application among the multiple applications, and obtain the application in the manner shown in FIG. 7 or FIG. 8 . Congestion parameter corresponding to type a. Alternatively, since different applications may have small differences in transmission performance indicators, the network device may obtain multiple congestion parameters corresponding to application type a in the manner shown in FIG. 7 or FIG. 8 based on multiple applications. The final congestion parameter corresponding to the application type a can be obtained in the following way. For example, the average value of multiple congestion parameters corresponding to the application type a can be taken as the final congestion parameter corresponding to the application type a.
需要说明的是,上述映射关系中的应用类型a对应的拥塞参数,可以是网络设备线下通过测试网络采用如图7或图8所示的方式训练得到的。It should be noted that the congestion parameter corresponding to the application type a in the above-mentioned mapping relationship may be obtained by training the network device offline through the test network in the manner shown in FIG. 7 or FIG. 8 .
需要说明的是,上述是以应用类型与拥塞参数之间的映射关系中包括第一应用的第一 应用类型为例。在具体的实现过程中,当应用类型与拥塞参数之间的映射关系中不包括第一应用的第一应用类型时,网络设备可以根据第一应用类型所属的第二应用类型和映射关系,确定第一应用类型对应的第一拥塞参数。之后,网络设备可以根据第一应用的第一应用类型对应的第一拥塞参数,更新该映射关系。例如,以第一应用为王者荣耀为例,当该映射关系中只包括游戏类应用类型,即不包括王者荣耀应用类型时,网络设备可以根据游戏类应用类型和映射关系,确定王者荣耀应用类型对应的第一拥塞参数。It should be noted that the above is an example of the first application type including the first application in the mapping relationship between the application type and the congestion parameter. In a specific implementation process, when the mapping relationship between the application type and the congestion parameter does not include the first application type of the first application, the network device may determine, according to the second application type and the mapping relationship to which the first application type belongs, to determine The first congestion parameter corresponding to the first application type. Afterwards, the network device may update the mapping relationship according to the first congestion parameter corresponding to the first application type of the first application. For example, taking the first application as the King of Glory as an example, when the mapping relationship only includes the game application type, that is, the King of Glory application type is not included, the network device can determine the King of Glory application type according to the game application type and the mapping relationship. The corresponding first congestion parameter.
下面具体介绍网络设备根据第一应用的第二应用类型和应用类型与拥塞参数之间的映射关系,获取第一应用的第一应用类型对应的第一拥塞参数的过程。The following specifically describes the process of acquiring the first congestion parameter corresponding to the first application type of the first application by the network device according to the second application type of the first application and the mapping relationship between the application type and the congestion parameter.
在一些实施例中,网络设备获取到第一应用的第一应用类型后,可以根据第一应用的第一应用类型,确定第一应用的第二应用类型。之后,网络设备可以根据第一应用的第二应用类型以及该映射关系,获取第一应用的第二应用类型对应的第二拥塞参数。此时,网络设备获取到的第一应用的第二应用类型对应的第二拥塞参数,可以理解为,对第一应用的第一应用类型对应的第一拥塞参数进行初始化取值,即该映射关系中包括的第一应用的第二应用类型对应的第二拥塞参数的数值,为第一应用的第一应用类型对应的第一拥塞参数的初始值。之后,网络设备可以采用强化学习的方式,基于第一应用的第二应用类型对应的第二拥塞参数和第一应用的流量数据进行训练,得到第一应用的第一应用类型对应的第一拥塞参数。比如,网络设备可以基于第一应用的第二应用类型对应的第二拥塞参数获取第二拥塞控制算法,并可以获取基于第二拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第三传输性能指标,可以将第三传输性能指标输入目标函数,得到第三评估值。之后,网络设备可以采用强化学习方式基于第三评估值和第一应用的流量数据进行训练,得到第一应用的第一应用类型对应的第一拥塞参数。其中,具体训练过程可以参照上述图7所示的步骤S401-S411或者图8所示的步骤S501-S511的相关描述,在此不再赘述。In some embodiments, after acquiring the first application type of the first application, the network device may determine the second application type of the first application according to the first application type of the first application. Afterwards, the network device may acquire the second congestion parameter corresponding to the second application type of the first application according to the second application type of the first application and the mapping relationship. At this time, the second congestion parameter corresponding to the second application type of the first application obtained by the network device can be understood as initializing the value of the first congestion parameter corresponding to the first application type of the first application, that is, the mapping The value of the second congestion parameter corresponding to the second application type of the first application included in the relationship is the initial value of the first congestion parameter corresponding to the first application type of the first application. After that, the network device may use reinforcement learning to perform training based on the second congestion parameter corresponding to the second application type of the first application and the traffic data of the first application to obtain the first congestion parameter corresponding to the first application type of the first application parameter. For example, the network device may obtain the second congestion control algorithm based on the second congestion parameter corresponding to the second application type of the first application, and may obtain the second congestion control algorithm corresponding to the congestion control of the traffic data of the first application based on the second congestion control algorithm. Three transmission performance indicators, the third transmission performance indicator may be input into the objective function to obtain a third evaluation value. Afterwards, the network device may perform training based on the third evaluation value and the traffic data of the first application in a reinforcement learning manner to obtain a first congestion parameter corresponding to the first application type of the first application. For the specific training process, reference may be made to the related descriptions of steps S401-S411 shown in FIG. 7 or steps S501-S511 shown in FIG. 8 , which will not be repeated here.
需要说明的是,当应用类型和拥塞参数之间的映射关系不包括第一应用的第一应用类型和第二应用类型时,网络设备可以采用如图7或图8所示的方式,获得第一应用的第一应用类型对应的第一拥塞参数和/或第二应用类型对应的第二拥塞参数,具体可以参照上述图7所示的步骤S401-S411或者图8所示的步骤S501-S511的相关描述,在此不再赘述。It should be noted that when the mapping relationship between the application type and the congestion parameter does not include the first application type and the second application type of the first application, the network device can obtain the first application type as shown in FIG. 7 or FIG. 8 . For the first congestion parameter corresponding to the first application type of an application and/or the second congestion parameter corresponding to the second application type, please refer to steps S401-S411 shown in FIG. 7 or steps S501-S511 shown in FIG. 8 for details. The related descriptions are not repeated here.
需要说明的是,当应用类型与拥塞参数之间的映射关系不包括第一应用的第一应用类型对应的第一拥塞参数时,第一应用的第一应用类型对应的第一拥塞参数,可以是网络设备线上采用如图7或图8所示的方式训练得到的,即网络设备在第一应用被使用的过程中采用如图7或图8所示的方式训练得到的。It should be noted that when the mapping relationship between the application type and the congestion parameter does not include the first congestion parameter corresponding to the first application type of the first application, the first congestion parameter corresponding to the first application type of the first application may be It is obtained by training the network equipment online in the manner shown in FIG. 7 or FIG. 8 , that is, the network equipment is trained in the manner shown in FIG. 7 or FIG. 8 when the first application is used.
在本申请实施例中,由于第一应用的第一应用类型对应的第一拥塞参数,是网络设备采用强化学习方式,基于第一应用对传输性能指标的要求和第一应用的流量数据进行训练得到的,可以保障网络设备基于第一拥塞参数获取到的第一拥塞控制算法,适用于对第一应用的流量数据进行拥塞控制,可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。In the embodiment of the present application, since the first congestion parameter corresponding to the first application type of the first application is the network device using the reinforcement learning method to perform training based on the first application's requirements for transmission performance indicators and the traffic data of the first application obtained, it can be ensured that the first congestion control algorithm obtained by the network device based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application, and can effectively perform congestion control on the traffic data of the first application, and further , the limited network bandwidth resources can be allocated on the basis of not affecting the user's experience of using the first application, and the utilization rate of the network bandwidth resources can be improved.
本申请实施例中,由于网络环境可以发生变化,在终端运行第一应用的过程中,网络设备可以通过调整第一应用的第一应用类型对应的第一拥塞参数,以适用不同的网络环境,从而可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。In this embodiment of the present application, since the network environment may change, during the process of running the first application on the terminal, the network device may adjust the first congestion parameter corresponding to the first application type of the first application to apply to different network environments, Therefore, the limited network bandwidth resources can be allocated without affecting the user's experience of using the first application, and the utilization rate of the network bandwidth resources can be improved.
下面将结合图5-9对网络设备调整第一应用的第一应用类型对应的第一拥塞参数的具体过程进行介绍。The specific process of adjusting the first congestion parameter corresponding to the first application type of the first application by the network device will be described below with reference to FIGS. 5-9 .
请参考图9所示,为本申请实施例提供的一种网络设备调整第一应用的第一应用类型对应的第一拥塞参数的过程示意图。其中,图9以执行主体为网络设备为例。如图9所示,该过程可以包括如下步骤:Please refer to FIG. 9 , which is a schematic diagram of a process for a network device to adjust a first congestion parameter corresponding to a first application type of a first application according to an embodiment of the present application. Wherein, FIG. 9 takes the execution subject as a network device as an example. As shown in Figure 9, the process may include the following steps:
S601、获取基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第一传输性能指标。S601. Acquire a first transmission performance indicator corresponding to when congestion control is performed on the traffic data of the first application based on the first congestion control algorithm.
在一些实施例中,网络设备在基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制过程中,网络设备可以获取基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标。具体过程可以参照上述图6所示的步骤S301-S302的相关描述,在此不再赘述。In some embodiments, when the network device performs congestion control on the traffic data of the first application based on the first congestion control algorithm, the network device may obtain the corresponding information when performing congestion control on the traffic data of the first application based on the first congestion control algorithm. The first transmission performance index. For the specific process, reference may be made to the relevant descriptions of steps S301-S302 shown in FIG. 6 above, which will not be repeated here.
S602、根据所述第一传输性能指标,调整所述第一拥塞参数。S602. Adjust the first congestion parameter according to the first transmission performance indicator.
在一些实施例中,网络设备可以根据第一传输性能指标,获取第一应用对传输性能指标的要求。比如,网络设备可以通过分析第一传输性能指标,获取第一应用对传输性能指标的要求。或者,网络设备可以基于第一应用的第一应用类型确定第一应用对传输性能指标的要求,本申请实施例对此不作限定。之后,网络设备可以基于第一应用对传输性能指标的要求,调整第一应用的第一应用类型对应的第一拥塞参数。比如,网络设备可以通过获取目标函数,评估第一应用对传输性能指标的要求。换言之,目标函数可以用于衡量第一拥塞控制算法对第一应用的流量数据进行拥塞控制的效果,即衡量第一拥塞控制算法是否可以满足第一应用对传输性能指标的要求。之后,网络设备可以将第一传输性能指标输入目标函数,得到第一评估值。之后,网络设备可以基于第一评估值调整第一拥塞参数。In some embodiments, the network device may acquire the requirements of the first application for the transmission performance index according to the first transmission performance index. For example, the network device may obtain the requirements of the first application for the transmission performance indicator by analyzing the first transmission performance indicator. Alternatively, the network device may determine, based on the first application type of the first application, the requirement of the first application on the transmission performance indicator, which is not limited in this embodiment of the present application. Afterwards, the network device may adjust the first congestion parameter corresponding to the first application type of the first application based on the first application's requirement for the transmission performance indicator. For example, the network device can evaluate the requirements of the first application on the transmission performance index by acquiring the objective function. In other words, the objective function can be used to measure the effect of the first congestion control algorithm on the congestion control of the traffic data of the first application, that is, to measure whether the first congestion control algorithm can meet the requirements of the first application for transmission performance indicators. Afterwards, the network device may input the first transmission performance index into the objective function to obtain the first evaluation value. Afterwards, the network device may adjust the first congestion parameter based on the first evaluation value.
下面结合图5-10具体介绍网络设备基于第一评估值调整第一应用的第一应用类型对应的第一拥塞参数的过程。The following specifically describes the process of the network device adjusting the first congestion parameter corresponding to the first application type of the first application based on the first evaluation value with reference to FIGS. 5-10 .
示例性的,如图10所示,为本申请实施例提供的一种网络设备基于第一评估值调整第一应用的第一应用类型对应的第一拥塞参数的过程示意图。其中,图10以执行主体为网络设备,以第一应用对传输性能指标包括的至少两个性能指标中的至少一个性能指标为高要求为例。如图10所示,该过程可以包括如下步骤:Exemplarily, as shown in FIG. 10 , a schematic diagram of a process in which a network device adjusts a first congestion parameter corresponding to a first application type of a first application based on a first evaluation value according to an embodiment of the present application. In FIG. 10 , the execution subject is the network device, and the first application has a high requirement on at least one performance indicator of the at least two performance indicators included in the transmission performance indicator as an example. As shown in Figure 10, the process may include the following steps:
S701、按照多个调整方向中的第一调整方向调整第一应用的第一应用类型对应的初始拥塞参数,得到调整后的第一拥塞参数。S701. Adjust an initial congestion parameter corresponding to a first application type of a first application according to a first adjustment direction among a plurality of adjustment directions, to obtain an adjusted first congestion parameter.
S702、基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法。S702. Obtain an adjusted first congestion control algorithm based on the adjusted first congestion parameter.
S703、基于调整后的第一拥塞控制算法对第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第二传输性能指标。S703. Perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm, and obtain a second transmission performance corresponding to the time when the traffic data of the first application is congestion controlled based on the adjusted first congestion control algorithm index.
S704、将第二传输性能指标输入目标函数,获得第二评估值。S704. Input the second transmission performance index into the objective function to obtain a second evaluation value.
S705、判断第二评估值是否大于第一评估值。若是,执行S706,否则,执行S707。S705. Determine whether the second evaluation value is greater than the first evaluation value. If yes, execute S706, otherwise, execute S707.
S706、则将第一拥塞参数替换为调整后的第一拥塞参数,将第一评估值替换为第二评估值,返回S701。S706: Replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return to S701.
S707、将第一拥塞参数替换为调整后的第一拥塞参数,按照多个调整方向中的其他调整方向分别调整第一拥塞参数,得到多个调整后的第一拥塞参数,其他调整方向为多个调整方向中除去第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回 执行S702-S704,获得多个第二评估值,然后执行S708。S707. Replace the first congestion parameter with the adjusted first congestion parameter, adjust the first congestion parameter according to other adjustment directions in the multiple adjustment directions, and obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are multiple An adjustment direction other than the first adjustment direction among the adjustment directions; based on the plurality of adjusted first congestion parameters, return to execute S702-S704 respectively, obtain a plurality of second evaluation values, and then execute S708.
S708、判断多个第二评估值中是否存在至少一个第二评估值大于第一评估值。若存在,执行S709,否则,执行S710。S708. Determine whether at least one second evaluation value is greater than the first evaluation value among the plurality of second evaluation values. If it exists, execute S709, otherwise, execute S710.
S709、将第一调整方向替换为至少一个第二评估值中最大的第二评估值对应的调整方向,将第一评估值替换为最大的第二评估值,返回执行S701。S709: Replace the first adjustment direction with an adjustment direction corresponding to the largest second evaluation value among the at least one second evaluation value, replace the first evaluation value with the largest second evaluation value, and return to executing S701.
S710、确定第一评估值为目标函数的最大评估值,将第一评估值当前对应的第一拥塞参数作为第一应用的第一应用类型最终对应的第一拥塞参数。S710. Determine the first evaluation value as the maximum evaluation value of the objective function, and use the first congestion parameter currently corresponding to the first evaluation value as the first congestion parameter finally corresponding to the first application type of the first application.
其中,步骤S701至S710与上述图7所示的步骤S402至S411类似,具体过程可以参考上述步骤S402至S411的相关描述,在此不再赘述。Wherein, steps S701 to S710 are similar to steps S402 to S411 shown in FIG. 7 above, and the specific process can refer to the relevant descriptions of the above steps S402 to S411, which will not be repeated here.
示例性的,如图11所示,为本申请实施例提供的一种网络设备基于第一评估值调整第一应用的第一应用类型对应的第一拥塞参数的过程示意图。其中,图11以执行主体为网络设备,以第一应用对传输性能指标包括的至少两个性能指标均为低要求为例。如图11所示,该过程可以包括如下步骤:Exemplarily, as shown in FIG. 11 , a schematic diagram of a process in which a network device adjusts a first congestion parameter corresponding to a first application type of a first application based on a first evaluation value according to an embodiment of the present application. In FIG. 11 , the execution subject is the network device, and it is taken as an example that the first application has low requirements for at least two performance indicators included in the transmission performance indicator. As shown in Figure 11, the process may include the following steps:
S801、按照多个调整方向中的第一调整方向调整第一应用的第一应用类型对应的初始拥塞参数,得到调整后的第一拥塞参数。S801. Adjust an initial congestion parameter corresponding to a first application type of a first application according to a first adjustment direction among a plurality of adjustment directions, to obtain an adjusted first congestion parameter.
S802、基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法。S802. Obtain an adjusted first congestion control algorithm based on the adjusted first congestion parameter.
S803、基于调整后的第一拥塞控制算法对第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第二传输性能指标。S803. Perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm, and acquire a second transmission performance corresponding to the time when the traffic data of the first application is congestion controlled based on the adjusted first congestion control algorithm index.
S804、将第二传输性能指标输入目标函数,获得第二评估值。S804. Input the second transmission performance index into the objective function to obtain a second evaluation value.
S805、判断第二评估值是否小于第一评估值。若是,执行S806,否则,执行S807。S805. Determine whether the second evaluation value is smaller than the first evaluation value. If yes, execute S806, otherwise, execute S807.
S806、将第一拥塞参数替换为调整后的第一拥塞参数,将第一评估值替换为第二评估值,返回执行S801。S806. Replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return to performing S801.
S807、将初始拥塞参数替换为调整后的第一拥塞参数,按照多个调整方向中的其他调整方向分别调整第一拥塞参数,得到多个调整后的第一拥塞参数;基于多个调整后的第一拥塞参数,分别返回执行S802-S804,获得多个第二评估值,然后执行S808。S807. Replace the initial congestion parameter with the adjusted first congestion parameter, adjust the first congestion parameter according to other adjustment directions in the multiple adjustment directions, and obtain multiple adjusted first congestion parameters; based on the multiple adjusted first congestion parameters For the first congestion parameter, return to execute S802-S804 respectively, obtain a plurality of second evaluation values, and then execute S808.
S808、判断多个第二评估值中是否存在至少一个第二评估值小于第一评估值。若存在,执行S809,否则,执行S810。S808. Determine whether there is at least one second evaluation value in the plurality of second evaluation values that is smaller than the first evaluation value. If it exists, execute S809, otherwise, execute S810.
S809、将第一调整方向替换为至少一个第二评估值中最小的第二评估值对应的调整方向,将第一评估值替换为最小的第二评估值,返回执行S801。S809: Replace the first adjustment direction with an adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, replace the first evaluation value with the smallest second evaluation value, and return to executing S801.
S810、确定第一评估值为目标函数的最小评估值,将第一评估值当前对应的第一拥塞参数作为第一应用的第一应用类型最终对应的第一拥塞参数。S810. Determine the first evaluation value as the minimum evaluation value of the objective function, and use the first congestion parameter currently corresponding to the first evaluation value as the first congestion parameter finally corresponding to the first application type of the first application.
其中,步骤S801至S810与上述图8所示的步骤S502至S511类似,具体过程可以参考上述步骤S502至S511的相关描述,在此不再赘述。The steps S801 to S810 are similar to the steps S502 to S511 shown in FIG. 8 above, and the specific process can refer to the relevant descriptions of the above steps S502 to S511 , which will not be repeated here.
在一些实施例中,网络设备调整第一应用的第一应用类型对应的第一拥塞参数之后,网络设备可以基于调整后的第一拥塞参数,更新应用类型与拥塞参数之间的映射关系,以使网络设备后续可以基于调整后的第一拥塞参数获取到的调整后的第一拥塞控制算法对第一应用的流量数据进行拥塞控制,以使网络设备可以在不同的网络环境下有效的对第一应用进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。In some embodiments, after the network device adjusts the first congestion parameter corresponding to the first application type of the first application, the network device may update the mapping relationship between the application type and the congestion parameter based on the adjusted first congestion parameter, to The network device can subsequently perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm obtained based on the adjusted first congestion parameter, so that the network device can effectively control the first application in different network environments. When an application performs congestion control, further, limited network bandwidth resources can be allocated without affecting the user's experience of using the first application, which can improve the utilization rate of network bandwidth resources.
本申请实施例中,由于网络设备用于对不同应用各自的流量数据进行拥塞控制的第一拥塞控制算法的第一拥塞参数,是基于不同应用各自的第一应用类型来确定的,从而可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用不同应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。另外,网络设备还可以调整不同应用的第一应用类型对应的第一拥塞参数,从而可以适用于不同的网络环境。In the embodiment of the present application, since the first congestion parameter of the first congestion control algorithm used by the network device to perform congestion control on the traffic data of different applications is determined based on the respective first application types of different applications, it can effectively Congestion control is performed on the traffic data of the first application, and further, limited network bandwidth resources can be allocated without affecting the user's experience of using different applications, which can improve the utilization rate of network bandwidth resources. In addition, the network device can also adjust the first congestion parameters corresponding to the first application types of different applications, so that they can be applied to different network environments.
在另外一个实施例中,以图1-3所示的网络系统应用于如图4所示的网络系统为例,如图12所示,为本申请实施例提供的一种拥塞控制方法的流程示意图。其中,图12以执行主体为调整设备为例。如图12所示,该方法流程包括如下步骤:In another embodiment, taking the network system shown in FIGS. 1-3 applied to the network system shown in FIG. 4 as an example, as shown in FIG. 12 , a flowchart of a congestion control method provided by this embodiment of the present application is shown. Schematic. Among them, Fig. 12 takes the execution subject as the adjustment device as an example. As shown in Figure 12, the method flow includes the following steps:
S901、获取基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标。S901. Acquire a first transmission performance indicator corresponding to when congestion control is performed on traffic data of a first application based on a first congestion control algorithm.
在一些实施例中,调整设备可以通过监控网络设备基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标,即调整设备可以主动获取基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标。或者,调整设备可以获取网络设备发送的自身基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标。比如,网络设备可以记录自身基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标。之后,网络设备可以将记录的基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标发送给调整设备。In some embodiments, the adjustment device may monitor the first transmission performance index corresponding to when the network device performs congestion control on the traffic data of the first application based on the first congestion control algorithm, that is, the adjustment device may actively obtain the first congestion control algorithm based on the first transmission performance index. The first transmission performance index corresponding to the congestion control of the traffic data of the first application. Alternatively, the adjustment device may acquire the first transmission performance indicator that is sent by the network device and corresponds to when it performs congestion control on the traffic data of the first application based on the first congestion control algorithm. For example, the network device may record the corresponding first transmission performance index when it performs congestion control on the traffic data of the first application based on the first congestion control algorithm. Afterwards, the network device may send the recorded first transmission performance index corresponding to when the traffic data of the first application is subjected to congestion control based on the first congestion control algorithm to the adjustment device.
S902、根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数。其中,调整后的第一拥塞参数用于得到调整后的第一拥塞控制算法,调整后的第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。S902. Adjust a first congestion parameter corresponding to a first application type of the first application according to the first transmission performance indicator. The adjusted first congestion parameter is used to obtain an adjusted first congestion control algorithm, and the adjusted first congestion control algorithm is used to perform congestion control on the traffic data of the first application.
在一些实施例中,调整设备可以获取第一应用的第一应用类型对应的第一拥塞参数。比如,调整设备可以获取应用类型与拥塞参数之间的映射关系,并可以基于该映射关系和第一应用的第一应用类型,获取第一应用的第一应用类型对应的第一拥塞参数。可选的,该映射关系可以包括多个应用类型和多个应用类型各自对应的拥塞参数。在具体的实现过程中,该映射关系包括的多个应用类型,可以包括多个第二应用类型,还可以包括多个第二应用类型中的至少一个第二应用类型各自所包含的至少一个第一应用类型,即第一应用类型属于第二应用类型。具体的,多个第二应用类型可以包括但不限于:游戏类应用类型、在线视频类应用类型、短视频类应用类型、在线音乐类应用类型、VR类应用类型以及网页类应用类型等,本申请实施例对此不作具体限定。作为一种示例,以多个第二应用类型中的某个第二应用类型为游戏类应用类型为例,该第二应用类型可以包含王者荣耀应用类型或者和平英雄应用类型等第一应用类型。In some embodiments, the adjustment device may acquire the first congestion parameter corresponding to the first application type of the first application. For example, the adjustment device may acquire the mapping relationship between the application type and the congestion parameter, and may acquire the first congestion parameter corresponding to the first application type of the first application based on the mapping relationship and the first application type of the first application. Optionally, the mapping relationship may include multiple application types and respective congestion parameters corresponding to the multiple application types. In a specific implementation process, the multiple application types included in the mapping relationship may include multiple second application types, and may also include at least one first application type included in at least one second application type among the multiple second application types. An application type, that is, the first application type belongs to the second application type. Specifically, the multiple second application types may include, but are not limited to: game application types, online video application types, short video application types, online music application types, VR application types, and web page application types, etc. This is not specifically limited in the application examples. As an example, taking a second application type among the plurality of second application types as an example of a game application type, the second application type may include the first application type such as the King of Glory application type or the Peace Hero application type.
在一些实施例中,调整设备可以基于第一应用的第一应用类型和该映射关系,获取到第一应用的第一应用类型对应的第一拥塞参数。其中,该映射关系可以是调整设备存储于本地存储器、与调整设备连接的外部存储器、与调整设备连接的其他设备(例如网络设备)、云端等中的一个或者任意组合,本申请实施例对此不作具体限定。In some embodiments, the adjustment device may acquire the first congestion parameter corresponding to the first application type of the first application based on the first application type of the first application and the mapping relationship. Wherein, the mapping relationship may be one or any combination of the adjustment device stored in the local storage, the external storage connected to the adjustment device, other devices (such as network devices) connected to the adjustment device, the cloud, and the like. There is no specific limitation.
作为一种示例,对于应用类型与拥塞参数之间的映射关系中的至少一个应用类型中的任一应用类型,为了简便,以该应用类型称为应用类型b为例,应用类型b对应的拥塞参数,可以是调整设备采用强化学习的方式基于对应用类型b对应的至少一个应用的流量数 据进行训练得到的。其中,应用类型b通常指第二应用类型。As an example, for any application type in at least one application type in the mapping relationship between the application type and the congestion parameter, for simplicity, the application type is called application type b as an example, the congestion corresponding to the application type b The parameter may be obtained by training the adjustment device based on the traffic data of at least one application corresponding to the application type b by means of reinforcement learning. The application type b generally refers to the second application type.
其中,调整设备获取应用类型b对应的拥塞参数,与上述图7或图8所示的网络设备获取应用类型a对应的拥塞参数的过程类似,具体可以参照上述图7所示的步骤S401-S411或者图8所示的步骤S501-S511的相关描述,在此不再赘述。The process of obtaining the congestion parameter corresponding to application type b by the adjustment device is similar to the process of obtaining the congestion parameter corresponding to application type a by the network device shown in FIG. 7 or FIG. 8 . For details, refer to steps S401-S411 shown in FIG. Or the related descriptions of steps S501-S511 shown in FIG. 8 will not be repeated here.
其中,由于应用类型b可以对应至少一个应用,当应用类型b对应的至少一个应用包括多个应用时,调整设备可以选取多个应用中的某个应用,采用如与上述图7或图8所示的网络设备获得应用类型a对应的拥塞参数。或者,由于不同应用对传输性能指标可能存在较小的差异,调整设备可以基于多个应用,采用如与上述图7或图8所示的网络设备获得应用类型a对应的多个拥塞参数的方式,获得应用类型a对应的多个拥塞参数。之后,调整设备可以通过采用相应的方式得到应用类型b最终对应的拥塞参数,例如,可以取应用类型b对应的多个拥塞参数的平均值作为应用类型b最终对应的拥塞参数。Wherein, since the application type b can correspond to at least one application, when the at least one application corresponding to the application type b includes multiple applications, the adjustment device can select an application among the multiple applications, and the adjustment device can select one of the multiple applications. The shown network device obtains the congestion parameter corresponding to the application type a. Alternatively, since different applications may have small differences in transmission performance indicators, the adjustment device may, based on multiple applications, adopt the method of obtaining multiple congestion parameters corresponding to the application type a as shown in the above-mentioned FIG. 7 or FIG. 8 by the network device , to obtain multiple congestion parameters corresponding to the application type a. Afterwards, the adjustment device can obtain the final congestion parameter corresponding to application type b in a corresponding manner. For example, the average value of multiple congestion parameters corresponding to application type b can be taken as the final congestion parameter corresponding to application type b.
需要说明的是,上述映射关系中的应用类型b对应的拥塞参数,可以是调整设备线下通过测试网络采用如与上述图7或图8所示的网络设备获得应用类型a的方式训练得到的。It should be noted that the congestion parameter corresponding to the application type b in the above mapping relationship can be obtained by adjusting the device offline through the test network to obtain the application type a by training the network device as shown in Figure 7 or Figure 8. .
需要说明的是,上述是以应用类型与拥塞参数之间的映射关系中包括第一应用的第一应用类型为例。在具体的实现过程中,当应用类型与拥塞参数之间的映射关系中不包括第一应用的第一应用类型时,调整设备可以根据第一应用的第二应用类型和该映射关系,确定第一应用类型对应的第一拥塞参数。之后,调整设备可以根据第一应用的第一应用类型对应的第一拥塞参数,更新该映射关系。例如,以第一应用为王者荣耀为例,当该映射关系中只包括游戏类应用类型,即不包括王者荣耀应用类型时,调整设备可以根据游戏类应用类型和该映射关系,确定王者荣耀应用类型对应的第一拥塞参数。It should be noted that the above is an example of the first application type including the first application in the mapping relationship between the application type and the congestion parameter. In a specific implementation process, when the mapping relationship between the application type and the congestion parameter does not include the first application type of the first application, the adjustment device may determine the first application type according to the second application type of the first application and the mapping relationship A first congestion parameter corresponding to an application type. Afterwards, the adjustment device may update the mapping relationship according to the first congestion parameter corresponding to the first application type of the first application. For example, taking the first application as the King of Glory as an example, when the mapping relationship only includes the game application type, that is, does not include the King of Glory application type, the adjustment device can determine the King of Glory application according to the game application type and the mapping relationship. The first congestion parameter corresponding to the type.
下面具体介绍调整设备根据第一应用的第二应用类型和映射关系,获取第一应用类型对应的第一拥塞参数的过程。The following specifically describes a process for the adjustment device to acquire the first congestion parameter corresponding to the first application type according to the second application type and the mapping relationship of the first application.
在一些实施例中,调整设备获取到第一应用的第一应用类型后,可以根据第一应用的第一应用类型,确定第一应用的第二应用类型。之后,调整设备可以根据第一应用的第二应用类型以及该映射关系,获取第一应用的第二应用类型对应的第二拥塞参数。此时,调整设备获取到的第一应用的第二应用类型对应的第二拥塞参数,可以理解为,对第一应用的第一应用类型对应的第一拥塞参数进行初始化取值,即该映射关系中包括的第一应用的第二应用类型对应的第二拥塞参数的数值,为第一应用的第一应用类型对应的第一拥塞参数的初始值。之后,调整设备可以采用强化学习的方式,基于第一应用的第二应用类型对应的第二拥塞参数和第一应用的流量数据进行训练,得到第一应用的第一应用类型对应的第一拥塞参数。比如,调整设备可以基于第一应用的第二应用类型对应的第二拥塞参数获取第二拥塞控制算法,并可以获取基于第二拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第三传输性能指标,将第三性能指标输入目标函数,得到第三评估值。之后,调整设备可以采用强化学习方式基于第三评估值和第一应用的流量数据进行训练,得到第一应用类型对应的第一拥塞参数。其中,调整设备得到第一应用类型对应的第一拥塞参数过程,网络设备得到第一应用类型对应的第一拥塞参数的过程类似,具体训练过程可以参照上述图7所示的步骤S401-S411或者图8所示的步骤S501-S511的相关描述,在此不再赘述。In some embodiments, after acquiring the first application type of the first application, the adjustment device may determine the second application type of the first application according to the first application type of the first application. Afterwards, the adjustment device may acquire the second congestion parameter corresponding to the second application type of the first application according to the second application type of the first application and the mapping relationship. At this time, adjusting the second congestion parameter corresponding to the second application type of the first application obtained by the device can be understood as initializing the value of the first congestion parameter corresponding to the first application type of the first application, that is, the mapping The value of the second congestion parameter corresponding to the second application type of the first application included in the relationship is the initial value of the first congestion parameter corresponding to the first application type of the first application. After that, the adjustment device may use reinforcement learning to perform training based on the second congestion parameter corresponding to the second application type of the first application and the traffic data of the first application to obtain the first congestion corresponding to the first application type of the first application. parameter. For example, the adjustment device may obtain the second congestion control algorithm based on the second congestion parameter corresponding to the second application type of the first application, and may obtain the second congestion control algorithm corresponding to the congestion control of the traffic data of the first application based on the second congestion control algorithm. The third transmission performance index is input into the objective function to obtain the third evaluation value. Afterwards, the adjustment device may perform training based on the third evaluation value and the traffic data of the first application in a reinforcement learning manner to obtain the first congestion parameter corresponding to the first application type. The process for the adjustment device to obtain the first congestion parameter corresponding to the first application type is similar, and the process for the network device to obtain the first congestion parameter corresponding to the first application type is similar. For the specific training process, refer to steps S401-S411 shown in FIG. The related descriptions of steps S501-S511 shown in FIG. 8 will not be repeated here.
需要说明的是,当应用类型和拥塞参数之间的映射关系不包括第一应用的第一应用类型和第二应用类型时,调整设备可以采用如图7或图8的方式,获得第一应用的第一应用 类型对应的第一拥塞参数和/或第二应用类型对应的第二拥塞参数,具体过程可以参照上述图7所示的步骤S401-S411或者图8所示的步骤S501-S511的相关描述,在此不再赘述。It should be noted that, when the mapping relationship between the application type and the congestion parameter does not include the first application type and the second application type of the first application, the adjustment device can obtain the first application in the manner shown in FIG. 7 or FIG. 8 The first congestion parameter corresponding to the first application type and/or the second congestion parameter corresponding to the second application type, the specific process can refer to steps S401-S411 shown in FIG. 7 or steps S501-S511 shown in FIG. 8 . Relevant descriptions are not repeated here.
需要说明的是,当应用类型与拥塞参数之间的映射关系不包括第一应用的第一应用类型对应的第一拥塞参数时,第一应用的第一应用类型对应的第一拥塞参数,可以是调整设备线上采用如图7或图8的方式训练得到的,即调整设备在第一应用被使用的过程中采用如图7或图8的方式训练得到的。It should be noted that when the mapping relationship between the application type and the congestion parameter does not include the first congestion parameter corresponding to the first application type of the first application, the first congestion parameter corresponding to the first application type of the first application may be It is obtained by training the adjustment device online in the manner shown in FIG. 7 or FIG. 8 , that is, the adjustment device is trained in the manner shown in FIG. 7 or FIG. 8 when the first application is used.
在本申请实施例中,由于第一应用的第一应用类型对应的第一拥塞参数,是调整设备采用强化学习方式,基于第一应用对传输性能指标的要求和第一应用的流量数据进行训练得到的,可以保障基于第一拥塞参数获取到的第一拥塞控制算法是适用于对第一应用的流量数据进行拥塞控制的,可以有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。In the embodiment of the present application, due to the first congestion parameter corresponding to the first application type of the first application, the adjustment device adopts the reinforcement learning method to perform training based on the requirements of the first application for transmission performance indicators and the traffic data of the first application obtained, it can be guaranteed that the first congestion control algorithm obtained based on the first congestion parameter is suitable for performing congestion control on the traffic data of the first application, and can effectively perform congestion control on the traffic data of the first application, and further, The limited network bandwidth resources can be allocated on the basis of not affecting the user's experience of using the first application, which can improve the utilization rate of the network bandwidth resources.
在一些实施例中,调整设备在获取到第一应用的第一应用类型对应的第一拥塞参数之前,还可以获取第一应用的第一应用类型。比如,网络设备将识别设备识别到的第一应用的第一应用类型发送给调整设备。相应的,调整设备可以获取第一应用的第一应用类型。或者,当识别设备集成在网络设备上时,调整设备可以获取网络设备识别到的第一应用的第一应用类型。或者,当识别设备集成在调整设备上时,调整设备可以识别到的第一应用的第一应用类型。其中,具体识别第一应用的第一应用类型的过程,可以参见上述S201所示的识别第一应用的第一应用类型的过程,在此不再赘述。In some embodiments, before acquiring the first congestion parameter corresponding to the first application type of the first application, the adjustment device may further acquire the first application type of the first application. For example, the network device sends the first application type of the first application identified by the identification device to the adjustment device. Correspondingly, the adjustment device may acquire the first application type of the first application. Alternatively, when the identification device is integrated on the network device, the adjustment device may acquire the first application type of the first application identified by the network device. Or, when the identification device is integrated on the adjustment device, the adjustment device can identify the first application type of the first application. For the specific process of identifying the first application type of the first application, reference may be made to the process of identifying the first application type of the first application shown in the above S201, which will not be repeated here.
在一些实施例中,调整设备获取到第一传输性能指标后,可以根据第一传输性能指标调整第一应用的第一应用类型对应的第一拥塞参数。In some embodiments, after acquiring the first transmission performance indicator, the adjustment device may adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator.
在一些实施例中,调整设备可以根据第一传输性能指标,获取第一应用对传输性能指标的要求。其中,调整设备获取第一应用对传输性能指标的要求的具体实现过程,与网络设备获取第一应用对传输性能指标的要求的具体实现过程类似,具体可以参照上述关于网络设备获取第一应用对传输性能指标的要求的相关描述,在此不再赘述。之后,调整设备可以基于第一应用对传输性能指标的要求,调整第一应用的第一应用类型对应的第一拥塞参数。比如,调整设备可以通过获取目标函数,评估第一应用对传输性能指标的要求。换言之,目标函数可以用于衡量第一拥塞控制算法对第一应用的流量数据进行拥塞控制的效果,即衡量第一拥塞控制算法是否可以满足第一应用对传输性能指标的要求。之后,调整设备可以将第一传输性能指标输入目标函数,得到第一评估值。调整设备可以基于第一评估值调整第一拥塞参数。In some embodiments, the adjustment device may acquire the requirements of the first application for the transmission performance index according to the first transmission performance index. The specific implementation process for the adjustment device to acquire the requirements of the first application for transmission performance indicators is similar to the specific implementation process for the network device to acquire the requirements of the first application for transmission performance indicators. The relevant descriptions of the requirements of the transmission performance indicators will not be repeated here. After that, the adjustment device may adjust the first congestion parameter corresponding to the first application type of the first application based on the first application's requirement for the transmission performance indicator. For example, the adjustment device can evaluate the requirements of the first application on the transmission performance index by acquiring the objective function. In other words, the objective function can be used to measure the effect of the first congestion control algorithm on the congestion control of the traffic data of the first application, that is, to measure whether the first congestion control algorithm can meet the requirements of the first application for transmission performance indicators. Afterwards, the adjustment device may input the first transmission performance index into the objective function to obtain the first evaluation value. The adjusting device may adjust the first congestion parameter based on the first evaluation value.
其中,调整设备基于第一评估值调整第一拥塞参数的过程,与网络设备基于第一评估值调整第一拥塞参数的过程类似,具体可以参照上述图10所示的步骤S701-S710或者图11所示的步骤S801-S810的相关描述,在此不再赘述。The process of adjusting the first congestion parameter by the adjusting device based on the first evaluation value is similar to the process of adjusting the first congestion parameter by the network device based on the first evaluation value. For details, refer to steps S701-S710 shown in FIG. 10 or FIG. 11 . The related descriptions of the illustrated steps S801-S810 will not be repeated here.
本申请实施例中,由于网络环境可以发生变化,在终端运行第一应用的过程中,调整设备可以通过调整第一应用的第一应用类型对应的第一拥塞参数,以使网络设备可以在不同的网络环境下有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。In this embodiment of the present application, since the network environment may change, during the process of running the first application on the terminal, the adjustment device may adjust the first congestion parameter corresponding to the first application type of the first application, so that the network device can operate in different It can effectively control the congestion of the traffic data of the first application in the network environment of the first application. Furthermore, on the basis of not affecting the user's experience of using the first application, limited network bandwidth resources can be allocated, which can improve the utilization of network bandwidth resources. Rate.
在一些实施例中,调整设备调整第一应用的第一应用类型对应的第一拥塞参数之后, 调整设备可以基于调整后的第一拥塞参数,更新应用类型与拥塞参数之间的映射关系。调整设备还可以将调整后的第一拥塞参数发送给网络设备,以使网上设备后续可以基于调整后的第一拥塞参数获取到的调整后的第一拥塞控制算法对第一应用的流量数据进行拥塞控制,以使网络设备可以在不同的网络环境下有效的对第一应用的流量数据进行拥塞控制,进一步的,可以在不影响用户使用第一应用的体验的基础上,分配好有限的网络带宽资源,可以提高网络带宽资源的利用率。In some embodiments, after the adjustment device adjusts the first congestion parameter corresponding to the first application type of the first application, the adjustment device may update the mapping relationship between the application type and the congestion parameter based on the adjusted first congestion parameter. The adjustment device may also send the adjusted first congestion parameter to the network device, so that the network device can subsequently perform the first application traffic data based on the adjusted first congestion control algorithm obtained based on the adjusted first congestion parameter. Congestion control, so that the network device can effectively perform congestion control on the traffic data of the first application in different network environments, and further, can allocate a limited network on the basis of not affecting the user's experience of using the first application Bandwidth resources can improve the utilization of network bandwidth resources.
应理解,本申请实施例中,网络设备或者调整设备可以执行本申请实施例中的部分或全部步骤,这些步骤仅是示例,本申请实施例还可以执行其它步骤或者各种步骤的变形。此外,各个步骤可以按照本申请实施例呈现的不同的顺序来执行,并且有可能并非要执行本申请实施例中的全部步骤。It should be understood that, in the embodiments of the present application, the network device or the adjustment device may perform some or all of the steps in the embodiments of the present application, these steps are only examples, and the embodiments of the present application may also perform other steps or variations of various steps. In addition, various steps may be performed in different orders presented in the embodiments of the present application, and it may not be necessary to perform all the steps in the embodiments of the present application.
在本申请的各个实施例中,如果没有特殊说明以及逻辑冲突,不同的实施例之间的术语和/或描述具有一致性、且可以相互引用,不同的实施例中的技术特征根据其内在的逻辑关系可以组合形成新的实施例。In the various embodiments of the present application, if there is no special description or logical conflict, the terms and/or descriptions between different embodiments are consistent and can be referred to each other, and the technical features in different embodiments are based on their inherent Logical relationships can be combined to form new embodiments.
应理解,网络设备或者调整设备为了实现上述功能,其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。It should be understood that, in order to implement the above-mentioned functions, the network device or the adjustment device includes corresponding hardware structures and/or software modules for executing each function. Those skilled in the art should easily realize that the present application can be implemented in hardware or a combination of hardware and computer software with the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.
本申请实施例可以根据上述方法示例对网络设备或者调整设备进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。需要说明的是,本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。In this embodiment of the present application, the network device or the adjustment device can be divided into functional modules according to the above method examples. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. It should be noted that, the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.
在采用集成的单元(模块)的情况下,图13示出了本申请实施例提供的一种网络设备的结构示意图。如图13所示,网络设备1000可以包括:获取单元1001和处理单元1002。In the case of using an integrated unit (module), FIG. 13 shows a schematic structural diagram of a network device provided by an embodiment of the present application. As shown in FIG. 13 , the network device 1000 may include: an obtaining unit 1001 and a processing unit 1002 .
其中,获取单元1001,用于支持网络设备1000获取第一应用的第一应用类型。具体的,当网络设备1000是从其他设备中获取第一应用的第一应用类型时,获取单元1001可以支持网络设备与其他设备的通信,例如与识别设备之间的通信。处理单元1002,用于对网络设备1000的动作进行控制管理,例如,处理单元1002用于支持网络设备1000执行图5-图11中所示的过程,和/或用于本文所描述的技术的其它过程。具体的,可以参考如下描述:The obtaining unit 1001 is configured to support the network device 1000 to obtain the first application type of the first application. Specifically, when the network device 1000 obtains the first application type of the first application from other devices, the obtaining unit 1001 may support communication between the network device and other devices, such as communication with the identification device. The processing unit 1002 is used to control and manage the actions of the network device 1000, for example, the processing unit 1002 is used to support the network device 1000 to perform the processes shown in FIGS. other processes. Specifically, you can refer to the following description:
获取单元1001,用于获取第一应用的第一应用类型;an obtaining unit 1001, configured to obtain a first application type of a first application;
处理单元1002,用于根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,所述第一拥塞参数用于得到第一拥塞控制算法,所述第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。A processing unit 1002, configured to obtain, according to the first application type, a first congestion parameter corresponding to the first application type, where the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control algorithm for performing congestion control on the traffic data of the first application.
在一种可能的设计中,处理单元1002用于根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数之后,还可以用于:基于所述第一拥塞参数获取所述第一拥塞控制算法;基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制。In a possible design, after the processing unit 1002 is configured to obtain, according to the first application type, the first congestion parameter corresponding to the first application type, the processing unit 1002 may also be configured to: obtain the first congestion parameter based on the first congestion parameter. the first congestion control algorithm; and based on the first congestion control algorithm, congestion control is performed on the traffic data of the first application.
在一种可能的设计中,处理单元1002用于基于所述第一拥塞控制算法对所述第一应 用的流量数据进行拥塞控制之后,还可以用于:获取基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;根据所述第一传输性能指标,调整所述第一拥塞参数。In a possible design, after the processing unit 1002 is configured to perform congestion control on the traffic data of the first application based on the first congestion control algorithm, the processing unit 1002 may also be configured to: obtain a pair of data based on the first congestion control algorithm. The first transmission performance index corresponding to the traffic data of the first application when congestion control is performed; the first congestion parameter is adjusted according to the first transmission performance index.
在一种可能设计中,处理单元1002用于根据所述第一传输性能指标,调整所述第一应用的第一应用类型对应的第一拥塞参数时,可以具体用于:根据所述第一传输性能指标,获取所述第一应用对传输性能指标的要求;根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数。In a possible design, when the processing unit 1002 is configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, the processing unit 1002 may be specifically configured to: according to the first The transmission performance indicator is to obtain the requirements of the first application for the transmission performance indicator; and the first congestion parameter is adjusted according to the requirements of the first application for the transmission performance indicator.
在一种可能的设计中,处理单元1002用于根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数是,可以具体用于:将所述第一传输性能指标输入目标函数,得到第一评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;基于所述第一评估值,调整所述第一拥塞参数。In a possible design, the processing unit 1002 is configured to adjust the first congestion parameter according to the requirements of the first application on the transmission performance indicator, which may be specifically used to: input the first transmission performance indicator into a target function to obtain a first evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index; and based on the first evaluation value, the first congestion parameter is adjusted.
在一种可能的设计中,所述第一传输性能指标可以包括至少两个性能指标,例如可以包括吞吐率和时延;所述第一应用对所述至少两个性能指标中的至少一个性能指标为高要求时,处理单元1002可以采用以下方式调整所述第一拥塞参数:In a possible design, the first transmission performance indicator may include at least two performance indicators, such as throughput and delay; the first application may perform at least one of the at least two performance indicators. When the indicator is high demand, the processing unit 1002 may adjust the first congestion parameter in the following manner:
按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;将所述第二传输性能指标输入所述目标函数,得到第二评估值;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter; obtain the adjusted first congestion control algorithm based on the adjusted first congestion parameter; The first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值大于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最大的第二评估值对应的调整方向,将所述第一评估值替换为所述最大的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均小于所述第一评估值时,则确定所述第一评估值为所述目标函数的最大评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than When the first evaluation value is used, the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
在一种可能的设计中,所述传输性能指标可以包括至少两个性能指标,例如可以包括吞吐率和时延;所述第一应用对所述至少两个性能指标均为低要求时,处理单元1002可以采用以下方式调整所述第一拥塞参数:In a possible design, the transmission performance indicator may include at least two performance indicators, such as throughput and delay; when the first application has low requirements for the at least two performance indicators, processing Unit 1002 may adjust the first congestion parameter in the following manner:
按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;将所述第二传 输性能指标输入所述目标函数,得到第二评估值;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter; obtain the adjusted first congestion control algorithm based on the adjusted first congestion parameter; The first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值小于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最小的第二评估值对应的调整方向,将所述第一评估值替换为所述最小的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均大于所述第一评估值时,则确定所述第一评估值为所述目标函数的最小评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
在一种可能的设计中,所述第一拥塞参数可以至少包括第一子参数和第二子参数;所述多个调整方向可以包括以下四个调整方向,所述第一调整方向可以为以下四个调整方向中的任意一种:增大所述第一子参数和所述第二子参数;增大所述第一子参数,减小所述第二子参数;减小所述第一子参数,增大所述第二子参数;减小所述第一子参数和所述第二子参数。In a possible design, the first congestion parameter may include at least a first sub-parameter and a second sub-parameter; the multiple adjustment directions may include the following four adjustment directions, and the first adjustment direction may be the following Any one of four adjustment directions: increase the first sub-parameter and the second sub-parameter; increase the first sub-parameter, decrease the second sub-parameter; decrease the first sub-parameter sub-parameter, increase the second sub-parameter; decrease the first sub-parameter and the second sub-parameter.
在一种可能的设计中,所述第一拥塞控制算法可以包括升窗算法和降窗算法,所述第一子参数可以为所述升窗算法对应的参数,所述第二子参数可以为所述降窗算法对应的参数。具体的,所述升窗算法表征为:In a possible design, the first congestion control algorithm may include a window-up algorithm and a window-down algorithm, the first sub-parameter may be a parameter corresponding to the window-up algorithm, and the second sub-parameter may be Parameters corresponding to the window reduction algorithm. Specifically, the window raising algorithm is characterized as:
Figure PCTCN2021082120-appb-000006
Figure PCTCN2021082120-appb-000006
所述降窗算法表征为:The window reduction algorithm is characterized as:
cwnd=cwnd(1-β)cwnd=cwnd(1-β)
其中,cwnd用于表示拥塞窗口值,α为所述第一子参数,β为所述第二子参数。Wherein, cwnd is used to represent the congestion window value, α is the first sub-parameter, and β is the second sub-parameter.
在一种可能的设计中,处理单元1002用于根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数时,可以用于:获取应用类型与拥塞参数之间的映射关系;基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数。其中,所述映射关系可以但不限于存储于网络设备1000的本地存储器、与网络设备1000连接的外部存储器、云端。In a possible design, when the processing unit 1002 is configured to acquire the first congestion parameter corresponding to the first application type according to the first application type, the processing unit 1002 may be configured to: acquire the mapping between the application type and the congestion parameter relationship; based on the mapping relationship and the first application type, obtain a first congestion parameter corresponding to the first application type. The mapping relationship may be, but not limited to, stored in the local storage of the network device 1000, an external storage connected to the network device 1000, and the cloud.
在一种可能的设计中,所述映射关系可以包括多个应用类型和所述多个应用类型对应的拥塞参数;对于所述映射关系中的至少一个应用类型中的任一应用类型,处理单元1002可以采用以下方式确定所述应用类型对应的拥塞参数:获取所述应用类型对应的初始拥塞参数,基于所述应用类型对应的初始拥塞参数,获取所述应用类型对应的初始拥塞控制算法;基于所述应用类型对应的初始拥塞控制算法,对所述应用类型对应的至少一个应用的流量数据进行拥塞控制,获得所述至少一个应用各自对应的初始传输性能指标;将所述至少一个应用各自对应的初始传输性能指标输入目标函数,得到至少一个初始评估值,所述 目标函数用于评估所述至少一个应用各自对传输性能指标的要求;采用强化学习方式基于所述至少一个初始评估值和所述至少一个应用各自的流量数据进行训练,得到所述应用类型对应的拥塞参数。In a possible design, the mapping relationship may include multiple application types and congestion parameters corresponding to the multiple application types; for any application type in the at least one application type in the mapping relationship, the processing unit 1002 may determine the congestion parameter corresponding to the application type in the following manner: obtain the initial congestion parameter corresponding to the application type, and obtain the initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type; The initial congestion control algorithm corresponding to the application type performs congestion control on the traffic data of at least one application corresponding to the application type, and obtains the initial transmission performance index corresponding to the at least one application; The initial transmission performance index is input into the objective function, and at least one initial evaluation value is obtained, and the objective function is used to evaluate the respective requirements of the at least one application on the transmission performance index; the reinforcement learning method is adopted based on the at least one initial evaluation value and all The traffic data of the at least one application is trained to obtain a congestion parameter corresponding to the application type.
在一种可能的设计中,处理单元1002用于基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数时,可以具体用于:若所述映射关系中不包括所述第一应用类型,则根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数;或者,若所述映射关系中包括所述第一应用类型,则根据所述第一应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数。In a possible design, when the processing unit 1002 is configured to obtain the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type, it may be specifically configured to: if the mapping If the relationship does not include the first application type, then obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or, if the If the mapping relationship includes the first application type, the first congestion parameter corresponding to the first application type is acquired according to the first application type and the mapping relationship.
在一种可能的设计中,处理单元1002用于根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数时,可以具体用于:根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型所属的第二应用类型对应的第二拥塞参数,基于所述第二拥塞参数获取第二拥塞控制算法;基于所述第二拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第三传输性能指标;将所述第三性能指标输入目标函数,得到第三评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;采用强化学习方式基于所述第三评估值和所述第一应用的流量数据进行训练,得到所述第一应用类型对应的第一拥塞参数。In a possible design, when the processing unit 1002 is configured to obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship, the processing unit 1002 may specifically use In: obtaining a second congestion parameter corresponding to the second application type to which the first application type belongs, according to the second application type to which the first application type belongs and the mapping relationship, and obtaining the second congestion parameter based on the second congestion parameter Two congestion control algorithms; a third transmission performance index corresponding to when congestion control is performed on the traffic data of the first application based on the second congestion control algorithm; inputting the third performance index into an objective function to obtain a third evaluation value ; The objective function is used to evaluate the requirements of the first application to the transmission performance index; The reinforcement learning method is used to train based on the third evaluation value and the traffic data of the first application to obtain the first application type The corresponding first congestion parameter.
在一种可能的设计中,处理单元1002用于根据所述第一传输性能指标,调整所述第一拥塞参数之后,还可以用于:基于调整后的第一拥塞参数,更新所述映射关系。In a possible design, after the processing unit 1002 is configured to adjust the first congestion parameter according to the first transmission performance indicator, the processing unit 1002 may also be configured to: update the mapping relationship based on the adjusted first congestion parameter .
应理解,网络设备1000中的各个模块的操作和/或功能分别为了实现图5-图11所示的拥塞控制方法的相应流程,为了简洁,在此不再赘述。It should be understood that the operations and/or functions of each module in the network device 1000 are respectively to implement the corresponding processes of the congestion control methods shown in FIGS.
在采用集成的单元(模块)的情况下,图14示出了本申请实施例提供的一种网络设备的结构示意图。如图14所示,调整设备1100可以包括:获取单元1101和处理单元1102。In the case of using an integrated unit (module), FIG. 14 shows a schematic structural diagram of a network device provided by an embodiment of the present application. As shown in FIG. 14 , the adjustment device 1100 may include: an acquisition unit 1101 and a processing unit 1102 .
其中,获取单元1101,用于支持调整设备1100获取第一应用的第一应用类型。具体的,当调整设备1100是从其他设备中获取第一应用的第一应用类型时,获取单元1101可以支持调整设备与其他设备的通信,例如与识别设备和/或网络设备之间的通信。处理单元1102,用于对调整设备1100的动作进行控制管理,例如,处理单元1102用于支持调整设备1100执行图12中所示的过程,和/或用于本文所描述的技术的其它过程。具体的,可以参考如下描述:The obtaining unit 1101 is configured to support the adjustment device 1100 to obtain the first application type of the first application. Specifically, when the adjustment device 1100 obtains the first application type of the first application from other devices, the obtaining unit 1101 may support communication between the adjustment device and other devices, such as communication with the identification device and/or the network device. The processing unit 1102 is used to control and manage the actions of the adjustment device 1100. For example, the processing unit 1102 is used to support the adjustment device 1100 to perform the process shown in FIG. 12, and/or other processes for the techniques described herein. Specifically, you can refer to the following description:
获取单元1101,用于获取基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;An obtaining unit 1101, configured to obtain a first transmission performance indicator corresponding to when congestion control is performed on the traffic data of the first application based on the first congestion control algorithm;
处理单元1102,用于根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数,调整后的第一拥塞参数用于得到调整后的第一拥塞控制算法,调整后的第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。A processing unit 1102, configured to adjust a first congestion parameter corresponding to a first application type of the first application according to the first transmission performance index, and the adjusted first congestion parameter is used to obtain an adjusted first congestion control algorithm , and the adjusted first congestion control algorithm is used to perform congestion control on the traffic data of the first application.
在一种可能的设计中,处理单元1102用于根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数时,可以具体用于:根据所述第一传输性能指标,获取所述第一应用对传输性能指标的要求;根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数。In a possible design, when the processing unit 1102 is configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, it may be specifically configured to: according to the first The transmission performance indicator is to obtain the requirements of the first application for the transmission performance indicator; and the first congestion parameter is adjusted according to the requirements of the first application for the transmission performance indicator.
在一种可能的设计中,处理单元1102用于根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数时,可以具体用于:将所述第一传输性能指标输入目标函数,得到第一评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;基于所述第一 评估值,调整所述第一拥塞参数。In a possible design, when the processing unit 1102 is configured to adjust the first congestion parameter according to the requirements of the first application on the transmission performance indicator, it may be specifically configured to: input the first transmission performance indicator into a target function to obtain a first evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index; and based on the first evaluation value, the first congestion parameter is adjusted.
在一种可能的设计中,所述第一拥塞控制算法可以包括升窗算法和降窗算法,所述第一子参数可以为所述升窗算法对应的参数,所述第二子参数可以为所述降窗算法对应的参数。具体的,所述升窗算法表征为:In a possible design, the first congestion control algorithm may include a window-up algorithm and a window-down algorithm, the first sub-parameter may be a parameter corresponding to the window-up algorithm, and the second sub-parameter may be Parameters corresponding to the window reduction algorithm. Specifically, the window raising algorithm is characterized as:
Figure PCTCN2021082120-appb-000007
Figure PCTCN2021082120-appb-000007
所述降窗算法表征为:The window reduction algorithm is characterized as:
cwnd=cwnd(1-β)cwnd=cwnd(1-β)
其中,cwnd用于表示拥塞窗口值,α为所述第一子参数,β为所述第二子参数。Wherein, cwnd is used to represent the congestion window value, α is the first sub-parameter, and β is the second sub-parameter.
在一种可能的设计中,所述第一传输性能指标可以包括至少两个性能指标,例如可以包括吞吐率和时延;所述第一应用对所述至少两个性能指标中的至少一个性能指标为高要求时,处理单元1102可以采用以下方式调整所述第一拥塞参数:In a possible design, the first transmission performance indicator may include at least two performance indicators, such as throughput and delay; the first application may perform at least one of the at least two performance indicators. When the indicator is high demand, the processing unit 1102 may adjust the first congestion parameter in the following manner:
按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;将所述第二传输性能指标输入所述目标函数,得到第二评估值;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter; obtain the adjusted first congestion control algorithm based on the adjusted first congestion parameter; The first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值大于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最大的第二评估值对应的调整方向,将所述第一评估值替换为所述最大的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均小于所述第一评估值时,则确定所述第一评估值为所述目标函数的最大评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than When the first evaluation value is used, the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
在一种可能的设计中,所述传输性能指标可以包括至少两个性能指标,例如可以包括吞吐率和时延;所述第一应用对所述至少两个性能指标均为低要求时,处理单元1102可以采用以下方式调整所述第一拥塞参数包括:In a possible design, the transmission performance indicator may include at least two performance indicators, such as throughput and delay; when the first application has low requirements for the at least two performance indicators, processing The unit 1102 may adjust the first congestion parameter in the following manner, including:
按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;将所述第二传输性能指标输入所述目标函数,得到第二评估值;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter; obtain the adjusted first congestion control algorithm based on the adjusted first congestion parameter; The first congestion control algorithm performs congestion control on the traffic data of the first application, and acquires a second transmission performance index corresponding to when the adjusted first congestion control algorithm performs congestion control on the traffic data of the first application; Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一 拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值小于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最小的第二评估值对应的调整方向,将所述第一评估值替换为所述最小的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均大于所述第一评估值时,则确定所述第一评估值为所述目标函数的最小评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
在一种的可能设计中,所述第一拥塞参数至少包括第一子参数和第二子参数;所述多个调整方向包括以下四个调整方向,所述第一调整方向为以下四个调整方向中的任意一种:增大所述第一子参数和所述第二子参数;增大所述第一子参数,减小所述第二子参数;减小所述第一子参数,增大所述第二子参数;减小所述第一子参数和所述第二子参数。In a possible design, the first congestion parameter includes at least a first sub-parameter and a second sub-parameter; the multiple adjustment directions include the following four adjustment directions, and the first adjustment direction is the following four adjustment directions any one of the directions: increase the first sub-parameter and the second sub-parameter; increase the first sub-parameter, decrease the second sub-parameter; decrease the first sub-parameter, Increase the second sub-parameter; decrease the first sub-parameter and the second sub-parameter.
在一种可能的设计中,处理单元1102用于根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数之前,还可以用于:获取应用类型与拥塞参数之间的映射关系;基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数。其中,所述映射关系可以但不限于存储于调整设备1100的本地存储器、与调整设备1100连接的外部存储器、与调整设备1100连接的其他设备(如网络设备)、云端。In a possible design, before the processing unit 1102 is configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, the processing unit 1102 may also be configured to: obtain the application type and the congestion parameter A mapping relationship between parameters; based on the mapping relationship and the first application type, obtain a first congestion parameter corresponding to the first application type. The mapping relationship may be, but not limited to, stored in the local memory of the adjustment device 1100, an external memory connected to the adjustment device 1100, other devices (eg, network devices) connected to the adjustment device 1100, and the cloud.
在一种可能的设计中,所述映射关系可以包括多个应用类型和所述多个应用类型对应的拥塞参数;对于所述映射关系中的至少一个应用类型中的任一应用类型,处理单元1102可以采用以下方式确定所述应用类型对应的拥塞参数:获取所述应用类型对应的初始拥塞参数,基于所述应用类型对应的初始拥塞参数,获取所述应用类型对应的初始拥塞控制算法;基于所述应用类型对应的初始拥塞控制算法,对所述应用类型对应的至少一个应用的流量数据进行拥塞控制,获得所述至少一个应用各自对应的初始传输性能指标;将所述至少一个应用各自对应的初始传输性能指标输入目标函数,得到至少一个初始评估值,所述目标函数用于评估所述至少一个应用各自对传输性能指标的要求;采用强化学习方式基于所述至少一个初始评估值和所述至少一个应用各自的流量数据进行训练,得到所述应用类型对应的拥塞参数。In a possible design, the mapping relationship may include multiple application types and congestion parameters corresponding to the multiple application types; for any application type in the at least one application type in the mapping relationship, the processing unit 1102 may determine the congestion parameter corresponding to the application type in the following manner: obtain the initial congestion parameter corresponding to the application type, and obtain the initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type; The initial congestion control algorithm corresponding to the application type performs congestion control on the traffic data of at least one application corresponding to the application type, and obtains the initial transmission performance index corresponding to the at least one application; The initial transmission performance index is input into the objective function, and at least one initial evaluation value is obtained, and the objective function is used to evaluate the respective requirements of the at least one application on the transmission performance index; the reinforcement learning method is adopted based on the at least one initial evaluation value and all The traffic data of the at least one application is trained to obtain a congestion parameter corresponding to the application type.
在一种可能的设计中,处理单元1102用于基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数时,可以具体用于:若所述映射关系中不包括所述第一应用类型,则根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数;或者,若所述映射关系中包括所述第一应用类型,则根据所述第一应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数。In a possible design, when the processing unit 1102 is configured to acquire the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type, the processing unit 1102 may be specifically configured to: if the mapping If the relationship does not include the first application type, then obtain the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or, if the If the mapping relationship includes the first application type, the first congestion parameter corresponding to the first application type is acquired according to the first application type and the mapping relationship.
在一种可能的设计中,处理单元1102用于根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数时,可以具体用于:根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型所属的第二 应用类型对应的第二拥塞参数,基于所述第二拥塞参数获取第二拥塞控制算法;基于所述第二拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第三传输性能指标;将所述第三性能指标输入目标函数,得到第三评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;采用强化学习方式基于所述第三评估值和所述第一应用的流量数据进行训练,得到所述第一应用类型对应的第一拥塞参数。In a possible design, when the processing unit 1102 is configured to acquire the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship, the processing unit 1102 may specifically use In: obtaining a second congestion parameter corresponding to the second application type to which the first application type belongs, according to the second application type to which the first application type belongs and the mapping relationship, and obtaining the second congestion parameter based on the second congestion parameter Two congestion control algorithms; a third transmission performance index corresponding to when congestion control is performed on the traffic data of the first application based on the second congestion control algorithm; inputting the third performance index into an objective function to obtain a third evaluation value ; The objective function is used to evaluate the requirements of the first application to the transmission performance index; The reinforcement learning method is used to train based on the third evaluation value and the traffic data of the first application to obtain the first application type The corresponding first congestion parameter.
应理解,调整设备1100中的各个模块的操作和/或功能分别为了实现图12所示的拥塞控制方法的相应流程,为了简洁,在此不再赘述。It should be understood that the operations and/or functions of the various modules in the adjustment device 1100 are respectively to implement the corresponding flow of the congestion control method shown in FIG. 12 , and are not repeated here for brevity.
在采用集成的单元(模块)的情况下,在采用集成的单元(模块)的情况下,图15示出了本申请实施例提供的一种网络设备的结构示意图。如图15所示,网络设备1200可以包括至少一个处理器1201和存储器1202;所述存储器1202存储一个或多个计算机程序,例如用于存储网络设备1200必要的一个或多个计算机程序。所述至少一个处理器1201用于支持网络设备1200实现上述拥塞控制方法,例如,当所述存储器1202存储的一个或多个计算机程序被所述至少一个处理器1201执行时,使得所述网络设备1200可以实现图5-图11所示的任意一种可能,和/或用于实现本文所描述的其他实施例。In the case of using an integrated unit (module), in the case of using an integrated unit (module), FIG. 15 shows a schematic structural diagram of a network device provided by an embodiment of the present application. As shown in FIG. 15 , the network device 1200 may include at least one processor 1201 and a memory 1202 ; the memory 1202 stores one or more computer programs, such as for storing one or more computer programs necessary for the network device 1200 . The at least one processor 1201 is configured to support the network device 1200 to implement the above congestion control method. For example, when one or more computer programs stored in the memory 1202 are executed by the at least one processor 1201, the network device 1200 may implement any of the possibilities shown in Figures 5-11, and/or be used to implement other embodiments described herein.
在采用集成的单元(模块)的情况下,在采用集成的单元(模块)的情况下,图16示出了本申请实施例提供的一种调整设备的结构示意图。如图16所示,调整设备1300可以包括至少一个处理器1301和存储器1302;所述存储器1302存储一个或多个计算机程序,例如用于存储调整设备1300必要的一个或多个计算机程序。所述至少一个处理器1301用于支持调整设备1300实现上述拥塞控制方法,例如,当所述存储器1302存储的一个或多个计算机程序被所述至少一个处理器1301执行时,使得所述调整设备1300可以实现图12所示的任意一种可能,和/或用于实现本文所描述的其他实施例。In the case of using an integrated unit (module), in the case of using an integrated unit (module), FIG. 16 shows a schematic structural diagram of an adjustment device provided by an embodiment of the present application. As shown in FIG. 16 , the adjustment device 1300 may include at least one processor 1301 and a memory 1302 ; the memory 1302 stores one or more computer programs, for example, for storing one or more computer programs necessary for the adjustment device 1300 . The at least one processor 1301 is configured to support the adjustment device 1300 to implement the above-mentioned congestion control method. For example, when one or more computer programs stored in the memory 1302 are executed by the at least one processor 1301, the adjustment device 1300 may implement any of the possibilities shown in FIG. 12, and/or be used to implement other embodiments described herein.
基于与上述方法实施例相同构思,本申请实施例中还提供一种计算机可读存储介质或非易失性存储介质,所述计算机可读存储介质或非易失性存储介质存储有计算机指令或计算机程序,当所述计算机指令或计算机程序在计算机上运行时,使得所述计算机执行上述拥塞控制方法的实施例、实施例的任意一种可能的实现方式,或当所述计算机指令或计算机程序在一个或多个处理器上运行时,使得包含所述一个或多个处理器的网络设备或调整设备执行上述拥塞控制方法的实施例、实施例的任意一种可能的实现方式,例如执行图5-图11或图12所示的拥塞控制方法的实施例的任意步骤,和/或执行本文所描述的技术的其它过程。Based on the same concept as the foregoing method embodiments, the embodiments of the present application further provide a computer-readable storage medium or a non-volatile storage medium, where the computer-readable storage medium or the non-volatile storage medium stores computer instructions or A computer program, when the computer instructions or computer programs are run on a computer, causing the computer to execute the above-mentioned embodiments of the congestion control method, any possible implementation of the embodiments, or when the computer instructions or computer programs are executed. When running on one or more processors, the network device or adjustment device including the one or more processors is made to execute the embodiments of the congestion control method and any possible implementation manners of the embodiments, such as the execution diagram of the 5—Any steps of the embodiments of the congestion control method shown in FIG. 11 or FIG. 12, and/or other processes that perform the techniques described herein.
基于与上述方法实施例相同构思,本申请实施例中还提供一种程序产品,所述计算机程序产品用于存储计算机程序,当所述计算机程序在计算机上运行时,使得所述计算机执行上述拥塞控制方法的实施例、实施例的任意一种可能的实现方式,或当所述计算机指令或计算机程序在一个或多个处理器上运行时,使得包含所述一个或多个处理器的网络设备或调整设备执行上述拥塞控制方法的实施例、实施例的任意一种可能的实现方式,例如执行图5-图11或图12所示的拥塞控制方法的实施例的任意步骤,和/或执行本文所描述的技术的其它过程。Based on the same concept as the above method embodiments, the embodiments of the present application also provide a program product, the computer program product is used to store a computer program, and when the computer program runs on a computer, the computer is made to execute the above congestion Embodiments of the control method, any possible implementations of the embodiments, or when the computer instructions or computer programs run on one or more processors, make a network device including the one or more processors Or adjust the device to perform the above-mentioned embodiment of the congestion control method and any possible implementation manner of the embodiment, for example, perform any step of the embodiment of the congestion control method shown in FIG. 5-FIG. 11 or FIG. 12 , and/or perform Other procedures for the techniques described herein.
应理解,本申请实施例中的处理器(如图15、图16所示的处理器)可以是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述拥塞控制方法的实施例的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器可以是通用中央处理器(central processing unit,CPU),通用处理器,数字信号处理(digital signal  processing,DSP),专用集成电路(application specific integrated circuits,ASIC),现场可编程门阵列(field programmable gate array,FPGA)或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合;也可以是实现计算功能的组合,例如包括一个或多个微处理器组合,DSP和微处理器的组合等等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。It should be understood that the processor in the embodiment of the present application (the processor shown in FIG. 15 and FIG. 16 ) may be an integrated circuit chip, which has the capability of processing signals. In the implementation process, each step of the above-mentioned embodiment of the congestion control method may be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The above-mentioned processor can be a general-purpose central processing unit (central processing unit, CPU), a general-purpose processor, a digital signal processing (digital signal processing, DSP), an application specific integrated circuit (application specific integrated circuits, ASIC), a field programmable gate array (field programmable gate array, FPGA) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof; it may also be a combination that implements computing functions, such as a combination of one or more microprocessors, DSP and microprocessor combination of devices, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
应理解,本申请实施例中的存储器(如图15、图16所示的存储器)可以是是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(read-only memory,ROM)、可编程只读存储器(programmable ROM,PROM)、可擦除可编程只读存储器(erasable PROM,EPROM)、电可擦除可编程只读存储器(electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(random access memory,RAM),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(static RAM,SRAM)、动态随机存取存储器(dynamic RAM,DRAM)、同步动态随机存取存储器(synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(double data rate SDRAM,DDR SDRAM)、增强型同步动态随机存取存储器(enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(synchlink DRAM,SLDRAM)和直接内存总线随机存取存储器(direct rambus RAM,DR RAM)。应注意,本申请描述的系统和方法的存储器旨在包括但不限于这些和任意其它适合类型的存储器。It should be understood that the memory (the memory shown in FIG. 15 and FIG. 16 ) in this embodiment of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory . The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically programmable Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory. Volatile memory may be random access memory (RAM), which acts as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (synchlink DRAM, SLDRAM) ) and direct memory bus random access memory (direct rambus RAM, DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but not be limited to, these and any other suitable types of memory.
本申请实施例中所描述的各种说明性的逻辑单元和电路可以通过通用处理器,数字信号处理器,专用集成电路(application specific integrated circuit,ASIC),现场可编程门阵列(field programmable gate array,FPGA)或其它可编程逻辑装置,离散门或晶体管逻辑,离散硬件部件,或上述任何组合的设计来实现或操作所描述的功能。通用处理器可以为微处理器,可选地,该通用处理器也可以为任何传统的处理器、控制器、微控制器或状态机。处理器也可以通过计算装置的组合来实现,例如数字信号处理器和微处理器,多个微处理器,一个或多个微处理器联合一个数字信号处理器核,或任何其它类似的配置来实现。The various illustrative logic units and circuits described in the embodiments of the present application can be implemented by general-purpose processors, digital signal processors, application-specific integrated circuits (ASICs), field programmable gate arrays (field programmable gate arrays). , FPGA) or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, or any combination of the above designed to implement or operate the described functions. A general-purpose processor may be a microprocessor, or alternatively, the general-purpose processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented by a combination of computing devices, such as a digital signal processor and a microprocessor, multiple microprocessors, one or more microprocessors in combination with a digital signal processor core, or any other similar configuration. accomplish.
本申请实施例中所描述的方法或算法的步骤可以直接嵌入硬件、处理器执行的软件单元、或者这两者的结合。软件单元可以存储于RAM、闪存、ROM、EPROM、EEPROM、寄存器、硬盘、可移动磁盘、CD-ROM或本领域中其它任意形式的存储媒介中。示例性地,存储媒介可以与处理器连接,以使得处理器可以从存储媒介中读取信息,并可以向存储媒介存写信息。可选地,存储媒介还可以集成到处理器中。处理器和存储媒介可以设置于ASIC中,ASIC可以设置于网络设备或调整设备中,例如可以设置于网络设备或调整设备中的不同的部件中。The steps of the method or algorithm described in the embodiments of this application may be directly embedded in hardware, a software unit executed by a processor, or a combination of the two. The software unit may be stored in RAM, flash memory, ROM, EPROM, EEPROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art. Illustratively, a storage medium may be coupled to the processor such that the processor may read information from, and store information in, the storage medium. Optionally, the storage medium can also be integrated into the processor. The processor and the storage medium may be provided in an ASIC, which may be provided in the network device or the adjustment device, for example, in different components of the network device or the adjustment device.
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机程序或指令。在计算机上加载和执行所述计算机程序或指令时,全部或部分地执行本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机程序或指令可以存储在计算机可读存储介质中,或者通过所述计算机可读存储介质进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是集成一个或多个可用介质的服务器等数据存储设备。所述可用介质可以是磁性介质,例如,软盘、硬盘、磁带;也可以是光介质,例 如,DVD;还可以是半导体介质,例如,固态硬盘(solid state disk,SSD)。In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are executed in whole or in part. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer program or instructions may be stored in or transmitted over a computer-readable storage medium. The computer-readable storage medium can be any available media that can be accessed by a computer or a data storage device such as a server that integrates one or more available media. The usable media may be magnetic media, such as floppy disks, hard disks, magnetic tapes; optical media, such as DVDs; and semiconductor media, such as solid state disks (SSD).
本申请实施例是参照实施例所涉及的方法、装置、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The embodiments of the present application are described with reference to the flowcharts and/or block diagrams of the methods, apparatuses, and computer program products involved in the embodiments. It will be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.
尽管结合具体特征对本申请实施例进行了描述,显而易见的,在不脱离本申请实施例的精神和范围的情况下,可对其进行各种修改和组合。相应地,本说明书和附图仅仅是所附权利要求所界定的本申请实施例的示例性说明,且视为已覆盖本申请实施例范围内的任意和所有修改、变化、组合或等同物。Although the embodiments of the present application have been described in conjunction with specific features, it will be apparent that various modifications and combinations may be made without departing from the spirit and scope of the embodiments of the present application. Accordingly, the present specification and drawings are merely illustrative of the embodiments of the present application as defined by the appended claims, and are deemed to cover any and all modifications, variations, combinations or equivalents within the scope of the embodiments of the present application.

Claims (44)

  1. 一种拥塞控制方法,其特征在于,包括:A congestion control method, comprising:
    获取第一应用的第一应用类型;Obtain the first application type of the first application;
    根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,所述第一拥塞参数用于得到第一拥塞控制算法,所述第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。According to the first application type, a first congestion parameter corresponding to the first application type is obtained, the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control algorithm is used to The traffic data of an application performs congestion control.
  2. 如权利要求1所述的方法,其特征在于,根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数之后,还包括:The method according to claim 1, wherein after acquiring the first congestion parameter corresponding to the first application type according to the first application type, the method further comprises:
    基于所述第一拥塞参数获取所述第一拥塞控制算法;obtaining the first congestion control algorithm based on the first congestion parameter;
    基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制。Congestion control is performed on the traffic data of the first application based on the first congestion control algorithm.
  3. 如权利要求2所述的方法,其特征在于,基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制之后,还包括:The method according to claim 2, wherein after performing congestion control on the traffic data of the first application based on the first congestion control algorithm, the method further comprises:
    获取基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;acquiring a first transmission performance indicator corresponding to when congestion control is performed on the traffic data of the first application based on the first congestion control algorithm;
    根据所述第一传输性能指标,调整所述第一拥塞参数。The first congestion parameter is adjusted according to the first transmission performance index.
  4. 如权利要求3所述的方法,其特征在于,根据所述第一传输性能指标,调整所述第一拥塞参数,包括:The method of claim 3, wherein adjusting the first congestion parameter according to the first transmission performance indicator comprises:
    根据所述第一传输性能指标,获取所述第一应用对传输性能指标的要求;Obtaining, according to the first transmission performance indicator, a requirement of the first application for the transmission performance indicator;
    根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数。The first congestion parameter is adjusted according to the requirements of the first application for transmission performance indicators.
  5. 如权利要求4所述的方法,其特征在于,根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数,包括:The method according to claim 4, wherein adjusting the first congestion parameter according to the requirements of the first application on the transmission performance indicator comprises:
    将所述第一传输性能指标输入目标函数,得到第一评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;Inputting the first transmission performance index into an objective function to obtain a first evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index;
    基于所述第一评估值,调整所述第一拥塞参数。Based on the first evaluation value, the first congestion parameter is adjusted.
  6. 如权利要求5所述的方法,其特征在于,所述第一传输性能指标包括至少两个性能指标;所述第一应用对所述至少两个性能指标中的至少一个性能指标为高要求时,采用以下方式调整所述第一拥塞参数:The method according to claim 5, wherein the first transmission performance indicator comprises at least two performance indicators; when the first application has high requirements on at least one of the at least two performance indicators , adjust the first congestion parameter in the following manner:
    按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter;
    基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;obtaining an adjusted first congestion control algorithm based on the adjusted first congestion parameter;
    基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;Congestion control is performed on the traffic data of the first application based on the adjusted first congestion control algorithm, and the corresponding second Transmission performance indicators;
    将所述第二传输性能指标输入所述目标函数,得到第二评估值;Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
    若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
    若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多 个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值大于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最大的第二评估值对应的调整方向,将所述第一评估值替换为所述最大的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均小于所述第一评估值时,则确定所述第一评估值为所述目标函数的最大评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than When the first evaluation value is used, the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  7. 如权利要求5所述的方法,其特征在于,所述传输性能指标包括至少两个性能指标;所述第一应用对所述至少两个性能指标均为低要求时,采用以下方式调整所述第一拥塞参数包括:The method according to claim 5, wherein the transmission performance indicators include at least two performance indicators; when the first application has low requirements for the at least two performance indicators, the following methods are used to adjust the The first congestion parameters include:
    按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter;
    基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;obtaining an adjusted first congestion control algorithm based on the adjusted first congestion parameter;
    基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;Congestion control is performed on the traffic data of the first application based on the adjusted first congestion control algorithm, and the corresponding second Transmission performance indicators;
    将所述第二传输性能指标输入所述目标函数,得到第二评估值;Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
    若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
    若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值小于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最小的第二评估值对应的调整方向,将所述第一评估值替换为所述最小的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均大于所述第一评估值时,则确定所述第一评估值为所述目标函数的最小评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  8. 如权利要求6或7所述的方法,其特征在于,所述第一拥塞参数至少包括第一子参数和第二子参数;The method according to claim 6 or 7, wherein the first congestion parameter includes at least a first sub-parameter and a second sub-parameter;
    所述多个调整方向包括以下四个调整方向,所述第一调整方向为以下四个调整方向中的任意一种:The multiple adjustment directions include the following four adjustment directions, and the first adjustment direction is any one of the following four adjustment directions:
    增大所述第一子参数和所述第二子参数;increasing the first sub-parameter and the second sub-parameter;
    增大所述第一子参数,减小所述第二子参数;increasing the first sub-parameter and decreasing the second sub-parameter;
    减小所述第一子参数,增大所述第二子参数;Decrease the first sub-parameter and increase the second sub-parameter;
    减小所述第一子参数和所述第二子参数。Decrease the first subparameter and the second subparameter.
  9. 如权利要求8所述的方法,其特征在于,所述第一拥塞控制算法包括升窗算法和降窗算法,所述第一子参数为所述升窗算法对应的参数,所述第二子参数为所述降窗算法对应的参数。The method according to claim 8, wherein the first congestion control algorithm includes a window raising algorithm and a window lowering algorithm, the first sub-parameter is a parameter corresponding to the window raising algorithm, and the second sub-parameter is a parameter corresponding to the window raising algorithm. The parameters are parameters corresponding to the window reduction algorithm.
  10. 如权利要求9所述的方法,其特征在于,所述升窗算法表征为:The method of claim 9, wherein the window raising algorithm is characterized as:
    Figure PCTCN2021082120-appb-100001
    Figure PCTCN2021082120-appb-100001
    所述降窗算法表征为:The window reduction algorithm is characterized as:
    cwnd=cwnd(1-β)cwnd=cwnd(1-β)
    其中,cwnd用于表示拥塞窗口值,α为所述第一子参数,β为所述第二子参数。Wherein, cwnd is used to represent the congestion window value, α is the first sub-parameter, and β is the second sub-parameter.
  11. 如权利要求1-10任一项所述的方法,其特征在于,根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,包括:The method according to any one of claims 1-10, wherein obtaining the first congestion parameter corresponding to the first application type according to the first application type, comprising:
    获取应用类型与拥塞参数之间的映射关系;Obtain the mapping relationship between application types and congestion parameters;
    基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数。Based on the mapping relationship and the first application type, a first congestion parameter corresponding to the first application type is acquired.
  12. 如权利要求11所述的方法,其特征在于,所述映射关系包括多个应用类型和所述多个应用类型对应的拥塞参数;对于所述映射关系中的至少一个应用类型中的任一应用类型,采用以下方式确定所述应用类型对应的拥塞参数:The method according to claim 11, wherein the mapping relationship includes multiple application types and congestion parameters corresponding to the multiple application types; for any application in at least one application type in the mapping relationship Type, determine the congestion parameter corresponding to the application type in the following way:
    获取所述应用类型对应的初始拥塞参数,基于所述应用类型对应的初始拥塞参数,获取所述应用类型对应的初始拥塞控制算法;obtaining an initial congestion parameter corresponding to the application type, and obtaining an initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type;
    基于所述应用类型对应的初始拥塞控制算法,对所述应用类型对应的至少一个应用的流量数据进行拥塞控制,获得所述至少一个应用各自对应的初始传输性能指标;Based on the initial congestion control algorithm corresponding to the application type, congestion control is performed on the traffic data of at least one application corresponding to the application type, and the initial transmission performance index corresponding to the at least one application is obtained;
    将所述至少一个应用各自对应的初始传输性能指标输入目标函数,得到至少一个初始评估值,所述目标函数用于评估所述至少一个应用各自对传输性能指标的要求;Inputting the respective initial transmission performance indicators of the at least one application into an objective function to obtain at least one initial evaluation value, and the objective function is used to evaluate the respective requirements of the at least one application on the transmission performance indicators;
    采用强化学习方式基于所述至少一个初始评估值和所述至少一个应用各自的流量数据进行训练,得到所述应用类型对应的拥塞参数。The training is performed based on the at least one initial evaluation value and the respective traffic data of the at least one application in a reinforcement learning manner, and the congestion parameter corresponding to the application type is obtained.
  13. 如权利要求11或12所述的方法,其特征在于,基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,包括:The method according to claim 11 or 12, wherein obtaining the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type, comprising:
    若所述映射关系中不包括所述第一应用类型,则根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数;或者,If the mapping relationship does not include the first application type, obtain a first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or ,
    若所述映射关系中包括所述第一应用类型,则根据所述第一应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数。If the mapping relationship includes the first application type, obtain a first congestion parameter corresponding to the first application type according to the first application type and the mapping relationship.
  14. 如权利要求13所述的方法,其特征在于,根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数,包括:The method according to claim 13, wherein obtaining the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship, comprising:
    根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型所属的第二应用类型对应的第二拥塞参数,基于所述第二拥塞参数获取第二拥塞控制算法;According to the second application type to which the first application type belongs and the mapping relationship, a second congestion parameter corresponding to the second application type to which the first application type belongs is obtained, and a second congestion parameter is obtained based on the second congestion parameter control algorithm;
    获取基于所述第二拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第三传输性能指标;acquiring a third transmission performance indicator corresponding to when congestion control is performed on the traffic data of the first application based on the second congestion control algorithm;
    将所述第三性能指标输入目标函数,得到第三评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;Inputting the third performance index into an objective function to obtain a third evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index;
    采用强化学习方式基于所述第三评估值和所述第一应用的流量数据进行训练,得到所 述第一应用类型对应的第一拥塞参数。The reinforcement learning method is used to perform training based on the third evaluation value and the traffic data of the first application, so as to obtain the first congestion parameter corresponding to the first application type.
  15. 如权利要求11所述的方法,其特征在于,根据所述第一传输性能指标,调整所述第一拥塞参数之后,还包括:The method according to claim 11, wherein after adjusting the first congestion parameter according to the first transmission performance indicator, the method further comprises:
    基于调整后的第一拥塞参数,更新所述映射关系。Based on the adjusted first congestion parameter, the mapping relationship is updated.
  16. 如权利要求3-15任一项所述的方法,其特征在于,所述第一传输性能指标包括吞吐率和时延。The method according to any one of claims 3-15, wherein the first transmission performance indicator includes throughput and delay.
  17. 一种拥塞控制方法,其特征在于,包括:A congestion control method, comprising:
    获取基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;acquiring a first transmission performance indicator corresponding to when congestion control is performed on the traffic data of the first application based on the first congestion control algorithm;
    根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数,调整后的第一拥塞参数用于得到调整后的第一拥塞控制算法,调整后的第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。The first congestion parameter corresponding to the first application type of the first application is adjusted according to the first transmission performance index, and the adjusted first congestion parameter is used to obtain an adjusted first congestion control algorithm. The congestion control algorithm is used to perform congestion control on the traffic data of the first application.
  18. 如权利要求17所述的方法,其特征在于,根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数,包括:The method according to claim 17, wherein adjusting the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator comprises:
    根据所述第一传输性能指标,获取所述第一应用对传输性能指标的要求;Obtaining, according to the first transmission performance indicator, a requirement of the first application for the transmission performance indicator;
    根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数。The first congestion parameter is adjusted according to the requirements of the first application for transmission performance indicators.
  19. 如权利要求18所述的方法,其特征在于,根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数,包括:The method according to claim 18, wherein adjusting the first congestion parameter according to the requirements of the first application on the transmission performance index, comprising:
    将所述第一传输性能指标输入目标函数,得到第一评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;Inputting the first transmission performance index into an objective function to obtain a first evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index;
    基于所述第一评估值,调整所述第一拥塞参数。Based on the first evaluation value, the first congestion parameter is adjusted.
  20. 如权利要求17-19任一项所述的方法,其特征在于,所述第一传输性能指标包括至少两个性能指标;所述第一应用对所述至少两个性能指标中的至少一个性能指标为高要求时,采用以下方式调整所述第一拥塞参数:The method according to any one of claims 17-19, wherein the first transmission performance indicator comprises at least two performance indicators; and the first application performs at least one of the at least two performance indicators When the indicator is of high demand, the first congestion parameter is adjusted in the following manner:
    按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter;
    基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;obtaining an adjusted first congestion control algorithm based on the adjusted first congestion parameter;
    基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;Congestion control is performed on the traffic data of the first application based on the adjusted first congestion control algorithm, and the corresponding second Transmission performance indicators;
    将所述第二传输性能指标输入所述目标函数,得到第二评估值;Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
    若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
    若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值大于所述第一评估值时,将所述第一调整方向替换为所述至少 一个第二评估值中最大的第二评估值对应的调整方向,将所述第一评估值替换为所述最大的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均小于所述第一评估值时,则确定所述第一评估值为所述目标函数的最大评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is greater than When the first evaluation value is used, the first adjustment direction is replaced with the adjustment direction corresponding to the largest second evaluation value in the at least one second evaluation value, and the first evaluation value is replaced by the largest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all smaller than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the maximum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  21. 如权利要求17-19任一项所述的方法,其特征在于,所述传输性能指标包括至少两个性能指标;所述第一应用对所述至少两个性能指标均为低要求时,采用以下方式调整所述第一拥塞参数包括:The method according to any one of claims 17 to 19, wherein the transmission performance indicators include at least two performance indicators; when the first application has low requirements for the at least two performance indicators, adopting Adjusting the first congestion parameter in the following manner includes:
    按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;Adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions to obtain the adjusted first congestion parameter;
    基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法;obtaining an adjusted first congestion control algorithm based on the adjusted first congestion parameter;
    基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制,并获取基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标;Congestion control is performed on the traffic data of the first application based on the adjusted first congestion control algorithm, and the corresponding second Transmission performance indicators;
    将所述第二传输性能指标输入所述目标函数,得到第二评估值;Inputting the second transmission performance index into the objective function to obtain a second evaluation value;
    若所述第二评估值小于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,将所述第一评估值替换为所述第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;或者,If the second evaluation value is smaller than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, replace the first evaluation value with the second evaluation value, and return Adjusting the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions is performed to obtain the adjusted first congestion parameter; or,
    若所述第二评估值大于所述第一评估值,则将所述第一拥塞参数替换为调整后的第一拥塞参数,按照所述多个调整方向中的其他调整方向分别调整所述第一拥塞参数,得到多个调整后的第一拥塞参数,所述其他调整方向为所述多个调整方向中除去所述第一调整方向之外的调整方向;基于多个调整后的第一拥塞参数,分别返回执行基于调整后的第一拥塞参数获取调整后的第一拥塞控制算法,直至得到多个第二评估值;当所述多个第二评估值中的至少一个第二评估值小于所述第一评估值时,将所述第一调整方向替换为所述至少一个第二评估值中最小的第二评估值对应的调整方向,将所述第一评估值替换为所述最小的第二评估值,返回执行按照多个调整方向中的第一调整方向调整所述第一拥塞参数,得到调整后的第一拥塞参数;当所述多个第二评估值均大于所述第一评估值时,则确定所述第一评估值为所述目标函数的最小评估值,将所述第一评估值当前对应的第一拥塞参数作为最终的第一拥塞参数。If the second evaluation value is greater than the first evaluation value, replace the first congestion parameter with the adjusted first congestion parameter, and adjust the first congestion parameter according to other adjustment directions among the plurality of adjustment directions. a congestion parameter to obtain a plurality of adjusted first congestion parameters, and the other adjustment directions are adjustment directions other than the first adjustment direction among the plurality of adjustment directions; based on the plurality of adjusted first congestion parameters parameters, respectively return to execute the adjusted first congestion control algorithm based on the adjusted first congestion parameters, until multiple second evaluation values are obtained; when at least one of the multiple second evaluation values is less than In the case of the first evaluation value, the first adjustment direction is replaced with the adjustment direction corresponding to the smallest second evaluation value among the at least one second evaluation value, and the first evaluation value is replaced by the smallest second evaluation value. For the second evaluation value, return to adjust the first congestion parameter according to the first adjustment direction among the plurality of adjustment directions, and obtain the adjusted first congestion parameter; when the plurality of second evaluation values are all greater than the first adjustment direction When the evaluation value is obtained, the first evaluation value is determined as the minimum evaluation value of the objective function, and the first congestion parameter currently corresponding to the first evaluation value is used as the final first congestion parameter.
  22. 如权利要求20或21所述的方法,其特征在于,所述第一拥塞参数至少包括第一子参数和第二子参数;The method according to claim 20 or 21, wherein the first congestion parameter includes at least a first sub-parameter and a second sub-parameter;
    所述多个调整方向包括以下四个调整方向,所述第一调整方向为以下四个调整方向中的任意一种:The multiple adjustment directions include the following four adjustment directions, and the first adjustment direction is any one of the following four adjustment directions:
    增大所述第一子参数和所述第二子参数;increasing the first sub-parameter and the second sub-parameter;
    增大所述第一子参数,减小所述第二子参数;increasing the first sub-parameter and decreasing the second sub-parameter;
    减小所述第一子参数,增大所述第二子参数;Decrease the first sub-parameter and increase the second sub-parameter;
    减小所述第一子参数和所述第二子参数。Decrease the first subparameter and the second subparameter.
  23. 如权利要求17-22任一项所述的方法,其特征在于,根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数之前,还包括:The method according to any one of claims 17-22, wherein before adjusting the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, the method further comprises:
    获取应用类型与拥塞参数之间的映射关系;Obtain the mapping relationship between application types and congestion parameters;
    基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数。Based on the mapping relationship and the first application type, a first congestion parameter corresponding to the first application type is acquired.
  24. 如权利要求23所述的方法,其特征在于,所述映射关系包括多个应用类型和所述多个应用类型对应的拥塞参数;对于所述映射关系中的至少一个应用类型中的任一应用类型,采用以下方式确定所述应用类型对应的拥塞参数:The method of claim 23, wherein the mapping relationship includes multiple application types and congestion parameters corresponding to the multiple application types; for any application in the at least one application type in the mapping relationship Type, determine the congestion parameter corresponding to the application type in the following way:
    获取所述应用类型对应的初始拥塞参数,基于所述应用类型对应的初始拥塞参数,获取所述应用类型对应的初始拥塞控制算法;obtaining an initial congestion parameter corresponding to the application type, and obtaining an initial congestion control algorithm corresponding to the application type based on the initial congestion parameter corresponding to the application type;
    基于所述应用类型对应的初始拥塞控制算法,对所述应用类型对应的至少一个应用的流量数据进行拥塞控制,获得所述至少一个应用各自对应的初始传输性能指标;Based on the initial congestion control algorithm corresponding to the application type, congestion control is performed on the traffic data of at least one application corresponding to the application type, and the initial transmission performance index corresponding to the at least one application is obtained;
    将所述至少一个应用各自对应的初始传输性能指标输入目标函数,得到至少一个初始评估值,所述目标函数用于评估所述至少一个应用各自对传输性能指标的要求;Inputting the respective initial transmission performance indicators of the at least one application into an objective function to obtain at least one initial evaluation value, and the objective function is used to evaluate the respective requirements of the at least one application on the transmission performance indicators;
    采用强化学习方式基于所述至少一个初始评估值和所述至少一个应用各自的流量数据进行训练,得到所述应用类型对应的拥塞参数。The training is performed based on the at least one initial evaluation value and the respective traffic data of the at least one application in a reinforcement learning manner, and the congestion parameter corresponding to the application type is obtained.
  25. 如权利要求23或24所述的方法,其特征在于,基于所述映射关系和所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,包括:The method according to claim 23 or 24, wherein obtaining the first congestion parameter corresponding to the first application type based on the mapping relationship and the first application type, comprising:
    若所述映射关系中不包括所述第一应用类型,则根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数;或者,If the mapping relationship does not include the first application type, obtain a first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship; or ,
    若所述映射关系中包括所述第一应用类型,则根据所述第一应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数。If the mapping relationship includes the first application type, obtain a first congestion parameter corresponding to the first application type according to the first application type and the mapping relationship.
  26. 如权利要求25所述的方法,其特征在于,根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型对应的第一拥塞参数,包括:The method of claim 25, wherein obtaining the first congestion parameter corresponding to the first application type according to the second application type to which the first application type belongs and the mapping relationship, comprising:
    根据所述第一应用类型所属的第二应用类型和所述映射关系,获取所述第一应用类型所属的第二应用类型对应的第二拥塞参数,基于所述第二拥塞参数获取第二拥塞控制算法;According to the second application type to which the first application type belongs and the mapping relationship, a second congestion parameter corresponding to the second application type to which the first application type belongs is obtained, and a second congestion parameter is obtained based on the second congestion parameter control algorithm;
    基于所述第二拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第三传输性能指标;a third transmission performance indicator corresponding to when congestion control is performed on the traffic data of the first application based on the second congestion control algorithm;
    将所述第三性能指标输入目标函数,得到第三评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;Inputting the third performance index into an objective function to obtain a third evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index;
    采用强化学习方式基于所述第三评估值和所述第一应用的流量数据进行训练,得到所述第一应用类型对应的第一拥塞参数。The training is performed based on the third evaluation value and the traffic data of the first application in a reinforcement learning manner, and a first congestion parameter corresponding to the first application type is obtained.
  27. 如权利要求17-26任一项所述的方法,其特征在于,所述第一传输性能指标包括吞吐率和时延。The method according to any one of claims 17-26, wherein the first transmission performance indicator includes throughput and delay.
  28. 一种网络设备,其特征在于,包括:A network device, characterized in that it includes:
    获取单元,用于获取第一应用的第一应用类型;an obtaining unit for obtaining the first application type of the first application;
    处理单元,用于根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,所述第一拥塞参数用于得到第一拥塞控制算法,所述第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。a processing unit, configured to obtain, according to the first application type, a first congestion parameter corresponding to the first application type, where the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control algorithm uses for performing congestion control on the traffic data of the first application.
  29. 如权利要求28所述的设备,其特征在于,所述处理单元用于根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数之后,还用于:The device according to claim 28, wherein the processing unit is further configured to: after acquiring the first congestion parameter corresponding to the first application type according to the first application type:
    基于所述第一拥塞参数获取所述第一拥塞控制算法;obtaining the first congestion control algorithm based on the first congestion parameter;
    基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制。Congestion control is performed on the traffic data of the first application based on the first congestion control algorithm.
  30. 如权利要求29所述的设备,其特征在于,所述处理单元用于基于所述第一拥塞控 制算法对所述第一应用的流量数据进行拥塞控制之后,还用于:The device according to claim 29, wherein after the processing unit is configured to perform congestion control on the flow data of the first application based on the first congestion control algorithm, it is further configured to:
    获取基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;acquiring a first transmission performance indicator corresponding to when congestion control is performed on the traffic data of the first application based on the first congestion control algorithm;
    根据所述第一传输性能指标,调整所述第一拥塞参数。The first congestion parameter is adjusted according to the first transmission performance index.
  31. 如权利要求30所述的设备,其特征在于,所述处理单元用于根据所述第一传输性能指标,调整所述第一拥塞参数时,具体用于:The device according to claim 30, wherein when the processing unit is configured to adjust the first congestion parameter according to the first transmission performance indicator, it is specifically configured to:
    根据所述第一传输性能指标,获取所述第一应用对传输性能指标的要求;Obtaining, according to the first transmission performance indicator, a requirement of the first application for the transmission performance indicator;
    根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数。The first congestion parameter is adjusted according to the requirements of the first application for transmission performance indicators.
  32. 如权利要求31所述的设备,其特征在于,所述处理单元用于根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数时,具体用于:The device according to claim 31, wherein when the processing unit is configured to adjust the first congestion parameter according to the requirements of the first application on the transmission performance indicator, the processing unit is specifically configured to:
    将所述第一传输性能指标输入目标函数,得到第一评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;Inputting the first transmission performance index into an objective function to obtain a first evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index;
    基于所述第一评估值,调整所述第一拥塞参数。Based on the first evaluation value, the first congestion parameter is adjusted.
  33. 一种调整设备,其特征在于,包括:An adjustment device, characterized in that it includes:
    获取单元,用于获取基于第一拥塞控制算法对第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;an obtaining unit, configured to obtain the first transmission performance index corresponding to the congestion control of the traffic data of the first application based on the first congestion control algorithm;
    处理单元,用于根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数,调整后的第一拥塞参数用于得到调整后的第一拥塞控制算法,调整后的第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。a processing unit, configured to adjust a first congestion parameter corresponding to a first application type of the first application according to the first transmission performance indicator, and the adjusted first congestion parameter is used to obtain an adjusted first congestion control algorithm, The adjusted first congestion control algorithm is used to perform congestion control on the traffic data of the first application.
  34. 如权利要求33所述的设备,其特征在于,所述处理单元用于根据所述第一传输性能指标调整所述第一应用的第一应用类型对应的第一拥塞参数时,具体用于:The device according to claim 33, wherein when the processing unit is configured to adjust the first congestion parameter corresponding to the first application type of the first application according to the first transmission performance indicator, the processing unit is specifically configured to:
    根据所述第一传输性能指标,获取所述第一应用对传输性能指标的要求;Obtaining, according to the first transmission performance indicator, a requirement of the first application for the transmission performance indicator;
    根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数。The first congestion parameter is adjusted according to the requirements of the first application for transmission performance indicators.
  35. 如权利要求34所述的设备,其特征在于,所述处理单元用于根据所述第一应用对传输性能指标的要求,调整所述第一拥塞参数时,具体用于:The device according to claim 34, wherein when the processing unit is configured to adjust the first congestion parameter according to the requirements of the first application on the transmission performance indicator, the processing unit is specifically configured to:
    将所述第一传输性能指标输入目标函数,得到第一评估值;所述目标函数用于评估所述第一应用对传输性能指标的要求;Inputting the first transmission performance index into an objective function to obtain a first evaluation value; the objective function is used to evaluate the requirements of the first application on the transmission performance index;
    基于所述第一评估值,调整所述第一拥塞参数。Based on the first evaluation value, the first congestion parameter is adjusted.
  36. 一种网络设备,其特征在于,包括:至少一个处理器和存储器;A network device, comprising: at least one processor and a memory;
    所述存储器存储一个或多个计算机程序;the memory stores one or more computer programs;
    当所述存储器存储的一个或多个计算机程序被所述至少一个处理器执行时,使得所述网络设备执行如权利要求1-16任一所述的方法。One or more computer programs stored in the memory, when executed by the at least one processor, cause the network device to perform the method of any one of claims 1-16.
  37. 一种调整设备,其特征在于,包括:至少一个处理器和存储器;An adjustment device, characterized in that it comprises: at least one processor and a memory;
    所述存储器存储一个或多个计算机程序;the memory stores one or more computer programs;
    当所述存储器存储的一个或多个计算机程序被所述至少一个处理器执行时,使得所述调整设备执行如权利要求17-27任一所述的方法。One or more computer programs stored in the memory, when executed by the at least one processor, cause the adjustment device to perform the method of any of claims 17-27.
  38. 一种计算机存储介质,其特征在于,所述计算机可读存储介质用于存储计算机程序,当所述计算机程序在计算机上运行时,使得所述计算机执行如权利要求1-16任一所述的方法,或者使得所述计算机执行如权利要求17-27任一所述的方法。A computer storage medium, characterized in that, the computer-readable storage medium is used to store a computer program, and when the computer program is run on a computer, the computer is made to execute any one of claims 1-16. method, or causing the computer to perform the method according to any one of claims 17-27.
  39. 一种网络系统,其特征在于,包括:调整设备和网络设备;A network system, characterized in that it includes: adjustment equipment and network equipment;
    所述调整设备,用于获取第一应用的流量数据对应的第一传输性能指标;根据所述第一传输性能指标调整所述第一应用的应用类型对应的第一拥塞参数;将调整后的第一拥塞参数发送给所述网络设备;The adjustment device is configured to obtain a first transmission performance index corresponding to the traffic data of the first application; adjust the first congestion parameter corresponding to the application type of the first application according to the first transmission performance index; sending the first congestion parameter to the network device;
    所述网络设备,用于根据调整后的第一拥塞参数获取调整后的第一拥塞控制算法,基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制。The network device is configured to obtain an adjusted first congestion control algorithm according to the adjusted first congestion parameter, and perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm.
  40. 如权利要求39所述的系统,其特征在于,所述调整设备用于获取第一应用的流量数据对应的第一传输性能指标之前,所述网络设备还用于:The system according to claim 39, wherein before the adjustment device is configured to acquire the first transmission performance indicator corresponding to the traffic data of the first application, the network device is further configured to:
    获取所述第一应用的第一应用类型;obtaining a first application type of the first application;
    根据所述第一应用类型,获取所述第一拥塞参数;obtaining the first congestion parameter according to the first application type;
    基于所述第一拥塞参数获取第一拥塞控制算法;obtaining a first congestion control algorithm based on the first congestion parameter;
    所述调整设备用于获取第一应用的流量数据对应的第一传输性能指标时,具体用于:When the adjustment device is used to obtain the first transmission performance indicator corresponding to the traffic data of the first application, it is specifically used to:
    获取所述网络设备基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第一传输性能指标。Acquire a first transmission performance indicator corresponding to when the network device performs congestion control on the traffic data of the first application based on the first congestion control algorithm.
  41. 如权利要求39或40所述的系统,其特征在于,所述网络设备用于基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制之后,调整设备还用于:The system according to claim 39 or 40, wherein after the network device is configured to perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm, the adjustment device is further configured to:
    获取所述网络设备根据调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第二传输性能指标。Acquire a second transmission performance indicator corresponding to when the network device performs congestion control on the traffic data of the first application according to the adjusted first congestion control algorithm.
  42. 一种网络系统,其特征在于,包括:识别设备和网络设备;A network system, characterized by comprising: identification equipment and network equipment;
    所述识别设备,用于识别第一应用的第一应用类型;将所述第一应用类型发送给所述网络设备;the identifying device, configured to identify the first application type of the first application; sending the first application type to the network device;
    所述网络设备,用于根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数,所述第一拥塞参数用于得到第一拥塞控制算法,所述第一拥塞控制算法用于对所述第一应用的流量数据进行拥塞控制。The network device is configured to obtain, according to the first application type, a first congestion parameter corresponding to the first application type, where the first congestion parameter is used to obtain a first congestion control algorithm, and the first congestion control The algorithm is used to perform congestion control on the traffic data of the first application.
  43. 如权利要求42所述的系统,其特征在于,所述网络设备用于根据所述第一应用类型,获取所述第一应用类型对应的第一拥塞参数之后,还用于:The system according to claim 42, wherein after the network device is configured to obtain the first congestion parameter corresponding to the first application type according to the first application type, the network device is further configured to:
    基于所述第一拥塞参数获取所述第一拥塞控制算法;obtaining the first congestion control algorithm based on the first congestion parameter;
    基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制。Congestion control is performed on the traffic data of the first application based on the first congestion control algorithm.
  44. 如权利要求43所述的系统,其特征在于,所述网络系统还包括调整设备,所述调整设备用于:The system of claim 43, wherein the network system further comprises an adjustment device for:
    获取所述网络设备基于所述第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制时对应的第一传输性能指标;根据所述第一传输性能指标调整所述第一应用类型对应的第一拥塞参数;将调整后的第一拥塞参数发送给所述网络设备;Acquire a first transmission performance index corresponding to when the network device performs congestion control on the traffic data of the first application based on the first congestion control algorithm; adjust the corresponding first application type according to the first transmission performance index The first congestion parameter of ; send the adjusted first congestion parameter to the network device;
    所述网络设备用于:The network equipment is used for:
    根据调整后的第一拥塞参数获取调整后的第一拥塞控制算法,基于调整后的第一拥塞控制算法对所述第一应用的流量数据进行拥塞控制。Obtain an adjusted first congestion control algorithm according to the adjusted first congestion parameter, and perform congestion control on the traffic data of the first application based on the adjusted first congestion control algorithm.
PCT/CN2021/082120 2020-06-30 2021-03-22 Congestion control method and corresponding device WO2022001213A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010630381.7A CN113873571A (en) 2020-06-30 2020-06-30 Congestion control method and corresponding equipment
CN202010630381.7 2020-06-30

Publications (1)

Publication Number Publication Date
WO2022001213A1 true WO2022001213A1 (en) 2022-01-06

Family

ID=78982070

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/082120 WO2022001213A1 (en) 2020-06-30 2021-03-22 Congestion control method and corresponding device

Country Status (2)

Country Link
CN (1) CN113873571A (en)
WO (1) WO2022001213A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116545942A (en) * 2023-07-04 2023-08-04 腾讯科技(深圳)有限公司 Data transmission method, device, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102882803A (en) * 2012-10-11 2013-01-16 四川大学 Mixed congestion control method based on packet loss and time delay
CN104704783A (en) * 2012-10-03 2015-06-10 生活服务质量有限公司 System and method for a TCP mapper
CN105681265A (en) * 2014-11-20 2016-06-15 华为软件技术有限公司 Unilateral transmission control protocol acceleration method and device
CN105763474A (en) * 2014-12-19 2016-07-13 华为技术有限公司 Data transmission method and device
CN110856214A (en) * 2019-10-29 2020-02-28 广东省电信规划设计院有限公司 TCP congestion control method and device
CN111698243A (en) * 2020-06-09 2020-09-22 北京百度网讯科技有限公司 Parameter configuration method and device, electronic equipment and storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016118282A1 (en) * 2015-01-22 2016-07-28 Intel IP Corporation Application specific congestion control for data communications
CN110581808B (en) * 2019-08-22 2021-06-15 武汉大学 Congestion control method and system based on deep reinforcement learning

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104704783A (en) * 2012-10-03 2015-06-10 生活服务质量有限公司 System and method for a TCP mapper
CN102882803A (en) * 2012-10-11 2013-01-16 四川大学 Mixed congestion control method based on packet loss and time delay
CN105681265A (en) * 2014-11-20 2016-06-15 华为软件技术有限公司 Unilateral transmission control protocol acceleration method and device
CN105763474A (en) * 2014-12-19 2016-07-13 华为技术有限公司 Data transmission method and device
CN110856214A (en) * 2019-10-29 2020-02-28 广东省电信规划设计院有限公司 TCP congestion control method and device
CN111698243A (en) * 2020-06-09 2020-09-22 北京百度网讯科技有限公司 Parameter configuration method and device, electronic equipment and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116545942A (en) * 2023-07-04 2023-08-04 腾讯科技(深圳)有限公司 Data transmission method, device, electronic equipment and storage medium
CN116545942B (en) * 2023-07-04 2023-09-26 腾讯科技(深圳)有限公司 Data transmission method, device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN113873571A (en) 2021-12-31

Similar Documents

Publication Publication Date Title
US11394449B2 (en) Beam training based on sidelink control information and channel state information reference signal in device-to-device communications
US11784701B2 (en) Apparatus, system and method of beam tracking
US20150245409A1 (en) Carrier aggregation over lte and wifi
WO2023087442A1 (en) Digital twin network-based low-latency and high-reliability transmission method and apparatus, device, and medium
US20220321192A1 (en) Deep learning aided fingerprint based beam alignment
US11070466B2 (en) Method for link aggregation and related devices
CN106717036A (en) Systems and methods for determining network information on mobile devices
US11310161B2 (en) Method and system for packet size management
WO2020024813A1 (en) Method and device for indicating and receiving control information
US20220330083A1 (en) Methods and apparatuses for transmitting and receiving data in an nr system
WO2019051717A1 (en) Signal processing method and apparatus
WO2022001213A1 (en) Congestion control method and corresponding device
WO2020078248A1 (en) Wireless communication method and device
US11575780B1 (en) Wireless technology indicator display
US11689968B2 (en) Method and apparatus for executing virtualized network function
US20200344140A1 (en) Systems and methods for detecting control plane node availability
WO2022082356A1 (en) Communication method and apparatus
WO2015149639A1 (en) Method for scheduling radio resource, control node and system
WO2018170863A1 (en) Beam interference avoidance method and base station
US11425608B2 (en) Facilitating an interference leakage dependent resource reservation protocol in advanced networks
EP4064787B1 (en) Communication method, apparatus and system
EP4111729A1 (en) Method for cell issue forecasting
CN115428515A (en) Control messaging for multi-beam communications
EP4147440B1 (en) Procedures for triggering and updating tele-operated driving at a v2x application server
US10932169B2 (en) Systems and methods for determining TCP transfer types in LTE-A communication networks and handling thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21832795

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21832795

Country of ref document: EP

Kind code of ref document: A1