WO2023185467A1 - 一种网络自治能力评估方法、装置及存储介质 - Google Patents

一种网络自治能力评估方法、装置及存储介质 Download PDF

Info

Publication number
WO2023185467A1
WO2023185467A1 PCT/CN2023/081552 CN2023081552W WO2023185467A1 WO 2023185467 A1 WO2023185467 A1 WO 2023185467A1 CN 2023081552 W CN2023081552 W CN 2023081552W WO 2023185467 A1 WO2023185467 A1 WO 2023185467A1
Authority
WO
WIPO (PCT)
Prior art keywords
network
maintenance
task
key operation
level
Prior art date
Application number
PCT/CN2023/081552
Other languages
English (en)
French (fr)
Inventor
许瑞岳
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023185467A1 publication Critical patent/WO2023185467A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/14—Network analysis or design
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W24/00—Supervisory, monitoring or testing arrangements
    • H04W24/04—Arrangements for maintaining operational condition

Definitions

  • the present application relates to the field of communication technology, and in particular to a network autonomy capability evaluation method, device and storage medium.
  • Telecom system autonomy technology can be applied to a variety of scenarios in the network life cycle, including network planning, network deployment, network optimization, business operations, etc. It can reduce manual operations, reduce operator operating expenses (OPEX), and improve operation and maintenance efficiency. .
  • OPEX operator operating expenses
  • the current network autonomy capability assessment method is relatively rough, so there is a need to improve the refinement of network autonomy capability assessment.
  • Embodiments of the present application provide a network autonomy capability evaluation method, device, and storage medium to improve the refinement of network autonomy capability evaluation.
  • the first aspect is to provide a network autonomy capability evaluation method, which is used in the process of network capability evaluation in the first network operation and maintenance scenario.
  • the first network operation and maintenance scenario includes at least one key operation and maintenance task, the at least one key operation and maintenance task includes a first key operation and maintenance task, and the autonomous network level of the first network operation and maintenance scenario is the first autonomous network level,
  • the requirements of the first autonomous network level for the network autonomy capability of the first key operation and maintenance tasks are consistent with the requirements of the second autonomous network level (the second autonomous network level is higher than the first autonomous network level.
  • the second autonomous network level is An autonomous network level one level higher than the first autonomous network level) has different requirements for the network autonomy capability of the first key operation and maintenance task.
  • This method can be executed by a network autonomy capability evaluation device (such as a terminal, a server, any electronic device with information processing capabilities, or an application program used to implement the method).
  • a network autonomy capability evaluation device such as a terminal, a server, any electronic device with information processing capabilities, or an application program used to implement the method.
  • the following uses the network autonomy capability evaluation device as the execution subject as an example to describe the method. implementation process.
  • the method may include the following steps: after the network autonomy capability evaluation device determines that the autonomous network level of the first network operation and maintenance scenario is the first autonomous network level, based on the network autonomy of each key operation and maintenance task in the first network operation and maintenance scenario, Capability satisfaction (the satisfaction is the network autonomy capability of the first key operation and maintenance task) The degree of network autonomy that satisfies the requirements of the second autonomous network level for the first key operation and maintenance tasks), determine the level adjustment amount of the first network operation and maintenance scenario, and determine the level adjustment amount of the first network operation and maintenance scenario according to the first autonomous network level and the The level adjustment amount is used to determine the network autonomy capability evaluation result of the first network operation and maintenance scenario.
  • the first operation and maintenance scenario is a network operation and maintenance scenario obtained based on at least one of the following dimensions: wireless network standard dimension, wireless network service type dimension, wireless network application dimension, wireless environment dimension, and wireless traffic status dimension.
  • the network autonomy capability evaluation device determines the autonomous network level (first autonomous network level) of the first network operation and maintenance scenario, in order to further improve the refinement of the network autonomy capability assessment, further, the network autonomy capability assessment
  • the device determines the level adjustment amount of the first network operation and maintenance scenario based on the satisfaction of the network autonomy capability of each key operation and maintenance task in the first network operation and maintenance scenario, thereby determining the level adjustment amount of the first network operation and maintenance scenario based on the first autonomous network level and the level adjustment amount.
  • the network autonomy capability evaluation results of a network operation and maintenance scenario. Compared with the network autonomy capability that characterizes the first network operation and maintenance scenario based only on the first autonomous network level, using the above implementation method can obtain more refined network autonomy capabilities. evaluation result.
  • the network autonomy capability evaluation device determines the level adjustment amount based on the satisfaction of the network autonomy capability of key operation and maintenance tasks, thus comparing the actual network autonomy capability of key operation and maintenance tasks with a higher level.
  • the differences between network autonomy capabilities required by autonomous network levels are taken into account, and the level adjustment amount is determined based on this difference, thereby improving the refinement of network autonomy capability evaluation.
  • the network autonomy capability represented by the network autonomy capability evaluation result is higher than the network autonomy capability corresponding to the first autonomous network level, and lower than the network autonomy capability corresponding to the second autonomous network level.
  • Ability to Autonomy That is to say, the network autonomy capability of the first network operation and maintenance scenario is between the network autonomy capability corresponding to the first autonomous network level and the network autonomy capability corresponding to the second autonomous network level.
  • the requirements of the first autonomous network level on the network autonomy capability of any one of the at least one key operation and maintenance tasks are different from the requirements of the second autonomous network level on the network autonomy capability of any one of the at least one key operation and maintenance tasks.
  • the requirements for the network autonomy capability of any of the key operation and maintenance tasks mentioned above are different.
  • the network autonomy capability evaluation device determines the level adjustment of the first network operation and maintenance scenario based on the satisfaction of the network autonomy capability of each key operation and maintenance task in the first network operation and maintenance scenario.
  • the quantitative process may include: the network autonomy capability evaluation device determines the task score of each key operation and maintenance task in the at least one key operation and maintenance task; and determines the task score of each key operation and maintenance task in the at least one key operation and maintenance task.
  • the scores are weighted and averaged to obtain a first value; the first value is determined as the level adjustment amount of the first network operation and maintenance scenario.
  • the actual network of all key operation and maintenance tasks can be The difference between the autonomy capability and the network autonomy capability required by a higher autonomous network level is taken into account, so that the determined level adjustment amount can be made more reasonable.
  • the task score of the first key operation and maintenance task corresponds to the satisfaction degree of the network autonomy capability of the first key operation and maintenance task.
  • the degree of satisfaction may include a first degree of satisfaction and a second degree of satisfaction, where the first degree of satisfaction indicates that the network autonomy capability of the first key operation and maintenance task satisfies the second autonomous network level.
  • the second degree of satisfaction indicates that the network autonomy capability of the first key operation and maintenance task does not meet the requirements of the second autonomous network level for the first key operation and maintenance task.
  • first satisfaction degree corresponds to the first score
  • the second degree of satisfaction corresponds to the second score.
  • the second score is not equal to the first score.
  • the process by which the network autonomy capability evaluation device determines the task score of each key operation and maintenance task in the at least one key operation and maintenance task may include: if the network autonomy capability evaluation device determines the network autonomy capability of the first key operation and maintenance task. If the degree of satisfaction is the first degree of satisfaction, then it is determined that the task score of the first key operation and maintenance task is equal to the first score; if the network autonomy capability evaluation device determines that the degree of satisfaction of the network autonomy capability of the first key operation and maintenance task is the first If the second degree of satisfaction is satisfied, it is determined that the task score of the first key operation and maintenance task is equal to the second score. The second score is not equal to the first score.
  • the task score of the key operation and maintenance task is: are different, which can reflect the contribution of different key operation and maintenance tasks to the level adjustment amount, thereby making the determined level adjustment amount more reasonable.
  • the degree of satisfaction includes, in addition to the above-mentioned first degree of satisfaction and the above-mentioned second degree of satisfaction, a third degree of satisfaction, where the third degree of satisfaction represents the network of the first key operation and maintenance task.
  • the autonomy capability meets the first percentage of the network autonomy capability required by the second autonomous network level for the first key operation and maintenance task.
  • the third degree of satisfaction corresponds to a third score.
  • the value of the third score is between the first score and the second score.
  • the third degree of satisfaction may include one or more. If multiple third degrees of satisfaction are included, each third degree of satisfaction corresponds to a third task score.
  • the third task scores corresponding to different third degrees of satisfaction may be different.
  • the process by which the network autonomy capability evaluation device determines the task score of the first key operation and maintenance task may also include: if the network autonomy capability evaluation device determines that the satisfaction degree of the network autonomy capability of the first key operation and maintenance task is a third degree of satisfaction, Then the task score of the first key operation and maintenance task is equal to the third score, and the value of the third score is between the first score and the second score.
  • the satisfaction degree of the network autonomy capability can include a variety of possible situations.
  • the task score of the key operation and maintenance task corresponds to the satisfaction degree of the network autonomy capability of the key operation and maintenance task, thereby further refining the different key operation and maintenance tasks.
  • the contribution of operation and maintenance tasks to the level adjustment amount makes the determined level adjustment amount more refined.
  • a weighted average algorithm can be used to calculate the first value Ts_all.
  • the first value Ts_all satisfies the following formula:
  • K is the number of key operation and maintenance tasks in the at least one key operation and maintenance task
  • Ts i is the task score of the i-th key operation and maintenance task in the at least one key operation and maintenance task
  • Twi is the The task weight of the i-th key operation and maintenance task.
  • the task weight of the i-th key operation and maintenance task is related to the implementation difficulty of the i-th key operation and maintenance task.
  • task weights can be set for key operation and maintenance tasks.
  • task weights can be set according to the difficulty of implementing key operation and maintenance tasks, and the corresponding key operation and maintenance tasks can be introduced when calculating the level adjustment amount of the first network operation and maintenance scenario.
  • Task weights can make the network autonomy capability evaluation results in the first network operation and maintenance scenario more precise.
  • a network autonomy capability evaluation device which can implement the network autonomy capability evaluation method provided in the first aspect.
  • the network autonomy capability evaluation device may include: an autonomous network level determination module, configured to determine the autonomous network level of the first network operation and maintenance scenario as the first autonomous network level; and a level adjustment amount determination module, configured to determine the autonomous network level according to the first network operation and maintenance scenario.
  • the degree of satisfaction of the network autonomy capability of each key operation and maintenance task in the maintenance scenario is determined to determine the level adjustment amount of the first network operation and maintenance scenario;
  • a network autonomy capability evaluation module is used to determine the level adjustment amount of the first network operation and maintenance scenario according to the first autonomous network level and the The level adjustment amount determines the network autonomy capability evaluation result of the first network operation and maintenance scenario.
  • the first network operation and maintenance scenario includes at least one key operation and maintenance task, and the at least one key operation and maintenance task
  • the tasks include the first key operation and maintenance task.
  • the requirements of the first autonomous network level for the network autonomy capability of the first key operation and maintenance task are the same as the requirements of the second autonomous network level for the network autonomy of the first key operation and maintenance task. Capability requirements are different, and the satisfaction degree of the network autonomy capability of the first key operation and maintenance task is that the network autonomy capability of the first key operation and maintenance task satisfies the second autonomous network level for the first key operation and maintenance task.
  • the required degree of network autonomy capability, the second autonomous network level is higher than the first autonomous network level.
  • the second autonomous network level is an autonomous network level one level higher than the first autonomous network level.
  • the first network operation and maintenance scenario is a network operation and maintenance scenario obtained based on at least one of the following dimensions: wireless network standard dimension, wireless network service type dimension, wireless network application dimension, wireless environment dimension, and wireless traffic status dimension. .
  • the network autonomy capability represented by the network autonomy capability evaluation result is higher than the network autonomy capability corresponding to the first autonomous network level, and lower than the network autonomy capability corresponding to the second autonomous network level.
  • the requirements of the first autonomous network level on the network autonomy capability of any one of the at least one key operation and maintenance tasks are different from the requirements of the second autonomous network level on the network autonomy capability of any one of the at least one key operation and maintenance tasks.
  • the requirements for the network autonomy capability of any of the key operation and maintenance tasks mentioned above are different.
  • the level adjustment amount determination module is specifically configured to: determine the task score of each key operation and maintenance task in the at least one key operation and maintenance task; The task scores of each key operation and maintenance task are weighted and averaged to obtain a first value; the first value is determined as the level adjustment amount of the first network operation and maintenance scenario.
  • the task score of the first key operation and maintenance task corresponds to the satisfaction degree of the network autonomy capability of the first key operation and maintenance task.
  • the level adjustment amount determination module is specifically configured to: if the satisfaction degree of the network autonomy capability of the first key operation and maintenance task is a first degree of satisfaction, the first degree of satisfaction represents If the network autonomy capability of the first key operation and maintenance task meets the network autonomy capability required by the second autonomous network level for the first key operation and maintenance task, then it is determined that the task score of the first key operation and maintenance task is equal to the first key operation and maintenance task.
  • the level adjustment amount determination module is also used to:
  • the satisfaction degree of the network autonomy capability of the first key operation and maintenance task is a third degree of satisfaction
  • the third degree of satisfaction means that the network autonomy capability of the first key operation and maintenance task satisfies the second autonomy network level pair.
  • the first percentage of the network autonomy capability required by the first key operation and maintenance task, then the task score of the first key operation and maintenance task is equal to the third score, and the value of the third score is in the first between the score and the second score.
  • the first value Ts_all satisfies the following formula:
  • K is the number of key operation and maintenance tasks in the at least one key operation and maintenance task
  • Ts i is the task score of the i-th key operation and maintenance task in the at least one key operation and maintenance task
  • Twi is the The task weight of the i-th key operation and maintenance task.
  • the task weight of the i-th key operation and maintenance task is equal to the actual value of the i-th key operation and maintenance task. Difficulty related.
  • a communication device including: one or more processors; the one or more memories store one or more computer programs, the one or more computer programs include instructions, and when the instructions When executed by the one or more processors, the communication device is caused to execute the method described in any one of the above first aspects.
  • a fourth aspect provides a computer-readable storage medium, including a computer program, which when the computer program is run on an electronic device, causes the electronic device to perform the method described in any one of the above first aspects.
  • a fifth aspect provides a computer program product that, when run on an electronic device, causes the electronic device to execute the method described in any one of the above first aspects.
  • a chip system including: a memory for storing a computer program; a processor; when the processor calls and runs the computer program from the memory, the electronic device installed with the chip system executes the above first step. The method described in any of the aspects.
  • Embodiments of the present application also provide a network autonomy capability evaluation method, device, and storage medium to evaluate network autonomy capabilities in multiple network operation and maintenance scenarios.
  • a communication method which is used in the process of network capability evaluation in a first network operation and maintenance scenario.
  • the possible method includes: after the autonomous network assessment execution device determines that the autonomous network level of the first network operation and maintenance scenario is the first autonomous network level, based on the network autonomy capability of each key operation and maintenance task in the first network operation and maintenance scenario, The degree of satisfaction (the degree of satisfaction is the degree to which the network autonomy capability of the first key operation and maintenance task meets the network autonomy capability required by the second autonomous network level for the first key operation and maintenance task), determine the first The level adjustment amount of the network operation and maintenance scenario determines the network autonomy capability evaluation result of the first network operation and maintenance scenario based on the first autonomous network level and the level adjustment amount, and determines the network autonomy capability evaluation result of the first network operation and maintenance scenario.
  • the network autonomy capability evaluation results are sent to the autonomous network evaluation and monitoring device.
  • the autonomous network assessment and monitoring device receives the network autonomy capability assessment result.
  • the autonomous network assessment execution device can obtain the network autonomy capability assessment result of the first network operation and maintenance scenario by executing the method described in any one of the above first aspects.
  • a method for evaluating network autonomy capabilities is provided.
  • the method is applied to a process of evaluating network autonomy capabilities in multiple network operation and maintenance scenarios.
  • Each network operation and maintenance scenario in the multiple network operation and maintenance scenarios includes: At least one operation and maintenance task.
  • This method can be executed by a network autonomy capability evaluation device (such as a terminal, a server, any electronic device with information processing capabilities, or an application program used to implement the method).
  • a network autonomy capability evaluation device such as a terminal, a server, any electronic device with information processing capabilities, or an application program used to implement the method.
  • the following uses the network autonomy capability evaluation device as the execution subject as an example to describe the method. implementation process.
  • the method may include the following steps: the network autonomy capability evaluation device determines multiple network operation and maintenance scenarios, and determines the network autonomy capability evaluation results of each network operation and maintenance scenario in the multiple network operation and maintenance scenarios, and then determines the network autonomy capability evaluation results based on the multiple network operation and maintenance scenarios.
  • the network autonomy capability evaluation result of each network operation and maintenance scenario in the network operation and maintenance scenario determines one network autonomy capability evaluation result corresponding to the multiple network operation and maintenance scenarios.
  • At least one network operation and maintenance scenario in the plurality of network operation and maintenance fields may be a network operation and maintenance scenario obtained based on at least one of the following dimensions: wireless network standard dimension, wireless network service type dimension, wireless network application dimension, wireless Environmental dimension and wireless traffic status dimension.
  • the network autonomy capability evaluation results of each network operation and maintenance scenario are determined respectively, and then the network autonomy capability evaluation results of each network operation and maintenance scenario are determined.
  • the results determine the network autonomy capabilities corresponding to the multiple network operation and maintenance scenarios. Therefore, the network autonomy capabilities of the multiple network operation and maintenance scenarios can be synthesized and the network autonomy capabilities corresponding to the scenario combination formed by the multiple network operation and maintenance scenarios can be evaluated, which makes up for the There is currently no gap in evaluating network autonomy capabilities based on scenario combinations.
  • the plurality of network operation and maintenance scenarios include a first network operation and maintenance scenario, with the Taking the first network operation and maintenance scenario as an example, the process of the network autonomy capability evaluation device determining the network autonomy capability evaluation result of the first network operation and maintenance scenario may include:
  • the network autonomy capability evaluation device determines that the autonomous network level of the first network operation and maintenance scenario is the first autonomous network level, and determines based on the satisfaction of the network autonomy capability of each key operation and maintenance task in the first network operation and maintenance scenario.
  • the level adjustment amount of the first network operation and maintenance scenario, and the network autonomy capability evaluation result of the first network operation and maintenance scenario is determined based on the first autonomous network level and the level adjustment amount.
  • the first network operation and maintenance scenario includes at least one key operation and maintenance task
  • the at least one key operation and maintenance task includes a first key operation and maintenance task
  • the first autonomous network level is critical to the first key operation and maintenance task.
  • the requirements for the network autonomy capability of the task are different from the requirements of the second autonomous network level for the network autonomy capability of the first key operation and maintenance task, and the satisfaction degree of the network autonomy capability of the first key operation and maintenance task is that of the first key operation and maintenance task.
  • the network autonomy capability of key operation and maintenance tasks meets the degree of network autonomy capability required by the second autonomous network level for the first key operation and maintenance task, and the second autonomous network level is higher than the first autonomous network level.
  • the second autonomous network level is an autonomous network level one level higher than the first autonomous network level.
  • the network autonomy capability represented by the network autonomy capability evaluation result of the first network operation and maintenance scenario is higher than the network autonomy capability corresponding to the first autonomous network level and lower than the network autonomy capability of the third autonomous network level. 2.
  • the requirements of the first autonomous network level on the network autonomy capability of any one of the at least one key operation and maintenance tasks are different from the requirements of the second autonomous network level on the network autonomy capability of any one of the at least one key operation and maintenance tasks.
  • the requirements for the network autonomy capability of any of the key operation and maintenance tasks mentioned above are different.
  • the network autonomy capability evaluation device determines the level adjustment of the first network operation and maintenance scenario based on the satisfaction of the network autonomy capability of each key operation and maintenance task in the first network operation and maintenance scenario.
  • the quantity may include: the network autonomy capability evaluation device determines the task score of each key operation and maintenance task in the at least one key operation and maintenance task; and performs the task score on each key operation and maintenance task in the at least one key operation and maintenance task.
  • a weighted average is used to obtain a first value; the first value is determined as the level adjustment amount of the first network operation and maintenance scenario.
  • the task score of the first key operation and maintenance task corresponds to the satisfaction degree of the network autonomy capability of the first key operation and maintenance task.
  • the degree of satisfaction may include a first degree of satisfaction and a second degree of satisfaction, where the first degree of satisfaction indicates that the network autonomy capability of the first key operation and maintenance task satisfies the second autonomous network level.
  • the second degree of satisfaction indicates that the network autonomy capability of the first key operation and maintenance task does not meet the requirements of the second autonomous network level for the first key operation and maintenance task.
  • the network autonomy capabilities required by maintenance tasks corresponds to the first score, and the second degree of satisfaction corresponds to the second score.
  • the second score is not equal to the first score.
  • the process by which the network autonomy capability evaluation device determines the task score of each key operation and maintenance task in the at least one key operation and maintenance task may include: if the network autonomy capability evaluation device determines the network autonomy capability of the first key operation and maintenance task. If the degree of satisfaction is the first degree of satisfaction, then it is determined that the task score of the first key operation and maintenance task is equal to the first score; if the network autonomy capability evaluation device determines that the degree of satisfaction of the network autonomy capability of the first key operation and maintenance task is the second degree of satisfaction degree, it is determined that the task score of the first key operation and maintenance task is equal to the second score.
  • the degree of satisfaction includes, in addition to the above-mentioned first degree of satisfaction and the above-mentioned second degree of satisfaction, a third degree of satisfaction, where the third degree of satisfaction represents the network of the first key operation and maintenance task.
  • the autonomy capability meets the first percentage of the network autonomy capability required by the second autonomous network level for the first key operation and maintenance task.
  • the third degree of satisfaction corresponds to a third score.
  • the value of the third score is between the first score and the second score.
  • the third degree of satisfaction may include one or more. If multiple third degrees of satisfaction are included, each third degree of satisfaction corresponds to a third task score.
  • the third task scores corresponding to different third degrees of satisfaction may be different. .
  • the process by which the network autonomy capability evaluation device determines the task score of the first key operation and maintenance task may also include: if the network autonomy capability evaluation device determines that the satisfaction degree of the network autonomy capability of the first key operation and maintenance task is a third degree of satisfaction, Then it is determined that the task score of the first key operation and maintenance task is equal to the third score.
  • a weighted average algorithm can be used to calculate the first value Ts_all.
  • the first value Ts_all satisfies the following formula:
  • K is the number of key operation and maintenance tasks in the at least one key operation and maintenance task
  • Ts i is the task score of the i-th key operation and maintenance task in the at least one key operation and maintenance task
  • Twi is the The task weight of the i-th key operation and maintenance task.
  • the task weight of the i-th key operation and maintenance task is related to the implementation difficulty of the i-th key operation and maintenance task.
  • the network autonomy capability evaluation device determines a network corresponding to the multiple network operation and maintenance scenarios based on the network autonomy capability evaluation results of each network operation and maintenance scenario in the multiple network operation and maintenance scenarios.
  • the process of autonomous capability evaluation results may include: the network autonomy capability evaluation device determines a second value based on the autonomous network level score of each network operation and maintenance scenario in the plurality of network operation and maintenance scenarios, and determines the second value based on the autonomous network level score of each network operation and maintenance scenario. Describes the evaluation results of a network autonomy capability corresponding to multiple network operation and maintenance scenarios.
  • a weighted average algorithm can be used to calculate the second value ANLS_Ava.
  • the second value ANLS_Ava satisfies the following formula:
  • the second value ANLS_Ava satisfies the following formula:
  • M is the number of network operation and maintenance scenarios in the multiple network operation and maintenance scenarios
  • ANLs i is the autonomous network level score of the i-th network operation and maintenance scenario in the multiple network operation and maintenance scenarios
  • Sw i is the Describe the scenario weight of the i-th network operation and maintenance scenario.
  • a network autonomy capability evaluation device including: a network operation and maintenance scenario combination determination module for determining multiple network operation and maintenance scenarios, where each network operation and maintenance scenario in the multiple network operation and maintenance scenarios includes At least one operation and maintenance task; a first network autonomy capability evaluation module, used to determine the network autonomy capability evaluation results of each network operation and maintenance scenario in the plurality of network operation and maintenance scenarios; a second network autonomy capability evaluation module, used according to The network autonomy capability evaluation result of each network operation and maintenance scenario in the plurality of network operation and maintenance scenarios determines a network autonomy capability evaluation result corresponding to the multiple network operation and maintenance scenarios.
  • At least one network operation and maintenance scenario among the plurality of network operation and maintenance scenarios may be a network operation and maintenance scenario obtained based on at least one of the following dimensions: wireless network standard dimension, wireless network service type dimension, wireless network application dimension, wireless Environmental dimension and wireless traffic status dimension.
  • the plurality of network operation and maintenance scenarios include a first network operation and maintenance scenario
  • the first network autonomy capability evaluation module includes: an autonomous network level determination module, used to determine the first network operation and maintenance scenario.
  • a network operation and maintenance field The autonomous network level of the scene is the first autonomous network level; the level adjustment amount determination module determines the first network operation and maintenance based on the satisfaction of the network autonomy capability of each key operation and maintenance task in the first network operation and maintenance scenario.
  • the level adjustment amount of the scenario; the autonomy capability evaluation result determination module determines the network autonomy capability evaluation result of the first network operation and maintenance scenario according to the first autonomous network level and the level adjustment amount.
  • the first network operation and maintenance scenario includes at least one key operation and maintenance task
  • the at least one key operation and maintenance task includes a first key operation and maintenance task
  • the first autonomous network level is critical to the first key operation and maintenance task.
  • the requirements for the network autonomy capability of the task are different from the requirements of the second autonomous network level for the network autonomy capability of the first key operation and maintenance task, and the satisfaction degree of the network autonomy capability of the first key operation and maintenance task is that of the first key operation and maintenance task.
  • the network autonomy capability of key operation and maintenance tasks meets the degree of network autonomy capability required by the second autonomous network level for the first key operation and maintenance task, and the second autonomous network level is higher than the first autonomous network level;
  • the second autonomous network level is an autonomous network level one level higher than the first autonomous network level.
  • the network autonomy capability represented by the network autonomy capability evaluation result of the first network operation and maintenance scenario is higher than the network autonomy capability corresponding to the first autonomous network level and lower than the network autonomy capability of the third autonomous network level. 2.
  • the requirements of the first autonomous network level on the network autonomy capability of any one of the at least one key operation and maintenance tasks are different from the requirements of the second autonomous network level on the network autonomy capability of any one of the at least one key operation and maintenance tasks.
  • the requirements for the network autonomy capability of any of the key operation and maintenance tasks mentioned above are different.
  • the level adjustment amount determination module is specifically configured to: determine the task score of each key operation and maintenance task in the at least one key operation and maintenance task; The task scores of each key operation and maintenance task are weighted and averaged to obtain a first value; the first value is determined as the level adjustment amount of the first network operation and maintenance scenario.
  • the task score of the first key operation and maintenance task corresponds to the satisfaction degree of the network autonomy capability of the first key operation and maintenance task.
  • the level adjustment amount determination module is specifically configured to: if the satisfaction degree of the network autonomy capability of the first key operation and maintenance task is a first degree of satisfaction, the first degree of satisfaction represents If the network autonomy capability of the first key operation and maintenance task meets the network autonomy capability required by the second autonomous network level for the first key operation and maintenance task, then it is determined that the task score of the first key operation and maintenance task is equal to the first key operation and maintenance task.
  • the level adjustment amount determination module is also configured to: if the satisfaction degree of the network autonomy capability of the first key operation and maintenance task is a third degree of satisfaction, the third degree of satisfaction represents If the network autonomy capability of the first key operation and maintenance task meets the first percentage of the network autonomy capability required by the second autonomous network level for the first key operation and maintenance task, then the first key operation and maintenance task The task score of is equal to the third score, and the value of the third score is between the first score and the second score.
  • the first value Ts_all satisfies the following formula:
  • K is the number of key operation and maintenance tasks in the at least one key operation and maintenance task
  • Ts i is the at least one key operation and maintenance task.
  • the task score of the i-th key operation and maintenance task among the key operation and maintenance tasks, Twi is the task weight of the i-th key operation and maintenance task.
  • the task weight of the i-th key operation and maintenance task is related to the implementation difficulty of the i-th key operation and maintenance task.
  • the second network autonomy capability evaluation module is specifically configured to: determine the second value according to the autonomous network level score of each network operation and maintenance scenario in the multiple network operation and maintenance scenarios; The second value is determined as a network autonomy capability evaluation result corresponding to the multiple network operation and maintenance scenarios.
  • the second value ANLS_Ava satisfies the following formula:
  • the second value ANLS_Ava satisfies the following formula:
  • M is the number of network operation and maintenance scenarios in the multiple network operation and maintenance scenarios
  • ANLs i is the autonomous network level score of the i-th network operation and maintenance scenario in the multiple network operation and maintenance scenarios
  • Sw i is the Describe the scenario weight of the i-th network operation and maintenance scenario.
  • a communication method which is used in the process of network capability evaluation for multiple network operation and maintenance scenarios.
  • the possible method includes: the autonomous network assessment execution device determines multiple network operation and maintenance scenarios, determines the network autonomy capability evaluation result of each network operation and maintenance scenario in the multiple network operation and maintenance scenarios, and determines the network autonomy capability evaluation results according to the multiple network operation and maintenance scenarios.
  • the network autonomy capability evaluation result of each network operation and maintenance scenario in the network is determined, a network autonomy capability evaluation result corresponding to the multiple network operation and maintenance scenarios is determined, and a network autonomy capability evaluation result corresponding to the multiple network operation and maintenance scenarios is Sent to autonomous network evaluation monitoring device.
  • the autonomous network assessment and monitoring device receives the network autonomy capability assessment result.
  • the autonomous network assessment execution device can obtain the network autonomy capability assessment results of the multiple network operation and maintenance scenarios by executing the method described in any one of the eighth aspects.
  • a communication device including: one or more processors; the one or more memories store one or more computer programs, the one or more computer programs include instructions, and when the When the instructions are executed by the one or more processors, the communication device is caused to perform the method described in any one of the eighth aspects.
  • a computer-readable storage medium including a computer program, which when the computer program is run on an electronic device, causes the electronic device to perform the method described in any one of the eighth aspects.
  • a thirteenth aspect provides a computer program product that, when run on an electronic device, causes the electronic device to execute the method described in any one of the eighth aspects.
  • a fourteenth aspect provides a chip system, including: a memory for storing a computer program; a processor; when the processor calls and runs the computer program from the memory, the electronic device installed with the chip system executes the above-mentioned step. Methods described in any of the eight aspects.
  • a communication system including an autonomous network assessment execution device and an autonomous network assessment monitoring device.
  • the autonomous network assessment execution device can be used to evaluate network autonomy capabilities in a single network operation and maintenance scenario.
  • the autonomous network assessment execution device can be (or include) any one of the second aspects mentioned above.
  • the autonomous network evaluation execution device can send the network autonomy capability evaluation result of the first network operation and maintenance scenario to the autonomous network evaluation monitoring device.
  • the autonomous network assessment execution device can be used to evaluate network autonomy capabilities in multiple network operation and maintenance scenarios.
  • the autonomous network assessment execution device can be (or include) the above-mentioned eighth aspect.
  • the autonomous network assessment execution device can send the network autonomy capability assessment results of multiple network operation and maintenance scenarios to the autonomous network assessment monitoring device.
  • Figure 1 is a schematic diagram of the autonomous network level table of the "network optimization scenario" in the embodiment of the present application;
  • Figure 2a and Figure 2b are respectively schematic diagrams of the differences in network autonomy capabilities of different operators rated at the same autonomous network level;
  • Figure 3 is a schematic diagram of a system architecture applicable to the embodiment of the present application.
  • Figure 4 is a schematic flowchart of the network autonomy capability evaluation method in a single network operation and maintenance scenario provided by the embodiment of the present application;
  • Figure 5 is a schematic diagram of an autonomous network level table for network optimization in an embodiment of the present application.
  • FIG. 6 is a schematic diagram of key operation and maintenance tasks in the embodiment of this application.
  • Figure 7 is a schematic diagram of a method for determining the level adjustment amount of the first network operation and maintenance scenario in an embodiment of the present application
  • Figure 8 is a schematic flowchart of evaluating the network autonomy capability of the "wireless 5G coverage optimization scenario" provided by the embodiment of the present application;
  • Figure 9 is a schematic flowchart of the network autonomy capability evaluation method for multiple network operation and maintenance scenarios provided by the embodiment of the present application.
  • Figure 10 is a schematic structural diagram of a network autonomy capability evaluation device provided by an embodiment of the present application.
  • Figure 11 is a schematic structural diagram of another network autonomy capability evaluation device provided by an embodiment of the present application.
  • Figure 12 is a schematic structural diagram of a communication device provided by an embodiment of the present application.
  • one or more refers to one, two or more than two; "and/or” describes the association relationship of associated objects, indicating that three relationships can exist; for example, A and/or B can mean: A alone exists, A and B exist simultaneously, and B exists alone, where A and B can be singular or plural.
  • the character "/" generally indicates that the related objects are in an "or” relationship.
  • Autonomous network refers to a telecommunications system (including management system and network) with autonomy capabilities which is able to achieve self-control through autonomous capabilities with as little manual intervention as possible. be governed by itself with minimal to no human intervention).
  • the autonomous network level refers to the autonomous capability level of the autonomous network (escribes the level of autonomous capabilities in the autonomous network).
  • the autonomous network level can be determined based on the human-machine division of labor of each network management and operation task (hereinafter referred to as the operation and maintenance task) in the operation and maintenance process.
  • the state of human-machine division of labor is used to reflect the degree or proportion of participation in the completion of operation and maintenance tasks through manual methods and automatic system methods. From a state completely completed manually to a state completely completed automatically by the system, various human-machine division of labor states can be divided.
  • the human-machine division of labor status may include:
  • Manual combined system (manual + system): Operation and maintenance tasks are performed jointly by people and the system, that is, manual methods are combined with automatic system methods.
  • the "manual + system” status can be further subdivided into:
  • the operation and maintenance tasks are dominated by manual methods and supplemented by the system; further, the "artificial-assisted system” can be further subdivided according to the degree or proportion of human and system participation in completing the operation and maintenance tasks.
  • the state of human-machine division of labor can, for example, be further subdivided into "60% manual + 40% system", "80% manual + 20% system”, “90% manual + 10% system", etc.;
  • Different states of human-machine division of labor correspond to different network autonomy capabilities. For example, if the human-machine division of labor status includes: manual, manual + system, and system, then according to the network autonomy capability from high to low, the three human-machine division of labor status are ordered as: system, manual + system, system.
  • the operation and maintenance process is a necessary step to realize network management requirements, forming a complete closed loop from receiving management requirements to realizing the requirements.
  • the operation and maintenance process consists of multiple operation and maintenance tasks (tasks).
  • the operation and maintenance process may include:
  • -Network optimization In order to improve network performance or communication service experience, the process of monitoring and analyzing network performance indicators and other related information, and taking performance optimization measures such as adjusting network resources and parameter configurations.
  • this operation and maintenance process can include the following operation and maintenance tasks: performance anomaly identification, performance degradation prediction, performance problem delimitation, performance problem root cause analysis, and optimization solution generation.
  • one network operation and maintenance scenario can correspond to one of the above-mentioned operation and maintenance processes.
  • network operation and maintenance scenarios may include network optimization scenarios, network planning scenarios, network deployment scenarios, network maintenance scenarios, network operation and maintenance scenarios, etc.
  • network operation and maintenance scenarios can be subdivided from different dimensions.
  • the operation and maintenance scenario can be a network operation and maintenance scenario based on at least one of the following dimensions: wireless network standard dimension, wireless network Business type dimension, wireless network application dimension, wireless environment dimension, and wireless traffic status dimension.
  • wireless network performance type dimension it is divided into: wireless coverage optimization scenarios, wireless capacity optimization scenarios, wireless rate optimization scenarios, wireless voice quality optimization scenarios, etc.;
  • third generation mobile communication technology (3G) optimization scenarios fourth generation mobile communication technology (4G) optimization scenarios, fifth generation communication technology ( 5th generation mobile communication technology, 5G) optimization scenarios, etc.;
  • enhanced mobile broadband (eMBB) optimization scenarios ultra-reliable low latency communications (URLLC) optimization scenarios
  • ultra-reliable low latency communications (URLLC) optimization scenarios mobile internet of things (mIoT) Optimization scenarios, vehicle to everything (V2X) optimization scenarios, etc.
  • eMBB enhanced mobile broadband
  • URLLC ultra-reliable low latency communications
  • mioT mobile internet of things
  • V2X vehicle to everything
  • wireless traffic status dimension Based on the wireless traffic status dimension, it is divided into: low traffic optimization scenario, medium traffic optimization scenario, high traffic optimization scenario, etc.
  • network optimization scenarios can include: wireless 3G coverage optimization scenarios, wireless 4G coverage optimization scenarios, wireless 5G coverage optimization scenarios, wireless 3G capacity optimization scenarios, wireless 4G Capacity optimization scenarios and wireless 5G capacity optimization scenarios, etc.
  • the above-mentioned network scenario division dimensions are also applicable to other network operation and maintenance scenarios, such as network planning scenarios, network deployment scenarios, network maintenance scenarios, and network operation and maintenance scenarios.
  • Network autonomy capability refers to the ability to realize self-management and control, and is used to reflect the degree of autonomy of the network technology used. The higher the degree of network autonomy, the higher the network autonomy capability.
  • the network autonomy capability of a network operation and maintenance scenario can be determined by the network autonomy capability of the operation and maintenance tasks included in the network operation and maintenance scenario.
  • the network autonomy capability of an operation and maintenance task can be determined by the human-machine division of labor of the operation and maintenance task.
  • the autonomous network level is used to evaluate the network autonomy capability.
  • the autonomous network level of a telecommunications system is determined based on the human-machine division of labor for each operation and maintenance task in the operation and maintenance process. For example, taking the "network optimization" operation and maintenance process as an example, if the operation and maintenance process only includes performance Anomaly identification, performance problem root cause analysis, and optimization solutions generate three operation and maintenance tasks.
  • the autonomy of the "network optimization" operation and maintenance process can be determined based on the human-machine division of labor status of these three operation and maintenance tasks and the autonomous network level division rules. Network level.
  • the autonomous network level division rules define the human-machine division of labor (or the network autonomy capabilities that should be met) for each operation and maintenance task under each autonomous network level.
  • the autonomous network level division rules include the correspondence between the autonomous network levels and the status of human-machine division of labor in operation and maintenance tasks. This correspondence can be represented as a diagram or table at the autonomous network level.
  • Figure 1 illustrates an autonomous network level classification rule for a "network optimization" operation and maintenance process in a table format.
  • the autonomous network levels from low to high include: level 0, level 1, level 2, level 3, level 4, and level 5.
  • Each box in Figure 1 corresponds to an operation and maintenance task in the "network optimization" operation and maintenance process.
  • the letters in the box indicate the name or type of the corresponding operation and maintenance task, including:
  • Operation and maintenance task A1 generation of monitoring rules and optimization strategies
  • Operation and maintenance task B1 Network/business assurance intent assessment
  • Operation and maintenance task D1 performance anomaly identification
  • Operation and maintenance task E1 prediction of performance degradation
  • Operation and maintenance task F1 delimitation of performance issues
  • Operation and maintenance task G1 root cause analysis of performance problems
  • Operation and maintenance task H1 optimization plan generation
  • Operation and maintenance task I1 evaluation and determination of optimization plan
  • Operation and maintenance task J1 Optimize plan execution.
  • the human-machine division of labor required for operation and maintenance tasks at each autonomous network level is shown in the brackets in each box in Figure 1. Take the human-machine division of labor required for each operation and maintenance task at level 3 as an example:
  • the manual extension status required for operation and maintenance task E1 manual + system
  • the manual extension status required for operation and maintenance task G1 manual + system
  • the The human-machine division of labor status must meet the manual division status required by the target level for each operation and maintenance task, so that the autonomous network level of the operation and maintenance process can be rated as the target level. For example, if there is an operation and maintenance task in an operation and maintenance process that does not meet the human-machine division of labor status required by level 3, but meets the manual division of labor status required by level 2, other operation and maintenance tasks will all meet the manual labor division status required by level 3. extension status, the autonomous network level of this operation and maintenance process cannot be rated as level 3, but can only be rated as level 2.
  • Second aspect The difficulty of realizing network autonomy capabilities for operation and maintenance tasks cannot be reflected.
  • the third aspect The difficulty of realizing scene autonomy cannot be reflected.
  • Operator A's autonomy capability reaches Level 3 only for 5G outdoor coverage optimization scenarios
  • Operator B's autonomy capabilities for both 5G Outdoor coverage optimization scenarios and indoor coverage optimization scenarios reach Level 3.
  • the current autonomous network The hierarchical assessment method cannot reflect the above differences.
  • embodiments of the present application provide a network autonomy capability evaluation method to improve the refinement of network autonomy capability evaluation.
  • the embodiments of the present application will be described below with reference to the accompanying drawings.
  • Figure 3 exemplarily shows a system architecture diagram applicable to the embodiment of the present application.
  • the embodiment of the present application can perform network autonomy capability evaluation on autonomous networks of different scopes shown in the figure.
  • the autonomous network scope can include the following three situations:
  • Single domain autonomous network including network elements and domain management functional units;
  • Cross-domain autonomous network including network elements, domain management functional units and cross-domain management functional units;
  • Business autonomous network including network elements, domain management functional units, cross-domain management functional units and business operation units.
  • Business operation unit It can also be called communication service management function unit, which can provide functions and management such as billing, settlement, accounting, customer service, business, network monitoring, communication service life cycle management, and business intent translation.
  • Communication service management function unit can provide functions and management such as billing, settlement, accounting, customer service, business, network monitoring, communication service life cycle management, and business intent translation.
  • Serve Including the operator's operating system or the vertical industry's operating system (vertical operational technology system).
  • Cross-domain management functional unit It can also be called network management function (NMF).
  • the cross-domain management functional unit provides one or more of the following functions or management services: network life cycle management, network deployment, Network fault management, network performance management, network configuration management, network guarantee, network optimization function, translation of network intent from communication service provider (intent-CSP), communication service user's Translation of network intent (intent from communication service consumer, intent-CSC), etc.
  • the network here can include one or more network elements, subnetworks or network slices.
  • the cross-domain management functional unit may be a network slice management function (NSMF), a management data analytical function (MDAF), or a cross-domain self-organization network function. SON-function), or cross-domain intent management functional unit.
  • the cross-domain management functional unit can also provide one or more of the following management functions or management services: subnetwork life cycle management, subnetwork deployment, subnetwork fault management, Performance management of subnetworks, configuration management of subnetworks, guarantee of subnetworks, optimization functions of subnetworks, translation of subnetwork intentions of communication service providers, translation of subnetwork intentions of communication service users, etc.
  • a subnetwork can be composed of multiple small subnetworks or multiple network slice subnetworks.
  • Domain management function unit It can also be called subnetwork management function (NMF) or network element management function unit (network element/function management function).
  • the domain management function unit provides one or more of the following functions or management Services: life cycle management of subnetworks or network elements, deployment of subnetworks or network elements, fault management of subnetworks or network elements, performance management of subnetworks or network elements, guarantee of subnetworks or network elements, subnetwork or network Optimal management of elements, intention translation of subnetworks or network elements, etc.
  • the subnetwork here includes one or more network elements.
  • the subnetwork may also include one or more subnetworks, that is, one or more subnetworks form a subnetwork with a larger coverage area.
  • the subnetwork here may also include one or more network slice subnetworks.
  • Subnetworks include one of the following description methods:
  • a network in a certain technical domain such as wireless access network, core network, transmission network, etc.
  • a network of a certain standard such as a global system for mobile communications (GSM) network, a long term evolution (LTE) network, a 5G network, etc.;
  • GSM global system for mobile communications
  • LTE long term evolution
  • 5G 5th Generation
  • GSM global system for mobile communications
  • LTE long term evolution
  • the network provided by a certain equipment vendor such as the network provided by equipment vendor X, etc.;
  • a network in a certain geographical area such as the network of factory A, the network of prefecture-level city B, etc.
  • Network element An entity that provides network services, including core network elements, access network elements, etc.
  • core network elements may include, but are not limited to, access and mobility management function (AMF) entities, session management function (SMF) entities, policy control function (PCF) entities.
  • AMF access and mobility management function
  • SMF session management function
  • PCF policy control function
  • NWDAF network data analysis function
  • NRF network repository function
  • gateway etc.
  • Access network elements may include but are not limited to: various types of base stations (such as next-generation base stations (generation node B, gNB), evolved base stations (evolved Node B, eNB), centralized control unit (central unit control panel, CUCP), centralized unit (central unit, CU), distributed unit (distributed unit, DU), centralized user plane unit (central unit user panel, CUUP), etc.
  • generation node B gNB
  • evolved base stations evolved base stations
  • evolved Node B evolved base stations
  • eNB evolved base stations
  • centralized control unit central unit control panel, CUCP
  • centralized unit central unit
  • DU distributed unit
  • DU distributed unit user plane unit
  • CUUP centralized user plane unit
  • the business operation unit is the management service provider, and other business operator units can be management service consumers;
  • the cross-domain management functional unit is the management service provider and the business operation unit is the management service consumer;
  • the domain management functional unit is the management service provider
  • the cross-domain management functional unit or business operation unit is the management service consumer
  • the management service is the management service provided by the above-mentioned network element
  • the network element is the management service provider
  • the domain management functional unit or cross-domain management functional unit or business operation unit is the management service consumer.
  • FIG 4 is a schematic flowchart of a network autonomy capability evaluation method for a single network operation and maintenance scenario provided by an embodiment of the present application. This process can be performed by the network autonomy capability evaluation device.
  • the network autonomy capability evaluation device can be implemented by software, hardware, or a combination of software and hardware. It can be understood that when implemented by software, the network autonomy capability evaluation device may refer to an application program that implements the network autonomy capability evaluation method, or an electronic device installed with the application program.
  • the network autonomy capabilities of various ranges of autonomous networks in Figure 3 can be evaluated in a single network operation and maintenance scenario.
  • the following takes the first network operation and maintenance scenario as an example for explanation.
  • the process may include the following steps:
  • S401 Determine the autonomous network level of the first network operation and maintenance scenario as the first autonomous network level.
  • the first network operation and maintenance scenario is any possible network operation and maintenance scenario, for example, it can be any one of a network optimization scenario, a network planning scenario, a network deployment scenario, a network maintenance scenario, and a network operation and maintenance scenario, or it can be more Refined network operation and maintenance scenarios may be, for example, wireless coverage optimization scenarios, or wireless 5G coverage optimization scenarios, etc.
  • the embodiments of this application do not limit this.
  • the first network operation and maintenance scenario may include at least one operation and maintenance task.
  • the autonomous network level of the first network operation and maintenance scenario can be determined based on the human-machine division of labor status of the operation and maintenance tasks included in the first network operation and maintenance scenario, and the preset autonomous network level classification rules. This is for convenience of description.
  • the determined autonomous network level of the first network operation and maintenance scenario is called the first autonomous network level.
  • the first autonomous network level is an autonomous network level included in the autonomous network level table. According to the human-machine division of operation and maintenance tasks and the autonomous network level division rules, the method of determining the autonomous network level of the first network operation and maintenance scenario is basically the same as the traditional method.
  • Figure 5 exemplarily shows the network optimization autonomous network level table used to evaluate the autonomous network level of the "wireless 5G coverage optimization scenario".
  • this table Including the human-machine division of labor required for each operation and maintenance task at each autonomous network level in the "wireless 5G coverage optimization scenario”.
  • Each box in Figure 5 corresponds to an operation and maintenance task in the "Wireless 5G Coverage Optimization Scenario".
  • the letters in the box indicate the name or type of the corresponding operation and maintenance task, including:
  • Operation and maintenance task A2 Coverage monitoring rules and optimization strategy generation
  • Operation and maintenance task B2 Wireless coverage assurance intent assessment
  • Operation and maintenance task D2 Coverage performance anomaly identification
  • Operation and maintenance task E2 coverage performance degradation prediction
  • Operation and maintenance task F2 coverage problem delimitation
  • Operation and maintenance task G2 coverage problem location
  • Operation and maintenance task H2 generation of coverage optimization plan
  • Operation and maintenance task I2 coverage optimization plan evaluation and decision-making
  • Operation and maintenance task J2 Execution of coverage optimization plan.
  • Table 1 shows the human-machine division of labor status for each operation and maintenance task in the "wireless 5G coverage optimization scenario".
  • Table 1 Human-machine division of labor status for each operation and maintenance task in wireless 5G coverage optimization scenario
  • the "wireless 5G coverage optimization scenario” can be determined "The autonomous network level is Level 2.
  • S402 Determine the level adjustment amount of the first network operation and maintenance scenario based on the degree of satisfaction of the network autonomy capability of each key operation and maintenance task in the first network operation and maintenance scenario.
  • the at least one key operation and maintenance task includes a first key operation and maintenance task, the network autonomy capability requirements of the first autonomous network level for the first key operation and maintenance task, and the second autonomous network level for the first key operation and maintenance task.
  • the requirements for network autonomy capabilities of tasks are different.
  • the autonomous network level of the first network operation and maintenance scenario is the first autonomous network level
  • an operation and maintenance task included in the first network operation and maintenance scenario satisfies the above conditions (i.e., the first autonomous network
  • the operation and maintenance task is a critical operation and maintenance task.
  • the second autonomous network level is higher than the first autonomous network level.
  • the second autonomous network level is an autonomous network level one level higher than the first autonomous network level. For example, if the first autonomous network level is Level 2 in Figure 5, then the second autonomous network level is Level 3 in Figure 5.
  • the first autonomous network level is responsible for the key operation and maintenance task.
  • the requirements for network autonomy capabilities for key operation and maintenance tasks are different from the requirements for network autonomy capabilities for key operation and maintenance tasks at the second autonomous network level.
  • the following takes the first network operation and maintenance scenario as the "wireless 5G coverage optimization scenario" as an example to explain the method of determining the key operation and maintenance tasks.
  • the autonomous network level of the "wireless 5G coverage optimization scenario” is level 2.
  • the human-machine division of labor requirements for each operation and maintenance task at level 2 and the requirements for each operation and maintenance task at level 3 in Figure 5 can be determined.
  • the identified key operation and maintenance tasks are the key operation and maintenance tasks in the "wireless 5G coverage optimization scenario" when the autonomous network level is level 2.
  • the first autonomous network level of the first operation and maintenance scenario is level 2 in Figure 5, then the second autonomous network The level is level 3 in Figure 5, and the identified key operation and maintenance tasks can be the operation and maintenance tasks identified by the dotted box in Figure 6.
  • the network autonomy capability required for this operation and maintenance task at level 2 must reach the network autonomy capability corresponding to the "manual + system" state, and the network autonomy capability required for this operation and maintenance task at level 3
  • the network autonomy capability must reach the network autonomy capability corresponding to the "system” state and meet the above-mentioned "network autonomy capability requirements of the first autonomous network level for this key operation and maintenance task, and the requirements of the second autonomous network level for this key operation and maintenance task.”"Network autonomy capabilities have different requirements", so task C2 (covering data collection tasks) is a key operation and maintenance task.
  • task D2 coverage performance anomaly identification
  • task E2 coverage performance degradation prediction
  • task F2 coverage problem delimitation
  • task G2 coverage problem location
  • task H2 coverage optimization solution generation
  • task I2 coverage optimization solution evaluation decision
  • task A2 coverage monitoring rules and optimization strategy generation
  • the network autonomy required for this operation and maintenance task at level 2 must reach the network autonomy capability corresponding to the "manual + system” state
  • the network autonomy required for this operation and maintenance task at level 3 The autonomy capability must also reach the network autonomy capability corresponding to the "artificial + system” state.
  • the degree of satisfaction of the network autonomy capability of the key operation and maintenance task can be determined.
  • the degree of satisfaction of the network autonomy capability of the first key operation and maintenance task refers to the network autonomy capability of the first key operation and maintenance task, and the satisfaction of the second autonomous network level for the first key operation and maintenance task.
  • the degree of network autonomy required by the mission For example, taking the autonomous network level of the first network operation and maintenance scenario as level 2 as an example, the satisfaction degree of the first key operation and maintenance task means: the network autonomy capability of the first key operation and maintenance task meets level 3 for the first key operation and maintenance task.
  • the degree of network autonomy required by key operation and maintenance tasks may be: fully satisfied, not satisfied (that is, not satisfied at all), or partially satisfied (such as 80% satisfied).
  • the degree of satisfaction can be expressed as a percentage or level or other similar parameters.
  • the state of human-machine division of labor can represent the network autonomy capability, "the extent to which the network autonomy capability of the first key operation and maintenance task meets the network autonomy capability required by the second autonomous network level for the first key operation and maintenance task”, also It can be understood as “the degree to which the human-machine division of labor state of the first key operation and maintenance task meets the human-machine division of labor state required by the second autonomous network level for the first key operation and maintenance task.”
  • the degree of satisfaction may include two situations: “satisfied” and “not satisfied (that is, not satisfied at all)".
  • the first key operation and maintenance task if the network autonomy capability of the first key operation and maintenance task meets the network autonomy capability required by the second autonomous network level for the first key operation and maintenance task, then the first key operation and maintenance task The degree of satisfaction of the network autonomy capability is "satisfied", otherwise it is "not satisfied”.
  • the key operation and maintenance tasks included in the first network operation and maintenance scenario are as shown in Figure 6.
  • task C2 coverage data Collection task
  • Figure 6 coverage data Collection task
  • the human-machine division of labor status required by level 3 for this key operation and maintenance task is "system”. Since this The actual human-machine division of labor for key operation and maintenance tasks has reached the level 3 requirements for this key operation and maintenance task, which means that the network autonomy capability of this key operation and maintenance task meets the level 3 network autonomy requirements for this key operation and maintenance task.
  • the human-machine division of labor status of this key operation and maintenance task can be determined according to Table 1 It is "manual”. According to Figure 6, it can be determined that the human-machine division of labor required by level 3 for this key operation and maintenance task is "manual + system", because the actual human-machine division of labor for this key operation and maintenance task cannot reach (or satisfy) the level. 3 requirements for this key operation and maintenance task, which means that the network autonomy capability of this key operation and maintenance task does not meet the network autonomy capability required by level 3 for this key operation and maintenance task. Therefore, the network autonomy capability of this key operation and maintenance task is limited. Full Sufficient means "not satisfied”.
  • the degree of satisfaction may include multiple situations, such as: satisfaction (ie, complete satisfaction), dissatisfaction (ie, complete dissatisfaction), and partial satisfaction (eg, satisfaction to a certain extent or proportion).
  • satisfaction ie, complete satisfaction
  • dissatisfaction ie, complete dissatisfaction
  • partial satisfaction eg, satisfaction to a certain extent or proportion.
  • partial satisfaction can include a variety of more subdivided situations depending on the degree of satisfaction (proportion).
  • the actual human-machine division of labor for the first key operation and maintenance task is "30% manual + 70% system", and level 3 for this key operation and maintenance task
  • the human-machine division of labor status required by the task is "system”
  • the network autonomy level of the key operation and maintenance task is 70% satisfied
  • the actual human-machine division of labor status of the first key operation and maintenance task is "30%” "Manual + 70% system”
  • the human-machine division of labor required by level 3 for this key operation and maintenance task is "10% manual + 90% system”
  • the degree of satisfaction of the network autonomy capability level of this key operation and maintenance task is 77% satisfied
  • the actual human-machine division of labor for the first key operation and maintenance task is "30% manual + 70% system”
  • the human-machine division of labor required for level 3 for this key operation and maintenance task is "60% manual + 40% system” ”
  • the satisfaction degree of the network autonomy capability level of this key operation and maintenance task is 100%
  • the network autonomy of all key operation and maintenance tasks can be determined. Capability satisfaction determines the level adjustment amount for the first network operation and maintenance scenario.
  • the level adjustment amount can be represented by the weighted average of the task scores (task scope, Ts) of all key operation and maintenance tasks.
  • Figure 7 is a schematic flowchart of determining the level adjustment amount of the first network operation and maintenance scenario provided by an embodiment of the present application. As shown in the figure, the process may include the following steps:
  • S701 Determine the task score of each key operation and maintenance task in the first network operation and maintenance scenario.
  • the score of the key operation and maintenance task can be determined based on the satisfaction degree of the network autonomy capability of the key operation and maintenance task.
  • the task score of the first key operation and maintenance task corresponds to the satisfaction degree of the network autonomy capability of the first key operation and maintenance task.
  • the first degree of satisfaction (“satisfaction”) can be set to correspond to the first score
  • the second degree of satisfaction (“dissatisfaction”) can be set.
  • the second score is not equal to the first score.
  • the second score is lower than the first score.
  • the first score may be equal to 1, and the second score may be equal to 0.
  • the first degree of satisfaction represents the first key operation and maintenance task. If the network autonomy capability of the task meets the network autonomy capability required by the second autonomous network level for the first key operation and maintenance task, then the task score of the first key operation and maintenance task is determined to be equal to the first score; if the first key operation and maintenance task has The degree of satisfaction of the network autonomy capability is the satisfaction degree.
  • the second degree of satisfaction indicates that the network autonomy capability of the first key operation and maintenance task does not meet the network autonomy capability required by the second autonomous network level for the first key operation and maintenance task. Then the first degree of satisfaction is determined.
  • the task score for critical operations tasks is equal to the second score.
  • the degree of satisfaction includes multiple levels
  • the degree of satisfaction includes the above-mentioned first degree of satisfaction (indicating “satisfaction”) and the second degree of satisfaction (indicating “not satisfied”)
  • It may further include a third degree of satisfaction, where the third degree of satisfaction indicates that the network autonomy capability of the first key operation and maintenance task meets the first percentage of the network autonomy capability required by the second autonomous network level for the first key operation and maintenance task, For example, if the first percentage is equal to 70%, then the third degree of satisfaction is "70%" satisfaction.
  • Corresponding scores can be set for each degree of satisfaction. The higher the degree of satisfaction, the higher the task score.
  • the corresponding task score is equal to 1. If the degree of satisfaction is the second degree of satisfaction ("not satisfied"), the corresponding task score is equal to 0. If the degree of satisfaction is the third degree of satisfaction (such as "70% satisfied"), the corresponding task score is equal to 0.7. In this case, when determining the task score of the first key operation and maintenance task, if the satisfaction degree of the network autonomy capability of the first key operation and maintenance task is the third degree of satisfaction, then the task score of the first key operation and maintenance task is equal to Third score. Among them, the value of the third score is between the first score and the second score. For example, the third score is greater than the second score and less than the first score.
  • the task score corresponding to the first degree of satisfaction is equal to 1.
  • the task score corresponding to the second degree of satisfaction is equal to 0, and the task score corresponding to the third degree of satisfaction is equal to 0.7.
  • a corresponding coefficient can be set in advance for each degree of satisfaction. The higher the degree of satisfaction, the higher the coefficient. In this way, according to the satisfaction degree of the autonomy capability of the first key operation and maintenance task, the coefficient corresponding to the satisfaction degree can be queried, and the coefficient is multiplied by the preset basic score to obtain the task score of the first key operation and maintenance task.
  • the task score of a key operation and maintenance task can reflect the level of the network autonomy capability of the key operation and maintenance task.
  • the higher the score the higher the network autonomy capability of the key operation and maintenance task.
  • the task score of the first key operation and maintenance task is equal to the third score (corresponding to the third degree of satisfaction)
  • the network autonomy capability of the dimension task is between the network autonomy capability corresponding to the first score (corresponding to the first degree of satisfaction) and the network autonomy capability corresponding to the second score (corresponding to the second degree of satisfaction).
  • the task scores of the key operation and maintenance task are different, which can reflect different key operation and maintenance tasks.
  • the contribution of the task to the level adjustment amount makes the determined level adjustment amount more reasonable.
  • the network autonomy capability of the first key operation and maintenance task can be determined based on the network autonomy capability of the first key operation and maintenance task. Satisfaction is used to determine the task score of the first key operation and maintenance task. That is to say, for key operation and maintenance tasks whose network autonomy capability meets a higher autonomous network level, the degree of satisfaction of the network autonomy capability can include multiple possibilities.
  • the task score of the key operation and maintenance task is related to the score of the key operation and maintenance task.
  • the network autonomy capability meets the corresponding requirements, which further refines the contribution of different key operation and maintenance tasks to the level adjustment amount, thereby making the determined level adjustment amount more refined.
  • S702 Perform a weighted average of task scores of all key operation and maintenance tasks in the first network operation and maintenance scenario to obtain a first value.
  • the first value is a weighted average of task scores of all key operation and maintenance tasks in the first network operation and maintenance scenario.
  • the first value (Ts_all) can be calculated according to the following formula:
  • K is the number of tasks of all key operation and maintenance tasks in the first network operation and maintenance scenario
  • Ts i is the task score of the i-th key operation and maintenance task among all key operation and maintenance tasks in the first network operation and maintenance scenario
  • Tw i is the task weight of the i-th key operation and maintenance task.
  • the task weight of the i-th key operation and maintenance task is related to the implementation difficulty of the i-th key operation and maintenance task.
  • the weight of the operation and maintenance task can be set according to the difficulty of implementation of the operation and maintenance task (which can also be understood as the difficulty of autonomous implementation of the operation and maintenance task). The greater the difficulty of implementation, the greater the weight.
  • key operation and maintenance tasks can be implemented through
  • the weight of the task reflects the difficulty of implementing the key operation and maintenance task in the task score of the key operation and maintenance task, and then reflects it in the network autonomy capability evaluation result of the first operation and maintenance scenario, making the network autonomy capability evaluation result of the first operation and maintenance scenario More refined.
  • the setting of task weight can consider but is not limited to the following factors:
  • the weight of each key operation and maintenance task can also be set to the same weight, for example, set to 1.
  • the above formula for calculating the weighted average of task scores can be transformed into the following formula for calculating the arithmetic average:
  • K is the number of tasks of all key operation and maintenance tasks in the first network operation and maintenance scenario
  • Ts i is the task score of the i-th key operation and maintenance task among all key operation and maintenance tasks in the first network operation and maintenance scenario.
  • S703 Determine the first value as the level adjustment amount of the first network operation and maintenance scenario.
  • the determined first weighted average may be used as the level adjustment amount in the first network operation and maintenance scenario.
  • the level adjustment amount of the first network operation and maintenance scenario is determined based on the calculated first value (weighted average of the task scores), The difference between the actual network autonomy capabilities of all key operation and maintenance tasks and the network autonomy capabilities required by higher autonomous network levels can be taken into account, so that the determined level adjustment amount can be made more reasonable.
  • S403 Determine the network autonomy capability evaluation result of the first network operation and maintenance scenario based on the first autonomous network level and the level adjustment amount.
  • the network autonomy capability evaluation result of the first network operation and maintenance scenario can be expressed using the network autonomy capability level score.
  • the network autonomy capability level score of the first network operation and maintenance scenario is equal to the sum of the first autonomous network level and the level adjustment amount.
  • the network autonomy capability represented by the network autonomy capability evaluation result is higher than the network autonomy capability corresponding to the first autonomous network level, and lower than the network autonomy capability corresponding to the second autonomous network level. That is to say, the network autonomy capability of the first network operation and maintenance scenario is between the network autonomy capability corresponding to the first autonomous network level and the network autonomy capability corresponding to the second autonomous network level.
  • the embodiments of the present application can improve the refinement of the network autonomy capability assessment.
  • the evaluation result can be output, for example, sent to the autonomous network evaluation and monitoring device.
  • the degree of satisfaction of the network autonomy capability of a key operation and maintenance task is determined to determine the level adjustment amount of the first network operation and maintenance scenario, thereby determining the network autonomy capability evaluation of the first network operation and maintenance scenario based on the first autonomous network level and the level adjustment amount.
  • the level adjustment amount is determined based on the satisfaction of the network autonomy capability of key operation and maintenance tasks, so that the actual network autonomy capability of key operation and maintenance tasks is compared with the requirements of a higher autonomy network level.
  • the differences between the network autonomy capabilities are taken into account, and the level adjustment amount is determined based on this difference, which can improve the refinement of the network autonomy capability evaluation.
  • Figure 8 is a specific example of the process shown in Figure 4. That is, Figure 8 describes when the first network operation and maintenance scenario is "no In the case of "wireless 5G coverage optimization scenario", the process of evaluating network autonomy capabilities for this "wireless 5G coverage optimization scenario”.
  • the process for evaluating the network autonomy capability of the "wireless 5G coverage optimization scenario" provided by the embodiment of the present application may include:
  • S801 Based on the human-machine division of labor status of each operation and maintenance task in the "wireless 5G coverage optimization scenario" to be evaluated, and the preset network autonomy level table as shown in Figure 5, determine the "wireless 5G coverage optimization scenario”
  • S801 may include the following S8011 to S8012:
  • the “Wireless 5G Coverage Optimization Scenario” operation and maintenance process includes the following operation and maintenance tasks: coverage monitoring rules and optimization strategy generation tasks, wireless coverage assurance intent evaluation tasks, coverage data collection tasks, coverage performance anomaly identification tasks, and coverage performance degradation prediction tasks.
  • Covers the problem delimitation task covers the problem location task, covers the optimization plan generation task, covers the optimization plan evaluation and decision-making task, and covers the optimization plan execution task.
  • the human-machine division of labor for each of the above operation and maintenance tasks is shown in Table 1.
  • S802 may include the following steps S8021 to S8022:
  • S8021 may include the following steps I and II:
  • task C2 (coverage data collection task), task D2 ( Coverage performance anomaly identification), task E2 (coverage performance degradation prediction), task F2 (coverage problem delimitation), task G2 (coverage problem location), task H2 (coverage optimization plan generation), and task I2 (coverage optimization plan evaluation decision) .
  • Step II For the key operation and maintenance tasks selected in step I, comparatively analyze the satisfaction of the human-machine division of labor status of each key operation and maintenance task in the "wireless 5G coverage optimization scenario", and obtain the task score Ts of each key operation and maintenance task. .
  • “wireless The task score of each key operation and maintenance task in "5G Coverage Optimization Scenario” is shown in Table 2.
  • the task score corresponding to "satisfied” is equal to 1
  • the task score corresponding to "not satisfied” is equal to 0.
  • Table 2 Task scores of key operation and maintenance tasks in "Wireless 5G coverage optimization scenario"
  • Step S8022 may specifically include the following steps III to IV:
  • Step III Determine the task weight Tw of the key operation and maintenance tasks based on the difficulty of realizing autonomy of the key operation and maintenance tasks.
  • Table 3 shows an example of key operation and maintenance task weight Tw.
  • Table 3 Task weights of key operation and maintenance tasks
  • Step IV Calculate the weighted average of the task scores of all key tasks Ts_all based on the task score Ts and task weight Tw of the key operation and maintenance tasks of the "wireless 5G coverage optimization scenario", and then calculate the weighted average of the task scores of all key tasks Ts_all based on Ts_all and the "wireless 5G coverage optimization scenario".
  • the autonomous network level score ANLs of the "wireless 5G coverage optimization scenario” is calculated.
  • Ts_all Sum(Ts1*Tw1+Ts2*Tw2+...+Tsn*Twn)/Sum(1*Tw1+1*Tw2+...+1*Twn)
  • the calculation result of the autonomous network grade score of "wireless 5G coverage optimization scenario” is:
  • FIG 9 is a flowchart of a network autonomy capability evaluation method for multiple network operation and maintenance scenarios provided by an embodiment of the present application.
  • the network autonomy capability evaluation device can be implemented by software, hardware, or a combination of software and hardware. It can be understood that when implemented by software, the network autonomy capability evaluation device may refer to an application program that implements the network autonomy capability evaluation method, or an electronic device installed with the application program. Through this process, the network autonomy capabilities of various ranges of autonomous networks in Figure 3 can be evaluated.
  • the process may include the following steps:
  • S901 Determine multiple network operation and maintenance scenarios.
  • At least one network operation and maintenance scenario among the plurality of network operation and maintenance scenarios may be a network operation and maintenance scenario obtained based on at least one of the following dimensions: wireless network standard dimension, wireless network service type dimension, wireless network application dimension, and wireless environment dimension. , wireless traffic status dimension.
  • Each network operation and maintenance scenario in the plurality of network operation and maintenance scenarios includes at least one operation and maintenance task.
  • scenario combinations For convenience of description, these multiple network operation and maintenance scenarios can be called scenario combinations.
  • multiple network optimization scenarios that require network autonomy capability evaluation can be selected to form a scenario combination.
  • the multiple network optimization scenarios can include: wireless 4G coverage optimization scenarios, wireless 5G coverage optimization scenarios, and wireless 4G rate optimization. Scenario, wireless 5G rate optimization scenario.
  • S902 Determine the autonomy capability evaluation result of each network operation and maintenance scenario in the multiple network operation and maintenance scenarios (ie, scenario combination).
  • traditional methods can be used to determine the autonomous network level of each network operation and maintenance scenario in the scenario combination, and obtain the autonomy capability evaluation results of each network operation and maintenance scenario.
  • the network capability evaluation method for a single network operation and maintenance scenario provided by the above embodiments of the present application can be used.
  • the method as shown in Figure 4 is used to evaluate each network in the scenario combination.
  • the network autonomy capability of each network operation and maintenance scenario is evaluated, and the autonomy capability evaluation results of each network operation and maintenance scenario are obtained.
  • S903 Determine a network autonomy capability evaluation result corresponding to the multiple network operation and maintenance scenarios (ie, scenario combination) based on the autonomy capability evaluation result of each network operation and maintenance scenario (ie, scenario combination).
  • the second value may be determined based on the autonomous network level score of each network operation and maintenance scenario in multiple network operation and maintenance scenarios (ie, scenario combination).
  • the second value may be determined for the multiple network operation and maintenance scenarios (ie, scenario combination).
  • the weighted average of the autonomous network grade scores of all network operation and maintenance scenarios in the combination determine the second value as a network autonomy capability evaluation result corresponding to the multiple network operation and maintenance scenarios (ie, scenario combination).
  • the second value (ANLS_Ava) can be calculated according to the following formula:
  • M is the number of network operation and maintenance scenarios in multiple network operation and maintenance scenarios (ie, scenario combinations), and ANLs i is the autonomous network level score of the i-th network operation and maintenance scenario in multiple network operation and maintenance scenarios.
  • the second value (ANLS_Ava) can be calculated according to the following formula:
  • M is the number of network operation and maintenance scenarios in multiple network operation and maintenance scenarios (ie, scenario combinations)
  • ANLs i is the autonomous network level score of the i-th network operation and maintenance scenario in multiple network operation and maintenance scenarios
  • Sw i is the scenario weight (scenario weight, Sw) of the i-th network operation and maintenance scenario.
  • the evaluation result can be output, for example, sent to the autonomous network evaluation and monitoring device.
  • the network autonomy capability evaluation results of each network operation and maintenance scenario are determined respectively, and then the network autonomy capability evaluation results of each network operation and maintenance scenario are determined.
  • the network autonomy capability evaluation results determine the network autonomy capabilities corresponding to the multiple network operation and maintenance scenarios. Therefore, the network autonomy capabilities of the multiple network operation and maintenance scenarios can be integrated to evaluate the network autonomy corresponding to the scenario combination formed by the multiple network operation and maintenance scenarios. capabilities, which fills the gap that currently there is no way to evaluate network autonomy capabilities based on scenario combinations.
  • embodiments of the present application also provide a network autonomy capability evaluation device.
  • the network autonomy capability evaluation device can execute the processes shown in Figures 4 and 7.
  • the network autonomy capability evaluation device 1000 may include: an autonomous network level determination module 1001, a level adjustment amount determination module 1002, and a network autonomy capability evaluation module 1003.
  • the autonomous network level determination module 1001 is used to determine the autonomous network level of the first network operation and maintenance scenario as the first autonomous network level; the level adjustment amount determination module 1002 is used to determine the autonomous network level according to each key operation in the first network operation and maintenance scenario.
  • the degree of satisfaction of the network autonomy capability of the maintenance task is determined to determine the level adjustment amount of the first network operation and maintenance scenario; the network autonomy capability evaluation module 1003 is used to determine the level adjustment amount according to the first autonomous network level and the level adjustment amount. The following describes the network autonomy capability evaluation results of the first network operation and maintenance scenario.
  • the autonomous network level determination module 1001 can determine the autonomous network level of the first network operation and maintenance scenario as the first autonomous network level according to the autonomous network level classification rule 1004; the level adjustment amount determination module 1002 can determine the autonomous network level based on the autonomous network level determination module 1001 The first autonomous network level is determined, and the autonomous network level division rule 1004 is determined, and the first network operation and maintenance is determined based on the satisfaction of the network autonomy capability of each key operation and maintenance task in the first network operation and maintenance scenario. The amount of level adjustment for the scene.
  • the first network operation and maintenance scenario includes at least one key operation and maintenance task
  • the at least one key operation and maintenance task includes a first key operation and maintenance task
  • the first autonomous network level is critical to the first key operation and maintenance task.
  • the requirements for the network autonomy capability of the task are different from the requirements of the second autonomous network level for the network autonomy capability of the first key operation and maintenance task, and the satisfaction degree of the network autonomy capability of the first key operation and maintenance task is that of the first key operation and maintenance task.
  • the network autonomy capability of key operation and maintenance tasks meets the degree of network autonomy capability required by the second autonomous network level for the first key operation and maintenance task, and the second autonomous network level is higher than the first autonomous network level.
  • the second autonomous network level is an autonomous network level one level higher than the first autonomous network level.
  • the above-mentioned network autonomy capability evaluation device 1000 can implement all the method steps as shown in Figure 4 in the above-mentioned method embodiment, and can achieve the same technical effect.
  • the methods in this embodiment will no longer be implemented here.
  • the same parts and beneficial effects will be described in detail.
  • inventions of the present application also provide a network autonomy capability evaluation device.
  • the network autonomy capability evaluation device can execute the process shown in Figure 9.
  • the network autonomy capability evaluation device 1100 may include: a network operation and maintenance scenario combination determination module 1101, a first network autonomy capability evaluation module 1102, and a second network autonomy capability evaluation module 1103.
  • the network operation and maintenance scenario combination determination module 1101 is used to determine multiple network operation and maintenance scenarios.
  • Each network operation and maintenance scenario in the multiple network operation and maintenance scenarios includes at least one operation and maintenance task; the first network autonomy capability evaluation module 1102 , used to determine the network autonomy capability evaluation result of each network operation and maintenance scenario in the plurality of network operation and maintenance scenarios; the second network autonomy capability evaluation module 1103, used to determine the network autonomy capability evaluation result of each network operation and maintenance scenario in the multiple network operation and maintenance scenarios.
  • the network autonomy capability evaluation result of the operation and maintenance scenario determines one network autonomy capability evaluation result corresponding to the multiple network operation and maintenance scenarios.
  • the first network autonomy capability evaluation module 1102 can execute the processes shown in Figures 4 and 7 to obtain the network autonomy capability assessment for each network operation and maintenance scenario in the multiple network operation and maintenance scenarios. result.
  • the process by which the first network autonomy capability evaluation module 1102 obtains the network autonomy capability evaluation results in the network operation and maintenance scenario please refer to the descriptions in Figures 4 and 7.
  • Figures 4 and 7. 7 For explanations and definitions of related technical terms and concepts, please also refer to Figures 4 and 7. 7 as described in the process.
  • the first network autonomy capability evaluation module 1102 may include: an autonomous network level determination module 11021, a level adjustment amount determination module 11022, and a network autonomy capability evaluation module 11023.
  • each module in the first network autonomy capability evaluation module 1102 includes: an autonomous network level determination module 11021, used to determine the first network operation and maintenance scenario.
  • the autonomous network level of the network operation and maintenance scenario is the first autonomous network level;
  • the level adjustment amount determination module 11022 determines the third autonomous network level according to the satisfaction degree of the network autonomy capability of each key operation and maintenance task in the first network operation and maintenance scenario.
  • the network autonomy capability evaluation module 11023 determines the network autonomy capability evaluation result of the first network operation and maintenance scenario based on the first autonomous network level and the level adjustment amount.
  • the first network operation and maintenance scenario includes at least one key operation and maintenance task
  • the at least one key operation and maintenance task includes a first key operation and maintenance task
  • the first autonomous network level is critical to the first key operation and maintenance task.
  • the requirements for the network autonomy capability of the task are different from the requirements of the second autonomous network level for the network autonomy capability of the first key operation and maintenance task, and the satisfaction degree of the network autonomy capability of the first key operation and maintenance task is that of the first key operation and maintenance task.
  • the network autonomy capability of key operation and maintenance tasks meets the degree of network autonomy capability required by the second autonomous network level for the first key operation and maintenance task, and the second autonomous network level is higher than the first autonomous network level.
  • the above-mentioned network autonomy capability evaluation device 1100 can implement all the method steps as shown in Figure 9 in the above-mentioned method embodiment, and can achieve the same technical effect. The same as in the method embodiment in this embodiment will no longer be used. The parts and beneficial effects will be described in detail.
  • FIG. 12 only shows the structure required for the communication device 1200 to perform the method shown in this application. This application does not limit the communication device to be equipped with more components.
  • the communication device 1200 may be used to perform the steps performed by the network autonomy capability assessment device in the above method embodiment.
  • the communication device 1200 may include a communication interface 1201, a memory 1202 and a processor 1203.
  • the communication interface 1201 can be used for communication with a communication device, such as for sending or receiving signals.
  • the memory 1202 is coupled to the processor 1203 and can be used to store programs and data necessary for the communication device 1200 to implement various functions.
  • the processor 1203 is configured to support the communication device 1200 to perform the processing functions performed by the network autonomy capability evaluation device in the above method.
  • the above memory 1202 and processor 1203 can be integrated into one body or independent of each other.
  • the communication interface 1201 may be a communication port, such as a communication port used for communication between network elements (or called interface).
  • the communication interface 1201 may also be called a transceiver unit or a communication unit.
  • the processor 1203 can be implemented by a processing chip or a processing circuit.
  • the communication interface 1201 can receive or send information in a wireless or wired manner.
  • the communication device 1200 in the process of evaluating the network autonomy capability of the first network operation and maintenance scenario, can obtain the human-machine division of labor status of each operation and maintenance task in the first network operation and maintenance scenario based on the communication interface 1201, and also The autonomous network classification rules (such as the table shown in Figure 5) can be obtained.
  • the communication device 1200 can obtain the human-machine division of labor for each operation and maintenance task in each of the multiple network operation and maintenance scenarios based on the communication interface 1201 Status, the autonomous network level classification rules (such as the table shown in Figure 5) can also be obtained. Furthermore, after obtaining the evaluation results, they can also be output through the communication interface 1201.
  • the communication device may include a processor, and the processor calls an external transceiver and/or memory to implement the above functions or steps or operations.
  • the communication device may also include a memory, and the processor calls and executes the program stored in the memory to implement the above functions or steps or operations.
  • the communication device may also include a processor and a transceiver (or communication interface), and the processor calls and executes a program stored in an external memory to implement the above functions or steps or operations.
  • the communication device may include a processor, memory, and a transceiver.
  • the communication device 1200 can perform network autonomy capability evaluation on a single network operation and maintenance scenario, and specifically can implement the processes shown in Figure 4 and Figure 7 above.
  • the processor 1203 can realize the functions of the autonomous network level determination module 1001, the level adjustment amount determination module 1002, and the network autonomy assessment module 1003 in the network autonomy capability evaluation device 1000.
  • the communication device 1200 can perform network autonomy capability evaluation on multiple network operation and maintenance scenarios, and specifically can implement the process shown in Figure 9 above.
  • the processor 1203 can implement the functions of the network operation and maintenance scenario combination determination module 1101, the first network autonomy capability evaluation module 1102, and the second network autonomy capability evaluation module 1103 in the network autonomy capability evaluation device 1100.
  • embodiments of the present application also provide a computer-readable storage medium on which program instructions (or computer programs, instructions) are stored.
  • program instructions or computer programs, instructions
  • the The computer performs the operations performed by the network autonomy capability evaluation device in any of the above method embodiments and possible implementations of the method embodiment.
  • this application also provides a computer program product, including program instructions.
  • the computer program product When the computer program product is called and executed by a computer, it can cause the computer to implement any of the above method embodiments and method embodiments. Operations performed by the network autonomy capability assessment device in possible implementations.
  • this application also provides a chip or chip system, the chip is coupled with a transceiver, and is used to implement the above method embodiments and any possible implementation of the method embodiments by network autonomy. Capability assessment device performs operations.
  • the chip system may include the chip, as well as components such as memory and communication interfaces.
  • embodiments of the present application also provide a communication system, which includes an autonomous network assessment execution device and an autonomous network assessment monitoring device.
  • the autonomous network assessment execution device can be used to evaluate network autonomy capabilities in a single network operation and maintenance scenario.
  • the autonomous network assessment execution device can be (or include) the network shown in Figure 10 above.
  • the autonomous network evaluation execution device can send the network autonomy capability evaluation result of the first network operation and maintenance scenario to the autonomous network evaluation and monitoring device, so that the autonomous network evaluation and monitoring device can perform the first network operation and maintenance. Monitor the evaluation results of the network autonomy capabilities of the scenario.
  • the autonomous network assessment execution device can be used to evaluate multiple network operation and maintenance scenarios. Carry out network autonomy capability evaluation.
  • the autonomous network evaluation execution device may be (or include) the network autonomy capability evaluation device 1100 shown in Figure 11 above.
  • the autonomous network evaluation execution device may combine the network autonomy capabilities of multiple network operation and maintenance scenarios.
  • the evaluation results are sent to the autonomous network evaluation and monitoring device, so that the autonomous network evaluation and monitoring device can monitor the evaluation results of the network autonomy capabilities of the multiple network operation and maintenance scenarios.
  • embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment that combines software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
  • computer-usable storage media including, but not limited to, disk storage, CD-ROM, optical storage, etc.
  • These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction means, the instructions
  • the device implements the functions specified in a process or processes of the flowchart and/or a block or blocks of the block diagram.
  • These computer program instructions may also be loaded onto a computer or other programmable data processing device, causing a series of operating steps to be performed on the computer or other programmable device to produce computer-implemented processing, thereby executing on the computer or other programmable device.
  • Instructions provide steps for implementing the functions specified in a process or processes of a flowchart diagram and/or a block or blocks of a block diagram.

Abstract

一种网络自治能力评估方法、装置及存储介质。该方法用于对第一网络运维场景进行网络能力评估，第一网络运维场景中包括第一关键运维任务，第一网络运维场景的自治网络等级为第一自治网络等级，第一自治网络等级对第一关键运维任务的网络自治能力的要求与第二自治网络等级(第二自治网络等级高于第一自治网络等级)对第一关键运维任务的网络自治能力的要求不同。该方法包括：网络自治能力评估装置确定第一网络运维场景的自治网络等级为第一自治网络等级后，根据第一网络运维场景中每个关键运维任务的网络自治能力的满足度确定第一网络运维场景的等级调整量，并根据第一自治网络等级以及所述等级调整量确定第一网络运维场景的网络自治能力评估结果。

Description

一种网络自治能力评估方法、装置及存储介质
相关申请的交叉引用
本申请要求在2022年04月01日提交中国专利局、申请号为202210349407.X、申请名称为“一种网络自治能力评估方法、装置及存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及通信技术领域，尤其涉及一种网络自治能力评估方法、装置及存储介质。
背景技术
随着垂直行业的引入，终端设备的增加和业务的多样性，运营商的网络越来越复杂，导致网络运维难度增加。如何降低网络运维成本、简化网络运维流程、快速部署网络以满足多样性化的业务是网络运维领域需要解决的问题。
自动化技术在移动通信网络中的应用日渐成为行业的关注重点和研究热点。业界寄希望于通过引入自治技术(比如人工智能、机器学习、大数据分析等)，帮助解决移动通信网络遇到的运维效率问题。电信系统自治技术可以应用于网络生命周期的多种场景，包括网络规划、网络部署、网络优化、业务运营等，能够减少人工操作，降低运营商运营费用(operating expense，OPEX)，提高运维效率。
不同的电信系统分别引入不同的自治技术来解决运维效率问题，运营商需要对不同电信系统的网络自治能力进行分析，评估不同电信系统的网络自治能力。
目前的网络自治能力评估方法较粗略，因此有提高网络自治能力评估的精细化程度的需求。
发明内容
本申请实施例提供一种网络自治能力评估方法、装置及存储介质，用以提高网络自治能力评估的精细化程度。
第一方面，提供一种网络自治能力评估方法，该方法用于对第一网络运维场景进行网络能力评估的过程。所述第一网络运维场景包括至少一个关键运维任务，所述至少一个关键运维任务中包括第一关键运维任务，第一网络运维场景的自治网络等级为第一自治网络等级，第一自治网络等级对第一关键运维任务的网络自治能力的要求与第二自治网络等级(第二自治网络等级高于第一自治网络等级，可选的，所述第二自治网络等级是比所述第一自治网络等级高一级的自治网络等级)对第一关键运维任务的网络自治能力的要求不同。该方法可由网络自治能力评估装置(比如终端、服务器等任何具有信息处理能力的电子设备，或者用于实现该方法的应用程序)执行，下面以网络自治能力评估装置作为执行主体为例描述该方法的实现过程。该方法可包括以下步骤：网络自治能力评估装置确定第一网络运维场景的自治网络等级为第一自治网络等级后，根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度(该满足度为所述第一关键运维任务的网络自治能力 满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的程度)，确定所述第一网络运维场景的等级调整量，根据所述第一自治网络等级以及所述等级调整量，确定所述第一网络运维场景的网络自治能力评估结果。
可选的，所述第一运维场景是基于以下至少一个维度获得的网络运维场景：无线网络制式维度、无线网络业务类型维度、无线网络应用维度、无线环境维度、无线话务状态维度。
上述实现方式中，网络自治能力评估装置确定第一网络运维场景的自治网络等级(第一自治网络等级)后，为进一步提高网络自治能力评估的精细化程度，则进一步的，网络自治能力评估装置根据第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定第一网络运维场景的等级调整量，从而根据第一自治网络等级以及该等级调整量，确定第一网络运维场景的网络自治能力评估结果，相比于仅基于第一自治网络等级来表征第一网络运维场景的网络自治能力相比，采用上述实现方式可以得到更精细化的网络自治能力评估结果。
进一步的，由于在进行网络自治能力评估过程中，网络自治能力评估装置根据关键运维任务的网络自治能力的满足度确定等级调整量，这样就将关键运维任务的实际网络自治能力与更高自治网络等级所要求的网络自治能力之间的差异因素考虑进来，基于这种差异确定等级调整量，从而可以提高网络自治能力评估的精细化程度。
在一种可能的实现方式中，所述网络自治能力评估结果表示的网络自治能力，高于所述第一自治网络等级对应的网络自治能力，且低于所述第二自治网络等级对应的网络自治能力。也就是说，第一网络运维场景的网络自治能力介于第一自治网络等级对应的网络自治能力与第二自治网络等级对应的网络自治能力之间，相比于仅基于评估出的自治网络等级来确定网络自治能力相比，采用本申请可提高网络自治能力评估的精细化程度。
在一种可能的实现方式中，所述第一自治网络等级对所述至少一个关键运维任务中的任意一个关键运维任务的网络自治能力的要求，与所述第二自治网络等级对所述任意一个关键运维任务的网络自治能力的要求不同。
在一种可能的实现方式中，网络自治能力评估装置根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量的过程，可包括：网络自治能力评估装置确定所述至少一个关键运维任务中每个关键运维任务的任务分数；对所述至少一个关键运维任务中每个关键运维任务的任务分数进行加权平均，得到第一值；将所述第一值确定为所述第一网络运维场景的等级调整量。
上述实现方式中，通过对各关键运维任务的任务分数进行加权平均计算，将计算得到的第一值确定为第一网络运维场景的等级调整量，可以将所有关键运维任务的实际网络自治能力与更高自治网络等级所要求的网络自治能力之间的差异因素考虑进来，从而可以使得确定出的等级调整量更加合理。
在一种可能的实现方式中，所述第一关键运维任务的任务分数与所述第一关键运维任务的网络自治能力的满足度相对应。
在一种可能的实现方式中，满足度可包括第一满足度和第二满足度，所述第一满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力，所述第二满足度表示所述第一关键运维任务的网络自治能力不满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力。第一满足 度对应第一分数，第二满足度对应第二分数，可选的，所述第二分数不等于所述第一分数。网络自治能力评估装置确定所述至少一个关键运维任务中每个关键运维任务的任务分数的过程，可包括：若网络自治能力评估装置确定所述第一关键运维任务的网络自治能力的满足度为第一满足度，则确定所述第一关键运维任务的任务分数等于第一分数；若网络自治能力评估装置确定所述第一关键运维任务的网络自治能力的满足度为第二满足度，则确定所述第一关键运维任务的任务分数等于第二分数。所述第二分数不等于所述第一分数。
上述实现方式中，根据关键运维任务的网络自治能力是否满足更高自治网络等级(这里称为第二自治网络等级)对该运维任务要求的网络自治能力，关键运维任务的任务分数有所不同，从而可以体现不同关键运维任务对等级调整量的贡献大小，进而使得确定出的等级调整量更加合理。
在一种可能的实现方式中，满足度除了包括上述第一满足度和上述第二满足度以外，还包括第三满足度，所述第三满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的第一百分比。第三满足度对应第三分数，可选的，所述第三分数的取值在所述第一分数和所述第二分数之间。可选的，第三满足度可包括一个或多个，若包含多个第三满足度，则每个第三满足度对应一个第三任务分数，不同第三满足度对应的第三任务分数可能不同。网络自治能力评估装置确定所述第一关键运维的任务分数的过程还可包括：若网络自治能力评估装置确定所述第一关键运维任务的网络自治能力的满足度为第三满足度，则所述第一关键运维任务的任务分数等于第三分数，所述第三分数的取值在所述第一分数和所述第二分数之间。
通过上述实现方式，针对网络自治能力的满足度可以包括多种可能的情况，关键运维任务的任务分数与该关键运维任务的网络自治能力满足度对相对应，从而进一步细化了不同关键运维任务对等级调整量的贡献大小，进而使得确定出的等级调整量更加精细化。
在一种可能的实现方式中，可采用加权平均算法计算第一值Ts_all，示例性的，所述第一值Ts_all，满足以下公式：
其中，K为所述至少一个关键运维任务中的关键运维任务的数量，Tsi为所述至少一个关键运维任务中的第i个关键运维任务的任务分数，Twi为所述第i个关键运维任务的任务权重。可选的，所述第i个关键运维任务的任务权重，与所述第i个关键运维任务的实现难度关联。
上述实现方式中，可以针对关键运维任务设置任务权重，比如，根据关键运维任务的实现难度设置任务权重，并在计算第一网络运维场景的等级调整量时引入关键运维任务对应的任务权重，这样可以使得第一网络运维场景的网络自治能力评估结果更加精细。
第二方面，提供一种网络自治能力评估装置，该网络自治能力评估装置可实现第一方面提供的网络自治能力评估方法。该网络自治能力评估装置可包括：自治网络等级确定模块，用于确定第一网络运维场景的自治网络等级为第一自治网络等级；等级调整量确定模块，用于根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量；网络自治能力评估模块，用于根据所述第一自治网络等级以及所述等级调整量，确定所述第一网络运维场景的网络自治能力评估结果。
其中，所述第一网络运维场景包括至少一个关键运维任务，所述至少一个关键运维任 务中包括第一关键运维任务，所述第一自治网络等级对所述第一关键运维任务的网络自治能力的要求与第二自治网络等级对所述第一关键运维任务的网络自治能力的要求不同，所述第一关键运维任务的网络自治能力的满足度为所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的程度，所述第二自治网络等级高于所述第一自治网络等级。可选的，所述第二自治网络等级是比所述第一自治网络等级高一级的自治网络等级。
可选的，所述第一网络运维场景是基于以下至少一个维度获得的网络运维场景：无线网络制式维度、无线网络业务类型维度、无线网络应用维度、无线环境维度、无线话务状态维度。
在一种可能的实现方式中，所述网络自治能力评估结果表示的网络自治能力，高于所述第一自治网络等级对应的网络自治能力，且低于所述第二自治网络等级对应的网络自治能力。
在一种可能的实现方式中，所述第一自治网络等级对所述至少一个关键运维任务中的任意一个关键运维任务的网络自治能力的要求，与所述第二自治网络等级对所述任意一个关键运维任务的网络自治能力的要求不同。
在一种可能的实现方式中，所述等级调整量确定模块，具体用于：确定所述至少一个关键运维任务中每个关键运维任务的任务分数；对所述至少一个关键运维任务中每个关键运维任务的任务分数进行加权平均，得到第一值；将所述第一值确定为所述第一网络运维场景的等级调整量。
在一种可能的实现方式中，所述第一关键运维任务的任务分数与所述第一关键运维任务的网络自治能力的满足度相对应。
在一种可能的实现方式中，所述等级调整量确定模块，具体用于：若所述第一关键运维任务的网络自治能力的满足度为第一满足度，所述第一满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力，则确定所述第一关键运维任务的任务分数等于第一分数；若所述第一关键运维任务的网络自治能力的满足度为第二满足度，所述第二满足度表示所述第一关键运维任务的网络自治能力不满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力，则确定所述第一关键运维任务的任务分数等于第二分数，所述第二分数不等于所述第一分数。
在一种可能的实现方式中，所述等级调整量确定模块，还用于：
若所述第一关键运维任务的网络自治能力的满足度为第三满足度，所述第三满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的第一百分比，则所述第一关键运维任务的任务分数等于第三分数，所述第三分数的取值在所述第一分数和所述第二分数之间。
在一种可能的实现方式中，所述第一值Ts_all，满足以下公式：
其中，K为所述至少一个关键运维任务中的关键运维任务的数量，Tsi为所述至少一个关键运维任务中的第i个关键运维任务的任务分数，Twi为所述第i个关键运维任务的任务权重。可选的，所述第i个关键运维任务的任务权重，与所述第i个关键运维任务的实 现难度关联。
第三方面，提供一种通信装置，包括：一个或多个处理器；所述一个或多个存储器存储有一个或多个计算机程序，所述一个或多个计算机程序包括指令，当所述指令被所述一个或多个处理器执行时，使得所述通信装置执行如上述第一方面中任意一项所述的方法。
第四方面，提供一种计算机可读存储介质，包括计算机程序，当所述计算机程序在电子设备上运行时，使得所述电子设备执行如上述第一方面中任意一项所述的方法。
第五方面，提供一种计算机程序产品，当其在电子设备上运行时，使得所述电子设备执行如上述第一方面中任意一项所述的方法。
第六方面，提供一种芯片系统，包括：存储器，用于存储计算机程序；处理器；当处理器从存储器中调用并运行计算机程序后，使得安装有该芯片系统的电子设备执行如上述第一方面中任意一项所述的方法。
本申请实施例还提供了一种网络自治能力评估方法、装置及存储介质，用以实现对多个网络运维场景的网络自治能力进行评估。
第七方面，提供一种通信方法，该方法用于对第一网络运维场景进行网络能力评估的过程。该可方法包括：自治网络评估执行设备确定第一网络运维场景的自治网络等级为第一自治网络等级后，根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度(该满足度为所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的程度)，确定所述第一网络运维场景的等级调整量，根据所述第一自治网络等级以及所述等级调整量，确定所述第一网络运维场景的网络自治能力评估结果，并将所述第一网络运维场景的网络自治能力评估结果发送给自治网络评估监控设备。该自治网络评估监控设备接收所述网络自治能力评估结果。该方法中，自治网络评估执行设备可通过执行上述第一方面中任一项所述的方法，获得第一网络运维场景的网络自治能力评估结果。
第八方面，提供一种网络自治能力评估方法，该方法应用于对多个网络运维场景的网络自治能力进行评估的过程，所述多个网络运维场景中的每个网络运维场景包括至少一个运维任务。该方法可由网络自治能力评估装置(比如终端、服务器等任何具有信息处理能力的电子设备，或者用于实现该方法的应用程序)执行，下面以网络自治能力评估装置作为执行主体为例描述该方法的实现过程。该方法可包括以下步骤：网络自治能力评估装置确定多个网络运维场景，并确定所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果，再根据所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果，确定所述多个网络运维场景对应的一个网络自治能力评估结果。
可选的，所述多个网络运维场中的至少一个网络运维场景可以基于以下至少一个维度获得的网络运维场景：无线网络制式维度、无线网络业务类型维度、无线网络应用维度、无线环境维度、无线话务状态维度。
上述实现方式中，在对多个网络运维场景进行网络自治能力评估的场景中，分别确定每个网络运维场景的网络自治能力评估结果，再根据每个网络运维场景的网络自治能力评估结果确定该多个网络运维场景对应的网络自治能力，因此可以综合多个网络运维场景的网络自治能力，评估该多个网络运维场景形成的场景组合所对应的网络自治能力，弥补了目前尚未有根据场景组合评估网络自治能力的空白。
在一种可能的实现方式中，所述多个网络运维场景中包括第一网络运维场景，以所述 第一网络运维场景为例，网络自治能力评估装置确定所述第一网络运维场景的网络自治能力评估结果的过程，可包括：
网络自治能力评估装置确定所述第一网络运维场景的自治网络等级为第一自治网络等级，根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量，并根据所述第一自治网络等级以及所述等级调整量，确定所述第一网络运维场景的网络自治能力评估结果。
其中，所述第一网络运维场景包括至少一个关键运维任务，所述至少一个关键运维任务中包括第一关键运维任务，所述第一自治网络等级对所述第一关键运维任务的网络自治能力的要求与第二自治网络等级对所述第一关键运维任务的网络自治能力的要求不同，所述第一关键运维任务的网络自治能力的满足度为所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的程度，所述第二自治网络等级高于所述第一自治网络等级。可选的，所述第二自治网络等级是比所述第一自治网络等级高一级的自治网络等级。
在一种可能的实现方式中，所述第一网络运维场景的网络自治能力评估结果表示的网络自治能力，高于所述第一自治网络等级对应的网络自治能力，且低于所述第二自治网络等级对应的网络自治能力。
在一种可能的实现方式中，所述第一自治网络等级对所述至少一个关键运维任务中的任意一个关键运维任务的网络自治能力的要求，与所述第二自治网络等级对所述任意一个关键运维任务的网络自治能力的要求不同。
在一种可能的实现方式中，网络自治能力评估装置根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量，可包括：网络自治能力评估装置确定所述至少一个关键运维任务中每个关键运维任务的任务分数；对所述至少一个关键运维任务中每个关键运维任务的任务分数进行加权平均，得到第一值；将所述第一值确定为所述第一网络运维场景的等级调整量。
在一种可能的实现方式中，所述第一关键运维任务的任务分数与所述第一关键运维任务的网络自治能力的满足度相对应。
在一种可能的实现方式中，满足度可包括第一满足度和第二满足度，所述第一满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力，所述第二满足度表示所述第一关键运维任务的网络自治能力不满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力。第一满足度对应第一分数，第二满足度对应第二分数，可选的，所述第二分数不等于所述第一分数。网络自治能力评估装置确定所述至少一个关键运维任务中每个关键运维任务的任务分数的过程，可包括：若网络自治能力评估装置确定所述第一关键运维任务的网络自治能力的满足度为第一满足度，则确定所述第一关键运维任务的任务分数等于第一分数；若网络自治能力评估装置确定第一关键运维任务的网络自治能力的满足度为第二满足度，则确定所述第一关键运维任务的任务分数等于第二分数。
在一种可能的实现方式中，满足度除了包括上述第一满足度和上述第二满足度以外，还包括第三满足度，所述第三满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的第一百分比。第三满足度对应第三分数，可选的，所述第三分数的取值在所述第一分数和所述第二分数之间。可 选的，第三满足度可包括一个或多个，若包含多个第三满足度，则每个第三满足度对应一个第三任务分数，不同第三满足度对应的第三任务分数可能不同。网络自治能力评估装置确定所述第一关键运维的任务分数的过程还可包括：若网络自治能力评估装置确定所述第一关键运维任务的网络自治能力的满足度为第三满足度，则确定所述第一关键运维任务的任务分数等于第三分数。
在一种可能的实现方式中，可采用加权平均算法计算第一值Ts_all，示例性的，所述第一值Ts_all，满足以下公式：
其中，K为所述至少一个关键运维任务中的关键运维任务的数量，Tsi为所述至少一个关键运维任务中的第i个关键运维任务的任务分数，Twi为所述第i个关键运维任务的任务权重。可选的，所述第i个关键运维任务的任务权重，与所述第i个关键运维任务的实现难度关联。
在一种可能的实现方式中，网络自治能力评估装置根据所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果，确定所述多个网络运维场景对应的一个网络自治能力评估结果的过程，可包括：网络自治能力评估装置根据所述多个网络运维场景中每个网络运维场景的自治网络等级分数确定第二值，并将所述第二值确定所述多个网络运维场景对应的一个网络自治能力评估结果。
在一种可能的实现方式中，可采用加权平均算法计算第二值ANLS_Ava，示例性的，所述第二值ANLS_Ava，满足以下公式：
或者，所述第二值ANLS_Ava，满足以下公式：
其中，M为所述多个网络运维场景中的网络运维场景的数量，ANLsi为所述多个网络运维场景中第i个网络运维场景的自治网络等级分数，Swi为所述第i个网络运维场景的场景权重。
第九方面，提供一种网络自治能力评估装置，包括：网络运维场景组合确定模块，用于确定多个网络运维场景，所述多个网络运维场景中的每个网络运维场景包括至少一个运维任务；第一网络自治能力评估模块，用于确定所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果；第二网络自治能力评估模块，用于根据所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果，确定所述多个网络运维场景对应的一个网络自治能力评估结果。
可选的，所述多个网络运维场景中的至少一个网络运维场景可以基于以下至少一个维度获得的网络运维场景：无线网络制式维度、无线网络业务类型维度、无线网络应用维度、无线环境维度、无线话务状态维度。
在一种可能的实现方式中，所述多个网络运维场景中包括第一网络运维场景，所述第一网络自治能力评估模块，包括：自治网络等级确定模块，用于确定所述第一网络运维场 景的自治网络等级为第一自治网络等级；等级调整量确定模块，根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量；自治能力评估结果确定模块，根据所述第一自治网络等级以及所述等级调整量，确定所述第一网络运维场景的网络自治能力评估结果。
其中，所述第一网络运维场景包括至少一个关键运维任务，所述至少一个关键运维任务中包括第一关键运维任务，所述第一自治网络等级对所述第一关键运维任务的网络自治能力的要求与第二自治网络等级对所述第一关键运维任务的网络自治能力的要求不同，所述第一关键运维任务的网络自治能力的满足度为所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的程度，所述第二自治网络等级高于所述第一自治网络等级；可选的，所述第二自治网络等级是比所述第一自治网络等级高一级的自治网络等级。
在一种可能的实现方式中，所述第一网络运维场景的网络自治能力评估结果表示的网络自治能力，高于所述第一自治网络等级对应的网络自治能力，且低于所述第二自治网络等级对应的网络自治能力。
在一种可能的实现方式中，所述第一自治网络等级对所述至少一个关键运维任务中的任意一个关键运维任务的网络自治能力的要求，与所述第二自治网络等级对所述任意一个关键运维任务的网络自治能力的要求不同。
在一种可能的实现方式中，所述等级调整量确定模块，具体用于：确定所述至少一个关键运维任务中每个关键运维任务的任务分数；对所述至少一个关键运维任务中每个关键运维任务的任务分数进行加权平均，得到第一值；将所述第一值确定为所述第一网络运维场景的等级调整量。
在一种可能的实现方式中，所述第一关键运维任务的任务分数与所述第一关键运维任务的网络自治能力的满足度相对应。
在一种可能的实现方式中，所述等级调整量确定模块，具体用于：若所述第一关键运维任务的网络自治能力的满足度为第一满足度，所述第一满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力，则确定所述第一关键运维任务的任务分数等于第一分数；若所述第一关键运维任务的网络自治能力的满足度为第二满足度，所述第二满足度表示所述第一关键运维任务的网络自治能力不满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力，则确定所述第一关键运维任务的任务分数等于第二分数，所述第二分数不等于所述第一分数。
在一种可能的实现方式中，所述等级调整量确定模块，还用于：若所述第一关键运维任务的网络自治能力的满足度为第三满足度，所述第三满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的第一百分比，则所述第一关键运维任务的任务分数等于第三分数，所述第三分数的取值在所述第一分数和所述第二分数之间。
在一种可能的实现方式中，所述第一值Ts_all，满足以下公式：
其中，K为所述至少一个关键运维任务中的关键运维任务的数量，Tsi为所述至少一 个关键运维任务中的第i个关键运维任务的任务分数，Twi为所述第i个关键运维任务的任务权重。可选的，所述第i个关键运维任务的任务权重，与所述第i个关键运维任务的实现难度关联。
在一种可能的实现方式中，所述第二网络自治能力评估模块，具体用于：根据所述多个网络运维场景中每个网络运维场景的自治网络等级分数，确定第二值；将所述第二值确定为所述多个网络运维场景对应的一个网络自治能力评估结果。
在一种可能的实现方式中，所述第二值ANLS_Ava，满足以下公式：
或者，所述第二值ANLS_Ava，满足以下公式：
其中，M为所述多个网络运维场景中的网络运维场景的数量，ANLsi为所述多个网络运维场景中第i个网络运维场景的自治网络等级分数，Swi为所述第i个网络运维场景的场景权重。
第十方面，提供一种通信方法，该方法用于对多个网络运维场景进行网络能力评估的过程。该可方法包括：自治网络评估执行设备确定多个网络运维场景，确定所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果，根据所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果，确定所述多个网络运维场景对应的一个网络自治能力评估结果，并将所述多个网络运维场景对应的一个网络自治能力评估结果发送给自治网络评估监控设备。该自治网络评估监控设备接收所述网络自治能力评估结果。该方法中，自治网络评估执行设备可通过执行上述第八方面中任一项所述的方法，获得所述多个网络运维场景的网络自治能力评估结果。
第十一方面，提供一种通信装置，包括：一个或多个处理器；所述一个或多个存储器存储有一个或多个计算机程序，所述一个或多个计算机程序包括指令，当所述指令被所述一个或多个处理器执行时，使得所述通信装置执行如上述第八方面中任意一项所述的方法。
第十二方面，提供一种计算机可读存储介质，包括计算机程序，当所述计算机程序在电子设备上运行时，使得所述电子设备执行如上述第八方面中任意一项所述的方法。
第十三方面，提供一种计算机程序产品，当其在电子设备上运行时，使得所述电子设备执行如上述第八方面中任意一项所述的方法。
第十四方面，提供一种芯片系统，包括：存储器，用于存储计算机程序；处理器；当处理器从存储器中调用并运行计算机程序后，使得安装有该芯片系统的电子设备执行如上述第八方面中任意一项所述的方法。
第十五方面，提供一种通信系统，所述通信系统包括自治网络评估执行设备和自治网络评估监控设备。
一种可能的实现方式中，所述自治网络评估执行设备可以用于对单一网络运维场景进行网络自治能力评估，比如该自治网络评估执行设备可以是(或包括)上述第二方面中任一项所述的网络自治能力评估装置，该自治网络评估执行设备可以将第一网络运维场景的网络自治能力评估结果发送给所述自治网络评估监控设备。
另一种可能的实现方式中，所述自治网络评估执行设备可以用于对多个网络运维场景进行网络自治能力评估，比如该自治网络评估执行设备可以是(或包括)上述第八方面中任一项所述的网络自治能力评估装置，该自治网络评估执行设备可以将多个网络运维场景的网络自治能力评估结果发送给所述自治网络评估监控设备。
以上第二方面至第七方面的有益效果请参见第一方面的有益效果，第九方面至第十四方面的有益效果请参见第八方面的有益效果，不重复赘述。
附图说明
图1为本申请实施例中的“网络优化场景”的自治网络等级表格示意图；
图2a、图2b分别为被定级为同一自治网络等级的不同运营商的网络自治能力差异示意图；
图3为本申请实施例适用的一种系统架构示意图；
图4为本申请实施例提供的单一网络运维场景的网络自治能力评估方法流程示意图；
图5为本申请实施例中的网络优化的自治网络等级表格示意图；
图6为本申请实施例中的关键运维任务的示意图；
图7为本申请实施例中确定第一网络运维场景的等级调整量的方法示意图；
图8为本申请实施例提供的对“无线5G覆盖优化场景”的网络自治能力进行评估的流程示意图；
图9为本申请实施例提供的针对多个网络运维场景的网络自治能力评估方法流程示意图；
图10为本申请实施例提供的一种网络自治能力评估装置的结构示意图；
图11为本申请实施例提供的另一种网络自治能力评估装置的结构示意图；
图12为本申请实施例提供的一种通信装置的结构示意图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述。以下实施例中所使用的术语只是为了描述特定实施例的目的，而并非旨在作为对本申请的限制。如在本申请的说明书和所附权利要求书中所使用的那样，单数表达形式“一个”、“一种”、“所述”、“上述”、“该”和“这一”旨在也包括例如“一个或多个”这种表达形式，除非其上下文中明确地有相反指示。还应当理解，在本申请实施例中，“一个或多个”是指一个、两个或两个以上；“和/或”，描述关联对象的关联关系，表示可以存在三种关系；例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B的情况，其中A、B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。
在本说明书中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此，在本说明书中的不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同的实施例，而是意味着“一个或多个但不是所有的实施例”，除非是以其他方式另外特别强调。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”，除非是以其他方式另外特别强调。
本申请实施例涉及的多个，是指大于或等于两个。需要说明的是，在本申请实施例的描述中，“第一”、“第二”等词汇，仅用于区分描述的目的，而不能理解为指示或暗示相对重要性，也不能理解为指示或暗示顺序。
下面首先对本申请实施例中涉及的技术术语进行介绍。
(1)自治网络(autonomous network，AN)
自治网络是指电信系统(包含电信网络及其运营管理系统)在尽可能少的人工干预的前提下，通过自治能力实现自我管控(telecommunication system(including management system and network)with autonomy capabilities which is able to be governed by itself with minimal to no human intervention)。
(2)自治网络等级(autonomous network level，ANL)
自治网络等级是指自治网络的自治能力等级(escribes the level of autonomy capabilities in the autonomous network)。自治网络等级可根据运维流程中各网络管理运维任务(以下简称运维任务)的人机分工状态确定。
(3)人机分工状态
人机分工状态用于反映人工方式和系统自动方式在运维任务完成过程中的参与程度或所占比例。从完全由人工完成的状态到完全由系统自动完成的状态，可划分多种人机分工状态。
示例性的，人机分工状态可包括：
人工：运维任务由人执行，即通过人工方式完成；
人工结合系统(人工+系统)：运维任务由人和系统共同执行，即由人工方式结合系统自动方式完成。可选的，“人工+系统”状态又可进一步细分为：
-人工辅助系统：运维任务以人工方式为主导并辅之以系统完成；进一步的，可根据人工和系统在完成运维任务中的参与程度或所占比例，进一步细分“人工辅助系统”的人机分工状态，例如可进一步细分为“60％人工+40％系统”，“80％人工+20％系统”，“90％人工+10％系统”等；
-系统辅助人工：运维任务以系统自动方式为主导并辅之以人工完成；进一步的，可根据人工和系统在完成运维任务中的参与程度或所占比例，进一步细分“系统辅助人工”的人机分工状态，例如可进一步细分为“10％人工+90％系统”，“20％人工+80％系统”，“40％人工+60％系统”等；
系统：运维任务由系统以自动方式完成。
不同的人机分工状态对应不同的网络自治能力。例如，若人机分工状态包括：人工、人工+系统、系统，则按照网络自治能力从高到低，这3个人机分工状态排序为：系统、人工+系统、系统。
需要说明的是，以上人机分工状态的划分方式仅为示例性的，本申请实施例对此不作限制。
(4)运维流程和网络场景
运维流程是实现网络管理需求的必要步骤，构成从接收管理需求到实现需求的完整闭环，运维流程由多个运维任务(task)组成。
示例性的，运维流程可包括：
-网络规划：根据业务、市场、产品和客户服务需求及其发展预期，为新建网络或改 造网络进行设计和计划制定的过程。
-网络建设：根据网络规划结果，对网络进行安装、配置、激活和验证的过程，以使得网络具备开通条件。
-网络维护：为保障网络处于正常运行状态，对网络状态等相关信息进行监控、问题分析和问题解决的过程。
-网络优化：为提升网络性能或通信业务体验，对网络性能指标等相关信息进行监控、分析，并采取网络资源、参数配置调整等性能优化措施的过程。
-网络运营：为保障通信业务、市场、产品和服务满足客户需求，根据相关运营策略对网络运营数据等相关信息进行监控、分析，并采取相关措施的过程。
以上述“网络优化”运维流程为例，该运维流程可包括以下运维任务：性能异常识别、性能劣化预测、性能问题定界、性能问题根因分析、优化方案生成。
需要说明的是，以上运维流程的划分方式以及运维流程中包括的运维任务仅为示例性的，本申请实施例对此不作限制。
本申请实施例中，一个网络运维场景(scenario)可对应上述一个运维流程。例如，网络运维场景可包括网络优化场景、网络规划场景、网络部署场景、网络维护场景和网络运维场景等。
进一步的，网络运维场景又可以从不同维度进行细分，对于一个网络运维场景来说，该运维场景可以是基于以下至少一个维度获得的网络运维场景：无线网络制式维度、无线网络业务类型维度、无线网络应用维度、无线环境维度、无线话务状态维度。
示例性的，在不同维度下可以细分为多种网络运维场景。以网络优化场景为例，可以从以下几个维度进一步细分为若干个场景：
基于无线网络性能类型维度划分为：无线覆盖优化场景，无线容量优化场景，无线速率优化场景，无线语音质量优化场景等；
基于无线网络制式维度划分为：第三代通信技术(3th generation mobile communication technology，3G)优化场景，第四代通信技术(4th generation mobile communication technology，4G)优化场景，第五代通信技术(5th generation mobile communication technology，5G)优化场景等；
基于无线网络业务类型维度划分为：增强移动宽带(enhanced mobile broadband，eMBB)优化场景，超可靠低延迟通信(ultra reliable low latency communications，URLLC)优化场景，移动物联网(mobile internet of things，mIoT)优化场景，车联网(vehicle to everything，V2X)优化场景等；
基于无线网络应用维度划分为：面向个人(toC)的业务模式优化场景，面向企业(toB)的业务模式优化场景等；
基于无线环境维度划分为：室内优化场景，城区优化场景，郊区优化场景，农村优化场景等；
基于无线话务状态维度划分为：低话务量优化场景，中话务量优化场景，高话务量优化场景等。
以上是以单一维度进行划分的示例，可选的，还可以以多个维度进行划分。比如，以无线网络性能类型和无线网络制式两个维度为例，网络优化场景可包括：无线3G覆盖优化场景，无线4G覆盖优化场景，无线5G覆盖优化场景，无线3G容量优化场景，无线4G 容量优化场景和无线5G容量优化场景等。
上述网络场景划分维度也适用于其它网络运维场景，比如网络规划场景、网络部署场景、网络维护场景和网络运维场景等。
需要说明的是，以上仅为网络运维场景的一些示例，本申请实施例对网络运维场景的划分方式不做限制。
(5)网络自治能力
网络自治能力，是指实现自我管控的能力，用于体现采用的网络技术的自治化程度高低，网络自治化程度越高，网络自治能力越高。
网络运维场景的网络自治能力可通过该网络运维场景中包括的运维任务的网络自治能力来决定。运维任务的网络自治能力可由该运维任务的人机分工状态决定。
传统的网络自治能力评估方法中，使用自治网络等级来评价网络自治能力。
目前，电信系统的自治网络等级是根据运维流程中的每个运维任务的人机分工状态确定的，比如，以“网络优化”运维流程为例，如果该运维流程中只包括性能异常识别、性能问题根因分析以及优化方案生成三个运维任务，则可根据这三个运维任务的人机分工状态以及自治网络等级划分规则来确定该“网络优化”运维流程的自治网络等级。
自治网络等级划分规则定义了各自治网络等级下，各运维任务应满足的人机分工状态(或应满足的网络自治能力)。自治网络等级划分规则包括自治网络等级与运维任务人机分工状态之间的对应关系。这种对应关系可表现为自治网络等级的图表或表格。
图1示例性的以表格方式给出了一种“网络优化”运维流程的自治网络等级划分规则。图1中，自治网络等级从低到高包括：等级0、等级1、等级2、等级3、等级4、等级5。图1中的每个方框对应“网络优化”运维流程中的一个运维任务，方框中的字母表示相应运维任务的名称或种类，包括：
运维任务A1：监控规则和优化策略生成；
运维任务B1：网络/业务保障意图评估；
运维任务C1：数据采集：
运维任务D1：性能异常识别；
运维任务E1：性能劣化预测；
运维任务F1：性能问题定界；
运维任务G1：性能问题根因分析；
运维任务H1：优化方案生成；
运维任务I1：优化方案评估和确定；
运维任务J1：优化方案执行。
各自治网络等级对运维任务要求的人机分工状态如图1中各方框内括号中的内容所示，以等级3下对各运维任务要求的人机分工状态为例：
对运维任务A1要求的人工分机状态：人工；
对运维任务B1要求的人工分机状态：人工；
对运维任务C1要求的人工分机状态：系统；
对运维任务D1要求的人工分机状态：系统；
对运维任务E1要求的人工分机状态：人工+系统；
对运维任务F1要求的人工分机状态：系统；
对运维任务G1要求的人工分机状态：人工+系统；
对运维任务H1要求的人工分机状态：人工+系统；
对运维任务I1要求的人工分机状态：人工+系统；
对运维任务J1要求的人工分机状态：系统。
基于图1所示的自治网络等级划分规则，并结合运维流程中各运维任务的人机分工状态，在确定运维流程的自治网络等级时，运维流程中的每个运维任务的人机分工状态都要满足目标等级对各运维任务要求的人工分机状态，才能将该运维流程的自治网络等级定级为该目标等级。举例来说，如果一个运维流程中有一个运维任务不满足等级3所要求的人机分工状态，但满足等级2所要求的人工分机状态，其它运维任务均满足等级3所要求的人工分机状态，则该运维流程的自治网络等级不能被定级为等级3，而只能被定级为等级2。
由于不同电信系统分别引入不同的自治技术，因此可能出现以下情况：两个不同自治网络的自治网络等级相同的情况下，同一运维流程的网络自治能力存在较大差异，故而目前的自治网络等级评价方法较粗略，无法体现更精细化的差异，具体可体现在以下几个方面中的一个或多个：
第一方面：同一自治网络等级的运维任务的自治能力差异大。
以评估运营商A和运营商B的“网络优化”运维流程的网络自治能力为例，根据图1所示的自治网络等级划分规则，运营商A和运营商B的自治网络等级均为等级2，如图2a所示。但是运营商B的“网络优化”运维流程中的“性能异常识别(运维任务D1)”和“性能问题定界(运维任务F1)”两个运维任务的人机分工状态达到全系统参与，而运营商A在“网络优化”运维流程中的“性能异常识别(运维任务D1)”和“性能问题定界(运维任务F1)”的人机分工状态仅为人工参与，因此可以看出，虽然运营商A和运营商B的自治网络等级相同，但是运营商B的网络自治能力比运营商A的网络自治能力要强很多。
第二方面：运维任务的网络自治能力实现的难易程度无法体现。
以评估运营商A和运营商B的“网络优化”运维流程的网络自治能力为例，根据图1所示的自治网络等级划分规则，运营商A和运营商B的自治网络等级均为等级2，如图2b所示，运营商B的“性能劣化预测(运维任务E1)”运维任务的人机分工状态达到了等级3级的要求，运营商A的“数据采集(运维任务C1)”运维任务的人机分工状态达到了等级3的要求。但是，“性能劣化预测”运维任务的实现难度(或该运维任务的自治化实现难度)远高于“数据采集”运维任务的实现难度(或该运维任务的自治化实现难度)。
第三方面：场景自治实现的难易程度无法体现。
比如，运营商A只针对5G室外覆盖优化场景的自治能力达到了等级3，而运营商B针对5G室外覆盖的优化场景和室内覆盖优化场景的自治能力均达到了等级3，但是目前的自治网络等级评估方法无法体现上述差异。
为解决上述一个或多个方面的问题，本申请实施例提供了网络自治能力评估方法，用以提高网络自治能力评估的精细化程度。下面结合附图对本申请实施例进行说明。
图3示例性示出了本申请实施例适用的一种系统架构图。如图所示，本申请实施例可对图中所示的不同范围的自治网络进行网络自治能力评估。自治网络范围可包括以下三种情况：
单域自治网络：包括网元和域管理功能单元；
跨域自治网络：包括网元、域管理功能单元和跨域管理功能单元；
业务自治网络：包括网元、域管理功能单元，跨域管理功能单元和业务运营单元。
业务运营单元：也可以称为通信业务管理功能单元(communication service management function)，可以提供计费、结算、帐务、客服、营业、网络监控、通信业务生命周期管理、业务意图翻译等功能和管理服务。包括运营商的运营系统或者垂直行业的运营系统(vertical operational technology system)。
跨域管理功能单元：也可以称之为网络管理功能单元(network management function，NMF)，跨域管理功能单元提供以下一项或几项功能或者管理服务：网络的生命周期管理，网络的部署，网络的故障管理，网络的性能管理，网络的配置管理，网络的保障，网络的优化功能，通信服务提供商的网络意图(intent from communication service provider，intent-CSP)的翻译，通信服务使用者的网络意图(intent from communication service consumer，intent-CSC)的翻译等。这里的网络可以包括一个或者多个网元，子网络或者网络切片。例如，跨域管理功能单元可以是网络切片管理功能(network slice management function，NSMF)，或者管理数据分析功能(management data analytical function，MDAF)，或者跨域自组织网络功能(self-organization network function，SON-function)，或者跨域意图管理功能单元。
需要说明的是，在某些部署场景下，跨域管理功能单元也可以提供以下一项或几项管理功能或者管理服务：子网络的生命周期管理，子网络的部署，子网络的故障管理，子网络的性能管理，子网络的配置管理，子网络的保障，子网络的优化功能，通信服务提供商的子网络意图的翻译，通信服务使用者的子网络意图的翻译等。其中，子网络可以由多个小的子网络组成或者由多个网络切片子网络组成。
域管理功能单元：也可以称之为子网络管理功能(subnetwork management function，NMF)或者网元管理功能单元(network element/function management function)，域管理功能单元提供以下一项或者多项功能或者管理服务：子网络或者网元的生命周期管理，子网络或者网元的部署，子网络或者网元的故障管理，子网络或者网元的性能管理，子网络或者网元的保障，子网络或者网元的优化管理，子网络或者网元的意图翻译等。这里的子网络包括一个或者多个网元。或者，这里的子网络也可以包括一个或多个子网络，即一个或多个子网络组成一个更大覆盖范围的子网络。又或者，这里的子网络也可以包括一个或多个网络切片子网络。子网络包括以下几种描述方式之一：
某个技术域的网络，比如无线接入网，核心网，传输网等；
某个制式的网络，比如全球移动通信系统(global system for mobile communications，GSM)网络，长期演进(long term evolution，LTE)网络，5G网络等；
某个设备商(或运营商)提供的网络，比如设备商X提供的网络等；
某个地理区域的网络，比如工厂A的网络，地级市B的网络等。
网元：为提供网络服务的实体，包括核心网网元、接入网网元等。例如，核心网网元可以包括但不限于接入与移动性管理功能(access and mobility management function，AMF)实体、会话管理功能(session management function，SMF)实体、策略控制功能(policy control function，PCF)实体、网络数据分析功能(network data analysis function，NWDAF)实体、网络存储功能(network repository function，NRF)、网关等。接入网网元可以包括但不限于：各类基站(例如下一代基站(generation node B，gNB)，演进型基站(evolved Node B， eNB)、集中控制单元(central unit control panel，CUCP)、集中单元(central unit，CU)、分布式单元(distributed unit，DU)、集中用户面单元(central unit user panel，CUUP)等。
在服务化管理架构下，聚焦管理服务的提供者(management service producer,MnS Producer)和管理服务的消费者(management service consumer，MnS Consumer)，应理解：
当管理服务为上述业务运营单元提供的管理服务时，业务运营单元为管理服务提供者，其它业务运营商单元可以为管理服务消费者；
当管理服务为上述跨域管理功能单元提供的管理服务时，跨域管理功能单元为管理服务提供者，业务运营单元为管理服务消费者；
当管理服务为上述域管理功能单元提供的管理服务时，域管理功能单元为管理服务提供者，跨域管理功能单元或者业务运营单元为管理服务消费者；
当管理服务为上述网元提供的管理服务时，网元为管理服务提供者，域管理功能单元或者跨域管理功能单元或者业务运营单元为管理服务消费者。
图4示例性示出了本申请实施例提供的针对单一网络运维场景的网络自治能力评估方法的流程示意图。该流程可由网络自治能力评估装置执行。网络自治能力评估装置可由软件方式实现，或者硬件方式实现，或者软件和硬件结合的方式实现。可理解，当由软件方式实现时，网络自治能力评估装置可以是指实现网络自治能力评估方法的应用程序，或者是安装有该应用程序的电子设备。通过该流程可对图3中各种范围的自治网络在单一网络运维场景下的网络自治能力进行评估。
下面以第一网络运维场景为例进行说明。
如图4所示，该流程可包括以下步骤：
S401：确定第一网络运维场景的自治网络等级为第一自治网络等级。
所述第一网络运维场景是可能的任意一种网络运维场景，例如可以是网络优化场景、网络规划场景、网络部署场景、网络维护场景和网络运维场景中任意一个，也可以是更细化的网络运维场景，比如可以是无线覆盖优化场景，或者是无线5G覆盖优化场景等，本申请实施例对此不作限制。第一网络运维场景中可包括至少一个运维任务。
该步骤中，可根据第一网络运维场景中包括的运维任务的人机分工状态，以及预设的自治网络等级划分规则，确定第一网络运维场景的自治网络等级，这里为描述方便，将确定出的第一网络运维场景的自治网络等级称为第一自治网络等级。该第一自治网络等级为自治网络等级表格中包括的一个自治网络等级。根据运维任务的人机分工状态和自治网络等级划分规则，确定第一网络运维场景的自治网络等级的方法，与传统方法基本相同。
以第一网络运维场景为“无线5G覆盖优化场景”为例，图5示例性示出了用于评估“无线5G覆盖优化场景”的自治网络等级的网络优化自治网络等级表格，该表格中包括“无线5G覆盖优化场景”下每个自治网络等级对每个运维任务要求的人机分工状态。
图5中的每个方框对应“无线5G覆盖优化场景”中的一个运维任务，方框中的字母表示相应运维任务的名称或种类，包括：
运维任务A2：覆盖监控规则和优化策略生成；
运维任务B2：无线覆盖保障意图评估；
运维任务C2：覆盖数据采集：
运维任务D2：覆盖性能异常识别；
运维任务E2：覆盖性能劣化预测；
运维任务F2：覆盖问题定界；
运维任务G2：覆盖问题定位；
运维任务H2：覆盖优化方案生成；
运维任务I2：覆盖优化方案评估决策；
运维任务J2：覆盖优化方案执行。
表1示出了“无线5G覆盖优化场景”中的每个运维任务的人机分工状态。
表1：无线5G覆盖优化场景中每个运维任务的人机分工状态
将上述表1所示的各运维任务的人机分工状态，与图5所示的各自治网络等级对各运维任务要求的人机分工状态进行匹配，可确定出“无线5G覆盖优化场景”的自治网络等级为等级2。
S402：根据第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定第一网络运维场景的等级调整量。
本申请实施例中，自治网络等级为第一自治网络等级的第一网络运维场景包括的所有运维任务中，存在至少一个关键运维任务(key task)。所述至少一个关键运维任务中包括第一关键运维任务，第一自治网络等级对该第一关键运维任务的网络自治能力的要求，与第二自治网络等级对该第一关键运维任务的网络自治能力的要求不同。也就是说，在确定第一网络运维场景的自治网络等级为第一自治网络等级的情况下，若第一网络运维场景中包括的一个运维任务满足上述条件(即，第一自治网络等级对该运维任务的网络自治能力的要求，与第二自治网络等级对该运维任务的网络自治能力的要求不同)，则该运维任务为关键运维任务。其中，第二自治网络等级高于第一自治网络等级，可选的，第二自治网络等级是比第一自治网络等级高一级的自治网络等级，例如，若所述第一自治网络等级为图5中的等级2，则所述第二自治网络等级为图5中的等级3。
可选的，若所述至少一个关键运维任务中包括多个关键运维任务，则对于该多个关键运维任务中的任意一个运维任务来说，第一自治网络等级对该关键运维任务的网络自治能力的要求，与第二自治网络等级对该关键运维任务的网络自治能力的要求不同。
根据上述关键运维任务应满足的条件，下面以第一网络运维场景为“无线5G覆盖优化场景”为例，说明确定关键运维任务的方法。在S401中，确定出该“无线5G覆盖优化场景”的自治网络等级为等级2，则可根据图5中等级2对各运维任务要求的人机分工状态和等级3对各运维任务要求的人机分工状态，确定这些运维任务中的关键运维任务。可理解，确定出的关键运维任务是“无线5G覆盖优化场景”的自治网络等级为等级2情况下，“无线5G覆盖优化场景”中的关键运维任务。
示例性的，若第一运维场景的第一自治网络等级为图5中的等级2，则第二自治网络 等级为图5中的等级3，则确定出的关键运维任务可如图6中的虚线框标识的运维任务。如图6所示，对于任务C2(覆盖数据采集任务)，等级2对该运维任务要求的网络自治能力要达到“人工+系统”状态对应的网络自治能力，等级3对该运维任务要求的网络自治能力要达到“系统”状态对应的网络自治能力，满足上述“第一自治网络等级对该关键运维任务的网络自治能力的要求，与第二自治网络等级对该关键运维任务的网络自治能力的要求不同”的条件，因此任务C2(覆盖数据采集任务)为关键运维任务。同理，还可以进一步确定任务D2(覆盖性能异常识别)、任务E2(覆盖性能劣化预测)，任务F2(覆盖问题定界)、任务G2(覆盖问题定位)、任务H2(覆盖优化方案生成)以及任务I2(覆盖优化方案评估决策)也是关键运维任务。而对于任务A2(覆盖监控规则和优化策略生成)，等级2对该运维任务要求的网络自治能力要达到“人工+系统”状态对应的网络自治能力，等级3对该运维任务要求的网络自治能力同样要达到“人工+系统”状态对应的网络自治能力。
本申请实施例中，对于每个关键运维任务，可以确定该关键运维任务的网络自治能力的满足度。以第一关键运维任务为例，第一关键运维任务的网络自治能力的满足度，是指第一关键运维任务的网络自治能力，满足第二自治网络等级对该第一关键运维任务要求的网络自治能力的程度。例如，以第一网络运维场景的自治网络等级为等级2作为例子，第一关键运维任务的满足度，是指：该第一关键运维任务的网络自治能力满足等级3对该第一关键运维任务要求的网络自治能力的程度，比如具体可能是：完全满足，不满足(即完全不满足)，或者部分满足(比如80％满足)。可选的，满足度可用百分比或级别或其它类似参数来表示。
需要说明的是，本申请实施例对“满足度”的参数命名没有限制。
可理解，由于人机分工状态可以表示网络自治能力，因此“第一关键运维任务的网络自治能力满足第二自治网络等级对该第一关键运维任务要求的网络自治能力的程度”，也可理解为“第一关键运维任务的人机分工状态满足第二自治网络等级对该第一关键运维任务要求的人机分工状态的程度”。
在一种实现方式中，满足度可包括“满足”“不满足(即完全不满足)”两种情况。对于第一关键运维任务来说，若该第一关键运维任务的网络自治能力满足第二自治网络等级对该第一关键运维任务要求的网络自治能力，则第一关键运维任务的网络自治能力的满足度为“满足”，否则为“不满足”。
举例来说，在第一网络运维场景的自治网络等级为等级2的情况下，该第一网络运维场景中包括的关键运维任务如图6所示，对于其中的任务C2(覆盖数据采集任务)，根据表1可以确定该关键运维任务的人机分工状态为“系统”，根据图6可确定等级3对该关键运维任务要求的人机分工状态为“系统”，由于该关键运维任务的实际人机分工状态已经达到等级3对该关键运维任务的要求，也就意味着该关键运维任务的网络自治能力满足等级3对该关键运维任务要求的网络自治能力，因此该关键运维任务的网络自治能力的满足度为“满足”；而对于如图6中的任务E2(覆盖性能劣化预测)，根据表1可以确定该关键运维任务的人机分工状态为“人工”，根据图6可确定等级3对该关键运维任务要求的人机分工状态为“人工+系统”，由于该关键运维任务的实际人机分工状态无法达到(或满足)等级3对该关键运维任务的要求，也就意味着该关键运维任务的网络自治能力不满足等级3对该关键运维任务要求的网络自治能力，因此该关键运维任务的网络自治能力的满 足度为“不满足”。
在另一种实现方式中，满足度可包括多种情况，比如包括：满足(即完全满足)，不满足(即完全不满足)，部分满足(比如一定程度或比例满足)。进一步的，“部分满足”的情况，又可以根据满足程度(比例)的不同，包括多种更细分的情况。比如，在第一网络运维场景的自治网络等级为等级2的情况下，第一关键运维任务的实际人机分工状态为“30％人工+70％系统”，等级3对该关键运维任务要求的人机分工状态为“系统”，则该关键运维任务的网络自治能力等级的满足度为70％满足；再比如，第一关键运维任务的实际人机分工状态为“30％人工+70％系统”，等级3对该关键运维任务要求的人机分工状态为“10％人工+90％系统”，则该关键运维任务的网络自治能力等级的满足度为77％满足；再比如，第一关键运维任务的实际人机分工状态为“30％人工+70％系统”，等级3对该关键运维任务要求的人机分工状态为“60％人工+40％系统”，则该关键运维任务的网络自治能力等级的满足度为100％满足。
本申请实施例中，确定出第一网络运维场景中包括的所有关键运维任务，并确定出每个关键运维任务的网络自治能力满足度后，可根据所有关键运维任务的网络自治能力满足度，确定该第一网络运维场景的等级调整量。
可选的，等级调整量可使用所有关键运维任务的任务分数(task scope，Ts)的加权平均值来表示。
可选的，图4中的S402的一种实现方式可如图7所示。图7示例性示出了本申请实施例提供的一种确定第一网络运维场景的等级调整量的流程示意图，如图所示，该流程可包括以下步骤：
S701：确定第一网络运维场景中的每个关键运维任务的任务分数。
本申请实施例中，可根据关键运维任务的网络自治能力满足度，确定该关键运维任务的分数。第一关键运维任务的任务分数与第一关键运维任务的网络自治能力的满足度相对应。
针对上述满足度可包括“满足”“不满足”的情况，在一种实现方式中，可设置第一满足度(“满足”)与第一分数对应，设置第二满足度(“不满足”)与第二分数对应。第二分数不等于第一分数。可选的，在自治网络等级的取值越高，网络自治能力越高的情况下，第二分数低于第一分数。进一步的，第一分数可以等于1，第二分数可以等于0。在一种实现方式中，在确定第一关键运维任务的任务分数时，若第一关键运维任务的网络自治能力的满足度为第一满足度，第一满足度表示第一关键运维任务的网络自治能力满足第二自治网络等级对该第一关键运维任务要求的网络自治能力，则确定该第一关键运维任务的任务分数等于第一分数；若第一关键运维任务的网络自治能力的满足度为满足度，第二满足度表示第一关键运维任务的网络自治能力不满足第二自治网络等级对第一关键运维任务要求的网络自治能力，则确定该第一关键运维任务的任务分数等于第二分数。
针对上述满足度包括多个的情况，在一种可能的实现方式中，满足度除了包括上述第一满足度(表示“满足”)和第二满足度(表示“不满足”)的情况下，还可以进一步包括第三满足度，第三满足度表示第一关键运维任务的网络自治能力满足第二自治网络等级对该第一关键运维任务要求的网络自治能力的第一百分比，比如该第一百分比等于70％，则第三满足度为“70％”满足。可分别针对每个满足度设置对应的分数，满足度越高，任务分数越高。比如，若满足度为第一满足度(“100％满足”)，则对应的任务分数等于1，若 满足度为第二满足度(“不满足”)，则对应的任务分数等于0，若满足度为第三满足度(比如“70％满足”)，则对应的任务分数等于0.7。此种情况下，在确定第一关键运维任务的任务分数时，若第一关键运维任务的网络自治能力的满足度为第三满足度，则该第一关键运维任务的任务分数等于第三分数。其中，第三分数的取值在第一分数和第二分数之间，比如，第三分数大于第二分数且小于第一分数，比如上述例子中，第一满足度对应的任务分数等于1，第二满足度对应的任务分数等于0，第三满足度对应的任务分数等于0.7。在另一种可能的实现方式中，可预先针对每个满足度设置对应的系数，满足度越高，系数越高。这样，可以根据第一关键运维任务的自治能力的满足度，查询与该满足度对应的系数，从而用该系数乘以预先设置的基础分数，得到第一关键运维任务的任务分数。
一个关键运维任务的任务分数的高低，可以反映该关键运维任务的网络自治能力的高低，在自治网络等级的取值越高网络自治能力越高的情况下，一个关键运维任务的任务分数越高表示该关键运维任务的网络自治能力也越高，例如上述例子中，如果第一关键运维任务的任务分数等于第三分数(对应于第三满足度)，则表示该关键运维任务的网络自治能力介于第一分数(对应于第一满足度)对应的网络自治能力和第二分数(对应于第二满足度)对应的网络自治能力之间。
上述实现方式中，根据关键运维任务的网络自治能力是否满足第二自治网络等级对该运维任务要求的网络自治能力，关键运维任务的任务分数有所不同，从而可以体现不同关键运维任务对等级调整量的贡献大小，进而使得确定出的等级调整量更加合理。
通过上述实现方式，若第一关键运维任务的网络自治能力满足第二自治网络等级对该第一关键运维任务要求的网络自治能力，则可根据第一关键运维任务的网络自治能力的满足度来确定该第一关键运维任务的任务分数。也就是说，对于网络自治能力满足更高自治网络等级的关键运维任务来说，其网络自治能力的满足度可以包括多种可能，该关键运维任务的任务分数与该关键运维任务的网络自治能力满足对相对应，从而进一步细化了不同关键运维任务对等级调整量的贡献大小，进而使得确定出的等级调整量更加精细化。
S702：对第一网络运维场景中的所有关键运维任务的任务分数进行加权平均，得到第一值。
该第一值为第一网络运维场景中所有关键运维任务的任务分数的加权平均值。
可选的，可根据以下公式计算第一值(Ts_all)：
其中，K为第一网络运维场景中的所有关键运维任务的任务数量，Tsi为第一网络运维场景中所有关键运维任务中的第i个关键运维任务的任务分数，Twi为第i个关键运维任务的任务权重(task weight)。
可选的，第i个关键运维任务的任务权重，与第i个关键运维任务的实现难度关联。本申请实施例中，可根据运维任务的实现难度(也可理解为运维任务的自治化实现难度)设置运维任务的权重，实现难度越大，权重越大，这样可以通过关键运维任务的权重将关键运维任务的实现难度体现于该关键运维任务的任务分数，进而体现在第一运维场景的网络自治能力评估结果中，使得第一运维场景的网络自治能力评估结果更加精细。
可选的，任务权重的设置可以考虑但不限于以下因素：
-人工实现该运维任务所需投入的时间；
-人工实现该运维任务所需掌握的技能，即工作难度；
-该运维任务实现自治之后带来的网络性能增益。
如何统计分析以上因素得到任务权重，可以有多种计算方式，本申请实施例不做限制。
可选的，也可以将每个关键运维任务的权重设置为相同，比如设置为1，这样，上述计算任务分数的加权平均值的公式可变形为以下计算算数平均值的公式：
其中，K为第一网络运维场景中的所有关键运维任务的任务数量，Tsi为第一网络运维场景中所有关键运维任务中的第i个关键运维任务的任务分数。
S703：将第一值确定为第一网络运维场景的等级调整量。
可选的，可将确定出的第一加权平均值作为第一网络运维场景的等级调整量。
根据图7所示的流程，通过对各关键运维任务的任务分数进行加权平均计算，根据计算得到的第一值(任务分数的加权平均值)确定第一网络运维场景的等级调整量，可以将所有关键运维任务的实际网络自治能力与更高自治网络等级所要求的网络自治能力之间的差异因素考虑进来，从而可以使得确定出的等级调整量更加合理。
S403：根据第一自治网络等级以及等级调整量，确定第一网络运维场景的网络自治能力评估结果。
可选的，第一网络运维场景的网络自治能力评估结果可使用网络自治能力等级分数来表示。可选的，第一网络运维场景的网络自治能力等级分数等于第一自治网络等级与该等级调整量的和。
可选的，网络自治能力评估结果表示的网络自治能力，高于所述第一自治网络等级对应的网络自治能力，且低于第二自治网络等级对应的网络自治能力。也就是说，第一网络运维场景的网络自治能力介于第一自治网络等级对应的网络自治能力与第二自治网络等级对应的网络自治能力之间，相比于传统方案中仅基于评估出的自治网络等级来确定网络自治能力相比，采用本申请实施例可提高网络自治能力评估的精细化程度。
可选的，网络能力评估装置确定出第一网络运维场景的网络自治能力评估结果后，可以将该评估结果输出，比如发送给自治网络评估监控设备。
上述实施例中，确定第一网络运维场景的自治网络等级(第一自治网络等级)后，为进一步提高网络自治能力评估的精细化程度，则进一步的，根据第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定第一网络运维场景的等级调整量，从而根据第一自治网络等级以及该等级调整量，确定第一网络运维场景的网络自治能力评估结果，相比于仅基于第一自治网络等级来表征第一网络运维场景的网络自治能力相比，采用上述实现方式可以得到更精细化的网络自治能力评估结果。
进一步的，由于在进行网络自治能力评估过程中，根据关键运维任务的网络自治能力的满足度确定等级调整量，这样就将关键运维任务的实际网络自治能力与更高自治网络等级所要求的网络自治能力之间的差异因素考虑进来，基于这种差异确定等级调整量，从而可以提高网络自治能力评估的精细化程度。
下面以“无线5G覆盖优化场景”为例，结合图5所示的网络优化的自治网络等级表格，对单一网络运维场景下的网络自治能力评估流程进行说明，该流程的具体实现过程可参见图8，图8为图4所示流程的一个具体示例，即图8描述了当第一网络运维场景是“无 线5G覆盖优化场景”的情况下，对该“无线5G覆盖优化场景”进行网络自治能力评估的过程。
参见图8，本申请实施例提供的对“无线5G覆盖优化场景”的网络自治能力进行评估的流程可包括：
S801：根据待评估的“无线5G覆盖优化场景”中的每个运维任务的人机分工状态，以及预先设置的如图5所示的网络自治等级表格，确定“无线5G覆盖优化场景”的自治网络等级为等级2(ANL＝2)。
具体地，S801可包括以下S8011至S8012：
S8011：获取“无线5G覆盖优化场景”中的每个运维任务的人机分工状态。
“无线5G覆盖优化场景”运维流程中包括以下运维任务：覆盖监控规则和优化策略生成任务，无线覆盖保障意图评估任务，覆盖数据采集任务，覆盖性能异常识别任务，覆盖性能劣化预测任务，覆盖问题定界任务，覆盖问题定位任务，覆盖优化方案生成任务，覆盖优化方案评估决策任务和覆盖优化方案执行任务。上述各运维任务的人机分工状态如表1所示。
S8012：根据“无线5G覆盖优化场景”中每个运维任务的人机分工状态，以及如图5所示的网络优化的自治网络等级表格，确定“无线5G覆盖优化场景”的自治能力等级为等级2(ANL＝2)。
该步骤中，根据图5所示的网络优化的自治网络等级表格，确定该“无线5G覆盖优化场景”中的“覆盖数据采集”任务和“覆盖优化方案执行”任务已经实现由电信系统进行，同时“覆盖性能异常的识别”任务和“覆盖问题定界”任务也具备由电信系统独立完成的能力，但是“覆盖性能劣化预测”任务仍需人工进行，无法满足等级3对该运维任务所要求的人机分工状态，因此将“无线5G覆盖优化场景”的网络自治等级确定为等级2(ANL＝2)。
S802：根据S801确定的定级结果(ANL＝2)，确定“无线5G覆盖优化场景”的网络优化自治能力等级分数(ANL Scope,即ANLs)。
“无线5G覆盖优化场景”的网络优化自治能力等级分数(ANLs)，可依据定级结果(ANL＝2)以及等级调整量(这里称为关键运维任务的加权平均分Ts_all)确定得到。
具体地，S802可包括以下步骤S8021至S8022：
S8021：针对S801确定的定级结果(ANL＝2)以及ANL＝3，确定关键运维任务，对每个关键运维任务进行打分，得到每个关键运维任务的任务分数(task scope，Ts)。
具体地，S8021可包括以下步骤I和步骤II：
步骤I：根据S801确定的定级结果(ANL＝2)，基于如图5所示的网络优化的自治网络等级表格，比对ANL＝2以及ANL＝3对各运维任务要求的人机分工状态，将人机分工状态存在差异的所有运维任务确定为关键运维任务。确定出的关键运维任务(key task)如图6中虚线框标识的运维任务所示，具体包括7个关键运维任务(key task)：任务C2(覆盖数据采集任务)、任务D2(覆盖性能异常识别)、任务E2(覆盖性能劣化预测)，任务F2(覆盖问题定界)、任务G2(覆盖问题定位)、任务H2(覆盖优化方案生成)以及任务I2(覆盖优化方案评估决策)。
步骤II：针对步骤I中选取的关键运维任务，对比分析“无线5G覆盖优化场景”中每个关键运维任务的人机分工状态的满足度，得到每个关键运维任务的任务分数Ts。“无线 5G覆盖优化场景”中的每个关键运维任务的任务分数如表2所示。这里，以“满足度”包括“满足”和“不满足”为例，“满足”对应的任务分数等于1，“不满足”对应的任务分数等于0。计算任务分数Ts时，若某个关键运维任务的“满足度”为“满足”，则该关键运维任务的任务分数Ts＝1，若某个关键运维任务的“满足度”为“不满足”，则该关键运维任务的任务分数Ts＝0。
表2：“无线5G覆盖优化场景”中的关键运维任务的任务分数
S8022：获取每个关键运维任务的任务权重(Tw1,…,Twn)，并根据关键运维任务的任务权重(Tw1,…,Twn)和任务分数(Ts1,…,Tsn)，确定“无线5G覆盖优化场景”的自治网络等级分数(ANLs scope，ANLs)。
步骤S8022具体可包括以下步骤III至步骤IV：
步骤III：根据关键运维任务的自治化实现难易程度，确定关键运维任务的任务权重Tw。表3示出了一种关键运维任务权重Tw举例。
表3：关键运维任务的任务权重
步骤IV：根据“无线5G覆盖优化场景”的关键运维任务的任务分数Ts和任务权重Tw计算得到所有关键任务的任务分数的加权平均值Ts_all，再根据Ts_all和“无线5G覆 盖优化场景”的等级结果(ANL＝2)，计算得到“无线5G覆盖优化场景”的自治网络等级分数ANLs。
其中，Ts_all的计算公式为：
Ts_all＝Sum(Ts1*Tw1+Ts2*Tw2+…+Tsn*Twn)/Sum(1*Tw1+1*Tw2+…+1*Twn)
ANLs的计算公式为：
ANLs＝ANL+Ts_all
根据以上公式，“无线5G覆盖优化场景”的自治网络等级分数的计算结果为：
ANLs＝2+(1*2+1*2+0*4+1*2+1*5+1*8+1*4)/(1*2+1*2+1*4+1*2+1*5+1*8+1*4)＝2.85
需要说明的是，图8中各步骤的具体实现方式可参见前述实施例，在此不再重复。
参见图9，为本申请实施例提供的对多个网络运维场景的网络自治能力评估方法的流程。该流程可由网络自治能力评估装置执行。网络自治能力评估装置可由软件方式实现，或者硬件方式实现，或者软件和硬件结合的方式实现。可理解，当由软件方式实现时，网络自治能力评估装置可以是指实现网络自治能力评估方法的应用程序，或者是安装有该应用程序的电子设备。通过该流程可对图3中各种范围的自治网络的网络自治能力进行评估。
如图9所示，该流程可包括以下步骤：
S901：确定多个网络运维场景。
其中，所述多个网络运维场景中的至少一个网络运维场景可以基于以下至少一个维度获得的网络运维场景：无线网络制式维度、无线网络业务类型维度、无线网络应用维度、无线环境维度、无线话务状态维度。所述多个网络运维场景中的每个网络运维场景包括至少一个运维任务。
为描述方便，可将该多个网络运维场景称为场景组合。
示例性的，可选定多个需要进行网络自治能力评估的网络优化场景形成场景组合，例如，该多个网络优化场景可包括：无线4G覆盖优化场景、无线5G覆盖优化场景、无线4G速率优化场景、无线5G速率优化场景。
S902：确定该多个网络运维场景(即场景组合)中每个网络运维场景的自治能力评估结果。
在一种实现方式中，可采用传统的方法，分别确定该场景组合中每个网络运维场景的自治网络等级，得到每个网络运维场景的自治能力评估结果。
在另一种实现方式中，可采用本申请的上述实施例提供的针对单一网络运维场景的网络能力评估方法，例如采用如图4所示的方法，分别对该场景组合中的每个网络运维场景的网络自治能力进行评估，得到每个网络运维场景的自治能力评估结果。
S903：根据该多个网络运维场景(即场景组合)中每个网络运维场景的自治能力评估结果，确定该多个网络运维场景(即场景组合)对应的一个网络自治能力评估结果。
该步骤中，可以根据多个网络运维场景(即场景组合)中每个网络运维场景的自治网络等级分数，确定第二值，该第二值为该多个网络运维场景(即场景组合)中所有网络运维场景的自治网络等级分数的加权平均值；将该第二值确定为该多个网络运维场景(即场景组合)对应的一个网络自治能力评估结果。
在一种实现方式中，该第二值(ANLS_Ava)，可以根据以下公式计算：
其中，M为该多个网络运维场景(即场景组合)中的网络运维场景的数量，ANLsi为该多个网络运维场景中第i个网络运维场景的自治网络等级分数。
在另一种实现方式中，该第二值(ANLS_Ava)，可以根据以下公式计算：
其中，M为该多个网络运维场景(即场景组合)中的网络运维场景的数量，ANLsi为该多个网络运维场景中第i个网络运维场景的自治网络等级分数，Swi为第i个网络运维场景的场景权重(scenario weight，Sw)。
可选的，可根据网络运维场景的实现难易程度，为网络运维场景设置对应的场景权重。比如，“5G室内覆盖优化场景”比“5G室外覆盖优化场景”的实现难度大，因此“5G室内覆盖优化场景”的场景权重比“5G室外覆盖优化场景”的场景权重高。
可选的，网络能力评估装置确定出该多个网络运维场景(即场景组合)对应的一个网络自治能力评估结果后，可以将该评估结果输出，比如发送给自治网络评估监控设备。
根据以上图9所示的流程，在对多个网络运维场景进行网络自治能力评估的场景中，分别确定每个网络运维场景的网络自治能力评估结果，再根据每个网络运维场景的网络自治能力评估结果确定该多个网络运维场景对应的网络自治能力，因此可以综合多个网络运维场景的网络自治能力，评估该多个网络运维场景形成的场景组合所对应的网络自治能力，弥补了目前尚未有根据场景组合评估网络自治能力的空白。
基于相同的技术构思，本申请实施例还提供了一种网络自治能力评估装置。该网络自治能力评估装置可执行图4、图7所示的流程。
如图10所示，该网络自治能力评估装置1000可包括：自治网络等级确定模块1001、等级调整量确定模块1002、网络自治能力评估模块1003。
自治网络等级确定模块1001，用于确定第一网络运维场景的自治网络等级为第一自治网络等级；等级调整量确定模块1002，用于根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量；网络自治能力评估模块1003，用于根据所述第一自治网络等级以及所述等级调整量，确定所述第一网络运维场景的网络自治能力评估结果。可选的，自治网络等级确定模块1001可依据自治网络等级划分规则1004确定第一网络运维场景的自治网络等级为第一自治网络等级；等级调整量确定模块1002可依据自治网络等级确定模块1001确定出的第一自治网络等级，以及自治网络等级划分规则1004，并根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量。
其中，所述第一网络运维场景包括至少一个关键运维任务，所述至少一个关键运维任务中包括第一关键运维任务，所述第一自治网络等级对所述第一关键运维任务的网络自治能力的要求与第二自治网络等级对所述第一关键运维任务的网络自治能力的要求不同，所述第一关键运维任务的网络自治能力的满足度为所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的程度，所述第二自治网络等级高于所述第一自治网络等级。可选的，所述第二自治网络等级是比所述第一自治网络等级高一级的自治网络等级。
需要说明的是，上述网络自治能力评估装置1000能够实现上述方法实施例中如图4所实现的所有方法步骤，且能够达到相同的技术效果，在此不再对本实施例中与方法实施 例相同的部分及有益效果进行具体赘述。
基于相同的技术构思，本申请实施例还提供了一种网络自治能力评估装置。该网络自治能力评估装置可执行图9所示的流程。
如图11所示，该网络自治能力评估装置1100可包括：网络运维场景组合确定模块1101、第一网络自治能力评估模块1102、第二网络自治能力评估模块1103。
网络运维场景组合确定模块1101，用于确定多个网络运维场景，所述多个网络运维场景中的每个网络运维场景包括至少一个运维任务；第一网络自治能力评估模块1102，用于确定所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果；第二网络自治能力评估模块1103，用于根据所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果，确定所述多个网络运维场景对应的一个网络自治能力评估结果。
在一种可能的实现方式中，第一网络自治能力评估模块1102可执行图4、图7所示的流程，获得所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果。第一网络自治能力评估模块1102获得网络运维场景的网络自治能力评估结果的过程，可参见图4、图7中的描述，相关技术术语以及概念的解释和定义，也可参见图4、图7所述流程中的描述。
可选的，第一网络自治能力评估模块1102可包括：自治网络等级确定模块11021、等级调整量确定模块11022、网络自治能力评估模块11023。
以所述多个网络运维场景中包括第一网络运维场景为例，第一网络自治能力评估模块1102中的各模块的功能包括：自治网络等级确定模块11021，用于确定所述第一网络运维场景的自治网络等级为第一自治网络等级；等级调整量确定模块11022，根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量；网络自治能力评估模块11023，根据所述第一自治网络等级以及所述等级调整量，确定所述第一网络运维场景的网络自治能力评估结果。
其中，所述第一网络运维场景包括至少一个关键运维任务，所述至少一个关键运维任务中包括第一关键运维任务，所述第一自治网络等级对所述第一关键运维任务的网络自治能力的要求与第二自治网络等级对所述第一关键运维任务的网络自治能力的要求不同，所述第一关键运维任务的网络自治能力的满足度为所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的程度，所述第二自治网络等级高于所述第一自治网络等级。
需要说明的是，上述网络自治能力评估装置1100能够实现上述方法实施例中如图9所实现的所有方法步骤，且能够达到相同的技术效果，在此不再对本实施例中与方法实施例相同的部分及有益效果进行具体赘述。
为便于理解，图12中仅示出了通信装置1200执行本申请所示方法所需的结构，本申请并不限制通信装置可具备更多组件。该通信装置1200可用于执行上述方法实施例中网络自治能力评估装置执行的步骤。该通信装置1200可包括通信接口1201、存储器1202以及处理器1203。该通信接口1201可以用于通信装置进行通信，如用于发送或接收信号。该存储器1202与所述处理器1203耦合，可用于保存通信装置1200实现各功能所必要的程序和数据。该处理器1203被配置为支持通信装置1200执行上述方法中由网络自治能力评估装置执行的处理功能。以上存储器1202以及处理器1203可集成于一体也可相互独立。
示例性的，该通信接口1201可以是通信端口，如网元之间用于通信的通信端口(或 称接口)。通信接口1201也可被称为收发单元或通信单元。该处理器1203可通过处理芯片或处理电路实现。通信接口1201可采用无线方式或有线方式进行信息接收或发送。本申请实施例中，通信装置1200在对第一网络运维场景的网络自治能力评估的过程中，可基于通信接口1201获取第一网络运维场景中各运维任务的人机分工状态，还可以获取自治网络等级划分规则(比如图5所示的表格)，进一步的，在获得评估结果后，还可以通过通信接口1201进行输出。通信装置1200在对多个网络运维场景的网络自治能力评估的过程中，可基于通信接口1201获取该多个网络运维场景中每个网络运维场景中的各运维任务的人机分工状态，还可以获取自治网络等级划分规则(比如图5所示的表格)，进一步的，在获得评估结果后，还可以通过通信接口1201进行输出。
另外，根据实际使用的需要，本申请实施例提供的通信装置可包括处理器，由该处理器调用外接的收发器和/或存储器以实现上述功能或步骤或操作。通信装置也可包括存储器，由处理器调用并执行存储器中存储的程序实现上述功能或步骤或操作。或者，通信装置也可包括处理器及收发器(或通信接口)，由处理器调用并执行外接的存储器中存储的程序实现上述功能或步骤或操作。或者，通信装置也可包括处理器、存储器以及收发器。
在一种实现方式中，该通信装置1200可对单一网络运维场景进行网络自治能力评估，具体可实现上述图4、图7所示的流程。此种情况下，处理器1203可实现网络自治能力评估装置1000中自治网络等级确定模块1001、等级调整量确定模块1002、网络自治能力评估模块1003的功能。
在另一种实现方式中，该通信装置1200可对多个网络运维场景进行网络自治能力评估，具体可实现上述图9所示的流程。此种情况下，处理器1203可实现网络自治能力评估装置1100中网络运维场景组合确定模块1101、第一网络自治能力评估模块1102、第二网络自治能力评估模块1103的功能。
基于与上述方法实施例相同构思，本申请实施例中还提供一种计算机可读存储介质，其上存储有程序指令(或称计算机程序、指令)，该程序指令被处理器执行时，使该计算机执行上述方法实施例、方法实施例的任意一种可能的实现方式中由网络自治能力评估装置执行的操作。
基于与上述方法实施例相同构思，本申请还提供一种计算机程序产品，包括程序指令，该计算机程序产品在被计算机调用执行时，可以使得计算机实现上述方法实施例、方法实施例的任意一种可能的实现方式中由网络自治能力评估装置执行的操作。
基于与上述方法实施例相同构思，本申请还提供一种芯片或芯片系统，该芯片与收发器耦合，用于实现上述方法实施例、方法实施例的任意一种可能的实现方式中由网络自治能力评估装置执行的操作。该芯片系统可包括该芯片，以及包括存储器、通信接口等组件。
基于与上述方法实施例相同构思，本申请实施例还提供一种通信系统，所述通信系统包括自治网络评估执行设备和自治网络评估监控设备。
一种可能的实现方式中，所述自治网络评估执行设备可以用于对单一网络运维场景进行网络自治能力评估，比如该自治网络评估执行设备可以是(或包括)上述图10所示的网络自治能力评估装置1000，该自治网络评估执行设备可以将第一网络运维场景的网络自治能力评估结果发送给所述自治网络评估监控设备，以使得自治网络评估监控设备可以对第一网络运维场景的网络自治能力的评估结果进行监控。
另一种可能的实现方式中，所述自治网络评估执行设备可以用于对多个网络运维场景 进行网络自治能力评估，比如该自治网络评估执行设备可以是(或包括)上述图11所示的网络自治能力评估装置1100，该自治网络评估执行设备可以将多个网络运维场景的网络自治能力评估结果发送给所述自治网络评估监控设备，以使得自治网络评估监控设备可以对该多个网络运维场景的网络自治能力的评估结果进行监控。
本领域内的技术人员应明白，本申请的实施例可提供为方法、系统、或计算机程序产品。因此，本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本申请是参照根据本申请的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
显然，本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的保护范围。这样，倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内，则本申请也意图包含这些改动和变型在内。

Claims (56)

  1. 一种网络自治能力评估方法，其特征在于，包括：
    确定第一网络运维场景的自治网络等级为第一自治网络等级；
    根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量；其中，所述第一网络运维场景包括至少一个关键运维任务，所述至少一个关键运维任务中包括第一关键运维任务，所述第一自治网络等级对所述第一关键运维任务的网络自治能力的要求与第二自治网络等级对所述第一关键运维任务的网络自治能力的要求不同，所述第一关键运维任务的网络自治能力的满足度为所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的程度，所述第二自治网络等级高于所述第一自治网络等级；
    根据所述第一自治网络等级以及所述等级调整量，确定所述第一网络运维场景的网络自治能力评估结果。
  2. 如权利要求1所述的方法，其特征在于，所述网络自治能力评估结果表示的网络自治能力，高于所述第一自治网络等级对应的网络自治能力，且低于所述第二自治网络等级对应的网络自治能力。
  3. 如权利要求1-2任一项所述的方法，其特征在于，所述第一自治网络等级对所述至少一个关键运维任务中的任意一个关键运维任务的网络自治能力的要求，与所述第二自治网络等级对所述任意一个关键运维任务的网络自治能力的要求不同。
  4. 如权利要求1-3任一项所述的方法，其特征在于，所述根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量，包括：
    确定所述至少一个关键运维任务中每个关键运维任务的任务分数；
    对所述至少一个关键运维任务中每个关键运维任务的任务分数进行加权平均，得到第一值；
    将所述第一值确定为所述第一网络运维场景的等级调整量。
  5. 如权利要求4所述的方法，其特征在于，所述第一关键运维任务的任务分数与所述第一关键运维任务的网络自治能力的满足度相对应。
  6. 如权利要求4-5任一项所述的方法，其特征在于，所述确定所述至少一个关键运维任务中每个关键运维任务的任务分数，包括：
    若所述第一关键运维任务的网络自治能力的满足度为第一满足度，所述第一满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力，则确定所述第一关键运维任务的任务分数等于第一分数；
    若所述第一关键运维任务的网络自治能力的满足度为第二满足度，所述第二满足度表示所述第一关键运维任务的网络自治能力不满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力，则确定所述第一关键运维任务的任务分数等于第二分数，所述第二分数不等于所述第一分数。
  7. 如权利要求6所述的方法，其特征在于，还包括：
    若所述第一关键运维任务的网络自治能力的满足度为第三满足度，所述第三满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运 维任务要求的网络自治能力的第一百分比，则所述第一关键运维任务的任务分数等于第三分数，所述第三分数的取值在所述第一分数和所述第二分数之间。
  8. 如权利要求4-7任一项所述的方法，其特征在于，所述第一值Ts_all，满足以下公式：
    其中，K为所述至少一个关键运维任务中的关键运维任务的数量，Tsi为所述至少一个关键运维任务中的第i个关键运维任务的任务分数，Twi为所述第i个关键运维任务的任务权重。
  9. 如权利要求8所述的方法，其特征在于，所述第i个关键运维任务的任务权重，与所述第i个关键运维任务的实现难度关联。
  10. 如权利要求1-9任一项所述的方法，其特征在于，所述第二自治网络等级是比所述第一自治网络等级高一级的自治网络等级。
  11. 如权利要求1-10任一项所述的方法，其特征在于，所述第一运维场景是基于以下至少一个维度获得的网络运维场景：无线网络制式维度、无线网络业务类型维度、无线网络应用维度、无线环境维度、无线话务状态维度。
  12. 一种网络自治能力评估装置，其特征在于，包括：
    自治网络等级确定模块，用于确定第一网络运维场景的自治网络等级为第一自治网络等级；
    等级调整量确定模块，用于根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量；其中，所述第一网络运维场景包括至少一个关键运维任务，所述至少一个关键运维任务中包括第一关键运维任务，所述第一自治网络等级对所述第一关键运维任务的网络自治能力的要求与第二自治网络等级对所述第一关键运维任务的网络自治能力的要求不同，所述第一关键运维任务的网络自治能力的满足度为所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的程度，所述第二自治网络等级高于所述第一自治网络等级；
    网络自治能力评估模块，用于根据所述第一自治网络等级以及所述等级调整量，确定所述第一网络运维场景的网络自治能力评估结果。
  13. 如权利要求12所述的装置，其特征在于，所述网络自治能力评估结果表示的网络自治能力，高于所述第一自治网络等级对应的网络自治能力，且低于所述第二自治网络等级对应的网络自治能力。
  14. 如权利要求12-13任一项所述的装置，其特征在于，所述第一自治网络等级对所述至少一个关键运维任务中的任意一个关键运维任务的网络自治能力的要求，与所述第二自治网络等级对所述任意一个关键运维任务的网络自治能力的要求不同。
  15. 如权利要求12-14任一项所述的装置，其特征在于，所述等级调整量确定模块，具体用于：
    确定所述至少一个关键运维任务中每个关键运维任务的任务分数；
    对所述至少一个关键运维任务中每个关键运维任务的任务分数进行加权平均，得到第一值；
    将所述第一值确定为所述第一网络运维场景的等级调整量。
  16. 如权利要求15所述的装置，其特征在于，所述第一关键运维任务的任务分数与所述第一关键运维任务的网络自治能力的满足度相对应。
  17. 如权利要求15-16任一项所述的装置，其特征在于，所述等级调整量确定模块，具体用于：
    若所述第一关键运维任务的网络自治能力的满足度为第一满足度，所述第一满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力，则确定所述第一关键运维任务的任务分数等于第一分数；
    若所述第一关键运维任务的网络自治能力的满足度为第二满足度，所述第二满足度表示所述第一关键运维任务的网络自治能力不满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力，则确定所述第一关键运维任务的任务分数等于第二分数，所述第二分数不等于所述第一分数。
  18. 如权利要求17所述的装置，其特征在于，所述等级调整量确定模块，还用于：
    若所述第一关键运维任务的网络自治能力的满足度为第三满足度，所述第三满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的第一百分比，则所述第一关键运维任务的任务分数等于第三分数，所述第三分数的取值在所述第一分数和所述第二分数之间。
  19. 如权利要求15-18任一项所述的装置，其特征在于，所述第一值Ts_all，满足以下公式：
    其中，K为所述至少一个关键运维任务中的关键运维任务的数量，Tsi为所述至少一个关键运维任务中的第i个关键运维任务的任务分数，Twi为所述第i个关键运维任务的任务权重。
  20. 如权利要求19所述的装置，其特征在于，所述第i个关键运维任务的任务权重，与所述第i个关键运维任务的实现难度关联。
  21. 如权利要求12-20任一项所述的装置，其特征在于，所述第二自治网络等级是比所述第一自治网络等级高一级的自治网络等级。
  22. 如权利要求12-21任一项所述的装置，其特征在于，所述第一网络运维场景是基于以下至少一个维度获得的网络运维场景：无线网络制式维度、无线网络业务类型维度、无线网络应用维度、无线环境维度、无线话务状态维度。
  23. 一种通信系统，其特征在于，所述通信系统包括自治网络评估执行设备和自治网络评估监控设备；其中，所述自治网络评估执行设备用于执行如权利要求1-11任一项所述的方法，并将所述第一网络运维场景的网络自治能力评估结果发送给所述自治网络评估监控设备；所述自治网络评估监控设备，用于接收所述第一网络运维场景的网络自治能力评估结果。
  24. 一种网络自治能力评估方法，其特征在于，包括：
    确定多个网络运维场景；
    确定所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果；
    根据所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果，确定所述多个网络运维场景对应的一个网络自治能力评估结果。
  25. 如权利要求24所述的方法，其特征在于，所述多个网络运维场景中包括第一网络运维场景，所述确定所述第一网络运维场景的网络自治能力评估结果，包括：
    确定所述第一网络运维场景的自治网络等级为第一自治网络等级；
    根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量；其中，所述第一网络运维场景包括至少一个关键运维任务，所述至少一个关键运维任务中包括第一关键运维任务，所述第一自治网络等级对所述第一关键运维任务的网络自治能力的要求与第二自治网络等级对所述第一关键运维任务的网络自治能力的要求不同，所述第一关键运维任务的网络自治能力的满足度为所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的程度，所述第二自治网络等级高于所述第一自治网络等级；
    根据所述第一自治网络等级以及所述等级调整量，确定所述第一网络运维场景的网络自治能力评估结果。
  26. 如权利要求25所述的方法，其特征在于，所述第一网络运维场景的网络自治能力评估结果表示的网络自治能力，高于所述第一自治网络等级对应的网络自治能力，且低于所述第二自治网络等级对应的网络自治能力。
  27. 如权利要求25-26任一项所述的方法，其特征在于，所述第一自治网络等级对所述至少一个关键运维任务中的任意一个关键运维任务的网络自治能力的要求，与所述第二自治网络等级对所述任意一个关键运维任务的网络自治能力的要求不同。
  28. 如权利要求25-27任一项所述的方法，其特征在于，所述根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量，包括：
    确定所述至少一个关键运维任务中每个关键运维任务的任务分数；
    对所述至少一个关键运维任务中每个关键运维任务的任务分数进行加权平均，得到第一值；
    将所述第一值确定为所述第一网络运维场景的等级调整量。
  29. 如权利要求28所述的方法，其特征在于，所述第一关键运维任务的任务分数与所述第一关键运维任务的网络自治能力的满足度相对应。
  30. 如权利要求28-29任一项所述的方法，其特征在于，所述确定所述至少一个关键运维任务中每个关键运维任务的任务分数，包括：
    若确定所述第一关键运维任务的网络自治能力的满足度为第一满足度，则确定所述第一关键运维任务的任务分数等于第一分数；其中，所述第一满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力；
    若确定第一关键运维任务的网络自治能力的满足度为第二满足度，则确定所述第一关键运维任务的任务分数等于第二分数；其中，所述第二满足度表示所述第一关键运维任务的网络自治能力不满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力，所述第二分数不等于所述第一分数。
  31. 如权利要求30所述的方法，其特征在于，还包括：
    若所述第一关键运维任务的网络自治能力的满足度为第三满足度，则所述第一关键运维任务的任务分数等于第三分数；其中，所述第三满足度表示所述第一关键运维任务的网 络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的第一百分比，所述第三分数的取值在所述第一分数和所述第二分数之间。
  32. 如权利要求28-31任一项所述的方法，其特征在于，所述第一值Ts_all，满足以下公式：
    其中，K为所述至少一个关键运维任务中的关键运维任务的数量，Tsi为所述至少一个关键运维任务中的第i个关键运维任务的任务分数，Twi为所述第i个关键运维任务的任务权重。
  33. 如权利要求32所述的方法，其特征在于，所述第i个关键运维任务的任务权重，与所述第i个关键运维任务的实现难度关联。
  34. 如权利要求25-33任一项所述的方法，其特征在于，所述根据所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果，确定所述多个网络运维场景对应的一个网络自治能力评估结果，包括：
    根据所述多个网络运维场景中每个网络运维场景的自治网络等级分数确定第二值；其中，所述第一网络运维场景的自治网络等级分数是根据所述第一网络运维场景的自治网络等级和所述第一网络运维场景的等级调整量确定的；
    将所述第二值确定所述多个网络运维场景对应的一个网络自治能力评估结果。
  35. 如权利要求34所述的方法，其特征在于，所述第二值ANLS_Ava，满足以下公式：
    或者，所述第二值ANLS_Ava，满足以下公式：
    其中，M为所述多个网络运维场景中的网络运维场景的数量，ANLsi为所述多个网络运维场景中第i个网络运维场景的自治网络等级分数，Swi为所述第i个网络运维场景的场景权重。
  36. 如权利要求24-35任一项所述的方法，其特征在于，所述第二自治网络等级是比所述第一自治网络等级高一级的自治网络等级。
  37. 如权利要求24-36任一项所述的方法，其特征在于，所述多个网络运维场中的至少一个网络运维场景，是基于以下至少一个维度获得的网络运维场景：无线网络制式维度、无线网络业务类型维度、无线网络应用维度、无线环境维度、无线话务状态维度。
  38. 一种网络自治能力评估装置，其特征在于，包括：
    网络运维场景组合确定模块，用于确定多个网络运维场景；
    第一网络自治能力评估模块，用于确定所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果；
    第二网络自治能力评估模块，用于根据所述多个网络运维场景中每个网络运维场景的网络自治能力评估结果，确定所述多个网络运维场景对应的一个网络自治能力评估结果。
  39. 如权利要求38所述的装置，其特征在于，所述多个网络运维场景中包括第一网络 运维场景，所述第一网络自治能力评估模块确定所述第一网络运维场景的网络自治能力评估结果时，具体用于
    确定所述第一网络运维场景的自治网络等级为第一自治网络等级；
    根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量；其中，所述第一网络运维场景包括至少一个关键运维任务，所述至少一个关键运维任务中包括第一关键运维任务，所述第一自治网络等级对所述第一关键运维任务的网络自治能力的要求与第二自治网络等级对所述第一关键运维任务的网络自治能力的要求不同，所述第一关键运维任务的网络自治能力的满足度为所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的程度，所述第二自治网络等级高于所述第一自治网络等级；
    根据所述第一自治网络等级以及所述等级调整量，确定所述第一网络运维场景的网络自治能力评估结果。
  40. 如权利要求39所述的装置，其特征在于，所述第一网络运维场景的网络自治能力评估结果表示的网络自治能力，高于所述第一自治网络等级对应的网络自治能力，且低于所述第二自治网络等级对应的网络自治能力。
  41. 如权利要求39-40任一项所述的装置，其特征在于，所述第一自治网络等级对所述至少一个关键运维任务中的任意一个关键运维任务的网络自治能力的要求，与所述第二自治网络等级对所述任意一个关键运维任务的网络自治能力的要求不同。
  42. 如权利要求39-41任一项所述的装置，其特征在于，所述第一网络自治能力评估模块根据所述第一网络运维场景中每个关键运维任务的网络自治能力的满足度，确定所述第一网络运维场景的等级调整量时，具体用于：
    确定所述至少一个关键运维任务中每个关键运维任务的任务分数；
    对所述至少一个关键运维任务中每个关键运维任务的任务分数进行加权平均，得到第一值；
    将所述第一值确定为所述第一网络运维场景的等级调整量。
  43. 如权利要求42所述的装置，其特征在于，所述第一关键运维任务的任务分数与所述第一关键运维任务的网络自治能力的满足度相对应。
  44. 如权利要求42-43任一项所述的装置，其特征在于，所述第一网络自治能力评估模块确定所述至少一个关键运维任务中每个关键运维任务的任务分数时，具体用于：
    若确定所述第一关键运维任务的网络自治能力的满足度为第一满足度，则确定所述第一关键运维任务的任务分数等于第一分数；其中，所述第一满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力；
    若确定第一关键运维任务的网络自治能力的满足度为第二满足度，则确定所述第一关键运维任务的任务分数等于第二分数；其中，所述第二满足度表示所述第一关键运维任务的网络自治能力不满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力，所述第二分数不等于所述第一分数。
  45. 如权利要求44所述的装置，其特征在于，所述第一网络自治能力评估模块，还用于：
    若所述第一关键运维任务的网络自治能力的满足度为第三满足度，则确定所述第一关 键运维任务的任务分数等于第三分数；其中，所述第三满足度表示所述第一关键运维任务的网络自治能力满足所述第二自治网络等级对所述第一关键运维任务要求的网络自治能力的第一百分比，所述第三分数的取值在所述第一分数和所述第二分数之间。
  46. 如权利要求42-45任一项所述的装置，其特征在于，所述第一值Ts_all，满足以下公式：
    其中，K为所述至少一个关键运维任务中的关键运维任务的数量，Tsi为所述至少一个关键运维任务中的第i个关键运维任务的任务分数，Twi为所述第i个关键运维任务的任务权重。
  47. 如权利要求46所述的装置，其特征在于，所述第i个关键运维任务的任务权重，与所述第i个关键运维任务的实现难度关联。
  48. 如权利要求39-47任一项所述的装置，其特征在于，所述第二网络自治能力评估模块，具体用于：
    根据所述多个网络运维场景中每个网络运维场景的自治网络等级分数确定第二值；其中，所述第一网络运维场景的自治网络等级分数是根据所述第一网络运维场景的自治网络等级和所述第一网络运维场景的等级调整量确定的；
    将所述第二值确定所述多个网络运维场景对应的一个网络自治能力评估结果。
  49. 如权利要求48所述的装置，其特征在于，所述第二值ANLS_Ava，满足以下公式：
    或者，所述第二值ANLS_Ava，满足以下公式：
    其中，M为所述多个网络运维场景中的网络运维场景的数量，ANLsi为所述多个网络运维场景中第i个网络运维场景的自治网络等级分数，Swi为所述第i个网络运维场景的场景权重。
  50. 如权利要求38-49任一项所述的装置，其特征在于，所述第二自治网络等级是比所述第一自治网络等级高一级的自治网络等级。
  51. 如权利要求38-50任一项所述的装置，其特征在于，所述多个网络运维场中的至少一个网络运维场景，是基于以下至少一个维度获得的网络运维场景：无线网络制式维度、无线网络业务类型维度、无线网络应用维度、无线环境维度、无线话务状态维度。
  52. 一种通信系统，其特征在于，所述通信系统包括自治网络评估执行设备和自治网络评估监控设备；其中，所述自治网络评估执行设备用于执行如权利要求24-37任一项所述的方法，并将所述多个网络运维场景对应的一个网络自治能力评估结果发送给所述自治网络评估监控设备；所述自治网络评估监控设备，用于接收所述多个网络运维场景对应的一个网络自治能力评估结果。
  53. 一种通信装置，其特征在于，包括：一个或多个处理器；所述一个或多个存储器存储有一个或多个计算机程序，所述一个或多个计算机程序包括指令，当所述指令被所述一 个或多个处理器执行时，使得所述通信装置执行如权利要求1-11中任意一项所述的方法，或使得所述通信装置执行如权利要求24-37中任意一项所述的方法。
  54. 一种计算机可读存储介质，其特征在于，包括计算机程序，当所述计算机程序在电子设备上运行时，使得所述电子设备执行如权利要求1-11中任意一项所述的方法，或使得所述电子设备执行如权利要求24-37中任意一项所述的方法。
  55. 一种计算机程序产品，其特征在于，当其在电子设备上运行时，使得所述电子设备执行如权利要求1-11中任意一项所述的方法，或使得所述电子设备执行如权利要求24-37中任意一项所述的方法。
  56. 一种芯片系统，其特征在于，包括：存储器，用于存储计算机程序；处理器；当处理器从存储器中调用并运行计算机程序后，使得安装有该芯片系统的电子设备执行如权利要求1-11中任意一项所述的方法，或使得安装有该芯片系统的电子设备执行如权利要求24-37中任意一项所述的方法。
PCT/CN2023/081552 2022-04-01 2023-03-15 一种网络自治能力评估方法、装置及存储介质 WO2023185467A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210349407.XA CN116939673A (zh) 2022-04-01 2022-04-01 一种网络自治能力评估方法、装置及存储介质
CN202210349407.X 2022-04-01

Publications (1)

Publication Number Publication Date
WO2023185467A1 true WO2023185467A1 (zh) 2023-10-05

Family

ID=88199032

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/081552 WO2023185467A1 (zh) 2022-04-01 2023-03-15 一种网络自治能力评估方法、装置及存储介质

Country Status (2)

Country Link
CN (1) CN116939673A (zh)
WO (1) WO2023185467A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103996147A (zh) * 2014-03-20 2014-08-20 国家电网公司 配电网综合评估方法
CN105303466A (zh) * 2015-11-17 2016-02-03 福州大学 一种基于ahp-gra的智能电网工程项目的综合评价方法
CN111463774A (zh) * 2020-03-11 2020-07-28 广东电网有限责任公司 一种基于ahp法的城市配电网自愈能力评估方法
CN112055364A (zh) * 2019-06-06 2020-12-08 华为技术有限公司 一种网络系统分级方法及装置
WO2021103647A1 (zh) * 2019-11-30 2021-06-03 华为技术有限公司 一种信息处理方法及装置
WO2022061900A1 (zh) * 2020-09-28 2022-03-31 华为技术有限公司 故障自治能力的确定方法以及相关设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103996147A (zh) * 2014-03-20 2014-08-20 国家电网公司 配电网综合评估方法
CN105303466A (zh) * 2015-11-17 2016-02-03 福州大学 一种基于ahp-gra的智能电网工程项目的综合评价方法
CN112055364A (zh) * 2019-06-06 2020-12-08 华为技术有限公司 一种网络系统分级方法及装置
WO2021103647A1 (zh) * 2019-11-30 2021-06-03 华为技术有限公司 一种信息处理方法及装置
CN111463774A (zh) * 2020-03-11 2020-07-28 广东电网有限责任公司 一种基于ahp法的城市配电网自愈能力评估方法
WO2022061900A1 (zh) * 2020-09-28 2022-03-31 华为技术有限公司 故障自治能力的确定方法以及相关设备

Also Published As

Publication number Publication date
CN116939673A (zh) 2023-10-24

Similar Documents

Publication Publication Date Title
US10536866B2 (en) Orchestrating wireless network operations
Trestian et al. Game theory-based network selection: Solutions and challenges
Orhan et al. Connection management xAPP for O-RAN RIC: A graph neural network and reinforcement learning approach
WO2022061900A1 (zh) 故障自治能力的确定方法以及相关设备
US11218369B2 (en) Method, apparatus and system for changing a network based on received network information
CN114615718A (zh) 基于数字孪生技术的网络拓扑构建方法及装置
Sabella et al. Edge computing: from standard to actual infrastructure deployment and software development
Laselva et al. Advancements of QoE assessment and optimization in mobile networks in the machine era
WO2023185467A1 (zh) 一种网络自治能力评估方法、装置及存储介质
Ma et al. Heterogeneous network selection algorithm for novel 5G services based on evolutionary game
Zou et al. Resource multi-objective mapping algorithm based on virtualized network functions: RMMA
CN113728673A (zh) 用于估计被无线电问题抑制的数据业务的方法和装置
Smura et al. Future scenarios for local area access: industry structure and access fragmentation
Ferrús Ferré et al. Machine learning-assisted cross-slice radio resource optimization: Implementation framework and algorithmic solution
CN109788501A (zh) 2g+4g移动网络语音质量联合评估方法及装置
CN116976713A (zh) 对象评估方法、装置、存储介质及电子设备
WO2024078519A1 (zh) 自治网络的自治方法和装置
Cojoc et al. Horizontal cooperation on investment: Evidence from mobile network sharing
Luo et al. Prospect theory for human-centric communications
CN116739440B (zh) 自智网络的评价方法、装置、电子设备及存储介质
WO2024051805A1 (zh) 一种运维网络自治等级的评估方法、装置及系统
Hahn Mobile radio network management in the context of realistic heterogeneous scenarios
Li et al. An SMDP-based service function allocation scheme for mobile edge clouds
CN115688020A (zh) 网络投诉分类方法、装置、设备及存储介质
Ouyang et al. The First Decade of Computing and Network Convergence

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23777842

Country of ref document: EP

Kind code of ref document: A1