WO2024051805A1 - Procédé et appareil d'évaluation de niveau autonome de réseau d'exploitation et de maintenance, et système - Google Patents

Procédé et appareil d'évaluation de niveau autonome de réseau d'exploitation et de maintenance, et système Download PDF

Info

Publication number
WO2024051805A1
WO2024051805A1 PCT/CN2023/117655 CN2023117655W WO2024051805A1 WO 2024051805 A1 WO2024051805 A1 WO 2024051805A1 CN 2023117655 W CN2023117655 W CN 2023117655W WO 2024051805 A1 WO2024051805 A1 WO 2024051805A1
Authority
WO
WIPO (PCT)
Prior art keywords
maintenance
information
network
evaluation
maintenance tasks
Prior art date
Application number
PCT/CN2023/117655
Other languages
English (en)
Chinese (zh)
Inventor
刘银萍
李贤明
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2024051805A1 publication Critical patent/WO2024051805A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/14—Network analysis or design

Definitions

  • the embodiments of the present application relate to the field of communication technology, and in particular, to a method, device and system for evaluating the autonomy level of an operation and maintenance network.
  • the autonomy level of the operation and maintenance network reflects the operation and maintenance efficiency and operation and maintenance effectiveness, and can be used as an important indicator to measure the performance of the operator's network products.
  • the operation and maintenance network providers mainly provide the evaluation results of their operation and maintenance network autonomy levels. This method is not transparent enough and has poor reliability.
  • Embodiments of the present application provide a method, device and system for evaluating the autonomy level of an operation and maintenance network, in order to improve the reliability of the evaluation of the autonomy level of the operation and maintenance network.
  • embodiments of this application provide a method for evaluating the autonomy level of an operation and maintenance network, including:
  • the first device obtains the evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link from the second device, where N is a positive integer.
  • the first device sends the evaluation data of the N operation and maintenance tasks to the third device, and the evaluation data of the N operation and maintenance tasks are used to determine the network autonomy level of the first operation and maintenance operation link; or, The first device determines the network autonomy level of the first operation and maintenance operation link based on the evaluation data of the N operation and maintenance tasks.
  • the evaluation data of operation and maintenance tasks can be exchanged between devices.
  • the network autonomy level of the operation and maintenance operation can be evaluated based on the evaluation data of the operation and maintenance tasks. This can achieve an objective and transparent evaluation scheme and improve the reliability of the evaluation results.
  • the first device may also send first information to the second device, where the first information is used to request evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link, N is a positive integer. Based on the first information, the second device sends the evaluation data of the N operation and maintenance tasks in the first operation and maintenance operation link to the first device.
  • the first device controls which evaluation data of operation and maintenance tasks are sent by the second device, ensuring that the first device obtains the evaluation data of the required operation and maintenance tasks, and ensuring the fairness and reliability of the evaluation scheme.
  • the first device receives the second information from the third device.
  • the second information is used to request evaluation of the network autonomy level of the first operation and maintenance operation link, and the second information includes the first information.
  • the third device supports the third device to trigger the evaluation of operation and maintenance operations. It can be applied to scenarios where the operation and maintenance network provider obtains evaluation data or evaluation results through a third device externally, and supports objective evaluation through multiple evaluation methods.
  • the second information includes the content in the first information, but the signaling formats of the first information and the second information are different; or, the first information is encapsulated in the second information, and the first information is the second information. part of.
  • the evaluation data of any of the N operation and maintenance tasks requested by the first information includes one or more of the following: information of any of the operation and maintenance tasks , the execution mode of any operation and maintenance task, and the execution effect of any operation and maintenance task.
  • the first device requests the evaluation data of different operation and maintenance tasks among the N operation and maintenance tasks through the first information, which may be the same or different. For example, if N is 5, the first information requests the evaluation data of each of the three operation and maintenance tasks, including the information and execution mode of the operation and maintenance task; the first information requests the evaluation data of each of the remaining two operation and maintenance tasks.
  • Task evaluation data includes operation and maintenance task information, execution mode, and Execution effect.
  • the first information includes indicator information used to measure the execution effect of some or all of the N operation and maintenance tasks. Different operation and maintenance tasks correspond to different indicator information for measuring execution effects.
  • the first information includes first indication information
  • the first indication information is used to indicate a candidate mode corresponding to the execution mode of any one of the N operation and maintenance tasks.
  • the candidate modes include: manual execution mode, manual and system joint execution mode, and system execution mode.
  • the first device obtains the evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link from the second device, including: the first device receives the third operation and maintenance task from the second device.
  • the third information is used to indicate one or more of the following: the processing of the N operation and maintenance tasks has been completed, the execution mode of the N operation and maintenance tasks, the N operation and maintenance tasks The execution effect of some or all operation and maintenance tasks in the task.
  • embodiments of this application provide a method for evaluating the autonomy level of an operation and maintenance network, including:
  • the second device receives the first information from the first device, where the first information is used to request evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link, where N is a positive integer.
  • the second device sends third information to the first device according to the first information, where the third information is used to indicate the evaluation data of the N operation and maintenance tasks.
  • the evaluation data of any of the N operation and maintenance tasks requested by the first information includes one or more of the following: information of any of the operation and maintenance tasks , the execution mode of any operation and maintenance task, and the execution effect of any operation and maintenance task.
  • the first information includes first indication information
  • the first indication information is used to indicate a candidate mode corresponding to the execution mode of any one of the N operation and maintenance tasks
  • the candidate modes include: manual execution mode, manual and system joint execution mode, and system execution mode.
  • the third information is used to indicate one or more of the following: the processing of the N operation and maintenance tasks has been completed, the execution mode of the N operation and maintenance tasks, the Describe the execution effect of some or all of the N operation and maintenance tasks.
  • embodiments of the present application provide a method for evaluating the autonomy level of an operation and maintenance network, including: the second device sends the evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link to the first device, where N is a positive integer. .
  • the first device determines the network autonomy level of the first operation and maintenance operation link based on the evaluation data of the N operation and maintenance tasks; or, the first device sends the N operation and maintenance tasks to a third device
  • the third device determines the network autonomy level of the first operation and maintenance operation link based on the evaluation data of the N operation and maintenance tasks.
  • the method further includes: the first device sending first information to the second device, the first information being used to request evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link. .
  • the evaluation data of the N operation and maintenance tasks requested by the first information includes one or more of the following: information of the N operation and maintenance tasks, the N operation and maintenance tasks The execution mode of maintenance tasks, the execution effect of some or all of the N operation and maintenance tasks.
  • the first information includes first indication information
  • the first indication information is used to indicate a candidate mode corresponding to the execution mode of any of the N operation and maintenance tasks.
  • the candidate modes include: manual execution mode, manual and system joint execution mode, and system execution mode.
  • the method further includes: the third device sending second information to the first device.
  • the second information is used to request evaluation of the network autonomy level of the first operation and maintenance operation link, and the second information includes the first information.
  • the second device sends the evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link to the first device, including: the second device sends a third operation and maintenance task to the first device.
  • Information the third information is used to indicate one or more of the following: the processing of the N operation and maintenance tasks has been completed, the execution mode of the N operation and maintenance tasks, the N operation and maintenance tasks The execution effect of some or all operation and maintenance tasks.
  • inventions of the present application provide a device for evaluating the autonomy level of an operation and maintenance network.
  • the device may be the first device, or may be a module or chip in the first device, or may be used in conjunction with the first device. installation.
  • the device may include modules that perform one-to-one correspondence with the methods/operations/steps/actions described in the first aspect.
  • the modules may be hardware circuits, software, or hardware circuits combined with software.
  • the device may include a processing module and a communications module. include:
  • the processing module is used to obtain the evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link from the second device, where N is a positive integer.
  • a communication module configured to send the evaluation data of the N operation and maintenance tasks to a third device, where the evaluation data of the N operation and maintenance tasks are Determination of the network autonomy level in the first operation and maintenance operation link;
  • the processing module is also configured to determine the network autonomy level of the first operation and maintenance operation link based on the evaluation data of the N operation and maintenance tasks.
  • the communication module is also used to send first information to the second device, where the first information is used to request evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link.
  • N is a positive integer.
  • the communication module is also used to receive second information from the third device.
  • the second information is used to request evaluation of the network autonomy level of the first operation and maintenance operation link, and the second information includes the first information.
  • the second information includes the content in the first information, but the signaling formats of the first information and the second information are different; or, the first information is encapsulated in the second information, and the first information is the second information. part of.
  • the evaluation data of the N operation and maintenance tasks requested by the first information includes one or more of the following: information of the N operation and maintenance tasks, the N operation and maintenance tasks The execution mode of maintenance tasks, and the execution effect of the N operation and maintenance tasks.
  • the first information includes first indication information
  • the first indication information is used to indicate a candidate mode corresponding to the execution mode of any one of the N operation and maintenance tasks.
  • the candidate modes include: manual execution mode, manual and system joint execution mode, and system execution mode.
  • the communication module is also configured to receive third information from the second device, where the third information is used to indicate one or more of the following: for the N The processing of the operation and maintenance tasks has been completed, the execution mode of the N operation and maintenance tasks, and the execution effect of some or all of the N operation and maintenance tasks.
  • inventions of the present application provide a device for evaluating the autonomy level of an operation and maintenance network.
  • the device may be a second device, or may be a module or chip in the second device, or may be used in conjunction with the second device. installation.
  • the device may include modules that perform one-to-one correspondence with the methods/operations/steps/actions described in the second aspect.
  • the modules may be hardware circuits, software, or hardware circuits combined with software.
  • the apparatus may include a processing module and a communication module. include:
  • the communication module is configured to receive first information from the first device, where the first information is used to request evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link, where N is a positive integer.
  • a processing module configured to send third information to the first device through the communication module according to the first information, where the third information is used to indicate the evaluation data of the N operation and maintenance tasks.
  • the evaluation data of the N operation and maintenance tasks requested by the first information includes one or more of the following: information of the N operation and maintenance tasks, the N operation and maintenance tasks The execution mode of maintenance tasks, the execution effect of some or all of the N operation and maintenance tasks.
  • the first information includes first indication information
  • the first indication information is used to indicate a candidate mode corresponding to the execution mode of any one of the N operation and maintenance tasks
  • the candidate modes include: manual execution mode, manual and system joint execution mode, and system execution mode.
  • the third information is used to indicate one or more of the following: the processing of the N operation and maintenance tasks has been completed, the execution mode of the N operation and maintenance tasks, the Describe the execution effect of some or all of the N operation and maintenance tasks.
  • embodiments of the present application provide a device for evaluating the autonomy level of an operation and maintenance network.
  • the device includes a processor and is used to implement the method described in the first aspect.
  • the processor is coupled to a memory, and the memory is used to store instructions and data.
  • the evaluation device for the operation and maintenance network autonomy level may also include a memory;
  • the evaluation device for the operation and maintenance network autonomy level may also include a communication interface, and the communication interface is used for the device to communicate with other devices. Examples
  • the communication interface may be a transceiver, a circuit, a bus, a module, a pin, or other types of communication interfaces.
  • the device includes:
  • Memory used to store instructions.
  • a processor configured to obtain evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link from the second device, where N is a positive integer.
  • a communication interface configured to send evaluation data of the N operation and maintenance tasks to a third device, where the evaluation data of the N operation and maintenance tasks are used to determine the network autonomy level of the first operation and maintenance operation link;
  • the processor is also configured for the first device to determine the network autonomy level of the first operation and maintenance operation link based on the evaluation data of the N operation and maintenance tasks.
  • embodiments of the present application provide a device for evaluating the autonomy level of an operation and maintenance network.
  • the device includes a processor and is used to implement the method described in the second aspect.
  • the processor is coupled to a memory, and the memory is used to store instructions and data.
  • the evaluation device for the operation and maintenance network autonomy level may also include a memory;
  • the evaluation device for the operation and maintenance network autonomy level may also include a communication interface, and the communication interface is used for the device to communicate with other devices. Examples
  • the communication interface may be a transceiver, a circuit, a bus, a module, a pin, or other types of communication interfaces.
  • the device includes:
  • Memory used to store instructions.
  • the communication interface is used to receive first information from the first device, where the first information is used to request evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link, where N is a positive integer.
  • a processor configured to send third information to the first device through the communication module according to the first information, where the third information is used to indicate the evaluation data of the N operation and maintenance tasks.
  • inventions of the present application provide an evaluation system for the autonomy level of an operation and maintenance network.
  • the system includes a first device and a second device.
  • the system may also include a third device. in:
  • the second device is configured to send the evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link to the first device, where N is a positive integer.
  • the first device is configured to determine the network autonomy level of the first operation and maintenance operation link based on the evaluation data of the N operation and maintenance tasks; or,
  • the first device is configured to send the evaluation data of the N operation and maintenance tasks to a third device;
  • the third device is configured to determine the network autonomy level of the first operation and maintenance operation link based on the evaluation data of the N operation and maintenance tasks.
  • embodiments of the present application provide an evaluation system for the autonomy level of an operation and maintenance network.
  • the system includes an evaluation device for the autonomy level of an operation and maintenance network as described in the fourth or sixth aspect, and as described in the fifth or sixth aspect.
  • embodiments of the present application further provide a computer program, which when the computer program is run on a computer, causes the computer to execute the method provided in any one of the above-mentioned first to second aspects.
  • embodiments of the present application further provide a computer program product, including instructions, which when the instructions are run on a computer, cause the computer to execute the method provided in any one of the above first to second aspects.
  • embodiments of the present application further provide a computer-readable storage medium.
  • the computer-readable storage medium stores computer programs or instructions. When the computer program or instructions are run on a computer, the The computer executes the method provided in any one of the above first to second aspects.
  • embodiments of the present application further provide a chip, which is used to read a computer program stored in a memory and execute the method provided in any one of the above first to second aspects, or the The chip includes a circuit for executing the method provided in any one of the above first to second aspects.
  • embodiments of the present application further provide a chip system.
  • the chip system includes a processor and is configured to support a device to implement the method provided in any one of the above first to second aspects.
  • the chip system further includes a memory, and the memory is used to save necessary programs and data for the device.
  • the chip system can be composed of chips or include chips and other discrete devices.
  • Figure 1 is one of the structural schematic diagrams of the operation and maintenance network provided by the embodiment of the present application.
  • Figure 2 is a schematic diagram of the division relationship between operation and maintenance work links based on the technical domain and the business domain;
  • Figure 3 is a flow chart of a method for evaluating the autonomy level of an operation and maintenance network provided by an embodiment of the present application
  • Figure 4 is one of the structural schematic diagrams of the operation and maintenance network provided by the embodiment of the present application.
  • Figure 5 is one of the flow diagrams of the evaluation method for network coverage optimization provided by the embodiment of the present application.
  • Figure 6 is one of the structural schematic diagrams of the operation and maintenance network provided by the embodiment of the present application.
  • Figure 7 is one of the flow diagrams of the evaluation method for network coverage optimization provided by the embodiment of the present application.
  • Figure 8 is one of the structural schematic diagrams of the operation and maintenance network provided by the embodiment of the present application.
  • Figure 9 is one of the flow diagrams of the evaluation method for network coverage optimization provided by the embodiment of the present application.
  • Figure 10 is one of the structural schematic diagrams of an evaluation device for operating and maintaining network autonomy levels provided by an embodiment of the present application
  • Figure 11 is one of the structural schematic diagrams of an evaluation device for operating and maintaining network autonomy levels provided by an embodiment of the present application.
  • one or more refers to one, two or more than two; "and/or” describes the association relationship of associated objects, indicating that three relationships can exist; for example, A and/or B can mean: A alone exists, A and B exist simultaneously, and B exists alone, where A and B can be singular or plural.
  • the character "/" generally indicates that the related objects are in an "or” relationship.
  • the operation and maintenance network can also be called the operation and maintenance network system, which refers to the system that manages and maintains the communication network.
  • the operation and maintenance network involved in the embodiments of this application may be an autonomous network (AN).
  • An autonomous network refers to a telecommunications system (including a telecommunications network and its operation management system) that operates with as little manual intervention as possible. Autonomy capabilities realize self-control (telecommunication system (including management system and network) with autonomy capabilities which is able to be governed by itself with minimal to no human intervention).
  • network operation and maintenance can be divided into two functions, such as network management function and network element management function.
  • the operation and maintenance network includes two types of functional systems, one type of functional system provides network-level management functions, and the other type of functional system provides network element-level management functions.
  • network-level management functions can include management functions such as monitoring, analysis, configuration, and maintenance of the operator's network.
  • the management function at the network element level mainly focuses on the management of network elements within the communication network, achieving end-to-end management and maintenance between network elements and the network.
  • the system that provides network-level management functions in the operation and maintenance network can be a network management system (NMS) or other systems
  • the system that provides network element-level management functions can be a network element management system (NMS).
  • FIG. 1 illustrates an operation and maintenance network 100.
  • the operation and maintenance network 100 includes a network management system NMS and a network element management system EMS.
  • NMS can provide users with communication interfaces.
  • NMS can receive instructions from the network administrator, and perform management operations such as monitoring, analysis, configuration, and maintenance of the operator's network.
  • NMS can communicate with the operator's network. communicate with other systems.
  • EMS can communicate with network elements (NE) in the communication network, such as collecting data of network elements in the communication network and sending the collected data to the NMS.
  • the EMS can establish a connection with the NMS through the northbound interface (NBI), that is, the EMS can send data to the NMS through the northbound interface NBI.
  • the NMS may include one or more devices that provide network management functions, and the EMS may include one or more devices that provide network element management functions.
  • the operation and maintenance network may also include network elements that communicate with the EMS.
  • the aforementioned communication network may be a network of a certain standard.
  • the communication network may be a third generation (3G) communication network or a fourth generation (4G) communication network (such as Long Term Evolution). (long term evolution, LTE) network), fifth generation (5th generation, 5G) communication network, global interoperability for microwave access (WiMAX) or wireless local area network (WLAN) network, or A converged network of multiple networks, or a future communication network, such as 6G communication network, etc.
  • the communication network can also be in a certain technical domain Networks, such as digital energy networks, data center networks, transmission networks, bearer networks, core networks, fixed access networks, wireless access networks, etc.
  • the communication network can also be a network corresponding to certain services provided by operators. Different services correspond to different areas or types, such as enterprise campus networks, mobile networks for enterprise users (mobile 2B), mobile networks for individual users (mobile 2C), Government and enterprise dedicated line networks, home broadband networks, etc.
  • Different services correspond to different areas or types, such as enterprise campus networks, mobile networks for enterprise users (mobile 2B), mobile networks for individual users (mobile 2C), Government and enterprise dedicated line networks, home broadband networks, etc.
  • Network elements in the communication network can be entities that provide network services, and can be core network elements, access network elements, etc.
  • core network elements may include, but are not limited to, access and mobility management function (AMF) entities, session management function (SMF) entities, and policy control function (PCF) entities. Entities, network data analysis function (NWDAF) entities, network repository function (NRF), gateways, etc.
  • AMF access and mobility management function
  • SMF session management function
  • PCF policy control function
  • NWF network data analysis function
  • NWDAF network repository function
  • gateways etc.
  • Access network elements may include but are not limited to various types of base stations (such as next-generation base stations (generation node B, gNB), evolved base stations (evolved node B, eNB), centralized control units (central unit control panel, CU-CP) , centralized unit (central unit, CU), distributed unit (distributed unit, DU), centralized user plane unit (central unit user panel, CU-UP), etc.
  • base stations such as next-generation base stations (generation node B, gNB), evolved base stations (evolved node B, eNB), centralized control units (central unit control panel, CU-CP) , centralized unit (central unit, CU), distributed unit (distributed unit, DU), centralized user plane unit (central unit user panel, CU-UP), etc.
  • base stations such as next-generation base stations (generation node B, gNB), evolved base stations (evolved node B, eNB), centralized control units (central unit control panel, CU-CP) ,
  • the operation and maintenance operation link refers to the main production activities for operating and maintaining the communication network.
  • the operation and maintenance operation link defined by relevant protocols includes: network planning and design, network deployment, network monitoring and troubleshooting, service provisioning, network changes, network optimization (such as optimizing and adjusting parameters), etc.
  • the aforementioned operation and maintenance work links may refer to the main activities of the entire life cycle of operation and maintenance of a network in a certain technical domain and/or a network in a certain business domain. Or it can also be described as: the operation and maintenance operation link is for one or more network dimensions, and the network dimension can correspond to the technical domain or the business domain.
  • Figure 2 illustrates a division relationship between operation and maintenance work links based on the technical domain and the business domain.
  • the technical domain is the bearer network
  • the business domain is the government-enterprise dedicated line.
  • Network optimization This operation and maintenance link is specifically for network optimization of the bearer network of government and enterprise dedicated lines.
  • An operation and maintenance operation link corresponds to a workflow.
  • the workflow of an operation and maintenance operation link can be composed of one or more operation and maintenance tasks, or it can also be described as an operation and maintenance operation link can include one or more operation and maintenance tasks. Operation and maintenance tasks can be recorded as Tasks.
  • -Network maintenance In order to ensure that the network is in normal operation, the process of monitoring network status and other related information, analyzing and solving problems. For example, monitoring to detect faults, troubleshooting, etc.
  • -Network optimization In order to improve network performance or communication service experience, the process of monitoring and analyzing network performance indicators and other related information, and taking performance optimization measures such as adjusting network resources and parameter configurations.
  • the operation and maintenance operations corresponding to the network coverage optimization may include the following operation and maintenance tasks: control information generation, intent evaluation, data collection, problem identification (or anomaly identification), Deterioration prediction, problem delimitation, root cause analysis, optimization plan generation, optimization plan evaluation and decision-making, and optimization plan issuance.
  • control information generation mainly includes generating and determining policy control information related to network coverage optimization.
  • Intent evaluation (coverage optimization intent evaluation) mainly refers to evaluating whether network coverage optimization achieves the target intent. Intent refers to the expectations for the requirements, goals and constraints of a specific service or network management workflow.
  • Data collection (coverage related information collection) mainly includes collecting relevant data for network coverage optimization.
  • Coverage issues identification mainly includes analyzing the performance of network coverage and determining network coverage problems.
  • Deterioration prediction (coverage deterioration prediction) mainly includes analyzing current and historical network coverage performance, predicting future network coverage performance trends, and identifying potential network coverage performance deterioration problems in advance.
  • Coverage issues demarcation mainly includes analyzing network coverage issues and identifying the categories of network coverage issues.
  • Root cause analysis (coverage issue root cause analysis) mainly refers to analyzing and determining the root cause of network coverage problems.
  • Optimization solution generation (coverage adjustment solutions analysis) mainly includes generating solutions to network coverage problems, which can be used to deal with identified or predicted network coverage problems.
  • Optimization solution evaluation and decision-making (coverage adjustment solutions evaluation and determination) mainly includes the evaluation and determination of adjustment plans for network coverage problems.
  • Network autonomy level refers to the autonomous capability level of a network (autonomous network level).
  • autonomous network level the network autonomy level can be evaluated separately for each operation and maintenance operation link. It can be understood that one operation and maintenance operation link in the operation and maintenance network can be used as an evaluation object.
  • An operation and maintenance task (Task) in the operation and maintenance operation link can be used as the minimum evaluation granularity in the evaluation process of the operation and maintenance operation link.
  • the network autonomy level of an operation and maintenance operation link can be determined by one or more operation and maintenance tasks included in it. Determined by the ability of autonomy.
  • the state of human-machine division of labor is used to reflect the degree or proportion of participation in the completion of operation and maintenance tasks through manual methods and automatic system methods.
  • the status of human-machine division of labor can also be described as the execution mode of operation and maintenance tasks, which can be used to determine the network autonomy capabilities corresponding to operation and maintenance tasks. From a state completely completed manually to a state completely completed automatically by the system, various human-machine division of labor states can be divided.
  • the human-machine division of labor status may include:
  • Manual combined system (manual + system): Operation and maintenance tasks are performed jointly by people and the system, that is, manual methods are combined with automatic system methods.
  • the "manual + system” status can be further subdivided into:
  • Different states of human-machine division of labor correspond to different network autonomy capabilities. For example, if the human-machine division of labor status includes: manual, manual + system, and system, then according to the network autonomy capability from high to low, the three human-machine division of labor status are ordered as: system, manual + system, system.
  • an evaluation method for the autonomy level of the operation and maintenance network is provided, and the evaluation data of each operation and maintenance task can be defined among multiple devices/devices.
  • Inter-transmission makes the evaluation plan based on the evaluation data of each operation and maintenance task transparent, which can improve the reliability of the evaluation of the autonomy level of the operation and maintenance network.
  • FIG. 3 illustrates a method for evaluating the autonomy level of an operation and maintenance network provided by an embodiment of the present application. This method can be applied to the aforementioned operation and maintenance network, such as the operation and maintenance network illustrated in FIG. 1 .
  • this method mainly includes the following processes:
  • the first device obtains the evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link from the second device.
  • N is a positive integer.
  • the evaluation data of N operation and maintenance tasks are used to evaluate the network autonomy level of the first operation and maintenance operation link.
  • N can be the number of all operation and maintenance tasks included in the first operation and maintenance operation link, or N can also be the number of partial operation and maintenance tasks included in the first operation and maintenance operation link, and this part of the operation and maintenance tasks accounts for the total number of operation and maintenance tasks.
  • the proportion of dimension tasks is greater than the set threshold, such as 80%.
  • the first device can be understood as a device that evaluates the decision-making network autonomy level. It can be a device in the NMS or EMS in the operation and maintenance network as shown in Figure 1, or it can also be a device deployed separately in the operation and maintenance network with the decision-making network autonomy level. A device for evaluating functionality.
  • the second device may include an execution entity for processing N operation and maintenance tasks, and the number of the execution entities may be one or more.
  • the execution entity may be a device or network element entity with network element management functions in the operation and maintenance network.
  • an execution entity is a device in the EMS in the operation and maintenance network shown in Figure 1 , or it can also be understood that the second device includes one or more devices in the EMS.
  • one operation and maintenance task is processed by one execution entity, but one execution entity can process one or more operation and maintenance tasks.
  • the devices in the embodiments of the present application can also be described as systems, subsystems, devices, modules or units.
  • the first device can also be called the first system, the first subsystem, the first module, the first device, the first One unit, etc., the embodiments of this application are not limited to this.
  • the first device is not included in the second device.
  • the first device may send first information to the second device, where the first information is used to request evaluation data of N operation and maintenance tasks in the first operation and maintenance operation link.
  • the second device may send third information to the first device, where the third information is used to indicate the evaluation data of the N operation and maintenance tasks in the first operation and maintenance operation link.
  • evaluation data can be understood with reference to the following two examples.
  • the type of evaluation data can be configured in a predefined manner so that each device in the operation and maintenance network has a consistent understanding of the evaluation data.
  • the evaluation data of the operation and maintenance task may include the identification of the operation and maintenance task, the operation and maintenance task One or more of the execution mode of the maintenance task, or the human-machine division of labor status of the operation and maintenance task, and the execution effect of the operation and maintenance task.
  • the identifier of an operation and maintenance task is used to indicate the information of the operation and maintenance task.
  • the second device may indicate one or more of the following data in the third information according to the type of the predefined evaluation data: the processing of the N operation and maintenance tasks has been completed, and the N operation and maintenance tasks have been completed.
  • the first device may indicate in the first information the type of evaluation data for the N operation and maintenance tasks requested by it (the type can also be described as definition instead), for example, among the N operation and maintenance tasks requested by the first information
  • the evaluation data of any operation and maintenance task includes one or more of the following data: the information of any operation and maintenance task, the execution mode of any operation and maintenance task, and the execution effect of any operation and maintenance task; or, It can also be described as: the evaluation data of the i-th operation and maintenance task among the N operation and maintenance tasks requested by the first information includes one or more of the following data: the information of the i-th operation and maintenance task, the i-th operation and maintenance task
  • I takes an integer from 1 to N.
  • the data included in different operation and maintenance tasks in N operations and maintenance can be the same or different.
  • the second device can determine which data the evaluation data required by the first device specifically includes.
  • the indication in the first information may be expressed as: the first information may include a task set list, and the task set list includes information of N operation and maintenance tasks, such as identification of N operation and maintenance tasks.
  • the first information may also include the type of evaluation data, such as the execution mode of the operation and maintenance task, the execution effect of the operation and maintenance task, etc.
  • the first device may also indicate the candidate mode of the execution mode in the first information, that is, provide a selection range of the execution mode.
  • the first device may include first indication information in the first information, where the first indication information is used to indicate a candidate mode of the execution mode.
  • the candidate modes corresponding to the execution mode include: manual execution mode (corresponding to the aforementioned human-machine division of labor state is manual), manual and system joint execution mode (corresponding to the human-machine division of labor state is manual combined system), and system execution mode ( The corresponding human-machine division of labor state is system).
  • the first device can also indicate the subdivision range of the manual integration system in the first information. This design can refer to the aforementioned terminology introduction to the state of human-machine division of labor, which will not be described again in the embodiment of the present application. .
  • the first device may also indicate in the first information index information used to measure the execution effect.
  • the indicator information is related to the operation and maintenance tasks, and the indicator information corresponding to different operation and maintenance tasks is different.
  • the indicator information of the execution effect of problem delimitation, problem identification, and root cause analysis can include accuracy rate, autonomy ratio; the execution effect of degradation prediction.
  • Indicator information can include false alarm rate (false alarm ratio), missing alarm rate (missing alarm ratio), self-intelligence rate, etc.
  • the self-intelligence rate is used to indicate the proportion of operation and maintenance tasks automatically completed by the system.
  • the self-intelligence rate of root cause analysis can indicate the number of cells that have completed root cause analysis by the system as a percentage of the number of cells that have undergone root cause analysis. Proportion of the total number of communities.
  • the third information is used to indicate one or more of the following data: processing of the N operation and maintenance tasks has been completed, and the N operation and maintenance tasks have been completed.
  • the execution mode of the task the execution effect of some or all of the N operation and maintenance tasks.
  • the type of evaluation data indicated in the third information includes the type of evaluation data indicated in the first information.
  • the first device is a device in the NMS
  • the second device includes one or more devices in the EMS.
  • the first device may send the first information to the second device through a signaling.
  • each device in the multiple devices is used to process part of the N operation and maintenance tasks.
  • the first device may send the first information to one of the plurality of devices through one signaling.
  • This one device is recorded as a fourth device, and the fourth device can determine the execution entity corresponding to each of the N operation and maintenance tasks based on the first information.
  • the fourth device may request evaluation data of part of the operation and maintenance tasks processed by the fourth device from other execution entities other than itself.
  • the fourth device can send fourth information to the fifth device, and the fourth information is used to request evaluation data of the N1 operation and maintenance tasks. .
  • the fourth information may include part of the content of the first information.
  • the first information includes a task set list.
  • the task set list includes information about N operation and maintenance tasks
  • the fourth information may include the task set list.
  • Part of the content that is, the information of N1 operation and maintenance tasks.
  • Case two the first device is a device in the EMS, the second device includes one or more devices in the EMS, and the first device is not included in the second device.
  • the first device may send the first information to the second device through a signaling.
  • each device in the multiple devices is used to process N operation and maintenance tasks. Some operation and maintenance tasks.
  • the first device may send the first information to one of the plurality of devices through one signaling. This one device is recorded as a fourth device, and the fourth device can determine the execution entity corresponding to each of the N operation and maintenance tasks based on the first information.
  • the fourth device may request evaluation data of part of the operation and maintenance tasks it handles from other execution entities other than itself; or,
  • the first device may send the first information to multiple devices through multiple signalings.
  • multiple signalings correspond to multiple devices one-to-one, and the first device can send the signaling corresponding to the one device to one of the multiple devices, and the signaling corresponding to the one device is used to request the one device.
  • Evaluation data of part of the operation and maintenance tasks that each device can handle.
  • the first device may indicate the type of evaluation data of the corresponding part of the operation and maintenance tasks in the signaling corresponding to the one device.
  • the second device When the second device includes a device in the EMS, the second device sends the third information to the first device through a signaling.
  • the third information may be composed of multiple signalings, and the multiple signalings correspond to the multiple devices one-to-one.
  • One device among the plurality of devices sends signaling corresponding to the device to the first device, where the signaling corresponding to the device is used to indicate evaluation data of part of the operation and maintenance tasks processed by the device.
  • the first device determines the third information based on the multiple received signalings.
  • the fifth device sends fifth information to the first device, and the fifth information is used to instruct N1 operation and maintenance tasks. Assessment data for the task.
  • the fifth information can also be described as signaling corresponding to the fifth device.
  • the fifth information may include part of the third information.
  • the fifth information is used to indicate one or more of the following: the processing of the N1 operation and maintenance tasks has been completed, and the N1 The execution mode of the operation and maintenance tasks, and the execution effect of the N1 operation and maintenance tasks.
  • the second device includes multiple devices in the EMS, and the first device is included in the second device.
  • the first device may determine the evaluation data of part of the operation and maintenance tasks that it can handle, and the first device may request evaluation data of the corresponding operation and maintenance tasks from other devices in the second device except the first device.
  • the first device requests and obtains the evaluation data corresponding to the operation and maintenance task from other devices. This can be implemented by referring to the manner in which the fourth device can request evaluation data from other execution entities except itself in the aforementioned case 1.
  • the embodiments of this application apply This will not be described again.
  • the first device can actively obtain the evaluation data of N operation and maintenance tasks from the second device.
  • the first device may obtain the evaluation data of N operation and maintenance tasks from the second device under the trigger of the third device.
  • Figure 3 also illustrates an optional step S300 before S301: the third device sends second information to the first device, and the second information is used to request evaluation of the network autonomy level of the first operation and maintenance operation link.
  • the third device may indicate the evaluation data it needs in the second information.
  • the second information includes second indication information, and the second indication information is used to instruct the evaluation of network autonomy in the first operation and maintenance link. Assessment data required for grade.
  • the evaluation data indicated by the second indication information may include one or more of the following: information indicating the N operation and maintenance tasks, the execution mode of the N operation and maintenance tasks, the N The execution effect of each operation and maintenance task.
  • the third device may also include the aforementioned first indication information, the subdivision range of the manual combination system, etc. in the second information.
  • the first device when the first device is a device in the NMS, you can implement: the first device actively obtains the evaluation data of N operation and maintenance tasks from the second device; when the first device is a device in the EMS When, it can be executed: the first device obtains the evaluation data of N operation and maintenance tasks from the second device under the trigger of the third device.
  • the third device can provide a communication interface for the user, and can provide data related to the operation and maintenance network to the user.
  • the third device can be a device in the NMS in the operation and maintenance network shown in Figure 1, or a third-party evaluation system outside the operation and maintenance network.
  • the first device may provide the evaluation data or evaluation results of the N operation and maintenance tasks to users other than the operation and maintenance network provider through the third device.
  • the above method also includes S302A or S302B to S303.
  • S302A when the first device is a device in the NMS, perform S302A; when the first device is a device in the EMS, perform S302B and S303.
  • the first device determines the network autonomy level of the first operation and maintenance operation link based on the evaluation data of the N operation and maintenance tasks.
  • the network autonomy level of the first operation and maintenance operation link belongs to the evaluation result of the first operation and maintenance operation link by the first device.
  • the evaluation result may also include other contents, which is not limited by the embodiments of the present application.
  • the first device can determine the automation level of each of the N operation and maintenance tasks according to the execution mode of the N operation and maintenance tasks; and then use a weighted average algorithm to determine the automation level of each operation and maintenance task according to the execution mode of the N operation and maintenance tasks.
  • Ti is the automation capability of the i-th operation and maintenance task among N operation and maintenance tasks.
  • the automation capability of an operation and maintenance task can be determined by the execution mode and/or execution effect of the operation and maintenance task.
  • the execution effect is used to indicate the results or performance of the operation and maintenance task.
  • the execution effect of the root cause analysis can be the accuracy of the root cause analysis.
  • w i is the weight corresponding to the i-th operation and maintenance task.
  • w i can be preconfigured or calculated based on a specific algorithm.
  • the first device may determine the network autonomy level of the first operation and maintenance step according to the type of the first operation and maintenance step and the execution mode of the N operation and maintenance tasks.
  • the first operation and maintenance operation link may include operation and maintenance tasks (Task) A to J, and the human-machine division of labor mode (i.e. execution mode) of each operation and maintenance task.
  • the network autonomy level of "network coverage optimization” can be one level from level 1 to level 5.
  • the human-machine division of labor modes corresponding to Tasks A to J in different levels are not exactly the same.
  • the network autonomy level of "network coverage optimization” can be determined by the human-machine division of labor mode of operation and maintenance tasks A to J. For example, when the first device determines that the obtained human-machine division of labor status of operation and maintenance tasks A to J conforms to Table 1 When the human-machine division of labor status of operation and maintenance tasks A to J in the column of level 1 is shown, it can be determined that the network autonomy level of the operation and maintenance operation link of "network coverage optimization" is level 1.
  • S302B The first device sends the evaluation data of the N operation and maintenance tasks to the third device.
  • the third device determines the network autonomy level of the first operation and maintenance link based on the evaluation data of N operation and maintenance tasks.
  • this step can be implemented with reference to S302A, which will not be described again in the embodiments of this application.
  • the device for deployment decision-making and evaluation communicates with the device for processing operation and maintenance tasks, collects evaluation data of multiple operation and maintenance tasks, and then determines the network for the operation and maintenance operation link based on the evaluation data of multiple operation and maintenance tasks.
  • the level of autonomy can realize objective and transparent evaluation plans and improve the reliability of evaluation results.
  • FIG 4 illustrates an operation and maintenance network architecture.
  • the NMS system in the operation and maintenance network includes consumers of intent-driven management function (IDMF). )system.
  • the EMS system in the operation and maintenance network includes an IDMF producer device and a management function (MnF) device that interacts with the IDMF device.
  • MnF devices include data collection coordination function (DCCF) devices, management data analytics function (MDAF) devices, etc.
  • IDMF consumer system IDMF producer device, DCCF device and MDAF device
  • IDMF consumer IDMF producer, DCCF and MDAF respectively.
  • IDMF producer DCCF
  • MDAF device MDAF device
  • IDMF consumer can receive user instructions and is responsible for issuing intentions or intention requests to IDMF.
  • IDMF consumer Network coverage optimization creation intent and network coverage optimization hierarchical evaluation intent can be issued to IDMF.
  • IDMF consumer can also be used for decision-making evaluation, such as summarizing the evaluation data of various operation and maintenance tasks in network coverage optimization to determine whether an operation and maintenance task is executed and the corresponding execution mode.
  • a network autonomy level evaluation (EVA) device can be deployed in the IDMF consumer, and the EVA performs decision-making evaluation.
  • EVA network autonomy level evaluation
  • the intent translation module is responsible for translating the network coverage optimization intent and network coverage optimization hierarchical evaluation intent issued by the IDMF consumer into a series of strategies, such as data collection strategies, root cause analysis strategies, etc.
  • the intent control function is responsible for sending control instructions to the MnF that interacts with the IDMF (such as sending data collection instructions to the DCCF).
  • the intent analysis and decision-making function is responsible for analysis and decision-making based on policies and data, such as root cause analysis and coverage of optimization plan decisions.
  • Intent analysis and decision-making functions can be deployed within IDMF or completed by calling MDAF.
  • IDMF producer can also be referred to as IDMF.
  • -DCCF Responsible for data collection and coordination functions, such as collecting performance data and alarm data.
  • -MDAF Responsible for completing analysis tasks based on collected data, such as problem identification, root cause analysis, solution generation, etc.
  • the IDMF consumer can be understood as an example of the first device; or when the IDMF consumer deploys EVA, the EVA can be understood as an example of the first device.
  • IDMF producer, DCCF, and MDAF are all examples of the aforementioned second device, or can be described as the second device including IDMF producer, DCCF, and MDAF.
  • IDMF consumer obtains the evaluation data of N operation and maintenance tasks in network coverage optimization from IDMF producer, DCCF and MDAF, and then IDMF consumer determines the network based on the evaluation data of N operation and maintenance tasks in network coverage optimization. Coverage optimized levels of network autonomy.
  • the value of N is the number of all operation and maintenance tasks in network coverage optimization.
  • IDMF consumer sends the first information to a device among IDMF producer, DCCF and MDAF; the device that receives the first information then sends signaling to other execution entities to request the evaluation data of the corresponding part of the operation and maintenance tasks; then IDMF producer, DCCF And MDAF sends signaling to IDMF consumer to indicate the evaluation data of the corresponding part of the operation and maintenance tasks.
  • IDMF consumer can obtain the third information based on the signaling from IDMF producer, DCCF and MDAF to IDMF. The third information is used to indicate the evaluation data of N operation and maintenance tasks in network coverage optimization.
  • Figure 5 illustrates an evaluation method for network coverage optimization.
  • This method is an example of the method illustrated in Figure 3 and can be applied to the operation and maintenance network illustrated in Figure 4.
  • the method mainly includes the following steps:
  • IDMF consumer sends the first information to IDMF producer.
  • this step corresponds to the solution described in case 1 in S301, IDMF consumer corresponds to the first device, and IDMF producer corresponds to the fourth device.
  • IDMF consumer corresponds to the first device
  • IDMF producer corresponds to the fourth device.
  • the first information here is used to request evaluation data of N operation and maintenance tasks in network coverage optimization.
  • the first information can also be described as network coverage optimization hierarchical evaluation intention.
  • the IDMF consumer when configured with EVA, the IDMF consumer can send the first information to the IDMF producer through EVA.
  • the first information may include a coverage optimization evaluation instruction.
  • the coverage optimization evaluation instruction is used to indicate the evaluation data required to evaluate the operation and maintenance operation link of network coverage optimization; alternatively, it may also be understood as coverage optimization evaluation. Indicates evaluation data for N operation and maintenance tasks indicating the first information request.
  • the coverage optimization evaluation instruction may include a task (Task) set list indicating network coverage optimization to indicate that evaluation data for each operation and maintenance task in the Task set list is required.
  • the Task collection list includes the identification of N operation and maintenance tasks in network coverage optimization.
  • the N operation and maintenance tasks include intention translation, control information generation, intention evaluation, data collection, problem identification (or anomaly identification), degradation prediction, and problem determination. boundary, root cause analysis, optimization plan generation, optimization plan evaluation and decision-making, and optimization plan issuance.
  • the coverage optimization evaluation instruction may also include an identifier of the Task execution mode (or Task human-machine division of labor status) to indicate that the evaluation data required for each operation and maintenance task includes the execution mode of the operation and maintenance task.
  • the coverage optimization evaluation indication may also include first indication information, that is, the candidate mode of the Task execution mode.
  • IDMF consumer sends network coverage optimization creation intention to IDMF producer.
  • the network coverage optimization creation intent is used to request the creation of the network coverage optimization operation and maintenance operation link.
  • the network coverage optimization creation intention includes instructions for network coverage optimization strategies, such as indicating coverage optimization areas, coverage optimization goals, etc.
  • the IDMF producer performs intent translation on the network coverage optimization creation intention and the first information, generates relevant strategies for network coverage optimization, and establishes a correspondence between network coverage optimization operation and maintenance tasks and execution entities.
  • related strategies for network coverage optimization may include: coverage optimization data collection rules, coverage optimization problem identification strategies, coverage optimization root cause analysis strategies, and calculation formulas for achieving intended goals, etc.
  • establishing a correspondence between network coverage optimization operation and maintenance tasks and execution entities may include: data collection operation and maintenance tasks correspond to DCCF, problem identification operation and maintenance tasks correspond to MDAF, root cause analysis operation and maintenance tasks correspond to MDAF, etc.
  • IDMF producer sends evaluation data intended for translation to IDMF consumer.
  • the evaluation data of intent translation may include intent translation completion notification, intent translation execution mode, etc.
  • IDMF can determine the execution mode of intention translation or the state of human-machine division of labor based on whether there is manual intervention during the intention translation process.
  • the state of human-machine division of labor as an example, the state of human-machine division of labor when there is human intervention is a human-machine combined system.
  • the human-machine division of labor state without manual intervention is a system.
  • the IDMF producer specifically sends evaluation data intended for translation to EVA.
  • the IDMF producer can be understood as an example of the fourth device.
  • the IDMF producer can request some of the operation and maintenance tasks it handles from other execution entities (i.e., devices in the EMS) other than itself. evaluation data. Specifically, it can be understood with reference to the following steps S505 to S514:
  • IDMF producer sends a data collection request message to DCCF.
  • the data collection request message may be used to request evaluation data for the operation and maintenance task of data collection.
  • the data collection request message includes part of the first information, such as a Task list with only data collection identifiers and an identifier of the Task execution mode (or Task human-machine division of labor status).
  • this section may also describe hierarchical assessment instructions for data collection.
  • the data collection request message may also include policy instructions for data collection operation and maintenance tasks, such as indicating monitoring areas, monitoring objects, and monitoring targets.
  • the monitoring target can be understood as the target data type of data collection, including one or more of the following data: performance data (such as performance strategy, minimization of drive tests (MDT) data), alarm data, Community configuration data, inventory data (such as equipment information, engineering parameters, etc.), and environmental data (such as electronic maps, etc.).
  • DCCF collects data from relevant network elements according to the data collection request message.
  • DCCF feeds back the collected data to the IDMF producer.
  • DCCF feeds back the collected performance data, configuration data, etc. to the IDMF producer.
  • DCCF can also request external data that cannot be obtained from relevant network elements.
  • the above method also includes S508 to S509.
  • S508 to S509 are optional steps, which are illustrated by dotted lines in Figure 5 .
  • DCCF sends an external data import request message to the IDMF consumer.
  • the message may include a list of data requested for external import, such as stock data, environment data, etc.
  • IDMF consumer sends the externally imported data list to IDMF producer.
  • DCCF sends the data collection evaluation data to the IDMF consumer.
  • the evaluation data of data collection may include: data collection completion notification and data collection Task human-machine division status. It can be understood that if there is a process of DCCF requesting external data import in S508, the human-machine division of labor status of data collection is a manual combined system. If there is no process of DCCF requesting external import of data in S508, the human-machine division of labor status of data collection It is an artificial combined system.
  • DCCF specifically sends the evaluation data of data collection to EVA.
  • evaluation data of the data collection includes evaluation data of the operation and maintenance tasks processed by the DCCF among the N operation and maintenance tasks of network coverage optimization indicated by the third information.
  • IDMF producer sends a network coverage optimization request message to MDAF.
  • the network coverage optimization request message can be used to request evaluation data for some operation and maintenance tasks handled by MDAF in network coverage optimization.
  • the network coverage optimization request message includes part of the content in the first information.
  • the network coverage optimization request message includes a Task list.
  • the Task list includes part of the task set list in the first information.
  • the Task list includes MDAF.
  • the identification of part of the operation and maintenance tasks being processed; the network coverage optimization request message also includes the identification of the Task execution mode (or Task human-machine division of labor status).
  • some of the operation and maintenance tasks handled by MDAF include problem identification, problem delimitation, deterioration prediction, root cause analysis, and solution generation.
  • part of the content in the first information may also be described as hierarchical evaluation instructions for part of the operation and maintenance tasks processed by MDAF.
  • the network coverage optimization request message contains instructions for network coverage optimization related strategies.
  • MDAF processes multiple operation and maintenance tasks of network coverage optimization according to the network coverage optimization request message.
  • MDAF can complete multiple operation and maintenance tasks involved in S511 independently or with the assistance of IDMF consumer, such as problem identification, problem delimitation, degradation prediction, root cause analysis, and solution generation.
  • MDAF can send the evaluation data of multiple operation and maintenance tasks processed by it to the IDMF consumer, including the following steps S513 and S514, that is, the evaluation data of multiple operation and maintenance tasks processed by MDAF includes the execution mode and execution mode of multiple operation and maintenance tasks. Execution effect. It can be understood that the evaluation data of the multiple operation and maintenance tasks include evaluation data of the operation and maintenance tasks processed by MDAF among the N operation and maintenance tasks of network coverage optimization indicated by the third information.
  • MDAF sends the execution modes of multiple operation and maintenance tasks to the IDMF consumer.
  • the evaluation data of the problem identification can include the problem identification completion notification and the human-machine division status of the task identification (such as the system).
  • MDAF specifically sends the execution modes of multiple operation and maintenance tasks to EVA.
  • MDAF sends the execution results of multiple operation and maintenance tasks to the IDMF consumer.
  • Some examples of implementation effects are provided below: such as problem identification results (weak coverage), problem delimitation (cells with weak coverage), root cause analysis results (unreasonable power settings), solution generation results (providing antenna power to the set value ).
  • S514 is illustrated by a dotted line in Figure 6 .
  • EVA is configured in the IDMF consumer
  • MDAF specifically sends the execution results of multiple operation and maintenance tasks to EVA.
  • IDMF producer evaluates and makes decisions on optimization solutions.
  • the IDMF producer can complete the evaluation and decision-making of the optimization plan independently or with the assistance of the IDMF consumer, such as analyzing the coverage optimization effect of the optimization plan, conflicts with other intentions, etc.
  • IDMF producer sends evaluation data of optimization plan evaluation and decision-making to IDMF consumer.
  • the evaluation data of the optimization plan evaluation and decision-making can include: the completion notification of the optimization plan evaluation and decision-making and the task human-machine division status of the optimization plan evaluation and decision-making (for example, system when there is no manual intervention, or manual when there is manual intervention). combined system). It can be understood that the evaluation data of the optimization plan evaluation and decision-making include the evaluation data of the operation and maintenance tasks processed by the IDMF producer among the N operation and maintenance tasks of network coverage optimization indicated by the third information.
  • the IDMF producer specifically sends evaluation data for optimization plan evaluation and decision-making to EVA.
  • IDMF producer delivers the optimization plan to relevant network elements.
  • the IDMF producer can indicate to relevant network elements the network element list corresponding to the optimization plan and the operation list of the optimization plan.
  • IDMF producer sends the evaluation data issued by the optimization plan to IDMF consumer.
  • the evaluation data issued by the optimization plan includes the completion notice issued by the optimization plan, and the human-machine division status of the Task issued by the optimization plan (for example, the system when there is no manual intervention, or the manual combined system when there is manual intervention).
  • IDMF producer performs intent evaluation.
  • the IDMF producer can determine whether the network coverage optimization hierarchical evaluation intention is achieved through intention evaluation.
  • Intent evaluation can also be described as intention achievement evaluation.
  • the IDMF producer can complete the intention achievement evaluation independently or with the assistance of the IDMF consumer, such as evaluating whether the intention is achieved, the specific circumstances of the intention completion, etc.
  • IDMF producer sends the evaluation data of intent evaluation to IDMF consumer.
  • the evaluation data of intention evaluation includes the completion notification issued by the optimization plan, and the task human-machine division status of the intention evaluation.
  • the IDMF producer specifically sends the evaluation data of the intent evaluation to EVA.
  • the evaluation data of the intention evaluation includes the evaluation data of the operation and maintenance tasks processed by the IDMF producer among the N operation and maintenance tasks of network coverage optimization indicated by the third information.
  • IDMF producer feeds back the result of intent evaluation to IDMF consumer.
  • the results of the intention evaluation can be used to indicate the specific situation of the completion of the intention.
  • the result of the intent evaluation can also be used as evaluation data to evaluate the network autonomy level for network coverage optimization.
  • the content indicated by the third information in Example 1 includes S504, S510, S513, S514, S516, S518, S520 and S521. Involved assessment data.
  • the IDMF consumer determines the network autonomy level of the network coverage optimization based on the received evaluation data of each operation and maintenance task in the network coverage optimization.
  • this step corresponds to what is described in S302A: the first device determines the network autonomy level of the first operation and maintenance link based on the evaluation data of N operation and maintenance tasks in the first operation and maintenance link.
  • This step S522 can be implemented with reference to the solution for determining the network autonomy level in the first operation and maintenance link described in S302A, which will not be described again in the embodiment of this application.
  • EVA when EVA is configured in the IDMF consumer, EVA can determine the network autonomy level for network coverage optimization. Enter However, EVA stores the network autonomy level for network coverage optimization in the IDMF consumer.
  • the IDMF consumer collects the evaluation data of each task to support external manufacturers to evaluate the network autonomy level of the operation and maintenance network, which can enhance the transparency, fairness and reliability of the hierarchical evaluation.
  • Figure 6 shows an operation and maintenance network architecture.
  • the NMS of the operation and maintenance network includes a third-party evaluation system.
  • the third-party evaluation system has network management functions and can Used to evaluate the network autonomy level in operation and maintenance operations.
  • the EMS in the operation and maintenance network includes some functional devices with network element management functions, such as exposure governance function (EGMF) devices, IDMF producer devices, and MnF devices that interact with EGMF devices and IDMF producer devices.
  • EGMF exposure governance function
  • IDMF producer devices IDMF producer devices
  • MnF devices that interact with EGMF devices and IDMF producer devices.
  • MnF devices include DCCF devices, MDAF devices, etc.
  • the EGMF device, IDMF producer device, DCCF device and MDAF device can be abbreviated as EGMF, IDMF producer, DCCF and MDAF respectively.
  • EGMF can be responsible for opening MnF's data or services to third parties for use, such as sending MnF's evaluation data to a third-party evaluation system.
  • EGMF can be understood as an example of the aforementioned first device
  • IDMF producer, DCCF, and MDAF are examples of the aforementioned second device, that is, the second device includes IDMF producer, DCCF, and MDAF.
  • the third-party evaluation system can be understood as an example of the aforementioned third device, or the devices in the third-party evaluation system can be understood as an example of the third device.
  • EGMF obtains the evaluation data of N operation and maintenance tasks in network coverage optimization from IDMF producer, DCCF and MDAF.
  • EGMF sends the obtained evaluation data of the N operation and maintenance tasks to the third-party evaluation system, and then The third-party evaluation system determines the network autonomy level of network coverage optimization based on the evaluation data of N operation and maintenance tasks in network coverage optimization.
  • the value of N is the number of all operation and maintenance tasks in network coverage optimization.
  • EGMF can be understood as a device in EMS.
  • EGMF can specifically send the first information to a device among the IDMF producer, DCCF and MDAF; the device that receives the first information then sends a signaling request to the remaining execution entities to request the corresponding part of the operation and maintenance tasks.
  • the evaluation data; then IDMF producer, DCCF and MDAF send signaling to EGMF to indicate the evaluation data of the corresponding part of the operation and maintenance tasks.
  • EGMF can obtain the third information based on the signaling sent from IDMF producer, DCCF and MDAF.
  • the third information is used to indicate the evaluation data of N operation and maintenance tasks in network coverage optimization. Further, EGMF sends the evaluation data of N operation and maintenance tasks in network coverage optimization to the third-party evaluation system.
  • Figure 7 illustrates an evaluation method for network coverage optimization.
  • This method is an example of the method illustrated in Figure 3 and can be applied to the operation and maintenance network illustrated in Figure 6 .
  • the method mainly includes the following steps:
  • the third-party evaluation system sends second information to EGMF.
  • this step corresponds to S300 in Figure 3, and the second information is used to request an evaluation of the network autonomy level for network coverage optimization.
  • the second information may also replace a data opening request described as a hierarchical assessment of network coverage optimization.
  • the second information may include first information, and the first information is used to request evaluation data of N operation and maintenance tasks for network coverage optimization.
  • the first information may include a coverage optimization evaluation instruction.
  • the coverage optimization evaluation instruction is used to indicate the evaluation data required to evaluate the operation and maintenance operation link of network coverage optimization; alternatively, it may also be understood as a coverage optimization evaluation instruction. Evaluation data used to indicate the N operation and maintenance tasks of the first information request.
  • the coverage optimization evaluation indication may include information indicating operation and maintenance tasks of network coverage optimization, such as a Task set list, to indicate that evaluation data for each operation and maintenance task in the Task set list is required.
  • the Task collection list includes the identification of N operation and maintenance tasks in network coverage optimization: intent translation, control information generation, intent evaluation, data collection, problem identification (or anomaly identification), degradation prediction, problem delimitation, root cause analysis, optimization Plan generation, optimization plan evaluation and decision-making, and optimization plan issuance.
  • the coverage optimization evaluation instruction may also include an identifier of the Task execution mode (or Task human-machine division of labor status) to indicate that the evaluation data required for each operation and maintenance task includes the execution mode of the operation and maintenance task.
  • the coverage optimization evaluation indication may also include first indication information, that is, the candidate mode of the Task execution mode.
  • EGMF sends the network coverage optimization creation intention and first information to the IDMF producer.
  • the network coverage optimization hierarchical evaluation intention can be understood with reference to the description in S501.
  • the first information can also be described as the network coverage optimization creation intention.
  • the definition of the first information can be understood with reference to the description in S701. The embodiment of the present application is This will not be described again.
  • the IDMF producer performs intent translation based on the network coverage optimization creation intention and the first information, generates relevant strategies for network coverage optimization, and establishes a correspondence between network coverage optimization operation and maintenance tasks and execution entities.
  • this step can be performed with reference to S503, which will not be described again in the embodiment of this application.
  • IDMF producer sends evaluation data intended for translation to EGMF.
  • evaluation data intended to be translated can be understood with reference to the description of S504, which will not be described again in this embodiment of the present application.
  • the IDMF producer can be understood as an example of the fourth device.
  • the IDMF producer can request some of the operation and maintenance tasks it handles from other execution entities (i.e., devices in the EMS) other than itself. evaluation data. Specifically, it can be understood with reference to the following steps S705 to S720:
  • IDMF producer sends a data collection request message to DCCF.
  • the data collection request message can be understood with reference to the description of S505, which will not be described again in this embodiment of the present application.
  • DCCF collects data from relevant network elements according to the data collection request message.
  • DCCF feeds back the collected data to the IDMF producer.
  • DCCF feeds back the collected performance data, configuration data, etc. to the IDMF producer.
  • S708 is an optional step and is illustrated by a dotted line in Figure 7 .
  • the IDMF producer receives an externally imported data list input by an operator.
  • the externally imported data list includes stock data, environmental data, etc.
  • S708, as an optional step, is shown with a dotted line in Figure 7 .
  • DCCF can trigger a request for an externally imported data list.
  • DCCF sends the data collection evaluation data to EGMF.
  • IDMF producer sends a network coverage optimization request message to MDAF.
  • this step can be performed with reference to S511, which will not be described again in the embodiment of this application.
  • MDAF processes multiple operation and maintenance tasks of network coverage optimization according to the network coverage optimization request message.
  • MDAF can complete multiple operation and maintenance tasks independently or with the assistance of EGMF, such as problem identification, problem delimitation, degradation prediction, root cause analysis, and solution generation.
  • MDAF may send the evaluation data of multiple operation and maintenance tasks processed by MDAF to EGMF, including the following steps S712 and S713, that is, the evaluation data of multiple operation and maintenance tasks processed by MDAF includes the execution mode and execution of multiple operation and maintenance tasks. Effect. It can be understood that the evaluation data of the multiple operation and maintenance tasks include evaluation data of the operation and maintenance tasks processed by MDAF among the N operation and maintenance tasks of network coverage optimization indicated by the third information.
  • MDAF sends the execution modes of multiple operation and maintenance tasks to EGMF.
  • the evaluation data of the problem identification can include the problem identification completion notification and the human-machine division status of the task identification (such as the system).
  • MDAF sends the execution results of multiple operation and maintenance tasks to EGMF.
  • this step can be performed with reference to S514, which will not be described again in the embodiment of this application.
  • IDMF producer evaluates and makes decisions on optimization solutions.
  • IDMF producer can complete the evaluation and decision-making of the optimization plan independently or with the assistance of EGMF, such as analyzing the coverage optimization effect of the optimization plan, conflicts with other intentions, etc.
  • IDMF producer sends evaluation data of optimization plan evaluation and decision-making to EGMF.
  • the IDMF producer delivers the optimization plan to relevant network elements.
  • the IDMF producer can indicate to relevant network elements the network element list corresponding to the optimization plan and the operation list of the optimization plan.
  • IDMF producer sends the evaluation data issued by the optimization plan to EGMF.
  • IDMF producer performs intent evaluation.
  • this step can be performed with reference to S519, which will not be described again in the embodiment of this application.
  • IDMF producer sends the evaluation data of intent evaluation to EGMF.
  • IDMF producer feeds back the result of intent evaluation to EGMF.
  • the results of the intention evaluation can be used to indicate the specific situation of the completion of the intention.
  • the result of the intent evaluation can also be used as evaluation data to evaluate the network autonomy level for network coverage optimization.
  • the content indicated by the third information in Example 2 includes the content involved in S704, S709, S712, S715, S717, S719 and S720. Evaluate data.
  • S721 EGMF sends the received evaluation data of N operation and maintenance tasks in network coverage optimization to the third-party evaluation system.
  • the third-party evaluation system determines the network autonomy level of the operation and maintenance operation link of network coverage optimization based on the received evaluation data of each operation and maintenance task in network coverage optimization.
  • step S722 may be implemented with reference to the solution for determining the network autonomy level in the first operation and maintenance link described in S302A, which will not be described again in the embodiment of this application.
  • the third-party evaluation system is supported to collect the evaluation data of each operation and maintenance task through EGMF, and then the third-party evaluation system completes the evaluation of the network autonomy level of the operation and maintenance network. There is no need to expose the evaluation data to the IDMF consumer, which can protect Data security to avoid privacy leakage issues.
  • Figure 8 shows an operation and maintenance network architecture. Based on the operation and maintenance network shown in Figure 1, it further shows that NMS includes IDMF consumer, and EMS includes IDMF producer, DCCF and MDAF. Among them, the definitions of IDMF consumer, IDMF producer, DCCF and MDAF can be understood with reference to the description in Figure 4, which will not be described again in the embodiment of this application.
  • the operation and maintenance network illustrated in Figure 8 may also include EVA.
  • the difference from Figure 4 is that the EVA in Figure 8 is deployed in the IDMF producer.
  • the IDMF producer or the EVA in the IDMF producer can be responsible for summarizing the evaluation data of each operation and maintenance task in network coverage optimization, and determining whether an operation and maintenance task is executed and timely. The corresponding execution mode.
  • Example 3 the aforementioned first device may correspond to the IDMF producer or the EVA in the IDMF producer.
  • IDMF, DCCF, and MDAF are examples of the aforementioned second device, or may be described as the second device including IDMF, DCCF, MDAF, and the like. It can be understood that Example 3 corresponds to the situation described in S301 in which the first device is included in the second device.
  • IDMF consumer is an example of a third device.
  • the IDMF consumer can send the second information to the IDMF producer to request the evaluation of the network autonomy level for network coverage optimization.
  • IDMF producer obtains the evaluation data of N operation and maintenance tasks in network coverage optimization from IDMF producer itself, DCCF and MDAF, and then IDMF producer sends the obtained evaluation data of N operation and maintenance tasks to IDMF consumer.
  • IDMF consumer can determine the network autonomy level of network coverage optimization based on the evaluation data of N operation and maintenance tasks in network coverage optimization.
  • the value of N is the number of all operation and maintenance tasks in network coverage optimization.
  • the IDMF producer itself can handle some of the N operation and maintenance tasks.
  • the IDMF producer can send signaling to DCCF and MDAF to request evaluation data for some operation and maintenance tasks handled by DCCF and MDAF.
  • IDMF producer, DCCF and MDAF send signaling to EGMF to indicate the evaluation data of their corresponding parts of the operation and maintenance tasks.
  • IDMF consumer can obtain the third information based on the signaling sent from IDMF producer, DCCF and MDAF.
  • the third information The information is used to indicate the evaluation data of N operation and maintenance tasks in network coverage optimization.
  • Figure 9 illustrates an evaluation method for network coverage optimization.
  • This method is an example of the method illustrated in Figure 3 and can be applied to the operation and maintenance network illustrated in Figure 8 .
  • the method mainly includes the following steps:
  • IDMF consumer sends second information to IDMF producer.
  • this step corresponds to S300 in Figure 3, and the second information is used to request an evaluation of the network autonomy level for network coverage optimization.
  • the second information may also be described as network coverage optimization hierarchical evaluation intention.
  • the second information may include first information, and the first information is used to request evaluation data of N operation and maintenance tasks for network coverage optimization.
  • the first information may include a coverage optimization evaluation instruction, and the coverage optimization evaluation instruction is used to indicate the evaluation data required to evaluate the operation and maintenance operation link of network coverage optimization; or, it can also be understood that the coverage optimization evaluation instruction is used to indicate the third Evaluation data of N operation and maintenance tasks for an information request.
  • the coverage optimization evaluation indication may include information indicating operation and maintenance tasks of network coverage optimization, such as a Task set list, to indicate that evaluation data for each operation and maintenance task in the Task set list is required.
  • the Task collection list includes the identification of N operation and maintenance tasks in network coverage optimization: intent translation, control information generation, intent evaluation, data collection, problem identification (or anomaly identification), degradation prediction, problem delimitation, root cause analysis, optimization Plan generation, optimization plan evaluation and decision-making, and optimization plan issuance.
  • the coverage optimization evaluation instruction may also include an identifier of the Task execution mode (or Task human-machine division of labor status) to indicate that the evaluation data required for each operation and maintenance task includes the execution mode of the operation and maintenance task.
  • the coverage optimization evaluation indication may also include first indication information, that is, the candidate mode of the Task execution mode.
  • the IDMF consumer when the IDMF producer is configured with EVA, the IDMF consumer sends the second information to the EVA in the IDMF producer.
  • IDMF consumer sends network coverage optimization creation intention to IDMF producer.
  • S901 and S902 can be executed at the same time or in time-sharing, which is not limited in the embodiment of the present application.
  • the IDMF producer performs intent translation on the network coverage optimization creation intention and the second information, generates relevant strategies for network coverage optimization, and establishes a correspondence between network coverage optimization operation and maintenance tasks and execution entities.
  • this step can be performed with reference to S503, which will not be described again in the embodiment of this application.
  • IDMF producer determines the evaluation data intended for translation.
  • this step may be performed with reference to S504, which will not be described again in the embodiment of this application.
  • the IDMF producer can request, based on the first information in the second information, other execution entities other than itself (that is, devices in the EMS) for evaluation data of part of the operation and maintenance tasks it processes. Specifically, you can refer to the following steps to understand:
  • IDMF producer sends a data collection request message to DCCF.
  • this step can be performed with reference to S505, which will not be described again in the embodiment of this application.
  • DCCF collects data from relevant network elements according to the data collection request message.
  • DCCF feeds back the collected data to the IDMF producer.
  • DCCF feeds back the collected performance data, configuration data, etc. to the IDMF producer.
  • S908-S909 are optional steps, which are indicated by dotted lines in Figure 9.
  • DCCF sends an external data import request message to the IDMF consumer.
  • the message may include a list of data requested for external import, such as stock data, environment data, etc.
  • IDMF consumer sends the externally imported data list to IDMF producer.
  • DCCF sends the data collection evaluation data to the IDMF producer.
  • evaluation data of data collection can be understood with reference to S510, which will not be described again in the embodiment of this application.
  • DCCF specifically sends the evaluation data of data collection to EVA.
  • IDMF producer sends a network coverage optimization request message to MDAF.
  • this step can be performed with reference to S511, which will not be described again in the embodiment of this application.
  • MDAF processes multiple operation and maintenance tasks of network coverage optimization according to the network coverage optimization request message.
  • this step can be performed with reference to S512, which will not be described again in the embodiment of this application.
  • MDAF can send the evaluation data of multiple operation and maintenance tasks processed by it to the IDMF producer, including the following steps S913 and S914, that is, the evaluation data of multiple operation and maintenance tasks processed by MDAF includes the execution mode and execution mode of multiple operation and maintenance tasks. Execution effect. It can be understood that the evaluation data of the multiple operation and maintenance tasks include evaluation data of the operation and maintenance tasks processed by MDAF among the N operation and maintenance tasks of network coverage optimization indicated by the third information.
  • MDAF sends the execution modes of multiple operation and maintenance tasks to the IDMF producer.
  • the evaluation data of the problem identification can include the problem identification completion notification and the human-machine division status of the task identification (such as the system).
  • MDAF specifically sends the execution modes of multiple operation and maintenance tasks to EVA.
  • S914 MDAF sends the execution results of multiple operation and maintenance tasks to the IDMF producer.
  • Some examples of implementation effects are provided below: such as problem identification results (weak coverage), problem delimitation (cells with weak coverage), root cause analysis results (unreasonable power settings), solution generation results (providing antenna power to the set value ).
  • S914 is shown with a dotted line in Figure 10 .
  • IDMF producer evaluates and makes decisions on optimization solutions.
  • this step may be performed with reference to S515, which will not be described again in the embodiment of this application.
  • IDMF producer determines the evaluation data for optimization plan evaluation and decision-making.
  • this step may be performed with reference to S516, which will not be described again in the embodiment of this application.
  • the IDMF producer delivers the optimization plan to relevant network elements.
  • this step can be performed with reference to S517, which will not be described again in the embodiment of this application.
  • IDMF producer determines the evaluation data to be issued by the optimization plan.
  • evaluation data issued by the optimization plan can be understood with reference to S518, which will not be described again in the embodiment of this application.
  • IDMF producer performs intent evaluation.
  • this step can be performed with reference to S519, which will not be described again in the embodiment of this application.
  • IDMF producer determines the evaluation data for intent evaluation.
  • this step can be performed with reference to S520, which will not be described again in the embodiment of this application.
  • IDMF producer feeds back the result of intent evaluation to IDMF consumer.
  • the results of the intention evaluation can be used to indicate the specific situation of the completion of the intention.
  • the IDMF producer determines the network autonomy level of the operation and maintenance operation of network coverage optimization based on the evaluation data of each operation and maintenance task in network coverage optimization.
  • step S922 may be implemented with reference to the solution for determining the network autonomy level in the first operation and maintenance link described in S302A, which will not be described again in the embodiment of this application.
  • the IDMF producer sends the network autonomy level optimized for network coverage to the IDMF consumer.
  • the IDMF producer is supported to collect the evaluation data of each operation and maintenance task, and complete the evaluation of the network autonomy level of the operation and maintenance network. There is no need to expose the evaluation data to the IDMF consumer, which can protect data security and avoid privacy leakage issues. At the same time, it facilitates the operators or equipment vendors corresponding to the operation and maintenance network to conduct internal evaluation of the operation and maintenance network, and assists in the improvement and enhancement of the automation capabilities of the operation and maintenance network.
  • an embodiment of the present application provides an evaluation device 1000 for operation and maintenance network autonomy level.
  • the evaluation device 1000 for operation and maintenance network autonomy level includes a processing module 1001 and a communication module 1002 .
  • the evaluation device 1000 for the operation and maintenance network autonomy level may be a first device, may be applied to the first device or used in conjunction with the first device, and can realize the evaluation of the operation and maintenance network autonomy level of the communication method executed by the first device side.
  • the operation and maintenance network autonomy level evaluation device 1000 may be a second device, or may be an operation and maintenance network applied to or matched with the second device and capable of implementing the communication method executed by the second device side.
  • the operation and maintenance network autonomy level evaluation device 1000 may be a third device, or may be applied to or matched with a third device to implement a communication method executed by the third device side.
  • the evaluation device 1000 for the operation and maintenance network autonomy level; or the evaluation device 1000 for the operation and maintenance network autonomy level may be a fourth device, may be applied to the fourth device or used in conjunction with the fourth device, and can realize the fourth device side Implementation of means for evaluating the level of autonomy of the operation and maintenance network of communication methods.
  • the communication module may also be called a transceiver module, a transceiver, a transceiver, or a transceiver device, etc.
  • the processing module may also be called a processor, a processing board, a processing module, or a processing device.
  • the communication module is used to perform the sending operation and receiving operation on the first device side or the second device side in the above method.
  • the device used to implement the receiving function in the communication module can be regarded as a receiving unit, and the devices used in the communication module can be regarded as receiving units.
  • the device that implements the sending function is regarded as a sending unit, that is, the communication module includes a receiving unit and a sending unit.
  • the processing module 1001 can be used to implement the processing function of the first device in the example shown in Figure 3, and the communication module 1002 can be used to Implement the transceiver function of the first device in the example shown in Figure 3.
  • the apparatus for evaluating the autonomy level of the operation and maintenance network may be understood with reference to the third aspect of the invention and possible designs in the third aspect.
  • the processing module 1001 can be used to implement the processing function of the second device in the example described in Figure 3, and the communication module 1002 can be used to Implement the transceiver function of the second device in the example described in Figure 3.
  • the apparatus for evaluating the autonomy level of the operation and maintenance network may be understood with reference to the fourth aspect of the invention and possible designs in the fourth aspect.
  • the aforementioned communication module and/or processing module can be implemented through a virtual module.
  • the processing module can be implemented through a software functional unit or a virtual device, and the communication module can be implemented through a software function or a virtual device.
  • the processing module or the communication module can also be implemented by a physical device.
  • the communication module can be an input/output circuit and/or a communication interface to perform input operations (corresponding to the aforementioned receiving operations), Output operation (corresponding to the aforementioned sending operation); the processing module is an integrated processor or microprocessor or integrated circuit.
  • each functional module in each example of the embodiment of the present application may be integrated into one In the processor, it can exist physically alone, or two or more modules can be integrated into one module.
  • the above integrated modules can be implemented in the form of hardware or software function modules.
  • the embodiment of the present application also provides an evaluation device 1100 for operation and maintenance network autonomy level.
  • the The evaluation device 1100 for operating and maintaining network autonomy level may be a chip or a chip system.
  • the chip system may be composed of chips, or may include chips and other discrete devices.
  • the evaluation apparatus 1100 for operation and maintenance network autonomy level can be used to implement the functions of any network element in the communication system described in the foregoing examples.
  • the evaluation device 1100 for operating and maintaining the network autonomy level may include at least one processor 1110.
  • the processor 1110 is coupled to a memory.
  • the memory may be located within the device.
  • the memory may be integrated with the processor.
  • the memory may also be located in the device. outside the device.
  • the evaluation device 1100 for operating and maintaining network autonomy levels may further include at least one memory 1120 .
  • the memory 1120 stores the necessary computer programs, computer programs or instructions and/or data to implement any of the above examples; the processor 1110 may execute the computer program stored in the memory 1120 to complete the method in any of the above examples.
  • the evaluation device 1100 for operating and maintaining the network autonomy level may also include a communication interface 1130.
  • the evaluation device 1100 for operating and maintaining the network autonomy level may interact with other devices through the communication interface 1130.
  • the communication interface 1130 may be a transceiver, a circuit, a bus, a module, a pin, or other types of communication interfaces.
  • the communication interface 1130 in the evaluation device 1100 for the operation and maintenance network autonomy level can also be an input-output circuit, which can input information (or receive information). information) and output information (or send information)
  • the processor is an integrated processor or a microprocessor or an integrated circuit or a logic circuit, and the processor can determine the output information based on the input information.
  • the coupling in the embodiment of this application is an indirect coupling or communication connection between devices, units or modules, which may be in electrical, mechanical or other forms, and is used for information interaction between devices, units or modules.
  • the processor 1110 may cooperate with the memory 1120 and the communication interface 1130.
  • the specific connection medium between the processor 1110, the memory 1120 and the communication interface 1130 is not limited in the embodiment of the present application.
  • the processor 1110 , the memory 1120 and the communication interface 1130 are connected to each other through a bus 1140 .
  • the bus 1140 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc.
  • PCI peripheral component interconnect
  • EISA extended industry standard architecture
  • the bus can be divided into address bus, data bus, control bus, etc. For ease of presentation, only one thick line is used in Figure 11, but it does not mean that there is only one bus or one type of bus.
  • the processor may be a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, which may implement or Execute each method, step and logical block diagram disclosed in the embodiment of this application.
  • a general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the methods disclosed in conjunction with the embodiments of the present application can be directly implemented by a hardware processor for execution, or can be executed by a combination of hardware and software modules in the processor.
  • the memory may be a non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD), etc., or it may be a volatile memory (volatile memory), such as Random-access memory (RAM).
  • Memory is, but is not limited to, any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.
  • the memory in the embodiment of the present application can also be a circuit or any other device capable of realizing a storage function, used to store program instructions and/or data.
  • the evaluation device 1100 for operation and maintenance network autonomy level may be applied to the first device.
  • the evaluation device 1100 for operation and maintenance network autonomy level may be the first device, or may be capable of supporting the first device.
  • Device a device that implements the function of the first device in any of the above-mentioned examples.
  • the memory 1120 stores computer programs (or instructions) and/or data that implement the functions of the first device in any of the above examples.
  • the processor 1110 can execute the computer program stored in the memory 1120 to complete the method executed by the first device in any of the above examples.
  • the communication interface in the operation and maintenance network autonomy level evaluation device 1100 can be used to interact with the second device, send information to the second device or receive information from the second device.
  • the evaluation device 1100 for operation and maintenance network autonomy level may be applied to a second device.
  • the evaluation device 1100 for operation and maintenance network autonomy level may be the second device, or may be capable of supporting the second device.
  • Device a device that implements the function of the second device in any of the above-mentioned examples.
  • the memory 1120 stores computer programs (or instructions) and/or data that implement the functions of the second device in any of the above examples.
  • the processor 1110 can execute the computer program stored in the memory 1120 to complete the method executed by the second device in any of the above examples.
  • the communication interface in the operation and maintenance network autonomy level evaluation device 1100 may be used to interact with the first device, send information to the first device or receive information from the first device.
  • the evaluation device 1100 for operation and maintenance network autonomy level may be applied to a third device.
  • the evaluation device 1100 for operation and maintenance network autonomy level may be a third device, or may be capable of supporting a third device.
  • Device a device that implements the function of the third device in any of the above-mentioned examples.
  • the memory 1120 stores a computer program that implements the functions of the third device in any of the above examples. (or instructions) and/or data.
  • the processor 1110 can execute the computer program stored in the memory 1120 to complete the method executed by the third device in any of the above examples.
  • the communication interface in the operation and maintenance network autonomy level evaluation device 1100 may be used to interact with the first device, send information to the first device or receive information from the first device.
  • the evaluation device 1100 for operating and maintaining network autonomy level provided in this example can be applied to a first device to complete the method executed by the first device, or to a second device, to complete the method executed by the second device, or to a third device. Device, completes the method executed by the third device. Therefore, the technical effects that can be obtained can be referred to the above method examples and will not be described again here.
  • embodiments of the present application provide a communication system, including a first device, a second device, and a third device.
  • the first device, the second device and the third device can implement the method provided in the example shown in FIG. 3 .
  • the technical solutions provided by the embodiments of this application can be implemented in whole or in part through software, hardware, firmware, or any combination thereof.
  • software When implemented using software, it may be implemented in whole or in part in the form of a computer program product.
  • the computer program product includes one or more computer instructions.
  • the computer program instructions When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part.
  • the computer may be a general-purpose computer, a special-purpose computer, a computer network, a terminal device, an access network device, or other programmable devices.
  • the computer instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., the computer instructions may be transferred from a website, computer, server, or data center Transmission to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means.
  • the computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more available media integrated.
  • the available media may be magnetic media (eg, floppy disk, hard disk, tape), optical media (eg, digital video disc (digital video disc, DVD)), or semiconductor media, etc.
  • the examples may refer to each other, for example, the methods and/or terms between the method embodiments may refer to each other, for example, the functions and/or terms between the device embodiments may refer to each other.
  • Terms may refer to each other, for example, functions and/or terms between apparatus examples and method examples may refer to each other.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

La présente invention concerne le domaine technique des communications. L'invention concerne un procédé et un appareil d'évaluation d'un niveau autonome d'un réseau d'exploitation et de maintenance, et un système. Le procédé comprend les étapes suivantes : un premier appareil acquiert des données d'évaluation de N tâches d'exploitation et de maintenance dans une première liaison de tâche d'exploitation et de maintenance à partir d'un deuxième appareil, puis le premier appareil envoie les données d'évaluation des N tâches d'exploitation et de maintenance à un troisième appareil, de telle sorte que le troisième appareil peut déterminer un niveau de réseau autonome de la première liaison de tâche d'exploitation et de maintenance en fonction des données d'évaluation des N tâches d'exploitation et de maintenance ; ou le premier appareil détermine le niveau de réseau autonome de la première liaison de tâche d'exploitation et de maintenance en fonction des données d'évaluation des N tâches d'exploitation et de maintenance. Dans la présente invention, un niveau de réseau autonome d'une liaison de tâche d'exploitation et de maintenance est évalué sur la base de données d'évaluation d'une tâche d'exploitation et de maintenance, de telle sorte que la fiabilité d'un résultat d'évaluation peut être améliorée.
PCT/CN2023/117655 2022-09-08 2023-09-08 Procédé et appareil d'évaluation de niveau autonome de réseau d'exploitation et de maintenance, et système WO2024051805A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211098293.2 2022-09-08
CN202211098293.2A CN117714300A (zh) 2022-09-08 2022-09-08 一种运维网络自治等级的评估方法、装置及系统

Publications (1)

Publication Number Publication Date
WO2024051805A1 true WO2024051805A1 (fr) 2024-03-14

Family

ID=90159365

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/117655 WO2024051805A1 (fr) 2022-09-08 2023-09-08 Procédé et appareil d'évaluation de niveau autonome de réseau d'exploitation et de maintenance, et système

Country Status (2)

Country Link
CN (1) CN117714300A (fr)
WO (1) WO2024051805A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107317361A (zh) * 2017-08-18 2017-11-03 华北电力大学 一种考虑区域自治能力的主动配电网全局优化调度方法
CN110766301A (zh) * 2019-10-12 2020-02-07 南京理工大学 基于narx神经网络的交直流电网自治能力评估方法
CN112055364A (zh) * 2019-06-06 2020-12-08 华为技术有限公司 一种网络系统分级方法及装置
WO2022061900A1 (fr) * 2020-09-28 2022-03-31 华为技术有限公司 Procédé de détermination d'aptitude à l'autonomie en cas de panne et dispositif associé

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107317361A (zh) * 2017-08-18 2017-11-03 华北电力大学 一种考虑区域自治能力的主动配电网全局优化调度方法
CN112055364A (zh) * 2019-06-06 2020-12-08 华为技术有限公司 一种网络系统分级方法及装置
CN110766301A (zh) * 2019-10-12 2020-02-07 南京理工大学 基于narx神经网络的交直流电网自治能力评估方法
WO2022061900A1 (fr) * 2020-09-28 2022-03-31 华为技术有限公司 Procédé de détermination d'aptitude à l'autonomie en cas de panne et dispositif associé

Also Published As

Publication number Publication date
CN117714300A (zh) 2024-03-15

Similar Documents

Publication Publication Date Title
US11451452B2 (en) Model update method and apparatus, and system
US20210281492A1 (en) Determining context and actions for machine learning-detected network issues
CN113741282A (zh) 一种基于边缘计算的设备智能化管理系统及方法
US20200358653A1 (en) Method, apparatus and system for changing a network based on received network information
CN115174416A (zh) 一种网络规划系统、方法、装置及电子设备
US20230403223A1 (en) Data analysis apparatus management and control method and communication apparatus
WO2024051805A1 (fr) Procédé et appareil d'évaluation de niveau autonome de réseau d'exploitation et de maintenance, et système
US11556100B2 (en) Control method, related device, and system
WO2023045931A1 (fr) Procédé et appareil d'analyse d'anomalie de performance de réseau, et support d'enregistrement lisible
US20240155435A1 (en) Method for managing qos in a communications network using a machine learning
EP3457634B1 (fr) Collecte de données de performance de plan de gestion
WO2024078519A1 (fr) Procédé et appareil d'autonomie pour réseau autonome
CN113746656A (zh) 一种评估网络操作影响的方法、装置及设备
Tagami et al. Integration of Network and Artificial Intelligence toward the Beyond 5G/6G Networks
Sun et al. Research on 6G intelligent network architecture and key technologies for intelligent generation and autonomy
EP4120075A1 (fr) Dispositifs et procédés de traitement des événements associés au réseau
WO2021204075A1 (fr) Procédé et appareil de gestion d'automatisation de réseau
WO2024093561A1 (fr) Procédé et appareil d'apprentissage de modèle, procédé et appareil de test de modèle, et support de stockage
WO2023051329A1 (fr) Procédé et appareil de communication pour économie d'énergie de réseau
CN116739440B (zh) 自智网络的评价方法、装置、电子设备及存储介质
WO2023185467A1 (fr) Procédé et appareil d'évaluation de capacité d'autonomie de réseau, et support de stockage
WO2023240592A1 (fr) Appareil, procédés et programmes informatiques
EP3787330B1 (fr) Architecture de réseau pour améliorer la gestion de la qualité de service
WO2024065279A1 (fr) Procédé de commande de communication basé sur une prédiction d'intention d'utilisateur et appareil de communication
Ngo et al. RAN Intelligent Controller (RIC): From open-source implementation to real-world validation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23862499

Country of ref document: EP

Kind code of ref document: A1