CN116133028A

CN116133028A - Method and device for executing intention and storage medium

Info

Publication number: CN116133028A
Application number: CN202111348271.2A
Authority: CN
Inventors: 邓灵莉; 张佳辰
Original assignee: China Mobile Communications Group Co Ltd; China Mobile Communications Ltd Research Institute
Current assignee: China Mobile Communications Group Co Ltd; China Mobile Communications Ltd Research Institute
Priority date: 2021-11-15
Filing date: 2021-11-15
Publication date: 2023-05-16

Abstract

The invention discloses an intention execution method, a device and a storage medium, comprising the following steps: the intention creator sends a first original intention strategy; identifying the first original intention strategy, matching with the existing strategy, and sending a corresponding first original application strategy; executing the first original application strategy. By adopting the method and the device, the intention of the induced intention creator is considered in the execution process of the strategy, so that the intention is also included in the execution of the strategy, and the strategy can be executed according to the needs of a designer in the execution process of the strategy.

Description

Method and device for executing intention and storage medium

Technical Field

The present invention relates to the field of communications technologies, and in particular, to an intent execution method, apparatus, and storage medium.

Background

The 5G (fifth Generation mobile communication technology) age has come, and in the 5G age, the object of mobile network services is no longer a mere mobile phone, but various types of devices such as a mobile phone, a tablet, a fixed sensor, a vehicle, and the like. Application scenarios are also diversified, such as mobile broadband, large-scale internet, mission critical internet, etc. The requirements that need to be met are also diversified, such as mobility, security, latency, reliability, etc. Because different application scenes have different demands in the aspects of network functions, system performance, safety, user experience and the like, if the same network is used for providing services, the network is quite complex and heavy, the limit performance requirements required by the application cannot be met, the network operation and maintenance become quite complex, and the cost of network operation is increased. Conversely, if a proprietary network is deployed for providing services according to different requirements of different service scenes, the network only comprises functions required by the application scenes of the type, so that the service efficiency is greatly improved, the network performance required by the application scenes can be ensured, the operation and maintenance of the network are simple, and the investment and operation and maintenance cost can be reduced. This is the network slicing technique, and the proprietary network described above is an example of a network slice.

In summary, slicing is the most important feature of 5G, and how to automatically deploy slicing, end-to-end service quality guarantee and problem positioning response are key technologies of 5G slicing. The main concept of slicing is briefly described below.

1. Slice management concept.

Network slice (Network slice): refers to different logical networks customized according to different service requirements, over a physical or virtual network infrastructure. The network slice can be a complete end-to-end network comprising a terminal, an access network, a transmission network, a core network and an application server, can provide complete telecommunication service, and has certain network capability; the network slice may also be any combination of the above-mentioned terminals, access networks, transport networks, core networks and application servers. The network slice may have one or more of the following characteristics: the access network may or may not be sliced. The access network may be common to multiple network slices. The characteristics of the different network slices and the network functions that make up them may be different.

The 3GPP defined network slice management system includes: CSMF (traffic management function, communication Service Management Function) entity, NSMF (network slice management function ) and NSSMF (network slice subnet management function, network Slice Subnet Management Function). In practical applications, the NSSMF may be provided in plural.

The CSMF may be responsible for translating communications service requirements of an operator and/or a third party customer into requirements for a network (slicing), sending the requirements for the network slicing (e.g., creating, terminating, modifying a network slicing instance request, etc.) to the NSMF through an interface with the NSMF, obtaining management data (e.g., performance, failure data, etc.) for the network slicing from the NSMF, generating management data for communications traffic running on top of the network slicing instance, receiving subscription requirements for the network slicing management data and/or the management data for communications traffic by the operator and/or the third party customer, etc.

The NSMF may be responsible for receiving the network slice requirements sent by the CSMF, managing the life cycle, performance, failure, etc. of the network slice instance (hereinafter referred to as life cycle, performance, failure management are simply managed), arranging the composition of the network slice instance, decomposing the network slice instance requirements into requirements of each network slice subnet instance and/or network function, and sending a network slice subnet instance management request to each NSSMF.

The NSSMF may be responsible for receiving the network slicing subnet requirements sent by the NSMF, managing the network slicing subnet instances, arranging the composition of the sublevel network slicing instances, decomposing the network slicing subnet instances requirements into requirements of each network function and/or nested network slicing subnet instance, and possibly sending nested network slicing subnet instance management requests to other NSSMFs.

NSI (network slice example, network slice instance): is a logic network which runs truly and can meet certain network characteristics or service requirements. One network slice instance may provide one or more services. Network slice instances may be created by a network management system, which may create multiple network slice instances and manage them at the same time, including performance monitoring and fault management during operation of the network slice instances, etc. When multiple network slice instances coexist, portions of network resources and network functions may be shared between the network slice instances. The network slice instance may or may not be created from a network slice template. A complete network slice instance is capable of providing complete end-to-end network services, and may constitute NSSI (network slice subnet instance ) and/or network functions. The network functions may include physical network functions and/or virtual network functions. Hereinafter, the physical network function and/or the virtual network function are collectively referred to as network functions.

NSSI: the network slicing subnet instance may not need to provide end-to-end complete network services, and may be a set of network functions of the same equipment provider in the network slicing instance, or may be a set of network functions divided by domains, for example, a core network slicing subnet instance, an access network slicing subnet instance, or may be a set of network functions formed by other modes such as deployment locations. Network slice subnet instances may be shared by multiple network slice instances. The network slicing subnet example is provided, and the management of a network management system can be facilitated.

One network slice instance may consist of several network slice subnet instances, each network slice subnet instance consisting of several network functions and/or several network slice subnet instances; a network slice instance may consist of several network slice subnet instances and network functions that are not partitioned into network slice subnet instances; it is also possible that one network slice instance consists of only a few network functions.

NF (Network function): the network function is a processing function in the network, defines the functional behaviors and interfaces, and can be realized by special hardware, can be realized by running software on the special hardware, and can be realized in a virtual function form on a general hardware platform. Thus, from an implementation perspective, network functions may be divided into physical network functions and virtual network functions. From the point of view of use, the network functions may be divided into dedicated network functions and shared network functions, in particular, for multiple (sub) network slice instances, different network functions may be used independently, which are referred to as dedicated network functions, or may share the same network function, which is referred to as shared network functions.

2. And (5) automatically deploying slices.

The existing end-to-end slice automatic deployment method comprises the following steps: constructing a networking resource topology according to the slicing service requirement; extracting a slice configuration deployment capability from a subnet, setting a slice deployment flow, and constructing a slice deployment flow model; associating the slice monitoring and strategy model to generate a network slice template; and matching the corresponding network slice templates according to the ordering instructions, setting parameters in the network slice templates, deploying the slices to enable the slices to enter an activated state, and starting monitoring and strategy.

The method and the system realize the network resource discovery of the wireless network, the bearing network and the core network according to the region where the user is located, and the slice resource design is carried out according to the slice service requirement; and after the design is finished, slicing end-to-end allocation is performed according to user orders, and the slicing state end-to-end is monitored after the deployment is finished.

The monitored information includes: the topology from large client slice, slice to sub-slice to VNF (virtual network function, virtualization Network Function), topology-based slice, sub-slice and layer-by-layer information of networking resources, through visual presentation of slice KPIs (key performance indicators, key Performance Indicator), resource occupancy information and alert detailed information.

Specifically, in the slice deployment flow model, corresponding monitoring, inspection and alarm models of the sub-network are associated, and monitoring, inspection and alarm of a wireless network, a bearing network and a core network are set, so that end-to-end index monitoring of the slice is realized.

3. Slice test management.

The existing test method adopts a unified test method for one type of network element. When the concept of network slicing is introduced, different types of network slicing instances, even if they use the same network function, are tested differently due to different service requirements, and in addition, there may be shared network functions or network slicing subnet instances between different network slicing instances, so that the existing test method cannot meet the test of the network slicing.

Aiming at the problems, there is a proposal that NSMF completes end-to-end slicing test in two steps by issuing test tasks to NSSMF, each NSMF respectively carries out subnet slicing state feedback and domain division test, and then NSMF starts end-to-end slicing test, so that:

on the one hand, the end-to-end test start message sent by the NSMF to the NSSMF of the management access network equipment carries uplink workload information of the terminal user, including user geographic position distribution, user sending data packet size, qoS (Quality of Service ) requirement, sending frequency, user movement condition, roaming condition, activation ratio (active/all), corresponding DNN (data network name ) information, and indication information of other NSSI/NF that the test management object of the NSSMF has interaction with, test performance indexes and the like;

In one aspect, the downlink workload information of the data network carried in the end-to-end test initiation message sent by the NSMF to the NSSMF of the management core network device includes a data packet size, a sending frequency, a QoS requirement, information corresponding to a UE (User Equipment), indication information of other NSSI/NF that there is interaction with the test management object of the NSSMF to be tested, a performance index of the test, and the like.

The prior art has the following defects: the existing slice test method can only perform simple end-to-end index verifiability test.

Disclosure of Invention

The invention provides an intention execution method, an intention execution device and a storage medium, which are used for solving the problem that the conventional slicing test method can only carry out simple end-to-end index verifiability test.

The invention provides the following technical scheme:

an intent execution method comprising:

the intention creator sends a first original intention strategy;

identifying the first original intention strategy, matching with the existing strategy, and sending a corresponding first original application strategy;

executing the first original application strategy.

In implementation, the first original application policy includes a first extended intent policy;

said executing said first original application policy comprising:

Identifying the first expansion intention strategy, matching with the existing strategy, and sending a corresponding first expansion application strategy;

and executing the first extended application strategy.

In implementation, the first original application policy includes a first test intention policy;

said executing said first original application policy comprising:

identifying the first test intention strategy and determining a test case set in a test case library;

and executing the test cases in the test case set.

In an implementation, identifying the first test intention policy, determining a set of test cases in a test case library, includes:

acquiring a testing intention described by a tester in a testing specification through a graphical network topology design interactive interface;

generating a test case containing a test intention;

publishing the test cases containing the test intents to a test case library;

and selecting a test case containing the test intention from the test case library, and triggering the execution flow of the test task.

In practice, further comprising: on active test orchestration and capability opening, test intents are handled by one or a combination of the following:

at the design state stage, packaging and opening a strategy design service containing active test call based on intention;

In the design state stage, adding an active test service API call based on test intention in one of slicing service strategy design, network strategy design and resource strategy design or a combination thereof;

in the design state stage, increasing the test intention requirement quoted by the process in one or a combination of third party slice service loading verification, network loading verification and resource loading verification to realize consistency check with the local;

at the run-state stage, packaging and opening active test execution and result feedback services based on intention;

in the run state stage, analyzing a corresponding template at the life cycle management service request of one or a combination of the business, the slice and the subnet slice of the orchestration management function module of one or a combination of the CSMF, NSMF, NSSMF, NFVO, and extracting and executing a corresponding strategy;

and in the run-state stage, the test intention references contained in the analysis strategy description of the general strategy engine and/or the analysis strategy description of the orchestration service logic are referred to, and an automatic test optimizing system based on the intention is called to complete the execution of the related test.

In practice, further comprising: on policy orchestration and capability opening, test intents are handled by one or a combination of the following:

At the design state stage, packaging and opening a high-level business strategy design service containing lower-level resource strategy call based on intention;

in the design state stage, adding lower resource policy call based on intention in one of slicing service policy design, network policy design and resource policy design or a combination thereof;

in the design state stage, adding the lower resource strategy intention quoted by the process in one or a combination of the third party slice service loading verification, the network loading verification and the resource loading verification and realizing consistency check;

at the run-state stage, packaging and opening policy enforcement and result feedback services based on intention;

in the run state stage, analyzing a corresponding strategy template by using the arrangement management function module of one or a combination of CSMF, NSMF, NSSMF, NFVO according to a life cycle management service request of one or a combination of business, slicing and subnet slicing, and extracting and executing a corresponding strategy;

and in the run-state stage, analyzing the strategy by the general strategy engine and/or arranging the lower resource strategy intention reference contained in the service logic analysis strategy description, and calling an intention-based strategy execution system to complete the execution of the related test.

In practice, further comprising: on management intent and/or knowledge management, test intent is handled by one or a combination of the following:

in the design state stage, adding intention description for an atomic strategy and an atomic test case uniformly to form an atomic intention;

at the design stage, uniformly managing an operation intention knowledge base;

at the design state stage, unifying nested design processes from atomic intention to complex intention;

in the running state stage, using an intent translation engine to uniformly complete the flow of management operation intent analysis, instantiation and layer-by-layer decomposition until atomic intent;

in the running state stage, calling a common test execution system as an atomic test intention execution engine;

in the run-state stage, a common policy enforcement engine is called as an atomic policy enforcement engine.

In an implementation, generating a test case including a test intention, and publishing the test case including the test intention to a test case library includes:

converting the configuration information of the corresponding test networking topology into a formal topology description file according to the input of a user on a graphical interface of the graphical network topology design interactive interface;

according to the input of a user, converting the test script, the input parameters and the output parameters of each test case into a formal test case description file;

Packaging the test case description file according to a specified format;

and correspondingly registering the test intention contained in the test case description file according to the specified format.

In implementation, selecting a test case containing a test intention from a test case library, triggering a test task execution flow, including:

after natural language processing is called according to the user input test intention to convert the test intention into formalized test intention, a call intention matching module refers to a test intention knowledge base to convert the test intention into a test case set, a corresponding test case description file is extracted, test parameters are filled, and the test case description file is submitted to a test arrangement and execution module;

optimizing and scheduling the execution sequence of the corresponding test case set in each test task, and delivering the optimized test case execution set to a test execution system for sequential execution;

and sequentially executing the test cases in the test case execution set, and correspondingly updating and recording the relevant test case execution conditions according to the execution result.

In practice, further comprising processing the test intent according to the following strategy:

performing one or a combination of the following operations on the test intent: creation, instantiation, configuration, activation, deletion, termination, update, deactivation;

Performing an operation in a design state on one or a combination of the following objects of the test intent: the method comprises the steps of managing object types, uniquely identifying UUIDs, slicing service templates, slicing templates, subnet slicing templates, network service templates and network element resource templates;

performing an operation at run state on one or a combination of the following objects of the test intent: management object instance, instantiation parameter, slicing service instance, slicing instance, subnet slicing instance, network service instance, network element resource instance;

one or a combination of the following operational expectations are intended for the test: guaranteeing, optimizing and diagnosing.

In practice, further comprising processing the design of the test strategy by one or a combination of the following means:

adding an intention description field in a strategy template, and testing strategy description grammar and semantics by using formal model specifications;

one or a combination of the following services are provided in the policy design flow: providing a UI or command line input interface for strategy intention input according to the formalized model, providing a grammar check and semantic check tool for input intention description, and prompting a designer to complete a strategy design flow containing intention description according to a check/check result as required;

Storing the output strategy template containing the intention description in a strategy template library;

storing corresponding operation/management intention knowledge items in an intention analysis knowledge base, recording a newly built strategy template UUID, and supporting a keyword retrieval and matching function of an intention model field;

and providing an existing strategy searching, matching prompt and multiplexing confirmation based on intention in the programming process based on the keyword searching and matching function provided by the strategy knowledge base.

In implementations, further comprising processing the execution of the test strategy by one or a combination of the following:

analyzing the management intention statement, and calling a natural language processing module to translate the management intention statement into a formalized management intention statement;

matching the existing management strategies of the strategy intention knowledge base through the fuzzy matching module;

identifying a management intent field, prompting for input intent instantiation parameters;

identifying cited management intention sentences, and prompting to input intention instantiation parameters according to requirements;

the referenced management intent is translated into a set of policies with reference to a management intent knowledge base, and the intent instantiation process is repeated for the referenced policies.

In an implementation, the method further comprises the steps of constructing a management intention knowledge base, including:

Aiming at each test strategy and/or test case description file, analyzing action and object type information contained in a management intention field, and establishing a corresponding data record in a management intention knowledge base by taking the action and object type information as a keyword;

analyzing action and object type information contained in a management intention statement referenced by the flow, searching matched records in a knowledge base by taking the action and object type information as key values, and supplementing the intention dependency relationship of the records on the hit records through corresponding test strategies and/or test case description files of the referenced records if the records hit; if the current strategy is not hit, the user can report the fault and exit, or remind the testing strategy and/or the test case designer to supplement the management intention corresponding to the current strategy to realize knowledge definition.

An intent execution apparatus comprising:

a processor for reading the program in the memory, performing the following process:

the intention creator sends a first original intention strategy;

executing the first original application policy;

and a transceiver for receiving and transmitting data under the control of the processor.

Said executing said first original application policy comprising:

and executing the first extended application strategy.

said executing said first original application policy comprising:

and executing the test cases in the test case set.

generating a test case containing a test intention;

publishing the test cases containing the test intents to a test case library;

at the design stage, uniformly managing an operation intention knowledge base;

Packaging the test case description file according to a specified format;

An intent execution apparatus comprising:

a receiving unit for the intention creator to send a first original intention policy;

the identification unit is used for identifying the first original intention strategy, matching with the existing strategy and sending a corresponding first original application strategy;

and the execution unit is used for executing the first original application strategy.

In an implementation, the identifying unit is further configured to output the first original application policy including a first extended intent policy;

The execution unit is further configured to, when executing the first original application policy, include:

and executing the first extended application strategy.

In an implementation, the identifying unit is further configured to output the first original application policy including a first test intent policy;

and executing the test cases in the test case set.

In an implementation, the execution unit includes:

the acquisition module is used for acquiring the test intention described by the tester by the test specification through the graphical network topology design interactive interface;

the generation module is used for generating a test case containing a test intention;

the issuing module is used for issuing the test cases containing the test intents to the test case library;

and the triggering module is used for selecting the test case containing the test intention from the test case library and triggering the execution flow of the test task.

In practice, on active test orchestration and capability opening, test intents are handled by one or a combination of the following:

The generation module is further to:

the trigger module is further configured to:

In practice, on policy orchestration and capability opening, test intents are handled by one or a combination of the following:

the generation module is further to:

the trigger module is further configured to:

In practice, the test intent is handled on management intent and/or knowledge management by one or a combination of the following:

the generation module is further to:

at the design stage, uniformly managing an operation intention knowledge base;

the trigger module is further configured to:

In implementations, the generating module is further to: when generating a test case including a test intention and publishing the test case including the test intention to a test case library, the method includes:

packaging the test case description file according to a specified format;

In an implementation, the triggering module is further configured to, when selecting a test case including a test intention from the test case library, trigger a test task execution flow, include:

In practice, the generating module is further configured to process the test intention according to the following strategy:

In practice, the generation module is further configured to process the design of the test strategy by one or a combination of the following means:

In practice, the generation module is further configured to process the execution of the test strategy by one or a combination of the following means:

In implementation, the generating module is further configured to construct a management intent knowledge base, including:

A computer-readable storage medium storing a computer program for executing the above-described intended execution method.

The invention has the following beneficial effects:

in the technical scheme provided by the embodiment of the invention, the intention recognition of the intention creator is introduced, then the intention creator is matched with the preset existing strategy, the original application strategy is output, and the target, the suggestion or the command is arranged in the existing strategy, so that the intention of the designer is introduced into the design and the execution of the strategy. Since the intention of the introduction intention creator is taken into consideration during execution of the policy, the intention is also included in execution of the policy, and thus the intention can be executed as required by the designer during execution of the policy.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and do not constitute a limitation on the invention. In the drawings:

FIG. 1 is a schematic flow chart of an NFV automatic test optimization system in an embodiment of the invention;

FIG. 2 is a schematic flow chart of an embodiment of the method according to the present invention;

FIG. 3 is a schematic overall flow chart of an orchestration strategy subsystem according to an embodiment of the present invention;

fig. 4 is a schematic flow chart of an implementation of a basic network testing method according to the first embodiment of the invention;

FIG. 5 is a flow chart of a network testing method according to a second embodiment of the present invention;

FIG. 6 is a flowchart illustrating a network testing method according to a third embodiment of the present invention;

FIG. 7 is a flow chart of a network testing method according to a fourth embodiment of the present invention;

FIG. 8 is a flowchart illustrating a network testing method according to a fifth embodiment of the present invention;

fig. 9 is a schematic diagram of a network testing method implementation flow according to a sixth embodiment of the present invention;

fig. 10 is a schematic diagram of a network testing device according to an embodiment of the invention.

Detailed Description

The inventors noted during the course of the invention that:

The NFV automatic test system is briefly described below.

1. Background introduction.

NFV (network function virtualization technology, network Function Virtualization) refers to a technology that, by means of virtualization technology, carries a wide variety of software-implemented network functions through servers, memories and switches to replace traditional proprietary hardware devices (such as routers, firewalls, content distribution networks, etc.). The NFV architecture includes: VIM (virtualized infrastructure manager, virtual infrastructure manager) responsible for managing the software and hardware resources of the infrastructure layer NFVI (network function virtualized infrastructure, network function virtualization infrastructure); VNFM (virtual network function manager ), responsible for life cycle management of VNFs (virtual network element functions, virtual network function); EMS (network management system, element management system) is responsible for the configuration, fault, alarm and other management of virtual network elements; NFVO (network function virtualization orchestrator ), responsible for the lifecycle management of NS (network services).

Because of the many components involved in NFV architecture, the complex and numerous interfaces between the components themselves and the different components, testing and docking are labor intensive. In the related art, the process of testing the network element includes: test case design, test environment construction, test task execution and test result analysis. Besides the fact that the test task execution links of part of test cases (such as interface consistency test and the like) can be optimized by adopting an automatic script, other steps are often manually executed by adopting a manual mode, and the method has the advantages of high cost, low efficiency, easiness in error and difficulty in large scale.

An automated test method for NFV comprising: acquiring a test case set required by a test, wherein the test case set comprises at least two test cases; constructing a test task based on a case description file of each test case in the test case set, wherein the case description file comprises: dependency relationship information for describing the relevance between the test case and other test cases; optimizing the execution sequence of the test task based on the dependency information of each test case related to the test task; and executing the test task based on the optimized execution sequence.

2. An overall architecture.

FIG. 1 is a schematic flow diagram of an NFV automatic test optimization system, and as shown in the figure, the overall flow of the NFV automatic test optimization system is divided into a design subsystem and an execution subsystem:

1) And (3) a design subsystem: the method comprises the steps of providing a graphical network topology design interaction interface for designing test cases by referring to test specifications (text descriptions) for test designers, converting the test cases and corresponding test networking descriptions into formal description files which can be automatically processed by a system, and publishing the formal description files to a test case library which can be used by test executives. The design subsystem specifically comprises three sub-modules:

(1) The topology design module converts the corresponding test networking topology (comprising a plurality of tested systems, a plurality of test meters and network connection relations thereof) and specific configuration information thereof into a formal topology description file according to the input of a user on a graphical interface. Wherein each test topology description file has a globally unique identification UUID (universally unique identification code, universally Unique Identifier).

(2) And the case design module converts the input and output parameters of the test script of each test case into a formalized test case description file according to the input of a user. Wherein each test case description file contains a test topology description file UUID reference that is relied upon.

(3) And the test case library encapsulates the encapsulated test case description file (comprising a test topology description template, a test script, a test flow file and the like) according to a specified format and distributes the encapsulated test case description file into the execution subsystem.

2) The execution subsystem: and the test case library is responsible for triggering the execution flow of the test task aiming at the test case selected by the test executor from the test case library. The execution subsystem includes three sub-modules:

(1) The task construction module extracts a corresponding test case description file according to a test case set selected by a user for a specific test task and fills specific test parameters;

(2) The test scheduling module is in charge of optimizing and scheduling the execution sequence of the corresponding test case set in each test task, and delivering the optimized test case set to the test execution system for sequential execution;

(3) And the test execution module is responsible for sequentially executing the test cases in the test tasks.

3. The test case describes a template.

The test case is described by a case description file, which comprises the following steps:

test environment/test topology/topology configuration: the test topology used to describe the test steps that need to be built before they are performed typically includes the components to be tested, the general purpose devices, the instrumentation devices, the surrounding components, and the network connections between them.

Preconditions/input conditions/prior conditions: after the test environment is built, the configuration of the service or resource parameters for the components under test, the general purpose devices, the instrumentation devices, the surrounding components and the network connections between them is required before the test steps are performed.

Test step/test flow/execution step: and simulating specific situations such as business processes, information interaction or equipment faults and the like occurring in the actual environment by utilizing a series of operation processes aiming at elements in the test environment, and verifying whether the system/component to be tested meets the requirements of expected specific functions, performances, reliability, interface compliance and the like.

Decision condition/checkpoint/observation: and judging whether the behavior of the component to be tested meets the expected condition or not. In particular, the method can be embodied as a priori, in-process, post-process observation item and logical combinations thereof, involved in each test step.

The existing slice testing method utilizes a combined subnet slice instance testing process to realize the end-to-end slice instance testing, considers the situation that the subnet slice instance is shared across slice instances, and automatically triggers related testing tasks.

On the one hand, the test implemented by the subnet slice manager cannot cover the network link of the inter-professional subnet domain in the operator network, only a simple end-to-end index verification test can be performed, and the active test auxiliary fine-grained problem positioning test service cannot be completed in the operation and maintenance management process.

On the other hand, the prior art does not consider the utilization of test arrangement and the capability opening thereof, and the open test for content providers and industry users flexibly arranges and calls services on demand, and can not provide the opening capability for the end-to-end service test outside the operator network.

Therefore, in the embodiment of the invention, a policy execution and capability opening scheme based on arrangement is provided, and mainly test is taken as an example, and the scheme is applied to the business processes such as template design, business deployment, operation and maintenance management and the like of end-to-end slicing, so as to realize business quality assurance, cross-domain fault diagnosis and automatic experience optimization. The following describes specific embodiments of the present invention with reference to the drawings.

FIG. 2 is a schematic flow diagram of an implementation of the method, as shown, may include:

step 201, an intention creator sends a first original intention strategy;

step 202, identifying the first original intention strategy, matching with the existing strategy, and sending a corresponding first original application strategy;

step 203, executing the first original application policy.

In the technical scheme provided by the embodiment of the invention, the intention recognition of the intention creator is introduced, then the intention creator is matched with the preset existing strategy, the original application strategy is output, and the target, the suggestion or the command is arranged in the existing strategy, so that the intention of the designer is introduced into the design and the execution of the strategy.

Further, the expansion and enrichment of the policy can be achieved by including an expansion intention policy in the original application policy, that is:

said executing said first original application policy comprising:

and executing the first extended application strategy.

The following will mainly take the introduction intention in the test strategy as an example, namely:

said executing said first original application policy comprising:

and executing the test cases in the test case set.

In specific implementation, identifying the first test intention policy, and determining a test case set in a test case library includes:

generating a test case containing a test intention;

publishing the test cases containing the test intents to a test case library;

The technical scheme provided by the embodiment of the invention mainly utilizes an automatic testing system based on arrangement to provide unified, open and customizable active testing service for 5G slice service opening, resource scheduling and operation and maintenance management.

On one hand, the design state test arrangement capability of the automatic test system is opened to partner partners such as industry users and network element suppliers, so that the partner partners can be used as designers or the test intention and use case realization of the service/resource of the partner partners can be customized through the identity of a third party test network element/service provider, and a slicing service template containing the test capability and realization of the test capability is output;

On the other hand, through analyzing the test capability description template and instantiating the test service, the automatic call of corresponding test intention/use case for corresponding service quality assurance, cross-domain fault diagnosis and automatic experience optimization is realized in the resource instance selection, service deployment and operation and maintenance management flow of end-to-end slicing, and the automation, flexibility and openness of the slicing test and the assurance optimization service thereof are realized.

Fig. 3 is a schematic overall flow diagram of an arrangement policy subsystem, and in the scheme, as shown in the drawing, the overall flow optimization and expansion of the NFV automatic arrangement policy subsystem is divided into a design subsystem and an execution subsystem, and is described below.

1. Implementation of active test orchestration and capability opening schemes.

In practice, the method may further comprise: on active test orchestration and capability opening, test intents are handled by one or a combination of the following:

Specifically, an automatic test service based on intention is packaged and opened, and the automatic test service is used for slicing design state design and running state calling of management operation strategies of a full life cycle:

1. design state.

Packaging and opening a policy design service containing an intent-based active test call;

the slice business/network/resource management intention design process adds active test service API (application programming interface, application Program Interface) call based on the test intention;

And the consistency check of the referenced test intention requirement and the local implementation is increased in the third-party slice service/network/resource loading verification process.

2. And (5) running state.

Packaging and opening active test execution and result feedback services based on intention;

CSMF, NSMF, NSSMF or NFVO, etc., analyzes the corresponding templates, extracts and executes the corresponding policies in response to the business/slice/subnet slice lifecycle management service request;

the general policy engine/orchestration service logic analyzes the test intention references contained in the policy description, invokes an automatic test optimization system based on intention, and completes the execution of the relevant steps.

2. Policy orchestration and enforcement of capability opening schemes.

In practice, the method may further comprise: on policy orchestration and capability opening, test intents are handled by one or a combination of the following:

Specifically, the lower resource management policy service is packaged and opened based on the intention, and is used for designing and calling the intention of the management operation of the higher service:

1. design state.

Packaging and opening a high-level business intention design service containing intention-based lower-level resource management strategy closed-loop call;

adding lower resource management policy call based on intention in the design process of slicing service, network or resource workflow;

The third party slice service, network or resource loading verification process adds the intention and the realization consistency check to the referenced lower resource management strategy.

2. And (5) running state.

Packaging and opening management policy execution and result feedback services based on intention;

CSMF, NSMF, NSSMF or NFVO, etc., analyzes the corresponding policy template, extracts and executes the corresponding policy in response to the service, slice, or subnet slice lifecycle management service request;

the general policy engine/orchestration service logic analyzes the underlying resource policy intention references contained in the policy description, invokes the intention-based policy execution system, and completes the execution of the relevant steps.

In practice, services and resources are a relative concept. Such as: the slice is a "service" composed of three types of sub-network slices "resources", the core network sub-network slice is a "service" composed of several virtual/physical network elements "resources", etc.

3. Management intent/knowledge management based on unified model.

In practice, the method may further comprise: on management intent and/or knowledge management, test intent is handled by one or a combination of the following:

At the design stage, uniformly managing an operation intention knowledge base;

Specifically, the intent description model for management operation and complex test is unified:

1. design state.

Adding intention descriptions for the atomic strategy and the atomic test case uniformly to form an atomic intention;

uniformly managing an operation intention knowledge base;

nested design processes from atomic intent to complex intent are unified.

2. And (5) running state.

The intention translation engine uniformly completes the flow of management operation intention analysis, instantiation and layer-by-layer decomposition until atomic intention;

calling a common test execution system as an atomic test intention execution engine;

and calling a common policy execution engine as an atomic policy execution engine.

The atomic policy and test case in implementation refer to a policy and test case which do not contain other intention references and can be directly analyzed and executed by a general policy and test execution system.

The implementation of the overall flow is described below.

The whole flow of the automatic test optimization system based on the intention can be divided into a design subsystem and an execution subsystem:

1. the subsystem is designed.

packaging the test case description file according to a specified format;

Specifically, a graphical network topology design interactive interface for designing test cases with reference to test specifications (text descriptions) can be provided for test designers, the test cases containing test intention descriptions and corresponding test networking descriptions are converted into formal description files which can be automatically processed by a system, and the formal description files are released into a test case library and a test intention knowledge base which can be used by test executives. The design subsystem may specifically comprise the following sub-modules:

1. The topology design module converts the corresponding test networking topology (comprising a plurality of tested systems, a plurality of test meters and network connection relations thereof) and specific configuration information thereof into a formal topology description file according to the input of a user on a graphical interface. Wherein each test topology description file may have a globally unique identification UUID.

2. And the case design module converts the input and output parameters of the test script of each test case into a formalized test case description file according to the input of a user. Each test case description file contains a UUID reference of the test topology description file relied on and a test intention field of formal description, and may contain references to other test intents in other fields such as a precondition, a test step, a decision condition, and the like.

3. And the test case library packages and distributes test case description files (comprising test topology description templates, test intents, test scripts, test flow files and the like) into the execution subsystem according to a specified format.

4. And the test intention knowledge base correspondingly registers the test intention contained in the test case description file according to a specified format (in practice, the test intention and the test case can be in one-to-one or one-to-many relation), and issues the test intention and the test case into the execution subsystem.

2. And an execution subsystem.

Specifically, the test cases selected from the test case library aiming at the test intention input by the test executor trigger the test task execution flow. The execution subsystem comprises the following sub-modules:

1. the task construction module is used for calling natural language processing to convert into formalized test intents according to the input test intents of a user, then calling the intent matching module to convert into a test case set by referring to a test intention knowledge base, extracting corresponding test case description files (including test intents referenced by test intention description fields and other fields), filling specific test parameters (including intent instantiation parameters), and delivering to the test arrangement and execution module.

2. The test scheduling module is responsible for optimally scheduling the execution sequence of the corresponding test case set in each test task, and delivering the optimized test case execution set to the test execution system for sequential execution.

3. And the test execution module is responsible for sequentially executing the test cases in the test case execution set and correspondingly updating and recording the relevant test case execution conditions according to the execution result.

Next, the intent description model, the test case description file, the test intent knowledge base record, the association tracking table, and the processing logic of the test case design module and the orchestration module are further described, respectively.

1. The policy intent describes the model.

The method can be concretely as follows:

< Action >: an optional field identifying a management operation related to the intent, extensible;

management operation: creation (Create), instantiation (Initiate), configuration (Configure), activation (Delete), termination (Stop), update (Update), deactivation (Deactivate);

< Object >: the mandatory field identifies the operated object and is extensible.

The design state is as follows: managing object types; a unique identifier UUID, a slicing service template, a slicing template, a subnet slicing template, a network service template, a network element resource template and the like;

and (3) operating state: management object instance, instantiation parameter, slicing service instance, slicing instance, subnet slicing instance, network service instance, network element resource instance and the like;

< State >: the necessary field is used for identifying the expected operation effect and comprises an operation target and an effect index;

objective: a mandatory field for identifying a single management operation target for a specific operated object and correspondingly assigning a unique identifier UUID;

management intention: assurance (Assure), optimization, diagnostics (diagnostics);

Expect ion: according to different values of Action fields, selecting a field under the condition, instantiating parameters, and marking the value of an operation expected effect index;

if the Action value is Delete or Stop or Deactivate, the expected may be null;

if the Action value is other operations, the extension is an optional field, and the value may be different according to the value of the Objective;

if the Objective value is fault delimited, the expected value is Bool type (Pass/Failed);

if Objective Value is the index guarantee, the expected Value is the composite Metric type consisting of Value and Unit.

The intention model is defined, the mode of realizing strategy intention description and test intention description model is unified, and the universal realization can be realized for an intention translation and processing engine.

2. The intent-based strategy design optimizes the extension.

The method can be concretely as follows:

first: and expanding a strategy description template and establishing a strategy intention description formalized model.

And adding an intention description field in the strategy template, and standardizing the description grammar and semantics by using a formalized model so that the system can automatically read, analyze and store related information to form a strategy intention analysis knowledge base.

Second,: and (3) expanding a strategy design flow and increasing a strategy intention information input step.

In the policy design flow, a UI (User interface) or command line input interface for policy intention entry is provided according to a formalized model, a grammar check and semantic check tool for input intention description is provided, and a designer is prompted to complete the policy design flow containing intention description according to a check/check result as required.

Third,: and expanding a strategy template library and establishing a strategy intention analysis knowledge base.

The expanded strategy design flow outputs strategy templates containing intention descriptions and stores the strategy templates in a strategy template library; and storing corresponding operation/management intention knowledge items in the intention analysis knowledge base, recording the UUID of the newly built strategy template, and supporting the keyword retrieval and matching functions of intention model fields such as action, object.

Fourth,: and (3) expanding a strategy design flow and adding a complex strategy abstract design flow based on intention.

The keyword searching and matching functions provided by the strategy knowledge base can further expand the strategy design flow, and the existing strategy searching, matching prompt and multiplexing confirmation based on intention are provided in the operation/management intention input and pre-condition/test step/judgment condition compiling process of the designer, so that the multiplexing of the existing strategy in the complex strategy design is supported.

3. The intent-based policy performs an optimization extension.

The method can be concretely as follows:

and the first and the extension policy construction modules are used for completing the translation from the input intention of the management executive to the policy.

First, analyzing management intention sentences one by one, and calling a natural language processing module to translate the management intention sentences into formalized management intention sentences.

And secondly, matching the existing management strategies of the strategy intention knowledge base through a fuzzy matching module.

And the second, expanding the policy construction module, completing the provision/knowledge matching policy description file from the management executive and completing the management intention instantiation by combining the input parameters.

First, a management intention field therein is identified, prompting a management executor to input necessary intention instantiation parameters.

Secondly, the management intention statement quoted in the management intention statement is further identified, and management executives are further prompted to input other necessary intention instantiation parameters according to requirements.

Finally, referring to the management intent knowledge base, the management intent referenced therein is translated into a set of policies and the intent instantiation process is repeated for the referenced policies.

4. And managing the intention knowledge base.

In implementation, the method may further include constructing a management intention knowledge base, including:

The method can be concretely as follows:

managing data records of an intent knowledge base:

<refID>

UUID (policy description file/test case description file) of current management operation description file

Dependency management intent record UUID

Construction process of management intention knowledge base

For each policy/test case description file:

analyzing action and object type information contained in the management intention field, and taking the action and object type information as a keyword to establish a corresponding data record in a management intention knowledge base, wherein the record corresponds to a strategy/test case description file UUID;

analyzing action and object type information contained in the management intention statement of the flow reference, and searching matched records in the knowledge base by taking the action and object type information as key values;

if hit, supplementing the intended dependency relationship of the record on the hit record through the corresponding strategy/test case description file UUID of the referenced record;

if the current strategy is not hit, the user logs out in error, or reminds a strategy/test case designer to supplement the management intention corresponding to the current strategy to realize knowledge definition.

The following is an example.

Example 1

Fig. 4 is a schematic flow chart of an implementation of the basic network testing method according to the first embodiment, and the specific flow chart is shown in the following embodiment.

Example two

Fig. 5 is a schematic diagram of a flow chart of implementing the network testing method in the second embodiment, in this example, end-to-end service SLA guarantee is expanded in the embodiment, and the specific flow chart is shown in the figure.

Example III

Fig. 6 is a schematic diagram of a network test method implementation flow in the third embodiment, in which the fault delimitation of the end-to-end slice example of the extension embodiment is shown in the specific flow.

Example IV

Fig. 7 is a schematic flow chart of a network testing method implementation in the fourth embodiment, and in this embodiment, the three-terminal to end slicing service experience optimization in the extended embodiment is implemented, and the specific flow chart is shown in the figure.

Example five

Fig. 8 is a schematic flow chart of a network test method implementation in the fifth embodiment, in which the fourth embodiment is extended, and a third party is used to import test cases and management policies, and the specific flow chart is shown in the figure.

Example six

Fig. 9 is a schematic flow chart of an implementation of a network testing method in the sixth embodiment, in which the fifth embodiment is extended, and the specific flow chart is shown in the drawing, based on universal intent/knowledge management of a unified model.

Based on the same inventive concept, the embodiments of the present invention further provide an intended execution device and a computer readable storage medium, and since the principle of solving the problem by these devices is similar to that of the intended execution method, the implementation of these devices may refer to the implementation of the method, and the repetition is omitted.

In implementing the technical scheme provided by the embodiment of the invention, the method can be implemented as follows.

FIG. 10 is a schematic diagram of an apparatus for performing the method, as shown, the apparatus includes:

processor 1000, for reading the program in memory 1020, performs the following processes:

the intention creator sends a first original intention strategy;

executing the first original application policy;

a transceiver 1010 for receiving and transmitting data under the control of the processor 1000.

said executing said first original application policy comprising:

and executing the first extended application strategy.

said executing said first original application policy comprising:

and executing the test cases in the test case set.

generating a test case containing a test intention;

publishing the test cases containing the test intents to a test case library;

at the design stage, uniformly managing an operation intention knowledge base;

packaging the test case description file according to a specified format;

Wherein in fig. 10, a bus architecture may comprise any number of interconnected buses and bridges, and in particular one or more processors represented by the processor 1000 and various circuits of the memory, represented by the memory 1020, are chained together. The bus architecture may also link together various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., which are well known in the art and, therefore, will not be described further herein. The bus interface provides an interface. The transceiver 1010 may be a number of elements, i.e., including a transmitter and a receiver, providing a means for communicating with various other apparatus over a transmission medium. The processor 1000 is responsible for managing the bus architecture and general processing, and the memory 1020 may store data used by the processor 1000 in performing operations.

The embodiment of the invention also provides an intention executing device, which comprises:

and executing the first extended application strategy.

and executing the test cases in the test case set.

In an implementation, the execution unit includes:

the generation module is further to:

the trigger module is further configured to:

the generation module is further to:

the trigger module is further configured to:

the generation module is further to:

at the design stage, uniformly managing an operation intention knowledge base;

the trigger module is further configured to:

packaging the test case description file according to a specified format;

For convenience of description, the parts of the above apparatus are described as being functionally divided into various modules or units, respectively. Of course, the functions of each module or unit may be implemented in the same piece or pieces of software or hardware when implementing the present invention.

There is also provided in an embodiment of the present invention a computer-readable storage medium storing a computer program for executing the above-described intended execution method.

Specific implementations may be found in implementations intended to perform the method.

In summary, the embodiments of the present invention provide:

1. active test orchestration and capability opening schemes.

And packaging and opening an automatic test service based on intention, wherein the automatic test service is used for slicing design state design and running state call of management operation strategies of a full life cycle:

the design state is as follows:

adding an active test service API call based on test intention in the design process of slicing service/network/resource strategy;

And (3) operating state:

the CSMF/NSMF/NSSMF/NFVO scheduling management function modules analyze the corresponding templates and extract and execute the corresponding strategies according to the business/slice/subnet slice life cycle management service requests;

2. Policy orchestration and capability opening schemes.

The lower resource policy service is packaged and opened based on intention, and is used for designing and calling a higher-level service management operation policy:

The design state is as follows:

packaging and opening a high-level business strategy design service containing lower-level resource strategy call based on intention;

adding lower resource strategy call based on intention in the design process of slicing service/network/resource strategy;

and adding intention and realizing consistency check of the referenced lower resource strategy in the third party slice service/network/resource loading verification process.

And (3) operating state:

packaging and opening policy enforcement and outcome feedback services including intent-based;

the CSMF/NSMF/NSSMF/NFVO scheduling management function modules analyze the corresponding strategy templates and extract and execute the corresponding strategies according to the business/slice/subnet slice life cycle management service requests;

3. Management intent/knowledge management based on unified model.

Intent description model for unified management operation and complex test:

the design state is as follows:

uniformly managing an operation intention knowledge base;

nested design processes from atomic intent to complex intent are unified.

And (3) operating state:

Therefore, the scheme provides an active test and capability opening scheme based on arrangement, and is applied to the business processes such as template design, business deployment, operation and maintenance management and the like of end-to-end slicing, so as to realize business quality assurance, cross-domain fault diagnosis and automatic experience optimization.

It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims

1. An intended execution method, comprising:

the intention creator sends a first original intention strategy;

executing the first original application strategy.

2. The method of claim 1, wherein the first original application policy comprises a first extended intent policy;

said executing said first original application policy comprising:

and executing the first extended application strategy.

3. The method of claim 1, wherein the first original application policy includes a first test intent policy therein;

said executing said first original application policy comprising:

and executing the test case set.

4. The method of claim 3, wherein identifying the first test intent policy, determining a set of test cases in a test case library, comprises:

Generating a test case containing a test intention;

publishing the test cases containing the test intents to a test case library;

5. The method as recited in claim 3, further comprising: on active test orchestration and capability opening, test intents are handled by one or a combination of the following:

in the design state stage, adding an active test service application programming interface API call based on test intention in one of slicing service strategy design, network strategy design and resource strategy design or a combination thereof;

in the operation state stage, analyzing corresponding templates at the life cycle management service request of one or a combination of business, slicing and subnet slicing according to the arrangement management function module of one or a combination of the business, slicing and subnet management function CSMF, network slicing subnet management function NSSMF and network function virtualization orchestrator NFVO, and extracting and executing corresponding strategies;

6. The method as recited in claim 3, further comprising: on policy orchestration and capability opening, test intents are handled by one or a combination of the following:

7. The method as recited in claim 3, further comprising: on management intent and/or knowledge management, test intent is handled by one or a combination of the following:

at the design stage, uniformly managing an operation intention knowledge base;

8. The method of claim 3, wherein generating the test case containing the test intent, publishing the test case containing the test intent to the test case library, comprises:

packaging the test case description file according to a specified format;

9. The method of claim 3, wherein selecting a test case from a library of test cases that includes a test intent, triggering a test task execution flow, comprises:

10. The method of claim 3, further comprising processing the test intent according to the following strategy:

performing an operation in a design state on one or a combination of the following objects of the test intent: management object type, unique identification universal unique identification code UUID, slicing service template, slicing template, subnet slicing template, network service template and network element resource template;

11. The method of claim 3, further comprising processing the design of the test strategy by one or a combination of:

one or a combination of the following services are provided in the policy design flow: providing a user interface UI or command line input interface for inputting the strategy intention according to the formalized model, providing a grammar check and semantic check tool for inputting the intention description, and prompting a designer to complete a strategy design flow containing the intention description according to the check/check result as required;

12. The method of claim 3, further comprising processing execution of the test strategy by one or a combination of:

13. The method of claim 3, further comprising building a knowledge base of management intents, comprising:

14. An intent execution apparatus, comprising:

the intention creator sends a first original intention strategy;

executing the first original application policy;

15. An intent execution apparatus, comprising:

16. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program for executing the method of any one of claims 1 to 13.