CN114416589A - Network target range comprehensive detection method, device, equipment and readable storage medium - Google Patents
Network target range comprehensive detection method, device, equipment and readable storage medium Download PDFInfo
- Publication number
- CN114416589A CN114416589A CN202210099326.9A CN202210099326A CN114416589A CN 114416589 A CN114416589 A CN 114416589A CN 202210099326 A CN202210099326 A CN 202210099326A CN 114416589 A CN114416589 A CN 114416589A
- Authority
- CN
- China
- Prior art keywords
- test
- scene
- target
- consistency
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Abstract
The application provides a network shooting range comprehensive detection method, which comprises the following steps: the method comprises the steps that after a target server receives a test task about a target scene issued by a control server, a scene file and a test script corresponding to the target scene are obtained; creating a target scene based on the scene file, the target scene including at least one virtual machine; starting a test script to carry out consistency test; the consistency refers to the function consistency and the performance consistency when the target server executes the test task in the target scene each time, and/or the function consistency and the performance consistency when the target server and other physical servers execute the test task in the target scene. The method and the device can adopt an automatic mode to carry out comprehensive detection on the network target range. The application also provides a network target range comprehensive detection device, equipment and a readable storage medium.
Description
Technical Field
The present application relates to the field of network security, and in particular, to a method, an apparatus, a device, and a readable storage medium for comprehensively detecting a network target range.
Background
The network target range is a technology or a product for simulating and reproducing the running states and running environments of network architecture, system equipment and business processes in a real network space based on a virtualization technology. Network shooting ranges have become an essential network space security core infrastructure for network space security research, learning, testing, verification, drilling and the like in various countries. Network shooting ranges are highly valued in all countries in the world and are used as important means for safety capacity construction support.
The network target range can carry out technical evaluation on the network new technology, can carry out research test and operational test on network weapons, can carry out quantitative qualitative evaluation on operational effectiveness, can be used for network fighters to carry out attack and defense training exercises, and is a network space security core infrastructure. The network target field can provide efficient and accurate services, and meanwhile, detection work needs to be carried out synchronously, so that expected effects can be realized.
The network shooting range integrates multiple elements such as virtualization, cloud computing, network security, capability management and the like, and needs to be tested by a comprehensive detection method in combination with an application scene besides conventional function test, performance test and stability test.
In the existing detection scheme, the network target range test only adopts the traditional test/inspection method, and the detection of the efficacy of the whole network target range cannot be realized; moreover, the efficacy of the network shooting range is biased due to different application scenes, the test needs manual participation due to the diversity of the scenes, the problems of high test cost, long time period and the like exist, a compromise method needs to be found for solving, and automatic verification under the basic verification condition is guaranteed.
Disclosure of Invention
The application provides a network target range comprehensive detection method, a device, equipment and a computer readable storage medium, which can adopt an automatic form to carry out comprehensive detection on a network target range.
In a first aspect, the present application provides a method for comprehensively detecting a network target range, where an execution subject of the method is a target server in the network target range, and the target server is any one of physical servers to be detected in the network target range, and the method includes:
after receiving a test task about a target scene issued by a control server, acquiring a scene file and a test script corresponding to the target scene;
creating the target scene based on the scene file, the target scene including at least one virtual machine;
starting the test script to carry out consistency test; the consistency refers to the function consistency and the performance consistency of the target server executing the test task in the target scene each time, and/or the function consistency and the performance consistency of the target server and other physical servers executing the test task in the target scene.
Optionally, the test task includes a test mode, a test range, a test time, and a test object, where:
the test mode is to test according to a preset upper limit value of the resource utilization rate;
the test range refers to independent test of the target server or joint test of the target server and other physical servers;
the test time refers to the duration of the test;
the test object refers to the resource use condition of the virtual machine in the target scene.
Optionally, the starting the test script for performing the consistency test includes:
after the virtual machine is created and the test script is started, if the resource utilization rate of the virtual machine reaches a preset upper limit value, the current test state is kept until a preset test time is reached; or after the virtual machine is created and the test script is started, if the resource utilization rate of the virtual machine reaches a preset upper limit value and does not reach a preset test time, closing the target scene, and re-executing the steps of creating the virtual machine and starting the test script until the preset test time is reached;
and in the test time, data acquisition is carried out according to a fixed frequency, so that the control server determines whether the target server has consistency in function and performance based on the acquired data.
Optionally, the collected data includes resource detection data and fault detection data.
Optionally, the resource detection data includes at least one of:
the method comprises the steps of setting up a scene, starting testing time, time when the resource utilization rate reaches a preset upper limit value, resource consumption during scene creation and resource consumption during scene interruption.
Optionally, the fault detection data includes at least one of:
error reporting information in the scene running process, abnormal data in the scene running process and alarm information when resources are overloaded.
Optionally, the determining whether the target server has consistency in function and performance based on the collected data includes:
determining a scene cycle mean value and a resource usage mean value of the target server based on the acquired data; determining whether the target servers have consistency in function and performance according to the scene period average value and/or the resource usage average value;
the scene cycle mean value refers to a time mean value of at least two scene cycles when the target server creates the target scene at least twice, the resource usage mean value refers to a mean value of resource usage rates at each data acquisition time in one scene cycle, and the scene cycle refers to a time length taken from creation to release of the target scene.
In a second aspect, the present application provides a network shooting range comprehensive detection apparatus, where the apparatus is applied to a target server in a network shooting range, where the target server is any one of physical servers to be detected in the network shooting range, and the apparatus includes:
the file acquisition unit is used for acquiring a scene file and a test script corresponding to a target scene after receiving a test task about the target scene issued by the control server;
a scene creating unit, configured to create the target scene based on the scene file, where the target scene includes at least one virtual machine;
the comprehensive detection unit is used for starting the test script to carry out consistency test;
the consistency refers to the function consistency and the performance consistency of the target server executing the test task in the target scene each time, and/or the function consistency and the performance consistency of the target server and other physical servers executing the test task in the target scene.
Optionally, the test task includes a test mode, a test range, a test time, and a test object, where:
the test mode is to test according to a preset upper limit value of the resource utilization rate;
the test range refers to independent test of the target server or joint test of the target server and other physical servers;
the test time refers to the duration of the test;
the test object refers to the resource use condition of the virtual machine in the target scene.
Optionally, the comprehensive detection unit includes:
the comprehensive detection subunit is used for maintaining the current test state until the preset test time is reached if the resource utilization rate of the virtual machine reaches a preset upper limit value after the virtual machine is created and the test script is started; or after the virtual machine is created and the test script is started, if the resource utilization rate of the virtual machine reaches a preset upper limit value and does not reach a preset test time, closing the target scene, and re-executing the steps of creating the virtual machine and starting the test script until the preset test time is reached;
and the consistency determining subunit is used for acquiring data according to a fixed frequency in the test time so that the control server determines whether the target server has consistency in function and performance based on the acquired data.
Optionally, the collected data includes resource detection data and fault detection data.
Optionally, the resource detection data includes at least one of:
the method comprises the steps of setting up a scene, starting testing time, time when the resource utilization rate reaches a preset upper limit value, resource consumption during scene creation and resource consumption during scene interruption.
Optionally, the fault detection data includes at least one of:
error reporting information in the scene running process, abnormal data in the scene running process and alarm information when resources are overloaded.
Optionally, the consistency determining subunit is specifically configured to perform data acquisition according to a fixed frequency within the test time, so that the control server determines a scene cycle average value and a resource usage average value of the target server based on the acquired data; determining whether the target servers have consistency in function and performance according to the scene period average value and/or the resource usage average value;
the scene cycle mean value refers to a time mean value of at least two scene cycles when the target server creates the target scene at least twice, the resource usage mean value refers to a mean value of resource usage rates at each data acquisition time in one scene cycle, and the scene cycle refers to a time length taken from creation to release of the target scene.
In a third aspect, the present application provides an electronic device, comprising: a processor, a memory;
the memory for storing a computer program;
the processor is used for executing the network shooting range comprehensive detection method by calling the computer program.
In a fourth aspect, the present application provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the network range integrated detection method described above.
In the technical scheme provided by the application, the target server obtains a scene file and a test script corresponding to the target scene after receiving a test task about the target scene issued by the control server; creating a target scene based on the scene file, the target scene including at least one virtual machine; starting a test script to carry out consistency test; the consistency refers to the function consistency and the performance consistency when the target server executes the test task in the target scene each time, and/or the function consistency and the performance consistency when the target server and other physical servers execute the test task in the target scene. By adopting the embodiment of the application, the core function point of the target server can be verified only, the method is easy to realize quickly and is easy to finish independently by production operators, moreover, based on a typical target scene and various built-in automatic scripts, the automatic test operation is realized under the condition of no need of personnel intervention, the consistency test on functions and performances is carried out on the target server and other servers, so that the requirement of stability verification under the condition of certain pressure is met, and the delivery quality of server products is further ensured.
Drawings
Fig. 1 is a schematic flow chart of a network shooting range comprehensive detection method shown in the present application;
FIG. 2 is a schematic diagram illustrating the components of a network shooting range comprehensive detection device according to the present application;
fig. 3 is a schematic structural diagram of an electronic device shown in the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
The embodiment of the application provides a comprehensive detection method for a network target range.
By the method, the detection and evaluation result of the integrity of the network shooting range can be obtained under the condition of less resource investment (namely, shorter time, semi-automation, less personnel intervention and the like), the method is suitable for the network shooting range complete products to be used in factory inspection, does not replace daily detailed function, performance and stability detection, is easy for non-specialized testers (such as factory quality inspection personnel or customers) to perform simple and integral verification, and ensures that each set of equipment is subjected to required inspection and delivery.
That is to say, what this application embodiment provided is a simple and easy-to-use product factory test/verification scheme, the test of basic function and the pressure test (all relate to professional tester) under the extreme condition are not in the test scope of this application embodiment, the operation object of this application embodiment is the operating personnel of production line under the default condition, for example filling deployment personnel, factory inspection personnel etc. the core content of inspection is the uniformity of equipment of leaving the factory, equipment steady operation is in certain performance pressure and observation time, the performance is unanimous, no obvious flaw can. If a deep problem or a defect (bug) under other abnormal conditions exists, the problem can be found in a subsequent long-time pressure test and reported to other departments for solving, and the requirement on the skill of personnel caused by complicated and detailed detection before delivery is avoided.
Regarding the comprehensive detection method for the network target range provided by the embodiment of the application, the execution main body of the method is the target server in the network target range, and the target server is any one server in each physical server to be detected in the network target range.
Specifically, the embodiment of the present application is functionally divided into a control server and a general server, where the control server is a physical server with a control function, and the general server is a physical server to be detected that integrates calculation, storage, and network. The network target range may include a plurality of physical servers to be detected, and the control server may be one of the physical servers or an independent server other than the physical servers. For example, the network shooting range has 20 physical servers, one of which is a control server, and the other 19 servers are servers to be detected; alternatively, the 20 servers are all servers to be detected, and one of the 20 servers is also used as a control server.
For the convenience of distinction, for each physical server to be detected, the embodiment of the present application defines it as a target server. And when the test task is executed, the servers to be tested uniformly execute the test task according to the following comprehensive detection method.
Referring to fig. 1, a schematic flow chart of a network shooting range comprehensive detection method provided in an embodiment of the present application is shown, where an execution subject of the method is a target server (i.e., any physical server to be detected in a network shooting range), and the method includes the following steps:
s101: and after receiving a test task about the target scene issued by the control server, acquiring a scene file and a test script corresponding to the target scene.
In this embodiment of the present application, an application scenario in a network target site is selected, where the application scenario is defined as a target scenario, and specifically, the target scenario may include at least 1 virtual machine, 1 switch, and 1 firewall device, for example, a minimized scenario including 1 virtual machine, 1 switch, and 1 firewall, where the virtual machine is connected to the switch, and the switch is connected to the firewall. A complex target scenario may include multiple virtual machines, multiple switches, multiple firewall devices, the definition of which may be scenario defined and described in a network target site.
It should be noted that, in the embodiment of the present application, each physical server to be detected in the network shooting range needs to be virtualized in a unified scene.
For example, assuming that there are 19 physical servers to be detected, the control server issues a test task about the target scene to each physical server, so as to build the target scene on each physical server. Specifically, the 19 physical servers are actually unified scene virtualization, taking a minimized scene including 1 virtual machine (fixed resources such as 1 core, 4G memory, 40G storage, and 100M bandwidth), 1 switch, and 1 firewall as an example, the minimized scene is a scene for testing, which may be different from an actual application scene, but for convenience of testing and verification, interference factors are reduced, and the test scene is deployed on one physical server by default. Actually, one physical server defaults to bear a plurality of test scenes, and generally defaults to support 32 virtual machines and can distribute the 32 virtual machines according to the configuration condition of the physical machines, for example, a CPU has two 16 cores, and because the switch and the firewall occupy few resources and can not be considered, 32 test scenes can be issued; the actual testing procedure is convenient for statistical analysis, and typically takes an integer number such as 20 for comparison and statistical analysis.
In the embodiment of the application, the image files, the configuration files and the like required for building the test scene environment are all placed on the control server of the network shooting range or the appointed storage nodes, and the file resources can be uniformly scheduled and used. Therefore, in this step, after the target server receives the test task about the target scene issued by the control server, the target scene is used as the current test scene, and the target server may obtain the scene text and the test script corresponding to the target scene from the control server or the agreed storage node.
The test task of the target scenario may include aspects such as a test mode, a test range, a test time, and a test object, which may be set by the test script of the target scenario to prepare for a subsequent test. Wherein:
the test mode is a pressure mode, which is a test according to a preset upper limit value of the resource utilization rate, namely, the test is performed according to the highest platform load degree;
the test range refers to independent test of the target server or joint test of the target server and other physical servers, namely, test according to physical nodes or cross-physical nodes;
the test time refers to the duration of the test, for example, the factory inspection is performed according to 48-72 hours;
the test object refers to the resource use condition of the virtual machine in the target scene, that is, the core index parameters are collected, the resource use condition of the virtual machine in each scene, such as the use condition of a CPU, a memory, a disk and network card flow, is collected in the default condition, and the data can be collected by the target server and sent to the control server.
S102: an object scene is created based on the scene file, the object scene including at least one virtual machine.
In the embodiment of the application, after the target server acquires the scene file about the target scene, the target scene may be created based on the scene file, and the target scene may include at least 1 virtual machine, at least 1 switch, and at least 1 firewall device.
S103: and starting a test script to carry out consistency test.
The consistency refers to the function consistency and the performance consistency when the target server executes the test task in the target scene each time, and/or the function consistency and the performance consistency when the target server and other physical servers execute the test task in the target scene.
In the embodiment of the application, the switch and the firewall are matched switching and security protection units and are non-user operable objects, so that only one operating object, namely a virtual machine, is provided. Therefore, comprehensive test software such as a CPU, a memory, a disk, a network card and the like can be pre-installed in the virtual machine, and an automatic operation script and parameters are set, for example, the automatic software execution is carried out according to the parameters at the appointed time after the system is started, if a plurality of operation objects exist, the mutual operation between the operation objects is involved, and automatic test tool software such as bandwidth or concurrency can be additionally set.
In an implementation manner of the embodiment of the present application, the step of opening the test script for consistency testing in S103 may include the following steps a1-a 2:
step A1: after the virtual machine is created and the test script is started, if the resource utilization rate of the virtual machine reaches a preset upper limit value, the current test state is kept until a preset test time is reached; or after the virtual machine is created and the test script is started, if the resource utilization rate of the virtual machine reaches a preset upper limit value and does not reach the preset test time, closing the target scene, and re-executing the steps of creating the virtual machine and starting the test script until the preset test time is reached.
Specifically, after the virtual machine is created and the test script is started through steps S102 and S103, the virtual machine is used to test resources such as a CPU, a memory, a disk, a network, and the like of the virtual machine by using the test program and the script which are automatically run and are built in the virtual machine, and the selection of the test software and the test items is not limited in the embodiment of the present application because the variety and the mode of the test software are many. By executing the test script, the target server is tested, and one of the following two test modes can be adopted:
in one testing mode, through detection of the testing software, a certain resource of the virtual machine will generally reach a preset upper limit of the utilization rate step by step within a certain period of time, for example, after the CPU usage load reaches 80% of the upper limit, the virtual machine will remain in the state, and the continuous running time does not exceed a preset testing time (for example, does not exceed 48 hours or other appointed time).
In another testing mode, through detection of testing software, a certain resource of the virtual machine generally gradually reaches a preset upper limit value of the utilization rate within a certain time period, for example, after a CPU utilization load reaches 80% of the upper limit value, a system shutdown program is triggered to automatically shutdown the virtual machine (i.e., close a target scene), and at this time, all resources of the target scene are automatically recovered; then, the target scene is created again and the virtual machine is started again, and the above operations are repeated, and the running time does not exceed the preset test time (such as 48 hours or other appointed time).
Step A2: and during the test time, data acquisition is carried out according to a fixed frequency, so that the control server determines whether the target server has consistency in function and performance based on the acquired data.
In the specified test time, the target server can collect data according to a fixed frequency and feed the collected data back to the control server, and the data can be used as comparison data in the aspects of functions and performances with the target server or other physical servers.
With respect to the collected data, it may include resource detection data and fault detection data. The resource detection data may include resource data of a physical machine and a virtual machine (such as a CPU, a memory, a disk IO, and a network); the fault detection data may include fault-related detection data in terms of virtual machine scheduling.
Wherein the fault detection data comprises at least one of: error reporting information in the scene running process, abnormal data in the scene running process and alarm information when resources are overloaded. The resource detection data includes at least one of: the method comprises the steps of setting up a scene, starting testing time, time when the resource utilization rate reaches a preset upper limit value, resource consumption during scene creation and resource consumption during scene interruption.
Regarding the resource detection data, specifically, the process from the beginning to the end of the target scenario relates to the scenario starting time point, the virtual machine starts to create and start, the automated test script runs, the resource usage rate reaches an upper limit value (e.g., 80%), the duration reaches a specified destruction time, the scenario resources are recovered, and the like. The data collected in this process may include not only data on resource consumption such as resource consumption when the scene is created, resource consumption when the scene is interrupted, resource consumption when the scene is created again, and the like, but also data on time such as creation time of the scene, test start time, time when the resource usage rate reaches the upper limit value, time when the scene is created again, and the like.
In the embodiment of the application, for each physical server (i.e. target server) to be detected, the acquired data is fed back to the control server, so that the control server can perform comparative analysis based on the data to check the consistency of the target server in terms of functions and performance. During the comparative analysis, the deviation condition of one or more items of data of the target server is determined, if the deviation is larger or obvious deviation appears in comparison with historical data, the target server is regarded as unqualified equipment, and the product delivery inspection standard of the network target range cannot be met.
In one implementation manner of the embodiment of the present application, the step a2 of determining whether the target server has consistency in function and performance based on the collected data may include:
determining a scene cycle average value and a resource use average value of a target server based on the acquired data; and determining whether the target server has consistency in function and performance according to the scene period average value and/or the resource usage average value. The scene cycle mean value refers to a time mean value of at least two scene cycles when the target server creates at least two target scenes, the resource usage mean value refers to a mean value of resource usage rates at each data acquisition time in one scene cycle, and the scene cycle refers to a time length spent by the target scenes from creation to release.
In the implementation mode, the target server can be compared with other physical servers, and also can be compared with the target server; if the data deviation exceeds the corresponding limited range, determining that the target server does not have consistency on function and performance; and otherwise, if the data deviation does not exceed the corresponding limited range, determining that the target server has consistency in function and performance.
Specifically, when the target server is compared with other physical servers, the scene period mean value of the target server can be compared with the scene period mean values of the other physical servers when the scene period mean value of the target server is obtained through calculation, and if the deviation is large, namely the deviation exceeds a limited range, it is determined that the target server does not have consistency in function and performance; when the target server is compared with the target server, for at least two target scenes created by the target server, each target scene corresponds to one resource use average value, each resource use average value is compared with the previous historical resource use average value, and if the deviation is large, namely the deviation exceeds a limited range, the target server is determined not to have consistency in function and performance.
Further, if the deviation of a certain item of data exceeds a limited range, targeted detection is carried out on a target scene and a target server so as to determine whether the target scene and the target server have hardware problems or software problems.
In the test process, the transmission of scene files, the creation of scenes, the operation scheduling, the recovery and the like of the control server and the detected physical server are all finished through mutual interface scheduling and are fed back to the control server, if the scene creation of a certain physical server is delayed or fails, scheduling alarm logs, resource alarms and the like exist, and the scheduling alarm logs, the resource alarms and the like belong to the detection data of a scheduling management and control program.
In the network shooting range comprehensive detection method provided by the embodiment of the application, the target server obtains the scene file and the test script corresponding to the target scene after receiving the test task about the target scene issued by the control server; creating a target scene based on the scene file, the target scene including at least one virtual machine; starting a test script to carry out consistency test; the consistency refers to the function consistency and the performance consistency when the target server executes the test task in the target scene each time, and/or the function consistency and the performance consistency when the target server and other physical servers execute the test task in the target scene. By adopting the embodiment of the application, the core function point of the target server can be verified only, the method is easy to realize quickly and is easy to finish independently by production operators, moreover, based on a typical target scene and various built-in automatic scripts, the automatic test operation is realized under the condition of no need of personnel intervention, the consistency test on functions and performances is carried out on the target server and other servers, so that the requirement of stability verification under the condition of certain pressure is met, and the delivery quality of server products is further ensured.
Referring to fig. 2, a schematic composition diagram of a network shooting range comprehensive detection apparatus provided in an embodiment of the present application is shown, where the apparatus is applied to a target server in a network shooting range, where the target server is any one of physical servers to be detected in the network shooting range, and the apparatus includes:
the file obtaining unit 210 is configured to obtain a scene file and a test script corresponding to a target scene after receiving a test task about the target scene issued by a control server;
a scene creating unit 220, configured to create the target scene based on the scene file, where the target scene includes at least one virtual machine;
the comprehensive detection unit 230 is used for starting the test script to perform consistency test; the consistency refers to the function consistency and the performance consistency of the target server executing the test task in the target scene each time, and/or the function consistency and the performance consistency of the target server and other physical servers executing the test task in the target scene.
In an implementation manner of the embodiment of the present application, the test task includes a test mode, a test range, a test time, and a test object, where:
the test mode is to test according to a preset upper limit value of the resource utilization rate;
the test range refers to independent test of the target server or joint test of the target server and other physical servers;
the test time refers to the duration of the test;
the test object refers to the resource use condition of the virtual machine in the target scene.
In an implementation manner of the embodiment of the present application, the comprehensive detecting unit 230 includes:
the comprehensive detection subunit is used for maintaining the current test state until the preset test time is reached if the resource utilization rate of the virtual machine reaches a preset upper limit value after the virtual machine is created and the test script is started; or after the virtual machine is created and the test script is started, if the resource utilization rate of the virtual machine reaches a preset upper limit value and does not reach a preset test time, closing the target scene, and re-executing the steps of creating the virtual machine and starting the test script until the preset test time is reached;
and the consistency determining subunit is used for acquiring data according to a fixed frequency in the test time so that the control server determines whether the target server has consistency in function and performance based on the acquired data.
In an implementation manner of the embodiment of the present application, the collected data includes resource detection data and fault detection data.
In an implementation manner of the embodiment of the present application, the resource detection data includes at least one of:
the method comprises the steps of setting up a scene, starting testing time, time when the resource utilization rate reaches a preset upper limit value, resource consumption during scene creation and resource consumption during scene interruption.
In an implementation manner of the embodiment of the present application, the fault detection data includes at least one of the following:
error reporting information in the scene running process, abnormal data in the scene running process and alarm information when resources are overloaded.
In an implementation manner of the embodiment of the present application, the consistency determining subunit is specifically configured to perform data acquisition according to a fixed frequency within the test time, so that the control server determines a scene cycle average value and a resource usage average value of the target server based on the acquired data; determining whether the target servers have consistency in function and performance according to the scene period average value and/or the resource usage average value;
the scene cycle mean value refers to a time mean value of at least two scene cycles when the target server creates the target scene at least twice, the resource usage mean value refers to a mean value of resource usage rates at each data acquisition time in one scene cycle, and the scene cycle refers to a time length taken from creation to release of the target scene.
The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the application. One of ordinary skill in the art can understand and implement it without inventive effort.
An embodiment of the present application further provides an electronic device, a schematic structural diagram of the electronic device is shown in fig. 3, the electronic device 3000 includes at least one processor 3001, a memory 3002, and a bus 3003, and the at least one processor 3001 is electrically connected to the memory 3002; the memory 3002 is configured to store at least one computer-executable instruction, and the processor 3001 is configured to execute the at least one computer-executable instruction so as to perform the steps of any one of the network range integrated detection methods as provided by any one of the embodiments or any one of the alternative embodiments of the present application.
Further, the processor 3001 may be an FPGA (Field-Programmable Gate Array) or other devices with logic processing capability, such as an MCU (micro controller Unit) and a CPU (Central processing Unit).
By applying the embodiment of the application, only the core function point of the target server can be verified, the method is easy to realize quickly, and is also easy to finish independently by production operators, and based on a typical target scene and various built-in automatic scripts, the automatic test operation is realized under the condition of no need of personnel intervention, and the consistency test on functions and performances is carried out on the target server and other servers, so that the requirement of stability verification under the condition of certain pressure is met, and further the delivery quality of server products is guaranteed.
The embodiments of the present application further provide another computer-readable storage medium, which stores a computer program, and the computer program is configured to, when executed by a processor, implement the steps of any one of the network range comprehensive detection methods provided in any one of the embodiments or any one of the optional implementation manners of the present application.
The computer-readable storage medium provided by the embodiments of the present application includes, but is not limited to, any type of disk including floppy disks, hard disks, optical disks, CD-ROMs, and magneto-optical disks, ROMs (Read-Only memories), RAMs (Random Access memories), EPROMs (Erasable Programmable Read-Only memories), EEPROMs (Electrically Erasable Programmable Read-Only memories), flash memories, magnetic cards, or optical cards. That is, a readable storage medium includes any medium that stores or transmits information in a form readable by a device (e.g., a computer).
By applying the embodiment of the application, only the core function point of the target server can be verified, the method is easy to realize quickly, and is also easy to finish independently by production operators, and based on a typical target scene and various built-in automatic scripts, the automatic test operation is realized under the condition of no need of personnel intervention, and the consistency test on functions and performances is carried out on the target server and other servers, so that the requirement of stability verification under the condition of certain pressure is met, and further the delivery quality of server products is guaranteed.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.
Claims (10)
1. A comprehensive detection method for a network shooting range is characterized in that an execution main body of the method is a target server in the network shooting range, the target server is any one of physical servers to be detected in the network shooting range, and the method comprises the following steps:
after receiving a test task about a target scene issued by a control server, acquiring a scene file and a test script corresponding to the target scene;
creating the target scene based on the scene file, the target scene including at least one virtual machine;
starting the test script to carry out consistency test; the consistency refers to the function consistency and the performance consistency of the target server executing the test task in the target scene each time, and/or the function consistency and the performance consistency of the target server and other physical servers executing the test task in the target scene.
2. The method of claim 1, wherein the test task comprises a test mode, a test scope, a test time, a test object, wherein:
the test mode is to test according to a preset upper limit value of the resource utilization rate;
the test range refers to independent test of the target server or joint test of the target server and other physical servers;
the test time refers to the duration of the test;
the test object refers to the resource use condition of the virtual machine in the target scene.
3. The method according to claim 1 or 2, wherein the starting the test script for consistency testing comprises:
after the virtual machine is created and the test script is started, if the resource utilization rate of the virtual machine reaches a preset upper limit value, the current test state is kept until a preset test time is reached; or after the virtual machine is created and the test script is started, if the resource utilization rate of the virtual machine reaches a preset upper limit value and does not reach a preset test time, closing the target scene, and re-executing the steps of creating the virtual machine and starting the test script until the preset test time is reached;
and in the test time, data acquisition is carried out according to a fixed frequency, so that the control server determines whether the target server has consistency in function and performance based on the acquired data.
4. The method of claim 3, wherein the collected data comprises resource detection data and fault detection data.
5. The method of claim 4, wherein the resource detection data comprises at least one of:
the method comprises the steps of setting up a scene, starting testing time, time when the resource utilization rate reaches a preset upper limit value, resource consumption during scene creation and resource consumption during scene interruption.
6. The method of claim 4, wherein the fault detection data comprises at least one of:
error reporting information in the scene running process, abnormal data in the scene running process and alarm information when resources are overloaded.
7. The method of claim 3, wherein determining whether the target server is consistent in function and performance based on the collected data comprises:
determining a scene cycle mean value and a resource usage mean value of the target server based on the acquired data; determining whether the target servers have consistency in function and performance according to the scene period average value and/or the resource usage average value;
the scene cycle mean value refers to a time mean value of at least two scene cycles when the target server creates the target scene at least twice, the resource usage mean value refers to a mean value of resource usage rates at each data acquisition time in one scene cycle, and the scene cycle refers to a time length taken from creation to release of the target scene.
8. The comprehensive detection device for the network target range is characterized in that the device is applied to a target server in the network target range, the target server is any one of physical servers to be detected in the network target range, and the device comprises:
the file acquisition unit is used for acquiring a scene file and a test script corresponding to a target scene after receiving a test task about the target scene issued by the control server;
a scene creating unit, configured to create the target scene based on the scene file, where the target scene includes at least one virtual machine;
the comprehensive detection unit is used for starting the test script to carry out consistency test; the consistency refers to the function consistency and the performance consistency of the target server executing the test task in the target scene each time, and/or the function consistency and the performance consistency of the target server and other physical servers executing the test task in the target scene.
9. An electronic device, comprising: a processor, a memory;
the memory for storing a computer program;
the processor is configured to execute the network range integrated detection method according to any one of claims 1 to 7 by calling the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the network range integrated detection method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210099326.9A CN114416589B (en) | 2022-01-27 | 2022-01-27 | Network target range comprehensive detection method, device, equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210099326.9A CN114416589B (en) | 2022-01-27 | 2022-01-27 | Network target range comprehensive detection method, device, equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114416589A true CN114416589A (en) | 2022-04-29 |
| CN114416589B CN114416589B (en) | 2022-09-16 |
Family
ID=81279661
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210099326.9A Active CN114416589B (en) | 2022-01-27 | 2022-01-27 | Network target range comprehensive detection method, device, equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114416589B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115225535A (en) * | 2022-07-27 | 2022-10-21 | 济南浪潮数据技术有限公司 | Consistency detection method of cloud platform and related components |
| CN116319482A (en) * | 2023-05-22 | 2023-06-23 | 南京赛宁信息技术有限公司 | Wazuh-based custom probe acquisition system and method in network target range |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104461856A (en) * | 2013-09-22 | 2015-03-25 | 阿里巴巴集团控股有限公司 | Performance test method, device and system based on cloud computing platform |
| US20150229725A1 (en) * | 2014-02-12 | 2015-08-13 | International Business Machines Corporation | Defining multi-channel tests system and method |
| CN105577475A (en) * | 2015-12-28 | 2016-05-11 | 上海瀚之友信息技术服务有限公司 | Automatic performance test system and method |
| CN108108297A (en) * | 2016-11-25 | 2018-06-01 | 腾讯科技（深圳）有限公司 | The method and apparatus of automatic test |
| CN110716861A (en) * | 2019-08-31 | 2020-01-21 | 苏州浪潮智能科技有限公司 | Server testing system, method and device |
| CN111324519A (en) * | 2020-02-21 | 2020-06-23 | 浪潮电子信息产业股份有限公司 | Compatibility testing method, system, device and readable storage medium |
| CN113971130A (en) * | 2021-10-27 | 2022-01-25 | 腾讯科技（深圳）有限公司 | Software performance testing method, device, equipment and storage medium |
-
2022
- 2022-01-27 CN CN202210099326.9A patent/CN114416589B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104461856A (en) * | 2013-09-22 | 2015-03-25 | 阿里巴巴集团控股有限公司 | Performance test method, device and system based on cloud computing platform |
| US20150229725A1 (en) * | 2014-02-12 | 2015-08-13 | International Business Machines Corporation | Defining multi-channel tests system and method |
| CN105577475A (en) * | 2015-12-28 | 2016-05-11 | 上海瀚之友信息技术服务有限公司 | Automatic performance test system and method |
| CN108108297A (en) * | 2016-11-25 | 2018-06-01 | 腾讯科技（深圳）有限公司 | The method and apparatus of automatic test |
| CN110716861A (en) * | 2019-08-31 | 2020-01-21 | 苏州浪潮智能科技有限公司 | Server testing system, method and device |
| CN111324519A (en) * | 2020-02-21 | 2020-06-23 | 浪潮电子信息产业股份有限公司 | Compatibility testing method, system, device and readable storage medium |
| CN113971130A (en) * | 2021-10-27 | 2022-01-25 | 腾讯科技（深圳）有限公司 | Software performance testing method, device, equipment and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115225535A (en) * | 2022-07-27 | 2022-10-21 | 济南浪潮数据技术有限公司 | Consistency detection method of cloud platform and related components |
| CN116319482A (en) * | 2023-05-22 | 2023-06-23 | 南京赛宁信息技术有限公司 | Wazuh-based custom probe acquisition system and method in network target range |
| CN116319482B (en) * | 2023-05-22 | 2023-08-22 | 南京赛宁信息技术有限公司 | Wazuh-based custom probe acquisition system and method in network target range |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114416589B (en) | 2022-09-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114416589B (en) | Network target range comprehensive detection method, device, equipment and readable storage medium | |
| CN108399114B (en) | System performance testing method and device and storage medium | |
| US10635473B2 (en) | Setting support program, setting support method, and setting support device | |
| CN105787364B (en) | Automatic testing method, device and system for tasks | |
| CN112769810B (en) | Firewall testing method and device, nonvolatile storage medium and electronic device | |
| CN106850330B (en) | Intelligent cloud desktop performance test system and method | |
| CN111124911A (en) | Automatic testing method, device, equipment and readable storage medium | |
| CN107797914A (en) | Code process method, apparatus and code delivery system | |
| CN109522181B (en) | Performance test method, device and equipment of distributed storage system | |
| CN111258591A (en) | Program deployment task execution method and device, computer equipment and storage medium | |
| CN112115005A (en) | Test data acquisition method and device, computer equipment and storage medium | |
| CN111181800A (en) | Test data processing method and device, electronic equipment and storage medium | |
| CN114064465A (en) | Stability testing method based on Linux cloud platform | |
| CN113590337A (en) | Method and device for automatically adjusting cloud host configuration in cloud environment | |
| CN105897498A (en) | Business monitoring method and device | |
| CN105204975A (en) | Performance monitoring system and method based on JavaEE system structure | |
| CN105405220A (en) | Method and device for automated test | |
| CN115237441A (en) | Upgrade test method, device and medium based on cloud platform | |
| CN115733741A (en) | Abnormal scene testing method and device for system to be tested | |
| CN110825466B (en) | Program jamming processing method and jamming processing device | |
| CN114385498A (en) | Performance test method, system, computer equipment and readable storage medium | |
| CN111090553B (en) | Test system, test method and test device | |
| CN113918459A (en) | Self-detection method for script performance test | |
| US20110154356A1 (en) | Methods and apparatus to benchmark software and hardware | |
| CN108062471B (en) | Risk processing method and device in cloud computing network operation process |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 100094 103, building 6, yard 9, FengHao East Road, Haidian District, Beijing Patentee after: Yongxin Zhicheng Technology Group Co.,Ltd. Address before: 100094 103, building 6, yard 9, FengHao East Road, Haidian District, Beijing Patentee before: BEIJING YONGXIN ZHICHENG TECHNOLOGY CO.,LTD. |
|
| CP01 | Change in the name or title of a patent holder |