CN113190248A - Virtualization-based web system upgrade test method and server - Google Patents

Virtualization-based web system upgrade test method and server Download PDF

Info

Publication number
CN113190248A
CN113190248A CN202110467393.7A CN202110467393A CN113190248A CN 113190248 A CN113190248 A CN 113190248A CN 202110467393 A CN202110467393 A CN 202110467393A CN 113190248 A CN113190248 A CN 113190248A
Authority
CN
China
Prior art keywords
upgrading
version
web system
virtualized
tested
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110467393.7A
Other languages
Chinese (zh)
Inventor
高学玲
刘敏
刘丽君
赵博
周黎
樊志甲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nsfocus Technologies Inc
Nsfocus Technologies Group Co Ltd
Original Assignee
Nsfocus Technologies Inc
Nsfocus Technologies Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nsfocus Technologies Inc, Nsfocus Technologies Group Co Ltd filed Critical Nsfocus Technologies Inc
Priority to CN202110467393.7A priority Critical patent/CN113190248A/en
Publication of CN113190248A publication Critical patent/CN113190248A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/60Software deployment
    • G06F8/65Updates
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0803Configuration setting
    • H04L41/0813Configuration setting characterised by the conditions triggering a change of settings
    • H04L41/082Configuration setting characterised by the conditions triggering a change of settings the condition being updates or upgrades of network functionality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/085Retrieval of network configuration; Tracking network configuration history
    • H04L41/0859Retrieval of network configuration; Tracking network configuration history by keeping history of different configuration generations or by rolling back to previous configuration versions
    • H04L41/0863Retrieval of network configuration; Tracking network configuration history by keeping history of different configuration generations or by rolling back to previous configuration versions by rolling back to previous configuration versions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0866Checking the configuration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/50Testing arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45562Creating, deleting, cloning virtual machine instances

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention relates to a virtualization-based web system upgrade test method and a server, relating to the technical field of software upgrade, wherein the method comprises the following steps: aiming at any one historical version of the virtualized web system, switching the virtualized web system from the current version to the historical version according to snapshot information of the historical version, and taking the virtualized web system switched to the historical version as a virtualized test web system; the snapshot information of the historical version is backup of one state of the historical version based on a virtualization technology; upgrading the virtualized test web system by using an upgrade package of the version to be tested; and detecting the upgraded virtualized test web system in a preset detection mode to obtain an upgrade result from the historical version to the version needing to be tested. The embodiment of the invention obtains the upgrading result by testing whether the historical version can be directly upgraded to the version to be tested in advance, thereby providing a basis for upgrading.

Description

Virtualization-based web system upgrade test method and server
Technical Field
The invention relates to the technical field of software upgrading, in particular to a virtualization-based web system upgrading test method and a server.
Background
With the continuous development of virtualization technology, the version of a virtualized web system is mature more and more, and many software systems continuously release the virtualized version while supporting hardware products. However, the strength of the dependency of different web system versions is different, for example, when the version of one web system is 6.0.3.0, the version 6.0.3.0 can upgrade the 6.0.3.1 version or the 6.0.4.0 version, but not upgrade to other versions. Therefore, since each user using the web system may use different versions, the upgrade process may fail because the version currently used by the user cannot be upgraded to the latest version.
Disclosure of Invention
The invention provides a virtualization-based web system upgrade test method and a server, which are used for solving the problem of upgrade failure caused by the fact that a historical version cannot be compatible with a new version due to the fact that the new version is directly released in the prior art.
In a first aspect, an embodiment of the present invention provides a virtualization-based web system upgrade testing method, including:
aiming at any one historical version of a virtualized web system, switching the virtualized web system from a current version to the historical version according to snapshot information of the historical version, and taking the virtualized web system switched to the historical version as a virtualized test web system; wherein the snapshot information of the historical version is a backup of a state of the historical version based on virtualization technology;
upgrading the virtualized test web system by using an upgrade package of the version to be tested;
and detecting the upgraded virtualized test web system in a preset detection mode to obtain an upgrade result from the historical version to the version needing to be tested.
The method comprises the steps of taking a snapshot of the virtualized web system of the historical version through the snapshot function of the virtualized web system for each historical version of the virtualized web system, saving the running data of the virtualized web system, switching the version of the virtualized web system to the historical version according to the saved data when testing, upgrading the virtualized web system of the historical version to the version to be tested, and finally testing whether the historical version can be directly upgraded to the version to be tested or not. The successful probability of upgrading is improved.
In one possible implementation manner, there are multiple preset upgrading manners; the upgrading process is carried out on the virtualized test web system by using the upgrading package of the version to be tested, and comprises the following steps:
aiming at any one upgrading mode, upgrading the virtualized test web system by using the operation script corresponding to the upgrading mode and the upgrading packet of the version to be tested; and the upgrading mode is a version upgrading mode supported by the virtualized test web system.
Considering that different upgrading methods may be adopted by a user during actual upgrading, the method can also adopt each upgrading mode to upgrade the virtualized test web system during testing, and test whether each upgrading mode can be successfully upgraded or not, so that the comprehensiveness of the upgraded test is improved.
In a possible implementation manner, if the upgrading manner is manual upgrading, the operation script corresponding to the manual upgrading is generated by uploading the upgrading package of the version to be tested to the virtualized test web system through the upgrading interface of the virtualized test web system to start upgrading according to the version to be tested downloaded from the upgrading site by the user;
if the upgrading mode is semi-automatic upgrading, the operation script corresponding to the semi-automatic upgrading is generated by the operation steps of producing description information of the upgrading packet of the version to be tested at the upgrading site according to the upgrading packet of the version to be upgraded, uploading the upgrading packet of the version to be tested to the upgrading site, triggering an upgrading button after upgrading site information is set in the virtualized test web system according to a user, and upgrading the virtualized test web system;
if the upgrading mode is automatic upgrading, the operation script corresponding to the automatic upgrading is generated by the operation steps of generating description information of the upgrading packet of the version to be upgraded at the upgrading site according to the upgrading packet of the version to be upgraded, uploading the upgrading packet of the version to be tested to the upgrading site, setting timing upgrading according to the condition that a user arrives in the virtualized test web system, and performing timing upgrading on the virtualized test web system.
According to the method, the virtualized web system can be upgraded in different upgrading modes through the scripts of the actual operation steps of each upgrading mode, so that the full automation of the operation process is realized, and the testing efficiency is improved.
In a possible implementation manner, the preset detection manner includes some or all of the following:
detecting whether the upgrading packet of the version to be tested can be subjected to system upgrading on the virtualized test web system;
detecting whether the completion time of each upgrading step in the upgrading process of the virtualized test web system is within the preset timeout time corresponding to the upgrading step;
detecting whether the version number of the upgraded virtualized test web system is the same as the version number of the version to be tested;
and detecting whether the functions appointed in the upgraded virtualized test web system are the functions in the version needing to be tested.
The method can obtain the upgrading result from the detection of the upgrading in all aspects from the fact that whether the upgrading packet is normally uploaded to the virtualized web system, whether the finishing time of the upgrading step is within the preset time corresponding to the upgrading step, whether the version number displayed by the upgraded system is the same as the version number of the version to be tested and whether the newly added function in the upgraded virtualized web system is the function in the version to be tested, so that the upgrading result can be obtained, the problems in the upgrading process can be known more, and more comprehensive basis can be provided for upgrading.
In one possible implementation manner, before performing an upgrade process on the virtualized test web system by using an upgrade package of a version to be tested, the method further includes:
determining that the virtualized test web system is in a powered-on state.
The method can be used for upgrading the virtualized test web system in the starting-up state, and the problem that the startup and shutdown state of the virtualized test web system cannot be upgraded during testing is avoided.
In one possible implementation, the method further includes:
if the virtualized test web system is determined to be in a power-off state, controlling the virtualized test web system to be powered on, and detecting the state of an external access port of the virtualized test web system;
and if the state of the external access port is an open state, determining that the virtualized test web system is started.
According to the method, the virtualized test web system can be controlled to be started up when the test web system is shut down, the starting-up state of the virtualized test web system is detected by detecting the state of the external access port of the virtualized test web system, and the test web system is started to be upgraded when the test web system is started, so that the problem that the starting-up state of the virtualized test web system cannot be upgraded when the test web system is started up is solved.
In a second aspect, an embodiment of the present invention provides a server, including: a processor and a memory;
the memory is used for storing program codes used when the server runs;
the processor is configured to execute the program code to implement the following processes:
aiming at any one historical version of a virtualized web system, switching the virtualized web system from a current version to the historical version according to snapshot information of the historical version, and taking the virtualized web system switched to the historical version as a virtualized test web system; wherein the snapshot information of the historical version is a backup of a state of the historical version based on virtualization technology;
upgrading the virtualized test web system by using an upgrade package of the version to be tested;
and detecting the upgraded virtualized test web system in a preset detection mode to obtain an upgrade result from the historical version to the version needing to be tested.
In one possible implementation manner, there are multiple preset upgrading manners; the processor is specifically configured to:
aiming at any one upgrading mode, upgrading the virtualized test web system by using the operation script corresponding to the upgrading mode and the upgrading packet of the version to be tested; and the upgrading mode is a version upgrading mode supported by the virtualized test web system.
In a possible implementation manner, if the upgrading manner is manual upgrading, the operation script corresponding to the manual upgrading is generated by uploading the upgrading package of the version to be tested to the virtualized test web system through the upgrading interface of the virtualized test web system to start upgrading according to the version to be tested downloaded from the upgrading site by the user;
if the upgrading mode is semi-automatic upgrading, the operation script corresponding to the semi-automatic upgrading is generated by the operation steps of producing description information of the upgrading packet of the version to be tested at the upgrading site according to the upgrading packet of the version to be upgraded, uploading the upgrading packet of the version to be tested to the upgrading site, triggering an upgrading button after upgrading site information is set in the virtualized test web system according to a user, and upgrading the virtualized test web system;
if the upgrading mode is automatic upgrading, the operation script corresponding to the automatic upgrading is generated by the operation steps of generating description information of the upgrading packet of the version to be upgraded at the upgrading site according to the upgrading packet of the version to be upgraded, uploading the upgrading packet of the version to be tested to the upgrading site, setting timing upgrading according to the condition that a user arrives in the virtualized test web system, and performing timing upgrading on the virtualized test web system.
In a possible implementation manner, the preset detection manner includes some or all of the following:
detecting whether the upgrading packet of the version to be tested can be subjected to system upgrading on the virtualized test web system;
detecting whether the completion time of each upgrading step in the upgrading process of the virtualized test web system is within the preset timeout time corresponding to the upgrading step;
detecting whether the version number of the upgraded virtualized test web system is the same as the version number of the version to be tested;
and detecting whether the functions appointed in the upgraded virtualized test web system are the functions in the version needing to be tested.
In one possible implementation, the processor is further configured to:
determining that the virtualized test web system is in a powered-on state.
In one possible implementation, the processor is further configured to:
if the virtualized test web system is determined to be in a power-off state, controlling the virtualized test web system to be powered on, and detecting the state of an external access port of the virtualized test web system;
and if the state of the external access port is an open state, determining that the virtualized test web system is started.
In a third aspect, the present application further provides a computer storage medium, on which a computer program is stored, which when executed by a processing unit, implements the steps of the virtualization-based web system upgrade testing method according to the first aspect.
In addition, for technical effects brought by any one implementation manner of the second aspect and the third aspect, reference may be made to technical effects brought by different implementation manners of the first aspect, and details are not described here.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention and are not to be construed as limiting the invention.
FIG. 1 is a flow diagram of a preparation before upgrade testing of a virtualized web system provided in accordance with an embodiment of the present invention;
FIG. 2 is a flowchart of a virtualization-based web system upgrade testing method according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating an upgrade result provided according to an embodiment of the present invention;
FIG. 4 is a flowchart of a method for testing integrity of a virtualization-based web system upgrade provided in accordance with an embodiment of the present invention;
FIG. 5 is a flowchart of another virtualization-based web system upgrade test completion method provided in accordance with an embodiment of the present invention;
fig. 6 is a block diagram of a server provided according to an embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.
The application scenario described in the embodiment of the present invention is for more clearly illustrating the technical solution of the embodiment of the present invention, and does not form a limitation on the technical solution provided in the embodiment of the present invention, and it can be known by a person skilled in the art that with the occurrence of a new application scenario, the technical solution provided in the embodiment of the present invention is also applicable to similar technical problems.
Since each user using the virtualized web system may use different versions and different versions have different dependencies, if a new version is directly released, a problem that the version currently used by the user cannot be upgraded to the latest version, which may result in an upgrade failure, may occur.
In summary, the embodiment of the present invention provides a scheme, which can upgrade all released historical versions to new versions before releasing the new versions to obtain test results, so as to early warn all situations occurring in the upgrade process, provide a basis for the upgrade, effectively avoid the problem of upgrade failure caused by the fact that the historical versions cannot be compatible with the new versions, and improve the probability of upgrade success.
Before describing the scheme of the embodiment of the present invention, terms appearing in the present invention are explained first:
virtualized web system: refers to a logical computer system with complete hardware functionality, including operating systems and applications, running in an isolated environment using virtualization technology.
Snapshot: a snapshot is a "copy" of the virtualized web system at a point in time, based on a backup of a state of the historical version of the virtualization technique, so that the virtualized web system can be restored to that point in time after a failure.
And (3) system upgrading: is an operation to complete an update of a subsequent version from some earlier version.
Manual upgrading: uploading an upgrade package to a virtualized web system by a user for upgrading;
semi-automatic upgrading: after a user clicks an upgrade button on equipment, an upgrade site uploads an upgrade package to a virtualized web system after receiving an upgrade command, and the virtualized web system is upgraded;
automatic upgrading: and performing networking upgrade through an upgrade site, and storing the upgrade package and a description file of key information of the upgrade package by the upgrade site.
Selenium: a tool for testing a user web application program and realizing the function test of a simulation web interface.
The embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
First, preparation for an upgrade test of the virtualized web system is required.
Referring to fig. 1, an embodiment of the present invention provides a preparation process before an upgrade test:
s100: acquiring all released historical versions from an upgrading site;
s101: installing a base version of the virtualized web system in a server;
s102: collecting snapshot information of all historical versions by using a snapshot function of a virtualized web system;
s103: and generating an upgrade package of the version needing to be tested.
Illustratively, the embodiment of the present invention obtains snapshot information of all published history versions by the following method:
aiming at any historical version of the virtualized web system, upgrading the virtualized web system by using an upgrade package of the historical version, and after the upgrading is finished, photographing the current virtualized web system by using a snapshot function of the virtualized web system to obtain snapshot information of the historical version.
For example, when the snapshot information of all the historical versions is obtained, the snapshot information of all the historical versions may be collected in sequence according to the release time of the historical versions.
However, when two versions adjacent in the release time cannot be upgraded from the version with the longer release time to the version with the shorter release time, the collection process may be continued as follows:
firstly: determining a version which can be directly upgraded to a version with longer release time in the historical versions without snapshots, and determining a version which can be directly upgraded to a version with shorter release time in the historical versions with snapshots;
upgrading the virtualized web system of the version with longer release time by using an upgrade package of the version which can be directly upgraded in the historical version without snapshot and photographing the current virtualized web system by using the virtualized web system snapshot function after upgrading is finished to obtain snapshot information of the version which can be directly upgraded in the historical version without snapshot and can be determined by the version with longer release time;
switching the virtualized web system from the version which is determined to be directly upgraded to the version with shorter release time in the historical version which takes the snapshot by utilizing the recovery function of the virtualized web system;
upgrading the virtualized web system which is determined in the snapshot-taken historical version and can be directly upgraded to the version with shorter release time by using the upgrade package which is determined in the snapshot-taken historical version and can be directly upgraded to the version with shorter release time, and after the upgrade is finished, taking a picture of the current virtualized web system by using the virtualized web system snapshot function to obtain the snapshot information of the version with shorter release time.
And then continuously collecting the snapshot information of the historical version according to the release time.
For example, the history versions in sequence according to the release time are: version A, version B, version C, version D, version E, version F, version G and version H;
according to the sequence of the release time, when the snapshot information of the historical version is collected in sequence, if the version D cannot be directly upgraded to the version E, determining a version, such as the version F, of which the version D can be directly upgraded from the version F, the version G and the version H;
determining a version capable of being upgraded to the version E directly from the version A, the version B and the version C, such as the version B;
firstly, upgrading the version D to the version F, and collecting snapshot information of the version F; and then restoring the virtualized web system from the version F to the version B according to the snapshot information of the version B, upgrading the version B to the version E, collecting the snapshot information of the version E, then starting from the version E, checking whether the version E can be directly upgraded to the version G, and the like until all historical versions are collected.
And secondly, carrying out upgrading test by using the collected snapshot information of all the historical versions.
Referring to fig. 2, an embodiment of the present invention provides a method for testing an upgrade of a virtualized web system, including:
s200: aiming at any one historical version of the virtualized web system, switching the virtualized web system from the current version to the historical version according to snapshot information of the historical version, and taking the virtualized web system switched to the historical version as a virtualized test web system.
Wherein the historical version is the version already released. The snapshot information of the historical version is backup of one state of the historical version based on virtualization technology;
s201: and upgrading the virtualized test web system by using the upgrade package of the version to be tested.
For example, since the virtualized web system may be in a power-off state or a power-on state when the snapshot information of the historical version is collected, in order to perform the test normally, it is first required to determine whether the virtualized test web system is in the power-on state before performing step 201.
If the virtualized test web system is determined to be in a power-off state, controlling the virtualized test web system to be powered on, and detecting the state of an external access port of the virtualized test web system;
and if the state of the external access port is the opening state, determining that the virtualized test web system is started.
After the start-up is completed, the virtualized test web system can normally obtain the upgrade package of the version to be tested, so that the upgrade process of the virtualized test web system is completed.
S202: and detecting the upgraded virtualized test web system in a preset detection mode to obtain an upgrade result from the historical version to the version needing to be tested.
Illustratively, the invention mainly detects whether the upgrade is successful from two aspects, one is from the upgrade process, and the second is from the detection of the upgraded virtualized web system after the upgrade is successful.
The preset detection mode comprises the following parts or all of the following detection modes:
mode 1: detecting whether the upgrading package of the version to be tested can be subjected to system upgrading on the virtualized test web system;
mode 2: detecting whether the completion time of each upgrading step in the upgrading process of the virtualized test web system is within the preset timeout time corresponding to the upgrading step;
mode 3: detecting whether the version number of the upgraded virtualized test web system is the same as the version number of the version needing to be tested;
mode 4: and detecting whether the functions specified in the upgraded virtualized test web system are the functions in the version needing to be tested. Wherein the specified functions include the added function and the optimized previous function.
In detail, when the upgrade process is performed, the data of the upgrade process is recorded, and all the detection modes are realized by using the recorded data.
And detecting whether the upgrade package can be uploaded to the web system for testing virtualization through the recorded data, if so, passing the detection, and if not, failing to pass the detection.
The preset timeout time includes preset upload time, preset write time corresponding to different types of data, and the like. May be based on the completion time of each upgrade step in the virtualized test web system upgrade process.
In the upgrading process, each step of upgrading detects completion time, for example, time for uploading the upgrade package, time for writing different types of data in the upgrade package into different places respectively, and the like. If the time for uploading the upgrade package is within the preset uploading time and the time required for writing the different types of data in the upgrade package into different places respectively is within the corresponding preset writing time, the detection of the completion time of each upgrade step in the upgrade process is passed, and if one item exceeds the corresponding preset timeout time, for example, the time for uploading the upgrade package is not within the range of the preset uploading time, or the time required for writing the different types of data in the upgrade package into different places respectively is not within the corresponding preset writing time, the detection of the completion time of each upgrade step in the upgrade process is not passed.
When the upgraded virtualized test web system is detected, the virtualized test web system needs to be logged in, and then the detection test of the upgraded virtualized test web system is completed.
For example, the virtualized test web system may have a version number of a version currently used by the virtualized test web system on a fixed page, an operation process is simulated through a selenium tool, the operation process includes logging in the virtualized test web system, acquiring the version number of the virtualized test web system through the fixed page, and then detecting whether the version number is the version number of the version needing to be tested. If so, the test passes, otherwise, the test fails.
For another example: if the upgrade is successful, the upgraded virtualized test web system is the virtualized test web system of the version needing to be tested, so the newly added functions of the virtualized test web system are the functions in the version needing to be tested. The new function of the version to be tested can be determined by looking at the function introduction of the version to be tested, the operation process can be simulated by the tool selenium, the operation process can realize logging in the virtualized test web system, the function of the version to be tested is found in the virtualized test web system, if all the functions can be found, the item passes, and if the functions cannot be found, the item does not pass.
Illustratively, if the detection is performed by all the detection modes, whether each item of detection passes or not is recorded, if all items of detection pass, the obtained upgrading result is passed, and if any item of detection does not pass, the upgrading result is failed.
Referring to fig. 3, an example of an upgrade result is shown, where the first item detects whether the upgrade package of the version to be tested can be subjected to system upgrade on the virtualized test web system, and the second item detects whether the completion time of each upgrade step in the upgrade process of the virtualized test web system is within a preset timeout time corresponding to the upgrade step; the third item detects whether the version number of the upgraded virtualized test web system is the same as the version number of the version needing to be tested; and a fourth item is used for detecting whether the functions appointed in the upgraded virtualized test web system are the functions in the version needing to be tested, if the functions pass through, the back of the upgraded virtualized test web system is painted with black, if the functions do not pass through, the back of the upgraded virtualized test web system is painted with black, if the functions pass through, the upgrade result is marked as successful, and if one of the functions does not pass through, the upgrade result is marked as failed.
The upgrade result can include the screenshot information of the upgrade process and all recorded information of the upgrade process in addition to each detection result.
As shown in fig. 4, an embodiment of the present invention provides a complete upgrade test process, including:
s400: selecting one historical version which is not tested from the historical versions; the selection can be realized according to the name of the historical version, and the historical version is selected by selecting the name of the historical version and mapping;
s401: and switching the virtualized web system from the current version to the historical version according to the snapshot information of the historical version, and taking the virtualized web system switched to the historical version as a virtualized test web system. For example, when all history versions are snapshot, the snapshot information may be named, and when switching is performed, the snapshot information of the corresponding history version may be called according to the name of the snapshot information of the selected history version, and switching to the corresponding history version may be performed.
S402: detecting whether the state of an external access port of the virtualized test web system is an open state, if so, executing S403; otherwise, executing S404;
s403: upgrading the virtualized test web system by using an upgrade package of the version to be tested;
s404: controlling the virtualized test web system to start and returning to the step S402;
s405: detecting the virtualized test web system in a detection mode in the upgrading process to obtain a detection result; the mode 1 and the mode 2 are detection modes in the upgrading process.
S406: logging in the upgraded virtualized test web system, and detecting the upgraded virtualized test web system in an upgraded detection mode to obtain a detection result, wherein the mode 3 and the mode 4 are the upgraded detection modes.
S407: determining an upgrading result according to a detection result corresponding to the detection mode in the upgrading process and a detection result corresponding to the detection mode after upgrading;
s408: and judging whether all the historical versions obtain the upgrading result, if so, ending, otherwise, executing S400.
By the method, each historical version can be upgraded to the version to be tested by using the snapshot function of the virtualized web system before the new version is released, the upgrade test is performed to obtain the detection result, all possibilities of the version to be tested are comprehensively tested, reference can be provided for the upgrade of the new version, and the upgrade success probability is improved.
In order to test all upgrading processes more comprehensively, the invention also provides a plurality of preset upgrading modes, and then aiming at any one upgrading mode, the operation script corresponding to the upgrading mode and the upgrading package of the version to be tested are used for upgrading the virtualized test web system; the upgrading mode is a mode of uploading an upgrading package of the version to be tested to the virtualized testing web system.
For example, if the number of preset upgrade modes is N, then when upgrading from a historical version to a version to be tested, N upgrade modes are required to be adopted to perform the upgrade, and N upgrade results are obtained.
In the upgrading process, preparation before upgrading test is also needed, and in the preparation process of the mode, in addition to the process of fig. 1, operation steps corresponding to each upgrading mode need to be prepared.
Taking a common upgrading mode as an example, the common upgrading mode is manual upgrading, semi-automatic upgrading and automatic upgrading, and then for each upgrading mode, the operation script can be obtained through the following modes:
if the upgrading mode is manual upgrading, the operation script corresponding to the manual upgrading is generated by uploading an upgrading package of the version to be tested to the virtualized test web system through an upgrading interface of the virtualized test web system to start upgrading after a user downloads the version to be tested from an upgrading site;
for example, the embodiment of the invention adopts the tool selenium to realize the operation of the simulation interface, so that the simulation user can download the upgrade package of the version to be tested from the upgrade site, then upload the version to be tested to the virtualized test web system on the relevant operation page of the virtualized web system, and start the upgrade. The method mainly simulates a user to download an upgrade package of a version to be tested from a certain place, namely the user obtains the upgrade package of the version to be tested, and then the simulation user uploads the version to be tested to a virtualized test web system on a related operation page of the virtualized web system to start upgrading.
If the upgrading mode is semi-automatic upgrading, the operation script corresponding to the semi-automatic upgrading is generated by the operation steps of producing description information of the upgrading packet of the version to be tested at the upgrading site according to the upgrading packet of the version to be upgraded, uploading the upgrading packet of the version to be tested to the upgrading site, triggering an upgrading button after setting upgrading site information on the virtualized test web system according to a user, and upgrading the virtualized test web system;
for example, the embodiment of the present invention uses a selenium tool to implement interface simulation operation, so that an upgrade package of a version to be upgraded according to needs can be simulated, description information of the upgrade package of the version to be tested is produced at an upgrade site, and the upgrade package of the version to be tested is uploaded to the upgrade site, after a user sets upgrade site information in a virtualized test web system, an upgrade button is triggered on a relevant operation page of the virtualized test web system, and after the upgrade site receives an upgrade request from the user, the version to be tested is uploaded to the virtualized test web system, and upgrade is started. Wherein the upgrade site and the user's operations on the relevant operating pages of the virtualized web system are mainly simulated.
If the upgrading mode is automatic upgrading, automatically upgrading the corresponding operation script to generate the description information of the upgrading packet of the version to be upgraded at the upgrading site according to the upgrading packet of the version to be upgraded, uploading the upgrading packet of the version to be tested to the upgrading site, setting timing upgrading according to the fact that a user arrives in the virtualized test web system, and performing operation steps of timing upgrading on the virtualized test web system.
Because the automatic upgrade involves the interaction between the virtualized test web system and the site, in the operation script, firstly, according to the upgrade package of the version to be upgraded, the description information of the upgrade package of the version to be upgraded is generated at the upgrade site, the upgrade package of the version to be tested is uploaded to the upgrade site, then the connection between the upgrade site and the device where the test virtualized web system is located is established, after the preparation, the timed upgrade is set in the virtualized test web system according to the user, the device provided with the virtualized test web system downloads the upgrade package of the version to be tested from the upgrade site, and then the downloaded upgrade package is automatically uploaded to the virtualized test web system.
Specifically, according to the size of the upgrade package and the upgrade package description files such as MD5(Message Digest MD 5), description information of the upgrade package is generated, a simulation operation interface is realized by a tool, a upgrade site is established, the description information of the upgrade package is set in the upgrade site, and when the upgrade is performed automatically, the upgrade package is downloaded from the upgrade site automatically and uploaded to a virtualized test web system for subsequent upgrade tasks.
And secondly, carrying out upgrading test by using the collected snapshot information of all the historical versions and the operation scripts corresponding to the plurality of preset upgrading modes.
Referring to fig. 5, an embodiment of the present invention provides another method for testing an upgrade of a web system based on virtualization, where the method includes:
s500: selecting one historical version which is not tested from the historical versions;
s501: and switching the virtualized web system from the current version to the historical version according to the snapshot information of the historical version, and taking the virtualized web system switched to the historical version as a virtualized test web system.
S502: detecting whether the state of an external access port of the virtualized test web system is an open state, if so, executing S503; otherwise, executing S504;
s503: selecting an upgrading mode which is not tested from preset upgrading modes;
s505: upgrading the virtualized test web system according to the operation steps corresponding to the selected upgrading mode and the upgrading package of the version to be tested;
s504: controlling the virtualized test web system to start up, and returning to the step S502;
s506: detecting the virtualized test web system in a detection mode in the upgrading process to obtain a detection result; the mode 1 and the mode 2 are detection modes in the upgrading process.
S507: logging in the upgraded virtualized test web system, and detecting the upgraded virtualized test web system in an upgraded detection mode to obtain a detection result, wherein the mode 3 and the mode 4 are the upgraded detection modes.
S508: determining an upgrading result according to a detection result corresponding to the detection mode in the upgrading process and a detection result corresponding to the detection mode after upgrading;
s509: judging whether all preset upgrading modes are upgraded aiming at the selected historical version; namely, if all the preset upgrading modes are 3, judging whether to upgrade the virtualized test web system according to the 3 upgrading packages which are all matched with the version to be tested, and obtaining the corresponding upgrading result. If so, go to S510; otherwise, executing S511;
s510: and judging whether all the historical versions obtain the upgrading result, if so, ending, otherwise, executing S511.
S511: and switching the virtualized test web system from the current version to the historical version according to the snapshot information of the historical version. And then S503 is performed again.
Taking 2 upgrading modes and 2 historical versions as examples, it is necessary to go through each upgrading mode and each historical version for upgrading. Specifically, the virtualized test web system is switched to a first historical version according to snapshot information of the first historical version, then the virtualized web system of the first historical version is upgraded by adopting an operation step corresponding to a first upgrading mode and an upgrading package of the version to be tested, and the virtualized web system of the first historical version is detected through a preset detection mode to obtain an upgrading result; switching the virtualized web system to the first historical version again according to the snapshot information of the first historical version, then upgrading the virtualized web system of the first historical version by adopting an operation step corresponding to the second upgrading mode and an upgrading package of the version to be tested, and detecting the virtualized web system of the first historical version by a preset detection mode to obtain an upgrading result.
Switching the virtualized web system to a second historical version according to snapshot information of the second historical version, then upgrading the virtualized web system of the second historical version by adopting an operation step corresponding to the first upgrading mode and an upgrading package of the version to be tested, and detecting the virtualized web system of the second historical version by a preset detection mode to obtain an upgrading result; and switching the virtualized web system to the second historical version again according to the snapshot information of the second historical version, upgrading the virtualized web system of the second historical version by adopting an operation step corresponding to a second upgrading mode and an upgrading package of the version to be tested, and detecting the virtualized web system of the second historical version by a preset detection mode to obtain an upgrading result.
Certainly, when the upgrade mode and the historical version which are needed to be used currently are selected, the upgrade mode and the historical version can be selected manually, that is, the user selects the upgrade mode and the historical version by checking the names of the upgrade mode and the historical version, so that the upgrade test is completed under the selected upgrade mode and the historical version.
As shown in fig. 6, an embodiment of the present invention further provides a server, including: a processor 610 and a memory 620;
the memory 620 is used for storing program codes used when the server runs;
the processor 610 is configured to execute the program code to implement the following processes:
aiming at any one historical version of a virtualized web system, switching the virtualized web system from a current version to the historical version according to snapshot information of the historical version, and taking the virtualized web system switched to the historical version as a virtualized test web system; wherein the snapshot information of the historical version is a backup of a state of the historical version based on virtualization technology;
upgrading the virtualized test web system by using an upgrade package of the version to be tested;
and detecting the upgraded virtualized test web system in a preset detection mode to obtain an upgrade result from the historical version to the version needing to be tested.
The collected snapshot information of all historical versions can be stored on the server, all scripts corresponding to the preset upgrading modes can be stored on the server, and the snapshot information or the steps corresponding to the upgrading modes can be called when the test is needed, so that the test process can be automatically completed.
In addition, all the snapshot information of the historical version can be stored in other electronic devices. Since the test is completed in the server, basic information of the server needs to be set when the version is switched. Therefore, when the versions are switched, switching is realized after connection is established between other electronic equipment and the server, and the startup and shutdown operation of the virtualized web system is realized on the server.
Optionally, there are multiple preset upgrading modes; the processor 610 is specifically configured to:
aiming at any one upgrading mode, upgrading the virtualized test web system by using the operation script corresponding to the upgrading mode and the upgrading packet of the version to be tested; and the upgrading mode is a version upgrading mode supported by the virtualized test web system.
Optionally, if the upgrade mode is manual upgrade, the operation script corresponding to the manual upgrade is generated by uploading the upgrade package of the version to be tested to the virtualized test web system through the upgrade interface of the virtualized test web system to start the upgrade operation after the user downloads the version to be tested from the upgrade site;
if the upgrading mode is semi-automatic upgrading, the operation script corresponding to the semi-automatic upgrading is generated by the operation steps of producing description information of the upgrading packet of the version to be tested at the upgrading site according to the upgrading packet of the version to be upgraded, uploading the upgrading packet of the version to be tested to the upgrading site, triggering an upgrading button after upgrading site information is set in the virtualized test web system according to a user, and upgrading the virtualized test web system;
if the upgrading mode is automatic upgrading, the operation script corresponding to the automatic upgrading is generated by the operation steps of generating description information of the upgrading packet of the version to be upgraded at the upgrading site according to the upgrading packet of the version to be upgraded, uploading the upgrading packet of the version to be tested to the upgrading site, setting timing upgrading according to the condition that a user arrives in the virtualized test web system, and performing timing upgrading on the virtualized test web system.
Optionally, the preset detection mode includes the following part or all of:
detecting whether the upgrading packet of the version to be tested can be subjected to system upgrading on the virtualized test web system;
detecting whether the completion time of each upgrading step in the upgrading process of the virtualized test web system is within the preset timeout time corresponding to the upgrading step;
detecting whether the version number of the upgraded virtualized test web system is the same as the version number of the version to be tested;
and detecting whether the functions appointed in the upgraded virtualized test web system are the functions in the version needing to be tested.
Optionally, the processor 610 is further configured to:
determining that the virtualized test web system is in a powered-on state.
Optionally, the processor 610 is further configured to:
if the virtualized test web system is determined to be in a power-off state, controlling the virtualized test web system to be powered on, and detecting the state of an external access port of the virtualized test web system;
and if the state of the external access port is an open state, determining that the virtualized test web system is started.
In an exemplary embodiment, a storage medium comprising instructions, such as a memory comprising instructions, executable by the processor 610 of the server to perform the virtualization-based web system upgrade testing method described above is also provided. Alternatively, the storage medium may be a non-transitory computer readable storage medium, which may be, for example, a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
The embodiment of the present invention further provides a computer program product, which when running on a server, enables the server to execute any one of the above described web system upgrade test methods based on virtualization according to the embodiments of the present invention.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, electronic devices (systems), and computer program products according to the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing electronic device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing electronic device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing electronic devices to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing electronic device to cause a series of operational steps to be performed on the computer or other programmable electronic device to produce a computer implemented process such that the instructions which execute on the computer or other programmable electronic device provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims (10)

1. A web system upgrade testing method based on virtualization is characterized by comprising the following steps:
aiming at any one historical version of a virtualized web system, switching the virtualized web system from a current version to the historical version according to snapshot information of the historical version, and taking the virtualized web system switched to the historical version as a virtualized test web system; wherein the snapshot information of the historical version is a backup of a state of the historical version based on virtualization technology;
upgrading the virtualized test web system by using an upgrade package of the version to be tested;
and detecting the upgraded virtualized test web system in a preset detection mode to obtain an upgrade result from the historical version to the version needing to be tested.
2. The virtualization-based web system upgrade testing method according to claim 1, wherein there are a plurality of preset upgrade modes; the upgrading process is carried out on the virtualized test web system by using the upgrading package of the version to be tested, and comprises the following steps:
aiming at any one upgrading mode, upgrading the virtualized test web system by using the operation script corresponding to the upgrading mode and the upgrading packet of the version to be tested; and the upgrading mode is a version upgrading mode supported by the virtualized test web system.
3. The virtualization-based web system upgrade testing method of claim 2, wherein:
if the upgrading mode is manual upgrading, the operation script corresponding to the manual upgrading is generated according to the operation step that after a user downloads the version to be tested from an upgrading site, the upgrading package of the version to be tested is uploaded to the virtualized test web system through the upgrading interface of the virtualized test web system to start upgrading;
if the upgrading mode is semi-automatic upgrading, the operation script corresponding to the semi-automatic upgrading is generated by the operation steps of producing description information of the upgrading packet of the version to be tested at the upgrading site according to the upgrading packet of the version to be upgraded, uploading the upgrading packet of the version to be tested to the upgrading site, triggering an upgrading button after upgrading site information is set in the virtualized test web system according to a user, and upgrading the virtualized test web system;
if the upgrading mode is automatic upgrading, the operation script corresponding to the automatic upgrading is generated by the operation steps of generating description information of the upgrading packet of the version to be upgraded at the upgrading site according to the upgrading packet of the version to be upgraded, uploading the upgrading packet of the version to be tested to the upgrading site, setting timing upgrading according to the condition that a user arrives in the virtualized test web system, and performing timing upgrading on the virtualized test web system.
4. The virtualization-based web system upgrade testing method according to claim 1, wherein the preset detection manner includes some or all of the following:
detecting whether the upgrading packet of the version to be tested can be subjected to system upgrading on the virtualized test web system;
detecting whether the completion time of each upgrading step in the upgrading process of the virtualized test web system is within the preset timeout time corresponding to the upgrading step;
detecting whether the version number of the upgraded virtualized test web system is the same as the version number of the version to be tested;
and detecting whether the functions appointed in the upgraded virtualized test web system are the functions in the version needing to be tested.
5. The virtualization-based web system upgrade testing method according to any one of claims 1 to 4, wherein before the upgrade processing is performed on the virtualized testing web system by using an upgrade package of a version to be tested, the method further comprises:
determining that the virtualized test web system is in a powered-on state.
6. The virtualization-based web system upgrade testing method of claim 5, further comprising:
if the virtualized test web system is determined to be in a power-off state, controlling the virtualized test web system to be powered on, and detecting the state of an external access port of the virtualized test web system;
and if the state of the external access port is an open state, determining that the virtualized test web system is started.
7. A server, comprising: a processor and a memory;
the memory is used for storing program codes used when the server runs;
the processor is configured to execute the program code to implement the following processes:
aiming at any one historical version of a virtualized web system, switching the virtualized web system from a current version to the historical version according to snapshot information of the historical version, and taking the virtualized web system switched to the historical version as a virtualized test web system; wherein the snapshot information of the historical version is a backup of a state of the historical version based on virtualization technology;
upgrading the virtualized test web system by using an upgrade package of the version to be tested;
and detecting the upgraded virtualized test web system in a preset detection mode to obtain an upgrade result from the historical version to the version needing to be tested.
8. The server according to claim 7, wherein there are a plurality of preset upgrading modes; the processor is specifically configured to:
aiming at any one upgrading mode, upgrading the virtualized test web system by using the operation script corresponding to the upgrading mode and the upgrading packet of the version to be tested; and the upgrading mode is a version upgrading mode supported by the virtualized test web system.
9. The server according to claim 7, wherein the preset detection mode comprises some or all of the following:
detecting whether the upgrading packet of the version to be tested can be subjected to system upgrading on the virtualized test web system;
detecting whether the completion time of each upgrading step in the upgrading process of the virtualized test web system is within the preset timeout time corresponding to the upgrading step;
detecting whether the version number of the upgraded virtualized test web system is the same as the version number of the version to be tested;
and detecting whether the functions appointed in the upgraded virtualized test web system are the functions in the version needing to be tested.
10. The server according to any one of claims 7 to 9, wherein the processor is further configured to:
determining that the virtualized test web system is in a powered-on state.
CN202110467393.7A 2021-04-28 2021-04-28 Virtualization-based web system upgrade test method and server Pending CN113190248A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110467393.7A CN113190248A (en) 2021-04-28 2021-04-28 Virtualization-based web system upgrade test method and server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110467393.7A CN113190248A (en) 2021-04-28 2021-04-28 Virtualization-based web system upgrade test method and server

Publications (1)

Publication Number Publication Date
CN113190248A true CN113190248A (en) 2021-07-30

Family

ID=76980311

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110467393.7A Pending CN113190248A (en) 2021-04-28 2021-04-28 Virtualization-based web system upgrade test method and server

Country Status (1)

Country Link
CN (1) CN113190248A (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101158917A (en) * 2007-11-09 2008-04-09 中兴通讯股份有限公司 Software version upgrade mounting test system and method thereof
CN111104125A (en) * 2019-11-19 2020-05-05 泰康保险集团股份有限公司 Intelligent integrated version management method, device, medium and electronic equipment

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101158917A (en) * 2007-11-09 2008-04-09 中兴通讯股份有限公司 Software version upgrade mounting test system and method thereof
CN111104125A (en) * 2019-11-19 2020-05-05 泰康保险集团股份有限公司 Intelligent integrated version management method, device, medium and electronic equipment

Similar Documents

Publication Publication Date Title
CN107729066B (en) Automatic construction and release method and device based on SVN (singular value decomposition) resource library
CN109358858B (en) Automatic deployment method, device, medium and electronic equipment
CN106708740B (en) Script testing method and device
CN107733985B (en) Method and device for deploying functional components of cloud computing system
WO2014209359A1 (en) Hook framework
CN109032838B (en) Automatic verification method for consistency of backup and recovery data of virtual machine
CN102681874B (en) A kind ofly guarantee the method that software normally runs and device
CN106980565B (en) Upgrading process monitoring method and device
JP2017117309A (en) Smartphone application test automatization system
CN109840194B (en) Method and system for detecting configuration file
CN109558318B (en) Code management method and code warehouse distributed system
CN107003876A (en) Firmware updates
CN111651352B (en) Warehouse code merging method and device
CN111459740A (en) Master-slave disk serial test method and device for solid state disk and computer equipment
CN111324365A (en) Method and equipment for upgrading super-converged system
CN112052037A (en) Application software development method, device, equipment and medium
CN113485755B (en) Device driver verification method, device and storage medium
CN113190448B (en) Test code updating method and device, electronic equipment and storage medium
CN111611160B (en) Software testing method, device, equipment and storage medium
CN113190248A (en) Virtualization-based web system upgrade test method and server
CN107220174B (en) Automatic testing method and device
CN109428936B (en) APP upgrading method, device, system, electronic equipment and storage medium
CN113452550A (en) Information acquisition device, firmware updating method and system of embedded system device
CN111858315B (en) Software debugging method, device, equipment and medium based on version management
JP2004326337A (en) Code analysis program, code analysis automation program and automated code analysis system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination