CN112463621B

CN112463621B - Regression test management method, storage medium management method, device, equipment and medium

Info

Publication number: CN112463621B
Application number: CN202011414318.6A
Authority: CN
Inventors: 杨晶晶; 王芳; 沈旭
Original assignee: Haiguang Information Technology Co Ltd
Current assignee: Haiguang Information Technology Co Ltd
Priority date: 2020-12-03
Filing date: 2020-12-03
Publication date: 2023-02-24
Anticipated expiration: 2040-12-03
Also published as: CN112463621A

Abstract

The application provides a regression test management method, a storage medium management method, a device, equipment and a medium, wherein the method comprises the following steps: determining a target account space of a verification environment to be tested currently; the method comprises the steps that a verification environment to be tested currently is allocated with a special account space in a plurality of storage units; the target account space is one of the account spaces of the verification environment to be tested currently; and saving regression test data generated during the regression test operation of the verification environment to be tested in the target account space of the verification environment to be tested. Therefore, each verification environment shares the respective account space independently, the regression tests of different verification environments run on the account space of each verification environment, and the problems that the multiple verification environments compete for the same space, the multiple verification environments occupy the space of the storage unit mutually and the running success rate of the regression tests is affected are avoided.

Description

Regression test management method, storage medium management method, device, equipment and medium

Technical Field

The present application relates to the field of chip testing technologies, and in particular, to a regression test management method, a storage medium management method, an apparatus, a device, and a medium.

Background

Regression testing is an important step in the chip verification process, and various combinations of design behaviors are triggered through a large number of random test excitations to check defects possibly existing in the design, so that the regression testing is an important reference index of the chip verification convergence degree. For the verification of a large-scale SoC (System-on-a-Chip, system-on-Chip) at present, a plurality of independent verification environments exist to verify design modules with different functions in the SoC Chip. Each independent verification environment needs to continuously and iteratively run its own regression test to find and repair various potential problems in the chip design, so that the regression tests of multiple verification environments run simultaneously.

Generally, an information technology department of a company allocates a certain amount of storage space (such as disk space) to a chip verification department of the SoC, so that regression tests of all verification environments can store relevant operation data results. In practical use, the whole storage space is composed of a plurality of storage units (such as disks), the regression test needs to be repeatedly executed in each verification environment, and each iteration is executed to store a large amount of data in a certain storage unit.

Since these memory units are shared by the regression tests of all verification environments in the SoC, if the memory space of these memory units cannot be reasonably allocated and managed in one iteration of the regression tests, for example, once the memory space of a certain memory unit is used up by the regression tests of a certain verification environment, the regression tests of all verification environments currently running on the memory unit will fail due to the write error of data. Generally speaking, running a regression test once takes several days, even ten days, depending on the number and complexity of regression test cases in a verification environment. If the regression test of the current round of the multiple verification environments fails because the storage space of the storage unit is occupied, the project progress of the multiple verification environments can be simultaneously influenced.

Disclosure of Invention

An object of the embodiments of the present application is to provide a regression test management method, a storage medium management method, an apparatus, a device, and a medium, which are used to implement reasonable management of the space of a storage unit during regression test of all verification environments in an SoC verification process, and solve the problem that the success rate of regression test operation is affected due to mutual occupation of the space of the storage unit by multiple verification environments caused by the contention of multiple verification environments for the same storage unit.

The embodiment of the application provides a regression test management method, which comprises the following steps: determining a target account space of a verification environment to be tested currently; the current verification environment to be tested is allocated with a special account space in a plurality of storage units; the target account space is one of all account spaces allocated to the current verification environment to be tested; and storing regression test data generated during the regression test operation of the current verification environment to be tested in the target account space of the current verification environment to be tested.

In the implementation process, the regression test data generated when the regression test is run in the verification environment of the current verification environment to be tested is stored in the account space of the verification environment, and the account space of the verification environment is exclusive to the verification environment and cannot be used by other verification environments, so that isolation among different verification environments is realized. Therefore, each verification environment shares the respective account space independently, the regression tests of different verification environments run on the account space of each verification environment, and the problems that the multiple verification environments compete for the same space, the multiple verification environments occupy the space of the storage unit mutually and the running success rate of the regression tests is affected are avoided.

Further, prior to determining the target account space of the validation environment currently being tested, the method further comprises: judging whether a to-be-selected account space with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the current to-be-tested verification environment; correspondingly, the determining the target account space of the verification environment to be tested currently comprises: and when the account space to be selected exists, determining the target account space from the account space to be selected.

In the implementation process, whether the account space to be selected with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the current verification environment to be tested is judged, so that the determined target account space can meet the requirement of the regression test as much as possible.

Further, determining whether there is a to-be-selected account space in each account space of the verification environment to be tested, where the size of the remaining space is greater than the preset minimum space size of the verification environment, includes: judging whether the regression testing times corresponding to the currently existing regression testing data in all account spaces of the verification environment to be tested reach a preset maximum time threshold of the verification environment or not; if not, judging whether a to-be-selected account space with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the verification environment to be tested; and if so, deleting regression test data of the primary regression test with the longest existence time, and judging whether the account space to be selected with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the current verification environment to be tested.

In the implementation process, whether the regression test times corresponding to the currently existing regression test data in all account spaces of the current verification environment to be tested reach a preset maximum time threshold of the verification environment is judged, then when the regression test times reach the preset maximum time threshold, the regression test data of the primary regression test with the longest existence time is deleted, and then whether the to-be-selected account space with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the current verification environment to be tested is judged, so that the dynamic recovery of the regression test data is realized, the condition that the account space is fully occupied and cannot be reused in the regression test due to continuous iteration of the regression test is avoided to a certain extent, and the reusability of the account space is improved.

Further, the method further comprises: when the to-be-selected account space does not exist, judging whether the regression testing times corresponding to the currently existing regression testing data in all the account spaces of the current to-be-tested verification environment are smaller than a preset minimum time threshold of the verification environment or not; and if not, deleting regression test data of the one-time regression test with the longest existence time, and then judging whether the account space to be selected with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the current verification environment to be tested again.

In the implementation process, a minimum time threshold is set, and whether the regression testing times corresponding to the currently existing regression testing data in all account spaces of the verification environment to be tested are smaller than a preset minimum time threshold of the verification environment is compared, so that at least regression testing data required to be reserved by the verification environment can be ensured in the account spaces when the regression testing data are recovered, and sufficient regression testing data are ensured to be used for reference or data integration for coverage rate statistics.

Further, determining the target account space from the candidate account spaces includes: monitoring the size of the residual space of each account space to be selected of the current verification environment to be tested; determining the account space to be selected with the largest residual space size; and the account space to be selected with the largest residual space size is the target account space.

In the implementation process, the account space to be selected with the largest residual space size is selected as the target account space, so that the probability that the target account space can successfully complete regression testing without causing overflow of the storage space can be further improved, and dynamic balance of the storage capacity in each account space can be realized.

Further, before determining the target account space of the verification environment currently to be tested, the method further comprises: obtaining the size of a storage space occupied by regression test data generated in the last regression test of the verification environment and the size of the residual space of each account space of the verification environment; judging whether transferable account spaces with residual space size larger than or equal to the size of the storage space occupied by the regression test data exist in each account space except the target account space of the last regression test; and if so, migrating the regression test data to the transferable account space.

In the implementation process, the storage state of the target account space used in the last regression test is restored to the state before the last regression test is run. Therefore, according to the scheme that the account space with the largest residual space size is selected as the target account space, the data of the last regression test is transferred to the rest account spaces for storage, so that the account space with the larger residual space size can be kept larger, and the effect of more reasonable utilization of storage resources is achieved.

Further, determining a target account space of the verification environment currently to be tested includes: and after the regression test data is transferred into the transferable account space, determining that the target account space in the last regression test in the verification environment is the target account space in the current regression test.

In the implementation process, the storage state of the target account space used in the last regression test is restored to the state before the last regression test is run. Since the previous regression test is successful, after the data migration, the target account space used in the previous regression test is continuously selected as the target account space of the current regression test, and the account space still has a high probability of successfully bearing the current regression test in the aspect of probability, so that the success probability of the current regression test can be improved to a certain extent.

Further, the method further comprises: determining the total size of the account space required by the verification environment to be tested according to the estimated value of the occupied storage space of the one-time regression test of the verification environment to be tested and the operation frequency requirement of the regression test of the verification environment to be tested; allocating an exclusive account space for the current to-be-tested verification environment in a plurality of storage units according to the total size of the account space required by the current to-be-tested verification environment; wherein: the account space of the current verification environment to be tested in each storage unit is larger than the estimated value of the storage space occupied by the current verification environment to be tested running the one-time regression test.

In the implementation process, the total size of the account space required by the verification environment to be tested is determined according to the estimated value of the occupied storage space of the regression test of the verification environment to be tested in one operation and the operation frequency requirement of the regression test of the verification environment to be tested in the current operation. And then the account space is distributed based on the total size of the account space required by the verification environment to be tested, so that the distributed account space of each verification environment can be more suitable for the regression test requirement of each verification environment. And the size of the account space of the verification environment in each storage unit is larger than the estimated value of the storage space occupied by the one-time regression test of the verification environment, so that each account space has the capacity of being used for performing the regression test, and the waste of storage resources is avoided.

Further, one storage unit has account spaces of a plurality of authentication environments therein.

Further, the sum of the account spaces of the respective authentication environments in one storage unit is equal to the size of the storage unit.

In the implementation process, the sum of the account spaces of the verification environments in one storage unit is equal to the size of the storage unit. Therefore, the storage space of the storage unit is not wasted in the distribution process.

An embodiment of the present application further provides a storage unit management method, including: configuring a dedicated account space for each verification environment in a plurality of storage units; and storing regression test data generated during the regression test operation of each verification environment in the account space of each verification environment.

In the implementation process, the special account space is set for each verification environment, and regression test data generated during the regression test operation of each verification environment is stored in the account space of each verification environment, so that the isolation among different verification environments is realized. Therefore, each verification environment shares the respective account space independently, the regression tests of different verification environments run on the account space of each verification environment, and the problems that the multiple verification environments compete for the same space, the multiple verification environments occupy the space of the storage unit mutually and the running success rate of the regression tests is affected are avoided.

Further, the configuring of the account space dedicated to each authentication environment in the plurality of storage units includes: determining the total size of the account space required by each verification environment according to the estimated value of the storage space occupied by the regression test operated in one time in each verification environment and the operation frequency requirement of the regression test in each verification environment; allocating an exclusive account space for each verification environment in a plurality of storage units according to the total size of the account space required by each verification environment; wherein: the size of the account space of each verification environment in each storage unit is larger than the estimated value of the storage space occupied by running the regression test for one time in each verification environment.

The embodiment of the present application further provides a regression test management device, including: a determining module and an operating module; the determining module is used for determining a target account space of the verification environment to be tested currently; the current to-be-tested verification environment is allocated with an exclusive account space in a plurality of storage units; the target account space is one of all account spaces allocated to the verification environment to be tested currently; the running module is used for storing regression test data generated during the regression test running of the verification environment to be tested in the target account space of the verification environment to be tested.

An embodiment of the present application further provides a storage unit management apparatus, including: a configuration module; the configuration module is used for configuring an exclusive account space for each verification environment in a plurality of storage units; and storing regression test data generated during the regression test operation of each verification environment in the account space of each verification environment.

An embodiment of the present application further provides an electronic device, including: a processor, a memory, and a communication bus; the communication bus is used for realizing connection communication between the processor and the memory; the processor is configured to execute one or more programs stored in the memory to implement the method of any of the above.

Also provided in embodiments of the present application is a readable storage medium storing one or more programs which are executable by one or more processors to implement the method of any of the above.

Drawings

To more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.

Fig. 1 is a schematic flowchart of a storage unit management method according to an embodiment of the present disclosure;

fig. 2 is a schematic flowchart of a regression testing management method according to an embodiment of the present disclosure;

fig. 3 is a schematic flowchart of threshold determination according to an embodiment of the present disclosure;

fig. 4 is a schematic flowchart of another threshold determination provided in the embodiment of the present application;

fig. 5 is a specific management flow diagram provided in the embodiment of the present application;

fig. 6 is a schematic diagram illustrating that a disk space formed by N physical disks is allocated to corresponding account spaces for M verification environments according to an embodiment of the present application;

FIG. 7 is a diagram illustrating a regression test configuration table established for M verification environments according to an embodiment of the present application;

FIG. 8 is a schematic diagram of a regression test performed on a current round to select an account space with the largest remaining space size according to an embodiment of the present application;

FIG. 9 is a diagram illustrating an example of data migration provided by an embodiment of the present application;

fig. 10 is a schematic structural diagram of a regression test management apparatus according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of a storage unit management apparatus according to an embodiment of the present application;

fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.

The first embodiment is as follows:

in order to realize reasonable management of the space of the storage unit during the regression test of all the verification environments in the SoC verification process and avoid the problem that the space of the storage unit is crowded and occupied by a plurality of verification environments and the running success rate of the regression test is influenced because a plurality of verification environments compete for the same storage unit, the embodiment of the application provides a regression test management method and a storage unit management method.

Referring to fig. 1, fig. 1 is a schematic flow chart of a storage unit management method according to an embodiment of the present application, including:

s101: a dedicated account space is allocated for each authentication environment in a plurality of storage units.

In the embodiment of the present application, the storage unit may be a physical magnetic disk, an optical disk, or the like having a data storage capability.

In the embodiment of the application, after the project is determined, an exclusive account space can be allocated in each storage unit for each verification environment which needs to be subjected to regression testing in the project, and regression testing data generated during the regression testing operation of each verification environment is stored in the account space of each verification environment, so that isolation among different verification environments is realized.

Therefore, each verification environment shares the respective account space independently, and different verification environments operate in the account spaces of the verification environments, so that the problems that the multiple verification environments crowd the storage unit space and influence the success rate of regression test operation due to the fact that the multiple verification environments compete for the same space do not exist any more.

In practical applications, in order to meet data storage requirements in an SoC verification process, regression test data is often stored in a storage space formed by a plurality of storage units. For a verification environment, regression test data generated at each regression test is stored in a storage unit.

In the embodiment of the present application, a plurality of account spaces may be partitioned for any one storage unit in the storage space for storing regression test data. Each account space in a storage unit corresponds to a verification environment. It should be noted, however, that a verification environment does not necessarily have a corresponding account space in each storage unit. That is, in the embodiment of the present application, each authentication environment may or may not have an account space corresponding to the authentication environment in one storage unit.

It is also noted that each authentication environment may have account space in multiple storage units, and thus each authentication environment may have multiple account spaces.

In a feasible implementation manner of the embodiment of the application, in order to implement configuration of the account space of each verification environment, the total size of the account space required by each verification environment may be determined according to an estimated value of the size of a storage space occupied by running a regression test in each verification environment and an operation frequency requirement of the regression test in each verification environment. Further, an exclusive account space is allocated to each verification environment in a plurality of storage units according to the total size of the account space required for each verification environment.

In the above possible embodiment, the product of the estimated value of the size of the storage space occupied by the regression test performed in each verification environment for one time and the operation frequency requirement of the regression test in each verification environment may be used as the nominal value of the total size of the account space required by each verification environment.

In addition, the total size of the account space required to be allocated to each verification environment can be determined according to the ratio of the nominal value of the total size of the account space required by each verification environment to the sum of the nominal values of the total sizes of the account spaces required by all the verification environments and the total storage size of the storage space, and further, based on the storage size of each storage unit, an exclusive account space is allocated to each verification environment in each storage unit.

For example, assuming that there are M verification environments in total, for any one verification environment i of the M verification environments, a nominal value of the total size of the required account space is represented by P (i), and then the total size of the account space required to be allocated for the verification environment i may be represented as: SIZE (i) = total storage SIZE of storage space P (i)/(P (1) + P (2) + \8230, + P (M-1) + P (M)). Wherein SIZE (i) is the total SIZE of the account space required to be allocated corresponding to the verification environment i.

In a possible implementation manner of the embodiment of the present application, after the total size of the account space required to be allocated to each verification environment is determined, the account space may be allocated to each verification environment in each storage unit based on a proportional relationship between the storage sizes of the storage units.

Illustratively, for example, for verification environment i, the total SIZE of the account space required to be allocated is SIZE (i). Assuming that there are 3 storage units, which are respectively referred to as

storage units

1, 2, and 3, and the storage SIZEs are respectively a, 2A, and 3A, then an account space with SIZE (i)/6 may be allocated in the storage unit 1 for the verification environment i, an account space with SIZE (i)/3 may be allocated in the storage unit 2 for the verification environment i, and an account space with SIZE (i)/2 may be allocated in the storage unit 3 for the verification environment i.

It should be understood that the above is only one possible allocation manner of the account space of each verification environment in the embodiment of the present application, and the present application is not limited to only allocating the account space of each verification environment in this manner in the embodiment of the present application. For example, in the embodiment of the present application, the account space may be allocated to each verification environment by, for example, evenly allocating the total size of the account space that needs to be allocated to each verification environment in each storage unit.

In addition, it should be understood that, in the embodiment of the present application, for any one verification environment, one account space may be allocated to each storage unit, but one account space may also be allocated to only part of the storage units.

It should be noted that, in order to enable each account space to actually meet the test requirement as much as possible, in the embodiment of the present application, the size of the account space of each verification environment in each storage unit may be configured to be larger than an estimated value of the size of the storage space occupied by each verification environment running the one-time regression test.

In the embodiment of the application, the estimated value of the size of the storage space occupied by running the regression test once in each verification environment can be determined by engineers according to actual experience.

In this embodiment of the present application, when allocating the account space of each verification environment, the allocation of the account space may be performed from the verification environment in which the total size of the account space to be allocated is the largest, and the allocation of the account spaces of the remaining verification environments may be performed in the order from the largest to the smallest according to the total size of the account spaces until all the verification environments complete the allocation of the account space.

In addition, when allocating the account space of each verification environment, the allocation of the account space may be started from the verification environment in which the estimation value of the size of the storage space occupied by running the one-time regression test is the largest, and the allocation of the account spaces of the remaining verification environments may be performed in the order from large to small according to the estimation value of the size of the storage space occupied by running the one-time regression test until all the verification environments complete the allocation of the account space.

In the embodiment of the present application, for any one storage unit, a plurality of account spaces may be partitioned, and the sum of the storage capacities of the plurality of account spaces may be set to be equal to the storage capacity of the storage unit, so as to avoid the storage space of the storage unit being wasted in the allocation process.

In the embodiment of the present application, after the account space is allocated to each verification environment in the storage unit, the regression test can be implemented based on the account space of each verification environment. Therefore, the embodiment of the application provides a regression testing management method. For ease of understanding, the regression test management method is described below by taking the verification environment to be tested as an example, and may be referred to as shown in fig. 2, which includes:

s201: a target account space of a verification environment currently to be tested is determined.

It should be understood that, in the embodiment of the present application, the verification environment to be tested currently is allocated with a dedicated account space in a plurality of storage units. The target account space refers to an account space determined to be used for performing the regression test of the current verification environment to be tested in each account space of the current verification environment to be tested.

It should be understood that, in the actual application process, the regression test of this time can be successful only when the storage size of the target account is greater than or equal to the regression test data generated in the regression test of this time.

Therefore, in the embodiment of the application, before determining the target account space of the verification environment to be tested, it may be determined whether there is an account space to be selected in each account space of the verification environment to be tested, where the size of the remaining space is greater than the preset minimum space size of the verification environment.

If the regression test data exists, the target account space can be determined from the account space to be selected, so that the storage size of the target account is ensured to be larger than or equal to the size of the regression test data generated in the regression test as far as possible.

In embodiments of the present application, the minimum space size of different verification environments may be different.

In an example of an embodiment of the present application, the minimum spatial size of the verification environment may be determined by the size of regression test data generated by regression tests performed prior to the verification environment. For example, the minimum space size of the verification environment may be an average of the sizes of regression test data generated by regression tests performed before the verification environment. For the first regression test, the initial value of the minimum space size of the verification environment may be set to 0, or an estimate value of the storage space size occupied by the first regression test performed on the verification environment given by an engineer.

In another example of the embodiment of the present application, the minimum space size of the verification environment may also be directly set to an estimate of the size of the storage space occupied by the engineer when the verification environment runs the one-time regression test.

In practical applications, there may be a case where each account space of the verification environment to be tested is not smaller than the minimum space size of the verification environment. In practical applications, although it is generally necessary to retain at least a certain number of past regression test data for reference or data integration for coverage statistics for a verification environment, the longer the data, the weaker the reference value and the lower the reference value. For this reason, in the embodiment of the present application, a maximum number threshold may be set for each verification environment, so that only regression test data of regression test numbers within the maximum number threshold is retained.

Therefore, in the embodiment of the present application, before determining the target account space of the current verification environment to be tested, it may be determined whether the regression test times corresponding to the currently existing regression test data in all account spaces of the current verification environment to be tested reach a preset maximum time threshold of the verification environment.

If not, whether the account space to be selected with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the verification environment to be tested or not can be judged, and then when the account space to be selected exists, the target account space is determined from the account space to be selected.

If the result is reached, the regression test data of the primary regression test with the longest existence time can be deleted, whether the account space to be selected with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the current verification environment to be tested is judged, and then when the account space to be selected exists, the target account space is determined from the account space to be selected.

It should be understood that, in this embodiment of the present application, before performing the regression test each time, the determination whether the regression test frequency corresponding to the currently existing regression test data reaches the preset maximum frequency threshold of the verification environment may be directly performed, so that the operation of deleting the regression test data of the one regression test having the longest existence time is performed when the maximum frequency threshold is reached.

It should be understood that in practical applications, it is generally necessary for a verification environment to retain at least a certain number of past regression test data for reference or for data integration of coverage statistics. For this reason, in the embodiment of the present application, a minimum number threshold of each verification environment may be set in advance. Therefore, when the account space to be selected does not exist, whether the regression testing times corresponding to the currently existing regression testing data in all the account spaces of the verification environment to be tested are smaller than the preset minimum time threshold of the verification environment or not can be judged.

And if not, deleting regression test data of the primary regression test with the longest existence time, judging whether the account space to be selected in each account space of the current verification environment to be tested has a residual space size larger than the preset minimum space size of the verification environment, and determining the target account space from the account spaces to be selected when the account space to be selected exists.

It should be understood that, if the regression test times corresponding to the currently existing regression test data are smaller than the preset minimum time threshold of the verification environment, a message that the storage space is insufficient and the regression test cannot be performed may be reported to wait for the engineer to process the message.

It should be noted that the above-mentioned determination method for the minimum count threshold value can be implemented in combination with the above-mentioned determination method for the maximum count threshold value. See also fig. 3 for an illustration:

when the regression test is needed, whether the regression test times corresponding to the currently existing regression test data in all account spaces of the verification environment to be tested reach a preset maximum time threshold of the verification environment is judged.

If not, judging whether the size of the residual space is larger than the preset minimum space size of the verification environment in each account space of the current verification environment to be tested, and determining a target account space from the candidate account spaces when the candidate account spaces exist.

And if so, deleting regression test data of the primary regression test with the longest existence time, judging whether the account space to be selected in each account space of the current verification environment to be tested has a residual space size larger than the preset minimum space size of the verification environment, and determining a target account space from the account spaces to be selected when the account space to be selected exists.

If the account space to be selected does not exist, the size of the remaining space of which is larger than the size of the preset minimum space of the verification environment, whether the regression testing times corresponding to the currently existing regression testing data in all the account spaces of the current verification environment to be tested are smaller than a preset minimum time threshold of the verification environment or not can be further judged.

And when the residual space size is not less than the preset minimum space size of the verification environment, deleting the regression test data of the primary regression test with the longest existence time, judging whether the account space to be selected exists in the account spaces of the current verification environment to be tested, and determining the target account space from the account spaces to be selected when the account space to be selected exists.

At this time, if the current regression testing data does not exist in all the account spaces of the current verification environment to be tested, whether the regression testing times corresponding to the currently existing regression testing data are smaller than a preset minimum time threshold of the verification environment or not is continuously judged, so that the process is repeated until the existence of the account space to be selected with the residual space size larger than the preset minimum space size of the verification environment is judged, the target account space is determined from the account space to be selected, or the regression testing times corresponding to the currently existing regression testing data are judged to be smaller than the preset minimum time threshold of the verification environment.

It should be understood that in the manner shown in fig. 3, in each regression test, it is determined whether the regression test frequency corresponding to the currently existing regression test data in all account spaces of the verification environment to be tested reaches the preset maximum frequency threshold of the verification environment, so that the regression test data of the one regression test having the longest existence time is deleted when the regression test frequency reaches the preset maximum frequency threshold, and the regression test frequency corresponding to the existing regression test data falls within the maximum frequency threshold. Therefore, in the process of judging each round of return test, after judging whether the return test times corresponding to the currently existing return test data in all the account spaces of the verification environment to be tested reach the preset maximum time threshold of the verification environment, the situation that the return test times corresponding to the currently existing return test data are larger than the preset maximum time threshold of the verification environment does not necessarily occur any more, and therefore, the return test is not required to be judged again.

It should be understood that the above-mentioned determination method for the minimum count threshold value may be implemented without being combined with the above-mentioned determination method for the maximum count threshold value. For example, see fig. 4 for an illustration:

when the regression test is needed, whether the account space to be selected exists in each account space of the verification environment to be tested or not is judged firstly, wherein the size of the remaining space is larger than the size of the preset minimum space of the verification environment.

And when the test result does not exist, judging whether the regression test times corresponding to the currently existing regression test data in all the account spaces of the verification environment to be tested are smaller than a preset minimum time threshold of the verification environment.

If the current regression testing data does not exist in the account spaces of the verification environment to be tested, whether the regression testing times corresponding to the currently existing regression testing data in all the account spaces of the verification environment to be tested are smaller than a preset minimum time threshold of the verification environment or not is judged, so that the process is repeated until the fact that the to-be-selected account space with the residual space size larger than the preset minimum space size of the verification environment exists is judged, the target account space is determined from the to-be-selected account space, or the fact that the regression testing times corresponding to the currently existing regression testing data are smaller than the preset minimum time threshold of the verification environment is judged.

In the embodiment of the application, the existing regression test data can be dynamically recycled through the mode, so that the storage space is vacated for the subsequent regression test in time.

It should be understood that the minimum number threshold described in the embodiment of the present application is a value of at least the number of times that needs to be retained for one verification environment minus 1. For example, assuming that for a verification environment, it needs to retain regression test data of at least m regression tests, the minimum time threshold is (m-1), which is because after the regression test is run this time, regression test data of one regression test is obtained, so that regression test data of m regression tests can be retained in the storage space.

In this embodiment of the present application, an engineer may set at least the number of times that each verification environment needs to be retained, so that a minimum number threshold of times of each verification environment can be obtained during comparison through a script. In addition, the engineer may directly set a minimum count threshold for each verification environment.

In the embodiment of the present application, the maximum number threshold and the minimum number threshold of each verification environment may be set by an engineer according to actual needs of the verification environment. However, the maximum number threshold should be greater than the minimum number threshold.

In the embodiment of the present application, one possible implementation manner of determining the target account space from the candidate account spaces may be: the method comprises the steps of monitoring the size of the residual space of each to-be-selected account space of a current to-be-tested verification environment, and further determining the to-be-selected account space with the largest size of the residual space; and performing regression testing by taking the account space to be selected with the largest residual space as a target account space.

In addition, when the minimum space size of the verification environment is directly set as the estimated value of the storage space size occupied by the verification environment running the one-time regression test given by the engineer, in another feasible implementation manner of the embodiment of the application, the size of the remaining space of each account space of the current verification environment to be tested can be monitored, and then one account space is randomly selected as the target account space from the account spaces of which the size of the remaining space is larger than the estimated value of the current verification environment to be tested.

Therefore, since the engineer gives the estimated value of the storage space occupied by the one-time regression test of the verification environment, theoretically, the account spaces with the residual space size larger than the estimated value of the verification environment to be tested have higher possibility of successfully completing the regression test, and one of the account spaces can be randomly selected as the target account space. Of course, it may also be configured to select an account space with the largest remaining space size as the target account space from account spaces with remaining space sizes larger than the estimated value of the verification environment to be tested. In this case, it is identical to the last possible embodiment.

S202: and saving regression test data generated during the regression test operation of the verification environment to be tested in the target account space of the verification environment to be tested.

In the embodiment of the present application, in order to achieve maximum use of each account space and ensure success of regression testing as much as possible, for a verification environment in which multiple account spaces exist, before a target account space of a verification environment to be tested is determined, a storage space size occupied by regression testing data generated during a last regression testing of the verification environment and a remaining space size of each account space of the verification environment may be obtained. Therefore, whether transferable account space with the residual space size larger than or equal to the storage space size occupied by the regression test data exists in each account space except the target account space of the last regression test is judged.

If so, the regression test data may be migrated into the transferable account space. In this way, the storage state of the target account space used in the last regression test is restored to the state before the last regression test is run.

Therefore, in an optional implementation manner of the embodiment of the present application, if the regression test data is successfully migrated into the transferable account space, the target account space used in the last regression test in the verification environment may be directly set as the target account space of the current regression test.

It should be noted that the above-mentioned manner is only an alternative manner as exemplified in the embodiments of the present application. It should be appreciated that in the embodiments of the present application, after migrating the regression test data into the transferable account space, the target account space may continue to be redetermined in the manner described above for determining the target account space (such as the manner shown in fig. 3 or fig. 4).

It should be noted that, in the embodiment of the present application, when a plurality of transferable account spaces exist in each account space except the target account space of the last regression test, and the size of the storage space occupied by the remaining space size of the transferable account space is greater than or equal to the size of the storage space occupied by the last regression test data, the transferable account space with the smallest remaining space size may be taken as the target transferable account space for transferring the last regression test data, so as to transfer the regression test data to the target transferable account space.

For example, assuming that the regression test data generated by the last regression test occupies 100G of storage space, assuming that there are two transferable account spaces that can be used for storing the transfer data, and the remaining space sizes are 110G and 150G, respectively, the regression test data generated by the last regression test can be migrated to the transferable account space with the remaining space size of 110G, so as to achieve the purpose of fully utilizing the account space size as much as possible.

It should be understood that regression test data belonging to the same regression test should be stored in the same account space to ensure the availability of regression test data.

It should be understood that, for any verification environment, when it needs to perform the regression test, it can be treated as the verification environment to be tested according to the regression test management method described in the embodiments of the present application.

According to the scheme provided by the embodiment of the application, the special account space is set for each verification environment, and regression test data generated during the regression test operation of each verification environment is stored in the account space of each verification environment, so that the isolation among different verification environments is realized. Therefore, each verification environment shares the respective account space independently, the regression tests of different verification environments run on the account space of each verification environment, and the problems that the multiple verification environments crowd the space of a storage unit and influence the running success rate of the regression tests due to the fact that the multiple verification environments compete for the same space do not exist any more.

In addition, according to the scheme provided by the embodiment of the application, whether the account space to be selected exists in each account space of the current verification environment to be tested and the size of the remaining space is larger than the preset minimum space size of the verification environment can be judged, so that the determined target account space can meet the requirement of the regression test as much as possible. And by adopting the to-be-selected account space with the largest residual space as the target account space to perform the regression test, the probability that the determined target account space can successfully complete the regression test without causing the overflow of the storage space is further improved, and the dynamic balance of the storage capacity in each account space can be realized.

In addition, according to the scheme provided by the embodiment of the application, dynamic recovery of regression test data can be realized by setting the maximum time threshold and the minimum time threshold of the verification environment and comparing the regression test times corresponding to the currently existing regression test data with the maximum time threshold and the minimum time threshold, so that the condition that the account space is occupied and cannot be used for regression test due to continuous iteration of the regression test is avoided to a certain extent, and the reusability of the account space is improved.

In addition, according to the scheme provided by the embodiment of the application, the maximum available space can be obtained for the next regression test operation in a data migration mode, so that the probability that the target account space can meet the requirement of the regression test is improved.

Example two:

the present embodiment further illustrates, on the basis of the first embodiment, a process from preparation to data migration in which a storage unit is a physical disk, as an example.

As shown in fig. 5, as a preparation work of this flow, it is necessary to first complete both the step S1 and the step S2 shown in fig. 5.

Step S1: a dedicated account space is allocated for a different authentication environment in each physical disk that makes up the disk space.

The description will be given by taking an example in which a disk space formed by N physical disks is allocated to corresponding account spaces for M verification environments. Referring to fig. 6, M verification environments correspond to M account spaces one to one, and regression test data in any verification environment can only access the corresponding account space. For each physical disk in the disk space, dividing the storage space of each physical disk into accounts corresponding to L verification environments according to a certain proportion, wherein L is greater than or equal to 1 and less than or equal to M. The storage capacity occupied by each account space is shown in fig. 6 as the corresponding square area. Therefore, each verification environment has a plurality of account spaces belonging to the verification environment, and the number of the account spaces is more than 1 and less than or equal to N. Here, it should be noted that:

1. for any physical disk, the sum of the storage capacities of the divided L account spaces is equal to the storage capacity of the physical disk, so that the storage space of the physical disk is not wasted in the allocation process.

2. In practical applications, the physical disks that make up the disk space may have different storage capacities. Generally, different verification environments occupy different storage spaces for running the regression test once according to the scale size of the verification environment and the number of regression test cases. In addition, the regression testing frequency of different verification environments is different, for example, the regression testing of an IP (Intellectual Property core) level verification environment needs to be operated more frequently than that of a system level verification environment.

Therefore, the product of the estimated value of the size of the storage space occupied by running the regression test once on the basis of the verification environment and the requirement of the running frequency can be used as the total size of the account space required to be allocated to all the account spaces corresponding to the environment. A larger product means a higher proportion of the total storage capacity that needs to be allocated to the verification environment.

For example, for a certain verification environment i, the product value is represented by P (i), and the total size of the account space required to be allocated for the verification environment i can be represented as: SIZE (i) = total memory SIZE of memory space P (i)/(P (1) + P (2) + \8230, + P (M-1) + P (M)). Wherein SIZE (i) corresponds to the total SIZE of the required allocated account space for the verification environment i. The total storage capacity of the disk space = storage capacity of the physical disk 1 + storage capacity of the physical disk 2 + \8230, + storage capacity of the physical disk N-1 + storage capacity of the physical disk N.

After the total SIZE (i) of the account space required to be allocated corresponding to the verification environment i is obtained, K account spaces of the environment are divided according to the storage capacity of each physical disk in the disk space, the sum of the storage capacities of the K account spaces is SIZE (i), and the value range of K is larger than 1 and smaller than or equal to N, as shown in fig. 6. Because the storage spaces of different physical disks are not necessarily the same, and the estimated values of the sizes of the storage spaces occupied by running the regression test in different verification environments are also different, when the account space is allocated, the verification environment with the largest estimated value of the size of the storage space occupied by running the regression test in one time can be started, and the estimated values are sequentially decreased until all the verification environments finish the allocation of the account space.

Any one of K account spaces needs to be satisfied in the distribution process, the storage capacity of the K account spaces at least exceeds the estimated value of the storage capacity occupied by the one-time regression test operated in the verification environment, and a 2-to 5-time estimated value is generally selected as the optimum value.

Step S2: a regression test configuration table is established for each verification environment.

Referring to fig. 7, fig. 7 is a regression test configuration table established for M verification environments in this embodiment, where the regression test configuration table of each verification environment includes three configuration parameters.

The first term is the number of regression iterations MIN _ NUM that each verification environment needs to retain (i.e., the minimum number threshold +1 for the verification environment in the embodiment).

In the iterative process of the regression test, the results of the previous regression test are often required to be retained as a reference, or the results of the previous regression test and the results of the current regression test are used for data integration to improve the function coverage rate and the code coverage rate, so that regression test data of at least a certain number of regression tests are required to be retained.

The second term is the maximum number of regression iterations MAX _ NUM that the verification environment is allowed to retain (i.e., the maximum number threshold for the verification environment).

This is based on the time efficiency of the regression iteration and the efficient use of memory. For the stale regression test results, the stale regression test results do not have any reference value and data integration value, and limited storage resources are occupied. Therefore, once the number of regression iterations reaches MAX _ NUM, the regression test data of the one regression test with the longest existence time can be recycled to release the memory space for the regression test to be currently run.

The third term is the memory space MIN SIZE that is minimally required for the authentication environment to run (i.e., the minimum space SIZE of the authentication environment).

For account space of a certain verification environment, if the remaining storage capacity of the account space on all the physical disks is small, even if the regression test is run, the storage overflow of the account space is likely to be caused, and the regression test is likely to fail. Therefore, MIN _ SIZE can provide a warning mechanism for the SIZE of the remaining account space, and the current regression test should not be performed once the remaining account space of the current environment in each physical disk is less than MIN _ SIZE.

In actual use, the three configuration parameters are configured by the verification personnel according to the actual requirements of the verification environment. The value of MIN _ SIZE can be set to 0 before the regression test is performed for the first time, and then adjusted by means of weighted average according to the data amount generated by the previous regression test. The specific configuration mechanism of MIN _ SIZE is not discussed in this disclosure.

After step S1 and step S2 are completed, the present embodiment enters into a formal management flow.

Before the regression test is run, as shown in step SS1 in fig. 5, all the account spaces corresponding to the verification environment are checked, the number of regression test iterations coexisting at present is recorded, and the number is compared with the MAX _ NUM of the corresponding environment in the regression test configuration table.

Once the number of iterations is found to be equal to MAX _ NUM, meaning that in addition to the running of this regression test, the total number of iterations will exceed MAX _ NUM. Therefore, in step SS2, the regression test data of the regression test with the longest existence time is deleted by time-sorting the existing regression tests.

In actual operation, a unique tag is bound to data of each regression test operation, the time sequence of each regression test operation can be judged in the system according to the time stamps of different tags, and then regression test data needing to be deleted are positioned.

On the other hand, if the iteration number is found to be less than MAX _ NUM, the past regression test data may be retained continuously, and the process skips step SS2 and proceeds to step SS3. Similarly, after the step SS2 is completed, the condition that the number of regression iterations is less than MAX _ NUM is satisfied, so the flow proceeds from step SS2 to step SS3.

At step SS3 in FIG. 5, it will be determined whether the verification environment has an account space with a SIZE of remaining space greater than MIN _ SIZE in the regression test configuration table described above. In concrete implementation, when the step SS3 is entered, the system command is called to check the size of the residual space of the account space corresponding to the verification environment in all the physical disks, and because the checked size is the storage capacity of the account space, the system command can return the result immediately without waiting for a long time, so that the execution of the process is not blocked.

When the judgment result in step SS3 shows that the remaining space SIZE of no account space in the disk space is larger than MIN _ SIZE, the flow proceeds from step SS3 to step SS5. In step SS5, the management process will again record the number of regression test iterations that have existed by now as in step SS1, and then compare it to the value of MIN _ NUM-1 for that verification environment in the regression test configuration table described above. If the number of regression iterations already exists is equal to MIN _ NUM-1, as described above in the first item of step S2, meaning that the number of regression iterations has reached the minimum allowed for the verification environment in addition to the running of the regression test. In this case, the past regression test data cannot be deleted any more, and at this time, the process proceeds from step SS5 to step SS8, so that it is reported that the current remaining account space is insufficient to run the regression test of this round, the dynamic space management process of the regression test of this round is completed, and the reason for the insufficient storage capacity of the corresponding account space needs to be further analyzed and processed manually.

On the contrary, once the management process finds that the number of regression iterations already existing is greater than MIN _ NUM-1, the management process may still further release the storage capacity of the account space by deleting the regression test data, at this time, the management process goes from step SS5 to step SS2, the execution content of step SS2 is described above, and details are not described here.

The flow from step SS5 to step SS2 forms a loop until after the memory space is freed, there is an account space that satisfies the conditions described in step SS3, or the number of regression tests remaining has been reduced to MIN _ NUM-1 in step SS5.

On the other hand, when the judgment result in the step SS3 shows that there is at least one account space in the physical disk, and the SIZE of the remaining space is larger than MIN _ SIZE, the process proceeds from the step SS3 to the step SS4. In step SS4, all account spaces satisfying the condition may be sorted based on the size of the remaining space, and the account space with the largest size of the remaining space is selected to run the regression test of the current round, as shown in fig. 8.

After the regression test in the step SS4 is finished, the space occupied by all the regression test data generated by the regression test is also determined. At this point, the space remaining in the account space can be more efficiently utilized by attempting one data migration as shown in steps SS6 and SS 7.

Illustratively, the amount of memory space that needs to be occupied for each regression test run is not fixed. For example, the increasing regression test cases during the development process of the verification may result in a larger amount of data per regression iteration than the last time; for example, modification of a test scenario or a chip design may cause some regression test cases to generate different data volumes at each regression iteration, and both of the data volumes will cause significant changes in the memory space occupied by the whole regression test at each iteration. On the other hand, before the regression test is run, the storage resource which is finally consumed by the regression test of the current round cannot be accurately estimated, and even if the account space with the residual space SIZE larger than the MIN _ SIZE exists, the regression test can fail due to the fact that the data volume generated by the regression test of the current round is increased sharply. Therefore, the distribution of the residual space size of the account space in different physical disks can be adjusted by migrating the regression test data to the rest of the account space, so that the condition that the regression test fails due to unfixed regression test data volume is avoided as much as possible.

As shown in fig. 9, the disk space of a certain verification environment is composed of three physical disk spaces, the residual space sizes of the corresponding three account spaces before the regression test of this time are 160g,180g and 100G, respectively, and the previous regression test of the round occupies 150G of the corresponding account space in the physical disk 2. It is assumed that once the regression test actually needs to occupy 210G of storage capacity for some reason, the residual space of 180G in the physical disk 2 will cause the failure of the regression test. However, it can be found from fig. 9 that the account space in the physical disk 1 still has 160G of remaining space for storing all the regression test data of the previous cycle of regression tests. If the regression test data are migrated to the account space in the physical disk 1, the remaining space of the corresponding account space in the physical disk 2 is increased to 150g +180g =330g, which is enough to ensure the smooth operation of the regression test.

The scheme provided by the embodiment can solve the problem of the overflow of the disk space caused by the sharing of the disk space and the lack of effective management of the disk space when the multiple verification environments carry out the iteration of the regression test.

In the scheme of this embodiment, first, in all physical disks constituting a disk space, a corresponding account space is divided for each verification environment, and logical isolation is performed in the physical space of the disk. Therefore, even if a regression test of a certain verification environment generates huge data volume, the worst case is that the regression test is divided into the account space of the user, the regression test of the user fails, the regression test of other environments running is not influenced, and the harm and influence range of the overflow of the disk space are reduced to the minimum.

Meanwhile, for each verification environment, a regression test data recovery mechanism based on a regression test configuration table is provided. The set of recovery mechanism not only reserves necessary past regression test data for reference and data integration, but also can recover unnecessary regression test data in real time according to the size of the residual space of the current account space. A user only needs to configure three parameter values in the regression test table according to the actual situation of the regression test environment of the user, and the whole set of recovery mechanism can self-adaptively determine whether to recover the past regression test data. The recovery mechanism reasonably utilizes the limited disk space to meet the requirement of continuous iteration of the regression test, and the management of the disk space is very efficient.

Finally, the scheme of the embodiment also considers regression failure possibly caused by the surge of the amount of the regression test data of a certain time, and the distribution of the residual space size of the account space in different physical disks is adjusted by judging and executing the data migration of the regression test data once after the regression test operation is completed each time, so that the probability of the regression failure caused by the surge of the amount of the regression test data is reduced to the minimum.

By the scheme of the embodiment, the problem of the overflow of the disk space possibly occurring in the process of continuously performing regression testing iteration in each verification environment is greatly reduced, and the influence of the overflow of the disk space caused by the regression testing of a certain verification environment on other verification environments is avoided.

Example three:

based on the same inventive concept, the embodiment of the application also provides a regression test management device and a storage unit management device. Referring to fig. 10 and 11, fig. 10 shows a regression test management apparatus 100 corresponding to the regression test management method according to the first embodiment, and fig. 11 shows a memory unit management apparatus 200 corresponding to the memory unit management method according to the first embodiment. It should be understood that the specific functions of the

apparatuses

100 and 200 can be referred to the above description, and the detailed description is omitted here as appropriate to avoid redundancy. The

devices

100 and 200 include at least one software functional module that can be stored in a memory in the form of software or firmware or solidified in an operating system of the

devices

100 and 200. Specifically, the method comprises the following steps:

referring to fig. 10, the regression test management apparatus 100 includes: a determination module 101 and an execution module 102. Wherein:

the determining module 101 is configured to determine a target account space of a verification environment to be tested currently; the current to-be-tested verification environment is allocated with an exclusive account space in a plurality of storage units; the target account space is one of all account spaces allocated to the verification environment to be tested currently;

the running module 102 is configured to store regression test data generated during the regression test running of the verification environment to be tested in the target account space of the verification environment to be tested.

In an optional implementation manner of the embodiment of the present application, the determining module 101 is further configured to, before determining a target account space of a current verification environment to be tested, determine whether a to-be-selected account space exists in each account space of the current verification environment to be tested, where a size of a remaining space of the to-be-selected account space is greater than a preset minimum space size of the verification environment. Correspondingly, the determining module 101 determines the target account space of the verification environment to be tested currently, including: and when the account space to be selected exists, determining the target account space from the account space to be selected.

In the above optional embodiment, the determining module 101 is specifically configured to determine whether a regression test frequency corresponding to currently existing regression test data in all account spaces of the verification environment to be currently tested reaches a preset maximum frequency threshold of the verification environment; if not, judging whether the account space to be selected with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the current verification environment to be tested; and if so, deleting regression test data of the primary regression test with the longest existence time, and judging whether the account space to be selected with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the current verification environment to be tested.

In the above optional embodiment, the determining module 101 is further configured to, when the to-be-selected account space does not exist, determine whether a regression test frequency corresponding to currently-existing regression test data in all account spaces of the current to-be-tested verification environment is smaller than a preset minimum frequency threshold of the verification environment; and if not, deleting regression test data of the primary regression test with the longest existence time, and then judging whether the account space to be selected with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the current verification environment to be tested again.

In the above optional embodiment, the determining module 101 is specifically configured to monitor the size of the remaining space of each candidate account space of the verification environment to be tested currently; determining the account space to be selected with the largest residual space size; and the account space to be selected with the largest residual space size is the target account space.

In the embodiment of the present application, the apparatus 100 may further include an operation module. The operation module is used for acquiring the size of a storage space occupied by regression test data generated in the last regression test of the verification environment and the size of the residual space of each account space of the verification environment before determining the target account space of the verification environment to be tested; judging whether transferable account spaces with residual space size larger than or equal to the size of the storage space occupied by the regression test data exist in each account space except the target account space of the last regression test; and if so, migrating the regression test data to the transferable account space.

In an optional implementation manner of the embodiment of the present application, the determining module 101 is specifically configured to determine, after migrating the regression test data into the transferable account space, that the target account space in the last regression test in the verification environment is the target account space in the current regression test.

In this embodiment of the application, the determining module 101 is further configured to determine, according to an estimated value of a storage space occupied by running a regression test on the current verification environment to be tested once and an operation frequency requirement of the regression test on the current verification environment to be tested, a total size of an account space required by the current verification environment to be tested; allocating a dedicated account space for the current to-be-tested verification environment in a plurality of storage units according to the total size of the account space required by the current to-be-tested verification environment; wherein: the account space of the current verification environment to be tested in each storage unit is larger than the estimated value of the storage space occupied by the current verification environment to be tested running the one-time regression test.

In the embodiment of the application, one storage unit has a plurality of account spaces of the verification environment.

In the embodiment of the present application, the sum of the account spaces of the respective authentication environments in one storage unit is equal to the size of the storage unit.

Referring to fig. 11, the memory unit management apparatus 200 includes: and configuring the module. Wherein:

the configuration module is used for configuring an exclusive account space for each verification environment in a plurality of storage units; and storing regression test data generated during the regression test operation of each verification environment in an account space of each verification environment.

In this embodiment of the present application, the configuration module is specifically configured to determine a total size of an account space required by each verification environment according to an estimated value of a storage space occupied by running a regression test in each verification environment for one time and a running frequency requirement of the regression test in each verification environment; allocating an exclusive account space for each verification environment in a plurality of storage units according to the total size of the account space required by each verification environment; wherein: the size of the account space of each verification environment in each storage unit is larger than the estimated value of the storage space occupied by running a regression test on each verification environment.

It should be understood that, for the sake of brevity, the contents described in some embodiments are not repeated in this embodiment.

Example four:

the present embodiment provides an electronic device, which can be seen in fig. 12 and includes a processor 1201, a memory 1202 and a communication bus 1203. Wherein:

the communication bus 1203 is used for implementing connection communication between the processor 1201 and the memory 1202.

The processor 1201 is configured to execute one or more programs stored in the memory 1202 to implement the methods of the first/second embodiments described above.

It is understood that the structure shown in fig. 12 is merely an illustration, and the electronic device may further include more or less components than those shown in fig. 12, or have a different configuration from that shown in fig. 12, and is not limited in the embodiment of the present application. As long as it can be used to complete the regression test.

The present embodiment also provides a readable storage medium, such as a floppy disk, an optical disk, a hard disk, a flash Memory, a usb disk, an SD (Secure Digital Memory Card) Card, an MMC (Multimedia Card) Card, etc., in which one or more programs for implementing the above steps are stored, and the one or more programs can be executed by one or more processors to implement the method in the first/second embodiment. And will not be described in detail herein.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.

In addition, units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

Furthermore, the functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.

In this context, a plurality means two or more.

The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A regression test management method, comprising:

after the project is determined, allocating dedicated account spaces in each storage unit for each verification environment needing regression testing in the project, wherein each verification environment shares the respective account space exclusively;

determining a target account space of a verification environment to be tested currently; the current to-be-tested verification environment is allocated with an exclusive account space in a plurality of storage units; the target account space is an account space which is determined in each account space of the current verification environment to be tested and is used for performing the regression test of the current verification environment to be tested;

and storing regression test data generated during the regression test operation of the current verification environment to be tested in the target account space of the current verification environment to be tested.

2. The regression test management method of claim 1, wherein prior to determining the target account space for the validation environment currently to be tested, the method further comprises:

judging whether a to-be-selected account space with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the current to-be-tested verification environment;

correspondingly, the determining the target account space of the verification environment to be tested currently includes:

and when the account space to be selected exists, determining the target account space from the account space to be selected.

3. The regression test management method of claim 2, wherein the step of determining whether there is a candidate account space having a remaining space size larger than a preset minimum space size of the verification environment in each account space of the current verification environment to be tested comprises:

judging whether the regression testing times corresponding to the currently existing regression testing data in all account spaces of the verification environment to be tested reach a preset maximum time threshold of the verification environment or not;

if not, judging whether a to-be-selected account space with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the verification environment to be tested;

and if so, deleting regression test data of the primary regression test with the longest existence time, and judging whether the account space to be selected with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the current verification environment to be tested.

4. The regression test management method of claim 2, wherein said method further comprises:

when the account space to be selected does not exist, judging whether regression testing times corresponding to currently existing regression testing data in all account spaces of the current verification environment to be tested are smaller than a preset minimum time threshold of the verification environment or not;

and if not, deleting regression test data of the primary regression test with the longest existence time, and then judging whether the account space to be selected with the residual space size larger than the preset minimum space size of the verification environment exists in each account space of the current verification environment to be tested again.

5. The regression test management method of any one of claims 2 to 4, wherein determining the target account space from the candidate account spaces comprises:

monitoring the size of the residual space of each account space to be selected of the current verification environment to be tested;

determining the account space to be selected with the largest residual space size; and the account space to be selected with the largest residual space size is the target account space.

6. The regression test management method of claim 1, wherein prior to determining the target account space for the validation environment currently to be tested, the method further comprises:

obtaining the size of a storage space occupied by regression test data generated in the last regression test of the verification environment and the size of the residual space of each account space of the verification environment;

judging whether transferable account spaces with residual space size larger than or equal to the size of the storage space occupied by the regression test data exist in each account space except the target account space of the last regression test;

and if so, migrating the regression test data to the transferable account space.

7. The regression test management method of claim 6, wherein determining a target account space for a validation environment currently to be tested comprises:

and after the regression test data is transferred into the transferable account space, determining that the target account space in the last regression test in the verification environment is the target account space in the current regression test.

8. The regression test management method of any one of claims 1 to 4 and 6 to 7, further comprising:

determining the total size of the account space required by the current verification environment to be tested according to the estimated value of the storage space occupied by the one-time regression test of the current verification environment to be tested and the operation frequency requirement of the regression test of the current verification environment to be tested;

allocating an exclusive account space for the current to-be-tested verification environment in a plurality of storage units according to the total size of the account space required by the current to-be-tested verification environment; wherein:

the account space of the current verification environment to be tested in each storage unit is larger than the estimated value of the storage space occupied by the current verification environment to be tested running a regression test.

9. A regression test management method according to any one of claims 1 to 4 and 6 to 7, wherein one storage unit has account spaces of a plurality of verification environments.

10. A regression test management method according to any one of claims 1 to 4 and 6 to 7, wherein a sum of the account spaces of the verification environments included in one storage unit is equal to the size of the storage unit.

11. A storage unit management method, comprising:

after the project is determined, allocating dedicated account spaces in a plurality of storage units for each verification environment needing regression testing in the project, wherein each verification environment shares the respective account space exclusively; and storing regression test data generated during the regression test operation of each verification environment in an account space exclusive to each verification environment.

12. The storage unit management method according to claim 11, wherein allocating an exclusive account space in a plurality of storage units for each verification environment in the project for which a regression test is to be performed comprises:

determining the total size of the account space required by each verification environment according to the estimated value of the storage space occupied by the regression test operated in one time in each verification environment and the operation frequency requirement of the regression test in each verification environment;

allocating an exclusive account space for each verification environment in a plurality of storage units according to the total size of the account space required by each verification environment; wherein:

the size of the account space of each verification environment in each storage unit is larger than the estimated value of the storage space occupied by running a regression test on each verification environment.

13. A regression test management apparatus, comprising: a determining module and an operating module;

the determining module is used for allocating dedicated account spaces in each storage unit for each verification environment needing regression testing in the project after the project is determined, and each verification environment shares the respective account space exclusively; and is used for determining a target account space of the verification environment to be tested currently; the current verification environment to be tested is allocated with a special account space in a plurality of storage units; the target account space is an account space which is determined in all account spaces of the current verification environment to be tested and is used for performing the regression test of the current verification environment to be tested;

the running module is used for storing regression testing data generated during regression testing running of the current verification environment to be tested in the target account space of the current verification environment to be tested.

14. A storage unit management apparatus, comprising: a configuration module;

the configuration module is used for allocating exclusive account spaces in a plurality of storage units aiming at each verification environment needing regression testing in the project after the project is determined, and each verification environment shares the account space independently; and storing regression test data generated during the regression test operation of each verification environment in an account space exclusive to each verification environment.

15. An electronic device, comprising: a processor, a memory, and a communication bus;

the communication bus is used for realizing connection communication between the processor and the memory;

the processor is configured to execute one or more programs stored in the memory to implement the regression test management method according to any one of claims 1 to 10, or to implement the memory unit management method according to claim 11 or 12.

16. A readable storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement the regression test management method according to any one of claims 1 to 10, or to implement the storage unit management method according to claim 11 or 12.