CN114238092A - Software performance evaluation method, device, equipment and readable storage medium - Google Patents

Software performance evaluation method, device, equipment and readable storage medium Download PDF

Info

Publication number
CN114238092A
CN114238092A CN202111484122.9A CN202111484122A CN114238092A CN 114238092 A CN114238092 A CN 114238092A CN 202111484122 A CN202111484122 A CN 202111484122A CN 114238092 A CN114238092 A CN 114238092A
Authority
CN
China
Prior art keywords
sub
evaluation
information
software
evaluation item
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111484122.9A
Other languages
Chinese (zh)
Inventor
苗潇绚
冷炜
高蕊
刘帅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Citic Bank Corp Ltd
Original Assignee
China Citic Bank Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Citic Bank Corp Ltd filed Critical China Citic Bank Corp Ltd
Priority to CN202111484122.9A priority Critical patent/CN114238092A/en
Publication of CN114238092A publication Critical patent/CN114238092A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3604Software analysis for verifying properties of programs

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Stored Programmes (AREA)

Abstract

The invention provides a software performance evaluation method, a device, equipment and a readable storage medium, which relate to the technical field of software testing and comprise the steps of displaying a first object in a first area of a display interface, wherein the first object comprises at least two second objects, each second object comprises a first sub-object and a second sub-object, each second object is sequentially and longitudinally arranged, the first sub-object and the second sub-object are sequentially and transversely arranged, and the second sub-object comprises a selection window for selecting the first sub-object; acquiring a first selection operation, wherein the first selection operation comprises a selection operation on a second sub-object in the second object; responding to the first selection operation, displaying a third object in a second area of the display interface, wherein the third object comprises performance scores of the evaluated software in the design and development stage obtained through calculation, assisting a software developer in finding short boards in the software design and development stage in time, and analyzing the urgency of the evaluated system in developing performance and high-availability tests.

Description

Software performance evaluation method, device, equipment and readable storage medium
Technical Field
The invention relates to the technical field of software testing, in particular to a software performance evaluation method, a device, equipment and a readable storage medium.
Background
The performance and highly available tests, which are implemented entirely by technical means, are located in the late stages of the software development lifecycle, and the introduction of problems and defects often stem from the design development phase. This mode results in high repair costs for problems found during performance and highly available testing, with significant development and testing personnel investment, and severely impacting the implementation cycle and delivery efficiency of the software system. But is not currently applied in the design development stage.
Disclosure of Invention
The present invention is directed to a method, an apparatus, a device and a readable storage medium for evaluating software performance, so as to improve the above-mentioned problems. In order to achieve the purpose, the technical scheme adopted by the invention is as follows:
in a first aspect, the present application provides a software performance evaluation method, including:
displaying a first object in a first area of a display interface, wherein the first object comprises at least two second objects, each second object comprises a first sub-object and a second sub-object, each second object is sequentially and longitudinally arranged, the first sub-object and the second sub-object are sequentially and transversely arranged, and the second sub-object comprises a selection window for selecting the first sub-object;
acquiring a first selection operation, wherein the first selection operation comprises a selection operation on the second sub-object in the second object;
and responding to the first selection operation, displaying a third object in a second area of the display interface, wherein the third object comprises the performance score of the evaluated software in the design and development stage.
Further, the displaying, in response to the first selection operation, a third object in a second area of the display interface, where the third object includes a performance score of the evaluated software in the design and development stage, includes:
sequentially judging the objects selected by the first selection operation, and if the second sub-object is selected, acquiring first information, wherein the first information is an evaluation score corresponding to the first sub-object, and the evaluation score is a first preset value;
establishing a reliability adjustment mathematical model according to all the first information, and solving the reliability adjustment mathematical model to obtain updated first information;
and calculating according to all the first information to obtain the performance score of the evaluated software in the design development stage.
Further, the establishing a reliability adjustment mathematical model according to all the first information, and solving the reliability adjustment mathematical model to obtain updated first information includes:
acquiring second information, wherein the second information comprises annual occurrence frequency information of the first sub-object in a software development record within a preset year, and the software development record is the development record of all software in a historical time period;
establishing a credibility calculation mathematical formula corresponding to each first sub-object based on the second information corresponding to each first sub-object, and solving the credibility calculation mathematical formula to obtain a credibility factor corresponding to the first sub-object;
and calculating to obtain an evaluation score after the reliability adjustment according to the reliability factor corresponding to the first sub-object and the evaluation score corresponding to the first sub-object, and updating the evaluation score corresponding to the first sub-object to be the evaluation score after the reliability adjustment.
Further, the establishing a reliability adjustment mathematical model according to all the first information, and solving the reliability adjustment mathematical model to obtain updated first information includes:
acquiring third information, wherein the third information comprises an application service type of the evaluated software, and the application service type comprises a business transaction type, a management analysis type, a supervision submission type or an operation management type;
acquiring an evaluation item attention factor table, wherein the evaluation item attention factor table is an evaluation item attention factor corresponding to each first sub-object under different application service types;
and calculating to obtain an evaluation score after the evaluation item attention factor is adjusted according to the evaluation item attention factor table and the evaluation score corresponding to the first sub-object, and updating the evaluation score corresponding to each first sub-object to be the evaluation score after the evaluation item attention factor is adjusted.
Further, the calculating according to all the first information to obtain the performance score of the evaluated software in the design and development stage includes:
acquiring fourth information, wherein the fourth information comprises an evaluation dimension corresponding to each first sub-object, and the evaluation dimension comprises application performance or database design or batch process design or high-availability design or reliability design;
acquiring a dimension attention factor table, wherein the dimension attention factor table is a dimension attention factor corresponding to different evaluation dimensions under different application service types;
and calculating the performance score of the evaluated software in the design and development stage according to the dimension attention factor table, the evaluation dimension corresponding to the first sub-object and the evaluation score corresponding to the first sub-object.
Further, in response to the first selection operation, displaying a third object in a second area of the display interface, where the third object includes a performance score calculated for the evaluated software, and then:
displaying a fourth object in a second area of a display interface, where the fourth object includes at least one fifth object and at least one sixth object, each fifth object includes at least two third sub-objects, each third sub-object is sequentially arranged in a horizontal direction, each sixth object includes at least five fourth sub-objects, and each fourth sub-object is sequentially arranged in a horizontal direction;
acquiring a first filling operation, wherein the first filling operation comprises filling evaluation item information and evaluation dimension information corresponding to the evaluation item information into two third sub-objects in the fifth object respectively;
acquiring a second filling operation, wherein the second filling operation comprises filling evaluation item information, an evaluation item attention factor of the evaluation item under a business transaction class, an evaluation item attention factor of the evaluation item under a management analysis class, an evaluation item attention factor of the evaluation item under a supervision and delivery class, and an evaluation item attention factor of the evaluation item under an operation management class into each fourth sub-object in the sixth objects;
adding the third sub-object filled with evaluation item information in the fifth object to the blank second object, and adding all the sixth objects to the evaluation item attention factor table.
In a second aspect, the present application further provides a software performance evaluation apparatus, including:
the display unit is used for displaying a first object in a first area of a display interface, the first object comprises at least two second objects, each second object comprises a first sub-object and a second sub-object, each second object is sequentially arranged longitudinally, the first sub-object and the second sub-object are sequentially arranged transversely, and each second sub-object comprises a selection window for selecting the first sub-object;
a first obtaining unit, configured to obtain a first selection operation, where the first selection operation includes a selection operation on the second sub-object in the second object;
and the first response unit is used for responding to the first selection operation and displaying a third object in a second area of the display interface, wherein the third object comprises the performance score of the evaluated software in the design and development stage.
Further, the first response unit includes:
a first judging unit, configured to sequentially judge the object selected by the first selecting operation, and if the second sub-object is selected, obtain first information, where the first information is an evaluation score corresponding to the first sub-object, and the evaluation score is a first preset value;
the first calculation unit is used for establishing a reliability adjustment mathematical model according to all the first information and solving the reliability adjustment mathematical model to obtain updated first information;
and the total score calculating unit is used for calculating according to all the first information to obtain the performance score of the evaluated software in the design and development stage.
Further, the first calculation unit includes:
a second obtaining unit, configured to obtain second information, where the second information includes information of the number of occurrences of the first sub-object in a software development record per year within a preset year, and the software development record is a development record of all software in a historical time period;
the first sub-calculation unit is used for establishing a credibility calculation mathematical formula corresponding to each first sub-object based on the second information corresponding to each first sub-object, and solving the credibility calculation mathematical formula to obtain a credibility factor corresponding to the first sub-object;
and the second sub-calculation unit is used for calculating to obtain an evaluation score after reliability adjustment according to the reliability factor corresponding to the first sub-object and the evaluation score corresponding to the first sub-object, and updating the evaluation score corresponding to the first sub-object to be the evaluation score after reliability adjustment.
Further, the first calculation unit includes:
a third obtaining unit, configured to obtain third information, where the third information includes an application service type of the evaluated software, and the application service type includes a business transaction type, a management analysis type, a supervision submission type, or an operation management type;
a fourth obtaining unit, configured to obtain an evaluation item attention factor table, where the evaluation item attention factor table is an evaluation item attention factor corresponding to each of the first sub-objects in different application service types;
and the third sub-calculation unit is used for calculating to obtain an evaluation score after the evaluation item attention factor is adjusted according to the evaluation item attention factor table and the evaluation score corresponding to the first sub-object, and updating the evaluation score corresponding to each first sub-object to be the evaluation score after the evaluation item attention factor is adjusted.
Further, the total score calculating unit includes:
a fifth obtaining unit, configured to obtain fourth information, where the fourth information includes an evaluation dimension corresponding to each of the first sub-objects, and the evaluation dimension includes an application performance, a database design, a batch design, a high availability design, or a reliability design;
a sixth obtaining unit, configured to obtain a dimension attention factor table, where the dimension attention factor table is a dimension attention factor corresponding to different evaluation dimensions in different application service types;
and the fourth sub-calculation unit is used for calculating and obtaining the performance score of the evaluated software in the design and development stage according to the dimension attention factor table, the evaluation dimension corresponding to the first sub-object and the evaluation score corresponding to the first sub-object.
Further, the software performance evaluation device further includes:
the operation and maintenance unit is used for displaying a fourth object in a second area of a display interface, the fourth object comprises at least one fifth object and at least one sixth object, each fifth object comprises at least two third sub-objects, each third sub-object is sequentially and transversely arranged, each sixth object comprises at least five fourth sub-objects, and each fourth sub-object is sequentially and transversely arranged;
a seventh obtaining unit, configured to obtain a first filling operation, where the first filling operation includes filling evaluation item information and evaluation dimension information corresponding to the evaluation item information into two third sub-objects in the fifth object, respectively;
an eighth obtaining unit, configured to obtain a second filling operation, where the second filling operation includes filling evaluation item information, an evaluation item attention factor of the evaluation item in a business transaction class, an evaluation item attention factor of the evaluation item in a management analysis class, an evaluation item attention factor of the evaluation item in a supervision and delivery class, and an evaluation item attention factor of the evaluation item in an operation management class into each fourth sub-object of the sixth object, respectively;
a first adding unit, configured to add the third sub-object, in which the evaluation item information is filled in the fifth object, to the blank second object, and add all the sixth objects to the evaluation item attention factor table.
In a third aspect, the present application further provides a software performance evaluation device, including:
a memory for storing a computer program;
a processor for implementing the steps of the software performance evaluation method when executing the computer program.
In a fourth aspect, the present application further provides a readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the software performance evaluation-based method described above.
The invention has the beneficial effects that:
the method integrates resources of historical performance data in the production, development and test stages, and automatically generates a system performance evaluation result by combining the service and technical requirements of the evaluated system, so that the evaluated system can know the performance of the system, the high-availability short board and the problem risk possibly caused by the corresponding short board in the development stage, and a developer is guided to improve the quality of system design and development.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the embodiments of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
FIG. 1 is a schematic flow chart of a software performance evaluation method according to an embodiment of the present invention;
FIG. 2 is a table of evaluation item focus factors as described in an embodiment of the present invention;
FIG. 3 is a table of estimated dimension attention factors according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a software performance evaluation apparatus according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a software performance evaluation device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present invention, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
Example 1:
the embodiment provides a software performance evaluation method.
Referring to fig. 1, it is shown that the method includes step S100, step S200, step S300, step S400, step S500, step S600, step S700, step S800 and step S900.
S100, displaying a first object in a first area of a display interface, wherein the first object comprises at least two second objects, each second object comprises a first sub-object and a second sub-object, each second object is sequentially and longitudinally arranged, the first sub-object and the second sub-object are sequentially and transversely arranged, and the second sub-object comprises a selection window for selecting the first sub-object;
it can be understood that the display interface mentioned in this step is the display interface to be faced by the software system development responsible person being evaluated this time, where the first object is a software evaluation list, each second object is each evaluation content of the software evaluation list, the content of the first sub-object is an evaluation item, and the second sub-object is a repeated option, and if selected, it indicates that the content of the evaluation item described by the first object appears in the software system being evaluated.
It should be noted that the evaluation item in the method is a cause of problems encountered in all software development histories of a company or a group in which the user is located, and the like, wherein all software includes development histories of various types of software.
Wherein the software development history comprises historical performance data of production, development and test stages, and for the convenience of understanding, the specific contents of several evaluation items are demonstrated in the step:
1. whether the large data size query operation has a paging query or return strip number control mechanism or not;
2. the batch transaction adopts an asynchronous processing mechanism;
3. unnecessary DISTINCE \ ORDER BY \ GROUP BY \ UNION is avoided, sorting operation is reduced, and unnecessary sorting predicates are eliminated.
S200, acquiring a first selection operation, wherein the first selection operation comprises a selection operation on a second sub-object in a second object;
it can be understood that, in this step, the content of the item to be evaluated is determined for the development of the software system, and if an inner cylinder of the description of the item to be evaluated appears in the software to be evaluated at this time, the inner cylinder needs to be selected.
It should be noted that, in this step, the software system development person in charge can check one or more evaluation items
And S300, responding to the first selection operation, displaying a third object in a second area of the display interface, wherein the third object comprises the performance score of the evaluated software in the design and development stage.
It will be appreciated that in this step, i.e., during the software system development process, the person in charge of the software system is responsible for displaying the performance scores of the software under evaluation in the design and development stage directly after completion of the check.
The method integrates resources of historical performance data in the production, development and test stages, and automatically generates evaluation data of system performance and high availability, so that an evaluated system can know the performance of the system, the high availability short boards and problem risks possibly caused by the corresponding short boards, and a developer is guided to improve the quality of system design and development.
In order to realize the content of this step, step S310, step S320 and step S330 are included in this embodiment.
S310, sequentially judging the objects selected by the first selection operation, and if a second sub-object is selected, acquiring first information, wherein the first information is an evaluation score corresponding to the first sub-object, and the evaluation score is a first preset value;
it should be noted that the first preset value in this step is 1.
It is understood that if a plurality of second sub-objects are selected, a plurality of first preset values should exist.
S320, establishing a reliability adjustment mathematical model according to all the first information, and solving the reliability adjustment mathematical model to obtain updated first information;
it should be noted that the selected first sub-object is a content of a subjective selection of the software system development person in charge, so this step corrects each piece of first information.
In order to achieve the above technical object, the present step further includes step S321, step S322, and step S323.
S321, acquiring second information, wherein the second information comprises annual occurrence frequency information of the first sub-object in a software development record within a preset year, and the software development record is the development record of all software within a historical time period;
it should be noted that the preset age mentioned in this step is 5 years, and those skilled in the art can select other ages according to the used environment, and no specific limitation is made in this application.
S322, establishing a credibility arithmetic mathematical formula corresponding to each first sub-object based on second information corresponding to each first sub-object, and solving the credibility arithmetic mathematical formula to obtain a credibility factor corresponding to the first sub-object;
it should be noted that, in this step, the following formula is calculated:
Figure BDA0003395910590000111
wherein c represents a confidence factor; a represents whether the production problems exist in the corresponding year, if so, the value is 1, and if not, the value is 0; x is a manually set basic attenuation parameter, currently set to 0.05; n represents the time range for searching production problems, and is currently set within 5 years; k represents the difference in the current year from the year in which the production problem was found.
Other options for x and n are available to those skilled in the art, and only one test environment suitable for me is provided in this step.
For ease of understanding, an illustrative example is given in this step:
taking an example that some kind of evaluation item has occurred in a certain system this year, c is calculated to be 1-0.05, namely 0.95;
taking the case that some kind of evaluation item occurs in a certain system in the year and the last year as an example, c is calculated to be 1-0.05-0.027, namely 0.923;
and S323, calculating to obtain the evaluation score after the reliability adjustment according to the reliability factor corresponding to the first sub-object and the evaluation score corresponding to the first sub-object, and updating the evaluation score corresponding to the first sub-object to be the evaluation score after the reliability adjustment.
It is understood that, in S300, one credibility factor is applied to one first message, it should be noted that, in this step, each message is modified, and each first message corresponds to one credibility factor.
That is, the score of each evaluation item is calculated by the following formula:
r=c*v
wherein r is the score of the evaluation item, c is the credibility factor, and v is the evaluation score.
However, in the method, it is also considered that the actual use environment of each software system is different, the actual influence of each evaluation item on the performance of the software in different application environments should be different, and if the evaluation items are all based on the same evaluation item scoring mechanism, a targeted scoring content cannot be obtained, and the software in different application environments cannot be objectively evaluated.
In order to solve the above problem, step S320 further includes step S324, step S325 and step S326.
S324, third information is obtained, the third information comprises an application service type of the evaluated software, and the application service type comprises a business transaction type, a management analysis type, a supervision reporting type or an operation management type;
s325, obtaining an evaluation item attention factor table, wherein the evaluation item attention factor table is an evaluation item attention factor corresponding to each first sub-object under different application service types;
referring to FIG. 2, an evaluation item focus factor table is shown.
S326, calculating to obtain the evaluation score after the evaluation item attention factor is adjusted according to the evaluation item attention factor table and the evaluation score corresponding to the first sub-object, and updating the evaluation score corresponding to each first sub-object to be the evaluation score after the evaluation item attention factor is adjusted.
Specifically, the step calculates the evaluation score adjusted by the evaluation item attention factor corresponding to each evaluation item through the following formula:
r=c*v*a
wherein r is the score of the evaluation item, v is the evaluation score, c is the credibility factor, and a is the evaluation item attention factor.
And S330, calculating according to all the first information to obtain the performance score of the software to be evaluated in the design and development stage.
In this step, the adjusted first information is calculated, and the targeted software performance score of the software to be evaluated is obtained. In order to achieve the above object, the present step further includes step S331, step S332, and step S333.
S331, acquiring fourth information, wherein the fourth information comprises an evaluation dimension corresponding to each first sub-object, and the evaluation dimension comprises application performance or database design or batch process design or high-availability design or reliability design;
it should be noted that the evaluation dimension corresponding to the first sub-object mentioned in this step is determined by those skilled in the art according to the content of the first sub-object. It should be noted that the maintenance personnel should update and determine the condition of the method according to the production operation and maintenance condition, the test defect submission condition, and the like.
S332, acquiring a dimension attention factor table, wherein the dimension attention factor table is a dimension attention factor corresponding to different evaluation dimensions under different application service types;
referring to FIG. 3, an evaluation dimension attention factor table is shown.
S333, calculating to obtain the performance score of the evaluated software in the design and development stage according to the dimension attention factor table, the evaluation dimension corresponding to the first sub-object and the evaluation score corresponding to the first sub-object.
Specifically, in this step, each dimension score is calculated by the following formula:
d=(∑r)/(w*100)
where, Σ r is the sum of all evaluation term scores in the dimension, and w is the dimension attention factor.
The score of each dimension under the percentage system can be obtained after the calculation of the formula.
Then the software performance score is calculated by the following formula:
s=∑d
s is the total score of the software performance score, and the sum of all the dimensionality scores of Σ d.
Meanwhile, in order to facilitate the operation and maintenance personnel to maintain the method, the method further comprises S400, S500, S600, S700 and S800.
S400, displaying a fourth object in a second area of the display interface, wherein the fourth object comprises at least one fifth object and at least one sixth object, each fifth object comprises at least two third sub-objects, each third sub-object is sequentially and transversely arranged, each sixth object comprises at least five fourth sub-objects, and each fourth sub-object is sequentially and transversely arranged;
it can be understood that in this step, the fourth object is an operation and maintenance personnel maintenance table, the fifth object is an evaluation item input item, and the sixth object is an evaluation item attention factor input item of the evaluation item.
S500, acquiring a first filling operation, wherein the first filling operation comprises filling evaluation item information and evaluation dimension information corresponding to the evaluation item information into two third sub-objects in a fifth object respectively;
s600, acquiring a second filling operation, wherein the second filling operation comprises the step of filling evaluation item information, an evaluation item attention factor of the evaluation item under a business transaction class, an evaluation item attention factor of the evaluation item under a management analysis class, an evaluation item attention factor of the evaluation item under a supervision and delivery class and an evaluation item attention factor of the evaluation item under an operation management class into each fourth sub-object in the sixth object;
it is understood that the operation and maintenance personnel in S500 and S600 perform update iteration on the system library of the method.
S700, sequentially analyzing the relation between each third sub-object and the first sub-object, if the third sub-object appears in the first sub-object, deleting the third sub-object, and adding a label of the repetition times to a second object which is repeatedly corresponding to the first object;
it can be understood that, this step is to count whether the scoring items input by the operation and maintenance personnel are repeated, and count the number of times of repetition.
And S800, calculating to obtain the evaluation score after the version iteration according to the repetition times corresponding to each second object, and updating the evaluation score corresponding to the first sub-object to be the evaluation score of the version iteration.
It should be noted that this step is to define the evaluation score by the number of times of repetition of the score item, and specifically, this step includes step S810, step S820, step S830, step S840, and step S850.
S810, if the repetition times are zero, the evaluation score of the version iteration is one;
s820, if the repetition times are more than or equal to one and less than or equal to three, the evaluation score of the version iteration is two;
s830, if the repetition times are more than or equal to four and less than or equal to six, the evaluation score of the version iteration is three;
s840, if the repetition times are more than or equal to seven and less than or equal to nine, the evaluation score of the version iteration is four;
and S850, if the repetition times are more than or equal to ten, the evaluation score of the version iteration is five.
It can be understood that the historical assets are reasonably utilized through the operations, and the appearance frequency of the evaluation content is converted into the corresponding score. In actual application, if the number of times of occurrence of the evaluation content is more, the higher the probability of causing a problem finally is, the more the influence on the reality can be caused, and the higher the final score is, the more a person in charge of development of a software system can be prompted through the score, and which needs to be modified in time.
And S900, adding a third sub-object filled with the evaluation item information in the fifth object into the blank second object, and adding all sixth objects into the evaluation item attention factor table.
It can be understood that, in this step, the newly input content of the operation and maintenance is added to the software evaluation list and the evaluation item attention factor table.
The method integrates resources of historical performance data in the production, development and test stages, and automatically generates a system performance evaluation result by combining the service and technical requirements of an evaluated system, so that the evaluated system can know the performance of the system, high-availability short boards and problem risks possibly caused by corresponding short boards in the development stage, and developers are guided to improve the quality of system design and development;
the method matches weight strategies according with system characteristics in the evaluation process of different types of systems, analyzes the urgency of the evaluated system to develop performance and high-availability tests by combining the production operation and maintenance requirements of the evaluated system and the performance and high-availability short boards found by evaluation, assists testers to make work priorities, and optimizes test resource allocation.
Example 2:
as shown in fig. 4, the present embodiment provides a software performance evaluation apparatus, including:
the display unit 1 is used for displaying a first object in a first area of a display interface, wherein the first object comprises at least two second objects, each second object comprises a first sub-object and a second sub-object, each second object is sequentially and longitudinally arranged, the first sub-object and the second sub-object are sequentially and transversely arranged, and the second sub-object comprises a selection window for selecting the first sub-object;
a first obtaining unit 2, configured to obtain a first selection operation, where the first selection operation includes a selection operation on a second sub-object in the second object;
and the first response unit 3 is used for responding to the first selection operation and displaying a third object in the second area of the display interface, wherein the third object comprises the performance score of the evaluated software in the design and development stage.
The operation and maintenance unit 4 is configured to display a fourth object in a second area of the display interface, where the fourth object includes at least one fifth object and at least one sixth object, each fifth object includes at least two third sub-objects, each third sub-object is sequentially and horizontally arranged, each sixth object includes at least five fourth sub-objects, and each fourth sub-object is sequentially and horizontally arranged;
a seventh obtaining unit 5, configured to obtain a first filling operation, where the first filling operation includes filling the evaluation item information and the evaluation dimension information corresponding to the evaluation item information into two third sub-objects in the fifth object, respectively;
an eighth obtaining unit 6, configured to obtain a second filling operation, where the second filling operation includes filling, into each fourth sub-object in the sixth object, evaluation item information, an evaluation item attention factor of the evaluation item in the service transaction class, an evaluation item attention factor of the evaluation item in the management analysis class, an evaluation item attention factor of the evaluation item in the supervision and delivery class, and an evaluation item attention factor of the evaluation item in the operation management class;
a first analysis unit 7, configured to sequentially analyze a relationship between each third sub-object and the first sub-object, and if a third sub-object appears in the first sub-object, delete the third sub-object, and add a tag of the repetition number to a second object that is repeatedly corresponding to the first object;
and the score updating unit 8 is configured to calculate an evaluation score after the version iteration according to the repetition number corresponding to each second object, and update the evaluation score corresponding to the first sub-object to the evaluation score of the version iteration.
A first adding unit 9, configured to add a third sub-object, in which the evaluation item information is filled in the fifth object, to the blank second object, and add all sixth objects to the evaluation item attention factor table.
In some other embodiments, the first response unit 3 comprises:
the first judging unit 31 is configured to sequentially judge the objects selected by the first selecting operation, and if the second sub-object is selected, obtain first information, where the first information is an evaluation score corresponding to the first sub-object, and the evaluation score is a first preset value;
the first calculating unit 32 is configured to establish a reliability adjustment mathematical model according to all the first information, and solve the reliability adjustment mathematical model to obtain updated first information;
and the total score calculating unit 33 is used for calculating according to all the first information to obtain the performance score of the evaluated software in the design and development stage.
In some other embodiments, the first calculation unit 32 includes:
a second obtaining unit 321, configured to obtain second information, where the second information includes information of the number of occurrences of the first sub-object in the software development record per year within a preset year, and the software development record is a development record of all software in a historical time period;
the first sub-calculation unit 322 is configured to establish a credibility mathematical formula corresponding to each first sub-object based on the second information corresponding to each first sub-object, and solve the credibility mathematical formula to obtain a credibility factor corresponding to the first sub-object;
the second sub-calculating unit 323 is configured to calculate, according to the reliability factor corresponding to the first sub-object and the evaluation score corresponding to the first sub-object, to obtain an evaluation score after the reliability adjustment, and update the evaluation score corresponding to the first sub-object to the evaluation score after the reliability adjustment.
A third obtaining unit 324, configured to obtain third information, where the third information includes an application service type of the software to be evaluated, and the application service type includes a business transaction type, a management analysis type, a supervision reporting type, or an operation management type;
a fourth obtaining unit 325, configured to obtain an evaluation item attention factor table, where the evaluation item attention factor table is an evaluation item attention factor corresponding to each first sub-object in different application service types;
the third sub-calculating unit 326 is configured to calculate, according to the evaluation item attention factor table and the evaluation score corresponding to the first sub-object, an evaluation score after the evaluation item attention factor is adjusted, and update the evaluation score corresponding to each first sub-object as the evaluation score after the evaluation item attention factor is adjusted.
In some other embodiments, the total score calculating unit 33 includes:
a fifth obtaining unit 331, configured to obtain fourth information, where the fourth information includes an evaluation dimension corresponding to each first sub-object, and the evaluation dimension includes an application performance or a database design or a batch design or a high availability design or a reliability design;
a sixth obtaining unit 332, configured to obtain a dimension attention factor table, where the dimension attention factor table is a dimension attention factor corresponding to different evaluation dimensions in different application service types;
a fourth sub-calculating unit 333, configured to calculate, according to the dimension attention factor table, the evaluation dimension corresponding to the first sub-object, and the evaluation score corresponding to the first sub-object, a performance score of the evaluated software in the design and development stage.
In some other embodiments, the score updating unit 8 includes:
a first logic unit 81, configured to, if the number of repetitions is zero, determine an evaluation score of version iteration to be one;
a second logic unit 82, configured to determine that the evaluation score of the version iteration is two if the number of repetitions is greater than or equal to one and the number of repetitions is less than or equal to three;
a third logic unit 83, configured to determine that the evaluation score of the version iteration is three if the number of repetitions is equal to or greater than four and the number of repetitions is equal to or less than six;
a fourth logic unit 84, configured to determine that the evaluation score of the version iteration is four if the number of repetitions is equal to or greater than seven and the number of repetitions is equal to or less than nine;
a fifth logic unit 85, configured to, if the number of repetitions is greater than or equal to ten, determine that the evaluation score of the version iteration is five.
It should be noted that, regarding the apparatus in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated herein.
Example 3:
corresponding to the above method embodiment, the present embodiment further provides a software performance evaluation device, and a software performance evaluation device described below and a software performance evaluation method described above may be referred to in correspondence with each other.
Fig. 5 is a block diagram illustrating a software performance evaluation device 800 according to an exemplary embodiment. As shown in fig. 5, the software performance evaluation apparatus 800 may include: a processor 801, a memory 802. The software performance evaluation device 800 may also include one or more of a multimedia component 803, an input/output (I/O) interface 804, and a communication component 805.
The processor 801 is configured to control the overall operation of the software performance evaluation apparatus 800, so as to complete all or part of the steps in the software performance evaluation method. The memory 802 is used to store various types of data to support the operation of the software performance evaluation device 800, such data may include, for example, instructions for any application or method operating on the software performance evaluation device 800, as well as application-related data, such as contact data, transceived messages, pictures, audio, video, and so forth. The Memory 802 may be implemented by any type of volatile or non-volatile Memory device or combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic disk or optical disk. The multimedia components 803 may include screen and audio components. Wherein the screen may be, for example, a touch screen and the audio component is used for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may further be stored in the memory 802 or transmitted through the communication component 805. The audio assembly also includes at least one speaker for outputting audio signals. The I/O interface 804 provides an interface between the processor 801 and other interface modules, such as a keyboard, mouse, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication component 805 is used for wired or wireless communication between the software performance evaluation device 800 and other devices. Wireless communication, such as Wi-Fi, bluetooth, Near Field Communication (NFC), 2G, 3G, or 4G, or a combination of one or more of them, so that the corresponding communication component 805 may include: Wi-Fi module, bluetooth module, NFC module.
In an exemplary embodiment, the software performance evaluation Device 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the software performance evaluation method described above.
In another exemplary embodiment, a computer readable storage medium comprising program instructions which, when executed by a processor, implement the steps of the software performance evaluation method described above is also provided. For example, the computer readable storage medium may be the memory 802 described above that includes program instructions that are executable by the processor 801 of the software performance evaluation device 800 to perform the software performance evaluation method described above.
Example 4:
corresponding to the above method embodiment, a readable storage medium is also provided in this embodiment, and a readable storage medium described below and a software performance evaluation method described above may be referred to in correspondence with each other.
A readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the software performance evaluation method of the above-mentioned method embodiments.
The readable storage medium may be a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and various other readable storage media capable of storing program codes.
The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes will occur to those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (14)

1. A method for evaluating software performance, comprising:
displaying a first object in a first area of a display interface, wherein the first object comprises at least two second objects, each second object comprises a first sub-object and a second sub-object, each second object is sequentially and longitudinally arranged, the first sub-object and the second sub-object are sequentially and transversely arranged, and the second sub-object comprises a selection window for selecting the first sub-object;
acquiring a first selection operation, wherein the first selection operation comprises a selection operation on the second sub-object in the second object;
and responding to the first selection operation, displaying a third object in a second area of the display interface, wherein the third object comprises the performance score of the evaluated software in the design and development stage.
2. The software performance evaluation method of claim 1, wherein the displaying a third object in a second area of the display interface in response to the first selection operation, the third object including a performance score of the evaluated software in a design development stage, comprises:
sequentially judging the objects selected by the first selection operation, and if the second sub-object is selected, acquiring first information, wherein the first information is an evaluation score corresponding to the first sub-object, and the evaluation score is a first preset value;
establishing a reliability adjustment mathematical model according to all the first information, and solving the reliability adjustment mathematical model to obtain updated first information;
and calculating according to all the first information to obtain the performance score of the evaluated software in the design development stage.
3. The software performance evaluation method of claim 2, wherein the establishing a reliability adjustment mathematical model according to all the first information, and solving the reliability adjustment mathematical model to obtain updated first information comprises:
acquiring second information, wherein the second information comprises annual occurrence frequency information of the first sub-object in a software development record within a preset year, and the software development record is the development record of all software in a historical time period;
establishing a credibility calculation mathematical formula corresponding to each first sub-object based on the second information corresponding to each first sub-object, and solving the credibility calculation mathematical formula to obtain a credibility factor corresponding to the first sub-object;
and calculating to obtain an evaluation score after the reliability adjustment according to the reliability factor corresponding to the first sub-object and the evaluation score corresponding to the first sub-object, and updating the evaluation score corresponding to the first sub-object to be the evaluation score after the reliability adjustment.
4. The software performance evaluation method of claim 2, wherein the establishing a reliability adjustment mathematical model according to all the first information, and solving the reliability adjustment mathematical model to obtain updated first information comprises:
acquiring third information, wherein the third information comprises an application service type of the evaluated software, and the application service type comprises a business transaction type, a management analysis type, a supervision submission type or an operation management type;
acquiring an evaluation item attention factor table, wherein the evaluation item attention factor table is an evaluation item attention factor corresponding to each first sub-object under different application service types;
and calculating to obtain an evaluation score after the evaluation item attention factor is adjusted according to the evaluation item attention factor table and the evaluation score corresponding to the first sub-object, and updating the evaluation score corresponding to each first sub-object to be the evaluation score after the evaluation item attention factor is adjusted.
5. The software performance evaluation method of claim 2, wherein the calculating from all the first information to obtain the performance score of the evaluated software in the design development stage comprises:
acquiring fourth information, wherein the fourth information comprises an evaluation dimension corresponding to each first sub-object, and the evaluation dimension comprises application performance or database design or batch process design or high-availability design or reliability design;
acquiring a dimension attention factor table, wherein the dimension attention factor table is a dimension attention factor corresponding to different evaluation dimensions under different application service types;
and calculating the performance score of the evaluated software in the design and development stage according to the dimension attention factor table, the evaluation dimension corresponding to the first sub-object and the evaluation score corresponding to the first sub-object.
6. The software performance evaluation method according to claim 1, wherein in response to the first selection operation, a third object is displayed in a second area of the display interface, and the third object includes a performance score of the evaluated software, and thereafter:
displaying a fourth object in a second area of a display interface, where the fourth object includes at least one fifth object and at least one sixth object, each fifth object includes at least two third sub-objects, each third sub-object is sequentially arranged in a horizontal direction, each sixth object includes at least five fourth sub-objects, and each fourth sub-object is sequentially arranged in a horizontal direction;
acquiring a first filling operation, wherein the first filling operation comprises filling evaluation item information and evaluation dimension information corresponding to the evaluation item information into two third sub-objects in the fifth object respectively;
acquiring a second filling operation, wherein the second filling operation comprises filling evaluation item information, an evaluation item attention factor of the evaluation item under a business transaction class, an evaluation item attention factor of the evaluation item under a management analysis class, an evaluation item attention factor of the evaluation item under a supervision and delivery class, and an evaluation item attention factor of the evaluation item under an operation management class into each fourth sub-object in the sixth objects;
adding the third sub-object filled with evaluation item information in the fifth object to the blank second object, and adding all the sixth objects to the evaluation item attention factor table.
7. A software performance evaluation apparatus, comprising:
the display unit is used for displaying a first object in a first area of a display interface, the first object comprises at least two second objects, each second object comprises a first sub-object and a second sub-object, each second object is sequentially arranged longitudinally, the first sub-object and the second sub-object are sequentially arranged transversely, and each second sub-object comprises a selection window for selecting the first sub-object;
a first obtaining unit, configured to obtain a first selection operation, where the first selection operation includes a selection operation on the second sub-object in the second object;
and the first response unit is used for responding to the first selection operation and displaying a third object in a second area of the display interface, wherein the third object comprises the performance score of the evaluated software in the design and development stage.
8. The software performance evaluation apparatus of claim 7, wherein the first response unit comprises:
a first judging unit, configured to sequentially judge the object selected by the first selecting operation, and if the second sub-object is selected, obtain first information, where the first information is an evaluation score corresponding to the first sub-object, and the evaluation score is a first preset value;
the first calculation unit is used for establishing a reliability adjustment mathematical model according to all the first information and solving the reliability adjustment mathematical model to obtain updated first information;
and the total score calculating unit is used for calculating according to all the first information to obtain the performance score of the evaluated software in the design and development stage.
9. The software performance evaluation apparatus of claim 8, wherein the first calculation unit comprises:
a second obtaining unit, configured to obtain second information, where the second information includes information of the number of occurrences of the first sub-object in a software development record per year within a preset year, and the software development record is a development record of all software in a historical time period;
the first sub-calculation unit is used for establishing a credibility calculation mathematical formula corresponding to each first sub-object based on the second information corresponding to each first sub-object, and solving the credibility calculation mathematical formula to obtain a credibility factor corresponding to the first sub-object;
and the second sub-calculation unit is used for calculating to obtain an evaluation score after reliability adjustment according to the reliability factor corresponding to the first sub-object and the evaluation score corresponding to the first sub-object, and updating the evaluation score corresponding to the first sub-object to be the evaluation score after reliability adjustment.
10. The software performance evaluation apparatus of claim 8, wherein the first calculation unit comprises:
a third obtaining unit, configured to obtain third information, where the third information includes an application service type of the evaluated software, and the application service type includes a business transaction type, a management analysis type, a supervision submission type, or an operation management type;
a fourth obtaining unit, configured to obtain an evaluation item attention factor table, where the evaluation item attention factor table is an evaluation item attention factor corresponding to each of the first sub-objects in different application service types;
and the third sub-calculation unit is used for calculating to obtain an evaluation score after the evaluation item attention factor is adjusted according to the evaluation item attention factor table and the evaluation score corresponding to the first sub-object, and updating the evaluation score corresponding to each first sub-object to be the evaluation score after the evaluation item attention factor is adjusted.
11. The software performance evaluation apparatus according to claim 8, wherein the total score calculation unit includes:
a fifth obtaining unit, configured to obtain fourth information, where the fourth information includes an evaluation dimension corresponding to each of the first sub-objects, and the evaluation dimension includes an application performance, a database design, a batch design, a high availability design, or a reliability design;
a sixth obtaining unit, configured to obtain a dimension attention factor table, where the dimension attention factor table is a dimension attention factor corresponding to different evaluation dimensions in different application service types;
and the fourth sub-calculation unit is used for calculating and obtaining the performance score of the evaluated software in the design and development stage according to the dimension attention factor table, the evaluation dimension corresponding to the first sub-object and the evaluation score corresponding to the first sub-object.
12. The software performance evaluation device of claim 7, further comprising:
the operation and maintenance unit is used for displaying a fourth object in a second area of a display interface, the fourth object comprises at least one fifth object and at least one sixth object, each fifth object comprises at least two third sub-objects, each third sub-object is sequentially and transversely arranged, each sixth object comprises at least five fourth sub-objects, and each fourth sub-object is sequentially and transversely arranged;
a seventh obtaining unit, configured to obtain a first filling operation, where the first filling operation includes filling evaluation item information and evaluation dimension information corresponding to the evaluation item information into two third sub-objects in the fifth object, respectively;
an eighth obtaining unit, configured to obtain a second filling operation, where the second filling operation includes filling evaluation item information, an evaluation item attention factor of the evaluation item in a business transaction class, an evaluation item attention factor of the evaluation item in a management analysis class, an evaluation item attention factor of the evaluation item in a supervision and delivery class, and an evaluation item attention factor of the evaluation item in an operation management class into each fourth sub-object of the sixth object, respectively;
a first adding unit, configured to add the third sub-object, in which the evaluation item information is filled in the fifth object, to the blank second object, and add all the sixth objects to the evaluation item attention factor table.
13. A software performance evaluation apparatus, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the software performance evaluation method of any one of claims 1 to 6 when executing the computer program.
14. A readable storage medium, characterized by: the readable storage medium has stored thereon a computer program which, when executed by a processor, carries out the steps of the software performance evaluation method of any one of claims 1 to 6.
CN202111484122.9A 2021-12-07 2021-12-07 Software performance evaluation method, device, equipment and readable storage medium Pending CN114238092A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111484122.9A CN114238092A (en) 2021-12-07 2021-12-07 Software performance evaluation method, device, equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111484122.9A CN114238092A (en) 2021-12-07 2021-12-07 Software performance evaluation method, device, equipment and readable storage medium

Publications (1)

Publication Number Publication Date
CN114238092A true CN114238092A (en) 2022-03-25

Family

ID=80753648

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111484122.9A Pending CN114238092A (en) 2021-12-07 2021-12-07 Software performance evaluation method, device, equipment and readable storage medium

Country Status (1)

Country Link
CN (1) CN114238092A (en)

Similar Documents

Publication Publication Date Title
CN111722839B (en) Code generation method and device, electronic equipment and storage medium
US20200241872A1 (en) Systems and Methods for Automating and Monitoring Software Development Operations
US20230112576A1 (en) Techniques for data processing predictions
CN111191879B (en) Comprehensive evaluation method and system
CN112783762B (en) Software quality assessment method, device and server
CN115687050A (en) Performance analysis method and device of SQL (structured query language) statement
US8375365B2 (en) Customization verification
US20210182701A1 (en) Virtual data scientist with prescriptive analytics
CN117407513A (en) Question processing method, device, equipment and storage medium based on large language model
JP2024000956A (en) Program, information processing device, method and information processing system
CN114238092A (en) Software performance evaluation method, device, equipment and readable storage medium
CN114141236B (en) Language model updating method and device, electronic equipment and storage medium
CN113590484B (en) Algorithm model service testing method, system, equipment and storage medium
CN115422202A (en) Service model generation method, service data query method, device and equipment
CN112631905A (en) Execution process data management method and device, computer equipment and storage medium
CN111414157A (en) Iteration method and device for changes of profiles architecture, computer equipment and storage medium
US20240338564A1 (en) Training sample acquiring method and apparatus as well as large model optimization training method and apparatus
CN117874211B (en) Intelligent question-answering method, system, medium and electronic equipment based on SAAS software
CN113448842B (en) Big data system testing method and device, server and storage medium
US11830081B2 (en) Automated return evaluation with anomoly detection
CN113282299B (en) Information processing method, device, equipment and storage medium
EP4050540A1 (en) Learning based modeling of emergent behaviour of complex system
US20230109797A1 (en) Api health analysis
CN113076317A (en) Data processing method, device and equipment based on big data and readable storage medium
CN118210513A (en) Cloud platform-based software development management method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination