CN112860556A - Coverage rate statistical method, coverage rate statistical device, computer system and readable storage medium - Google Patents

Coverage rate statistical method, coverage rate statistical device, computer system and readable storage medium Download PDF

Info

Publication number
CN112860556A
CN112860556A CN202110188255.5A CN202110188255A CN112860556A CN 112860556 A CN112860556 A CN 112860556A CN 202110188255 A CN202110188255 A CN 202110188255A CN 112860556 A CN112860556 A CN 112860556A
Authority
CN
China
Prior art keywords
coverage rate
coverage
counted
statistical
present disclosure
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110188255.5A
Other languages
Chinese (zh)
Other versions
CN112860556B (en
Inventor
吴诗涵
王禹
李培文
李双
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202110188255.5A priority Critical patent/CN112860556B/en
Publication of CN112860556A publication Critical patent/CN112860556A/en
Application granted granted Critical
Publication of CN112860556B publication Critical patent/CN112860556B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3676Test management for coverage analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3692Test management for test results analysis

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Stored Programmes (AREA)

Abstract

The present disclosure provides a coverage rate statistical method, a coverage rate statistical apparatus, a computer system, a computer-readable storage medium, and a computer program product, which may be used in the field of artificial intelligence, the internet of things, or other fields. Wherein, the method comprises the following steps: acquiring a coverage rate report file generated aiming at each to-be-counted method of a to-be-counted item, wherein the coverage rate report file comprises coverage rate statistical data obtained by counting aiming at each to-be-counted method; acquiring a configuration file, wherein the configuration file comprises various methods to be counted and a user-defined counting dimension corresponding to each method to be counted; matching the coverage rate statistical data in the coverage rate report file and the user-defined statistical dimension in the configuration file according to a method to be counted to obtain a matching result; and generating a coverage rate statistical record based on the user-defined statistical dimension statistics according to the matching result.

Description

Coverage rate statistical method, coverage rate statistical device, computer system and readable storage medium
Technical Field
The present disclosure relates to the field of computer technologies, and more particularly, to a coverage rate statistical method, a coverage rate statistical apparatus, a computer system, a computer-readable storage medium, and a computer program product.
Background
Code coverage is a measure of the integrity of software testing, and is a measure of the effectiveness of testing, and is used to describe the proportion and extent of the source Code being tested in a program, and the proportion is referred to as Code coverage. The code coverage rate is an important index for checking the code quality, and is particularly important in the project development process.
In the process of realizing the concept of the present disclosure, the inventor finds that in the related art, at least the following problems exist, the existing coverage rates are counted according to the code levels of the projects, the degree of fitting with the projects is not high, and accurate management is not convenient.
Disclosure of Invention
In view of the above, the present disclosure provides a coverage rate statistical method, a coverage rate statistical apparatus, a computer system, a computer-readable storage medium, and a computer program product.
One aspect of the present disclosure provides a coverage statistic method, including: acquiring a coverage rate report file generated aiming at each to-be-counted method of a to-be-counted item, wherein the coverage rate report file comprises coverage rate statistical data obtained by counting aiming at each to-be-counted method; acquiring a configuration file, wherein the configuration file comprises the to-be-counted methods and user-defined statistical dimensions corresponding to the to-be-counted methods; matching the coverage rate statistical data in the coverage rate report file and the user-defined statistical dimension in the configuration file according to the method to be counted to obtain a matching result; and generating a coverage rate statistical record based on the user-defined statistical dimension statistics according to the matching result.
According to an embodiment of the present disclosure, the method further includes: acquiring a coverage rate statistical record of a plurality of items to be tested; and generating a histogram for visual display according to the plurality of items to be tested and the coverage rate statistical record corresponding to each item to be tested.
According to an embodiment of the present disclosure, the method further includes: acquiring all to-be-counted methods in the to-be-tested items; determining parameter information corresponding to each method to be counted according to the coverage rate statistical record, wherein the parameter information comprises the user-defined statistical dimension and the coverage rate statistical data; and generating a table for visual display according to the method to be counted and the parameter information.
According to an embodiment of the present disclosure, the method further includes: determining developer information corresponding to each method to be counted in the project to be tested according to the configuration file; determining the total code line number, the coverage line number and the coverage rate of the codes corresponding to the developer information according to the coverage rate statistical record; and generating a stacking histogram for visual display according to the developer information and the total code line number, the coverage line number and the coverage rate.
According to an embodiment of the present disclosure, the method further includes: acquiring target self-defined statistical dimensions required to be based when inquiring the statistical record of the coverage rate; and obtaining a visual display result of a coverage rate statistical record related to the target user-defined statistical dimension according to the target user-defined statistical dimension query.
According to an embodiment of the present disclosure, in the above method, the parameter information includes coverage details, and the content of the coverage details is represented in a form of a link, and the method further includes: and clicking the target content of the coverage rate details, and jumping to a coverage rate details page, wherein the coverage rate details page shows the coverage condition of the method to be counted corresponding to the target content in different colors.
Another aspect of the present disclosure provides a coverage statistic apparatus, including: the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a coverage rate report file generated by each to-be-counted method of a to-be-counted project, and the coverage rate report file comprises coverage rate statistical data obtained by counting each to-be-counted method; a second obtaining module, configured to obtain a configuration file, where the configuration file includes the to-be-counted methods and a custom statistical dimension corresponding to each of the to-be-counted methods; the matching module is used for matching the coverage rate statistical data in the coverage rate report file with the custom statistical dimension in the configuration file according to the method to be counted to obtain a matching result; and the generating module is used for generating a coverage rate statistical record based on the user-defined statistical dimension statistics according to the matching result.
Another aspect of the present disclosure provides a computer system comprising: one or more processors; memory for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the coverage statistics method as described above.
Another aspect of the present disclosure provides a computer-readable storage medium having stored thereon computer-executable instructions for implementing the coverage statistics method as described above when executed.
Another aspect of the disclosure provides a computer program product comprising computer executable instructions for implementing the coverage statistics method as described above when executed.
According to the embodiment of the disclosure, a coverage rate report file generated by acquiring each to-be-counted method for a to-be-counted item is adopted, wherein the coverage rate report file comprises coverage rate statistical data counted by each to-be-counted method; acquiring a configuration file, wherein the configuration file comprises various methods to be counted and a user-defined counting dimension corresponding to each method to be counted; matching the coverage rate statistical data in the coverage rate report file and the user-defined statistical dimension in the configuration file according to a method to be counted to obtain a matching result; the coverage rate statistical records corresponding to the statistical dimensions can be obtained due to the self-defined statistical dimensions set for the method to be counted, the technical problem that the coverage rate statistical method based on the statistics only on the code level is not high in item fitting degree is at least partially solved, and the technical effect that the codes of the item to be counted can be accurately managed from different dimensions is achieved.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent from the following description of embodiments of the present disclosure with reference to the accompanying drawings, in which:
FIG. 1 schematically illustrates an exemplary system architecture to which a coverage statistics approach may be applied, according to an embodiment of the present disclosure;
FIG. 2 schematically illustrates a flow chart of a coverage statistics method according to an embodiment of the present disclosure;
FIG. 3 schematically illustrates a visualization page presentation of overall coverage of a project in accordance with an embodiment of the present disclosure;
FIG. 4 schematically illustrates a visualization page presentation of sets of item code overlay details, in accordance with an embodiment of the present disclosure;
FIG. 5 schematically illustrates a block diagram of a coverage statistics system according to an embodiment of the present disclosure;
fig. 6 schematically shows a block diagram of a coverage statistics apparatus according to an embodiment of the present disclosure; and
FIG. 7 schematically illustrates a block diagram of a computer system suitable for implementing the above-described method, according to an embodiment of the present disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is illustrative only and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.
Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). Where a convention analogous to "A, B or at least one of C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B or C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).
The code coverage rate is an important index for checking the code quality, and is particularly important in the project development process. The coverage rate can be used for measuring the self-testing level and effect of developers, and the number of problems is reduced, so that the reliability and stability of the product are improved.
Jacoco (an open source coverage tool, for Java language) is currently the most common coverage tool, and can detect line coverage, class coverage, method coverage, branch coverage, instruction coverage, and round-robin complexity of items. The implementation principle is to record the coverage data by means of instrumentation. MAVEN is Project management tool software for reports and documents, which comprises a Project Object Model (POM), a set of standard sets, a Project declaration period, a dependency management system and logic for running plug-in objects defined in the life cycle phase, wherein MAVEN can manage the construction of projects through a small piece of description information, Jacoco can be embedded into MAVEN, and the coverage rate of the projects can be viewed through code coverage rate reports generated after the projects are constructed.
Meanwhile, a plurality of third-party tools also provide integration for Jacoco, such as sonarQube project management, project coverage rate can be checked through a coverage rate index, Jenkins operation and maintenance management can be carried out, and project coverage rate can be checked through a coverage Report interface. The sonarQube is an open-source code analysis platform and is used for continuously analyzing and evaluating the quality of a project source code, and the problems of repeated codes, potential bugs, code specifications, security vulnerabilities and the like in a project can be detected through the sonarQube, and the scanning method comprises the following steps: calling the sonarScanner through Jenkins plug-in or using a built-in scanner such as Maven, Gradle and the like, continuously scanning codes according to project requirements, pushing results to sonarQube for page display, wherein Jenkins is an open-source continuous integration tool for providing a friendly operation interface, and is mainly used for continuously and automatically constructing/testing software projects and monitoring the running of external tasks.
In the process of implementing the disclosed concept, the inventor finds that, in the prior art, all coverage rates are counted according to the code level of the project, namely, the coverage rate of the project, the coverage rate of the class and the coverage rate of the method. The coverage of the codes cannot be combined with the service scenario, such as the coverage of all the codes in the service scenario is statistically settled. The code coverage rate cannot be matched with the developers, and the code coverage condition of each developer cannot be evaluated. Because the version is modified according to the service scene and the function when being upgraded, the existing statistical dimension is inconvenient for accurate management and has low degree of fitting with the project.
Embodiments of the present disclosure provide a coverage statistic method, a coverage statistic apparatus, a computer system, a computer-readable storage medium, and a computer program product. The method comprises the steps of obtaining a coverage rate report file generated aiming at each to-be-counted method of a to-be-counted project, wherein the coverage rate report file comprises coverage rate statistical data obtained by counting aiming at each to-be-counted method; acquiring a configuration file, wherein the configuration file comprises various methods to be counted and a user-defined counting dimension corresponding to each method to be counted; matching the coverage rate statistical data in the coverage rate report file and the user-defined statistical dimension in the configuration file according to a method to be counted to obtain a matching result; and generating a coverage rate statistical record based on the user-defined statistical dimension statistics according to the matching result.
Fig. 1 schematically illustrates an exemplary system architecture 100 to which a coverage statistics approach may be applied, according to an embodiment of the present disclosure. It should be noted that fig. 1 is only an example of a system architecture to which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, and does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.
As shown in fig. 1, the system architecture 100 according to this embodiment may include terminal devices 101, 102, 103, a network 104 and a server 105. The network 104 serves as a medium for providing communication links between the terminal devices 101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired and/or wireless communication links, and so forth.
A user may use the terminal devices 101, 102, 103 to interact with the server 105 over the network 104 to receive or transmit data or the like. The terminal devices 101, 102, 103 may have various communication client applications installed thereon, such as a shopping application, a web browser application, a search application, an instant messaging tool, a mailbox client, and/or social platform software.
The terminal devices 101, 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.
The server 105 may be a server that provides various services, such as a background management server that provides support for websites browsed by users using the terminal devices 101, 102, 103. The background management server may analyze and perform other processing on the received data such as the user request, and feed back a processing result (e.g., a webpage, information, or data obtained or generated according to the user request) to the terminal device.
It should be noted that the coverage statistics provided by the embodiments of the present disclosure may be generally performed by the server 105. Accordingly, the coverage statistic apparatus provided by the embodiments of the present disclosure may be generally disposed in the server 105. The coverage statistics method provided by the embodiments of the present disclosure may also be performed by a server or a server cluster that is different from the server 105 and is capable of communicating with the terminal devices 101, 102, 103 and/or the server 105. Accordingly, the coverage statistic apparatus provided by the embodiment of the present disclosure may also be disposed in a server or a server cluster different from the server 105 and capable of communicating with the terminal devices 101, 102, 103 and/or the server 105. Alternatively, the coverage rate statistical method provided by the embodiment of the present disclosure may also be executed by the terminal device 101, 102, or 103, or may also be executed by another terminal device different from the terminal device 101, 102, or 103. Accordingly, the coverage rate statistic apparatus provided by the embodiment of the present disclosure may also be disposed in the terminal device 101, 102, or 103, or in another terminal device different from the terminal device 101, 102, or 103.
For example, the coverage report file and the configuration file may be originally stored in any one of the terminal devices 101, 102, or 103 (e.g., the terminal device 101, but not limited thereto), or stored on an external storage device and may be imported into the terminal devices 101, 102, or 103, or the coverage report file and the configuration file may also be stored in the server 105, or stored on an external server and may be imported into the server 105. Then, the terminal device 101, 102, 103 or the server 105 may locally perform the coverage statistical method provided by the embodiment of the present disclosure, or transmit the coverage report file and the configuration file to other terminal devices, servers or server clusters, and perform the coverage statistical method provided by the embodiment of the present disclosure by other terminal devices, servers or server clusters receiving the coverage report file and the configuration file. It should be noted that the coverage report file and the configuration file need to be stored in the same file path, such as in the terminal device 101 or the server 105.
It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
It should be noted that the coverage rate statistical method, the coverage rate statistical device, the computer system, the computer readable storage medium, and the computer program product of the present disclosure may be used in the fields of artificial intelligence and internet of things technology, and may also be used in any field other than the fields of artificial intelligence and internet of things technology.
Fig. 2 schematically shows a flow chart of a coverage statistics method according to an embodiment of the present disclosure.
As shown in fig. 2, the method includes operations S201 to S204.
In operation S201, a coverage report file generated for each to-be-counted method of the item to be tested is obtained, where the coverage report file includes coverage statistical data counted for each to-be-counted method.
According to an embodiment of the disclosure, the coverage report file may be a jacoco coverage report generated based on jacoco plug-ins, for example.
In operation S202, a configuration file is obtained, where the configuration file includes each method to be counted and a custom statistical dimension corresponding to each method to be counted.
According to an embodiment of the present disclosure, the configuration file may be, for example, a file obtained by registering functions, methods (i.e., the above-mentioned methods to be counted), and information of a person in charge according to the project requirement, and the registered configuration file may exist and be placed under a specified path, for example.
According to an embodiment of the present disclosure, the configuration file may have a structure and parameters as shown in table 1 below, for example.
TABLE 1
Figure BDA0002943495050000081
The project group may be, for example, the project to be tested, the method name may be, for example, the method to be counted, the belonging project name, package name, and class name may be, for example, the project name, package name, and class name corresponding to the method to be counted, the primary function, the secondary function, the tertiary function, and the quaternary function may be, for example, one or more functions that can be implemented by the method to be counted in the project to be tested, and the responsible person may be, for example, a developer who writes a code of the method to be counted. In this embodiment, for example, information such as a function and a person in charge is added to the configuration file as the user-defined statistical dimension.
It should be noted that, the customized statistical dimension may further include, for example, at least one of information such as version plans and business scenarios, and may not be limited thereto.
In operation S203, the coverage statistical data in the coverage report file and the custom statistical dimensions in the configuration file are matched according to the method to be counted, so as to obtain a matching result.
According to the embodiment of the disclosure, the coverage rate report generated by the Jacoco plug-in may include, for example, the coverage rate statistics data of the method level, the class level, the package level and the item level, and since the method is the minimum statistical unit, the coverage rate of the class, the package and the item may be calculated by the method coverage rate. Since the coverage report generated by the Jococo is in the HTML format, to implement the matching process, for example, the method names, the parameter types, the category names of the access parameters, and other coverage data of the method may be obtained by analyzing the coverage report generated by the Jacoco plug-in the HTML format, and the coverage report file may be obtained by writing the analyzed data into an excel file.
According to an embodiment of the present disclosure, the coverage report file may have a structure and parameters as shown in table 2 below, for example.
TABLE 2
Figure BDA0002943495050000091
The project name, package name, instruction coverage, branch coverage, uncovered circle complexity, uncovered line number, total line number, uncovered method number, total method number, method link, etc. may constitute the other items of coverage data. The unique method in the project can be positioned through three elements of the method name, the parameter type of the parameter to be referred to and the name of the category.
According to the embodiment of the disclosure, since the method name, the parameter type of the access parameter and the name of the access parameter of the method to be counted have been registered in the configuration file, the read configuration file under the specified path can be matched with the coverage report file obtained by the analysis in combination with the three elements.
In operation S204, a coverage statistic record based on the custom statistic dimension statistic is generated according to the matching result.
According to the embodiment of the disclosure, based on the three elements, the coverage statistical data of the method level in the Jacoco coverage report file can be matched with the self-defined statistical dimension information of the functions and the like in the configuration file, and a multi-dimensional coverage statistical record containing the functions, the methods, the responsible persons, the circle complexity, the row coverage and the like is generated.
According to an embodiment of the present disclosure, the coverage statistics record may have a structure and parameters as shown in table 3 below, for example.
TABLE 3
Figure BDA0002943495050000101
Through the embodiment of the disclosure, the code coverage rate is combined with the self-defined statistical dimensions such as the service scenes, the version plans and the like, so that the obtained statistical result not only can show the report forms of the existing statistical dimensions, but also can be used for counting the coverage rates of the codes corresponding to different service scenes according to the requirements of different applications, so that when a certain service scene is modified, the code quality after the functional modification can be evaluated through the coverage rate of the scene, the code coverage condition of each developer in each version plan can be counted, and a plurality of referable dimensions are provided for the code coverage rate statistical result.
According to the embodiment of the disclosure, the coverage rate statistical record can be finally displayed visually in the presentation effect of the page view, for example.
The effect of the visual display is further described below with reference to fig. 3 to 5 in conjunction with specific embodiments.
According to an embodiment of the present disclosure, in order to implement a visual display of the coverage statistical record, the coverage statistical method may further include: acquiring a coverage rate statistical record of a plurality of items to be tested; and generating a histogram for visual display according to the plurality of items to be tested and the coverage rate statistical record corresponding to each item to be tested.
FIG. 3 schematically illustrates a visualization page presentation of overall coverage of a project in accordance with an embodiment of the present disclosure.
According to embodiments of the present disclosure, an item as a whole may, for example, comprise a plurality of different sets of items under the same or different products. Referring to fig. 3, the overall coverage of the items herein is used to show the coverage of different items under the same product after unit testing, and the graph includes two parts, i.e., a VIEW MORE module and a histogram, where the abscissa of the histogram can be, for example, an item group type, the ordinate can be the overall coverage of each (item) group (where statistics are performed, for example, by a row coverage value), each histogram cell in the histogram can correspond to a VIEW MORE module, and by clicking the VIEW MORE module, the MORE detailed code coverage of each group of items can be further viewed.
FIG. 4 schematically illustrates a visualization page presentation of sets of item code overlay details in accordance with an embodiment of the present disclosure.
As shown in fig. 4, the page may include, for example: and displaying the coverage details of each method of the project in a form of a table, and displaying the coverage details of each version of the developer in a form of a stacked histogram.
According to an embodiment of the present disclosure, to further view more detailed code coverage of each group of items, the coverage statistical method may further include: acquiring various to-be-counted methods in the to-be-tested project; determining parameter information corresponding to each method to be counted according to the coverage rate counting record, wherein the parameter information comprises user-defined counting dimensionality and coverage rate counting data; and generating a table for visual display according to the method to be counted and the parameter information.
According to the embodiment of the present disclosure, referring to fig. 4, a table therein is, for example, the table generated according to the method to be counted and the parameter information, and based on the table shown in fig. 4, for example, the code coverage of the project can be monitored from two custom dimensions of a principal and a function.
According to an embodiment of the present disclosure, the parameter information may include coverage details, the content of the coverage details may be represented in a form of a link, and the coverage statistical method may further include: and clicking the target content of the coverage rate details, and jumping to a coverage rate details page, wherein the coverage rate details page shows the coverage condition of the method to be counted corresponding to the target content in different colors.
According to the embodiment of the present disclosure, for the table in fig. 4, each method is a row that can be used as a table, and the column information of the table can be, for example, an item, a package, a class, a function to which the method belongs, a developer, a version, a total row number, a coverage row number, coverage details (i.e., the coverage details described above), and the like in which the method is located. The "details" (i.e., the above target content) under the coverage details are links, and by clicking the links, the user can jump to an HTML detail page for presenting coverage reports generated by Jacoco, and coverage of each line method can be represented by different background colors in the HTML detail page, for example.
According to an embodiment of the present disclosure, in order to more intuitively view more detailed code coverage of each group of items, the coverage rate statistical method may further include: determining developer information corresponding to each method to be counted in the project to be tested according to the configuration file; determining the total code line number, the coverage line number and the coverage rate of the codes corresponding to the developer information according to the coverage rate statistical record; and generating a stacking histogram for visual display according to the developer information, the total code line number, the coverage line number and the coverage rate.
According to the embodiment of the present disclosure, referring to fig. 4, the histogram is, for example, the above-mentioned stacked histogram, the abscissa of the stacked histogram is, for example, each responsible person (i.e. the above-mentioned developer information), and the ordinate is, for example, the total number of lines of codes responsible for each responsible person, and the number of covered lines and the coverage rate can be displayed through the stacked proportion and the sliding information card.
According to an embodiment of the present disclosure, in order to provide query convenience, the coverage rate statistical method may further include: acquiring target self-defined statistical dimensions required to be based when inquiring the statistical record of the coverage rate; and obtaining a visual display result of the coverage rate statistical record related to the target user-defined statistical dimension according to the target user-defined statistical dimension query.
According to an embodiment of the present disclosure, referring to fig. 4, the target custom statistical dimension may be represented as version information, for example, in order to implement a query based on the version information, a version search box is provided in fig. 4, for example, and based on the version search box, a row coverage condition of codes responsible for each responsible person in different versions may be presented according to search contents.
Through the embodiment of the disclosure, due to the fact that the results are visually displayed, the code coverage conditions of different service scenes can be visually monitored, meanwhile, the code coverage condition of the function which each developer is responsible for can be visually known, even the coverage statistical results can be visually monitored from other self-defined dimensions (such as version plans, service functions and the like), and the code quality can be further effectively improved through monitoring and management based on multiple dimensions.
Fig. 5 schematically illustrates a block diagram of a coverage statistics system according to an embodiment of the present disclosure.
As shown in fig. 5, the basic components of the coverage statistics system for implementing the coverage statistics method described above are illustrated, for example, the coverage statistics system may mainly be composed of three parts, i.e., a configuration file, a self-research statistics toolkit and a data presentation page, and additionally, for example, jenkins + Jacoco may provide support.
According to the embodiment of the disclosure, for example, the dimensions of the function, the service scene, the corresponding responsible person, the version plan and the like of the method to be counted under the item to be counted can be entered in the configuration file, and the problem that the counting dimension is single and the counting cannot be performed by taking the function, the service scene and the person version arrangement as the dimension in the prior art is solved.
According to the embodiment of the disclosure, the self-research statistical toolkit may read a coverage report generated by the configuration file and the Jacoco plug-in the specified path, and generate a statistical result file of a user-defined dimension (i.e., a multi-dimensional statistical data result module in fig. 5), where the statistical result file may be represented as, for example, a statistical report with the method as a minimum unit, and the report includes the affiliated dimensions and coverage indexes of the method. The statistical result file generated by the self-research statistical toolkit may include, for example, a project overall coverage rate file, a project method coverage detail file including all dimension information (functions, application scenarios, developers, etc.) of all methods in the configuration file and corresponding coverage rates (row coverage, branch coverage, etc.), and a developer version coverage rate detail file obtained by counting the total number of rows of codes, the number of rows covered and the number of rows uncovered in each development version of each developer.
According to the embodiment of the disclosure, the data presentation page may, for example, present different visual data results according to project requirements by using the statistical result file generated by the self-research statistical kit as a data source. For example, a histogram of planned coverage and actual coverage of each version can be generated according to the overall coverage file, and the visualization result can be represented as a page shown in fig. 3, for example; according to the item method coverage detail file, a coverage rate statistical table of the function corresponding method can be generated, and the visualization result can be represented as a table in fig. 4, for example; and generating a code coverage situation histogram of each developer according to the coverage rate detail file of each version of the developer, wherein the visualization result can be represented as a piled histogram in fig. 4. In this embodiment, the data presentation page may present, for example, a chart with a developer as a dimension by default. Meanwhile, the page can contain version numbers and keyword search boxes, a user can select dimensions to be counted, and the page can summarize and display all coverage indexes of all methods under the selected dimensions.
According to the embodiment of the present disclosure, the statistical result file generated by the self-research statistical kit may also be directly downloaded by the user (e.g., the result file downloading module in fig. 5), so as to satisfy more diversified requirements.
According to the embodiment of the disclosure, a system module composed of the configuration file, the self-research statistical toolkit and the data display page can be deployed to the same server with Jenkins, for example, Jacoco plug-ins can be installed in the Jenkins server, and a complete coverage statistical system can be constructed by combining the system module and the Jenkins, for example.
According to the embodiment of the disclosure, for the coverage rate statistical system shown in fig. 5, the jenkins project construction module in which the Jacoco plug-in is installed can select project automatic construction time through configuration parameters, so as to realize a timed construction project, so that jenkins can acquire the latest code corresponding to the project according to the project constructed at a timed time and automatically deploy, and meanwhile, the latest Jacoco coverage rate report can be generated under a specified path of a server by combining the function of the Jacoco plug-in. Based on this, the latest statistical result file generated after jenkins construction is read in real time by calling a self-research statistical toolkit through a button on the data presentation page, the latest data statistical result of the project is obtained, and statistical result data (such as a regenerated result file module in fig. 5) is generated and finally presented on the page.
According to the embodiment of the disclosure, a more flexible code coverage rate statistical tool and a method closer to project management requirements are realized, and the system can match configuration files by taking a coverage rate report of a method level generated in the prior art as a reference to generate a statistical report more conforming to project requirements. By combining the code coverage condition with the service, the use scene of the code coverage rate is expanded, a more intuitive measurement standard is provided for the quality of a certain function or a certain service scene, and the project quality is improved. Meanwhile, the workload statistics of personnel is carried out, and fine management is achieved.
Fig. 6 schematically shows a block diagram of a coverage statistics apparatus according to an embodiment of the present disclosure.
As shown in fig. 6, the coverage statistic apparatus 600 includes a first obtaining module 610, a second obtaining module 620, a matching module 630 and a first generating module 640.
The first obtaining module 610 is configured to obtain a coverage report file generated for each to-be-counted method of a to-be-counted item, where the coverage report file includes coverage statistical data counted for each to-be-counted method.
A second obtaining module 620, configured to obtain a configuration file, where the configuration file includes the to-be-counted methods and a custom statistical dimension corresponding to each of the to-be-counted methods.
A matching module 630, configured to match, according to the method to be counted, the coverage statistical data in the coverage report file with the custom statistical dimensions in the configuration file, so as to obtain a matching result.
And a first generating module 640, configured to generate, according to the matching result, a coverage statistic record based on the user-defined statistic dimension statistic.
According to the embodiment of the disclosure, the coverage rate report file generated by the method to be counted for each item of the item to be tested is acquired, wherein the coverage rate report file comprises the coverage rate statistical data counted for each item of the method to be counted; acquiring a configuration file, wherein the configuration file comprises various methods to be counted and a user-defined counting dimension corresponding to each method to be counted; matching the coverage rate statistical data in the coverage rate report file and the user-defined statistical dimension in the configuration file according to a method to be counted to obtain a matching result; the coverage rate statistical records corresponding to the statistical dimensions can be obtained due to the self-defined statistical dimensions set for the method to be counted, the technical problem that the coverage rate statistical method based on the statistics only on the code level is not high in item fitting degree is at least partially solved, and the technical effect that the codes of the item to be counted can be accurately managed from different dimensions is achieved.
According to an embodiment of the present disclosure, the coverage rate statistic apparatus may further include a third obtaining module and a second generating module.
And the third acquisition module is used for acquiring the coverage rate statistical records of a plurality of items to be tested.
And the second generation module is used for generating a histogram for visual display according to the plurality of items to be tested and the coverage rate statistical record corresponding to each item to be tested.
According to an embodiment of the present disclosure, the coverage rate statistic apparatus may further include a fourth obtaining module, a first determining module, and a third generating module.
And the fourth acquisition module is used for acquiring various to-be-counted methods in the to-be-tested items.
And the first determining module is used for determining the parameter information corresponding to each method to be counted according to the coverage rate statistical record, wherein the parameter information comprises the custom statistical dimension and the coverage rate statistical data.
And the third generating module is used for generating a table for visual display according to the method to be counted and the parameter information.
According to an embodiment of the present disclosure, the coverage statistic apparatus may further include a second determining module, a third determining module, and a fourth generating module.
And the second determining module is used for determining developer information corresponding to each to-be-counted method in the to-be-tested project according to the configuration file.
And the third determining module is used for determining the total code line number, the coverage line number and the coverage rate of the codes corresponding to the developer information according to the coverage rate statistical record.
And the fourth generation module is used for generating a stacking histogram for visual display according to the developer information and the total code line number, the coverage line number and the coverage rate.
According to an embodiment of the present disclosure, the coverage rate statistic apparatus may further include a fifth obtaining module and a querying module.
And the fifth acquisition module is used for acquiring target custom statistical dimensions which need to be based when the coverage statistical record is queried.
And the query module is used for querying according to the target custom statistic dimension to obtain a visual display result of the coverage rate statistic record related to the target custom statistic dimension.
According to the embodiment of the disclosure, the parameter information includes coverage rate details, the content of the coverage rate details is represented in a form of a link, and the coverage rate statistics apparatus may further include a detail presentation module.
And the detail display module is used for clicking the target content of the coverage rate detail and jumping to a coverage rate detail page, wherein the coverage rate detail page displays the coverage condition of the method to be counted corresponding to the target content in different colors.
Any of the modules according to embodiments of the present disclosure, or at least part of the functionality of any of them, may be implemented in one module. Any one or more of the modules according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules according to the embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging the circuit, or in any one of three implementations, or in any suitable combination of any of the software, hardware, and firmware. Alternatively, one or more of the modules according to embodiments of the disclosure may be implemented at least partly as computer program modules which, when executed, may perform corresponding functions.
For example, any plurality of the first obtaining module 610, the second obtaining module 620, the matching module 630 and the first generating module 640 may be combined and implemented in one module, or any one of them may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the first obtaining module 610, the second obtaining module 620, the matching module 630, and the first generating module 640 may be at least partially implemented as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented by hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or implemented by any one of three implementations of software, hardware, and firmware, or any suitable combination of any of them. Alternatively, at least one of the first obtaining module 610, the second obtaining module 620, the matching module 630 and the first generating module 640 may be at least partially implemented as a computer program module, which when executed may perform the corresponding functions.
It should be noted that the coverage rate statistics apparatus part in the embodiment of the present disclosure corresponds to the coverage rate statistics method part in the embodiment of the present disclosure, and the description of the coverage rate statistics apparatus part specifically refers to the coverage rate statistics method part, which is not described herein again.
FIG. 7 schematically illustrates a block diagram of a computer system suitable for implementing the above-described method, according to an embodiment of the present disclosure. The computer system illustrated in FIG. 7 is only one example and should not impose any limitations on the scope of use or functionality of embodiments of the disclosure.
As shown in fig. 7, a computer system 700 according to an embodiment of the present disclosure includes a processor 701, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)702 or a program loaded from a storage section 708 into a Random Access Memory (RAM) 703. The processor 701 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 701 may also include on-board memory for caching purposes. The processor 701 may comprise a single processing unit or a plurality of processing units for performing the different actions of the method flows according to embodiments of the present disclosure.
In the RAM 703, various programs and data necessary for the operation of the system 700 are stored. The processor 701, the ROM 702, and the RAM 703 are connected to each other by a bus 704. The processor 701 performs various operations of the method flows according to the embodiments of the present disclosure by executing programs in the ROM 702 and/or the RAM 703. It is noted that the programs may also be stored in one or more memories other than the ROM 702 and RAM 703. The processor 701 may also perform various operations of method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.
According to an embodiment of the present disclosure, the system 700 may also include an input/output (I/O) interface 705, the input/output (I/O) interface 705 also being connected to the bus 704. The system 700 may also include one or more of the following components connected to the I/O interface 705: an input portion 706 including a keyboard, a mouse, and the like; an output section 707 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 708 including a hard disk and the like; and a communication section 709 including a network interface card such as a LAN card, a modem, or the like. The communication section 709 performs communication processing via a network such as the internet. A drive 710 is also connected to the I/O interface 705 as needed. A removable medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 710 as necessary, so that a computer program read out therefrom is mounted into the storage section 708 as necessary.
According to embodiments of the present disclosure, method flows according to embodiments of the present disclosure may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable storage medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 709, and/or installed from the removable medium 711. The computer program, when executed by the processor 701, performs the above-described functions defined in the system of the embodiment of the present disclosure. The systems, devices, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.
The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.
According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium. Examples may include, but are not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
For example, according to embodiments of the present disclosure, a computer-readable storage medium may include the ROM 702 and/or the RAM 703 and/or one or more memories other than the ROM 702 and the RAM 703 described above.
Embodiments of the present disclosure also include a computer program product comprising a computer program containing program code for performing the method provided by the embodiments of the present disclosure, when the computer program product is run on an electronic device, the program code being configured to cause the electronic device to implement the coverage statistics method provided by the embodiments of the present disclosure.
The computer program, when executed by the processor 701, performs the above-described functions defined in the system/apparatus of the embodiments of the present disclosure. The systems, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.
In one embodiment, the computer program may be hosted on a tangible storage medium such as an optical storage device, a magnetic storage device, or the like. In another embodiment, the computer program may also be transmitted in the form of a signal on a network medium, distributed, downloaded and installed via the communication section 709, and/or installed from the removable medium 711. The computer program containing program code may be transmitted using any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
In accordance with embodiments of the present disclosure, program code for executing computer programs provided by embodiments of the present disclosure may be written in any combination of one or more programming languages, and in particular, these computer programs may be implemented using high level procedural and/or object oriented programming languages, and/or assembly/machine languages. The programming language includes, but is not limited to, programming languages such as Java, C + +, python, the "C" language, or the like. The program code may execute entirely on the user computing device, partly on the user device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.
The embodiments of the present disclosure have been described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the present disclosure, and such alternatives and modifications are intended to be within the scope of the present disclosure.

Claims (10)

1. A coverage statistics method, comprising:
acquiring a coverage rate report file generated aiming at each to-be-counted method of a to-be-counted item, wherein the coverage rate report file comprises coverage rate statistical data obtained by counting aiming at each to-be-counted method;
acquiring a configuration file, wherein the configuration file comprises the to-be-counted methods and user-defined statistical dimensions corresponding to the to-be-counted methods;
matching the coverage rate statistical data in the coverage rate report file and the user-defined statistical dimension in the configuration file according to the method to be counted to obtain a matching result; and
and generating a coverage rate statistical record based on the user-defined statistical dimension statistics according to the matching result.
2. The method of claim 1, further comprising:
acquiring a coverage rate statistical record of a plurality of items to be tested; and
and generating a histogram for visual display according to the plurality of items to be tested and the coverage rate statistical record corresponding to each item to be tested.
3. The method of claim 1, further comprising:
acquiring all to-be-counted methods in the to-be-tested items;
determining parameter information corresponding to each method to be counted according to the coverage rate statistical record, wherein the parameter information comprises the user-defined statistical dimension and the coverage rate statistical data; and
and generating a table for visual display according to the method to be counted and the parameter information.
4. The method of claim 1, further comprising:
determining developer information corresponding to each method to be counted in the project to be tested according to the configuration file;
determining the total code line number, the coverage line number and the coverage rate of the codes corresponding to the developer information according to the coverage rate statistical record; and
and generating a stacking histogram for visual display according to the developer information and the total code line number, the coverage line number and the coverage rate.
5. The method of claim 1, further comprising:
acquiring target self-defined statistical dimensions required to be based when inquiring the statistical record of the coverage rate; and
and inquiring according to the target user-defined statistical dimension to obtain a visual display result of a coverage rate statistical record related to the target user-defined statistical dimension.
6. The method of claim 3, wherein the parameter information includes coverage details, the content of the coverage details being represented in the form of a link, the method further comprising:
and clicking the target content of the coverage rate details, and jumping to a coverage rate details page, wherein the coverage rate details page shows the coverage condition of the method to be counted corresponding to the target content in different colors.
7. A coverage statistics apparatus, comprising:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a coverage rate report file generated by each to-be-counted method of a to-be-counted project, and the coverage rate report file comprises coverage rate statistical data obtained by counting each to-be-counted method;
a second obtaining module, configured to obtain a configuration file, where the configuration file includes the to-be-counted methods and a custom statistical dimension corresponding to each of the to-be-counted methods;
the matching module is used for matching the coverage rate statistical data in the coverage rate report file with the custom statistical dimension in the configuration file according to the method to be counted to obtain a matching result; and
and the generating module is used for generating a coverage rate statistical record based on the user-defined statistical dimension statistics according to the matching result.
8. A computer system, comprising:
one or more processors;
a memory for storing one or more programs,
wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of any of claims 1-6.
9. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to carry out the method of any one of claims 1 to 6.
10. A computer program product comprising computer executable instructions for implementing the method of any one of claims 1 to 6 when executed.
CN202110188255.5A 2021-02-18 2021-02-18 Coverage rate statistics method, coverage rate statistics device, computer system and readable storage medium Active CN112860556B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110188255.5A CN112860556B (en) 2021-02-18 2021-02-18 Coverage rate statistics method, coverage rate statistics device, computer system and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110188255.5A CN112860556B (en) 2021-02-18 2021-02-18 Coverage rate statistics method, coverage rate statistics device, computer system and readable storage medium

Publications (2)

Publication Number Publication Date
CN112860556A true CN112860556A (en) 2021-05-28
CN112860556B CN112860556B (en) 2024-04-02

Family

ID=75989678

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110188255.5A Active CN112860556B (en) 2021-02-18 2021-02-18 Coverage rate statistics method, coverage rate statistics device, computer system and readable storage medium

Country Status (1)

Country Link
CN (1) CN112860556B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113419959A (en) * 2021-07-01 2021-09-21 合肥忆芯电子科技有限公司 Method and equipment for generating coverage rate verification report
CN113516455A (en) * 2021-08-06 2021-10-19 上海中通吉网络技术有限公司 Project developer resource monitoring and management method and device
CN114880154A (en) * 2022-05-30 2022-08-09 中电云数智科技有限公司 Method and system for regularly reminding and counting BUG (BUG killer) conditions

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130212564A1 (en) * 2012-02-14 2013-08-15 Alibaba Group Holding Limited Code coverage rate determination method and system
CN109542789A (en) * 2018-11-26 2019-03-29 泰康保险集团股份有限公司 A kind of code coverage statistical method and device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130212564A1 (en) * 2012-02-14 2013-08-15 Alibaba Group Holding Limited Code coverage rate determination method and system
CN109542789A (en) * 2018-11-26 2019-03-29 泰康保险集团股份有限公司 A kind of code coverage statistical method and device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113419959A (en) * 2021-07-01 2021-09-21 合肥忆芯电子科技有限公司 Method and equipment for generating coverage rate verification report
CN113516455A (en) * 2021-08-06 2021-10-19 上海中通吉网络技术有限公司 Project developer resource monitoring and management method and device
CN114880154A (en) * 2022-05-30 2022-08-09 中电云数智科技有限公司 Method and system for regularly reminding and counting BUG (BUG killer) conditions

Also Published As

Publication number Publication date
CN112860556B (en) 2024-04-02

Similar Documents

Publication Publication Date Title
CN112860556B (en) Coverage rate statistics method, coverage rate statistics device, computer system and readable storage medium
Liu et al. Understanding diverse usage patterns from large-scale appstore-service profiles
US9886369B2 (en) Dynamic data fabrication for database applications
CN110196790A (en) The method and apparatus of abnormal monitoring
US10346294B2 (en) Comparing software projects having been analyzed using different criteria
CN101923510A (en) Software detection method as well as software detector and software detection system applying same
CN112817831A (en) Application performance monitoring method, device, computer system and readable storage medium
CN114238058A (en) Monitoring method, apparatus, device, medium, and program product
CN116594683A (en) Code annotation information generation method, device, equipment and storage medium
CN113918864A (en) Website page testing method, testing system, testing device, electronic equipment and medium
CN112445691B (en) Non-invasive intelligent contract performance detection method and device
CN103955425A (en) Webpage (WEB) exploring testing device and method
Romero et al. Integration of DevOps practices on a noise monitor system with CircleCI and Terraform
US9087298B2 (en) Inference of anomalous behavior of members of cohorts and associate actors related to the anomalous behavior based on divergent movement from the cohort context centroid
CN116483888A (en) Program evaluation method and device, electronic equipment and computer readable storage medium
CN115827122A (en) Operation guiding method and device, electronic equipment and storage medium
CN110554892A (en) Information acquisition method and device
CN117009397A (en) Data query method, data query device, electronic equipment and storage medium
Memon Advances in Computers
CN109614566A (en) Traffic source analysis method, system and device
CN113590686B (en) Processing method, device and equipment for ecological environment data index
CN111104626B (en) Information storage method and device
CN115687090A (en) Test case generation method, device, equipment and medium
CN114860597A (en) Method, device, equipment and storage medium for determining code coverage rate
Liu et al. Mining behavioral patterns from millions of android users

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant