CN107748719A

CN107748719A - Test report generation method and device

Info

Publication number: CN107748719A
Application number: CN201711079412.9A
Authority: CN
Inventors: 董曦
Original assignee: Guangzhou Kugou Computer Technology Co Ltd
Current assignee: Guangzhou Kugou Computer Technology Co Ltd
Priority date: 2017-11-06
Filing date: 2017-11-06
Publication date: 2018-03-02

Abstract

The present invention provides a kind of test report generation method and device, belongs to network technique field.Methods described includes：Obtain at least one wrong data of the indicated release of application；Based at least one wrong data, the value-at-risk of the indicated release of the application is calculated, the value-at-risk is used for the error situation for weighing the indicated release running of the application；The value-at-risk is written to test report, the test report is used to record the value-at-risk.The present invention devises the scheme that a kind of terminal automatically generates test report, and without relying on the manual operation of tester, step is simple, time-consuming shorter, saves human resources.Meanwhile wrong data calculation risk value is automatically based upon by terminal, accuracy rate is high.

Description

Test report generation method and device

Technical field

The present invention relates to network technique field, more particularly to a kind of test report generation method and device.

Background technology

Each applying in internet generally can undergo test phase-gray scale stage-after research and development, and stage of reaching the standard grade etc. is more Individual stage, during which application may develop multiple versions, it is often necessary to a test report is generated for the version of application, so as to The running situation of the version of the application is recorded according to test report.

The test report of any application is generally manually write by tester at present：Tester can be in advance in Mantis The wrong data of each version of record application in (a kind of mistake (bug) management system), each wrong data is including mistake etc. Level, error condition, find wrong mark of user etc..When to write the test report of version of some application, tester Member can input the version number of the version in Mantis, and trigger search operaqtion, and Mantis can retrieve the institute of the version of the application Wrong data, tester can click on the option for creating Excel file, to create Excel file, these wrong data answered System is pasted in Excel file, is carried out artificial screening according to different errorlevels in Excel file, is obtained these mistakes The quantity of wrong data corresponding to every kind of errorlevel in data, such as errorlevel are the number of the wrong data of menace level Errorlevel is quantity of wrong data of slight grade etc. in amount, wrong data, and tester can be reflected according to errorlevel The predetermined coefficient penetrated, summation is weighted to the quantity of different wrong data, as the value-at-risk of the application, finally clicked on Saving options in Excel file, obtain a test report.

During the present invention is realized, inventor has found that correlation technique at least has problems with：

It is artificial write test report process operation it is cumbersome, take longer, waste of manpower resource, while easily error.

The content of the invention

The embodiments of the invention provide a kind of test report generation method and device, it can solve the problem that in correlation technique and manually write Write the problem of test report is cumbersome.The technical scheme is as follows：

First aspect, there is provided a kind of test report generation method, applied in terminal, methods described includes：

Obtain at least one wrong data of the indicated release of application；

Based at least one wrong data, the value-at-risk of the indicated release of the application is calculated, the value-at-risk is used In the error situation for the indicated release running for weighing the application；

The value-at-risk is written to test report, the test report is used to record the value-at-risk.

In a kind of possible design, at least one wrong data of the indicated release for obtaining application, including：

The first web page address of the first named web page is obtained, first named web page includes at least one error number According to；

Based on first web page address, first named web page is shown；

Invoking web page analytic method, first named web page is parsed, obtain at least one wrong data.

It is described to be based on first web page address in a kind of possible design, show first named web page, bag Include：

Obtain user's mark and login password；

Based on user mark, the login password and first web page address, simulation login method is called, is logged in Fault management system；

Show the first named web page that the fault management system provides.

It is described based on user mark, the login password and first webpage in a kind of possible design Location, call and simulate login method, after logon error management system, methods described also includes：

Cookie store methods are called, the user is identified and preserved into cookie；

The cookie is sent to the fault management system；

When the fault management system identifies verification to the user in the cookie to be passed through, the display is performed The step of the first named web page that the fault management system provides.

In a kind of possible design, the invoking web page analytic method, first named web page is parsed, obtained To at least one wrong data, including：

First named web page is converted into node tree, the node tree includes multiple nodes, in the multiple node Each node be used to store data in first named web page；

Obtain and specify node identification, the specified node identification is used for the specified node for indicating the node tree, the finger Determine the node that node refers to store at least one wrong data；

Based on the specified node identification, at least one wrong data described in the specified Node extraction from the node tree.

It is described to be based at least one wrong data in a kind of possible design, calculate the specified version of the application This value-at-risk, including：

Obtain at least one predetermined coefficient corresponding at least one errorlevel and at least one errorlevel, institute State the serious conditions that each predetermined coefficient at least one predetermined coefficient is used to weigh corresponding errorlevel；

For each errorlevel at least one errorlevel, institute at least one wrong data is obtained The quantity of wrong data corresponding to errorlevel is stated, obtains the quantity of at least one wrong data；

Using at least one predetermined coefficient as weight, the quantity of at least one wrong data is weighted and asked With as the first value-at-risk.

It is the quantity of the wrong data of menace level to obtain errorlevel at least one wrong data；

Calculate the wrong data quantity and the menace level corresponding to predetermined coefficient product, as the second risk Value.

It is described to be based at least one wrong data in a kind of possible design, calculate the specified version of the application After this value-at-risk, methods described also includes：

File wiring method is called, creates test report, execution is described to be written to the test report by the value-at-risk The step of；Or,

Test report mark is obtained, the test report identifies the test report for indicating to be pre-created；It is based on The test report mark, calls file wiring method, performs the step that the value-at-risk is written to the test report Suddenly.

In a kind of possible design, methods described also includes：

Obtain the first business datum of the indicated release of the application；

Based on first business datum, the first mortality of the indicated release of the application is calculated, described first fails Rate is used for the service fail situation for weighing the indicated release of the application；

First mortality is written to test report, the test report is additionally operable to record first mortality.

In a kind of possible design, the first business datum of the indicated release for obtaining the application, including：

Obtain the first version number of the indicated release of the application；

Based on the first version number, the interface between application performance monitoring system is called, obtains the finger of the application Determine the first business datum of version.

It is described to be based on first business datum in a kind of possible design, calculate the indicated release of the application First mortality, including：

The first service fail number is obtained, the first service fail number refers to the business in first business datum The frequency of failure；

The first business total degree is obtained, the first business total degree refers to that the business in first business datum is always secondary Number；

The ratio between the first service fail number and the first business total degree is calculated, described first is obtained and loses Lose rate.

In a kind of possible design, methods described also includes：

Obtain the second business datum of the reference version of application；

Based on second business datum, the second mortality of the reference version of the application is calculated, described second fails Rate is used for the service fail situation for weighing the reference version of the application；

Calculate the first difference between first mortality and the second mortality；

Second mortality and first difference are written to the test report, the test report is additionally operable to remember Record second mortality and first difference.

It is described that second mortality and first difference are written to the test report in a kind of possible design After reporting to, methods described also includes：

Obtain the first predetermined threshold value and the second predetermined threshold value；

When first difference is more than first predetermined threshold value, it is pre- that the pattern of first difference is adjusted to first If pattern；Or, when first difference is less than second predetermined threshold value, the pattern of first difference is adjusted to second The preset style, described first the preset style and described second the preset style be used for distinguish whether satisfactory business datum.

In a kind of possible design, the pattern by first difference is adjusted to first the preset style, including with It is at least one of lower：

The font of first difference is adjusted to the first pre-set color；Cell where first difference is filled For first pre-set color；Addition first is marked with advance in the preset range of the first difference described in distance in the test report Note；

And/or

The pattern by first difference is adjusted to second the preset style, including at least one of following：

The font of first difference is adjusted to the second pre-set color；Cell where first difference is filled For second pre-set color；Addition second is marked with advance in the preset range of the first difference described in distance in the test report Note.

In a kind of possible design, first business datum and second business datum are in the identical time started Point starts to count, and first business datum and second business datum terminate to count in identical end time point.

It is described to be based on second business datum in a kind of possible design, calculate the reference version of the application Second mortality, including：

The second service fail number is obtained, the second service fail number refers to the business in second business datum The frequency of failure；

The second business total degree is obtained, the second business total degree refers to that the business in second business datum is always secondary Number；

The ratio between the second service fail number and the second business total degree is calculated, described second is obtained and loses Lose rate.

In a kind of possible design, methods described also includes：

Obtain the first delay data of the indicated release of the application；

First delay data is written to the test report, the test report is used to record first time delay Data.

In a kind of possible design, the first version of the indicated release of first delay data based on the application Number, call the interface between application performance monitoring system to obtain.

In a kind of possible design, methods described also includes：

Obtain the second delay data of the reference version of application；

Calculate the second difference between first delay data and second delay data；

Second delay data and second difference are written to the test report, the test report is used to remember Record second delay data and second difference.

It is described that second delay data and second difference are written to the test in a kind of possible design After report, methods described also includes：

Obtain the 3rd predetermined threshold value and the 4th predetermined threshold value；

When second difference is more than three predetermined threshold value, it is pre- that the pattern of second difference is adjusted to the 3rd If pattern；Or, when second difference is less than four predetermined threshold value, the pattern of second difference is adjusted to the 4th The preset style, described 3rd the preset style and described 4th the preset style be used for distinguish whether satisfactory delay data.

In a kind of possible design, the pattern by second difference is adjusted to the 3rd the preset style, including with It is at least one of lower：

The font of second difference is adjusted to the 3rd pre-set color；Cell where second difference is filled For the 3rd pre-set color；Addition the 3rd is marked with advance in the preset range of the first difference described in distance in the test report Note；

And/or

The pattern by second difference is adjusted to the 4th the preset style, including at least one of following：

The font of second difference is adjusted to the 4th pre-set color；Cell where second difference is filled For the 4th pre-set color；Addition the 4th is marked with advance in the preset range of the second difference described in distance in the test report Note.

In a kind of possible design, first delay data and second delay data are in the identical time started Point starts to count, and first delay data and second delay data terminate to count in identical end time point.

In a kind of possible design, methods described also includes：

Obtain the first flow data of the indicated release of the application；

The first flow data are written to the test report, the test report is used to record the first flow Data.

In a kind of possible design, the first flow data are the first versions of the indicated release based on the application Number, call what the interface between application performance monitoring system obtained.

In a kind of possible design, methods described also includes：

Obtain the second flow data of the reference version of application；

Calculate the 3rd difference between the first flow data and the second flow data；

The second flow data and the 3rd difference are written to the test report, the test report is used to remember Record the second flow data and the 3rd difference.

It is described that the second flow data and the 3rd difference are written to the test in a kind of possible design After report, methods described also includes：

Obtain the 5th predetermined threshold value and the 6th predetermined threshold value；

When the 3rd difference is more than five predetermined threshold value, it is pre- that the pattern of the 3rd difference is adjusted to the 5th If pattern；Or, when the 3rd difference is less than six predetermined threshold value, the pattern of the 3rd difference is adjusted to the 6th The preset style, described 5th the preset style and described 6th the preset style be used for distinguish whether satisfactory data on flows.

In a kind of possible design, the pattern by the 3rd difference is adjusted to the 5th the preset style, including with It is at least one of lower：The font of 3rd difference is adjusted to the 5th pre-set color；By the cell where the 3rd difference It is filled with the 5th pre-set color；Addition the 5th is pre- in the preset range of the 3rd difference described in distance in the test report Bidding note；

And/or

The pattern by the 3rd difference is adjusted to the 6th the preset style, including at least one of following：By described The font of three differences is adjusted to the 6th pre-set color；Cell where 3rd difference is filled with the described 6th default face Color；Add the 6th preset mark described in distance in the preset range of the 3rd difference in the test report.

In a kind of possible design, the first flow data and the second flow data are in the identical time started Point starts to count, and the first flow data and the second flow data terminate to count in identical end time point.

In a kind of possible design, methods described also includes：

Obtain the demand data of the indicated release of the application；

The demand data is written to the test report, the test report is used to record the demand data.

In a kind of possible design, the demand data of the indicated release for obtaining the application, including：

The second web page address of the second named web page is obtained, second named web page includes the demand data；It is based on Second web page address, show second named web page；Invoking web page analytic method, second named web page is carried out Parsing, obtains the demand data；Or,

The first version number of indicated release based on the application, the interface between requirement management systems is called, is obtained The demand data of the indicated release of the application.

In a kind of possible design, it is described the value-at-risk is written to test report after, methods described also includes：

Obtain at least one default email address；

Using the test report as Email attachment；And/or sectional drawing is carried out to the test report, the sectional drawing is made For message body；

Mail is sent at least one default email address.

It is described before at least one wrong data of the indicated release for obtaining application in a kind of possible design Method also includes：

Show that the generation of test report starts the page；

Obtain and start the first version number of the indicated release of the application inputted on the page, the ginseng applied in the generation Examine in the second edition number, sart point in time, the end time point of version, file name at least one of.

Second aspect, there is provided a kind of test report generating means, applied in terminal, described device includes：

Acquisition module, at least one wrong data of the indicated release for obtaining application；

Computing module, for based at least one wrong data, calculating the value-at-risk of the indicated release of the application, The value-at-risk is used for the error situation for weighing the indicated release running of the application；

Writing module, for the value-at-risk to be written into test report, the test report is used to record the risk Value.

In a kind of possible design, the acquisition module, including：

Acquiring unit, for obtaining the first web page address of the first named web page, first named web page includes described At least one wrong data；

Display unit, for based on first web page address, showing first named web page；

Resolution unit, for invoking web page analytic method, first named web page is parsed, obtain it is described at least One wrong data.

In a kind of possible design, the display unit, it is additionally operable to obtain user's mark and login password；Based on described User's mark, the login password and first web page address, call simulation entering device, logon error management system；It is aobvious Show the first named web page that the fault management system provides.

In a kind of possible design, the display unit, it is additionally operable to：Cookie store methods are called, by the user Mark is preserved into cookie；The cookie is sent to the fault management system；When the fault management system is to described When user mark verification in cookie passes through, the first specified net that the display fault management system provides is performed The step of page.

In a kind of possible design, the resolution unit, for first named web page to be converted into node tree, institute Stating node tree includes multiple nodes, and each node in the multiple node is used to store the number in first named web page According to；Obtain and specify node identification, the specified node identification is used for the specified node for indicating the node tree, the specified node Refer to the node for storing at least one wrong data；Based on the specified node identification, from the specified section of the node tree Point extracts at least one wrong data.

In a kind of possible design, the computing module, including：

Acquiring unit, for obtaining at least one corresponding at least one errorlevel and at least one errorlevel Individual predetermined coefficient, each predetermined coefficient at least one predetermined coefficient are used for the serious feelings for weighing corresponding errorlevel Condition；

The acquiring unit, it is additionally operable to for each errorlevel at least one errorlevel, described in acquisition The quantity of wrong data corresponding to errorlevel, obtains the number of at least one wrong data described at least one wrong data Amount；

Computing unit, for using at least one predetermined coefficient as weight, to the number of at least one wrong data Amount is weighted summation, as the first value-at-risk.

In a kind of possible design, the computing module, including：

Acquiring unit, it is the wrong data of menace level for obtaining errorlevel at least one wrong data Quantity；

Computing unit, for calculate the wrong data quantity and the menace level corresponding to predetermined coefficient multiply Product, as the second value-at-risk.

In a kind of possible design, described device also includes：

Creation module, for calling file wiring method, test report is created, execution is described to be written to the value-at-risk The step of test report；Or, obtain test report mark, the test report identify for indicate be pre-created it is described Test report；Identified based on the test report, call file wiring method, perform it is described the value-at-risk is written to it is described The step of test report.

In a kind of possible design, the acquisition module, it is additionally operable to obtain the first industry of the indicated release of the application Business data；

The computing module, it is additionally operable to be based on first business datum, calculates the first of the indicated release of the application Mortality, first mortality are used for the service fail situation for weighing the indicated release of the application；

Said write module, it is additionally operable to first mortality being written to test report, the test report is additionally operable to Record first mortality.

In a kind of possible design, the acquisition module, the first version of the indicated release for obtaining the application Number；Based on the first version number, the interface between application performance monitoring system is called, obtains the indicated release of the application The first business datum.

In a kind of possible design, the computing module, including：

Acquiring unit, for obtaining the first service fail number, the first service fail number refers to first industry Service fail number in data of being engaged in；

The acquiring unit, also obtains the first business total degree, and the first business total degree refers to first business Business total degree in data；

Computing unit, for calculating the ratio between the first service fail number and the first business total degree, Obtain first mortality.

In a kind of possible design, the acquisition module, be additionally operable to obtain application reference version the second business number According to；

The computing module, it is additionally operable to be based on second business datum, calculates the second of the reference version of the application Mortality, second mortality are used for the service fail situation for weighing the reference version of the application；

The computing module, it is additionally operable to calculate the first difference between first mortality and the second mortality；

Said write module, it is additionally operable to second mortality and first difference being written to the test report, The test report is additionally operable to record second mortality and first difference.

In a kind of possible design, the acquisition module, it is additionally operable to obtain the first predetermined threshold value and the second predetermined threshold value；

Described device also includes：Adjusting module, for when first difference is more than first predetermined threshold value, by institute The pattern for stating the first difference is adjusted to first the preset style；Or, when first difference is less than second predetermined threshold value, will The pattern of first difference is adjusted to second the preset style, and described first the preset style and described second the preset style are used for area Point whether satisfactory business datum.

In a kind of possible design, the adjusting module is at least one of following for performing：

The font of first difference is adjusted to the first pre-set color；Cell where first difference is filled For first pre-set color；Addition first is marked with advance in the preset range of the first difference described in distance in the test report Note；The font of first difference is adjusted to the second pre-set color；Cell where first difference is filled with institute State the second pre-set color；Add the second preset mark described in distance in the preset range of the first difference in the test report.

In a kind of possible design, the acquisition module, it is additionally operable to obtain the second service fail number, second industry The business frequency of failure refers to the service fail number in second business datum；

The acquisition module, it is additionally operable to obtain the second business total degree, the second business total degree refers to described second Business total degree in business datum；

The computing module, it is additionally operable to calculate between the second service fail number and the second business total degree Ratio, obtain second mortality.

In a kind of possible design, the acquisition module, when being additionally operable to obtain the first of the indicated release of the application Prolong data；

Said write module, it is additionally operable to first delay data being written to the test report, the test report For recording first delay data.

In a kind of possible design, the acquisition module, be additionally operable to obtain application reference version the second time delay number According to；

The computing module, it is second poor between first delay data and second delay data to be additionally operable to calculate Value；

Said write module, it is additionally operable to second delay data and second difference being written to the test report Accuse, the test report is used to record second delay data and second difference.

In a kind of possible design, the acquisition module, it is additionally operable to obtain the 3rd predetermined threshold value and the 4th predetermined threshold value；

Described device also includes：Adjusting module, for when second difference is more than three predetermined threshold value, by institute The pattern for stating the second difference is adjusted to the 3rd the preset style；Or, when second difference is less than four predetermined threshold value, will The pattern of second difference is adjusted to the 4th the preset style, and described 3rd the preset style and described 4th the preset style are used for area Point whether satisfactory delay data.

The font of second difference is adjusted to the 3rd pre-set color；Cell where second difference is filled For the 3rd pre-set color；Addition the 3rd is marked with advance in the preset range of the first difference described in distance in the test report Note；The font of second difference is adjusted to the 4th pre-set color；Cell where second difference is filled with institute State the 4th pre-set color；Add the 4th preset mark described in distance in the preset range of the second difference in the test report.

In a kind of possible design, the acquisition module, be additionally operable to obtain the application indicated release it is first-class Measure data；

Said write module, it is additionally operable to the first flow data being written to the test report, the test report For recording the first flow data.

In a kind of possible design, the acquisition module, be additionally operable to obtain application reference version second flow number According to；

The computing module, it is the 3rd poor between the first flow data and the second flow data to be additionally operable to calculate Value；

Said write module, it is additionally operable to the second flow data and the 3rd difference being written to the test report Accuse, the test report is used to record the second flow data and the 3rd difference.

In a kind of possible design, the acquisition module, it is additionally operable to obtain the 5th predetermined threshold value and the 6th predetermined threshold value；

Described device also includes：Adjusting module, for when the 3rd difference is more than five predetermined threshold value, by institute The pattern for stating the 3rd difference is adjusted to the 5th the preset style；Or, when the 3rd difference is less than six predetermined threshold value, will The pattern of 3rd difference is adjusted to the 6th the preset style, and described 5th the preset style and described 6th the preset style are used for area Point whether satisfactory data on flows.

The font of 3rd difference is adjusted to the 5th pre-set color；Cell where 3rd difference is filled For the 5th pre-set color；Addition the 5th is marked with advance in the preset range of the 3rd difference described in distance in the test report Note；The font of 3rd difference is adjusted to the 6th pre-set color；Cell where 3rd difference is filled with institute State the 6th pre-set color；Add the 6th preset mark described in distance in the preset range of the 3rd difference in the test report.

In a kind of possible design, the acquisition module, it is additionally operable to obtain the demand number of the indicated release of the application According to；

Said write module, it is additionally operable to the demand data being written to the test report, the test report is used for Record the demand data.

In a kind of possible design, the acquisition module, it is additionally operable to：With obtaining the second webpage of the second named web page Location, second named web page include the demand data；Based on second web page address, net is specified in display described second Page；Invoking web page resolver, second named web page is parsed, obtains the demand data；Or, answered based on described The first version number of indicated release, the interface between requirement management systems is called, obtains the indicated release of the application Demand data.

In a kind of possible design, the acquisition module, it is additionally operable to obtain at least one default email address；

Described device also includes：Mail editor module, for using the test report as Email attachment；And/or to institute State test report and carry out sectional drawing, using the sectional drawing as message body；

Sending module, for sending mail at least one default email address.

In a kind of possible design, described device also includes：Display module, for showing that the generation of test report starts The page；

The acquisition module, it is additionally operable to obtain the indicated release of the application inputted on the generation startup page In first version number, the second edition number for the reference version applied, sart point in time, end time point, file name at least One.

The third aspect, there is provided a kind of terminal, the terminal include processor and memory, be stored with the memory At least one instruction, the instruction are loaded by the processor and performed to realize that test report as described in relation to the first aspect generates Operation performed by method.

Fourth aspect, there is provided a kind of computer-readable recording medium, be stored with least one finger in the storage medium Order, the instruction are loaded as processor and performed to realize the behaviour performed by test report generation method as described in relation to the first aspect Make.

The beneficial effect that technical scheme provided in an embodiment of the present invention is brought is：

Method and device provided in an embodiment of the present invention, devise the scheme that a kind of terminal automatically generates test report, nothing The manual operation of tester need to be relied on, step is simple, time-consuming shorter, saves human resources.Meanwhile it is automatically based upon by terminal Wrong data calculation risk value, accuracy rate are high.

Brief description of the drawings

Technical scheme in order to illustrate the embodiments of the present invention more clearly, make required in being described below to embodiment Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for For those of ordinary skill in the art, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings Accompanying drawing.

Fig. 1 is a kind of flow chart of test report generation method provided in an embodiment of the present invention；

Fig. 2 is a kind of flow chart of test report generation method provided in an embodiment of the present invention；

Fig. 3 is a kind of schematic diagram for generating the startup page provided in an embodiment of the present invention；

Fig. 4 is a kind of flow chart of test report generation method provided in an embodiment of the present invention；

Fig. 5 is a kind of flow chart of test report generation method provided in an embodiment of the present invention；

Fig. 6 is a kind of flow chart of test report generation method provided in an embodiment of the present invention；

Fig. 7 is a kind of flow chart of test report generation method provided in an embodiment of the present invention；

Fig. 8 is a kind of operational flowchart of test report generation method provided in an embodiment of the present invention；

Fig. 9 is a kind of structural representation of test report generating means provided in an embodiment of the present invention；

Figure 10 is a kind of structural representation of terminal provided in an embodiment of the present invention.

Embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation describes, it is clear that described embodiment is part of the embodiment of the present invention, rather than whole embodiments.Based on this hair Embodiment in bright, the every other implementation that those of ordinary skill in the art are obtained under the premise of creative work is not made Example, belongs to the scope of protection of the invention.

Fig. 1 is a kind of flow chart of test report generation method provided in an embodiment of the present invention.The inventive embodiments are held Row main body is terminal, and referring to Fig. 1, this method includes：

101st, at least one wrong data of the indicated release of application is obtained.

102nd, based at least one wrong data, the value-at-risk of the indicated release of the application is calculated, the value-at-risk is used for Weigh the error situation of the indicated release running of the application.

103rd, the value-at-risk is written to test report, the test report is used to record the value-at-risk.

The method that the present embodiment provides, devises the scheme that a kind of terminal automatically generates test report, is tested without relying on The manual operation of personnel, step is simple, time-consuming shorter, saves human resources.Meanwhile wrong data meter is automatically based upon by terminal Value-at-risk is calculated, accuracy rate is high.

In a kind of possible design, at least one wrong data of the indicated release of acquisition application, including：

The first web page address of the first named web page is obtained, first named web page includes at least one wrong data；

Based on first web page address, first named web page is shown；

In a kind of possible design, first web page address should be based on, and show first named web page, including：

Obtain user's mark and login password；

Based on user mark, the login password and first web page address, simulation login method, logon error pipe are called Reason system；

Show the first named web page that the fault management system provides.

In a kind of possible design, mould should be called based on user mark, the login password and first web page address Intend login method, after logon error management system, this method also includes：

The cookie is sent to the fault management system；

When the fault management system identifies verification to the user in the cookie to be passed through, display mistake pipe is performed The step of the first named web page that reason system provides.

In a kind of possible design, the invoking web page analytic method, first named web page is parsed, is somebody's turn to do At least one wrong data, including：

First named web page is converted into node tree, the node tree includes multiple nodes, each in the plurality of node Node is used to store the data in first named web page；

Obtain and specify node identification, this specifies node identification to be used for the specified node for indicating the node tree, and this specifies node Refer to the node for storing at least one wrong data；

Node identification is specified based on this, from the specified Node extraction of the node tree at least one wrong data.

In a kind of possible design, at least one wrong data should be based on, and calculate the wind of the indicated release of the application Danger value, including：

At least one predetermined coefficient corresponding at least one errorlevel and at least one errorlevel is obtained, this is extremely Each predetermined coefficient in a few predetermined coefficient is used for the serious conditions for weighing corresponding errorlevel；

For each errorlevel at least one errorlevel, the mistake at least one wrong data is obtained The quantity of wrong data corresponding to grade, obtain the quantity of at least one wrong data；

Using at least one predetermined coefficient as weight, summation is weighted to the quantity of at least one wrong data, made For the first value-at-risk.

The quantity and the product of predetermined coefficient corresponding to the menace level of the wrong data are calculated, as the second value-at-risk.

In a kind of possible design, at least one wrong data should be based on, and calculate the wind of the indicated release of the application After the value of danger, this method also includes：

File wiring method is called, test report is created, performs the step of value-at-risk is written to the test report by this； Or,

Test report mark is obtained, the test report identifies the test report for indicating to be pre-created；Based on the survey Report identification is tried, file wiring method is called, performs the step of value-at-risk is written to the test report by this.

In a kind of possible design, this method also includes：

Obtain the first business datum of the indicated release of the application；

Based on first business datum, the first mortality of the indicated release of the application is calculated, first mortality is used for Weigh the service fail situation of the indicated release of the application；

In a kind of possible design, the first business datum of the indicated release of the acquisition application, including：

Obtain the first version number of the indicated release of the application；

Based on the first version number, the interface between application performance monitoring system is called, obtains the specified version of the application This first business datum.

In a kind of possible design, first business datum should be based on, calculate the indicated release of the application first is lost Rate is lost, including：

The first service fail number is obtained, the first service fail number refers to the service fail in first business datum Number；

The first business total degree is obtained, the first business total degree refers to the business total degree in first business datum；

The ratio between the first service fail number and the first business total degree is calculated, obtains first mortality.

In a kind of possible design, this method also includes：

Obtain the second business datum of the reference version of application；

Based on second business datum, the second mortality of the reference version of the application is calculated, second mortality is used for Weigh the service fail situation of the reference version of the application；

Second mortality and first difference are written to the test report, the test report be additionally operable to record this second Mortality and first difference.

In a kind of possible design, after second mortality and first difference are written to the test report by this, This method also includes：

When first difference is more than first predetermined threshold value, the pattern of first difference is adjusted to the first default sample Formula；Or, when first difference is less than second predetermined threshold value, the pattern of first difference is adjusted to second the preset style, First the preset style and second the preset style be used to distinguishing whether satisfactory business datum.

In a kind of possible design, the pattern of first difference is adjusted to first the preset style by this, including below extremely One item missing：

The font of first difference is adjusted to the first pre-set color；Cell where first difference is filled with this First pre-set color；In the test report the first preset mark is added in the preset range of distance first difference；

And/or

The pattern of first difference is adjusted to second the preset style by this, including at least one of following：

The font of first difference is adjusted to the second pre-set color；Cell where first difference is filled with this Second pre-set color；In the test report the second preset mark is added in the preset range of distance first difference.

In a kind of possible design, first business datum and second business datum are opened in identical sart point in time Begin statistics, and first business datum and second business datum terminate to count in identical end time point.

In a kind of possible design, second business datum should be based on, calculate the reference version of the application second is lost Rate is lost, including：

The second service fail number is obtained, the second service fail number refers to the service fail in second business datum Number；

The second business total degree is obtained, the second business total degree refers to the business total degree in second business datum；

The ratio between the second service fail number and the second business total degree is calculated, obtains second mortality.

In a kind of possible design, this method also includes：

Obtain the first delay data of the indicated release of the application；

First delay data is written to the test report, the test report is used to record first delay data.

In a kind of possible design, the first version number of the indicated release of first delay data based on the application, adjust Obtained with the interface between application performance monitoring system.

In a kind of possible design, this method also includes：

Obtain the second delay data of the reference version of application；

Second delay data and second difference are written to the test report, the test report be used to recording this second Delay data and second difference.

In a kind of possible design, this by second delay data and second difference be written to the test report it Afterwards, this method also includes：

When second difference is more than three predetermined threshold values, the pattern of second difference is adjusted to the 3rd default sample Formula；Or, when second difference is less than four predetermined threshold values, the pattern of second difference is adjusted to the 4th the preset style, 3rd the preset style and the 4th the preset style be used to distinguishing whether satisfactory delay data.

In a kind of possible design, the pattern of second difference is adjusted to the 3rd the preset style by this, including below extremely One item missing：

The font of second difference is adjusted to the 3rd pre-set color；Cell where second difference is filled with this 3rd pre-set color；The 3rd preset mark is added in the preset range of distance first difference in the test report；

And/or

The pattern of second difference is adjusted to the 4th the preset style by this, including at least one of following：

The font of second difference is adjusted to the 4th pre-set color；Cell where second difference is filled with this 4th pre-set color；The 4th preset mark is added in the preset range of distance second difference in the test report.

In a kind of possible design, first delay data and second delay data are opened in identical sart point in time Begin statistics, and first delay data and second delay data terminate to count in identical end time point.

In a kind of possible design, this method also includes：

Obtain the first flow data of the indicated release of the application；

In a kind of possible design, the first flow data are the first versions number of the indicated release based on the application, Call what the interface between application performance monitoring system obtained.

In a kind of possible design, this method also includes：

Obtain the second flow data of the reference version of application；

The second flow data and the 3rd difference are written to the test report, the test report be used to recording this second Data on flows and the 3rd difference.

In a kind of possible design, this by the second flow data and the 3rd difference be written to the test report it Afterwards, this method also includes：

When the 3rd difference is more than five predetermined threshold values, the pattern of the 3rd difference is adjusted to the 5th default sample Formula；Or, when the 3rd difference is less than six predetermined threshold values, the pattern of the 3rd difference is adjusted to the 6th the preset style, 5th the preset style and the 6th the preset style be used to distinguishing whether satisfactory data on flows.

In a kind of possible design, the pattern of the 3rd difference is adjusted to the 5th the preset style by this, including below extremely One item missing：The font of 3rd difference is adjusted to the 5th pre-set color；Cell where 3rd difference is filled with this 5th pre-set color；The 5th preset mark is added in the preset range of the difference of distance the 3rd in the test report；

And/or

The pattern of 3rd difference is adjusted to the 6th the preset style by this, including at least one of following：By the 3rd difference Font be adjusted to the 6th pre-set color；Cell where 3rd difference is filled with the 6th pre-set color；In the survey The 6th preset mark of addition in the preset range of the difference of distance the 3rd in examination report.

In a kind of possible design, the first flow data and the second flow data are opened in identical sart point in time Begin statistics, and the first flow data and the second flow data terminate to count in identical end time point.

In a kind of possible design, this method also includes：

Obtain the demand data of the indicated release of the application；

In a kind of possible design, the demand data of the indicated release of the acquisition application, including：

The second web page address of the second named web page is obtained, second named web page includes the demand data；Based on this Two web page addresses, show second named web page；Invoking web page analytic method, second named web page is parsed, obtained The demand data；Or,

The first version number of indicated release based on the application, the interface between requirement management systems is called, is somebody's turn to do The demand data of the indicated release of application.

In a kind of possible design, after the value-at-risk is written to test report by this, this method also includes：

Obtain at least one default email address；

Using the test report as Email attachment；And/or sectional drawing is carried out to the test report, using the sectional drawing as mail Text；

Mail is sent at least one default email address.

In a kind of possible design, before at least one wrong data of the indicated release of acquisition application, this method Also include：

Show that the generation of test report starts the page；

Obtain and start the first version number of the indicated release of the application inputted on the page, the reference version applied in the generation At least one of in the second edition number originally, sart point in time, end time point, file name.

In correlation technique, the wrong data of application, business datum, delay data, flow are artificially searched for by tester Data, demand data, and mortality is artificially calculated according to wrong data calculation risk value, according to business datum by tester And other data, and then test report is manually write, operation is very cumbersome, time-consuming longer, and the process manually calculated is easy Error.

And the embodiments of the invention provide a kind of method that test report is fully automatically generated by terminal, it is artificial without relying on Operation, it is time-consuming shorter, while accuracy rate is high.In implementation, the processing logic of each step in the embodiment of the present invention can be encapsulated For an application program, any terminal runs the application program, you can has the function of automatically generating test report, practicality It is high.

The embodiment of the present invention can apply to need in the various scenes of the test report of the version of a certain application, for example, Before wanting decision-making whether to want the version that gray scale issues some application, method provided in an embodiment of the present invention can be used, obtaining should The test report of the version of application, the performance of the application is weighed by test report, when the test report reflects the application Performance reach can with gray scale issue standard when, gray scale issues the application, when the performance of the application is not yet up to standard, can pass through Various data in test report, produced problem in application running is analyzed, and then application is improved.

Fig. 2 is a kind of flow chart of test report generation method provided in an embodiment of the present invention.The inventive embodiments are held Row main body is terminal, and referring to Fig. 2, this method includes：

201st, terminal shows that the generation of test report starts the page.

Test report refers to the file of the running situation of a certain version of record application., can be according to reality in the present embodiment Border demand determines that a certain version of application is indicated release, generates the test report of the indicated release.Wherein indicated release can be with For version on beta version, grayscale version, line etc., the beta version refers to apply each version in test phase, gray scale version Originally refer to apply each version in the gray scale stage, version refers to each version using the stage on line on line.

It is the page for referring to trigger the generating process of test report that generation, which starts the page, and terminal can show the generation During starting the page, generation enabled instruction is got, responds the generation enabled instruction, started execution and be subsequently generated test report The process of announcement.Wherein, the generation enabled instruction refers to the process of the instruction of triggering generation test report, and generation enabled instruction can be with Triggered by the clicking operation for the startupoptions for starting the page to generation.

The concrete mode for starting the page is generated for display, terminal can be based on default front end frame structure generation and start page Face, the default front end frame can include HTML (HyperText Markup Language, HTML), CSS The fundamental norms of the element such as (Cascading Style Sheets, CSS), JavaScript plug-in units, tester can Start the page to preset front end frame design generation according to this, to ensure that the generation starts the display content of the page, aesthetics accords with Conjunction demand.Wherein, the default front end frame can be bootstrap or other front end frames.

In a kind of possible design, the test report of the indicated release due to being subsequently generated application, terminal will be got The version number of the indicated release of the application, to get the related data of the indicated release of the application based on the version number.Separately Outside, when requiring that terminal is also when the indicated release of the application and the reference version of application being analyzed in test report The version number of the reference version of application is got, to get the dependency number of the reference version of application based on the version number According to.In addition, when the data of indicated release and the reference of application that require to apply in analysis certain time period in test report During the data of version, point and end time point between terminal will be also got at the beginning of the period, during so as to based on the two Between point get the related data of this period.In addition, terminal can obtain the file name of user's input, a this document is generated The test report of title, so as to ensure that the title of test report meets the self-defined demand of user.

In order to ensure terminal get the version number of indicated release, the version number with reference to version, sart point in time, at the end of Between the data such as point, file name, referring to Fig. 3, generation, which starts the page, can have the function of input data, and terminal can obtain The first version number of the indicated release of the application inputted on the generation startup page, the second edition number for the reference version applied, open At least one of in time point, end time point, the file name of beginning.Wherein, the first version number is used to uniquely determine application Indicated release, for example, 8500, reference version of the second edition number for uniquely determining application, for example, 8700, when this starts Between point be not later than end time point, the accuracy of sart point in time and end time point can arrive day, hour, minute etc., such as Sart point in time is on June 9th, 2017, and end time point is on June 10th, 2017, and file name can making by oneself according to user Adopted demand determines, is, for example, " gray scale brings a prisoner before the court table " etc..

Start the Show Styles of the page for the generation, alternatively, the generation, which starts the page, can include first version number Input options, first version number, second edition input options, sart point in time input options, end time point input options, File name input options, terminal can detect the input operation to the triggering of first version input options, obtain first version Number, the input operation to the triggering of second edition input options is detected, the second edition number is obtained, detects and sart point in time is inputted The input operation of option triggering, obtains sart point in time, detects the input operation to the triggering of end time point input options, obtains End time point, the input operation to the triggering of file name input options is detected, obtain file name.Certainly, generation starts page Face can also be shown with other Show Styles, and this is not limited.

When terminal gets first version number, the second edition number for the reference version applied, sart point in time, end time At least one of in point, file name, and when getting startup and confirming instruction, terminal can start the generation on foreground on the page The data currently inserted submit the processing logic of (post) to backstage in the form of list, to ensure that the processing logic on backstage performs Following steps 202-204, step 205-207, step 205- steps 210, step 211- steps 212, step 211- steps 214, Any one or any combination of these combinations of step 215- steps 216, step 215- steps 218, step 219- steps 220.

It should be noted that this step 201 is only optional step.In alternatively possible design, terminal can need not Display generation start the page, without by generate start the page obtain first version number, the second edition number, sart point in time, In end time point, file name at least one of, but by tester pre-set first version number, the second edition number, At least one of in sart point in time, end time point, file name, such as these numbers defined in some code file According to then terminal can directly obtain these data from code file, automatic to perform following steps 202-204, step 205- 207th, step 205- steps 210, step 211- steps 212, step 211- steps 214, step 215- steps 216, step 215- Any one or any combination of these combinations of step 218, step 219- steps 220.

202nd, at least one wrong data of the indicated release of application is obtained.

The wrong data of application is bug data, is referred to as defective data, fault data etc., and wrong data can be with Including errorlevel, the description of mistake, the mark for finding wrong user, the classification of mistake, numbering of mistake etc..The mistake etc. Level is used for the serious conditions for weighing corresponding mistake, can include menace level, secondary grade, slight grade etc., error condition table Show whether mistake has solved, can include having solved, not solved, having assigned, having waited to assign, the description of mistake is used to represent wrong Detail information, the numbering of mistake are used to uniquely determine corresponding numbering etc. by mistake.

In force, when terminal makes a mistake in the process of running, can then be given birth to the wrong data of misregistration During into test report, terminal can obtain the wrong data that have recorded.Specifically, terminal can be got including mistake The webpage of data, parses wrong data from webpage.

The process that wrong data is parsed from webpage specifically may comprise steps of one to step 3.

Step 1: obtain the first web page address of the first named web page.

Tester can pre-set the first web page address, be stored in terminal, then terminal can obtain what is stored First web page address.In force, in order to get the first web page address, tester can input in fault management system to be referred to Determine the version number of version, and trigger search operaqtion, the institute that fault management system can retrieve the indicated release of the application is wrong Data by mistake, generation include the page of all data, then can record the current page using the current page as the first named web page The address in face is as the first web page address.

Wherein, first named web page refers to the webpage for including at least one wrong data of the indicated release of application, should First web page address refers to the address of first named web page.First named web page can be provided by fault management system, should Fault management system be used for record application each version wrong data, can be Mantis or be other have management answer The system of the function of wrong data.

Step 2: being based on the first web page address, the first named web page is shown.

Terminal can start browser, based on the web page address of browser access first, so as to show the first named web page.

Alternatively, when the first named web page is provided by fault management system, fault management system can verify user's mark Know and login password, the terminal only with logon rights provide the webpage for including wrong data, then terminal can first obtain use Family identifies and login password, based on user's mark, login password and the first web page address, calls simulation login method, logs in wrong Management system by mistake, the first named web page that display fault management system provides.

Wherein, simulation login method is specifically as follows terminal and carries user's mark to fault management system transmission, logs in The logging request of password and the first web page address, simulation login method can be provided by python or other program languages, example Such as by calling requests storehouses, urllib2 storehouses code library to realize.User is identified for uniquely determining corresponding user, can Think the user's mark that have registered in fault management system, the login password and corresponding, the Ke Yiwei of user's mark Digital, alphabetical or other kinds of character string.The user identifies and login password can store in the terminal in advance, then terminal The user mark stored and login password can directly be obtained.

Need to illustrate first point be, it is contemplated that fault management system can verified to user's mark and password On the basis of, further user's mark in cookie is verified, then terminal calls simulation login method, logon error pipe After reason system, cookie store methods are may call upon, user is identified and preserved into cookie, are sent out to fault management system Cookie is sent, when fault management system identifies verification to the user in cookie to be passed through, then shows that fault management system provides The first named web page.Wherein, the cookie store methods can be provided by python or other programming languages, should Cookie store methods can be cookielib methods.

The second point for needing to illustrate is, in the present embodiment, the flow of simulation login method is called by devising, terminal can With automated log on fault management system, the first named web page is shown, user's mark is inputted on front page layout without user and uses Family password etc., the situation that user carries out cumbersome operation is avoided, step is simple, and efficiency is higher, saves human resources.

Step 3: terminal invoking web page analytic method, is parsed to the first named web page, at least one error number is obtained According to.

The detailed process that invoking web page analytic method is parsed to the first named web page can be：Terminal can be by first Named web page is converted into node tree, obtains and specifies node identification, based on specified node identification, from the specified Node extraction of node tree At least one wrong data.Wherein, terminal can call beautifulsoup methods to realize the process, or by python, Any method with analyzing web page function that json and other program languages provide realizes the process.

Node tree：Node tree is referred to as DOM (Document Object Model, DOM Document Object Model) structure, should Node tree is in the nature that the various elements of the page are organized in the form of node in a tree structure, and the node tree includes multiple Node, each node in the plurality of node are used to store the data in the first named web page.

Specify node：Refer to the node for storing at least one wrong data, terminal can by specifying node identification, it is determined that Specified node in node tree, specifies from this and wrong data is extracted in node.

Specify node identification：For indicating the specified node of node tree, can be node ID (identification, Identity), name (title), tagname (bookmark name), classname (class name) etc..Terminal can prestore this Specify node identification.

203rd, terminal is based at least one wrong data, calculates the value-at-risk of the indicated release of application.

Value-at-risk is used for the error situation for weighing the indicated release running of application, and the size of value-at-risk can be with error Situation positive correlation, i.e. value-at-risk are bigger, show that error situation is more serious.

In the present embodiment, terminal can be based at least one wrong data, and wind is calculated using following two possible designs Danger value.In order to distinguish description, value-at-risk in the first possible design is referred to as the first value-at-risk at this, herein by second Value-at-risk in possible design is referred to as the second value-at-risk.

In the first possible design, terminal can be weighted summation to the quantity of at least one wrong data, obtain To the first value-at-risk.Following steps one are specifically included to step 3.

Step 1: obtain at least one default system corresponding at least one errorlevel and at least one errorlevel Number.

Terminal can prestore the mapping relations between errorlevel and predetermined coefficient, can be obtained from the mapping relations Take at least one predetermined coefficient corresponding at least one errorlevel and at least one errorlevel.Wherein, it is at least one pre- If each predetermined coefficient in coefficient is mapped to obtain by corresponding errorlevel, it can be used for the serious feelings for weighing corresponding errorlevel Condition, the size of predetermined coefficient can be with serious conditions positive correlations, such as predetermined coefficient corresponding to menace level can be 3, slightly Predetermined coefficient corresponding to grade can be 1 etc..

Step 2: for each errorlevel at least one errorlevel, obtaining should at least one wrong data The quantity of wrong data corresponding to errorlevel, obtain the quantity of at least one wrong data.

For each errorlevel, terminal can be directed to the errorlevel and travel through at least one wrong data, judge each Whether the errorlevel of wrong data is the errorlevel, when the errorlevel of wrong data is the errorlevel, it is determined that should Wrong data is wrong data corresponding to the errorlevel, adds one to the quantity of wrong data corresponding to the errorlevel, and then Count the quantity of wrong data corresponding to the errorlevel.

Step 3: using at least one predetermined coefficient as weight, summation is weighted to the quantity of at least one wrong data, As the first value-at-risk.

After the quantity of at least one wrong data is obtained, for each mistake in the quantity of at least one wrong data The quantity of data, terminal can obtain predetermined coefficient corresponding to the quantity of the wrong data, calculate the quantity of the wrong data by mistake With the product of the predetermined coefficient, at least one product is obtained, calculate at least one product and value, as the first value-at-risk.

Exemplarily, it is assumed that predetermined coefficient corresponding to menace level is 3, and the quantity of wrong data is corresponding to menace level 100, predetermined coefficient corresponding to secondary grade is 2, and the quantity of wrong data corresponding to secondary grade is 150, and slight grade is corresponding Predetermined coefficient can be 1, the quantity of wrong data corresponding to slight grade is 500, then the first value-at-risk=3*100+2*150 + 1*500=1100.

In second of possible design, it is menace level that terminal, which can obtain errorlevel at least one wrong data, Wrong data quantity, calculate wrong data quantity and menace level corresponding to predetermined coefficient product, as the second wind Danger value.

Second value-at-risk is referred to as excessive risk bug values, and second value-at-risk can accurately reflect the serious of application The situation of the wrong data of grade.Exemplarily, it is assumed that predetermined coefficient corresponding to menace level is 3, wrong corresponding to menace level The quantity of data is 100 by mistake, then the second value-at-risk=3*100=300.

Need to illustrate first point is that the first above-mentioned possible design and second of possible design can use arbitrarily The mode of combination forms this step 203, i.e. terminal can only calculate the first value-at-risk, or only calculate the second value-at-risk, or calculate First value-at-risk and the second value-at-risk.

The second point for needing to illustrate is, it is contemplated that error condition is unsolved wrong data relative to mistake in wrong data State is that practical significance is bigger for the wrong data that has solved by mistake, terminal in the indicated release being applied at least one After individual wrong data, it is unsolved wrong data that error condition can be first filtered out from least one wrong data, then First value-at-risk is calculated according to the first above-mentioned possible design based on unsolved wrong data, or may according to second Design calculate the second value-at-risk.

204th, value-at-risk is written to test report by terminal.

This step 204 can include following two possible designs.

In the first possible design, terminal can call file wiring method, create test report, value-at-risk is write Enter to test report.That is, terminal can create a null file temporarily, and as the test report to be filled in, value-at-risk is write Enter into test report.

Alternatively, terminal can get file name in above-mentioned steps 201, then in this step 204, can create name The referred to as test report of this document title.Wherein, file can be Excel file, word document or other types of file, File wiring method can be pyExcelerator, xlsxwriter method or other have the method for writing file function.

In second of possible design, terminal can obtain test report mark, be identified based on test report, call text Part wiring method, value-at-risk is written to test report.That is, terminal can be pre-created and store test report, to the test Value-at-risk is write in report.Wherein, test report identifies the test report for indicating to be pre-created, and can be test report Title, storage address etc..

It should be noted that terminal is after at least one wrong data is obtained, can also be from least one wrong data Middle screening error condition is still unsolved wrong data, and these still unsolved wrong data are written into test report In, so that tester can understand these wrong data from test report, in time for these wrong data to application Error situation is improved.

In summary, by performing above-mentioned steps 202-204, terminal can be reached and fully automatically generated including value-at-risk The effect of test report, wrong data is artificially collected without tester, without tester artificially by wrong data Duplication pastes Excel file, without tester artificially by wrong data calculation risk value, greatly accelerates life Into the speed of test report, the efficiency for generating test report is improved, meanwhile, the wrong data that terminal is got is more comprehensive, The situation of omission will not be produced, while the accuracy rate for calculating value-at-risk is higher.

Alternatively, referring to Fig. 4, in a kind of possible design, base of the test report in the function of providing record value-at-risk On plinth, the function of the mortality of the indicated release operation business of record application can also be provided, i.e. terminal is performing above-mentioned steps On the basis of 202- steps 204, following steps 205- steps 207 can also be performed simultaneously, or terminating to perform above-mentioned steps 204 Afterwards, start to perform following steps 205- steps 207.

205th, terminal obtains the first business datum of the indicated release of application.

The situation that business is provided in running is applied in the business datum reflection of application, is to provide direct broadcast function with application Exemplified by, the business datum of application can be the data into direct broadcasting room, the data for the virtual present sent out, in direct broadcasting room Data of the barrage of transmission etc..In order to distinguish description, the business datum of the indicated release of application is referred to as the first business number herein According to.

Concrete mode for obtaining the first business datum, terminal can obtain the first version of the indicated release of application Number, based on first version number, call the interface between application performance monitoring system, the first industry of the indicated release being applied Business data.Wherein, the application performance monitoring system can be understood as the server of application, and operation has the visitor of the version of any application Business datum can be sent to the application performance monitoring system by family end, then application performance monitoring system can be stored with each of application The business datum of version, the application performance monitoring system can be APM (Application Performance Management＆Monitoring, application performance management and monitoring system).

206th, terminal is based on the first business datum, calculates the first mortality of the indicated release of application.

First mortality is used for the service fail situation for weighing the indicated release of application.First mortality can be with business Failure scenarios positive correlation, i.e. service fail situation is more frequent, and the first mortality is bigger.

Concrete mode for calculating the first mortality, terminal can obtain the first service fail number, obtain the first industry Business total degree, calculates the ratio between the first service fail number and the first business total degree, obtains the first mortality.Wherein, First service fail number refers to the service fail number in the first business datum, the frequency of failure for example, into direct broadcasting room, The frequency of failure of the frequency of failure of the virtual present of submitting, the barrage sent in direct broadcasting room, the first business total degree refer to Business total degree in one business datum.The void for for example, enter the total number of users amount of direct broadcasting room, sending out in each direct broadcasting room Intend present total quantity, the barrage total quantity sent in direct broadcasting room etc.,

207th, the first mortality is written to test report by terminal.

This step is similar with above-mentioned steps 204, i.e. terminal can call file wiring method, create test report, by the One mortality is written to test report.In addition, terminal can obtain test report mark, identified based on test report, call text Part wiring method, the first mortality is written to test report.

Alternatively, test report is on the basis of the function of the first mortality of indicated release of record application is provided, also The second mortality that the reference version to the first mortality of the indicated release of application and application can be provided is analyzed Function, i.e., for terminal on the basis of above-mentioned steps 205- steps 207 are performed, terminal can also be performed in parallel following steps 208- steps 210, or after above-mentioned steps 204 are performed, start to perform following steps 208- steps 210.

208th, the second business datum of the reference version of application is obtained.

Be properly termed as baseline version with reference to version, can be current line on version or other can be for reference version. Second business datum refers to the business datum of the reference version of the application, and second business datum can be used as the first industry of analysis The reference for data of being engaged in, terminal can be based on the second business datum and the first business datum is analyzed, to weigh application The service fail situation of indicated release.

Process for obtaining the second business datum, second that second business datum can be based on the reference version of application Version number, the interface between application performance monitoring system is called to obtain, such as terminal can perform the mistake of above-mentioned steps 205 Cheng Zhong, based on first version number and the second edition number, the interface between application performance monitoring system is called, obtains the first business Data and the second business datum.

It should be noted that in a kind of possible design, it can require that the first business datum and the second business datum exist Identical sart point in time starts to count, and the first business datum and the second business datum terminate to unite in identical end time point Meter.So, due to the first business datum and the second business datum at the beginning of between point identical, Neng Goubao is corresponded to end time point Demonstrate,prove the first business datum and the second business datum reflect service fail situation of the version of different application in same time period, So as to ensure the first business datum and the second business datum contrasted after result there is fairness and accuracy.

In order to meet the requirement, terminal can obtain sart point in time and end time point in above-mentioned steps 201, hold During row above-mentioned steps 205, first version number, the second edition number, sart point in time and end time point can be based on, is adjusted With the interface between application performance monitoring system, then the first business datum obtained can refer to：The indicated release of application is being opened The average value of all business datums in period between beginning time point to end time point, the second obtained business datum can To refer to：The reference version of application all business datums in the sart point in time to the period between end time point are averaged Value.

209th, terminal is based on the second business datum, calculates the second mortality of the reference version of application.

This step is similar with above-mentioned steps 206, i.e., terminal can obtain the second service fail number, and it is total to obtain the second business Number, the ratio between the second service fail number and the second business total degree is calculated, obtains the second mortality.Wherein, second Service fail number refers to the service fail number in the second business datum, and the second business total degree refers in the second business datum Business total degree, the second mortality be used for weigh application reference version service fail situation.

210th, terminal calculates the first difference between the first mortality and the second mortality, and the second mortality and first is poor Value is written to test report.

First difference refers to the difference between the first mortality and the second mortality, and the first difference can reflect the finger of application Service fail situation of the version relative to the reference version of application is determined, when the first difference is larger, it is believed that business datum is not Meet the requirements, when the first difference is smaller, it is believed that business datum meets the requirements.Terminal can use and above-mentioned steps 204 Similar mode, the second mortality and the first difference are written in test report, so that tester knows application in time Whether the business datum of indicated release meets the requirements.

In a kind of possible design, terminal can obtain first the preset style and second the preset style, and this is first default Pattern and second the preset style be used to distinguishing whether satisfactory business datum.Terminal can be based on the first differential analysis application The first business datum of indicated release whether meet the requirements, the pattern of the first difference is set as not according to different analysis results Same the preset style, when checking the first difference so as to user, can intuitively be distinguished and known by the pattern of the first difference should The situation of first business datum of indicated release.

The design specifically may comprise steps of one to step 3：

Step 1: obtain the first predetermined threshold value and the second predetermined threshold value.

First predetermined threshold value and the second predetermined threshold value are properly termed as service fail alarm index, and the first predetermined threshold value can be with As the heavier standard of service fail situation for the indicated release for judging application, for the numerical value more than 0, the second predetermined threshold value can be with Can be negative as the lighter standard of service fail situation for the indicated release for judging application, the first predetermined threshold value is more than the The concrete numerical value of two predetermined threshold values, the first predetermined threshold value and the second predetermined threshold value can determine that first is default according to the actual requirements Threshold value and the second predetermined threshold value can store in the terminal in advance.

Step 2: when the first difference is more than the first predetermined threshold value, the pattern of the first difference is adjusted to the first default sample Formula.

Terminal may determine that whether the first difference is more than the first predetermined threshold value, when the first difference is more than the first predetermined threshold value When, show the mortality of indicated release of application significantly beyond the mortality of the reference version of application, that is, the specified version applied This service fail situation significantly overweights the service fail situation of the reference version of application, then terminal determines the indicated release of application Business datum it is undesirable, the pattern of the first difference can be adjusted to first the preset style, it is default will pass through first The business datum of the indicated release of pattern prompting user's application is undesirable.Wherein, first the preset style can include default Color, preset mark etc., in order to distinguish description, pre-set color in first the preset style is referred to as the first pre-set color at this, Preset mark in first the preset style is referred to as the first preset mark.

The pattern of first difference is adjusted into first the preset style can specifically include any combination of following (1)-(3).

(1) font of the first difference, is adjusted to the first pre-set color.

First pre-set color can be red, yellow or other can warn the eye-catching color of user, and this is first pre- If color can form strong contrast and contrast with the background colour of test report, so that user can be according to the first default face Color, is quickly found out the first difference from test report, knows that the business datum of the indicated release of application is undesirable in time, industry Business failure scenarios are overweight, it is necessary to be improved to the indicated release of application, to mitigate the business when indicated release of application is run Failure scenarios.

(2) cell where the first difference, is filled with the first pre-set color.

Test report can be Excel file, including multiple cells, terminal can be by the cells where the first difference First pre-set color is filled with, so that user can be according to the first pre-set color, from all cells in test report The cell being quickly found out where the first difference.

(3), the first preset mark is added in the preset range of the difference of distance first in test report.

First preset mark can be red point, exclamation mark, preset characters string, icon or other can play it is prominent strong The mark of tune effect.The preset range can include preset direction and pre-determined distance, and the preset direction can include the first difference Top, lower section, left, right any combination, the pre-determined distance is no more than the ultimate range that can show of test report, can To determine according to the actual requirements, such as can be the length of a cell.It is exemplary, when test report is Excel file, Terminal can add red exclamation mark in the adjacent left cell lattice of the cell where the first difference.

Step 3: when the first difference is less than the second predetermined threshold value, the pattern of the first difference is adjusted to the second default sample Formula.

Terminal may determine that whether the first difference is less than the second predetermined threshold value, when the first difference is less than the second predetermined threshold value When, show that the service fail situation of the indicated release of application is significantly lighter than the service fail situation of the reference version of application, terminal It can determine that the business datum of the indicated release of application meets the requirements, having reached can be with gray scale or the standard reached the standard grade.Then terminal can So that the pattern of the first difference is adjusted into second the preset style, will pass through the specified version of second the preset style prompting user's application This service fail situation meets the requirements, and service fail situation is lighter.

Wherein, second the preset style can include pre-set color, preset mark etc., in order to distinguish description, herein by second Pre-set color included by the preset style is referred to as the second pre-set color, and the preset mark included by second the preset style is referred to as into Two preset marks.The pattern of first difference is adjusted into second the preset style can specifically include any knot of following (1)-(3) Close.

(1) font of the first difference, is adjusted to the second pre-set color.

Second pre-set color can be green or other signify qualified color, and user can be according to the second default face Color, is quickly found out the first difference from test report, knows that the business datum of the indicated release of application meets the requirements in time.

(2) cell where the first difference, is filled with the second pre-set color.

Test report can be Excel file, including multiple cells, terminal can be by the cells where the first difference Second pre-set color is filled with, so that user can be according to the second pre-set color, from all cells in test report The cell being quickly found out where the first difference.

(3), the second preset mark is added in the preset range of the difference of distance first in test report.

Second preset mark can be green point, to hook, preset characters string, icon or other can play with qualified The mark of implication.The preset range can include preset direction and pre-determined distance, and the preset direction can include the first difference Top, any combination of lower section, left, right, the pre-determined distance are no more than the ultimate range that can show of test report, can be with Determine according to the actual requirements, such as can be the length of a cell.It is exemplary, when test report is Excel file, eventually End can be in the adjacent left cell lattice addition green of the cell where the first difference to hook.

It should be noted that when the first difference is less than the first predetermined threshold value and is more than the second predetermined threshold value, show to apply The service fail situation of indicated release be in normal range (NR), then terminal can not adjust the pattern of the first difference, i.e., according to The pattern of acquiescence sets the pattern of the first difference.

In summary, by performing above-mentioned steps 205-207, terminal can be reached and fully automatically generated including mortality The effect of test report, business datum is artificially collected without tester, without tester artificially by business datum Duplication pastes Excel file, artificially calculates mortality by business datum without tester, greatly accelerates life Into the speed of test report, the efficiency for generating test report is improved.Meanwhile the business datum that terminal is got is more comprehensive, The situation of omission will not be produced, while the accuracy rate for calculating fail values is higher.Further, the test report can provide pair The function that first business datum of the indicated release of application and the second business datum of the reference version of application are analyzed, Artificially it is analyzed without tester by the business datum of the version of two applications.Further, also provide The first difference between two business datums sets the scheme of different patterns, so that tester can intuitively pass through Whether the business datum that the pattern of the first difference understands the indicated release of application meets the requirements.

Alternatively, record can also be provided on the basis of the function of record value-at-risk is provided referring to Fig. 5, test report The function of the case propagation delays of the indicated release operation business of application, i.e. terminal are performing the basis of above-mentioned steps 202- steps 204 On, following steps 211- steps 212 can also be performed in parallel, or after above-mentioned steps 204 are performed, start to perform following steps 211- steps 212.

211st, terminal obtains the first delay data of the indicated release of application.

The case propagation delays that business is provided in running, i.e. interim card situation are applied in the delay data reflection of application, with application Exemplified by providing the application of direct broadcast function, the delay data of application is first when can be into duration, the loading direct broadcasting room of direct broadcasting room The duration of blank screen when duration that frame is shown, display direct broadcasting room, send virtual present from sender and receive virtual gift to recipient Duration of thing etc..In order to distinguish description, the delay data of the indicated release of application is referred to as the first delay data herein.

Concrete mode for obtaining the first business datum, can use the similar mode of above-mentioned steps 205, and terminal can be with The first version number of indicated release based on application, the interface between application performance monitoring system is called to obtain the first time delay number According to.

212nd, the first delay data is written to test report by terminal.

This step is similar with above-mentioned steps 204, i.e. terminal can call file wiring method, create test report, by the One delay data is written to test report.Or terminal can obtain test report mark, be identified based on test report, call File wiring method, the first delay data is written to test report.

Alternatively, on the basis of test report records the function of the first delay data of the indicated release of application in offer, The second delay data that the reference version to the first delay data of the indicated release of application and application can also be provided is carried out pair Than the function of analysis, i.e., on the basis of above-mentioned steps 211- steps 212 are performed, terminal can also be performed in parallel following terminal Step 213- steps 214, or after terminating to perform above-mentioned steps 212, start to perform following steps 213- steps 214.

213rd, terminal obtains the second delay data of the reference version of application.

This step is similar with above-mentioned steps 211, will not be described here.

It should be noted that in a kind of possible design, it can require that the first delay data and the second delay data exist Identical sart point in time starts to count, and the first delay data and the second delay data terminate to unite in identical end time point Meter.So, due to the first delay data and the second delay data at the beginning of between point identical, Neng Goubao is corresponded to end time point Demonstrate,prove the first delay data and the second delay data reflects case propagation delays of the version of different application in same time period, so as to Ensure the first delay data and the second delay data contrasted after result there is fairness and accuracy.

In order to meet the requirement, terminal can obtain sart point in time and end time point in above-mentioned steps 201, hold During row above-mentioned steps 205, first version number, the second edition number, sart point in time and end time point can be based on, is adjusted With the interface between application performance monitoring system, then the first delay data obtained can refer to：The indicated release of application is being opened The average value of all delay datas in period between beginning time point to end time point, the second obtained delay data can To refer to：The reference version of application all delay datas in the sart point in time to the period between end time point are averaged Value.

214th, terminal calculates the second difference between the first delay data and the second delay data, by the second delay data and Second difference is written to test report.

Second difference refers to the difference between the first delay data and the second delay data, and terminal can use and above-mentioned step Rapid 204 similar mode, the second mortality and the first difference are written in test report.

In a kind of possible design, terminal can also obtain the 3rd the preset style and the 4th the preset style, and the 3rd is pre- If pattern and the 4th the preset style be used to distinguishing whether satisfactory delay data.Terminal can be based on the second differential analysis should Whether the delay data of indicated release meets the requirements, and it is difference to set the pattern of the second difference according to different analysis results The preset style, when checking the second difference so as to user, can intuitively distinguish and know application by the pattern of the second difference The delay data of indicated release whether meet the requirements.

The design specifically may comprise steps of one to step 3：

Step 1: obtain the 3rd predetermined threshold value and the 4th predetermined threshold value.

3rd predetermined threshold value and the 4th predetermined threshold value are properly termed as time delay alarm index, and the 3rd predetermined threshold value can conduct Judge the heavier standard of the case propagation delays of the indicated release of application, for the numerical value more than 0, the 4th predetermined threshold value, which can be used as, to be judged The lighter standard of the case propagation delays of the indicated release of application, can be negative, and the 3rd predetermined threshold value is more than the 4th predetermined threshold value, The concrete numerical value of three predetermined threshold values and the 4th predetermined threshold value can determine that the 3rd predetermined threshold value and the 4th is preset according to the actual requirements Threshold value can store in the terminal in advance.

Step 2: when the second difference is more than three predetermined threshold values, the pattern of the second difference is adjusted to the 3rd default sample Formula.

Terminal may determine that whether the second difference is more than the 3rd predetermined threshold value, when the second difference is more than the 3rd predetermined threshold value When, show the case propagation delays of indicated release of application significantly beyond the case propagation delays of the reference version of application, then terminal can be with It is determined that the delay data of the indicated release of application is undesirable, then the pattern of the second difference is adjusted to the 3rd the preset style, It is overweight will pass through the case propagation delays of the indicated release of the 3rd the preset style prompting user's application, it is undesirable.

Wherein, the 3rd the preset style can include pre-set color, preset mark etc., in order to distinguish description, herein by the 3rd Pre-set color in the preset style is referred to as the 3rd pre-set color, and the preset mark in the 3rd the preset style is referred to as into the 3rd pre- bidding Note.The pattern of second difference is adjusted into the 3rd the preset style can specifically include any combination of following (1)-(3).

(1) font of the second difference, is adjusted to the 3rd pre-set color.

3rd pre-set color can be red, yellow or other can warn the eye-catching color of user, and the 3rd is pre- If color can form strong contrast and contrast with the background colour of test report, so that user can be according to the 3rd default face Color, is quickly found out the second difference from test report, knows that the delay data of the indicated release of application is undesirable in time.

(2) cell where the second difference, is filled with the 3rd pre-set color.

Test report can be Excel file, including multiple cells, terminal can be by the cells where the second difference The 3rd pre-set color is filled with, so that user can be according to the 3rd pre-set color, from all cells in test report The cell being quickly found out where the second difference.

(3) the 3rd preset mark, is added in the preset range of the difference of distance second in test report.

3rd preset mark can be red point, exclamation mark, preset characters string, icon or other can play it is prominent strong The mark of tune effect.The preset range can include preset direction and pre-determined distance, and the preset direction can include the second difference Top, lower section, left, right any combination, the pre-determined distance is no more than the ultimate range that can show of test report, can To determine according to the actual requirements, such as can be the length of a cell.It is exemplary, when test report is Excel file, Terminal can add red exclamation mark in the adjacent left cell lattice of the cell where the second difference.

Step 3: when the second difference is less than four predetermined threshold values, the pattern of the second difference is adjusted to the 4th default sample Formula.

Terminal may determine that whether the second difference is less than the 4th predetermined threshold value, when the second difference is less than the 4th predetermined threshold value When, show that the case propagation delays of the indicated release of application are significantly lighter than the case propagation delays of the reference version of application, the specified version of application This performance is splendid, and having reached can be with gray scale or the standard reached the standard grade.Then terminal can determine the time delay number of the indicated release of application According to meeting the requirements, the pattern of the second difference is adjusted to the 4th the preset style, should will pass through the 4th the preset style prompting user The delay data of indicated release meets the requirements, and case propagation delays are lighter.

Wherein, the 4th the preset style can include pre-set color, preset mark etc., in order to distinguish description, herein by the 4th Pre-set color in the preset style is referred to as the 4th pre-set color, and the preset mark in the 4th the preset style is referred to as into the 4th pre- bidding Note.The pattern of second difference is adjusted into the 4th the preset style can specifically include any combination of following (1)-(3).

(1) font of the second difference, is adjusted to the 4th pre-set color.

4th pre-set color can be green or other signify qualified color, and user can be according to the 4th default face Color, is quickly found out the second difference from test report, knows that the delay data of the indicated release of application meets the requirements in time.

(2) cell where the 4th difference, is filled with the 4th pre-set color.

Test report can be Excel file, including multiple cells, terminal can be by the cells where the second difference The 4th pre-set color is filled with, so that user can be according to the 4th pre-set color, from all cells in test report The cell being quickly found out where the second difference.

(3) the 4th preset mark, is added in the preset range of the difference of distance the 4th in test report.

4th preset mark can be green point, to hook, preset characters string, icon or other can play with qualified The mark of implication.The preset range can include preset direction and pre-determined distance, and the preset direction can include the second difference Top, any combination of lower section, left, right, the pre-determined distance are no more than the ultimate range that can show of test report, can be with Determine according to the actual requirements, such as can be the length of a cell.It is exemplary, when test report is Excel file, eventually End can be in the adjacent left cell lattice addition green of the cell where the second difference to hook.

It should be noted that when the second difference is less than the 3rd predetermined threshold value and is more than four predetermined threshold values, show to apply The case propagation delays of indicated release be in normal range (NR), then terminal can not adjust the pattern of the second difference, i.e., according to acquiescence Pattern set the second difference pattern.

In summary, by performing above-mentioned steps 211-214, terminal can be reached and fully automatically generated including delay data Test report effect, delay data is artificially collected without tester, without tester artificially by time delay number Excel file is pasted according to duplication, greatly accelerates the speed of generation test report, improves the effect of generation test report Rate.Meanwhile the delay data that terminal is got is more comprehensive, the situation of omission will not be produced, accuracy rate is higher.Further, The test report can provide the second time delay number to the first delay data of the indicated release of application and the reference version of application According to the function being analyzed, artificially contrasted without tester by the delay data of the version of two applications Analysis.Further, the scheme that the second difference between two delay datas sets different patterns is additionally provided, to survey Whether the delay data for the indicated release that examination personnel intuitively can understand application by the pattern of the second difference meets the requirements.

Alternatively, referring to Fig. 6, test report is on the basis of the function of the value-at-risk for the indicated release for providing record application On, the function of the traffic conditions of the indicated release operation business of record application can also be provided, i.e., terminal is in execution above-mentioned steps On the basis of 202- steps 204, following steps 215- steps 216 can also be performed in parallel, or terminating to perform above-mentioned steps After 204, start to perform following steps 215- steps 216.

215th, terminal obtains the first flow data of the indicated release of application.

The data on flows of application can reflect that applies is welcome using the number of users that application is used in running Degree, so that application is provides the application of direct broadcast function as an example, the data on flows of application can be access direct broadcasting room number of users, The number of users of barrage is sent, so that application is microblogging application as an example, the data on flows of application can be to thumb up quantity, comment number Amount, forwarding quantity etc..In order to distinguish description, the data on flows of the indicated release of application is referred to as first flow data herein.

Concrete mode for obtaining first flow data, can use the similar mode of above-mentioned steps 205, and terminal can be with The first version number of indicated release based on application, the interface between application performance monitoring system is called to obtain first flow number According to.

216th, first flow data are written to test report by terminal.

This step is similar with above-mentioned steps 204, i.e. terminal can call file wiring method, create test report, by the One data on flows is written to test report.Or terminal can obtain test report mark, be identified based on test report, call File wiring method, first flow data are written to test report.

Alternatively, on the basis of test report records the function of the first delay data of the indicated release of application in offer, The second delay data that the reference version to the first delay data of the indicated release of application and application can also be provided is carried out pair Than the function of analysis, i.e., on the basis of above-mentioned steps 215- steps 216 are performed, terminal can also be performed in parallel following terminal Step 217- steps 218, or after terminating to perform above-mentioned steps 215, start to perform following steps 217- steps 218.

It should be noted that in a kind of possible design, it can require that first flow data and second flow data exist Identical sart point in time starts to count, and first flow data and second flow data terminate to unite in identical end time point Meter.So, due to first flow data and second flow data at the beginning of between point identical, Neng Goubao is corresponded to end time point Card first flow data and second flow data reflect traffic conditions of the version of different application in same time period, so as to Result has fairness and accuracy after guarantee first flow data and second flow data are contrasted.

In order to meet the requirement, terminal can obtain sart point in time and end time point in above-mentioned steps 201, hold During row above-mentioned steps 205, first version number, the second edition number, sart point in time and end time point can be based on, is adjusted With the interface between application performance monitoring system, then the first flow data obtained can refer to：The indicated release of application is being opened The average value of all datas on flows in period between beginning time point to end time point, obtained second flow data can To refer to：The reference version of application all datas on flows in the sart point in time to the period between end time point are averaged Value.

217th, terminal obtains the second flow data of the reference version of application.

This step is similar with above-mentioned steps 216, will not be described here.

218th, terminal calculates the 3rd difference between first flow data and second flow data, by second flow data and 3rd difference is written in test report.

3rd difference refers to the difference between first flow data and second flow data, and terminal can use and above-mentioned step Rapid 204 similar mode, second flow data and the 3rd difference are written in test report.

In a kind of possible design, terminal can also obtain the 5th the preset style and the 6th the preset style, and the 5th is default Pattern and the 6th the preset style be used to distinguishing whether satisfactory data on flows.Terminal can be based on the 3rd differential analysis application The data on flows of indicated release whether meet the requirements, it is different to set the pattern of the 3rd difference according to different analysis results The preset style, when checking three differences so as to user, the finger for knowing application can be intuitively distinguished by the pattern of the 3rd difference Whether the data on flows for determining version meets the requirements.

The design specifically may comprise steps of one to step 3：

Step 1: obtain the 5th predetermined threshold value and the 6th predetermined threshold value.

5th predetermined threshold value and the 6th predetermined threshold value are properly termed as alarming flow index, and the 5th predetermined threshold value can conduct Judge the whether satisfactory standard of flow of the indicated release of application, for the numerical value more than 0, the 6th predetermined threshold value can conduct Judging the undesirable standard of traffic conditions of the indicated release of application, the 5th predetermined threshold value is more than the 6th predetermined threshold value, the The concrete numerical value of five predetermined threshold values and the 6th predetermined threshold value can determine that the 5th predetermined threshold value and the 6th is preset according to the actual requirements Threshold value can store in the terminal in advance.

Step 2: when the 3rd difference is more than five predetermined threshold values, the pattern of the 3rd difference is adjusted to the 5th default sample Formula.

Terminal may determine that whether the 3rd difference is more than the 5th predetermined threshold value, when the 3rd difference is more than the 5th predetermined threshold value When, show the traffic conditions of indicated release of application significantly beyond the traffic conditions of the reference version of application, the finger of the application Determine that version is non-to be subjected to user's welcome, having reached can be with gray scale or the standard reached the standard grade, then terminal can determine that data on flows meets It is required that the pattern of the 3rd difference is adjusted to the 5th the preset style, will pass through the finger of the 5th the preset style prompting user's application The data on flows for determining version meets the requirements.

Wherein, the 5th the preset style can include pre-set color, preset mark etc., in order to distinguish description, herein by the 5th Pre-set color included by the preset style is referred to as the 5th pre-set color, and the preset mark included by the 5th the preset style is referred to as into Five preset marks.The pattern of 3rd difference is adjusted into the 5th the preset style can specifically include any knot of following (1)-(3) Close.

(1) font of the 3rd difference, is adjusted to the 5th pre-set color.

5th pre-set color can be green, and user can quickly look for according to the 5th pre-set color from test report To the 3rd difference, know that the traffic conditions of the indicated release of application meet the requirements in time.

(2) cell where the 3rd difference, is filled with the 5th pre-set color.

Test report can be Excel file, including multiple cells, terminal can be by the cells where the 3rd difference The 5th pre-set color is filled with, so that user can be according to the 5th pre-set color, from all cells in test report The cell being quickly found out where the 3rd difference.

(3) the 5th preset mark, is added in the preset range of the difference of distance the 3rd in test report.

5th preset mark can be green point, to hook, preset characters string, icon or other can play with qualified The mark of implication.The preset range can include preset direction and pre-determined distance, and the preset direction can include the 3rd difference Top, any combination of lower section, left, right, the pre-determined distance are no more than the ultimate range that can show of test report, can be with Determine according to the actual requirements, such as can be the length of a cell.It is exemplary, when test report is Excel file, eventually End can be in the adjacent left cell lattice addition green of the cell where the 3rd difference to hook.

Step 3: when the 3rd difference is less than six predetermined threshold values, the pattern of the 3rd difference is adjusted to the 6th default sample Formula.

Terminal may determine that whether the 3rd difference is less than the 6th predetermined threshold value, when the 3rd difference is less than the 6th predetermined threshold value When, show the flow of indicated release of application considerably less than the flow of the reference version of application, the flow of the indicated release of application Data are undesirable, it is still necessary to which the indicated release of application is improved.Then terminal can adjust the pattern of the 3rd difference , will will pass through that the data on flows of the indicated release of the 6th the preset style prompting user's application do not meet for the 6th the preset style Ask.

Wherein, the 6th the preset style can include pre-set color, preset mark etc., in order to distinguish description, herein by the 6th Pre-set color included by the preset style is referred to as the 6th pre-set color, and the preset mark included by the 6th the preset style is referred to as into Six preset marks.The pattern of 3rd difference is adjusted into the 6th the preset style can specifically include any knot of following (1)-(3) Close.

(1) font of the 3rd difference, is adjusted to the 6th pre-set color.

6th pre-set color can be red, yellow or other can warn the eye-catching color of user, and the 6th is pre- If color can form strong contrast and contrast with the background colour of test report, so that user can be according to the 6th default face Color, is quickly found out the 3rd difference from test report, knows that the case propagation delays of the indicated release of application are heavier in time.

(2) cell where the 3rd difference, is filled with the 6th pre-set color.

Test report can be Excel file, including multiple cells, terminal can be by the cells where the 3rd difference The 6th pre-set color is filled with, so that user can be according to the 6th pre-set color, from all cells in test report The cell being quickly found out where the 3rd difference.

(3) the 6th preset mark, is added in the preset range of the difference of distance the 3rd in test report

6th preset mark can be red point, exclamation mark, preset characters string, icon or other can play it is prominent strong The mark of tune effect.The preset range can include preset direction and pre-determined distance, and the preset direction can include the 3rd difference Top, lower section, left, right any combination, the pre-determined distance is no more than the ultimate range that can show of test report, can To determine according to the actual requirements, such as can be the length of a cell.It is exemplary, when test report is Excel file, Terminal can add red exclamation mark in the adjacent left cell lattice of the cell where the 3rd difference.

In summary, by performing above-mentioned steps 215-218, terminal can be reached and fully automatically generated including data on flows Test report effect, data on flows is artificially collected without tester, without tester artificially by flow number Excel file is pasted according to duplication, greatly accelerates the speed of generation test report, improves the effect of generation test report Rate.Meanwhile the data on flows that terminal is got is more comprehensive, the situation of omission will not be produced, accuracy rate is higher.Further, The test report can provide the second flow number to the first flow data of the indicated release of application and the reference version of application According to the function being analyzed, artificially contrasted without tester by the data on flows of the version of two applications Analysis.Further, the scheme that the 3rd difference between two datas on flows sets different patterns is additionally provided, to survey Whether the data on flows for the indicated release that examination personnel intuitively can understand application by the pattern of the 3rd difference meets the requirements.

Alternatively, record can also be provided on the basis of the function of record value-at-risk is provided referring to Fig. 7, test report The function of the demand data of the indicated release of application, i.e. terminal, can be with the basis of above-mentioned steps 202- steps 204 are performed Following steps 219- steps 220 are performed in parallel, or after above-mentioned steps 204 are performed, start to perform following steps 219- steps 220。

219th, terminal obtains the demand data of the indicated release of application.

Test report can record demand data, so that tester understands demand of the user to the indicated release of application, The performance of application is lifted.Wherein, demand data refers to record data of the user to the demand of the indicated release of the application, For example, " homepage correcting ", " requesting song square ", " flow is sold ", " optimization of giving a present ", " direct broadcasting room correcting etc. ", demand data can be with For tabular form or other forms.

Concrete mode for obtaining demand data, can specifically include following two possible designs.

In the first possible design, terminal can use with the similar mode of above-mentioned steps 202, to including demand number According to webpage parsed, to obtain demand data.Specifically one is may comprise steps of to step 3.

Step 1: obtain the second web page address of the second named web page.

Tester can pre-set the second web page address, be stored in terminal, then terminal can obtain stored The second web page address.In force, in order to get the second web page address, tester can input in requirement management systems The version number of indicated release, and search operaqtion is triggered, requirement management systems can retrieve all of the indicated release of the application Demand data, all demand datas are shown on current page, then can be using the current page as the second named web page, record The address of the current page is as the second web page address.

Wherein, second named web page refers to the webpage for including the demand data of the indicated release of application, second webpage Address refers to the address of second named web page.Second named web page can be provided by requirement management systems, the demand management System is used for the demand data for recording each version of application, can be JIRA or other systems.

Step 2: being based on the second web page address, the second named web page is shown.

This step is similar with the step two in above-mentioned steps 202, and terminal can first obtain user's mark and login password, base In user's mark, login password and the first web page address, simulation login method is called, logs in requirement management systems, shows demand The second named web page that management system provides.Alternatively, then terminal call simulation login method, log in requirement management systems it Afterwards, cookie store methods are may call upon, user is identified and preserved into cookie, are sent to requirement management systems Cookie, when requirement management systems identify verification to the user in cookie to be passed through, then show what requirement management systems provided Second named web page.

Step 3: invoking web page analytic method, parses to the second named web page, obtains demand data.

This step is similar with the step three in above-mentioned steps 202, i.e., the second named web page can be converted into node by terminal Tree, obtain and specify node identification, based on specified node identification, from the specified Node extraction demand data of node tree.Wherein, terminal Beautifulsoup methods can be called to realize the process, or provided by python, json and other programming languages Web analysis method realizes the process.

In second of possible design, terminal can be used with the similar mode of above-mentioned steps 205, the finger based on application Determine the first version number of version, call the interface between requirement management systems, the demand data for the indicated release being applied.

220th, demand data is written to test report by terminal.

This step is similar with above-mentioned steps 204, i.e. terminal can call file wiring method, create test report, need to Data are asked to be written to test report.In addition, terminal can obtain test report mark, identified based on test report, call file Wiring method, demand data is written to test report.

In summary, by performing above-mentioned steps 219-220, terminal can be reached and fully automatically generated including demand data Test report effect, demand data is artificially collected without tester, without tester artificially by demand number Excel file is pasted according to duplication, greatly accelerates the speed of generation test report, improves the effect of generation test report Rate.Meanwhile the demand data that terminal is got is more comprehensive, the situation of omission will not be produced, accuracy rate is higher.

Need to illustrate first point is above-mentioned steps 204, step 207, step 210, step 212, step 214, step 216th, step 218, step 220 can form the process of generation test report in a manner of any combination.Referring to it is following two can The design of energy.

In the first possible design, when above-mentioned steps 204, step 207, step 210, step 212, step 214, step Rapid 217, when any number of steps in step 221 are combined, terminal can create multiple test report, respectively in different surveys The data of recording different types in examination report.Such as a test report for being exclusively used in recording value-at-risk is created, in the test report Write-in value-at-risk is accused, a test report for being exclusively used in recording mortality is created, the first mortality, the is write in the test report Two mortalitys, the first difference, by that analogy.

In second of possible design, terminal can need not create multiple test report, need to only create a test report Accuse, all data obtained by the multiple steps being combined are written in the test report.It is for example, more for what is be combined For individual step, terminal can create a test report in first step in the plurality of step, subsequently in other steps In, whenever after obtaining related data will the data be written in the test report.For example, it is assumed that terminal is first calculated Value-at-risk, then terminal can create test report, value-at-risk is written in test report, subsequently whenever obtaining the first failure Rate, the second mortality, the first difference, the first delay data, the second delay data, the second difference, first flow data, second When measuring data, the 3rd difference and demand data, you can write related data to the test report.For another example, it is more for what is be combined For individual step, terminal can terminate in the multiple steps being combined, and after obtaining data corresponding to the plurality of step, then create One test report, these data are written in test report simultaneously.For example, terminal can obtain value-at-risk, the first mistake Lose rate, the second mortality, the first difference, the first delay data, the second delay data, the second difference, first flow data, second After data on flows, the 3rd difference and demand data, then test report is created, these data are write to the test report.

The second point for needing to illustrate is, when to write multiple data to test report, in order to ensure U.S. of test report The property seen, terminal can obtain default layout, and multiple data are write to test report according to the default layout.For example, test report For Excel file when, terminal can to the Excel file sheet1 write value-at-risk, to Excel file sheet2 write First mortality, the second mortality, the first difference, the first delay data, the second time delay number are write to the sheet3 of Excel file According to, second difference etc..And for example, terminal can write the first mortality, the second failure to the first row cell of Excel file Rate, the first difference, the first delay data, the second delay data, the second difference are write to the second row cell of Excel file Deng.Wherein the default layout can be pre-set in terminal, can be determined according to the actual requirements.

Need to illustrate is thirdly, can be with during terminal calculates data and writes data to test report Test report is stored in real time or periodically, in order to avoid there is loss of data during abnormal conditions in test report.In addition, obtaining After test report, test report can be stored in database by terminal, subsequently when needing to read the test report, Ke Yisui When the test report is called from database.

Need to illustrate the 4th point is that test report can be uploaded to some data by terminal after test report is generated Storage address on storehouse, website, management system, webpage or other networks, other-end can be downloaded by network and generated Test report.

Need to illustrate the 5th point is, after generating test report by above-mentioned steps, in order to ensure that associated user can Test report is obtained in time, terminal can be based on the test report, and mail is sent at least one default email address.For example, Terminal can obtain at least one default email address, using test report as Email attachment, and/or, test report is carried out Sectional drawing, using sectional drawing as message body, mail is sent at least one default email address.Wherein, at least one default postal Case address can store in the terminal in advance, can be the email address of tester, the application indicated release exploit person Email address of member etc..

In addition, terminal can also obtain default mail matter topics, the theme of mail is arranged to the default mail matter topics, this is pre- If mail matter topics can be " gray scale brings a prisoner before the court mail " etc., terminal can also obtain the priority of mail, correspondingly set mail Priority.In addition, terminal can carry the function of mailbox server, i.e., using itself as mailbox server, at least one pre- If email address sends mail, or, terminal can call the interface between mailbox server, and postal is sent to mailbox server Part, mail is sent from mailbox server at least one default email address.

Need to illustrate the 6th point is, when acquisition business datum, delay data, stream from same application performance monitoring system When measuring data, any number of steps in above-mentioned steps 205, step 208, step 211, step 213, step 216, step 218 When being combined, terminal only need to call an interface without repeatedly calling the interface between the application performance monitoring system, you can Obtain multiple data simultaneously.For example, terminal can be based on first version number and the second edition number calls an interface, it is applied It is the first business datum that performance monitoring system provides, the second business datum, the first delay data, the second delay data, first-class Measure data and second flow data.

Need to illustrate the 7th point is that the processing logic of each step can be encapsulated as one and apply journey in the present embodiment Sequence, the application program can provide the function of automatically generating test report, when any terminal runs the application program, you can perform Above-mentioned each step.Wherein, the programming language of the application program can be python, and design specification can be flask, front end frame Frame can be bootstrap, and the database of calling can be mysql, and the code library that each method is related to can include python PyExcelerator, xlsxwriter of offer, requests, cookielib, BeautifulSoup, urllib2, Wtforms etc..

Using fault management system as Mantis, application performance monitoring system is APM, exemplified by requirement management systems are JIRA, Referring to Fig. 8, a kind of operational flowchart of the test report generation method provided it illustrates the present embodiment, what terminal automatically generated In test report, including the first value-at-risk, the second value-at-risk, the first mortality, the second mortality, the first difference, the first time delay Data, the second delay data, the second difference, first flow data, second flow data, the 3rd difference and demand data, simultaneously Realize the comparative analysis of the first mortality and the second mortality, the comparative analysis of the first delay data and the second delay data, The comparative analysis of one data on flows and second flow data, test report can comprehensively, accurately, scientifically reflect the property of application Can, test process and R＆D process to application are respectively provided with great reference value and practicality.

In an exemplary scenario, the method provided using correlation technique and the present embodiment is tested respectively：Phase In the technology of pass, tester generate a test report when, finishing time at least more than one day, and calculate various data when ten Partial volume is easily obscured.And the method for using the present embodiment to provide, test report is fully automatically generated by terminal, finishing time can reach 20min or so is arrived, without relying on manual operation, and the equal zero defect of various data in test report.

Further, additionally provide it is a kind of being parsed to webpage come by way of obtaining wrong data, step is simple, Will not error of omission data, practicality is high.

Further, test report can also record the mortality of application, ensure the comprehensive, scientific of test report, The manual operation of tester need not be relied on simultaneously, and step is simple.

It is possible to further obtained automatically by terminal business datum calculate mortality, will not omitted transactions data, calculating Mortality accuracy rate is high.

Further, test report can also obtain the business datum of the reference version of application, and then be provided as application The comparative analysis function of the mortality of indicated release and the reference version of application, is easy to tester intuitively to be obtained from test report Know whether the business datum of the indicated release of application meets the requirements.

Further, test report can also record the delay data of application, ensure comprehensive, the science of test report Property, while the manual operation of tester need not be relied on, step is simple.

It is possible to further obtain delay data automatically by terminal, delay data will not be omitted, without tester people Work collects delay data, simple to operate, and accuracy rate is high.

Further, test report can also obtain the delay data of the reference version of application, and then be provided as application The comparative analysis function of the delay data of indicated release and the reference version of application, it is easy to tester directly perceived from test report Know whether the delay data of the indicated release of application meets the requirements.

It is possible to further obtain data on flows automatically by terminal, data on flows is artificially collected without tester, is grasped Make simply, data on flows will not be omitted, accuracy rate is high.

Further, test report can also obtain the data on flows of the reference version of application, and then be provided as application The comparative analysis function of the data on flows of indicated release and the reference version of application, it is easy to tester directly perceived from test report Know whether the data on flows of the indicated release of application meets the requirements.

It is possible to further obtain demand data automatically by terminal, demand data is artificially collected without tester, is grasped Make simply, demand data will not be omitted, accuracy rate is high.

Further, test report can also obtain the demand data of the reference version of application, and then be provided as application The comparative analysis function of the demand data of indicated release and the reference version of application, it is easy to tester directly perceived from test report Know whether the demand data of the indicated release of application meets the requirements.

It is possible to further send mail by terminal is automatic after test report generation, it can ensure that tester is timely Know that test report has generated, obtain the content of test report, ensure that instantaneity, practicality height.

Fig. 9 is a kind of structural representation of test report generating means provided in an embodiment of the present invention.Referring to Fig. 9, the dress Put including：Acquisition module 901, computing module 902 and writing module 903.

Acquisition module 901, at least one wrong data of the indicated release for obtaining application；

Computing module 902, for based at least one wrong data, calculating the value-at-risk of the indicated release of the application, The value-at-risk is used for the error situation for weighing the indicated release running of the application；

Writing module 903, for the value-at-risk to be written into test report, the test report is used to record the value-at-risk.

The device that the present embodiment provides, devises the scheme that a kind of terminal automatically generates test report, is tested without relying on The manual operation of personnel, step is simple, time-consuming shorter, saves human resources.Meanwhile wrong data meter is automatically based upon by terminal Value-at-risk is calculated, accuracy rate is high.

In a kind of possible design, the acquisition module 901, including：

Acquiring unit, for obtaining the first web page address of the first named web page, first named web page includes this at least One wrong data；

Resolution unit, for invoking web page analytic method, first named web page is parsed, it is at least one to obtain this Wrong data.

In a kind of possible design, the display unit, it is additionally operable to obtain user's mark and login password；Based on the user Mark, the login password and first web page address, call simulation entering device, logon error management system；Show the mistake The first named web page that management system provides.

In a kind of possible design, the display unit, it is additionally operable to：Cookie store methods are called, the user is identified Preserve into cookie；The cookie is sent to the fault management system；When the fault management system is to being somebody's turn to do in the cookie User identifies verification when passing through, the step of performing the first named web page that the display fault management system provides.

In a kind of possible design, the resolution unit, for first named web page to be converted into node tree, the node Setting includes multiple nodes, and each node in the plurality of node is used to store the data in first named web page；Obtain and specify Node identification, this specifies node identification to be used to indicate specified node of the node tree, this specify node refer to store this at least one The node of individual wrong data；Node identification is specified based on this, from the specified Node extraction of the node tree at least one error number According to.

In a kind of possible design, the computing module 902, including：

Acquiring unit, it is at least one corresponding at least one errorlevel and at least one errorlevel for obtaining Predetermined coefficient, each predetermined coefficient at least one predetermined coefficient are used for the serious conditions for weighing corresponding errorlevel；

The acquiring unit, be additionally operable to for each errorlevel at least one errorlevel, obtain this at least one The quantity of wrong data corresponding to the errorlevel, obtains the quantity of at least one wrong data in individual wrong data；

Computing unit, for using at least one predetermined coefficient as weight, entering to the quantity of at least one wrong data Row weighted sum, as the first value-at-risk.

In a kind of possible design, the computing module 902, including：

Acquiring unit, it is the number of the wrong data of menace level for obtaining errorlevel at least one wrong data Amount；

Computing unit, for calculating the quantity and the product of predetermined coefficient corresponding to the menace level of the wrong data, make For the second value-at-risk.

In a kind of possible design, the device also includes：

Creation module, for calling file wiring method, test report is created, this is performed and value-at-risk is written to the survey The step of examination report；Or, test report mark is obtained, the test report identifies the test report for indicating to be pre-created； Identified based on the test report, call file wiring method, perform the step of value-at-risk is written to the test report by this.

In a kind of possible design,

The acquisition module 901, it is additionally operable to obtain the first business datum of the indicated release of the application；

The computing module 902, it is additionally operable to be based on first business datum, calculates the first failure of the indicated release of the application Rate, first mortality are used for the service fail situation for weighing the indicated release of the application；

The writing module 903, it is additionally operable to first mortality being written to test report, the test report is additionally operable to record First mortality.

In a kind of possible design, the acquisition module 901, the first version of the indicated release for obtaining the application Number；Based on the first version number, the interface between application performance monitoring system is called, obtains the of the indicated release of the application One business datum.

In a kind of possible design, the computing module 902, including：

Acquiring unit, for obtaining the first service fail number, the first service fail number refers to the first business number Service fail number in；

The acquiring unit, the first business total degree is also obtained, the first business total degree refers in first business datum Business total degree；

In a kind of possible design, the acquisition module 901, be additionally operable to obtain application reference version the second business number According to；

The computing module 902, it is additionally operable to be based on second business datum, calculates the second failure of the reference version of the application Rate, second mortality are used for the service fail situation for weighing the reference version of the application；

The computing module 902, it is additionally operable to calculate the first difference between first mortality and the second mortality；

The writing module 903, it is additionally operable to second mortality and first difference being written to the test report, the test Report is additionally operable to record second mortality and first difference.

In a kind of possible design, the acquisition module 901, it is additionally operable to obtain the first predetermined threshold value and the second default threshold Value；

The device also includes：Adjusting module, it is for when first difference is more than first predetermined threshold value, this is first poor The pattern of value is adjusted to first the preset style；Or, when first difference is less than second predetermined threshold value, by first difference Pattern is adjusted to second the preset style, first the preset style and second the preset style be used to distinguishing whether satisfactory industry Business data.

The font of first difference is adjusted to the first pre-set color；Cell where first difference is filled with this First pre-set color；In the test report the first preset mark is added in the preset range of distance first difference；By this The font of one difference is adjusted to the second pre-set color；Cell where first difference is filled with second pre-set color； In the test report the second preset mark is added in the preset range of distance first difference.

In a kind of possible design, the acquisition module 901, it is additionally operable to obtain the second service fail number, second industry The business frequency of failure refers to the service fail number in second business datum；

The acquisition module 901, it is additionally operable to obtain the second business total degree, the second business total degree refers to second business Business total degree in data；

The computing module 902, it is additionally operable to calculate the ratio between the second service fail number and the second business total degree Value, obtains second mortality.

In a kind of possible design, the acquisition module 901, it is additionally operable to obtain the first time delay of the indicated release of the application Data；

The writing module 903, it is additionally operable to first delay data being written to the test report, the test report is used to remember Record first delay data.

In a kind of possible design, the device also includes：

The acquisition module 901, it is additionally operable to obtain the second delay data of the reference version of application；

The computing module 902, it is additionally operable to calculate the second difference between first delay data and second delay data；

The writing module 903, it is additionally operable to second delay data and second difference being written to the test report, the survey Examination report is used to record second delay data and second difference.

In a kind of possible design, the acquisition module 901, it is additionally operable to obtain the 3rd predetermined threshold value and the 4th default threshold Value；

The device also includes：Adjusting module, it is for when second difference is more than three predetermined threshold values, this is second poor The pattern of value is adjusted to the 3rd the preset style；Or, when second difference is less than four predetermined threshold values, by second difference Pattern is adjusted to the 4th the preset style, the 3rd the preset style and the 4th the preset style be used to distinguishing whether it is satisfactory when Prolong data.

The font of second difference is adjusted to the 3rd pre-set color；Cell where second difference is filled with this 3rd pre-set color；The 3rd preset mark is added in the preset range of distance first difference in the test report；By this The font of two differences is adjusted to the 4th pre-set color；Cell where second difference is filled with the 4th pre-set color； The 4th preset mark is added in the preset range of distance second difference in the test report.

In a kind of possible design, the acquisition module 901, it is additionally operable to obtain the first flow of the indicated release of the application Data；

The writing module 903, it is additionally operable to the first flow data being written to the test report, the test report is used to remember Record the first flow data.

In a kind of possible design, the acquisition module 901, be additionally operable to obtain application reference version second flow number According to；

The computing module 902, it is additionally operable to calculate the 3rd difference between the first flow data and the second flow data；

The writing module 903, it is additionally operable to the second flow data and the 3rd difference being written to the test report, the survey Examination report is used to record the second flow data and the 3rd difference.

In a kind of possible design, the acquisition module 901, it is additionally operable to obtain the 5th predetermined threshold value and the 6th default threshold Value；

The device also includes：Adjusting module, it is poor by the 3rd for when the 3rd difference is more than five predetermined threshold values The pattern of value is adjusted to the 5th the preset style；Or, when the 3rd difference is less than six predetermined threshold values, by the 3rd difference Pattern is adjusted to the 6th the preset style, the 5th the preset style and the 6th the preset style be used to distinguishing whether satisfactory stream Measure data.

The font of 3rd difference is adjusted to the 5th pre-set color；Cell where 3rd difference is filled with this 5th pre-set color；The 5th preset mark is added in the preset range of the difference of distance the 3rd in the test report；By this The font of three differences is adjusted to the 6th pre-set color；Cell where 3rd difference is filled with the 6th pre-set color； The 6th preset mark is added in the preset range of the difference of distance the 3rd in the test report.

In a kind of possible design, the acquisition module 901, it is additionally operable to obtain the demand number of the indicated release of the application According to；

The writing module 903, it is additionally operable to the demand data being written to the test report, the test report is used to record this Demand data.

In a kind of possible design, the acquisition module 901, it is additionally operable to：With obtaining the second webpage of the second named web page Location, second named web page include the demand data；Based on second web page address, second named web page is shown；Call net Page resolver, parses to second named web page, obtains the demand data；Or, the indicated release based on the application First version number, the interface between requirement management systems is called, obtains the demand data of the indicated release of the application.

In a kind of possible design, the acquisition module 901, it is additionally operable to obtain at least one default email address；

The device also includes：Mail editor module, for using the test report as Email attachment；And/or to the test Report carries out sectional drawing, using the sectional drawing as message body；

Sending module, for sending mail at least one default email address.

In a kind of possible design, the device also includes：Display module, for showing that the generation of test report starts page Face；

The acquisition module 901, is additionally operable to obtain and starts the of the indicated release of the application that is inputted on the page in the generation At least one in one version number, the second edition number for the reference version applied, sart point in time, end time point, file name .

Above-mentioned all optional technical schemes, any combination can be used to form the alternative embodiment of the present invention, herein no longer Repeat one by one.

It should be noted that：Above-described embodiment provide test report generating means when generating test report, only more than The division progress of each functional module is stated for example, in practical application, can be as needed and by above-mentioned function distribution by difference Functional module complete, i.e., the internal structure of terminal is divided into different functional modules, with complete it is described above whole or Person's partial function.In addition, the test report generating means that above-described embodiment provides belong to test report generation method embodiment Same design, its specific implementation process refer to embodiment of the method, repeated no more here.

Figure 10 is a kind of structural representation of terminal provided in an embodiment of the present invention.The terminal can be used for implementing above-mentioned reality Apply the function performed by the terminal in the test report generation method shown by example.Specifically：

Terminal 1000 can include RF (Radio Frequency, radio frequency) circuit 110, include one or more The memory 120 of computer-readable recording medium, input block 130, display unit 140, sensor 150, voicefrequency circuit 160, Transport module 170, include the part such as one or the processor 180 of more than one processing core and power supply 190.Ability Field technique personnel are appreciated that the restriction of the terminal structure shown in Figure 10 not structure paired terminal, can include than illustrating more More or less parts, either combine some parts or different parts arrangement.Wherein：

RF circuits 110 can be used for receive and send messages or communication process in, the reception and transmission of signal, especially, by base station After downlink information receives, transfer to one or more than one processor 180 is handled；In addition, it is sent to up data are related to Base station.Generally, RF circuits 110 include but is not limited to antenna, at least one amplifier, tuner, one or more oscillators, use Family identity module (SIM) card, transceiver, coupler, LNA (Low Noise Amplifier, low-noise amplifier), duplex Device etc..In addition, RF circuits 110 can also be communicated by radio communication with network and other-end.The radio communication can make With any communication standard or agreement, and including but not limited to GSM (Global System of Mobile communication, entirely Ball mobile communcations system), GPRS (General Packet Radio Service, general packet radio service), CDMA (Code Division Multiple Access, CDMA), WCDMA (Wideband Code Division Multiple Access, WCDMA), LTE (Long Term Evolution, Long Term Evolution), Email, SMS (Short Messaging Service, Short Message Service) etc..

Memory 120 can be used for storage software program and module, the terminal institute as shown by above-mentioned exemplary embodiment Corresponding software program and module, processor 180 are stored in the software program and module of memory 120 by operation, from And various function application and data processing are performed, such as realize the interaction based on video.Memory 120 can mainly include storage Program area and storage data field, wherein, storing program area can storage program area, the application program needed at least one function (such as sound-playing function, image player function etc.) etc.；Storage data field can store to be created according to using for terminal 1000 Data (such as voice data, phone directory etc.) etc..In addition, memory 120 can include high-speed random access memory, may be used also With including nonvolatile memory, for example, at least a disk memory, flush memory device or other volatile solid-states Part.Correspondingly, memory 120 can also include Memory Controller, to provide processor 180 and input block 130 to storage The access of device 120.

Input block 130 can be used for the numeral or character information for receiving input, and generation is set with user and function Control relevant keyboard, mouse, action bars, optics or the input of trace ball signal.Specifically, input block 130 may include to touch Sensitive surfaces 131 and other input terminals 132.Touch sensitive surface 131, also referred to as touch display screen or Trackpad, collect and use Family on or near it touch operation (such as user using any suitable object or annex such as finger, stylus in touch-sensitive table Operation on face 131 or near touch sensitive surface 131), and corresponding linked set is driven according to formula set in advance.It is optional , touch sensitive surface 131 may include both touch detecting apparatus and touch controller.Wherein, touch detecting apparatus detection is used The touch orientation at family, and the signal that touch operation is brought is detected, transmit a signal to touch controller；Touch controller is from touch Touch information is received in detection means, and is converted into contact coordinate, then gives processor 180, and can reception processing device 180 The order sent simultaneously is performed.Furthermore, it is possible to using polytypes such as resistance-type, condenser type, infrared ray and surface acoustic waves Realize touch sensitive surface 131.Except touch sensitive surface 131, input block 130 can also include other input terminals 132.Specifically, Other input terminals 132 can include but is not limited to physical keyboard, function key (such as volume control button, switch key etc.), One or more in trace ball, mouse, action bars etc..

Display unit 140 can be used for display by the information of user's input or be supplied to the information and terminal 1000 of user Various graphical user interface, these graphical user interface can be made up of figure, text, icon, video and its any combination. Display unit 140 may include display panel 141, optionally, can use LCD (Liquid Crystal Display, liquid crystal Show device), the form such as OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) configure display panel 141.Further, touch sensitive surface 131 can cover display panel 141, when touch sensitive surface 131 detects touching on or near it After touching operation, processor 180 is sent to determine the type of touch event, is followed by subsequent processing type of the device 180 according to touch event Corresponding visual output is provided on display panel 141.Although in Fig. 10, touch sensitive surface 131 and display panel 141 are conducts Two independent parts come realize input and input function, but in some embodiments it is possible to by touch sensitive surface 131 with display Panel 141 is integrated and realizes input and output function.

Terminal 1000 may also include at least one sensor 150, such as optical sensor, motion sensor and other sensings Device.Specifically, optical sensor may include ambient light sensor and proximity transducer, wherein, ambient light sensor can be according to environment The light and shade of light adjusts the brightness of display panel 141, and proximity transducer can close display when terminal 1000 is moved in one's ear Panel 141 and/or backlight.As one kind of motion sensor, gravity accelerometer can detect in all directions (generally Three axles) acceleration size, size and the direction of gravity are can detect that when static, available for identification mobile phone posture application (ratio Such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap)；Extremely The other sensors such as the gyroscope that can also configure in terminal 1000, barometer, hygrometer, thermometer, infrared ray sensor, herein Repeat no more.

Voicefrequency circuit 160, loudspeaker 161, microphone 162 can provide the COBBAIF between user and terminal 1000.Sound Electric signal after the voice data received conversion can be transferred to loudspeaker 161, is converted to by loudspeaker 161 by frequency circuit 160 Voice signal exports；On the other hand, the voice signal of collection is converted to electric signal by microphone 162, is received by voicefrequency circuit 160 After be converted to voice data, it is such as another to be sent to through RF circuits 110 then after voice data output processor 180 is handled Terminal, or voice data is exported to memory 120 further to handle.Voicefrequency circuit 160 is also possible that earplug is inserted Hole, to provide the communication of peripheral hardware earphone and terminal 1000.

Terminal 1000 can help user to send and receive e-mail, browse webpage and access streaming matchmaker by transport module 170 Body etc., the broadband internet that it has provided the user wirelessly or non-wirelessly access.Although Figure 10 shows transport module 170, It is understood that itself and be not belonging to must be configured into for terminal 1000, can not change the essence of invention as needed completely In the range of and omit.

Processor 180 is the control centre of terminal 1000, and each portion of whole mobile phone is linked using various interfaces and circuit Point, by running or performing the software program and/or module that are stored in memory 120, and call and be stored in memory 120 Interior data, the various functions and processing data of terminal 1000 are performed, so as to carry out integral monitoring to mobile phone.Optionally, handle Device 180 may include one or more processing cores；Preferably, processor 180 can integrate application processor and modulation /demodulation processing Device, wherein, application processor mainly handles operating system, user interface and application program etc., and modem processor is mainly located Manage radio communication.It is understood that above-mentioned modem processor can not also be integrated into processor 180.

Terminal 1000 also includes the power supply 190 (such as battery) to all parts power supply, it is preferred that power supply can pass through electricity Management system and processor 180 are logically contiguous, so as to realize management charging, electric discharge and power consumption by power-supply management system The functions such as management.Power supply 190 can also include one or more direct current or AC power, recharging system, power supply event The random component such as barrier detection circuit, power supply changeover device or inverter, power supply status indicator.

Although being not shown, terminal 1000 can also include camera, bluetooth module etc., will not be repeated here.Specifically at this In embodiment, the display unit of terminal 1000 is touch-screen display, and terminal 1000 also includes memory, and one or More than one program, one of them or more than one program storage are configured to by one or one in memory Individual above computing device said one or more than one program bag, which contain, is used to implement the performed behaviour of terminal in above-described embodiment The instruction of work.

In the exemplary embodiment, a kind of computer-readable recording medium for being stored with computer program, example are additionally provided The memory of computer program is such as stored with, the computer program realizes that any of above-described embodiment is real when being executed by processor Apply the test report generation method described in example.For example, computer-readable recording medium can be read-only memory (ROM), deposit at random Access to memory (RAM), read-only optical disc (CD-ROM), tape, floppy disk and optical data storage devices etc..

One of ordinary skill in the art will appreciate that hardware can be passed through by realizing all or part of step of above-described embodiment To complete, by program the hardware of correlation can also be instructed to complete, described program can be stored in a kind of computer-readable In storage medium, storage medium mentioned above can be read-only storage, disk or CD etc..

The foregoing is only presently preferred embodiments of the present invention, be not intended to limit the invention, it is all the present invention spirit and Within principle, any modification, equivalent substitution and improvements made etc., it should be included in the scope of the protection.

Claims

1. a kind of test report generation method, it is characterised in that applied in terminal, methods described includes：

Obtain at least one wrong data of the indicated release of application；

Based at least one wrong data, the value-at-risk of the indicated release of the application is calculated, the value-at-risk is for weighing Measure the error situation of the indicated release running of the application；

2. according to the method for claim 1, it is characterised in that at least one mistake of the indicated release for obtaining application Data, including：

Based on first web page address, first named web page is shown；

3. according to the method for claim 1, it is characterised in that it is described to be based at least one wrong data, calculate institute The value-at-risk of the indicated release of application is stated, including：

Obtain at least one predetermined coefficient corresponding at least one errorlevel and at least one errorlevel, it is described extremely Each predetermined coefficient in a few predetermined coefficient is used for the serious conditions for weighing corresponding errorlevel；For described at least one Each errorlevel in errorlevel, obtain wrong data corresponding to errorlevel described at least one wrong data Quantity, obtain the quantity of at least one wrong data；Using at least one predetermined coefficient as weight, to described at least one The quantity of wrong data is weighted summation, as the first value-at-risk；And/or

It is the quantity of the wrong data of menace level to obtain errorlevel at least one wrong data；Calculate the mistake The product of predetermined coefficient corresponding to the quantity of data and the menace level, as the second value-at-risk.

4. according to the method for claim 1, it is characterised in that methods described also includes：

Obtain the first business datum of the indicated release of the application；

Based on first business datum, the first mortality of the indicated release of the application is calculated, first mortality is used In the service fail situation for the indicated release for weighing the application；

5. according to the method for claim 4, it is characterised in that the first business of the indicated release for obtaining the application Data, including：

Obtain the first version number of the indicated release of the application；

6. according to the method for claim 4, it is characterised in that it is described to be based on first business datum, calculate described answer First mortality of indicated release, including：

The ratio between the first service fail number and the first business total degree is calculated, obtains first failure Rate.

7. according to the method for claim 4, it is characterised in that methods described also includes：

Obtain the second business datum of the reference version of application；

Based on second business datum, the second mortality of the reference version of the application is calculated, second mortality is used In the service fail situation for the reference version for weighing the application；

Second mortality and first difference are written to the test report, the test report is additionally operable to record institute State the second mortality and first difference.

8. according to the method for claim 7, it is characterised in that described to write second mortality and first difference Enter to after the test report, methods described also includes：

When first difference is more than first predetermined threshold value, the pattern of first difference is adjusted to the first default sample Formula；Or, when first difference is less than second predetermined threshold value, the pattern of first difference is adjusted to second and preset Pattern, described first the preset style and described second the preset style be used for distinguish whether satisfactory business datum.

9. according to the method for claim 1, it is characterised in that methods described also includes：

Obtain the first delay data of the indicated release of the application；

First delay data is written to the test report, the test report is used to record the first time delay number According to.

10. according to the method for claim 9, it is characterised in that methods described also includes：

Obtain the second delay data of the reference version of application；

Second delay data and second difference are written to the test report, the test report is used to record institute State the second delay data and second difference.

11. according to the method for claim 10, it is characterised in that described by second delay data and described second poor Value is written to after the test report, and methods described also includes：

When second difference is more than three predetermined threshold value, the pattern of second difference is adjusted to the 3rd default sample Formula；Or, when second difference is less than four predetermined threshold value, the pattern of second difference is adjusted to the 4th and preset Pattern, described 3rd the preset style and described 4th the preset style be used for distinguish whether satisfactory delay data.

12. according to the method for claim 1, it is characterised in that methods described also includes：

Obtain the first flow data of the indicated release of the application；

The first flow data are written to the test report, the test report is used to record the first flow number According to.

13. according to the method for claim 12, it is characterised in that methods described also includes：

Obtain the second flow data of the reference version of application；

The second flow data and the 3rd difference are written to the test report, the test report is used to record institute State second flow data and the 3rd difference.

14. according to the method for claim 13, it is characterised in that described by the second flow data and described 3rd poor Value is written to after the test report, and methods described also includes：

When the 3rd difference is more than five predetermined threshold value, the pattern of the 3rd difference is adjusted to the 5th default sample Formula；Or, when the 3rd difference is less than six predetermined threshold value, the pattern of the 3rd difference is adjusted to the 6th and preset Pattern, described 5th the preset style and described 6th the preset style be used for distinguish whether satisfactory data on flows.

15. according to the method for claim 1, it is characterised in that methods described also includes：

Obtain the demand data of the indicated release of the application；

16. according to the method for claim 1, it is characterised in that it is described the value-at-risk is written to test report after, Methods described also includes：

Obtain at least one default email address；

Using the test report as Email attachment；And/or sectional drawing is carried out to the test report, using the sectional drawing as postal Part text；

Mail is sent at least one default email address.

17. according to the method described in claim any one of 1-16, it is characterised in that the indicated release for obtaining application is extremely Before a few wrong data, methods described also includes：

Show that the generation of test report starts the page；

18. a kind of test report generating means, it is characterised in that applied in terminal, described device includes：

Computing module, it is described for based at least one wrong data, calculating the value-at-risk of the indicated release of the application Value-at-risk is used for the error situation for weighing the indicated release running of the application；

Writing module, for the value-at-risk to be written into test report, the test report is used to record the value-at-risk.

19. a kind of terminal, it is characterised in that the terminal includes processor and memory, is stored with least in the memory One instruction, the instruction are loaded by the processor and performed to realize such as any one of claim 1 to claim 17 institute The operation performed by test report generation method stated.

20. a kind of computer-readable recording medium, it is characterised in that at least one instruction, institute are stored with the storage medium Instruction is stated to be loaded as processor and performed to realize that the test report as described in claim 1 to any one of claim 17 generates Operation performed by method.