CN112559369A - Automatic testing method, automatic testing equipment and storage medium - Google Patents
Automatic testing method, automatic testing equipment and storage medium Download PDFInfo
- Publication number
- CN112559369A CN112559369A CN202011540052.XA CN202011540052A CN112559369A CN 112559369 A CN112559369 A CN 112559369A CN 202011540052 A CN202011540052 A CN 202011540052A CN 112559369 A CN112559369 A CN 112559369A
- Authority
- CN
- China
- Prior art keywords
- test
- result file
- correct
- result
- identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 283
- 238000000034 method Methods 0.000 claims abstract description 30
- 238000004590 computer program Methods 0.000 claims description 6
- 239000000463 material Substances 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 2
- 238000002372 labelling Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000012550 audit Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000001915 proofreading effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses an automatic testing method, automatic testing equipment and a storage medium. The method comprises the following steps: acquiring a test picture corresponding to the data report and a correct result file corresponding to the test picture; uploading the test picture to a test server for identification, and receiving an actual result file returned by the test server; comparing the actual result file with the correct result file to obtain a test result; generating a test report based on the test result. According to the method, firstly, the corrected correct result file is obtained, then the correct result file is automatically compared with the actual result file, the test result can be quickly and automatically obtained, manpower, material resources and time are greatly saved, and in addition, the generated test report can visually display the test result.
Description
Technical Field
The embodiment of the invention relates to the technical field of computers, in particular to an automatic testing method, automatic testing equipment and a storage medium.
Background
The intelligent data report recognition platform can recognize characters and numbers in an input data report picture and output recognition results to the excel table. The test end needs to further test the output result to determine whether the output result is correct or not so as to obtain the identification accuracy of the intelligent data report identification platform, and if the identification accuracy is low, the identification accuracy of the intelligent data report identification platform can be improved through algorithm iteration.
In the prior art, the test of the identification result is manually completed, that is, the identification result output by the intelligent data report identification platform is manually compared with a correct data report picture to judge the correctness of the identification result. The use of conventional manual testing has several problems: when the uploading is time-consuming, ten thousand data sets are uploaded to a system in a manual uploading mode, and a large amount of labor and time are consumed; secondly, judging results by time consumption, wherein hundreds of data and tens of thousands of characters are stored in each datagram, and if a manual judgment mode is adopted, a large amount of labor and time are consumed; and thirdly, the statistical result is wrong, and the statistical personnel can easily cause the statistical error due to fatigue under the long-time work, so that the deviation of the statistical result is caused.
Therefore, how to quickly and accurately automatically complete the test of the identification result is a technical problem to be solved at present.
Disclosure of Invention
The embodiment of the invention provides an automatic testing method, equipment and a storage medium, which can quickly and automatically obtain a testing result and greatly save manpower, material resources and time.
In a first aspect, an embodiment of the present invention provides an automated testing method, including:
acquiring a test picture corresponding to the data report and a correct result file corresponding to the test picture;
uploading the test picture to a test server for identification, and receiving an actual result file returned by the test server;
comparing the actual result file with the correct result file to obtain a test result;
generating a test report based on the test result.
In a second aspect, an embodiment of the present invention further provides a terminal device, including:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the automated testing methods described in any of the embodiments of the present invention.
In a third aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement an automated testing method according to any embodiment of the present invention.
The embodiment of the invention provides an automatic test method, equipment and a storage medium, wherein a test picture corresponding to a data report and a correct result file corresponding to the test picture are obtained; then uploading the test picture to a test server for identification, and receiving an actual result file returned by the test server; then comparing the actual result file with the correct result file to obtain a test result; and finally generating a test report based on the test result. According to the technical scheme, the corrected correct result file is obtained firstly, then the correct result file is automatically compared with the actual result file, the test result can be quickly and automatically obtained, manpower, material resources and time are greatly saved, and in addition, the generated test report can visually display the test result.
Drawings
Fig. 1 is a schematic structural diagram of an intelligent identification platform for data reports according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an automated testing platform according to an embodiment of the present invention;
fig. 3 is a schematic flow chart of an automated testing method according to an embodiment of the present invention;
fig. 4 is an exemplary flowchart of an automatic testing method according to a second embodiment of the present invention; (ii) a
FIG. 5 is a first internal logic diagram of an automated testing method according to a second embodiment of the present invention;
fig. 6 is an exemplary flowchart of an automatic testing method according to a second embodiment of the present invention;
fig. 7 is a schematic structural diagram of a terminal device according to a third embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like. In addition, the embodiments and features of the embodiments in the present invention may be combined with each other without conflict.
The term "include" and variations thereof as used herein are intended to be open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment".
Example one
Fig. 1 is a schematic structural diagram of an intelligent data report recognition platform according to an embodiment of the present invention, where the intelligent data report recognition platform is a platform for intelligently recognizing an asset balance sheet, a profit sheet, and a cash flow sheet, and as shown in fig. 1, the platform is implemented based on a browser and a server architecture mode, that is, a data report picture in a format of jpg or pdf is uploaded to a server through the browser, and the server recognizes characters and numbers in the data report picture and outputs a recognition result to an excel for downloading by the browser.
Fig. 2 is a schematic structural diagram of an automated testing platform according to an embodiment of the present invention, where the automated testing platform is a platform for testing the accuracy of the identification result, and the automated testing platform is used at a testing end, and an identification algorithm used by a data report intelligent identification platform may be updated and iterated according to the test result of the automated testing platform, so that the identification accuracy of the data report intelligent identification platform is improved to meet an identification standard.
As shown in fig. 2, the automated testing platform is implemented based on a testing tool and a testing server architecture mode, that is, a testing tool at a local PC terminal uploads a data report picture in a format of jpg or pdf to a testing server, the testing server identifies characters and numbers in the data report picture, and then outputs an identification result to an excel for a client to download.
The automatic test platform simulates the intelligent data report recognition platform at the test end, so that the data report can be recognized, and the reliability of the recognition result is ensured, thereby ensuring the reliability of the test result. The automatic test platform saves the time of browser operation and page loading, and obviously improves the efficiency under the condition of uploading mass data.
Fig. 3 is a schematic flow chart of an automated testing method according to an embodiment of the present invention, where the method is applicable to a situation where a testing end tests the recognition accuracy of an intelligent data report recognition platform, and the method may be executed by an automated testing apparatus, where the apparatus may be implemented by software and/or hardware and is generally integrated on a terminal device, where in this embodiment, the terminal device includes but is not limited to: an automated testing platform.
As shown in fig. 1, an automated testing method provided in an embodiment of the present invention includes the following steps:
s110, obtaining a test picture corresponding to the data report and a correct result file corresponding to the test picture.
The data report may be any type of report, and in this embodiment, the data report may include a financial report. For example, the data report may include various types of data reports such as a balance sheet, a profit sheet, and a cash flow sheet, wherein the type of the data report is not particularly limited.
The test pictures may include pictures corresponding to the data reports in various different scenes, and it may be understood that different test pictures include different scenes, and for example, the test pictures may be a scene with an interference line and a non-interference line, a scene with a black stamp and a non-black stamp, and a scene with a frame and a non-frame.
The correct result file may be an excel form file including correct identification information, and specifically, an excel form may be output after a test picture is input to the test server, and the correct result file may be obtained by performing collation and correction on information in the excel form.
It should be noted that the test pictures belonging to the same category may correspond to a correct result file, and the correct result file is stored in the test tool, so that the identification result is verified according to the correct result file in the following.
In this embodiment, after the test pictures are obtained, the test pictures may be classified according to different scenes and stored in different folders, an initial result file may be obtained according to the test pictures of the same category, that is, the test pictures in the same folder, and a correct result file may be obtained according to the initial result file.
Specifically, obtaining the test picture corresponding to the data report includes: classifying the test pictures corresponding to the data report according to the test scenes; and storing the test pictures belonging to the same category into the same folder.
Illustratively, if the influence of interference lines on the identification accuracy is tested, data report pictures with interference lines and interference lines can be selected as test pictures and are respectively and correspondingly stored in different folders. Therefore, the identification accuracy of various types of test pictures can be obtained. And determining influence factors of the test result according to the category of the test picture and the identification accuracy of the test picture.
Specifically, obtaining a correct result file corresponding to the test picture includes: uploading the test picture to the test server for identification to obtain an initial result file; and checking the initial result file to obtain a correct result file.
The test server can be a server in the automatic test platform, and the test server can identify the test picture to obtain an excel table corresponding to the test picture.
The initial result file may be an identification result file obtained after the test picture is first input into the automated test platform, and the initial result file may be an excel table obtained after identification is performed according to the test picture. The initial results file may include an excel table.
In this embodiment, the test server may perform a calibration on the initial result file to obtain a correct result file.
Specifically, the checking the initial recognition result file includes: checking the initial result file based on the hooking and checking relation of the data report; and/or, checking the characters and the numbers in the initial result file according to the test picture.
The relevant numbers in the cross-checking relation index data report table have a relation which can be checked and examined mutually. In this embodiment, the total amount in the initial result file can be checked by using the checking relationship.
Optionally, the process of checking the initial identification result file may be divided into two parts, wherein the first part is to automatically check the total data in the initial identification result file based on the audit relationship; the second part is to collate the characters and numbers in the initial result file.
The testing server can automatically check whether the total amount in the initial result file is correct or not by using the checking relationship. For example, if the amounts of short-term loan, accounts payable, and the like are described in the excel table of the initial result file, the total liability is the sum of the amounts.
Wherein, the comparison of the characters and the numbers in the initial result file is manually performed. The content in the initial result file is compared with the test pictures corresponding to the initial result file one by one, and the error content in the initial result file is corrected according to the content on the test pictures to obtain a correct result file.
It should be noted that a test picture of one category may obtain a correct result file after being first input into the test server, and the correct result file is stored in the local folder.
It should be further noted that the correct result file is only required to be obtained before the test picture is subjected to the automated test for the first time, and if the test algorithm in the test tool is updated and iterated, the correct result file is obtained without repeating the above process again when the test algorithm after the update and iteration is used for performing the automated test.
And S120, uploading the test picture to a test server for identification, and receiving an actual result file returned by the test server.
The actual result file may be an excel form, which is an identification result obtained after the test picture is input into the test server, and the actual result file may be stored in the local folder after being obtained.
In this embodiment, the test pictures of the same category are uploaded to an automated test platform, and a test server in the automated test platform may identify the test pictures to obtain an actual result file, and return the actual result file to a client, that is, store the actual result file in a local folder. The client can be understood as a local PC side.
Specifically, receiving the actual result file returned by the test server includes: sending a query instruction to the test server at every interval of first set time; when receiving identification completion information returned by the test server, sending a downloading instruction to the test server, so that the server sends an actual result file to a client according to the downloading instruction; and receiving an actual result file returned by the test server.
The first set time may be a preset time value. For example, the first set time may be 0.1 s.
The query instruction may be a signal sent by the client, and the query instruction may be understood as an instruction for querying whether the test server completes the identification of the test picture.
The identification completion information may represent that the test server completes identification of the test picture.
The downloading instruction may be a signal sent by the client, and the downloading instruction may be understood as downloading an actual result file by the client.
And S130, comparing the actual result file with the correct result file to obtain a test result.
The test result may be a result output by the test server. For example, the test result may include the recognition rate of the text content in the actual result file, and the recognition rate of the digital content in the actual result file.
Comparing the actual result file of the test picture with the correct result file to obtain the test result can be understood as: the testing tool compares the numbers and characters included in the actual result file with the numbers and characters included in the correct result file one by one, determines the number of wrong characters and numbers in the actual result file, and determines the testing result according to the number of wrong characters and the number of wrong numbers.
Optionally, the actual result file and the correct result file both include a plurality of cells, and the cells of the actual result file and the correct result file are in one-to-one correspondence.
The cells can be understood as cells in an excel table, and both the actual result file and the correct result file can be excel tables. The cells in the two excel tables may correspond one to one.
Specifically, the comparing the actual result file with the correct result file to obtain the test result includes: comparing the contents contained in the actual result file and the correct result file one by one, and determining the content identification rate according to the comparison result; and determining the content identification rate as a test result.
The content recognition rate may be understood as the recognition accuracy of the actual result file, and the content recognition rate may include a character recognition rate and a number recognition rate. The character recognition rate can be understood as the accuracy rate obtained by recognizing characters in an actual result file. The number recognition rate can be understood as the accuracy rate of recognizing the numbers in the actual result file.
In this embodiment, the comparison result may be obtained by comparing the characters and the numbers included in the actual result file, and the comparison result may include a character recognition rate and a number recognition rate, where the content recognition rate is the test result.
Specifically, determining the content identification rate according to the comparison result includes: if the content contained in the compared cell is the character and the comparison result is correct, accumulating the correct number of the character by 1; if the content contained in the compared cells is a number and the comparison result is correct, accumulating the number correct number by 1; determining the character recognition rate according to the correct number of the characters and the number of the characters contained in the actual result file; and determining the digital recognition rate according to the digital correct number and the digital number contained in the actual result file.
The determination process of the character recognition rate may be: dividing the accumulated correct number of the characters by the total number of all the characters in the actual result file to obtain the character recognition rate; the determination process of the number recognition rate may be: the word recognition rate can be obtained by dividing the accumulated correct number of digits by the total number of all digits included in the actual result file.
And S140, generating a test report based on the test result.
Further, when the test picture comprises a plurality of pictures, the sample identification rate is determined according to the content identification rate of each test picture.
The sample identification rate may be an identification accuracy of the actual result file, and the determination process of the sample identification rate may be: and taking the ratio of the actual result file with correct identification to the total actual result file as the sample identification rate of the type of test picture, namely dividing the sample correct number by the total number of samples to obtain the sample identification rate, wherein the samples are the actual result file.
In this embodiment, a content recognition rate may be determined based on the test results, a sample recognition rate may be determined based on the content recognition rate, and a test report may be generated based on the content recognition rate and the sample recognition rate. Since the content recognition rate may include a character recognition rate and a number recognition rate of the actual result file, a sample recognition rate of the actual result file may be determined according to the content recognition rate.
The test report may be a report of multiple versions, and in this embodiment, the content of the test report of different versions is different. A version of the test report may include one or more of the following: literal correct number, literal incorrect number, numeric correct number, numeric incorrect number, literal recognition rate, numeric recognition rate, sample incorrect number, sample correct number, and sample recognition rate.
Table 1 is a test report provided in the first embodiment of the present invention, and for example, as shown in table 1, the test report includes a text correct number, a text error number, a number correct number, a number error number, a text recognition rate, a number recognition rate, a sample error number, a sample correct number, and a sample recognition rate, and a test result can be visually and clearly reflected according to the test report.
TABLE 1
| Correct number of characters | Number of text errors | Rate of character recognition |
| 99 | 10 | 99％ |
| Number correct number | Number of digital errors | Rate of digit recognition |
| 95 | 5 | 95％ |
| Correct number of samples | Number of sample errors | Sample recognition rate |
| 92 | 8 | 92％ |
The automated testing method provided by the embodiment of the invention comprises the following steps of firstly, obtaining a test picture corresponding to a data report and a correct result file corresponding to the test picture; secondly, uploading the test picture to a test server for identification, and receiving an actual result file returned by the test server; then comparing the actual result file with the correct result file to obtain a test result; and finally generating a test report based on the test result. According to the method, firstly, the corrected correct result file is obtained, then the correct result file is automatically compared with the actual result file, the test result can be quickly and automatically obtained, manpower, material resources and time are greatly saved, and in addition, the generated test report can visually display the test result.
Example two
Two general flows of an automatic testing method provided by the first embodiment of the present invention are exemplarily described in the embodiment of the present invention, and fig. 4 is an exemplary flow chart of an automatic testing method provided by the second embodiment of the present invention.
As shown in fig. 4, the automated testing method may include the steps of:
step 1, obtaining a test picture, and selecting and classifying pictures corresponding to the data report to obtain the test picture.
And 2, acquiring an initial result file, and inputting the test picture into a test server to obtain the initial result file.
And 3, judging whether the initial result file is marked, namely whether the initial result file is marked as a correct result file after proofreading and correction.
Step 4, if yes, uploading the test picture to a test server, and downloading and identifying an obtained actual result file; if not, marking the initial result file, namely, checking the initial identification result file to obtain a correct result file.
And 5, determining a test result, namely comparing the actual result file with the correct result file to obtain the test result.
And 6, issuing a test report, namely generating the test report based on the test result.
And 7, performing iterative upgrade on the test algorithm according to the identification result of the test report, and redeploying the iteratively upgraded test algorithm in the test tool.
And 8, re-executing the steps to carry out the steps 2-7 on the test picture according to the iterated test algorithm until the test result in the test report reaches a standard value, and ending the test.
Fig. 5 is a first internal logic diagram of an automated testing method according to a second embodiment of the present invention, and as shown in fig. 5, for example, a detailed process of uploading the test chart to a test server for identification and receiving an actual result file returned by the test server may include the following steps:
step 1, obtaining a test picture, sending an uploading instruction by a test tool in an automatic test platform, and uploading the test picture under an appointed path to a test server.
And 2, circularly sending a query instruction to the test server at intervals of a first set time, and querying whether the test server completes the identification of the test picture.
And 3, if the identification is finished, namely the identification finishing information returned by the test server is received, sending a downloading instruction to the test server, and downloading the identified actual result file to the client.
Step 4, if the identification is not finished, namely the identification finishing information returned by the test server is not received, judging whether the accumulated identification time exceeds a second set time, and if the accumulated identification time does not exceed the second set time, continuing to execute the step 2; and if the second set time is exceeded, determining that the test picture identification fails.
And 5, after the actual result file is downloaded or the test picture identification fails, re-uploading the next test picture, namely re-executing the steps 1-4 until all the test pictures in the category are identified.
Wherein different classes of test pictures are stored in folders under different paths within the test tool. The second set time may be a preset time value, and for example, the second set time may be 10 s.
Fig. 6 is a second internal logic diagram of an automated testing method according to a second embodiment of the present invention. For example, the test tool may find out the correct result file and the actual result file stored in the test tool by searching "folder name + test picture name". As shown in fig. 6, the logic for comparing the actual result file with the correct result file is as follows:
step 1, comparing the actual result file with the correct result file one by one, and judging that the content in the first cell in the actual result file is a Chinese character or a number.
If one cell contains both numbers and Chinese characters, the content of the cell is judged as the Chinese character, and when one cell only contains the numbers, the content of the cell is judged as the numbers.
And 2, comparing the first cell of the actual result file with the first cell in the correct result file, if the contents are completely consistent, identifying the contents in the cell correctly, and otherwise, identifying the contents incorrectly.
Step 3, if the cell content is Chinese character and the identification is correct, adding 1 to the correct number of the corresponding Chinese character; if the cell content is a number and the identification is correct, adding 1 to the correct number of the corresponding number; if the cell content is Chinese character and the identification is wrong, adding 1 to the corresponding Chinese character error number; if the cell content is a number and an error is identified, the corresponding number of errors is incremented by 1.
And 4, circulating the steps 1-3, and completing comparison of all units in the actual result file to obtain the number of all correct Chinese characters, the number of error Chinese characters, the number of correct digits and the number of error digits in the actual result file 1.
And 5, if all characters and numbers included in the actual result file are completely correct, the recognition result file recognizes correctly, the number of correctly recognized total sheets is increased by 1, and otherwise, the number of incorrectly recognized total sheets is increased by 1.
And 6, circulating the steps 1-5 until all the actual result files are compared.
The automatic testing method provided by the embodiment of the invention provides an automatic solution for the problem that a large amount of manpower and time are consumed for a pure manual test when the accuracy of algorithm identification is tested by the intelligent data report identification platform, so that the testing efficiency is improved, and the result deviation caused by manual operation errors is reduced. On the other hand, for products based on the browser and the server architecture, the method can skip the operation of the browser, directly sends instructions to perform interface interaction with the server, and can obviously improve the efficiency during large-batch data processing. In addition, the hook-check relation is used for verifying the basic file of the labeling result in the testing process, so that the workload of the labeling process is greatly reduced.
EXAMPLE III
Fig. 7 is a schematic structural diagram of a terminal device according to a third embodiment of the present invention. As shown in fig. 7, a terminal device provided in the third embodiment of the present invention includes: one or more processors 71 and storage 72; the processor 71 in the terminal device may be one or more, and one processor 71 is taken as an example in fig. 7; the storage device 72 is used to store one or more programs; the one or more programs are executed by the one or more processors 71, such that the one or more processors 71 implement the automated testing method of any of the embodiments of the present invention.
The terminal device may further include: an input device 73 and an output device 74.
The processor 71, the storage device 72, the input device 73 and the output device 74 in the terminal equipment may be connected by a bus or other means, and the connection by the bus is exemplified in fig. 7.
The storage device 72 in the terminal device serves as a computer-readable storage medium, and can be used to store one or more programs, which may be software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the automated testing method provided in the first embodiment of the present invention. The processor 71 executes various functional applications and data processing of the terminal device by running software programs, instructions and modules stored in the storage device 72, that is, the automated testing method in the above-described method embodiment is implemented.
The storage device 72 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal device, and the like. Further, the storage device 72 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the storage 72 may further include memory located remotely from the processor 71, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 73 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the terminal device. The output device 74 may include a display device such as a display screen.
And, when the one or more programs included in the above-mentioned terminal device are executed by the one or more processors 71, the programs perform the following operations:
acquiring a test picture corresponding to the data report and a correct result file corresponding to the test picture;
uploading the test picture to a test server for identification, and receiving an actual result file returned by the test server;
comparing the actual result file with the correct result file to obtain a test result;
generating a test report based on the test result.
Example four
A fourth embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program is used to execute an automated testing method when executed by a processor, and the method includes:
acquiring a test picture corresponding to the data report and a correct result file corresponding to the test picture;
uploading the test picture to a test server for identification, and receiving an actual result file returned by the test server;
comparing the actual result file with the correct result file to obtain a test result;
generating a test report based on the test result.
Optionally, the program, when executed by the processor, may be further configured to perform an automated testing method provided by any of the embodiments of the present invention.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM), a flash Memory, an optical fiber, a portable CD-ROM, an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. A computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take a variety of forms, including, but not limited to: an electromagnetic signal, an optical signal, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, Radio Frequency (RF), etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. An automated testing method, comprising:
acquiring a test picture corresponding to the data report and a correct result file corresponding to the test picture;
uploading the test picture to a test server for identification, and receiving an actual result file returned by the test server;
comparing the actual result file with the correct result file to obtain a test result;
generating a test report based on the test result.
2. The method according to claim 1, wherein the obtaining of the test picture corresponding to the data report comprises:
classifying the test pictures corresponding to the data report according to the test scenes;
and storing the test pictures belonging to the same category into the same folder.
3. The method of claim 1, wherein obtaining the correct result file corresponding to the test picture comprises:
uploading the test picture to the test server for identification to obtain an initial result file;
and checking the initial result file to obtain a correct result file.
4. The method of claim 3, wherein the checking the initial recognition result file comprises:
checking the initial result file based on the hooking and checking relation of the data report; and/or the presence of a gas in the gas,
and checking the characters and the numbers in the initial result file according to the test picture.
5. The method of claim 1, wherein receiving the actual result file returned by the test server comprises:
sending a query instruction to the test server at every interval of first set time;
when receiving identification completion information returned by the test server, sending a downloading instruction to the test server, so that the server sends an actual result file to a client according to the downloading instruction;
and receiving an actual result file returned by the test server.
6. The method of claim 1, wherein the actual result file and the correct result file each comprise a plurality of cells, and the cells of the actual result file and the correct result file are in one-to-one correspondence; comparing the actual result file with the correct result file to obtain a test result, wherein the test result comprises the following steps:
comparing the contents contained in the actual result file and the correct result file one by one, and determining the content identification rate according to the comparison result; the content recognition rate comprises a character recognition rate and a number recognition rate;
and determining the content identification rate as a test result.
7. The method of claim 6, wherein comparing the actual result file with the correct result file one by one, and determining a content recognition rate according to the comparison result comprises:
if the content contained in the compared cell is the character and the comparison result is correct, accumulating the correct number of the character by 1;
if the content contained in the compared cells is a number and the comparison result is correct, accumulating the number correct number by 1;
determining the character recognition rate according to the correct number of the characters and the number of the characters contained in the actual result file;
and determining the digital recognition rate according to the digital correct number and the digital number contained in the actual result file.
8. The method according to claim 7, wherein when the test picture comprises a plurality of pictures, the sample identification rate is determined according to the content identification rate of each test picture;
correspondingly, generating a test report based on the test result comprises:
generating a test report based on the content recognition rate and the sample recognition rate.
9. A terminal device, comprising:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the automated testing method of any of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out an automated testing method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011540052.XA CN112559369A (en) | 2020-12-23 | 2020-12-23 | Automatic testing method, automatic testing equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011540052.XA CN112559369A (en) | 2020-12-23 | 2020-12-23 | Automatic testing method, automatic testing equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112559369A true CN112559369A (en) | 2021-03-26 |
Family
ID=75031591
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011540052.XA Pending CN112559369A (en) | 2020-12-23 | 2020-12-23 | Automatic testing method, automatic testing equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112559369A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113485921A (en) * | 2021-06-30 | 2021-10-08 | 网易（杭州）网络有限公司 | File system test method, device, equipment and storage medium |
| WO2022213466A1 (en) * | 2021-04-08 | 2022-10-13 | 平安科技（深圳）有限公司 | Method and apparatus for intelligent proofreading of recognition result, and device and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001005804A (en) * | 1999-06-18 | 2001-01-12 | Toshiba Corp | Data base registering method utilizing character recognizing device |
| CN110516663A (en) * | 2019-07-15 | 2019-11-29 | 平安普惠企业管理有限公司 | Test method, device, computer equipment and the storage medium of OCR recognition accuracy |
| CN110705651A (en) * | 2019-10-17 | 2020-01-17 | 上海眼控科技股份有限公司 | Method, device, equipment and medium for testing video identification accuracy |
-
2020
- 2020-12-23 CN CN202011540052.XA patent/CN112559369A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001005804A (en) * | 1999-06-18 | 2001-01-12 | Toshiba Corp | Data base registering method utilizing character recognizing device |
| CN110516663A (en) * | 2019-07-15 | 2019-11-29 | 平安普惠企业管理有限公司 | Test method, device, computer equipment and the storage medium of OCR recognition accuracy |
| CN110705651A (en) * | 2019-10-17 | 2020-01-17 | 上海眼控科技股份有限公司 | Method, device, equipment and medium for testing video identification accuracy |
Non-Patent Citations (1)
| Title |
|---|
| 陆海翔;姚龙海;: "雷达对抗侦察装备自动测试中的界面识别研究", 计算机测量与控制, no. 07, 25 July 2012 (2012-07-25), pages 159 - 161 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022213466A1 (en) * | 2021-04-08 | 2022-10-13 | 平安科技（深圳）有限公司 | Method and apparatus for intelligent proofreading of recognition result, and device and storage medium |
| CN113485921A (en) * | 2021-06-30 | 2021-10-08 | 网易（杭州）网络有限公司 | File system test method, device, equipment and storage medium |
| CN113485921B (en) * | 2021-06-30 | 2023-08-08 | 网易（杭州）网络有限公司 | File system testing method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111522942B (en) | Training method and device for text classification model, storage medium and computer equipment | |
| CN113656404A (en) | Data verification method and device, computer equipment and storage medium | |
| CN112559369A (en) | Automatic testing method, automatic testing equipment and storage medium | |
| CN110096430B (en) | Third party SDK access test method, device, terminal and storage medium | |
| CN113672520B (en) | Test case generation method and device, electronic equipment and storage medium | |
| CN110688536A (en) | Label prediction method, device, equipment and storage medium | |
| CN109872230B (en) | Test method and device of financial data analysis system, medium and electronic equipment | |
| CN111522741A (en) | Interface test code generation method and device, electronic equipment and readable storage medium | |
| CN112711640A (en) | Method and device for configuring business handling process | |
| CN113448869B (en) | Method and device for generating test case, electronic equipment and computer readable medium | |
| CN112395182A (en) | Automatic testing method, device, equipment and computer readable storage medium | |
| CN117806981A (en) | CFD software automatic testing method and system | |
| CN113434405A (en) | Method and device for determining test file, storage medium and electronic device | |
| CN116431522A (en) | Automatic test method and system for low-code object storage gateway | |
| CN116627804A (en) | Test method, system, electronic equipment and storage medium based on artificial intelligence | |
| CN113778875B (en) | System test defect classification method, device, equipment and storage medium | |
| CN113220594B (en) | Automatic test method, device, equipment and storage medium | |
| CN113238940B (en) | Interface test result comparison method, device, equipment and storage medium | |
| CN115168217A (en) | Defect discovery method and device for source code file | |
| CN115543816A (en) | Software regression test result verification method, device, equipment and storage medium | |
| CN114721943A (en) | Method and device for determining test range | |
| CN114841663A (en) | Verification method, device and equipment for installation quality of GPS equipment and storage medium | |
| CN110532186B (en) | Method, device, electronic equipment and storage medium for testing by using verification code | |
| CN114020642A (en) | Big data task testing method and device, storage medium and electronic equipment | |
| CN112882937A (en) | Test case processing method and device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |