CN104503910A - Product test method by monitoring users' using behavior - Google Patents
Product test method by monitoring users' using behavior Download PDFInfo
- Publication number
- CN104503910A CN104503910A CN201410802578.9A CN201410802578A CN104503910A CN 104503910 A CN104503910 A CN 104503910A CN 201410802578 A CN201410802578 A CN 201410802578A CN 104503910 A CN104503910 A CN 104503910A
- Authority
- CN
- China
- Prior art keywords
- test
- software
- function
- product
- tests
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a product test method by monitoring users' using behavior. The product test method includes completing a software development and coming online a test, encoding an independent function monitoring module for capturing business and status parameter when operating and recording log, integrating a statistic function module to the software, defining a test list according to demand by a tester and processing tests, collecting and monitoring the using details and status of each function of the software by the function monitoring module when the software operates, and doing statistical analysis to the collected data by a server and displaying the performance of each product function. The product test method collects the business information and status information, the using occasions of the software is completely reappeared, and thus the problem of low treatment efficiency because of inaccurate description of faults by users is resolved. Tolerance thresholds are set, non discovered problems in tests can be automatically discovered, and the test list is supplemented and optimized. The server can filter information according to rule configuration and the work load of follow-up people is reduced.
Description
Technical field
The present invention relates to software test field, concrete, relate to a kind of method of being tested on the impact of software performance thus to product by monitor user ' usage behavior.
Background technology
In prior art, the test process of product, be all have more understanding to product by related personnel, artificial enumeration test use-case, as finally checking and accepting basis.And along with the becoming increasingly complex of product, this mode workload of manually enumerating becomes increasing, and the scene be missed of correspondence gets more and more, and this is wherein no lack of the serious bug affecting product work.Therefore, need certain methods, just discovery more early addressing these problems.
In addition, the failure problems that the most directly can find software is often used user, but because terminal user is unprofessional for the description of product bug, cannot more adequately determine or reproduce during user uses the fault occurred, thus correctly, efficiently cannot improve problem.
Therefore, how to find from the angle of user's use, to reproduce fault, and further, for test when early stage, product was reached the standard grade provides element and data, and then find new test item, become the technical matters that prior art needs solution badly.
Summary of the invention
The object of the invention is to propose a kind of method of being tested product by monitor user ' usage behavior, make it possible to the scene in intactly reconstruction software use, and find new test event, improve test list.
For reaching this object, the present invention by the following technical solutions:
By the method that monitor user ' usage behavior is tested product, comprise the steps:
Step S110, software development completes, and can reach the standard grade for test;
Step S120, writes independently function monitoring module, charge capture run time business and state parameter and be responsible for log;
Step S130, is integrated in described software by described function statistical module;
Step S150, in software running process, the details that described function monitoring module acquires and each function of monitoring of software use and state;
Step S160, server does statistical study to the data collected, and presents the performance of each product function.
Preferably, between described step S130 and step S150, also have step S140, tester enumerates according to demand, and definition test list, writes test case, test, after test completion, and use that software is reached the standard grade; After step S160, also have step S170, test and product personnel according to the statistic analysis result of step S160, can improve test list, test for follow-up new product.
Preferably, in step S160, when server does statistical study to the data collected, the tolerance threshold of each function can be defined when exceeding tolerance threshold, can automatic recording function problem.
Preferably, in the step s 120, described business and state parameter comprise running software time, the resource consumed and network parameter.
Preferably, the described business that described function monitoring module is monitored and state parameter, according to rule configuration, to carry out information filtering, and according to concerned issue difference, can carry out Different Strategies configuration.
Preferably, in step S140, when test list is tested, successively single test point is tested, if do not passed through, then update routine re-starts the test of this test point, if by, judge whether all tests, if do not complete all tests, the test of the test point then do not completed, if completed all tests, then product is issued, for user.
Therefore, the present invention is monitored function by stuck-module, capturing service information and status information, can complete reconstruction software use scenes, more careful than general statistics, avoids because client is inaccurate and cause the low for the treatment of effeciency for fault statement.Can tolerance threshold be set, automatically find the problem not having in test to find, with supplementary optimal inspection list, the test of new product is optimized.According to rule configuration, information filtering can be carried out at server end, different according to concerned issue, can Different Strategies configuration be carried out, reduce person works's amount of follow-up, can deal with problems more efficiently.
Accompanying drawing explanation
Fig. 1 be according to a specific embodiment of the present invention by the process flow diagram of monitor user ' usage behavior to the method that product is tested;
Fig. 2 be according to another specific embodiment of the present invention by the process flow diagram of monitor user ' usage behavior to the method that product is tested.
Embodiment
Below in conjunction with drawings and Examples, the present invention is described in further detail.Be understandable that, specific embodiment described herein is only for explaining the present invention, but not limitation of the invention.It also should be noted that, for convenience of description, illustrate only part related to the present invention in accompanying drawing but not entire infrastructure.
See accompanying drawing 1, show according to a specific embodiment of the present invention by the process flow diagram of monitor user ' usage behavior to the method that product is tested, comprise the steps:
Step S110, software development completes, and can reach the standard grade for test;
Step S120, writes independently function monitoring module, charge capture run time business and state parameter and be responsible for log;
Step S130, is integrated in described software by described function statistical module;
Step S150, in software running process, the details that described function monitoring module acquires and each function of monitoring of software use and state;
Step S160, server does statistical study to the data collected, and presents the performance of each product function, such as.As the execution time, resource occupation etc.
Therefore, by inserting function monitoring module in software, and in real time capturing service run time business and state parameter, the various use procedures of user are made to also become a kind of test of reality, and by the result record faithfully of test, problem at that time can be reproduced by recorded data well when pinpointing the problems, thus be further test, or amendment provide parameter.
Preferably, between described step S130 and step S150, also have step S140, tester enumerates according to demand, and definition test list, writes test case, test, after test completion, and use that software is reached the standard grade;
After step S160, also have step S170, test and product personnel according to the statistic analysis result of step S160, can improve test list, test for follow-up new product.
Therefore, above-mentioned functions monitoring modular can provide material for new test case, avoids the not comprehensive of artificial selected test case, thus realizes a kind of method of being supplemented discovery test case by user's usage behavior.
Further preferably, in the step s 120, described business and state parameter comprise running software time, the resource consumed, network parameter etc.
Further preferably, in step S160, when server does statistical study to the data collected, the tolerance threshold of each function can be defined, such as, the page presentation time whether more than 1 second, when exceeding tolerance threshold, can automatic recording function problem.Therefore, it is possible to have scene accurately for problem, problem can be reappeared for tester, and retrofit testing work.
Further preferably, the described business that described function monitoring module is monitored and state parameter, can according to rule configuration, to carry out information filtering, and different according to concerned issue, carry out Different Strategies configuration, person works's amount of follow-up can be reduced like this, can deal with problems more efficiently.
See Fig. 2, show another specific embodiment by the process flow diagram of monitor user ' usage behavior to the method that product is tested, its further refinement step of product test,
In step S140, when test list is tested, test single test point successively, if do not passed through, then update routine re-starts the test of this test point, if by, judge whether all tests, if do not complete all tests, then the test of the test point do not completed, if completed all tests, then product is issued, for user.
In step S170, so-called improving tests list, turns back in other words in step S140, redefines test list, thus test in the testing procedure of new product.
Specifically: for the software of such as video website, a lot of page is all customize (as channel page, broadcast page, list page etc.).This kind of page is thousands of, does all tests and unrealistic.Meanwhile, because the customization of the page, be namely different (as page drawer numbers, page layout, load mode etc.) in function combination.Therefore, sampling Test coverage is incomplete, can cause problem test leakage.And these problems can only find after reaching the standard grade, and are generally fed back by Customer Service people.
And the present invention, in order to address this problem, do 2 improvement.1, software layer increases special function monitoring module, and to business information when each function is called when running, and running status (time, resource, network etc.) does comprehensive record.2. based on above data, by defining the tolerance threshold (within page presentation 1s) of each function, energy is discovery feature problem automatically, and has scene accurately, can reappear problem for tester, and retrofit testing work.
Therefore, tool of the present invention has the following advantages:
1, capturing service information and status information, can complete reconstruction software use scenes, more careful than general statistics, avoids because client is inaccurate and cause the low for the treatment of effeciency for fault statement.
2. can set tolerance threshold, automatically find the problem not having in test to find, with supplementary optimal inspection list, the test of new product is optimized.
3. software view, is realized by stuck-module, more unified standard, avoids collection result factor data quality problems to cause erroneous judgement
4, according to rule configuration, information filtering can be carried out at server end, different according to concerned issue, can Different Strategies configuration be carried out, reduce person works's amount of follow-up, can deal with problems more efficiently;
Above content is in conjunction with concrete preferred implementation further description made for the present invention; can not assert that the specific embodiment of the present invention is only limitted to this; for general technical staff of the technical field of the invention; without departing from the inventive concept of the premise; some simple deduction or replace can also be made, all should be considered as belonging to the present invention by submitted to claims determination protection domain.
Claims (6)
1., by the method that monitor user ' usage behavior is tested product, comprise the steps:
Step S110, software development completes, and can reach the standard grade for test;
Step S120, writes independently function monitoring module, charge capture run time business and state parameter and be responsible for log;
Step S130, is integrated in described software by described function statistical module;
Step S150, in software running process, the details that described function monitoring module acquires and each function of monitoring of software use and state;
Step S160, server does statistical study to the data collected, and presents the performance of each product function.
2. method according to claim 1, is characterized in that:
Between described step S130 and step S150, also have step S140, tester enumerates according to demand, and definition test list, writes test case, test, after test completion, and use that software is reached the standard grade;
After step S160, also have step S170, test and product personnel according to the statistic analysis result of step S160, can improve test list, test for follow-up new product.
3. method according to claim 1 and 2, is characterized in that:
In step S160, when server does statistical study to the data collected, the tolerance threshold of each function can be defined when exceeding tolerance threshold, can automatic recording function problem.
4. method according to claim 3, is characterized in that:
In the step s 120, described business and state parameter comprise running software time, the resource consumed and network parameter.
5. method according to claim 3, is characterized in that:
The described business that described function monitoring module is monitored and state parameter, according to rule configuration, to carry out information filtering, and according to concerned issue difference, can carry out Different Strategies configuration.
6. according to claim 3, it is characterized in that:
In step S140, when test list is tested, test single test point successively, if do not passed through, then update routine re-starts the test of this test point, if by, judge whether all tests, if do not complete all tests, then the test of the test point do not completed, if completed all tests, then product is issued, for user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410802578.9A CN104503910A (en) | 2014-12-22 | 2014-12-22 | Product test method by monitoring users' using behavior |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410802578.9A CN104503910A (en) | 2014-12-22 | 2014-12-22 | Product test method by monitoring users' using behavior |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104503910A true CN104503910A (en) | 2015-04-08 |
Family
ID=52945309
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410802578.9A Pending CN104503910A (en) | 2014-12-22 | 2014-12-22 | Product test method by monitoring users' using behavior |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104503910A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104965775A (en) * | 2015-04-23 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Reconstruction method for application software fault site, server, and terminal |
| CN105095081A (en) * | 2015-08-06 | 2015-11-25 | 小米科技有限责任公司 | Application program function testing method and device |
| CN105630658A (en) * | 2015-12-22 | 2016-06-01 | 北京奇虎科技有限公司 | Data processing method and data processing device |
| CN105930258A (en) * | 2015-11-13 | 2016-09-07 | 中国银联股份有限公司 | Parameter filtering method and apparatus |
| CN106294124A (en) * | 2016-07-21 | 2017-01-04 | 北京金山安全软件有限公司 | Application product test configuration method and device |
| CN107577497A (en) * | 2017-09-19 | 2018-01-12 | 郑州云海信息技术有限公司 | A kind of method, system and the relevant apparatus of research and development of software management |
| CN108255691A (en) * | 2018-01-29 | 2018-07-06 | 百度在线网络技术（北京）有限公司 | Thermodynamic chart methods of exhibiting and device |
| CN110309045A (en) * | 2018-03-20 | 2019-10-08 | 贵州白山云科技股份有限公司 | For determining method, apparatus, medium and the calculating equipment of server future state |
| CN110321277A (en) * | 2018-03-30 | 2019-10-11 | 武汉斗鱼网络科技有限公司 | Program testing method, device, readable storage medium storing program for executing and equipment |
| CN111258908A (en) * | 2020-01-23 | 2020-06-09 | 奇安信科技集团股份有限公司 | Software analysis method and device |
| CN111274121A (en) * | 2018-12-05 | 2020-06-12 | 北京奇虎科技有限公司 | Testing method and device applying monitoring rules |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100057751A1 (en) * | 2008-08-26 | 2010-03-04 | Siemens Aktiengesellschaft | Method for evaluating a production rule for a memory management analysis |
| CN102200942A (en) * | 2011-06-08 | 2011-09-28 | 宇龙计算机通信科技(深圳)有限公司 | Cloud-computing-based application program behavior monitoring method and cloud server |
| CN103237082A (en) * | 2013-05-06 | 2013-08-07 | 百度在线网络技术（北京）有限公司 | Cloud testing method, system, and cloud server |
| CN104023071A (en) * | 2014-06-13 | 2014-09-03 | 中国民航信息网络股份有限公司 | System and method of monitoring software performance test resources |
| CN104123223A (en) * | 2014-07-02 | 2014-10-29 | 珠海市君天电子科技有限公司 | Software repair method and device |
-
2014
- 2014-12-22 CN CN201410802578.9A patent/CN104503910A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100057751A1 (en) * | 2008-08-26 | 2010-03-04 | Siemens Aktiengesellschaft | Method for evaluating a production rule for a memory management analysis |
| CN102200942A (en) * | 2011-06-08 | 2011-09-28 | 宇龙计算机通信科技(深圳)有限公司 | Cloud-computing-based application program behavior monitoring method and cloud server |
| CN103237082A (en) * | 2013-05-06 | 2013-08-07 | 百度在线网络技术（北京）有限公司 | Cloud testing method, system, and cloud server |
| CN104023071A (en) * | 2014-06-13 | 2014-09-03 | 中国民航信息网络股份有限公司 | System and method of monitoring software performance test resources |
| CN104123223A (en) * | 2014-07-02 | 2014-10-29 | 珠海市君天电子科技有限公司 | Software repair method and device |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104965775A (en) * | 2015-04-23 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Reconstruction method for application software fault site, server, and terminal |
| CN105095081A (en) * | 2015-08-06 | 2015-11-25 | 小米科技有限责任公司 | Application program function testing method and device |
| CN105095081B (en) * | 2015-08-06 | 2019-03-15 | 小米科技有限责任公司 | The function test method and device of application program |
| CN105930258A (en) * | 2015-11-13 | 2016-09-07 | 中国银联股份有限公司 | Parameter filtering method and apparatus |
| CN105930258B (en) * | 2015-11-13 | 2019-04-26 | 中国银联股份有限公司 | A kind of method and device of parameter filtering |
| CN105630658B (en) * | 2015-12-22 | 2018-10-09 | 北京奇虎科技有限公司 | The method and device of data processing |
| CN105630658A (en) * | 2015-12-22 | 2016-06-01 | 北京奇虎科技有限公司 | Data processing method and data processing device |
| CN106294124B (en) * | 2016-07-21 | 2018-12-28 | 北京金山安全软件有限公司 | Application product test configuration method and device |
| CN106294124A (en) * | 2016-07-21 | 2017-01-04 | 北京金山安全软件有限公司 | Application product test configuration method and device |
| CN107577497A (en) * | 2017-09-19 | 2018-01-12 | 郑州云海信息技术有限公司 | A kind of method, system and the relevant apparatus of research and development of software management |
| CN108255691A (en) * | 2018-01-29 | 2018-07-06 | 百度在线网络技术（北京）有限公司 | Thermodynamic chart methods of exhibiting and device |
| CN108255691B (en) * | 2018-01-29 | 2021-08-10 | 百度在线网络技术（北京）有限公司 | Thermodynamic diagram display method and device |
| CN110309045A (en) * | 2018-03-20 | 2019-10-08 | 贵州白山云科技股份有限公司 | For determining method, apparatus, medium and the calculating equipment of server future state |
| CN110321277A (en) * | 2018-03-30 | 2019-10-11 | 武汉斗鱼网络科技有限公司 | Program testing method, device, readable storage medium storing program for executing and equipment |
| CN111274121A (en) * | 2018-12-05 | 2020-06-12 | 北京奇虎科技有限公司 | Testing method and device applying monitoring rules |
| CN111274121B (en) * | 2018-12-05 | 2024-04-05 | 三六零科技集团有限公司 | Test method and device for applying monitoring rule |
| CN111258908A (en) * | 2020-01-23 | 2020-06-09 | 奇安信科技集团股份有限公司 | Software analysis method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104503910A (en) | Product test method by monitoring users' using behavior | |
| US10606731B2 (en) | Code component debugging in an application program | |
| WO2017124808A1 (en) | Fault information reproduction method and reproduction apparatus | |
| CN101320350B (en) | Performance monitoring method and device | |
| US8116179B2 (en) | Simultaneous viewing of multiple tool execution results | |
| CN109002391A (en) | The method of automatic detection embedded software interface testing data | |
| CN103312851B (en) | Intelligent cellphone application interaction interface program usability testing method | |
| CN111614483A (en) | Link monitoring method and device, storage medium and computer equipment | |
| CN105068930A (en) | Intelligent analysis method and device for test generation data of mobile terminal | |
| CN102445941B (en) | Method for automatically determining and analyzing interoperability test results of on-board equipment of train control system | |
| CN104239168A (en) | Blocking detection method and device | |
| CN104063326A (en) | Software testing data analysis oscilloscope and method | |
| CN108572895A (en) | Automatically the stability test method of software and hardware configuration is checked under a kind of Linux | |
| CN105138447A (en) | Method for monitoring hard disk and memory in Reboot test process | |
| CN110928795A (en) | Stability test method and device for upgrading storage system | |
| CN103368762A (en) | Testing method, system and device for big data comparison | |
| CN115392802A (en) | Method, system, medium, and apparatus for detecting defects of industrial products | |
| CN109614429B (en) | Method for realizing association of application access and database access behaviors based on kernel driver | |
| CN113127345A (en) | Application testing method and device, electronic equipment and storage medium | |
| CN118093381B (en) | Software testing method and system based on artificial intelligence | |
| CN103678375A (en) | Test state presentation and anomaly indexing system and method | |
| CN113484710B (en) | Graphical user interface for traffic capture and debug tool | |
| CN114860549B (en) | Buried data verification method, buried data verification device, buried data verification equipment and storage medium | |
| CN115225936B (en) | Method, device, equipment and medium for determining definition index of video resource | |
| CN107438259B (en) | Method for positioning network management system performance module fault |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150408 |