CN109815947A - Test method, device and the computer equipment of application - Google Patents

Test method, device and the computer equipment of application Download PDF

Info

Publication number
CN109815947A
CN109815947A CN201811535140.3A CN201811535140A CN109815947A CN 109815947 A CN109815947 A CN 109815947A CN 201811535140 A CN201811535140 A CN 201811535140A CN 109815947 A CN109815947 A CN 109815947A
Authority
CN
China
Prior art keywords
mentioned
operating area
screen
application
mechanical manipulation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811535140.3A
Other languages
Chinese (zh)
Inventor
徐佳良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
OneConnect Smart Technology Co Ltd
Original Assignee
OneConnect Smart Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by OneConnect Smart Technology Co Ltd filed Critical OneConnect Smart Technology Co Ltd
Priority to CN201811535140.3A priority Critical patent/CN109815947A/en
Publication of CN109815947A publication Critical patent/CN109815947A/en
Pending legal-status Critical Current

Links

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

Present applicant proposes a kind of test method of application, device and computer equipments, wherein the test method of above-mentioned application includes: to shoot to the screen of electronic equipment;It is identified by the screen picture that optical object identification obtains shooting, obtains operable region on the screen;It obtains preset to operating area;When described when operating area includes in the operable region, the position to operating area in the screen picture is determined;Control mechanical manipulation device be moved at the position, and by the mechanical manipulation device at the position to the operation set to operating area.The application may be implemented to improve fidelity when testing the application on mobile terminal, improves test confidence level, reduces the workload of application test.

Description

Test method, device and the computer equipment of application
[technical field]
This application involves technical field of internet application more particularly to a kind of test methods of application, device and computer Equipment.
[background technique]
It is existing in the related technology, in mobile terminal application field, automatic test field there are mainly two types of method, one is A mobile terminal device is simulated by software in host, is carried out by the mobile terminal that application program is simulated with this Interaction is to realize automatic test;Another kind, which is host, connects mobile terminal by data line, and is simulated by software all kinds of Operation is to realize automatic test.
Former approach due to be software simulation equipment, it is lower to the fidelity of equipment, test confidence level also accordingly compared with It is low;Later approach is that each generic operation is simulated with software approach, preferable to fidelities such as text inputs, but to Novel movable end Fidelity on end mainly based on touch operation is lower, and test confidence level is also corresponding lower.
[summary of the invention]
The embodiment of the present application provides test method, device and the computer equipment of a kind of application, is improved with realizing to shifting Fidelity when application in dynamic terminal is tested improves test confidence level, reduces the workload of application test.
In a first aspect, the embodiment of the present application provides a kind of test method of application, comprising: to the screen of electronic equipment into Row shooting;It is identified by the screen picture that optical object identification obtains shooting, obtains operable area on the screen Domain;It obtains preset to operating area;When described when operating area includes in the operable region, institute is determined State the position to operating area in the screen picture;Control mechanical manipulation device is moved at the position, and passes through institute Mechanical manipulation device is stated at the position to the operation set to operating area.
Wherein in one possible implementation, it includes: to pass through setting that the screen to electronic equipment, which carries out shooting, The screen of electronic equipment is shot in the camera of specific location.
Wherein in one possible implementation, on the screen operable region include: can quilt on the screen Button, picture and/or the link of operation.
Wherein in one possible implementation, it is described obtain it is preset to operating area include: obtain it is preparatory According to testing requirement setting to operating area.
It is wherein in one possible implementation, described to obtain on the screen after operable region, further includes: Select the specified point of the screen picture for coordinate origin;Calculate the seat of the relatively described coordinate origin in the operable region Mark;Described in the determination to position of the operating area in the screen picture include: obtain it is described to operating area with respect to institute State the coordinate of coordinate origin.
Wherein in one possible implementation, the control mechanical manipulation device is moved at the position, and is led to It includes: to the mechanical behaviour to the operation set to operating area that the mechanical manipulation device, which is crossed, at the position It controls device and sends control instruction, the coordinate to the relatively described coordinate origin of operating area and institute are carried in the control instruction State the operation of setting.
Wherein in one possible implementation, the control mechanical manipulation device is moved at the position, and is led to Cross the mechanical manipulation device at the position to the operation set to operating area after, further includes: use The mode of software simulation carries out identical operation to operating area to described, obtains the operating result of software simulation;It will be described soft The operating result of the operating result and the mechanical manipulation device of part simulation compares, and determines and carries out to described to operating area The problems of touch control operation and touch control operation and the suitability to the application in operating area.
Second aspect, the embodiment of the present application also provide a kind of test device of application, comprising: shooting module, for electricity The screen of sub- equipment is shot;Identification module, the screen picture for being obtained by optical object identification to shooting are known Not, operable region on the screen is obtained;Module is obtained, it is preset to operating area for obtaining;Determining module, For when operating area includes in the operable region, determined when described it is described to operating area in the screen map Position as in;Control module is moved at the position for controlling mechanical manipulation device, and is filled by the mechanical manipulation It sets at the position to the operation set to operating area.
Wherein in one possible implementation, the shooting module is specifically used for by being arranged in specific location Camera the screen of electronic equipment is shot.
Wherein in one possible implementation, on the screen operable region include: can quilt on the screen Button, picture and/or the link of operation.
Wherein in one possible implementation, the acquisition module is specifically used for obtaining previously according to testing requirement Setting to operating area.
Wherein in one possible implementation, the test device of above-mentioned application further include: selecting module, in institute It states identification module to obtain on the screen after operable region, selects the specified point of the screen picture for coordinate origin; Computing module, for calculating the coordinate of the relatively described coordinate origin in the operable region;The determining module, is specifically used for Obtain the coordinate to the relatively described coordinate origin of operating area.
Wherein in one possible implementation, the control module is specifically used for sending out to the mechanical manipulation device It send control instruction, the coordinate to the relatively described coordinate origin of operating area and the setting is carried in the control instruction Operation.
Wherein in one possible implementation, the test device of above-mentioned application further include: analog module, in institute It states control module control mechanical manipulation device to be moved at the position, and through the mechanical manipulation device at the position It is identical to operating area progress to described by the way of software simulation after the operation set to operating area Operation, obtain software simulation operating result;Contrast module, the operation of the software simulation for obtaining the analog module As a result the operating result with the mechanical manipulation device compares, and determines and is deposited to described to operating area progress touch control operation The problem of and touch control operation and the suitability to the application in operating area.
The third aspect, the embodiment of the present application provide a kind of computer equipment, including memory, processor and are stored in described It is real when the processor executes the computer program on memory and the computer program that can run on the processor Now method as described above.
Fourth aspect, the embodiment of the present application provide a kind of non-transitorycomputer readable storage medium, are stored thereon with meter Calculation machine program, the computer program realize method as described above when being executed by processor.
In above technical scheme, after being shot to the screen of electronic equipment, shooting is obtained by optical object identification Screen picture identified, obtain operable region on above-mentioned screen, then obtain it is preset to operating area, When above-mentioned when operating area includes in above-mentioned operable region, determine it is above-mentioned to operating area in above-mentioned screen picture Position, control mechanical manipulation device is moved at above-mentioned position, and through above-mentioned mechanical manipulation device at above-mentioned position pair The above-mentioned operation set to operating area, so as to realize through mechanical manipulation unit simulation user on mobile terminal Application operation, improve fidelity when testing the application on mobile terminal, improve test confidence level, and realize Simply, reduce the workload using test.
[Detailed description of the invention]
Technical solution in ord to more clearly illustrate embodiments of the present application, below will be to needed in the embodiment attached Figure is briefly described, it should be apparent that, the drawings in the following description are only some examples of the present application, for this field For those of ordinary skill, without creative efforts, it can also be obtained according to these attached drawings other attached drawings.
Fig. 1 is the flow chart of test method one embodiment of the application application;
Fig. 2 is the flow chart of another embodiment of the test method of the application application;
Fig. 3 is the flow chart of the test method further embodiment of the application application;
Fig. 4 is the flow chart of the test method further embodiment of the application application;
Fig. 5 is the flow chart of the test method further embodiment of the application application;
Fig. 6 is the structural schematic diagram of test device one embodiment of the application application;
Fig. 7 is the structural schematic diagram of another embodiment of the test device of the application application;
Fig. 8 is the structural schematic diagram of the application computer equipment one embodiment.
[specific embodiment]
In order to better understand the technical solution of the application, the embodiment of the present application is retouched in detail with reference to the accompanying drawing It states.
It will be appreciated that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.Base Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts it is all its Its embodiment, shall fall in the protection scope of this application.
The term used in the embodiment of the present application is only to be not intended to be limiting merely for for the purpose of describing particular embodiments The application.In the embodiment of the present application and the "an" of singular used in the attached claims, " described " and "the" It is also intended to including most forms, unless the context clearly indicates other meaning.
It is existing in the related technology to lower, this Shen using fidelity when testing on mobile terminal to solve the problems, such as Please embodiment a kind of test method of application is provided, comprising: the screen of electronic equipment is shot;It is identified by optical object The screen picture obtained to shooting identifies, obtains operable region on above-mentioned screen;It obtains preset wait operate Region;When above-mentioned when operating area includes in above-mentioned operable region, determine it is above-mentioned to operating area in above-mentioned screen Position in image;Control mechanical manipulation device is moved at above-mentioned position, and by above-mentioned mechanical manipulation device in upper rheme The place of setting is to the above-mentioned operation set to operating area.
Application involved in the embodiment of the present application (App) can apply (Hybrid App) for mixing, but the application is not As limit.To better illustrate the embodiment in the application, carry out following explanation to application: application may include native applications (Hybrid App) is applied in (Native App), web application (Web App) and mixing.Wherein, native applications are for difference Operation system of smart phone is individually developed locally applied, is needed first to download to terminal and be installed if you need to use, and Native is downloaded The most common process of App is access application shop, such as the application shop (App Store) of apple, Android market, Google quotient Shop (Google Play) etc..Web application is the website of a touch screen version, and Html, JavaScript and layer are used in Web application completely Stacking style table (Cascading Style Sheets;The Web technological development such as hereinafter referred to as: CSS), passes through the browsing of electronic equipment Device accesses, the disadvantage is that these applications based on browser can not calling system application programming interface (Application Programming Interface;It hereinafter referred to as: API) realizes some Premium Features, is also not suitable for the field of high performance requirements It closes.Mixing application is a kind of App between Native App and Web App, although mixing application appears to be one Native App, but an only user interface web page view (User Interface WebView;Hereinafter referred to as: UI WebView), that the inside access is a Web App.The essence of mixing application is that the apk/ipa of one browser of forgery is primary Program, and run a Web App.Hybrid App has both the advantage and Web of the good user-interaction experience of Native App The advantage of App Cross-border congestion management can allow the transition of web developer's almost zero cost at mobile application developer, and And identical code need to only be compiled for different platform and can be achieved in multi-platform distribution, and compared to Web App, it opens Originator can call most of common system API by packaged interface.
Fig. 1 is the flow chart of test method one embodiment of the application application, as shown in Figure 1, the test of above-mentioned application Method may include:
Step 101, the screen of electronic equipment is shot.
Wherein, above-mentioned electronic equipment can be the intelligent electronic devices such as smart phone, smartwatch or tablet computer, this reality Example is applied to be not construed as limiting the specific form of above-mentioned electronic equipment.
Step 102, identify that the screen picture obtained to shooting identifies that obtaining can on above-mentioned screen by optical object The region of operation.
Wherein, operable region includes: the button, picture and/or chain that can be operated on above-mentioned screen on above-mentioned screen It connects.
In the present embodiment, it can operate and refer to and can be clicked, pull or long-pressing, can operate certainly can also include other behaviour Make form, the present embodiment is not construed as limiting this.
In specific implementation, it identifies that the screen picture obtained to shooting identifies by optical object, obtains above-mentioned screen Operable region can be on curtain are as follows: the screen picture input for obtaining shooting optical object identification model trained in advance is led to Identify that obtaining can operate on above-mentioned screen after the screen picture that optical object identification model trained in advance obtains shooting Region.
Wherein, above-mentioned optical object identification model training process can be with are as follows: firstly, the screen picture for training is obtained, Then the above-mentioned screen picture for training is labeled, above-mentioned standard information includes in the above-mentioned screen picture for training Position in above-mentioned screen picture of operable region and above-mentioned operable region;
It is trained next, the screen picture after mark is inputted optical object identification model to be trained, when wait instruct Experienced optical object identification model is small to the error between the recognition result of screen picture and the markup information of above-mentioned screen picture When predetermined threshold, trained optical object identification model is obtained.Wherein, above-mentioned predetermined threshold can in specific implementation, According to the sets itselfs such as system performance and/or realization demand, the present embodiment is not construed as limiting the size of above-mentioned predetermined threshold.
When the screen picture after mark being inputted the optical object identification model wait train being trained, machine can be used Learning algorithm (such as: decision tree or support vector machines (Support Vector Machine;Hereinafter referred to as: SVM) etc.) or mind Through network algorithm etc., the present embodiment is not construed as limiting used algorithm.
Step 103, it obtains preset to operating area.
Specifically, obtain it is preset can be with to operating area are as follows: obtain previously according to testing requirement set wait grasp Make region.
That is, tester can be inputted previously according to testing requirement to operating area in the present embodiment, survey in this way Examination server can be obtained previously according to testing requirement setting to operating area.
Step 104, it is determined above-mentioned to operating area when operating area includes in above-mentioned operable region when above-mentioned Position in above-mentioned screen picture.
Step 105, control mechanical manipulation device is moved at above-mentioned position, and by above-mentioned mechanical manipulation device above-mentioned To the above-mentioned operation set to operating area at position.
Wherein, above-mentioned mechanical manipulation device can be the devices such as mechanical arm or manipulator, and the present embodiment is to above-mentioned mechanical behaviour The concrete form of control device is not construed as limiting.
The operation of above-mentioned setting can be set according to testing requirement, may include: the operation such as click, movement or long-pressing, this Embodiment is not construed as limiting specific operation format.
In the test method of above-mentioned application, after shooting to the screen of electronic equipment, pass through optical object identification pair The screen picture that shooting obtains is identified, is obtained operable region on above-mentioned screen, is then obtained preset wait grasp Make region, when above-mentioned when operating area includes in above-mentioned operable region, determine it is above-mentioned to operating area in above-mentioned screen Position in curtain image, control mechanical manipulation device are moved at above-mentioned position, and by above-mentioned mechanical manipulation device above-mentioned To the above-mentioned operation set to operating area at position, so as to realize through mechanical manipulation unit simulation user to shifting The operation of application in dynamic terminal improves fidelity when testing the application on mobile terminal, improves test confidence level, And realize the workload simply reduced using test.
Fig. 2 is the flow chart of another embodiment of the test method of the application application, as shown in Fig. 2, shown in the application Fig. 1 In embodiment, step 101 can be with are as follows:
Step 201, the screen of electronic equipment is shot by the way that the camera of specific location is arranged in.
In the present embodiment, it can be shot by screen of the camera to electronic equipment, above-mentioned camera is set in one Specific location can take the screen of complete electronic equipment.
Fig. 3 is the flow chart of the test method further embodiment of the application application, as shown in figure 3, shown in the application Fig. 1 In embodiment, after step 102, can also include:
Step 301, select the specified point of above-mentioned screen picture for coordinate origin.
Wherein, the specified point of above-mentioned screen picture can be the central point of above-mentioned screen picture, or above-mentioned screen Point on four angles of image, the present embodiment are not construed as limiting selected specified point.
Step 302, the coordinate of the above-mentioned relatively above-mentioned coordinate origin in operable region is calculated.
Specifically, the specified point of screen picture is stated in the choice as that can calculate above-mentioned operable after coordinate origin The coordinate of the relatively above-mentioned coordinate origin of the central point in region, using the coordinate of the central point in above-mentioned operable region as it is above-mentioned can The coordinate in the region of operation.
At this moment, step 104 can be with are as follows:
Step 303, it when above-mentioned when operating area includes in above-mentioned operable region, obtains above-mentioned to operating area The coordinate of relatively above-mentioned coordinate origin.
When specific implementation, when above-mentioned when operating area includes in above-mentioned operable region, can first by it is above-mentioned to Operating area is matched in above-mentioned operable region, is then obtained in above-mentioned operable region with above-mentioned to operating space The region that domain matches finally is obtained the coordinate of the relatively above-mentioned coordinate origin of central point in the above-mentioned region to match, is made with this For the above-mentioned coordinate to the relatively above-mentioned coordinate origin of operating area.
Fig. 4 is the flow chart of the test method further embodiment of the application application, as shown in figure 4, shown in the application Fig. 3 In embodiment, step 105 can be with are as follows:
Step 401, Xiang Shangshu mechanical manipulation device sends control instruction, carries in above-mentioned control instruction above-mentioned to operating space The coordinate of the relatively above-mentioned coordinate origin in domain and the operation of above-mentioned setting.
In the present embodiment, after obtaining the above-mentioned coordinate to the relatively above-mentioned coordinate origin of operating area, testing service device Control instruction can be sent to above-mentioned mechanical manipulation device, be carried in above-mentioned control instruction above-mentioned relatively above-mentioned to operating area The operation of the coordinate of coordinate origin and above-mentioned setting, in this way, after receiving above-mentioned control instruction, mechanical manipulation device It according to the coordinate in above-mentioned control instruction, is moved at above-mentioned position, then executes carry in above-mentioned control instruction above-mentioned and set Fixed operation.
The test method of above-mentioned application may be implemented through mechanical manipulation unit simulation user to the application on mobile terminal Operation, improve fidelity when testing the application on mobile terminal, improve test confidence level, and realize it is simple, Reduce the workload using test.
Fig. 5 is the flow chart of the test method further embodiment of the application application, as shown in figure 5, shown in the application Fig. 1 In embodiment, after step 105, can also include:
Step 501, identical operation is carried out to operating area to above-mentioned by the way of software simulation, obtains software simulation Operating result.
Step 502, the operating result of operating result and above-mentioned mechanical manipulation device that above-mentioned software is simulated is compared, It determines to above-mentioned to the problems of operating area progress touch control operation and touch control operation and above-mentioned in operating area The suitability of application.
That is, identical operation can be carried out to operating area to above-mentioned by the way of software simulation, then will The operating result of the operating result and above-mentioned mechanical manipulation device of above-mentioned software simulation compares, and according to comparing result, determines The problems of touch control operation and touch control operation and the above-mentioned application in operating area are carried out to operating area to above-mentioned Suitability.Wherein, touch control operation and the above-mentioned suitability to the application in operating area, which refer to, carries out touch-control to above-mentioned application Whether the operating result of operation meets the required touch-control effect reached when developing above-mentioned application.
Fig. 6 is the structural schematic diagram of test device one embodiment of the application application, the survey of the application in the present embodiment Trial assembly, which is set, can be used as a part of testing service device or testing service device and realizes the survey of application provided by the embodiments of the present application Method for testing.As shown in fig. 6, the test device of above-mentioned application may include: shooting module 61, identification module 62, obtain module 63, Determining module 64 and control module 65;
Shooting module 61 is shot for the screen to electronic equipment;
Wherein, above-mentioned electronic equipment can be the intelligent electronic devices such as smart phone, smartwatch or tablet computer, this reality Example is applied to be not construed as limiting the specific form of above-mentioned electronic equipment.
Identification module 62, the screen picture for being obtained by optical object identification to shooting identifies, obtains above-mentioned Operable region on screen;Wherein, on above-mentioned screen operable region include: the button that can be operated on above-mentioned screen, Picture and/or link.
In the present embodiment, it can operate and refer to and can be clicked, pull or long-pressing, can operate certainly can also include other behaviour Make form, the present embodiment is not construed as limiting this.
In specific implementation, identification module 62 identifies that the screen picture obtained to shooting identifies by optical object, Obtaining on above-mentioned screen operable region can be with are as follows: the screen picture input training in advance that identification module 62 obtains shooting Optical object identification model identified by the screen picture that optical object identification model trained in advance obtains shooting, Obtain operable region on above-mentioned screen.
Wherein, above-mentioned optical object identification model training process can be with are as follows: firstly, the screen picture for training is obtained, Then the above-mentioned screen picture for training is labeled, above-mentioned standard information includes in the above-mentioned screen picture for training Position in above-mentioned screen picture of operable region and above-mentioned operable region;
It is trained next, the screen picture after mark is inputted optical object identification model to be trained, when wait instruct Experienced optical object identification model is small to the error between the recognition result of screen picture and the markup information of above-mentioned screen picture When predetermined threshold, trained optical object identification model is obtained.Wherein, above-mentioned predetermined threshold can in specific implementation, According to the sets itselfs such as system performance and/or realization demand, the present embodiment is not construed as limiting the size of above-mentioned predetermined threshold.
When the screen picture after mark being inputted the optical object identification model wait train being trained, machine can be used Learning algorithm (such as: decision tree or SVM etc.) or neural network algorithm etc., the present embodiment is not construed as limiting used algorithm.
Module 63 is obtained, it is preset to operating area for obtaining;In the present embodiment, module 63 is obtained, it is specific to use In obtain previously according to testing requirement set to operating area.
That is, tester can input previously according to testing requirement to operating area in the present embodiment, obtain in this way Modulus block 63 can be obtained previously according to testing requirement setting to operating area.
Determining module 64, for when operating area includes in above-mentioned operable region, determined when above-mentioned it is above-mentioned to Position of the operating area in above-mentioned screen picture;
Control module 65 is moved at above-mentioned position for controlling mechanical manipulation device, and is filled by above-mentioned mechanical manipulation It sets at above-mentioned position to the above-mentioned operation set to operating area.Wherein, above-mentioned mechanical manipulation device can be machinery The devices such as arm or manipulator, the present embodiment are not construed as limiting the concrete form of above-mentioned mechanical manipulation device.
The operation of above-mentioned setting can be set according to testing requirement, may include: the operation such as click, movement or long-pressing, this Embodiment is not construed as limiting specific operation format.
In the test device of above-mentioned application, after shooting module 61 shoots the screen of electronic equipment, identification module 62 identify that the screen picture obtained to shooting identifies by optical object, obtain operable region on above-mentioned screen, so Acquisition module 63 obtains preset to operating area afterwards, is included in above-mentioned operable region when above-mentioned to operating area When, determining module 64 determines the above-mentioned position to operating area in above-mentioned screen picture, and control module 65 controls mechanical manipulation Device is moved at above-mentioned position, and is set to above-mentioned to operating area at above-mentioned position by above-mentioned mechanical manipulation device Fixed operation, so as to realize the operation by mechanical manipulation unit simulation user to the application on mobile terminal, raising pair Fidelity when application on mobile terminal is tested improves test confidence level, and realizes simply, reduces using test Workload.
Fig. 7 is the structural schematic diagram of another embodiment of the test device of the application application, the survey with application shown in fig. 6 Trial assembly, which is set, to be compared, the difference is that, in the test device of application shown in Fig. 7, shooting module 61, specifically for passing through setting The screen of electronic equipment is shot in the camera of specific location.In the present embodiment, shooting module 61 can pass through camera shooting Head shoots the screen of electronic equipment, and above-mentioned camera is set in a specific location, can take complete electronics The screen of equipment.
Further, the test device of above-mentioned application can also include: selecting module 66 and computing module 67;
Selecting module 66 selects above-mentioned screen for obtaining on above-mentioned screen after operable region in identification module 62 The specified point of curtain image is coordinate origin;Wherein, the specified point of above-mentioned screen picture can be the central point of above-mentioned screen picture, Or the point on four angles of above-mentioned screen picture, the present embodiment are not construed as limiting selected specified point.
Computing module 67, for calculating the coordinate of the relatively above-mentioned coordinate origin in above-mentioned operable region;Specifically, it is selecting The specified point of above-mentioned screen picture is selected as after coordinate origin, computing module 67 can calculate the center in above-mentioned operable region The coordinate of the relatively above-mentioned coordinate origin of point, using the coordinate of the central point in above-mentioned operable region as above-mentioned operable region Coordinate.
At this moment, determining module 64, specifically for obtaining the above-mentioned coordinate to the relatively above-mentioned coordinate origin of operating area.
When specific implementation, when above-mentioned when operating area includes in above-mentioned operable region, determining module 64 can be with First matched above-mentioned in above-mentioned operable region to operating area, then obtain in above-mentioned operable region with it is upper The region to match to operating area is stated, the seat of the relatively above-mentioned coordinate origin of central point in the above-mentioned region to match is finally obtained Mark, in this, as the above-mentioned coordinate to the relatively above-mentioned coordinate origin of operating area.
In the present embodiment, control module 65 is specifically used for sending control instruction, above-mentioned control to above-mentioned mechanical manipulation device The operation of the above-mentioned coordinate to the relatively above-mentioned coordinate origin of operating area and above-mentioned setting is carried in instruction.
In the present embodiment, after determining module 64 obtains the above-mentioned coordinate to the relatively above-mentioned coordinate origin of operating area, Control module 65 can send control instruction to above-mentioned mechanical manipulation device, carry in above-mentioned control instruction above-mentioned to operating space The coordinate of the relatively above-mentioned coordinate origin in domain and the operation of above-mentioned setting, in this way, after receiving above-mentioned control instruction, mechanical manipulation Device can be moved at above-mentioned position according to the coordinate in above-mentioned control instruction, then execute and take in above-mentioned control instruction The operation of the above-mentioned setting of band.
The test device of above-mentioned application may be implemented through mechanical manipulation unit simulation user to the application on mobile terminal Operation, improve fidelity when testing the application on mobile terminal, improve test confidence level, and realize it is simple, Reduce the workload using test.
Further, the test device of above-mentioned application can also include: analog module 68 and contrast module 69;
Wherein, analog module 68 are moved to institute's rheme for controlling the mechanical manipulation device in the control module 65 Set place, and at the position to the operation set to operating area after, using software simulation by the way of to institute It states and carries out identical operation to operating area, obtain the operating result of software simulation;
Contrast module 69, the operating result and above-mentioned mechanical manipulation device of the software simulation for obtaining analog module 68 Operating result compare, determine and carry out the problems of touch control operation and touch control operation to operating area to above-mentioned With the above-mentioned suitability to the application in operating area.
That is, analog module 68 can carry out identical behaviour to operating area to above-mentioned by the way of software simulation Make, the operating result of operating result that then contrast module 69 simulates above-mentioned software and above-mentioned mechanical manipulation device carries out pair Than, according to comparing result, determine to it is above-mentioned to operating area carry out the problems of touch control operation and touch control operation with it is upper State the suitability to the application in operating area.Wherein, touch control operation is with the above-mentioned suitability to the application in operating area Refer to whether the operating result for carrying out touch control operation to above-mentioned application meets the required touch-control reached when developing above-mentioned application and imitate Fruit.
Fig. 8 is the structural schematic diagram of the application computer equipment one embodiment, and above-mentioned computer equipment may include depositing Reservoir, processor and it is stored in the computer program that can be run on above-mentioned memory and on above-mentioned processor, above-mentioned processor When executing above-mentioned computer program, the test method of application provided by the embodiments of the present application may be implemented.
Wherein, above-mentioned computer equipment can be the equipment for being tested application, such as: testing service device or tool There is the intelligent terminal etc. tested application, the present embodiment is not construed as limiting the specific form of above-mentioned computer equipment.
Fig. 8 shows the block diagram for being suitable for the exemplary computer device 12 for being used to realize the application embodiment.Fig. 8 is shown Computer equipment 12 be only an example, should not function to the embodiment of the present application and use scope bring any restrictions.
As shown in figure 8, computer equipment 12 is showed in the form of universal computing device.The component of computer equipment 12 can be with Including but not limited to: one or more processor or processing unit 16, system storage 28 connect different system components The bus 18 of (including system storage 28 and processing unit 16).
Bus 18 indicates one of a few class bus structures or a variety of, including memory bus or Memory Controller, Peripheral bus, graphics acceleration port, processor or the local bus using any bus structures in a variety of bus structures.It lifts For example, these architectures include but is not limited to industry standard architecture (Industry Standard Architecture;Hereinafter referred to as: ISA) bus, microchannel architecture (Micro Channel Architecture;Below Referred to as: MAC) bus, enhanced isa bus, Video Electronics Standards Association (Video Electronics Standards Association;Hereinafter referred to as: VESA) local bus and peripheral component interconnection (Peripheral Component Interconnection;Hereinafter referred to as: PCI) bus.
Computer equipment 12 typically comprises a variety of computer system readable media.These media can be it is any can be by The usable medium that computer equipment 12 accesses, including volatile and non-volatile media, moveable and immovable medium.
System storage 28 may include the computer system readable media of form of volatile memory, such as arbitrary access Memory (Random Access Memory;Hereinafter referred to as: RAM) 30 and/or cache memory 32.Computer equipment 12 It may further include other removable/nonremovable, volatile/non-volatile computer system storage mediums.Only conduct Citing, storage system 34 can be used for reading and writing immovable, non-volatile magnetic media, and (Fig. 8 do not show, commonly referred to as " hard disk Driver ").Although being not shown in Fig. 8, the magnetic for reading and writing to removable non-volatile magnetic disk (such as " floppy disk ") can be provided Disk drive, and to removable anonvolatile optical disk (such as: compact disc read-only memory (Compact Disc Read Only Memory;Hereinafter referred to as: CD-ROM), digital multi CD-ROM (Digital Video Disc Read Only Memory;Hereinafter referred to as: DVD-ROM) or other optical mediums) read-write CD drive.In these cases, each driving Device can be connected by one or more data media interfaces with bus 18.Memory 28 may include that at least one program produces Product, the program product have one group of (for example, at least one) program module, and it is each that these program modules are configured to perform the application The function of embodiment.
Program/utility 40 with one group of (at least one) program module 42 can store in such as memory 28 In, such program module 42 includes --- but being not limited to --- operating system, one or more application program, other programs It may include the realization of network environment in module and program data, each of these examples or certain combination.Program mould Block 42 usually executes function and/or method in embodiments described herein.
Computer equipment 12 can also with one or more external equipments (such as: mechanical manipulation device 21, camera 26, Keyboard, sensing equipment or display 24 etc.) communication, it can also enable a user to hand over the computer equipment 12 with one or more Mutual equipment communication, and/or with the computer equipment 12 is appointed with what one or more of the other calculating equipment was communicated What equipment (such as network interface card, modem etc.) communication.This communication can be carried out by input/output (I/O) interface 22. Also, computer equipment 12 can also pass through network adapter 20 and one or more network (such as local area network (Local Area Network;Hereinafter referred to as: LAN), wide area network (Wide Area Network;Hereinafter referred to as: WAN) and/or public network Network, such as internet) communication.As shown in figure 8, network adapter 20 is logical by other modules of bus 18 and computer equipment 12 Letter.It should be understood that other hardware and/or software module, packet can be used in conjunction with computer equipment 12 although being not shown in Fig. 8 It includes but is not limited to: microcode, device driver, redundant processing unit, external disk drive array, RAID system, magnetic tape drive Device and data backup storage system etc..
Processing unit 16 by the program that is stored in system storage 28 of operation, thereby executing various function application and Data processing, such as realize the test method of application provided by the embodiments of the present application.
Specifically, processing unit 16 are shot for the screen to electronic equipment, are identified by optical object to shooting The screen picture of acquisition is identified, operable region on above-mentioned screen is obtained;Obtain it is preset to operating area, when It is above-mentioned when operating area includes in above-mentioned operable region, determine it is above-mentioned to operating area in above-mentioned screen picture Position;And control mechanical manipulation device 21 is moved at above-mentioned position, and by above-mentioned mechanical manipulation device 21 in upper rheme The place of setting is to the above-mentioned operation set to operating area.
Wherein, above-mentioned electronic equipment can be the intelligent electronic devices such as smart phone, smartwatch or tablet computer, this reality Example is applied to be not construed as limiting the specific form of above-mentioned electronic equipment.
In specific implementation, processing unit 16 can be by being arranged in the camera 26 of specific location to electronic equipment Screen is shot, and above-mentioned camera 26 is set in a specific location, can take the screen of complete electronic equipment i.e. It can.
Wherein, operable region includes: the button, picture and/or chain that can be operated on above-mentioned screen on above-mentioned screen It connects.In the present embodiment, it can operate and refer to and can be clicked, pull or long-pressing, can operate certainly can also include other operation shapes Formula, the present embodiment are not construed as limiting this.
Wherein, above-mentioned mechanical manipulation device 21 can be the devices such as mechanical arm or manipulator, and the present embodiment is to above-mentioned machinery The concrete form of control device is not construed as limiting.
The operation of above-mentioned setting can be set according to testing requirement, may include: the operation such as click, movement or long-pressing, this Embodiment is not construed as limiting specific operation format.
That is, in the present embodiment, the program that processing unit 16 is stored in system storage 28 by operation can be with It controls mechanical manipulation device 21 and carries out position movement, and be moved to after determining position in mechanical manipulation device 21, control machine The operation that tool control device 21 is set, so as to realize through 21 analog subscriber of mechanical manipulation device on mobile terminal Application operation, improve fidelity when testing the application on mobile terminal, improve test confidence level, and realize Simply, reduce the workload using test.
The embodiment of the present application also provides a kind of non-transitorycomputer readable storage medium, is stored thereon with computer journey The test method of application provided by the embodiments of the present application may be implemented in sequence, above-mentioned computer program when being executed by processor.
Above-mentioned non-transitorycomputer readable storage medium can appointing using one or more computer-readable media Meaning combination.Computer-readable medium can be computer-readable signal media or computer readable storage medium.Computer can Reading storage medium for example may be-but not limited to-the system of electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, device Or device, or any above combination.The more specific example (non exhaustive list) of computer readable storage medium includes: Electrical connection, portable computer diskette, hard disk, random access memory (RAM), read-only storage with one or more conducting wires Device (Read Only Memory;Hereinafter referred to as: ROM), erasable programmable read only memory (Erasable Programmable Read Only Memory;Hereinafter referred to as: EPROM) or flash memory, optical fiber, portable compact disc are read-only deposits Reservoir (CD-ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.In this document, computer Readable storage medium storing program for executing can be any tangible medium for including or store program, which can be commanded execution system, device Either device use or in connection.
Computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal, Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including --- but It is not limited to --- electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be Any computer-readable medium other than computer readable storage medium, which can send, propagate or Transmission is for by the use of instruction execution system, device or device or program in connection.
The program code for including on computer-readable medium can transmit with any suitable medium, including --- but it is unlimited In --- wireless, electric wire, optical cable, RF etc. or above-mentioned any appropriate combination.
Can with one or more programming languages or combinations thereof come write for execute the application operation computer Program code, described program design language include object oriented program language-such as Java, Smalltalk, C++, It further include conventional procedural programming language-such as " C " language or similar programming language.Program code can be with It fully executes, partly execute on the user computer on the user computer, being executed as an independent software package, portion Divide and partially executes or executed on a remote computer or server completely on the remote computer on the user computer.? It is related in the situation of remote computer, remote computer can pass through the network of any kind --- including local area network (Local Area Network;Hereinafter referred to as: LAN) or wide area network (Wide Area Network;Hereinafter referred to as: WAN) it is connected to user Computer, or, it may be connected to outer computer (such as being connected using ISP by internet).
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example Point is contained at least one embodiment or example of the application.In the present specification, schematic expression of the above terms are not It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office It can be combined in any suitable manner in one or more embodiment or examples.In addition, without conflicting with each other, the skill of this field Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples It closes and combines.
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or Implicitly include at least one this feature.In the description of the present application, the meaning of " plurality " is at least two, such as two, three It is a etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes It is one or more for realizing custom logic function or process the step of executable instruction code module, segment or portion Point, and the range of the preferred embodiment of the application includes other realization, wherein can not press shown or discussed suitable Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be by the application Embodiment person of ordinary skill in the field understood.
Depending on context, word as used in this " if " can be construed to " ... when " or " when ... When " or " in response to determination " or " in response to detection ".Similarly, depend on context, phrase " if it is determined that " or " if detection (condition or event of statement) " can be construed to " when determining " or " in response to determination " or " when the detection (condition of statement Or event) when " or " in response to detection (condition or event of statement) ".
It should be noted that terminal involved in the embodiment of the present application can include but is not limited to personal computer (Personal Computer;Hereinafter referred to as: PC), personal digital assistant (Personal Digital Assistant;Below Referred to as: PDA), radio hand-held equipment, tablet computer (Tablet Computer), mobile phone, MP3 player, MP4 player etc..
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, it can be with It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit It divides, only a kind of logical function partition, there may be another division manner in actual implementation, for example, multiple units or group Part can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown Or the mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, device or unit it is indirect Coupling or communication connection can be electrical property, mechanical or other forms.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.
The above-mentioned integrated unit being realized in the form of SFU software functional unit can store and computer-readable deposit at one In storage media.Above-mentioned SFU software functional unit is stored in a storage medium, including some instructions are used so that a computer It is each that device (can be personal computer, server or network equipment etc.) or processor (Processor) execute the application The part steps of embodiment the method.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read- Only Memory;Hereinafter referred to as: ROM), random access memory (Random Access Memory;Hereinafter referred to as: RAM), The various media that can store program code such as magnetic or disk.
The foregoing is merely the preferred embodiments of the application, not to limit the application, all essences in the application Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the application protection.

Claims (10)

1. a kind of test method of application characterized by comprising
The screen of electronic equipment is shot;
It is identified by the screen picture that optical object identification obtains shooting, obtains operable region on the screen;
It obtains preset to operating area;
When described when operating area includes in the operable region, to operating area in the screen map described in determination Position as in;
Control mechanical manipulation device is moved at the position, and passes through the mechanical manipulation device at the position to described The operation set to operating area.
2. the method according to claim 1, wherein the screen to electronic equipment carry out shooting include:
Camera by the way that specific location is arranged in shoots the screen of electronic equipment.
3. the method according to claim 1, wherein operable region includes: the screen on the screen On button, picture and/or the link that can be operated.
4. the method according to claim 1, wherein described obtain preset includes: to operating area
Obtain previously according to testing requirement set to operating area.
5. method according to any of claims 1-4, which is characterized in that operable on the acquisition screen After region, further includes:
Select the specified point of the screen picture for coordinate origin;
Calculate the coordinate of the relatively described coordinate origin in the operable region;
Include: to position of the operating area in the screen picture described in the determination
Obtain the coordinate to the relatively described coordinate origin of operating area.
6. according to the method described in claim 5, it is characterized in that, the control mechanical manipulation device is moved to the position Place, and include: to the operation set to operating area at the position by the mechanical manipulation device
Control instruction is sent to the mechanical manipulation device, is carried in the control instruction described to the relatively described seat of operating area Mark the coordinate of origin and the operation of the setting.
7. method according to any of claims 1-4, which is characterized in that the control mechanical manipulation device is moved to At the position, and by the mechanical manipulation device at the position to the operation set to operating area it Afterwards, further includes:
Identical operation is carried out to operating area to described by the way of software simulation, obtains the operating result of software simulation;
The operating result of operating result and the mechanical manipulation device that the software is simulated is compared, determine to it is described to Operating area carries out being adapted to for the problems of touch control operation and touch control operation and the application in operating area Property.
8. a kind of test device of application characterized by comprising
Shooting module is shot for the screen to electronic equipment;
Identification module, the screen picture for being obtained by optical object identification to shooting identifies, obtains on the screen Operable region;
Module is obtained, it is preset to operating area for obtaining;
Determining module, it is described to operating space for when operating area includes in the operable region, being determined when described Position of the domain in the screen picture;
Control module is moved at the position for controlling mechanical manipulation device, and by the mechanical manipulation device in institute The rheme place of setting is to the operation set to operating area.
9. a kind of computer equipment, which is characterized in that including memory, processor and be stored on the memory and can be in institute The computer program run on processor is stated, when the processor executes the computer program, is realized as in claim 1-7 Any method.
10. a kind of non-transitorycomputer readable storage medium, is stored thereon with computer program, which is characterized in that the meter The method as described in any in claim 1-7 is realized when calculation machine program is executed by processor.
CN201811535140.3A 2018-12-14 2018-12-14 Test method, device and the computer equipment of application Pending CN109815947A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811535140.3A CN109815947A (en) 2018-12-14 2018-12-14 Test method, device and the computer equipment of application

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811535140.3A CN109815947A (en) 2018-12-14 2018-12-14 Test method, device and the computer equipment of application

Publications (1)

Publication Number Publication Date
CN109815947A true CN109815947A (en) 2019-05-28

Family

ID=66602043

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811535140.3A Pending CN109815947A (en) 2018-12-14 2018-12-14 Test method, device and the computer equipment of application

Country Status (1)

Country Link
CN (1) CN109815947A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110390328A (en) * 2019-06-28 2019-10-29 联想(北京)有限公司 A kind of information processing method and equipment
CN112306890A (en) * 2020-11-23 2021-02-02 国网北京市电力公司 Human-computer interaction test system, control method, control device and processor
CN113568517A (en) * 2020-04-28 2021-10-29 京东方科技集团股份有限公司 Touch module evaluation method and device, electronic equipment and storage medium
CN114393576A (en) * 2021-12-27 2022-04-26 江苏明月智能科技有限公司 Four-axis mechanical arm clicking and position calibrating method and system based on artificial intelligence
CN114546740A (en) * 2022-01-27 2022-05-27 深圳亿智时代科技有限公司 Touch screen testing method, device and system and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102902625A (en) * 2012-11-14 2013-01-30 北京奇虎科技有限公司 Software performance test system and method
CN104252410A (en) * 2013-06-27 2014-12-31 阿里巴巴集团控股有限公司 Method and equipment for testing control in page
CN104680771A (en) * 2015-03-20 2015-06-03 蒋海兵 Device and method for testing infrared remote controller
CN104679017A (en) * 2013-11-29 2015-06-03 中国银联股份有限公司 Automatic test device and test method for mobile terminal application program
CN106055446A (en) * 2016-06-24 2016-10-26 捷开通讯(深圳)有限公司 Mobile terminal test method and apparatus
CN107480036A (en) * 2017-07-07 2017-12-15 网易(杭州)网络有限公司 Automatic test approach, device, storage medium and the terminal of iOS Mobile solutions
CN108399124A (en) * 2018-02-07 2018-08-14 深圳壹账通智能科技有限公司 Application testing method, device, computer equipment and storage medium
CN108593672A (en) * 2018-03-01 2018-09-28 深圳回收宝科技有限公司 A kind of detection method, detection device and the storage medium of terminal touch screen
CN108664364A (en) * 2017-03-31 2018-10-16 腾讯科技(深圳)有限公司 A kind of terminal test method and device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102902625A (en) * 2012-11-14 2013-01-30 北京奇虎科技有限公司 Software performance test system and method
CN104252410A (en) * 2013-06-27 2014-12-31 阿里巴巴集团控股有限公司 Method and equipment for testing control in page
CN104679017A (en) * 2013-11-29 2015-06-03 中国银联股份有限公司 Automatic test device and test method for mobile terminal application program
CN104680771A (en) * 2015-03-20 2015-06-03 蒋海兵 Device and method for testing infrared remote controller
CN106055446A (en) * 2016-06-24 2016-10-26 捷开通讯(深圳)有限公司 Mobile terminal test method and apparatus
CN108664364A (en) * 2017-03-31 2018-10-16 腾讯科技(深圳)有限公司 A kind of terminal test method and device
CN107480036A (en) * 2017-07-07 2017-12-15 网易(杭州)网络有限公司 Automatic test approach, device, storage medium and the terminal of iOS Mobile solutions
CN108399124A (en) * 2018-02-07 2018-08-14 深圳壹账通智能科技有限公司 Application testing method, device, computer equipment and storage medium
CN108593672A (en) * 2018-03-01 2018-09-28 深圳回收宝科技有限公司 A kind of detection method, detection device and the storage medium of terminal touch screen

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110390328A (en) * 2019-06-28 2019-10-29 联想(北京)有限公司 A kind of information processing method and equipment
CN113568517A (en) * 2020-04-28 2021-10-29 京东方科技集团股份有限公司 Touch module evaluation method and device, electronic equipment and storage medium
CN112306890A (en) * 2020-11-23 2021-02-02 国网北京市电力公司 Human-computer interaction test system, control method, control device and processor
CN112306890B (en) * 2020-11-23 2024-01-23 国网北京市电力公司 Man-machine interaction test system, control method, control device and processor
CN114393576A (en) * 2021-12-27 2022-04-26 江苏明月智能科技有限公司 Four-axis mechanical arm clicking and position calibrating method and system based on artificial intelligence
CN114546740A (en) * 2022-01-27 2022-05-27 深圳亿智时代科技有限公司 Touch screen testing method, device and system and storage medium

Similar Documents

Publication Publication Date Title
CN109815947A (en) Test method, device and the computer equipment of application
US11900233B2 (en) Method and system for interactive imitation learning in video games
CN106687922B (en) Parametric inertia and API
CN106254848B (en) A kind of learning method and terminal based on augmented reality
CN102221974B (en) Indicating pen set
CA2925015C (en) System and method for testing data representation for different mobile devices
CN107301039A (en) Prototyping methods and its device
CN107395844A (en) Test equipment, method, system, medium, device and computing device
CN110147317A (en) Code test method and device, electronic equipment and storage medium
US11508105B2 (en) Using augmented reality for accessing legacy transaction terminals
CN107766499A (en) A kind of method for page jump, device, equipment and storage medium
US11803248B2 (en) Gesture operation method, apparatus, device and medium
CN105531756A (en) Information processing device, information processing method, and computer program
CN103218112A (en) Information processing method and information processing system
CN109684573A (en) Target Photo display methods and device, storage medium, electronic equipment
CN112306447A (en) Interface navigation method, device, terminal and storage medium
CN110134869A (en) A kind of information-pushing method, device, equipment and storage medium
CN109740079A (en) Loading method, device and the computer equipment of the H5 page
CN117785677A (en) Sliding test method for screen sensitivity, mobile terminal and storage medium
CN108921138A (en) Method and apparatus for generating information
CN107770253A (en) Long-range control method and system
US10318144B2 (en) Providing force input to an application
CN110245068A (en) Automated testing method, device and the computer equipment of the H5 page
CN110088750A (en) The method and system of context function is provided in static Web page
KR20200137594A (en) A mobile apparatus and a method for controlling the mobile apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination