CN107395844B - Test device, method, system, medium, apparatus, and computing device - Google Patents

Test device, method, system, medium, apparatus, and computing device Download PDF

Info

Publication number
CN107395844B
CN107395844B CN201710495645.0A CN201710495645A CN107395844B CN 107395844 B CN107395844 B CN 107395844B CN 201710495645 A CN201710495645 A CN 201710495645A CN 107395844 B CN107395844 B CN 107395844B
Authority
CN
China
Prior art keywords
touch
terminal
instruction
mechanical arm
test
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710495645.0A
Other languages
Chinese (zh)
Other versions
CN107395844A (en
Inventor
刘哲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netease Youdao Hangzhou Intelligent Technology Co ltd
Original Assignee
Netease Youdao Information Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netease Youdao Information Technology Beijing Co Ltd filed Critical Netease Youdao Information Technology Beijing Co Ltd
Priority to CN201710495645.0A priority Critical patent/CN107395844B/en
Publication of CN107395844A publication Critical patent/CN107395844A/en
Application granted granted Critical
Publication of CN107395844B publication Critical patent/CN107395844B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/24Arrangements for testing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/22Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector

Abstract

Test devices, methods, systems, media, apparatuses, and computing devices are provided. The test equipment includes cargo platform, support, touch head, installs the triaxial workstation of arm and workstation, touch-control detection device, wherein: the loading platform is used for loading the touch terminal; the touch control head is arranged at one end of the mechanical arm far away from the workbench; the touch detection device is arranged on the mechanical arm and used for detecting whether the touch head touches a touch screen of the touch terminal; the three-axis workbench can control the mechanical arm to move in the horizontal direction and the vertical direction; the three-axis workbench is used for receiving a touch instruction sent by the cloud test platform, moving the mechanical arm according to the touch instruction, and controlling the touch head to execute touch operation on the touch terminal according to touch operation in the touch instruction when the touch detection device detects that the touch head touches a touch screen of the touch terminal. Through the test equipment, no requirement is made on a test system during testing, so that the test method is wider in application range.

Description

Test device, method, system, medium, apparatus, and computing device
Technical Field
Embodiments of the present application relate to the field of testing technologies, and more particularly, to a testing device, a testing method, a testing system, a testing medium, a testing apparatus, a testing method, a testing system, a testing apparatus, and a computing apparatus.
Background
This section is intended to provide a background or context to the embodiments of the application that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.
Along with the continuous perfection of the functions of the intelligent terminal equipment, people increasingly depend on the intelligent terminal equipment in daily life. Taking a smart phone as an example, various applications can be installed in the smart phone at present, so that a user can perform activities such as online shopping, learning, playing games, even processing work and the like.
In order to facilitate testing of application performance, a cloud test platform of the intelligent terminal device is provided in the related art. Taking a cloud test platform of a smart phone as an example, the platform can be connected with a real test mobile phone (1 or more). After connection, the platform can project the operation interface of the test mobile phone into the browser. Then, the user can click, slide and the like on the operation interface of the test mobile phone in the browser, which is equivalent to that the user realizes the remote operation on the test mobile phone. The cloud test platform converts the operation of the user into a corresponding operation instruction, and sends the operation instruction to the test mobile phone for execution. The test mobile phone returns the operation interface after the operation instruction is executed to the platform, and then the operation interface is displayed to the user through the browser.
Therefore, the test platform of the intelligent terminal equipment can break the limitation of regions, and testers can remotely control the intelligent terminal equipment to test. For example, a tester may test an application on a smart terminal device.
Disclosure of Invention
However, because the operation instructions generated by the existing cloud test platform are all instructions that can be directly executed by the system of the intelligent terminal device, the system to which the cloud test method in the prior art can be applied must be open-source. For example, for the test mobile phone, the gesture operation is not performed on the test mobile phone, but an operation instruction corresponding to the gesture operation is directly sent to the test mobile phone for execution. Such a test method can only be tested against open source systems such as the android system.
The prior art test methods are therefore only suitable to a limited extent, which is very annoying.
For this reason, an improved test scheme is highly desirable to enable more operating systems to be accommodated.
In the first aspect of this application embodiment, provide a test equipment, including objective platform, support, touch head, the triaxial workstation of installing arm and workstation, touch-control detection device, wherein:
the carrying platform is used for carrying a touch terminal;
the touch control head is arranged at one end of the mechanical arm far away from the workbench;
the touch detection device is arranged on the mechanical arm and used for detecting whether the touch head touches a touch screen of the touch terminal;
the three-axis workbench can control the mechanical arm to move in the horizontal direction and the vertical direction;
the three-axis workbench is used for receiving a touch instruction sent by a cloud test platform, moving the mechanical arm according to the touch instruction, and controlling the touch head to execute touch operation on the touch terminal according to touch operation in the touch instruction when the touch detection device detects that the touch head touches a touch screen of the touch terminal.
In a second aspect of embodiments of the present application, there is provided a test method comprising:
displaying a projection picture of a current operation interface of the touch terminal; the projection picture is used for a user to execute remote operation on the touch terminal;
detecting an operation executed by a user on the projection picture;
if the detected operation is a preset operation, generating a touch instruction for the touch terminal; the touch instruction comprises touch operation corresponding to the detected operation;
sending the touch instruction to test equipment for placing the touch terminal, wherein the test equipment is used for executing the following operations: moving the mechanical arm according to the touch instruction, and controlling a touch head to execute touch operation on the touch terminal according to the touch operation in the touch instruction when a touch detection device on the mechanical arm detects that the touch head on the mechanical arm touches a touch screen of the touch terminal;
and receiving and displaying a projection picture of an operation interface of the touch terminal after the test equipment executes the touch operation.
In a third aspect of the present application, a test system is provided, which includes a touch terminal, a test device, and a cloud test platform, wherein:
the touch terminal is used for being in communication connection with the cloud test platform and sending a current operation interface to the cloud test platform; after the touch operation executed by the test equipment is detected, the operation interface after the touch operation is sent to the cloud test platform;
the cloud test platform is used for displaying a projection picture of a current operation interface of the touch terminal; the projection picture is used for a user to execute remote operation on the touch terminal; detecting an operation executed by a user on the projection picture; if the detected operation is a preset operation, generating a touch instruction for the touch terminal; the touch instruction comprises touch operation corresponding to the detected operation; sending the touch instruction to test equipment for placing the touch terminal; receiving a projection picture of an operation interface of the touch terminal after the test equipment executes the touch operation;
the test equipment is used for receiving a touch instruction sent by the cloud test platform, moving the mechanical arm according to the touch instruction, and controlling the touch head to execute touch operation on the touch terminal according to touch operation in the touch instruction when the touch detection device detects that the touch head touches the touch screen of the touch terminal.
In a fourth aspect of the embodiments of the present application, a computer-readable medium is provided, on which a computer program is stored, the program being executed by a processor to implement the steps of any one of the testing methods of the embodiments of the present application.
In a fifth aspect of embodiments of the present application, there is provided a test apparatus comprising:
the display module is used for displaying a projection picture of a current operation interface of the touch terminal; the projection picture is used for a user to execute remote operation on the touch terminal;
the detection module is used for detecting the operation executed by the user on the projection picture;
the touch instruction generating module is used for generating a touch instruction aiming at the touch terminal if the detected operation is a preset operation; the touch instruction comprises touch operation corresponding to the detected operation;
a touch instruction sending module, configured to send the touch instruction to a test device on which the touch terminal is placed, where the test device is configured to perform the following operations: moving the mechanical arm according to the touch instruction, and controlling a touch head to execute touch operation on the touch terminal according to the touch operation in the touch instruction when a touch detection device on the mechanical arm detects that the touch head on the mechanical arm touches a touch screen of the touch terminal;
and the projection interface receiving processing module is used for receiving and displaying a projection picture of the operation interface of the touch terminal after the test equipment executes the touch operation.
In a sixth aspect of embodiments of the present application, there is provided a computing device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of any one of the test methods in the embodiments of the present application when executing the program.
According to the test scheme of the embodiment of the application, the test equipment can be driven to execute the touch operation on the touch terminal according to the operation of the user in the remote operation interface for operating the touch terminal, so that the touch operation of a human is simulated to operate the touch terminal without directly generating an operation instruction executable by the touch terminal, the requirement on a touch terminal system is remarkably reduced, whether the system is an open source system or not is applicable, and better experience can be brought to the user.
Drawings
The above and other objects, features and advantages of exemplary embodiments of the present application will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. Several embodiments of the present application are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:
fig. 1 schematically shows an application scenario diagram according to an embodiment of the present application;
FIG. 2 schematically illustrates a structural schematic of a test apparatus according to another embodiment of the present application;
FIG. 3 schematically shows a structural schematic of a test apparatus according to yet another embodiment of the present application;
FIG. 4 schematically illustrates a three-axis table according to yet another embodiment of the present application;
FIG. 5 schematically illustrates a flow diagram of a testing method according to yet another embodiment of the present application;
FIG. 6 schematically illustrates one of the interface diagrams of a testing method according to yet another embodiment of the present application;
FIG. 7 schematically illustrates a second interface diagram of a testing method according to yet another embodiment of the present application;
FIG. 8 schematically illustrates a third interface diagram of a testing method according to yet another embodiment of the present application;
FIG. 9 schematically shows a program product for performing a testing method according to an embodiment of the present application;
FIG. 10 schematically illustrates a structural schematic of a testing device according to an embodiment of the present application;
FIG. 11 schematically illustrates a structural schematic of a test system according to an embodiment of the present application;
FIG. 12 is a diagram schematically illustrating a hardware configuration of a computing device for a testing method according to an embodiment of the present invention;
in the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
Detailed Description
The principles and spirit of the present application will be described with reference to a number of exemplary embodiments. It should be understood that these embodiments are given solely for the purpose of enabling those skilled in the art to better understand and to practice the present application, and are not intended to limit the scope of the present application in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
As will be appreciated by one skilled in the art, embodiments of the present application may be embodied as a system, apparatus, device, method, or computer program product. Accordingly, the present disclosure may be embodied in the form of: entirely hardware, entirely software (including firmware, resident software, micro-code, etc.), or a combination of hardware and software.
According to embodiments of the present application, a test device, a method, a system, a medium, an apparatus, and a computing device are provided.
In this context, it is to be understood that the term three-axis table as referred to means a device capable of driving a robot arm in three mutually perpendicular directions.
Moreover, any number of elements in the drawings are by way of example and not by way of limitation, and any nomenclature is used solely for differentiation and not by way of limitation.
The principles and spirit of the present application are explained in detail below with reference to several representative embodiments of the present application.
Summary of The Invention
The inventor finds that the operation instructions generated by the existing cloud test platform are all the reasons for the instructions that can be directly executed by the system of the intelligent terminal device, and the system to which the cloud test method in the prior art can be applied must be open-source. For example, for the test mobile phone, the gesture operation is not performed on the test mobile phone, but an operation instruction corresponding to the gesture operation is directly sent to the test mobile phone for execution. Such a test method can only be tested against open source systems such as the android system.
To this end, the application implementation method provides test equipment, a test method, a test system, a test device, a test medium and computing equipment. Taking a test system as an example, the test system: including touch terminal, test equipment, cloud test platform, wherein:
the touch terminal is used for being in communication connection with the cloud test platform and sending a current operation interface to the cloud test platform; after the touch operation executed by the test equipment is detected, the operation interface after the touch operation is sent to the cloud test platform;
the cloud test platform is used for displaying a projection picture of a current operation interface of the touch terminal; the projection picture is used for a user to execute remote operation on the touch terminal; detecting an operation executed by a user on the projection picture; if the detected operation is a preset operation, generating a touch instruction for the touch terminal; the touch instruction comprises touch operation corresponding to the detected operation; sending the touch instruction to test equipment for placing the touch terminal; receiving a projection picture of an operation interface of the touch terminal after the test equipment executes the touch operation;
the test equipment is used for receiving a touch instruction sent by the cloud test platform, moving the mechanical arm according to the touch instruction, and controlling the touch head to execute touch operation on the touch terminal according to touch operation in the touch instruction when the touch detection device detects that the touch head touches the touch screen of the touch terminal.
In summary, according to the technical scheme provided by the embodiment of the application, the test equipment can be driven to execute the touch operation on the touch terminal according to the operation of the user in the remote operation interface for operating the touch terminal, so that the touch operation of a human simulator is realized to operate the touch terminal without directly generating an operation instruction executable by the touch terminal, and thus the requirement on a touch terminal system is remarkably reduced, and therefore, whether the system is an open source system or not is applicable to the embodiment of the application, and better experience can be brought to the user.
Having described the basic principles of the present application, various non-limiting embodiments of the present application are described in detail below.
Application scene overview
Fig. 1 is a schematic view of an application scenario provided in an embodiment of the present application. The scenario may include, for example, a user 10, a touch terminal 11, a cloud test platform 12, and a test device 13. The cloud test platform may include a server 121 and a terminal device 122. The terminal device 122 may be installed with a browser to facilitate remote operation of the touch terminal 11. Various clients, such as a game application, a financial application, a health management application, etc., may be installed in the touch terminal 11. Wherein:
the touch terminal 11 is placed on the testing equipment 13, the touch terminal 11 is in communication connection with the server 121 of the cloud testing platform 12, and sends the current operation interface to the server 121;
the server 121 receives the current operation interface sent by the touch device 11 and forwards the current operation interface to the terminal device 122 of the cloud test platform 12;
the terminal device 122 displays a projection picture of the current operation interface of the touch terminal 11;
the user 10 performs an operation on the projection screen to realize remote control of the touch terminal 11;
the terminal device 122 detects an operation of a user, and if the detected operation is a preset operation, generates a touch instruction for the touch terminal and sends the touch instruction to the server 121; or, the terminal device 122 detects an operation of a user, and sends the operation of the user to the server 121, and if the server 121 determines that the operation is a preset operation, generates a touch instruction for the touch terminal;
the server 121 sends the touch instruction to the test equipment 13;
the test device 13 is configured to receive a touch instruction sent by the server 121, move the mechanical arm according to the touch instruction, and control the touch head to execute a touch operation on the touch terminal according to a touch operation in the touch instruction when receiving that the touch detection device detects that the touch head touches a touch screen of the touch terminal;
the touch terminal 11 performs corresponding processing according to the touch operation of the touch head, and sends the processed current operation interface to the server 121; the server 121 sends the processed current operation interface to the terminal device 122 for displaying, so that the user 10 can see the projection screen of the touch terminal after the touch operation.
The touch terminal 11 and the server 121 may be communicatively connected through a communication network, where the network may be a local area network, a wide area network, or the like. The touch terminal 11 may be a mobile phone, a tablet computer, an e-book reader, etc.
Exemplary device
In connection with the application scenario of fig. 1, a test device according to an exemplary embodiment of the present application is described below with reference to fig. 2-4. It should be noted that the above application scenarios are only presented to facilitate understanding of the spirit and principles of the present application, and the embodiments of the present application are not limited in this respect. Rather, embodiments of the present application may be applied to any scenario where applicable.
As shown in fig. 2, which is a schematic structural diagram of the testing apparatus provided in the embodiment of the present application, the testing apparatus includes a stage 20, a support 21, a touch control head 22, a three-axis table 23 on which a robot 231 and a table 232 are mounted, and a touch detection device 24, wherein:
the carrying platform 20 is used for carrying a touch terminal 25;
the touch head 22 is installed at one end of the mechanical arm 231 far away from the workbench 232;
the touch detection device 24 is disposed on the mechanical arm 231, and is configured to detect whether the touch head 22 touches the touch screen of the touch terminal 25;
the three-axis table 23 may control the robot arm 231 to move in the horizontal direction and the vertical direction;
the three-axis workbench 23 is configured to receive a touch instruction sent by a cloud test platform, move the mechanical arm 231 according to the touch instruction, and control the touch head 22 to execute a touch operation on the touch terminal 25 according to a touch operation in the touch instruction when the touch detection device 24 detects that the touch head 22 touches the touch screen of the touch terminal 25.
In one embodiment, the touch detection device 24 may be a distance sensor and/or a pressure sensor.
Taking the distance sensor as an example, assuming that the distance sensor detects the distance from the touch terminal, when the distance is less than or equal to the set distance, it means that the touch head touches the touch terminal.
Taking the pressure sensor as an example, the pressure sensor detects a pressure with the touch terminal, and when the pressure is greater than or equal to a set pressure, it indicates that the touch head touches the touch terminal. During specific implementation, the pressure sensor can be arranged on one surface of the touch screen contacted by the touch head, or can be arranged on the mechanical arm in parallel with the touch head, and after debugging, the pressure sensor can be simultaneously contacted with the touch screen and can detect certain pressure when the touch head touches the touch screen.
Of course, in specific implementation, other types of touch detection devices can be selected according to actual requirements, and are all suitable for the embodiment of the present application. In addition, the position of the touch detection device can be determined according to actual requirements as long as the touch detection device can detect that the touch head touches the touch terminal, and the application does not limit the position.
In one embodiment, in order to facilitate the placement of the touch terminal 25, the carrier platform 20 has a groove (as shown in fig. 3) for carrying the touch terminal 25.
Wherein, in one embodiment, the horizontal direction comprises a first direction and a second direction perpendicular to the first direction; the three-axis table further comprises a first linear drive motor, a second linear drive motor and a third linear drive motor;
the first linear driving motor is used for controlling the mechanical arm 231 to move in the first direction according to the touch instruction;
the second linear driving motor is used for controlling the mechanical arm 231 to move in the second direction according to the touch instruction;
the third linear driving motor is used for controlling the robot arm 231 to move in the vertical direction according to the touch instruction.
Fig. 4 is a schematic structural diagram of a slide rail of a three-axis workbench for controlling the movement of a mechanical arm. The robot comprises a first linear slide rail 401, a second linear slide rail 402 and a third linear slide rail 403, wherein the second linear slide rail moves on the first linear slide rail according to the arrow 1 direction, the third linear slide rail moves on the second linear slide rail according to the arrow 2 direction, and the robot arm 231 moves on the third linear slide rail according to the arrow 3 direction. The linear driving motor can drive the corresponding sliding rail to move and the mechanical arm to move, so that the mechanical arm can move in the horizontal direction and the vertical direction. The installation position of each linear driving motor can be determined according to actual requirements, and the installation position is not limited in the application.
In one embodiment, in order to implement a touch operation, the target position of the touch head 22 is included in the touch instruction;
the three-axis workbench is specifically configured to determine a working path of the mechanical arm 231 according to the target position, and move the mechanical arm 231 according to the working path; wherein the working path is a working path before the touch head 22 performs the touch operation.
Or, the touch instruction includes a working path of the robot arm 231; the working path is a working path before the touch head 22 performs a touch operation, and the three-axis worktable is specifically configured to move the robot arm 231 according to the working path.
For example, if the designated position moved above the touch point of the touch device is set as the target position of the touch head, the above-mentioned working path of the robot arm is formed from the start of moving the robot arm to the end of the target position.
To sum up, in this application embodiment, through test equipment, can realize the control to the touch-control head on the arm, can realize the touch-control operation that the simulation manual work sent through mechanical control touch-control head to realize the test. Since the touch operation is physically triggered, an operation instruction executed by the touch terminal system does not need to be generated, and thus the method can be applied to any system.
Exemplary method
In connection with the application scenario of fig. 1 and the test devices of fig. 2-4, a test method according to an exemplary embodiment of the present application is described below with reference to fig. 5-8. It should be noted that the above application scenarios and test equipment are merely illustrated for the convenience of understanding the spirit and principles of the present application, and the embodiments of the present application are not limited in this respect. Rather, embodiments of the present application may be applied to any scenario where applicable.
As shown in fig. 5, a schematic flow chart of the testing method provided in the embodiment of the present application includes:
step 501: displaying a projection picture of a current operation interface of the touch terminal; the projection picture is used for a user to execute remote operation on the touch terminal.
Step 502: and detecting the operation executed by the user on the projection picture.
Step 503: if the detected operation is a preset operation, generating a touch instruction for the touch terminal; the touch instruction comprises touch operation corresponding to the detected operation.
Wherein, in one embodiment, the touch operation is any one of the following: click operation, drag operation, zoom operation, and the like.
Step 504: sending the touch instruction to test equipment for placing the touch terminal, wherein the test equipment is used for executing the following operations: and moving the mechanical arm according to the touch instruction, and controlling the touch head to execute touch operation on the touch terminal according to the touch operation in the touch instruction when the touch detection device on the mechanical arm detects that the touch head on the mechanical arm touches the touch screen of the touch terminal.
Step 505: and receiving and displaying a projection picture of an operation interface of the touch terminal after the test equipment executes the touch operation.
Further, in this embodiment of the present application, in order to facilitate control of the test device, if the detected operation is a preset operation, the method further includes one of the following two methods:
(1) determining a target position of a mechanical arm of the test equipment according to the detected operation position of the operation in the projection picture, and adding the target position into the touch instruction;
(2) and determining a working path of the mechanical arm according to the detected operation position of the operation in the projection picture, the pre-obtained initial position of the mechanical arm of the test equipment and the position of the touch terminal, and adding the working path into the touch instruction.
According to the method (1), after receiving a touch instruction, the test equipment can determine a working path of the mechanical arm according to the target position and move the mechanical arm according to the working path; the working path is the working path before the touch control head executes touch control operation. That is, the test device may determine a working path according to the target position and then perform a corresponding operation according to the working path. Of course, when the processing capability of the test device is limited, the working path may be directly obtained from the touch instruction according to the method (2).
In specific implementation, a test log generated by the touch terminal and sent by the touch terminal may also be received, where the test log may include a time when the touch operation is detected, a time when the touch operation is completed, a function of the touch operation (e.g., a function of opening an application), and the like. Of course, the content in the test log may be determined according to actual requirements, so as to provide basic data for later test analysis.
In summary, in the embodiment of the application, a user can remotely install an application program on any interested touch terminal, and operate and test the application program. There is no requirement or limitation on the system of the touch terminal.
The following provides a further description of the test methods provided in the examples of the present application.
Assuming that a user wants to experience a new application, the user can experience the new application through a simulation environment provided by the test platform without installing the new application on the mobile phone, so that the aim of protecting the mobile phone can be fulfilled. Specifically, a user may log in the test platform provided in the embodiment of the present application through a browser, and then select a model of his mobile phone in a user interface provided by the test platform as shown in fig. 6, and enter the test interface. And then the platform projects the operation interface of the mobile phone selected by the user into the browser.
The effect diagram of the test interface is shown in fig. 7, in which the user can mouse click "app store". The test platform determines the mouse click operation as the operation of clicking the application store in the touch operation, then generates a touch instruction of the touch application store and sends the touch instruction to the test equipment for execution. And the test equipment moves the mechanical arm to perform touch operation on the mobile phone according to the touch instruction. And then, after the mobile phone displays the operation interface of the application store, and so on, the installation is executed according to the application selected by the user on the projection interface of the application store interface. After the installation is completed, the user can try the installed application through the browser.
Regarding the zooming operation, for example, the iOS operating system is taken as an example, in which the zooming operation can be selected by one click in the shortcut operation interface, and then the interface shown in fig. 8 is displayed to perform zooming. The user can drag one circle in the projection interface operated remotely through a mouse to achieve zooming. Thus, one touch head can realize zooming operation.
Certainly, in the specific implementation, the number of the touch heads may be two or even more than two, so that when the touch operation is performed, each touch head is used as one finger to perform a more complicated touch operation.
Exemplary Medium
Having described the method of the exemplary embodiments of the present application, a computer-readable medium for testing of the exemplary embodiments of the present application is described next. The embodiment of the present application provides a computer readable medium, on which a computer program is stored, which when executed by a processor implements the steps in the test method according to various exemplary embodiments of the present application described in the above section "exemplary method" of the present specification, such as implementing step 501 shown in fig. 5, displaying a projection screen of a current operation interface of a touch terminal; the projection picture is used for a user to execute remote operation on the touch terminal; step 502, detecting an operation executed by a user on the projection picture; step 503, if the detected operation is a preset operation, generating a touch instruction for the touch terminal; the touch instruction comprises touch operation corresponding to the detected operation; step 504, sending the touch instruction to a test device on which the touch terminal is placed, where the test device is configured to perform the following operations: moving the mechanical arm according to the touch instruction, and controlling a touch head to execute touch operation on the touch terminal according to the touch operation in the touch instruction when a touch detection device on the mechanical arm detects that the touch head on the mechanical arm touches a touch screen of the touch terminal; step 505: and receiving and displaying a projection picture of an operation interface of the touch terminal after the test equipment executes the touch operation.
The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
As shown in fig. 9, a program product 90 for testing, which may be in the form of a portable compact disc read only memory (CD-ROM), including program code, and which may be run on a device, according to an embodiment of the present application, is described. However, the program product of the present application is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code for carrying out operations of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device.
Exemplary devices
Having described the media of the exemplary embodiment of the present application, next, a test apparatus of the exemplary embodiment of the present application will be described with reference to fig. 10. It should be noted that the inventive concept of the apparatus portion is the same as that of the method of the embodiment, and the detailed description and the advantageous effects thereof are not repeated herein.
As shown in fig. 10, a schematic structural diagram of a testing apparatus includes:
the display module 1001 is configured to display a projection screen of a current operation interface of the touch terminal; the projection picture is used for a user to execute remote operation on the touch terminal;
a detection module 1002, configured to detect an operation performed by a user on the projection screen;
a touch instruction generating module 1003, configured to generate a touch instruction for the touch terminal if the detected operation is a preset operation; the touch instruction comprises touch operation corresponding to the detected operation;
a touch instruction sending module 1004, configured to send the touch instruction to a test device on which the touch terminal is placed, where the test device is configured to perform the following operations: moving the mechanical arm according to the touch instruction, and controlling a touch head to execute touch operation on the touch terminal according to the touch operation in the touch instruction when a touch detection device on the mechanical arm detects that the touch head on the mechanical arm touches a touch screen of the touch terminal;
a projection interface receiving processing module 1005, configured to receive and display a projection screen of the operation interface of the touch terminal after the test device executes the touch operation.
In one embodiment, if the detected operation is a preset operation, the apparatus further includes:
a target position processing module 1006, configured to determine a target position of a manipulator of the test equipment according to the detected operation position of the operation in the projection screen, and add the target position to the touch instruction.
In one embodiment, if the detected operation is a preset operation, the apparatus further includes:
a working path determining module 1007, configured to determine a working path of the manipulator according to an operation position of the detected operation in the projection screen, an initial position of the manipulator of the test equipment obtained in advance, and a position of the touch terminal, and add the working path to the touch instruction.
Wherein, in one embodiment, the touch operation is any one of the following: click operation, drag operation, zoom operation.
Exemplary System
Having described the apparatus, method, medium, and apparatus of the exemplary embodiments of the present application, a system for testing of the exemplary embodiments of the present application will now be described with reference to fig. 11. It should be noted that the inventive concept of the system part is the same as that of the embodiment method, and the detailed description and the advantageous effects thereof are not repeated herein.
As shown in fig. 11, is a schematic structural diagram of the system, including: touch-control terminal 111, test equipment 112, cloud test platform 113, wherein:
the touch terminal 111 is used for being in communication connection with the cloud test platform and sending a current operation interface to the cloud test platform; after the touch operation executed by the test equipment is detected, the operation interface after the touch operation is sent to the cloud test platform;
the cloud test platform 113 is used for displaying a projection picture of a current operation interface of the touch terminal; the projection picture is used for a user to execute remote operation on the touch terminal; detecting an operation executed by a user on the projection picture; if the detected operation is a preset operation, generating a touch instruction for the touch terminal; the touch instruction comprises touch operation corresponding to the detected operation; sending the touch instruction to test equipment for placing the touch terminal; and receiving a projection picture of an operation interface of the touch terminal after the test equipment executes the touch operation
The testing device 112 is configured to receive a touch instruction sent by the cloud testing platform, move the mechanical arm according to the touch instruction, and control the touch head to execute a touch operation on the touch terminal according to a touch operation in the touch instruction when the touch detection device detects that the touch head touches the touch screen of the touch terminal.
The test platform described herein and the test apparatus described above may be the same device, and in specific implementation, the test apparatus may also be a built-in plug-in the test platform.
Exemplary computing device
Having described the apparatus, methods, media, systems, and devices of the exemplary embodiments of the present application, a computing device for testing of the exemplary embodiments of the present application is described next with reference to fig. 12.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
In some possible embodiments, the computing device of the present invention may include at least one processor, and at least one memory. Wherein the memory stores program code that, when executed by the processor, causes the processor to perform various steps of testing in accordance with various exemplary embodiments of the present invention as described in the "exemplary methods" section above. For example, the processor may execute step 501 shown in fig. 5, and display a projection screen of a current operation interface of the touch terminal; the projection picture is used for a user to execute remote operation on the touch terminal; step 502, detecting an operation executed by a user on the projection picture; step 503, if the detected operation is a preset operation, generating a touch instruction for the touch terminal; the touch instruction comprises touch operation corresponding to the detected operation; step 504, sending the touch instruction to a test device on which the touch terminal is placed, where the test device is configured to perform the following operations: moving the mechanical arm according to the touch instruction, and controlling a touch head to execute touch operation on the touch terminal according to the touch operation in the touch instruction when a touch detection device on the mechanical arm detects that the touch head on the mechanical arm touches a touch screen of the touch terminal; step 505: and receiving and displaying a projection picture of an operation interface of the touch terminal after the test equipment executes the touch operation.
Computing device 120 according to an embodiment of the invention is described below with reference to FIG. 12. The computing device shown in FIG. 12 is only one example and should not impose any limitations on the scope of use or functionality of embodiments of the present invention.
As shown in fig. 12, computing device 1200 may take the form of a general purpose computing device, which may be a server device, for example. Components of computing device 1200 may include, but are not limited to: the at least one processor 1201, the at least one memory 1202, and the bus 1203 connecting the various system components (including the memory 1202 and the processor 1201).
The bus 1203 includes a data bus, an address bus, and a control bus.
The memory 1202 may include volatile memory, such as Random Access Memory (RAM)12021 and/or cache memory 12022, and may further include Read Only Memory (ROM) 12023.
Memory 1202 may also include programs/utilities 12025 having a set (at least one) of program modules 12024, such program modules 12024 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
Computing device 1200 may also communicate with one or more external devices 1204, such as a keyboard, pointing device, etc. Such communication may occur via input/output (I/O) interfaces 1205. Moreover, computing device 1200 may also communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) through network adapter 1206. As shown, a network adapter 1206 communicates with the other modules of the computing device 1200 over a bus 1203. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the computing device 1200, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
It should be noted that although in the above detailed description several units/modules or sub-units/sub-modules of the testing device are mentioned, such a division is merely exemplary and not mandatory. Indeed, the features and functionality of two or more of the units/modules described above may be embodied in one unit/module, according to embodiments of the application. Conversely, the features and functions of one unit/module described above may be further divided into embodiments by a plurality of units/modules.
Further, while the operations of the methods of the present application are depicted in the drawings in a particular order, this does not require or imply that these operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.
While the spirit and principles of the application have been described with reference to several particular embodiments, it is to be understood that the application is not limited to the disclosed embodiments, nor is the division of aspects, which is for convenience only as the features in such aspects may not be combined to benefit from the description. The application is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims (16)

1. The utility model provides a test equipment, includes objective platform, support, touch head, installs the triaxial workstation of arm and workstation, touch-control detection device, wherein:
the carrying platform is used for carrying a touch terminal;
the touch control head is arranged at one end of the mechanical arm far away from the workbench;
the touch detection device and the touch head are arranged on the mechanical arm in parallel and used for detecting whether the touch head touches a touch screen of the touch terminal; the touch detection device is a distance sensor and/or a pressure sensor;
the three-axis workbench can control the mechanical arm to move in the horizontal direction and the vertical direction;
the three-axis workbench is used for receiving a touch instruction sent by a cloud test platform, moving the mechanical arm according to the touch instruction, and controlling the touch head to execute touch operation on the touch terminal according to touch operation in the touch instruction when the touch detection device detects that the touch head touches a touch screen of the touch terminal;
the touch terminal is used for being in communication connection with the cloud test platform and sending a current operation interface to the cloud test platform; after the touch operation executed by the test equipment is detected, the operation interface after the touch operation is sent to the cloud test platform, wherein the cloud test platform is used for displaying a projection picture of the current operation interface of the touch terminal; the projection picture is used for a user to execute remote operation on the touch terminal; detecting an operation executed by a user on the projection picture; if the detected operation is a preset operation, generating a touch instruction for the touch terminal; the touch instruction comprises touch operation corresponding to the detected operation; sending the touch instruction to test equipment for placing the touch terminal; and receiving a projection picture of an operation interface of the touch terminal after the test equipment executes the touch operation from the touch terminal.
2. The test device of claim 1, the touch instruction including a target position of the touch head;
the three-axis workbench is specifically used for determining a working path of the mechanical arm according to the target position and moving the mechanical arm according to the working path; the working path is the working path before the touch control head executes touch control operation.
3. The test equipment of claim 1, wherein the touch instructions include a work path of the robotic arm; the working path is a working path before the touch control head executes touch control operation,
the three-axis table is specifically configured to move the mechanical arm according to the working path.
4. The test apparatus of claim 1, the stage platform having a recess for carrying the touch terminal.
5. The test apparatus of claim 1, the horizontal direction comprising a first direction and a second direction perpendicular to the first direction; the three-axis table further comprises a first linear drive motor, a second linear drive motor and a third linear drive motor;
the first linear driving motor is used for controlling the mechanical arm to move in the first direction according to the touch control instruction;
the second linear driving motor is used for controlling the mechanical arm to move in the second direction according to the touch control instruction;
the third linear driving motor is used for controlling the mechanical arm to move in the vertical direction according to the touch control instruction.
6. A method of testing, comprising:
the touch control terminal is in communication connection with the touch control terminal and displays a projection picture of a current operation interface of the touch control terminal;
the projection picture is used for a user to execute remote operation on the touch terminal;
detecting an operation executed by a user on the projection picture;
if the detected operation is a preset operation, generating a touch instruction for the touch terminal; the touch instruction comprises touch operation corresponding to the detected operation;
sending the touch instruction to test equipment for placing the touch terminal, wherein the test equipment is used for executing the following operations: moving the mechanical arm according to the touch instruction, and controlling a touch head to execute touch operation on the touch terminal according to the touch operation in the touch instruction when a touch detection device on the mechanical arm detects that the touch head on the mechanical arm touches a touch screen of the touch terminal; the touch detection device is a distance sensor and/or a pressure sensor; the touch detection device and the touch head are arranged on the mechanical arm in parallel;
and receiving and displaying a projection picture of an operation interface of the touch terminal after the test equipment executes the touch operation from the touch terminal.
7. The testing method of claim 6, if the detected operation is a predetermined operation, the method further comprising:
and determining a target position of a mechanical arm of the test equipment according to the detected operation position of the operation in the projection picture, and adding the target position into the touch instruction.
8. The testing method of claim 6, if the detected operation is a predetermined operation, the method further comprising:
and determining a working path of the mechanical arm according to the detected operation position of the operation in the projection picture, the pre-obtained initial position of the mechanical arm of the test equipment and the position of the touch terminal, and adding the working path into the touch instruction.
9. The test method according to any one of claims 6 to 8, wherein the touch operation is any one of: click operation, drag operation, zoom operation.
10. A test system comprises a touch terminal, test equipment and a cloud test platform, wherein:
the touch terminal is used for being in communication connection with the cloud test platform and sending a current operation interface to the cloud test platform; after the touch operation executed by the test equipment is detected, the operation interface after the touch operation is sent to the cloud test platform;
the cloud test platform is used for displaying a projection picture of a current operation interface of the touch terminal; the projection picture is used for a user to execute remote operation on the touch terminal; detecting an operation executed by a user on the projection picture; if the detected operation is a preset operation, generating a touch instruction for the touch terminal; the touch instruction comprises touch operation corresponding to the detected operation; sending the touch instruction to test equipment for placing the touch terminal; and receiving a projection picture of an operation interface of the touch terminal after the test equipment executes the touch operation from the touch terminal
The test equipment is used for receiving a touch instruction sent by the cloud test platform, moving the mechanical arm according to the touch instruction, and controlling the touch head to execute touch operation on the touch terminal according to touch operation in the touch instruction when receiving that the touch detection device detects that the touch head touches the touch screen of the touch terminal; the touch detection device is a distance sensor and/or a pressure sensor; the touch detection device and the touch head are arranged on the mechanical arm in parallel.
11. A computer-readable medium, on which a computer program is stored which is executed by a processor for carrying out the steps of the method of any one of claims 6 to 9.
12. A test apparatus, comprising:
the display module is used for being in communication connection with the touch terminal and displaying a projection picture of a current operation interface of the touch terminal; the projection picture is used for a user to execute remote operation on the touch terminal;
the detection module is used for detecting the operation executed by the user on the projection picture;
the touch instruction generating module is used for generating a touch instruction aiming at the touch terminal if the detected operation is a preset operation; the touch instruction comprises touch operation corresponding to the detected operation;
a touch instruction sending module, configured to send the touch instruction to a test device on which the touch terminal is placed, where the test device is configured to perform the following operations: moving the mechanical arm according to the touch instruction, and controlling a touch head to execute touch operation on the touch terminal according to the touch operation in the touch instruction when a touch detection device on the mechanical arm detects that the touch head on the mechanical arm touches a touch screen of the touch terminal; the touch detection device is a distance sensor and/or a pressure sensor; the touch detection device and the touch head are arranged on the mechanical arm in parallel;
and the projection interface receiving processing module is used for receiving and displaying a projection picture of the operation interface of the touch terminal after the touch operation is executed by the test equipment from the touch terminal.
13. The apparatus of claim 12, further comprising, if the detected operation is a predetermined operation:
and the target position processing module is used for determining the target position of the mechanical arm of the test equipment according to the detected operation position of the operation in the projection picture, and adding the target position into the touch instruction.
14. The apparatus of claim 12, further comprising, if the detected operation is a predetermined operation:
and the working path determining module is used for determining the working path of the mechanical arm according to the detected operation position of the operation in the projection picture, the pre-obtained initial position of the mechanical arm of the test equipment and the position of the touch terminal, and adding the working path into the touch instruction.
15. The apparatus according to any one of claims 12-14, wherein the touch operation is any one of: click operation, drag operation, zoom operation.
16. A computing device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method of any one of claims 6 to 9 when executing the program.
CN201710495645.0A 2017-06-26 2017-06-26 Test device, method, system, medium, apparatus, and computing device Active CN107395844B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710495645.0A CN107395844B (en) 2017-06-26 2017-06-26 Test device, method, system, medium, apparatus, and computing device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710495645.0A CN107395844B (en) 2017-06-26 2017-06-26 Test device, method, system, medium, apparatus, and computing device

Publications (2)

Publication Number Publication Date
CN107395844A CN107395844A (en) 2017-11-24
CN107395844B true CN107395844B (en) 2020-07-03

Family

ID=60333554

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710495645.0A Active CN107395844B (en) 2017-06-26 2017-06-26 Test device, method, system, medium, apparatus, and computing device

Country Status (1)

Country Link
CN (1) CN107395844B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110119219A (en) * 2018-02-06 2019-08-13 深圳市华夏双赢通信有限公司 Touch screen clicks control system and control method
CN111147651A (en) * 2019-12-10 2020-05-12 深圳市晨浩电声电子有限公司 Pressure-adjustable automatic clamp device for mobile phone audio test
CN112578209A (en) * 2020-12-10 2021-03-30 京东方科技集团股份有限公司 Touch control testing device and testing method
CN113407398A (en) * 2021-06-11 2021-09-17 展讯通信(上海)有限公司 Touch screen detection robot, detection method, device and medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105137860A (en) * 2015-07-31 2015-12-09 重庆世纪精信实业(集团)有限公司 Remote monitoring and control system for industrial manipulator based on Internet
CN105763705A (en) * 2016-04-28 2016-07-13 北京易诚高科科技发展有限公司 Dual-finger manipulator for mobile phone testing

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8761938B2 (en) * 2008-04-18 2014-06-24 David Jenkinson Robotic device tester
CN102387232A (en) * 2010-09-03 2012-03-21 宁波普天通信技术有限公司 General mobile phone testing system based on triaxial pushbutton and pattern recognition
US20120280934A1 (en) * 2011-05-04 2012-11-08 Apple Inc. Simulating Single and Multi-Touch Events for Testing A Touch Panel
CN103577320A (en) * 2012-08-07 2014-02-12 卓望数码技术(深圳)有限公司 Testing method and system of remote terminals
CN103076770B (en) * 2012-12-05 2017-07-07 瞬联软件科技(北京)有限公司 Mobile device remote test system based on manipulator
US9948411B2 (en) * 2014-12-05 2018-04-17 W2Bi, Inc. Smart box for automatic feature testing of smart phones and other devices

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105137860A (en) * 2015-07-31 2015-12-09 重庆世纪精信实业(集团)有限公司 Remote monitoring and control system for industrial manipulator based on Internet
CN105763705A (en) * 2016-04-28 2016-07-13 北京易诚高科科技发展有限公司 Dual-finger manipulator for mobile phone testing

Also Published As

Publication number Publication date
CN107395844A (en) 2017-11-24

Similar Documents

Publication Publication Date Title
CN107395844B (en) Test device, method, system, medium, apparatus, and computing device
CN103810089B (en) Automatically testing gesture-based applications
US10198345B2 (en) Test case generation for uncovered code paths
CN106897688B (en) Interactive projection apparatus, method of controlling interactive projection, and readable storage medium
US10807002B2 (en) Visual method and apparatus for compensating sound information, storage medium and electronic device
CN107992251B (en) Skill control method, skill control device, electronic equipment and storage medium
WO2015081841A1 (en) Devices and methods for test scenario reproduction
US9571930B2 (en) Audio data detection with a computing device
US9336121B2 (en) Capture and display of historical run-time execution traces in a code editor
US10081103B2 (en) Wearable device testing
US9599649B2 (en) System and method for electrostatic discharge testing of devices under test
US9645911B2 (en) System and method for debugging firmware/software by generating trace data
US8943477B2 (en) Debugging a graphical user interface code script with non-intrusive overlays
CN105453033A (en) Program testing service
KR20190078681A (en) System and Method for Artificial Neural Network Learning and Simulation
US20140258785A1 (en) Identifying a storage location for a storage address requested during debugging
CN112306447A (en) Interface navigation method, device, terminal and storage medium
US20190303110A1 (en) Virtual reality integrated development environment
CN105242920A (en) Image capture system, image capture method and electronic device
CN107589892B (en) Interaction method, system, equipment and storage medium for pull-down expansion of menu
CN112327009A (en) Test device, system and computer storage medium for testing touch mobile device
CN110515849A (en) A kind of breakpoint debugging method, device, system, equipment and storage medium
CN111258875A (en) Interface test method and system, electronic device and storage medium
CN110908578A (en) Virtual object moving method and device
CN114020164B (en) Stylus control method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20220614

Address after: 310052 room 509, building 3, No. 399, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province

Patentee after: Netease Youdao (Hangzhou) Intelligent Technology Co.,Ltd.

Address before: 100193 1 / F, block a, building 7, West Zhongguancun Software Park, yard 10, northwest Wangdong Road, Haidian District, Beijing

Patentee before: NETEASE YOUDAO INFORMATION TECHNOLOGY (BEIJING) Co.,Ltd.