CN114564401A

CN114564401A - Remote control method and computing device

Info

Publication number: CN114564401A
Application number: CN202210204176.3A
Authority: CN
Inventors: 张泽龙
Original assignee: Soyoung Technology Beijing Co Ltd
Current assignee: Beijing New Oxygen World Wide Technology Consulting Co ltd
Priority date: 2022-03-02
Filing date: 2022-03-02
Publication date: 2022-05-31

Abstract

The invention relates to a remote control method and a computing device. The remote control method comprises the following steps: displaying an application interface of target test equipment in a display interface of a client, wherein the target test equipment is equipment corresponding to target information, and the target information is information determined from a test equipment information set based on first operation; obtaining a second operation of the application interface aiming at the target test equipment through a display interface of the client; and responding to the second operation, generating an operation command for the target test equipment, and transmitting the operation command to the second server side so that the second server side controls the target test equipment to perform application test. The scheme of the invention can realize that a plurality of users can respectively remotely control the testing equipment in distributed arrangement.

Description

Remote control method and computing device

Technical Field

The invention relates to the technical field of software testing, in particular to a remote control method and a computing device.

Background

In the related art, in order to ensure that an online Application (APP) can be applied to terminal devices (such as smartphones of different models) produced by different terminal device manufacturers, compatibility testing needs to be performed on the APP.

However, the terminal devices in the related art need to be distributed in the same area network in order to control the terminal devices to perform the test. It is difficult in the related art to remotely control a plurality of terminal apparatuses distributively registered in different area networks, respectively.

Disclosure of Invention

The technical scheme of the invention breaks through the network limitation and can remotely control the test equipment connected to the server under various networks.

A first aspect of the present invention provides a remote control method performed by a client, including: displaying an application interface of target test equipment in a display interface of a client, wherein the target test equipment is equipment corresponding to target information, and the target information is information determined from a test equipment information set based on first operation; obtaining a second operation of the application interface aiming at the target test equipment through a display interface of the client; and responding to the second operation, generating an operation command for the target test equipment, and transmitting the operation command to the second server side so that the second server side controls the target test equipment to perform application test.

A second aspect of the present invention provides a remote control method executed by a first server, including: in response to obtaining an operation command from the client, storing the operation command in a command data set, the operation command being a command for a target test device corresponding to the application interface; obtaining an operation command downloading request from a second server, wherein the operation command downloading request comprises a unique identification code of the test equipment; and responding to the operation command downloading request, and transmitting an operation command corresponding to the unique identification code of the test equipment in the command data set to the second server so that the second server executes the operation command and controls the target test equipment to perform application test.

A third aspect of the present invention provides a remote control method performed by a second server, including: obtaining local test equipment data, wherein the local test equipment data comprises a test equipment unique identification code of at least one test equipment connected with a second server end; sending an operation command downloading request to a first server side, wherein the operation command downloading request comprises a test equipment unique identification code in local test equipment data; and obtaining an operation command corresponding to the unique identification code of the test equipment from the first server, and executing the operation command to control the target test equipment to perform application test.

A fourth aspect of the present invention provides a remote control apparatus, provided at a client, including: the device comprises an application interface display module, a second operation obtaining module and an operation command generating module. The application interface display module is used for displaying an application interface of the target test equipment in a display interface of the client, the target test equipment is equipment corresponding to the target information, and the target information is information determined from the test equipment information set based on the first operation; the second operation obtaining module is used for obtaining a second operation of the application interface aiming at the target test equipment through the display interface of the client; the operation command generating module is used for responding to the second operation, generating an operation command aiming at the target test equipment, and transmitting the operation command to the second server side so that the second server side controls the target test equipment to perform application test.

A fifth aspect of the present invention provides a remote control device, disposed at a first server, including: the device comprises an operation command storage module, a command downloading request acquisition module and an operation command transmission module. The operation command storage module is used for responding to an operation command obtained from the client and storing the operation command in the command data set, wherein the operation command is a command for the target test equipment corresponding to the application interface; the command downloading request obtaining module is used for obtaining an operation command downloading request from the second server side, and the operation command downloading request comprises the unique identification code of the test equipment; the operation command transmission module is used for responding to the operation command downloading request, transmitting the operation command corresponding to the unique identification code of the test equipment in the command data set to the second server so that the second server can execute the operation command and control the target test equipment to perform application test.

A sixth aspect of the present invention provides a remote control device, provided on a second server side, including: the device comprises a local test equipment data acquisition module, a command downloading request sending module and an operation command execution module. The local test equipment data acquisition module is used for acquiring local test equipment data, and the local test equipment data comprises a test equipment unique identification code of at least one test equipment connected with the second server end; the command downloading request sending module is used for sending an operation command downloading request to the first server side, wherein the operation command downloading request comprises a test equipment unique identification code in local test equipment data; the operation command execution module is used for obtaining an operation command corresponding to the unique identification code of the test equipment from the first server and executing the operation command so as to control the target test equipment to perform application test.

A seventh aspect of the present invention provides a remote control system comprising: a client for performing the method performed by the client as described above; a first server for executing the method as described above; and the second server side is used for executing the method executed by the second server side.

An eighth aspect of the present invention provides a computing apparatus comprising: a processor; and a memory having executable code stored thereon, which when executed by the processor, causes the processor to perform the method as above.

A ninth aspect of the invention provides a non-transitory machine-readable storage medium having stored thereon executable code which, when executed by a processor of a computing device, causes the processor to perform the method as above.

A tenth aspect of the invention provides a computer program product comprising executable code which, when executed by a processor of a computing device, causes the processor to perform the method as above.

The technical scheme provided by the invention can have the following beneficial effects:

according to the remote control method, the remote control device, the remote control system and the remote control computing device, after the application interface of the target test equipment selected by the user is displayed in the client, the user can execute the test operation aiming at the application interface of the target test equipment displayed in the client, the client converts the test operation into the operation command aiming at the target test equipment and sends the operation command to the target test equipment, and remote control is achieved.

The remote control method, the device, the system and the computing device provided by the embodiment of the invention effectively reduce the dependence on the area network when the application test is carried out through the distributed registration of the test equipment.

In addition, the remote control method, the remote control device, the remote control system and the remote control computing device provided by the embodiment of the invention can directly map the application interface displayed by the display screen of the test equipment, but not map the display interface of the display screen of the second server (such as a host), so that a client can conveniently display the application interface with a larger size, and the convenience in operation is effectively improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.

Drawings

The above and other objects, features and advantages of the present invention will become more apparent by describing in more detail exemplary embodiments thereof with reference to the attached drawings, in which like reference numerals generally represent like parts throughout.

FIG. 1 is a schematic diagram illustrating an application scenario of a remote control method, apparatus, system and computing device according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a system architecture suitable for use in a remote control method, apparatus, system and computing device according to embodiments of the present invention;

FIG. 3 is a data flow diagram illustrating another remote control method according to an embodiment of the present invention;

FIG. 4 is a flow chart illustrating another remote control method according to an embodiment of the present invention;

FIG. 5 is a flow chart illustrating another remote control method according to an embodiment of the present invention;

FIG. 6 is a flow chart illustrating another remote control method according to an embodiment of the present invention;

fig. 7 is a data flow diagram illustrating an information presentation method according to an embodiment of the present invention;

FIG. 8 is a flow chart illustrating another information presentation method according to an embodiment of the present invention;

FIG. 9 is a flow chart illustrating another information presentation method according to an embodiment of the present invention;

FIG. 10 is a flow chart illustrating another information presentation method according to an embodiment of the present invention;

FIG. 11 is a data flow diagram illustrating another image transmission method according to an embodiment of the invention;

FIG. 12 is a flow chart illustrating another image transmission method according to an embodiment of the present invention;

FIG. 13 is a flow chart illustrating another image transmission method according to an embodiment of the present invention;

FIG. 14 is a flow chart illustrating another image transmission method according to an embodiment of the present invention;

FIG. 15 is a flow chart illustrating an application testing method according to an embodiment of the present invention;

FIG. 16 is a schematic diagram illustrating a first operation of an embodiment of the present invention;

FIG. 17 is a schematic diagram illustrating a second operation of the present invention;

FIG. 18 is a schematic diagram illustrating another second operation of the present invention;

FIG. 19 is a schematic diagram illustrating another second operation of the present invention;

FIG. 20 is a flow chart diagram illustrating another application testing method according to an embodiment of the present invention;

FIG. 21 is a flow chart illustrating another application testing method according to an embodiment of the present invention;

fig. 22 is a block diagram showing the structure of a remote control apparatus according to an embodiment of the present invention;

fig. 23 is a block diagram showing the structure of another remote control apparatus according to the embodiment of the present invention;

fig. 24 is a block diagram showing the structure of another remote control apparatus according to the embodiment of the present invention;

fig. 25 is a block diagram showing the structure of a remote control system according to the embodiment of the present invention;

fig. 26 is a block diagram illustrating a structure of a computing device according to an embodiment of the present invention.

Detailed Description

Preferred embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While the preferred embodiments of the present invention are shown in the drawings, it should be understood that the present invention may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It is to be understood that, although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present invention. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise.

Before describing the technical scheme of the invention, some technical terms related to the invention in the field are explained.

Remote Dictionary service (Remote Dictionary Server, redis for short) is a database type that stores data in a memory, can set expiration time for the stored data, and has fast data access speed and convenient use.

An Android Debug Bridge (adb) command is a series of commands which are integrated in an Android SDK proposed by google corporation for Android developers and can operate a mobile phone.

A Software Development Kit (SDK) is a collection of Development tools used by some Software engineers to build application Software for a specific Software package, Software framework, hardware platform, operating system, and the like.

In a software testing process of an Application (APP) for an Android system, a compatibility testing operation can be performed, that is, the APP is installed on at least part of models (such as a hot-type mobile phone) to test the performance of the APP on various models, such as whether abnormal conditions exist.

However, the models allocated to the various test departments of the organization are limited, and some hot models may be lacking. This results in the need to borrow hot models from each other when performing compatibility tests. In addition, the compatibility test of multiple test groups of each test department can occur in the same time period (before APP release), so that the multiple test groups need to queue up to obtain the required hot machine types, which is very inconvenient.

In addition, the scheme of remote control test equipment (for example, a smart phone with an android system installed, hereinafter referred to as an android phone) in the related art can be used for displaying the android phone on a personal computer (pc), and then operating the android phone in real time in a manner of remotely controlling a pc display screen. However, in this way, the pc display screen is only mapped to the terminal device, the pc is operated, the pc display screen is relatively large, if the terminal device display screen is relatively small, the user operation is very inconvenient, and the display application of the mapping connection mobile phone needs to be opened on the pc in advance.

The applicant finds that the related art has the following technical problems:

on one hand, the remote control client is not registered in the discovery process, the remote control client can be respectively installed on the terminal equipment and the pc, the operation invention is sent to the operator account, and the operator can control the display screen of the controlled pc after receiving the operation invention.

On the other hand, since there is no real-time list, all test devices connected and registered on each pc cannot be shared for multi-user use.

On the other hand, the terminal equipment can not directly map the display interface of the test equipment, and can only map the display interface of the pc display screen, so that the operation of a user is very inconvenient due to the limitation of the size of the display screen of the terminal equipment.

In order to at least partially solve the above problem, an embodiment of the present invention provides a system capable of remotely controlling a test device, where an idle device that can be shared is inserted into a computer of the system, and after registration, a requesting party can remotely control the idle device. In addition, the technical scheme of the invention breaks through the network limitation, and the test equipment connected to the computer can be registered to the shared network under various networks, so that a plurality of demanders can carry out compatibility test. It should be noted that the compatibility test is only an exemplary application scenario, and may also be applied to other test scenarios, such as various scenarios that require queuing use of test equipment.

Fig. 1 is a schematic diagram illustrating an application scenario of a remote control method, device, system and computing device according to an embodiment of the present invention.

Referring to fig. 1, a user may request a test device from a server through a client of a terminal device. When a certain testing device in an idle state is connected, an application interface of the testing device may be displayed in a display interface of the client. The application interface can comprise a plurality of components, and a user can operate the components to perform application testing. In this embodiment, a user can remotely operate the test equipment by operating the application interface displayed in the client display interface, so as to perform application testing.

It should be noted that the terminal device includes but is not limited to: smart phones, notebook computers, tablet computers, desktop computers, and the like have displays and are capable of displaying internet (web) interfaces.

Fig. 2 is a schematic diagram of a system architecture suitable for a remote control method, device, system and computing device according to an embodiment of the present invention. It should be noted that fig. 2 is only an example of a system architecture to which the embodiments of the present invention may be applied, so as to help those skilled in the art understand the technical content of the present invention, and it does not mean that the embodiments of the present invention may not be applied to other devices, systems, environments or scenarios.

Referring to fig. 2, a system architecture 200 according to this embodiment may include a terminal device 201, a server 202, a host 203, a test device 204, and a network 205. The network 205 is used to provide a medium for communication links between the terminal device 201, the server 202, the host 203 and the test device 204. Network 205 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

The user may use the terminal device 201 to interact with other terminal devices, the server 202 and the host 203 via the network 205 to receive or transmit data and the like, such as transmitting operation commands, receiving application interfaces and the like. The terminal device 201 may be installed with various applications, such as a web browser application, a database-type application, a search-type application, an instant messaging tool, a mailbox client, social platform software, and the like.

The terminal device 201 includes, but is not limited to, a desktop computer, a tablet computer, a laptop portable computer, and other computing devices that can support functions of browsing web pages, surfing the internet, and the like. The host 203 includes, but is not limited to, a desktop computer, a tablet computer, a laptop, etc. computing device that can connect to and interact with the testing equipment. The testing device 204 includes, but is not limited to, a smart phone, a tablet computer, a laptop, etc. electronic device capable of human-computer interaction.

Server 202 may receive operational commands, test equipment data, application interfaces, etc., and may also send operational commands to host 203. For example, the server 202 may be a back office management server, a cluster of servers, and the like.

It should be noted that the number of terminal devices, networks, and servers is merely illustrative. Any number of terminal devices, networks, and cloud-ends may be provided as desired.

The technical scheme of the invention can be realized based on the system architecture as follows: the device information of the distributed test devices registered at the server side can be displayed in the display interface of the client side in real time, so that the user can select the target test device in the display interface of the terminal device. The user operation input by the user on the client can be fed back to the remote target test equipment in real time so as to execute the operation command corresponding to the user operation on the target test equipment. And the target test equipment executes the process of the operation command, and the application interface can be quickly fed back to the terminal equipment, so that a user can check the application interface after the user operation is input at the client, and the application test is conveniently carried out by the user.

In order to better understand the technical solution of the present invention, the device list and the real-time monitoring function, the testing device remote control function, and the image transmission function are respectively used as logical chains for the following exemplary description.

The following is an exemplary description of the functionality of the device for remote operation.

Fig. 3 is a data flow diagram illustrating another remote control method according to an embodiment of the present invention.

Referring to fig. 3, the operation command is converted, uploaded, downloaded and executed by the storage operation command function and instruction center of the first server, the function of downloading and executing the operation command of the second server, and the device operation page of the client. In addition, exclusive functions in multi-user operation can be realized. The function of remote control of the equipment is realized through the above functions.

Fig. 4 is a flow chart of another remote control method according to an embodiment of the present invention.

Referring to fig. 4, the remote control method performed by the client may include operations S410 to S430.

In operation S410, an application interface of a target test device is presented in a presentation interface of a client, the target test device being a device corresponding to target information, the target information being information determined from a test device information set based on a first operation.

The client, the target test device, the application interface, the first operation and test device information set, etc. will be described in detail in the relevant content part of fig. 15 to 19.

In operation S420, a second operation of the application interface for the target test device is obtained through the presentation interface of the client.

In some embodiments, the second operation comprises: at least one of click operation, sliding operation, long-time press operation and virtual key operation, wherein the object aimed by the virtual key operation comprises an entity key of the target test equipment. Reference is made in particular to fig. 17 to 19 in relation thereto.

In operation S430, in response to the second operation, an operation command for the target test device is generated and transmitted to the second server, so that the second server controls the target test device to perform the application test.

Specifically, in response to the second operation, generating the operation command for the target test device may include: and converting the second operation of the display interface of the client into an operation command of the application interface of the target test equipment.

For example, the second operation for the client may be converted to an operation for the target test device based on a difference between a first attribute of the target test device and a second attribute of the client.

In particular, a second operation of the presentation interface for the client may be converted to an operation of the application interface for the target test device based at least on the coordinate conversion.

In a specific embodiment, the operation command may conform to the specification of an android debug bridge (adb) command, so as to implement remote control of the test device. For the click operation, the long-press operation, the sliding operation, and the virtual key operation, reference may be made to relevant portions with respect to fig. 17 to 19, which will not be described in detail herein.

In some embodiments, the method may further include the following operations.

Firstly, the size of a test equipment display screen of target test equipment and the size of a display interface of a client are obtained.

Then, a specific scaling is determined according to the display screen size and the display interface size of the test equipment, so that the second operation of the display interface of the client is converted into an operation command of the application interface of the target test equipment based on the specific scaling.

In some embodiments, the test device display screen size includes a height of the test device display screen and a width of the test device display screen, and the presentation interface size includes a height of the presentation interface and a width of the presentation interface. The size of the display interface can be expressed by different units, such as millimeter, centimeter, decimeter, pixel row number, pixel column number, and the like.

Accordingly, the specific scaling includes: the display interface comprises a first scaling determined according to the height of the display screen of the test equipment and the height of the display interface, or a second scaling determined according to the width of the display screen of the test equipment and the width of the display interface. Wherein the first scaling and the second scaling may be the same or different.

In some embodiments, the second operation may also be converted to an operation command based on the particular scaling described above. Specifically, the method may further include an operation of storing the first scaling or the second scaling.

Accordingly, converting the second operation of the presentation interface for the client into the operation command of the application interface for the target test device may include converting the second operation of the presentation interface for the client into the operation command of the application interface for the target test device based on the first scaling or the second scaling.

In some embodiments, transmitting the operation command to the second server may include sending an operation upload request to the first server to store the operation command in the first server, so that the second server can download the operation command, wherein the operation upload request includes the test device unique identification code of the target test device and the operation command.

In addition, after sending the operation upload request to the first server, the method may further include sending a test device lock request to the first server, where the test device lock request includes a test device unique identification code of the target test device.

In a specific embodiment, the remote operation can be divided into three parts, namely, the real-time downloading and rendering of an application interface of the test equipment, the operation of the client side is converted into an adb command and uploaded to the server, and the adb command is uploaded while the equipment locking service is requested, so that the monopolization of the equipment is ensured.

A) Real-time downloading and rendering of application interfaces for test equipment

a) According to the IP address and the path of the picture server obtained in advance, the picture server is spliced with the unique identification code of the mobile equipment, and the suffix jpg of the picture type agreed in advance is spliced to the end to generate a resource path. < example: https: //111.222.333.444/img/l2k3jkj23_02309839.jpg >

b) And requesting the picture server once every 0.1 second, and accessing the generated resource path to obtain the screenshot of the android mobile device.

c) And calculating the most appropriate display size according to the width and the height of the web end equipment and the width and the height of the android mobile equipment, and rendering the downloaded screenshot of the mobile equipment to the web end. (one edge can be prevented from exceeding the web-side display screen)

i. And calculating the ratio of the width of the android mobile device to the width of the web-end device and the ratio of the height of the android mobile device to the height of the web-end device, and comparing the two ratios, and then taking the ratio of the side with the larger scaling ratio.

Scaling the width and height of the screenshot (thus ensuring that one side is full and the other side does not go beyond the web-side display).

And save this scale for standby (for use in converting the adb command).

B) And converting the operation on the web page into an adb command to be uploaded to the server.

a) Converting click operations to adb commands

And i, the web terminal acquires coordinate values of an x axis and a y axis of the clicked position.

Multiplying the x and y coordinate values by the scaling ratio to obtain corresponding coordinate values of the remote android mobile device.

Stitching the x and y coordinate values to an adb command for uploading.

Adb-s < device serial number > shell input tap < x-coordinate value > < y-coordinate value >.

b) The slide operation is converted to an adb command.

And the web terminal acquires coordinate values of an action starting x axis and a y axis and coordinate values of an action finishing x axis and a y axis of the position of the sliding operation.

Multiplying the starting and ending x and y coordinate values by the scaling ratio to obtain corresponding coordinate values for the remote android mobile device.

And iii, splicing the starting and ending x coordinate values and the ending y coordinate values to an adb command for uploading.

Adb-s < device serial number > shell input swap < start x-coordinate value > < start y-coordinate value > < end x-coordinate value > < end y-coordinate value >.

c) The long press operation is converted to an adb command.

And i, the web terminal acquires coordinate values of an x axis and a y axis of the position of the long press operation.

Stitching the starting and ending x and y coordinate values to the adb command for uploading.

Adb-s < device serial number > shell input swap < x-coordinate value > < y-coordinate value > < duration millisecond number >.

d) And making other commands into page floating buttons, and converting the commands into adb commands during clicking operation.

i. Shutdown

Adb-s < device serial number > shell reboot-p.

Restart, ii

Adb-s < device serial number > shell reboot.

Long press power key iii

Adb-s < device serial number > shell input keyervent

--longpress 26。

iv, locking the screen

Adb-s < device serial number > shell input keyervent 26.

v. Return key

Adb-s < device serial number > shell input keyervent 4.

Home bond vi

Adb-s < device serial number > shell input keyervent 3.

vii. Menu Key

Adb-s < device serial number > shell input keyervent 82.

Section key

Adb-s < equipment serial number > shell secure cap-p < save path +

Filename >.

ix. set volume

Adb-s < device serial number > shell media volume-show

Stream < volume type > -set < volume value >.

C) And requesting the server to instruct the command uploading service of the center and uploading the adb command.

i. The first parameter is as follows: the mobile device unique identification code (string).

Parameter two: adb command (string).

D) The device lock service is requested while the adb command is uploaded.

The first parameter is as follows: a mobile device unique identification code.

Fig. 5 is a flow chart of another remote control method according to an embodiment of the present invention.

Referring to fig. 5, the remote control method performed by the first server side may include operations S510 to S530.

In operation S510, in response to obtaining an operation command from the client, the operation command is stored in a command data set, where the operation command is a command for a target test device corresponding to an application interface exposed by the client.

In operation S520, an operation command download request from the second server is obtained, where the operation command download request includes the unique test device identification code.

In operation S530, in response to the operation command downloading request, the operation command corresponding to the unique identification code of the test device in the command data set is transmitted to the second server, so that the second server executes the operation command to control the target test device to perform the application test.

In some embodiments, the operation command conforms to the specification of an android debug bridge (adb) command.

Accordingly, in response to obtaining the operation command from the client, storing the operation command in the command data set may include the following operations.

First, an operation uploading request from a client is received, wherein the operation uploading request comprises a test equipment unique identification code and an operation command of target test equipment.

Then, in response to the operation uploading request, generating a key (key) of the command data set, wherein the key (key) of the command data set comprises a unique identification code of the testing equipment and an android debug bridge (adb) prefix.

Next, the operation command is inserted as a value (value) of the command data set into the head of the command data set.

Storing the operation command by means of a key value pair facilitates the key-based lookup of the corresponding value.

In some embodiments, transmitting the operation command corresponding to the test device unique identification code in the command data set to the second server side in response to the operation command download request may include searching the command set from the command data set based on the test device unique identification code, and/or regarding a last command in the command set as the operation command corresponding to the test device unique identification code and deleting the last command.

In some embodiments, the method may further include the following operations.

First, a test device locking request from a client is obtained, and an operation uploading request comprises a test device unique identification code of a target test device.

And then, responding to the test equipment locking request, and updating the locking state data corresponding to the unique identification code of the test equipment in the test equipment state data set into a locking state.

And the effective duration of the locking state is less than or equal to a preset duration threshold. Accordingly, the method may further include the operations of: and if the duration of the locked state data corresponding to the unique identification code of the test equipment after being updated to the locked state exceeds the preset duration threshold and the test equipment locking request comprising the unique identification code of the test equipment of the target test equipment is not received again, updating the locked state data corresponding to the unique identification code of the test equipment to the unlocked state. Thus, automatic unlocking of the measuring equipment can be realized.

In one particular embodiment, with respect to locking/unlocking device services:

since a device is preferably operated by only one user at a time (to prevent confusion), the device lock service is provided, and the device needs to have a release operation, i.e., unlock, after use.

A) Locking in

The locking service is divided into three parts: a receiving parameter setting, b program processing part, c returning value definition.

a) Receiving parameter setting:

i. the first parameter is as follows: a mobile device unique identification code.

b) The program processing section:

i. whether the device is locked is saved to the redis (redis lock library: adb _ lock _).

1. Adding the prefix adb _ lock _tothe unique identification code of the mobile equipment as the key of the redis.

2. The value is set to 1, representing that the device has been locked.

3. And a 60 second expiration is set.

c) The return value defines: successfully returns True and fails returns False (the user is the web-side, which does not care about the return value for this service, ignore).

B) Unlocking: because the locking service will be released automatically within a certain time, no manual unlocking is required.

With respect to the instruction center: the instruction center is mainly used for receiving an adb command uploaded by a client (such as a web end) and providing adb command downloading service corresponding to the mobile equipment for a pc end (a second server end).

A) The command uploads the service.

The service is divided into three parts: a receiving parameter setting, b program processing part, c returning value definition.

a) Receiving parameter setting:

Parameter two: adb command (string).

b) The program processing section:

i. and saving the adb command into a redis (redis command library: adb _ command _).

1. Adding the prefix adb _ command _tothe unique identification code of the mobile equipment to be used as the key of the redis list.

2. The adb command is inserted into the head of the redis list using the LPUSH command.

c) The return value defines: successful return True, failed return False (user is web-side, web-side does not care about return value of this service, ignore)

B) A download service is commanded.

a) Receiving parameter setting:

b) The program processing section:

i. the set of instructions is looked up in the redis command library using the RPOP command of redis based on the mobile device unique identifier. (RPOP: get the last command in the list and remove this command from the end of the list).

c) The return value defines: if the command is acquired, an adb command (character string) is returned, and if the command is failed or not found, a null is returned.

Fig. 6 is a flow chart of another remote control method according to an embodiment of the present invention.

Referring to fig. 6, the remote control method performed by the second server side may include operations S610 to S630.

In operation S610, local test equipment data is obtained, where the local test equipment data includes a test equipment unique identification code of at least one test equipment connected to the second server side.

In this embodiment, the local test equipment data may be obtained by scanning the equipment of the specific connection mode.

In operation S620, an operation command download request is sent to the first server, where the operation command download request includes the test device unique identification code in the local test device data.

In this embodiment, sending the operation command download request to the first server may include the following operations.

Firstly, a unique identification code of the testing equipment is generated based on the unique identification code of the second server side and the serial number of the testing equipment.

And then, sending an operation command downloading request comprising the unique identification code of the test equipment to the first server side.

In operation S630, an operation command corresponding to the unique identification code of the test device from the first server is obtained, and the operation command is executed to control the target test device to perform the application test.

In some embodiments, to filter out malicious operation commands, executing the operation commands may include executing the operation commands if the operation commands include an android debug bridge (adb) prefix.

In one embodiment, the adb command may be downloaded and the function performed (e.g., attempted once every 0.1 second) as follows:

A) and acquiring a local device list (acquiring serial numbers of all android mobile devices connected by a data line by using an adddevices command).

B) And circularly processing and downloading the adb command.

a) A unique identification code for the mobile device is generated.

i. And splicing the pc unique identification code and the mobile equipment serial number into the mobile equipment unique identification code by underlining.

b) And requesting the service end to instruct the adb command download service provided by the center.

c) The downloaded adb command is executed.

i. It is determined whether the first three characters of the command are adb (preventing web-side upload of malicious commands).

Execute immediately if the first three characters of the command are adb.

Device list and real-time monitoring functions

Fig. 7 is a data flow diagram of an information displaying method according to an embodiment of the present invention.

Referring to fig. 7, by means of the heartbeat detection service and the device list service discovered by the device registration of the first server, the heartbeat reporting function of the android device connected with the pc of the second server, and the device list display function of the client, real-time online and offline monitoring of the test device is realized, and the client can conveniently select the target test device from the test device information set.

Fig. 8 is a flowchart illustrating another information displaying method according to an embodiment of the present invention.

Referring to fig. 8, the information presentation method performed by the client may include operations S810 to S830.

In operation S810, a test device data request is sent to a first server side.

In some embodiments, sending the test device data request to the first server may include: and sending a test equipment data request to the first server side according to the preset frequency. The preset frequency may be a frequency set based on expert experience, simulation results, user preferences, and the like.

In operation S820, test device data from the first server side is obtained, and a test device information set is generated based on the test device data.

In this embodiment, the test device data includes: the unique identification code of the test equipment and the test equipment information, the test equipment information comprises: at least one of a test equipment serial number, a height of a test equipment display screen, and a width of the test equipment display screen.

Accordingly, generating the set of test device information based on the test device data may include: and rendering the test equipment data into a test equipment information list. The rendering process is to process the data into image information for presentation in a presentation area of the client.

In operation S830, in response to a first operation on the device information of the target test device in the test device information set, an application interface of the target test device is displayed in a display interface of the client to perform an application test based on the application interface.

In some embodiments, to avoid multiple users using the same test device for application testing during the same time period, the test device data may further include: at least some of the test devices have respective locked states, the locked states including: a locked state and an unlocked state.

Accordingly, the first operation in response to the device information for the target test device in the set of test device information may include the following operations.

If the locked state of a first test device of the at least some test devices is the locked state, a first operation in response to the device information for the first test device is inhibited.

If the locked state of a second test device of the at least some test devices is the unlocked state, a first operation is allowed to respond to the device information for the second test device to expose an application interface of the second test device.

In one embodiment, the device list presentation may be implemented as follows.

First, an acquisition device list service provided by a server is requested every 0.5 seconds. The list data is an array of information for each mobile device. The array format may be as follows.

The mobile device unique identification code (string).

Mobile device serial number (string).

Height of the mobile device display screen (number).

Width (number) of the mobile device display screen.

The locked state (digital 1 or 0) of the mobile device.

Then, the first four items of data returned by the list service are rendered into the list, and the operation button is shown according to the 5 th locked state (unlocked state button display < operation >, locked state button display < locked >, and gray is displayed so that the button cannot be clicked).

Then, clicking the operation button can jump to the device operation page and carry all the information of the device to the device operation page.

Fig. 9 is a flowchart illustrating another information displaying method according to an embodiment of the present invention.

Referring to fig. 9, the information presentation method performed by the first server may include operations S910 to S920.

In operation S910, a test device data request from a client is obtained.

In operation S920, in response to the test device data request, the test device data is sent to the client, so that the test device data is displayed in a display interface of the client, and the test device corresponding to the test device data is controlled to perform an application test.

The test equipment data is stored in a test equipment data set, the test equipment data set comprises local test equipment data from at least one second server end, and the local test equipment data comprises test equipment data of at least one test equipment connected with the second server end.

For example, the test device data includes a test device unique identification code and test device information assigned to the connected test device by the second server side.

In some embodiments, the test device unique identifier in the test device data set and the test device data set identifier together serve as a key (key) of the hash value, the test device information serves as a value (value) of the hash value, and the effective duration of the key (key) of the hash value is less than or equal to the preset duration threshold.

In some embodiments, sending the test device data to the client may include the following operations.

Firstly, retrieving a test equipment data set to obtain at least part of test equipment data in the test equipment data set, and retrieving a test equipment state data set to obtain locking state data of test equipment corresponding to at least part of the test equipment data.

Then, returning the object, wherein the object takes the second server-side unique identification code in at least part of the test equipment data as a key (key), and the format of the value (value) of the object is an array, and the array comprises: at least one of a test equipment unique identification code, a test equipment serial number, a height of a test equipment display screen, a width of the test equipment display screen or locking state data of the test equipment.

In a specific embodiment, the heartbeat detection service for device registration discovery may be implemented as follows:

the service is divided into three parts: a receives parameter settings, B program processing part, C returns value definitions.

A) Receiving parameter setting: the program receives two parameters in total.

a) The first parameter is as follows: the mobile device unique identification code (pc-generated).

b) And a second parameter: device information.

i. The mobile device serial number.

Mobile device display screen size (width/height).

B) The program processing section:

a) saving the device information into a redis database (redis device library:

adb_device_**)。

i. adding the prefix adb _ device _tothe unique identification code of the mobile equipment as the key of the redis hash.

Take the device information as the value of the redis hash.

1. Mobile device serial number (string).

2. Height of the mobile device display screen (number).

3. Width (number) of the mobile device display screen.

And sets 10 seconds expiration for this key.

C) The return value defines: successfully returns True and fails returns False (the applicable party is the pc end, which doesn't care about the return value of the service and ignores).

Regarding providing the device list service:

A) Receiving parameter setting: the present service does not require parameters.

B) The program processing section:

a) and searching a redis device library and taking out all the devices.

b) And retrieving a redis lock library and acquiring the lock states corresponding to all the devices.

C) The return value defines:

a) the return format is an object (multiple devices under multiple pcs).

b) Object's key is pc unique identifier (there may be multiple pcs registered to the system):

i. the mobile device unique identification code is split (pc unique identification code + mobile device serial number).

Acquiring the pc unique identification code.

c) The value of an object is an array (possibly connected to multiple mobile devices under a pc).

i. In the array are a plurality of mobile device information:

1. the mobile device unique identification code (string).

2. Mobile device serial number (string).

3. Height of the mobile device display screen (number).

4. Width (number) of the mobile device display screen.

5. The locked state (digital 1 or 0) of the mobile device.

Fig. 10 is a flowchart illustrating another information presentation method according to an embodiment of the present invention.

Referring to fig. 10, the information presentation method performed by the second server may include operations S1010 to S1020.

In operation S1010, local test equipment data is obtained, the local test equipment data including test equipment data of at least one test equipment connected to the second server side.

For example, obtaining local test equipment data may include the following operations: and acquiring the equipment serial number of the external test equipment connected with the second server side, and acquiring the height of the test equipment display screen and the width of the test equipment display screen corresponding to the equipment serial number. The width of the display screen can be expressed by various units, such as centimeters (cm), pixel row number or column number, and the like.

In operation S1020, the local test device data is sent to the first server according to a preset period, so that the first server generates a test device data set based on the local test device data, and the client performs an application test based on the test device data set acquired from the first server.

In some embodiments, sending the local test equipment data to the first server according to the preset period may include the following operations. The method comprises the steps of requesting heartbeat detection service provided by a first server side, and sending local test equipment data to the first server side, wherein the local test equipment data comprise: the unique identification code of the test equipment and the test equipment information, the test equipment information comprises: at least one of a test equipment serial number, a height of a test equipment display screen, and a width of the test equipment display screen.

For example, the test device unique identification code includes: the unique identification code of the second server end is the unique identification code distributed to the second server end by the first server end.

In one embodiment, the second server is a Personal Computer (PC) for example.

First, a unique identification code (uuid) of the pc is generated for standby at the first time of running the pc-side script.

1. Heartbeat reporting function (reporting once in 10 seconds) of android device connected with pc:

A) a local device list is obtained. (all android mobile device serial numbers connected with the data line are obtained using the adddevices command).

B) And circularly processing and reporting the data to the equipment.

a) The size of the android mobile device is obtained (corresponding numbers of the width and height of the device can be obtained by using an adb-s device number shell wm size command).

b) A unique identification code for the mobile device is generated.

c) And requesting heartbeat detection service provided by the server side and reporting the service to the equipment.

i. A mobile device unique identification code.

Mobile device information.

1. Mobile device serial number (string).

2. Mobile device width (number).

3. Mobile device height (number).

The on-line and off-line real-time monitoring of the android mobile device can be realized through the technical scheme, and the device list can be displayed for a user to select the test device.

The image transfer process is exemplified below.

Fig. 11 is a data flow diagram illustrating another image transmission method according to an embodiment of the present invention.

Referring to fig. 11, the uploading and downloading functions of the screenshot of the display screen of the testing device are realized through the image service of the server, the function of capturing and uploading the screenshot of the android device of the second server, the function of operating the device page of the client and the like, and the function of displaying the picture of the remote testing device in real time is mainly realized.

Fig. 12 is a flowchart illustrating another image transmission method according to an embodiment of the present invention.

Referring to fig. 12, the image transmission method performed by the client may include operations S1210 to S1230.

In operation S1210, an image download request is sent to a first server, where the image download request includes a resource path, and the resource path includes a first server IP address, a storage path, and a test device unique identification code.

In operation S1220, an application interface corresponding to the resource path from the first server is obtained, where the application interface is an image obtained by screenshot by the target test device, and the target test device is a device corresponding to the unique identification code of the test device.

In operation S1230, the application interface is rendered, and the rendered application interface is presented at a presentation interface of the client for application testing based on the operation for the rendered application interface.

In some embodiments, after the rendered application interface is displayed on the display interface of the client, the method may further include the following operations.

First, a second operation for an application interface displayed in a display interface of the client is obtained.

And then, responding to the second operation, generating an operation command for the target test equipment, and transmitting the operation command to the second server to control the target test equipment to perform application test and obtain an updated application interface, wherein the target test equipment is equipment corresponding to the unique identification code of the test equipment.

And then, displaying an updating application interface in a display interface of the client, wherein the updating application interface is an interface updated by the target test equipment in response to the operation command.

In some embodiments, in order to improve the display effect of the application interface of the test device in the display area of the client, the method may further include, before or after obtaining the application interface corresponding to the resource path from the first server, obtaining size information of the test device display screen of the target test device.

Accordingly, rendering the application interface may include: rendering the presentation interface based on a particular scale, wherein the particular scale includes a first scale and a second scale, the first scale being a scale for the application interface determined based on a height of the test device display screen and a height of the presentation interface, and the second scale being a scale for the application interface determined based on a width of the test device display screen and a width of the presentation interface.

For example, the particular scale is a large scale of the first scale and the second scale. This may cause the client's presentation area to be filled with either the wide side or the high side to maximize the presentation application interface.

In some embodiments, the method may further include storing the particular scaling. Accordingly, generating the operation command for the target test device may include: and converting the second operation of the presentation interface for the client into an operation command of the application interface for the target test equipment based on the specific scaling.

In some embodiments, sending the image download request to the first server may include, in response to a first operation on a presentation interface of the client, sending the image download request to the first server, where an object of the first operation includes: and displaying the equipment information of the target test equipment in the test equipment information set displayed by the interface, wherein the equipment information comprises the unique identification code of the test equipment.

In one embodiment, real-time downloading and rendering of device screenshots may be achieved as follows.

a) According to the IP address and the path of the picture server obtained in advance, the picture server is spliced with the unique identification code of the mobile equipment, and the suffix jpg of the picture type agreed in advance is spliced to the end to generate a resource path. < example: https: //111.222.333.444/img/l2k3jkj23_02309839.jpg >.

c) And calculating the most appropriate display size according to the width and the height of the web-side device and the width and the height of the android mobile device, and rendering the downloaded screenshot of the mobile device into the web side (preventing one edge from exceeding a display screen of the web side).

And save this scale for standby (for use in converting the adb command).

Fig. 13 is a flowchart illustrating another image transmission method according to an embodiment of the present invention.

Referring to fig. 13, the image transmission method performed by the first server side may include operations S1310 to S1330.

In operation S1310, an image download request from a client is obtained, the image download request including a resource path, the resource path including a storage path and a test device unique identification code.

In operation S1320, in response to the image download request, an application interface corresponding to the unique identification code of the test device is determined based on the storage path and the unique identification code of the test device, where the application interface is an image obtained by the target test device through screenshot, and the target test device is a device corresponding to the unique identification code of the test device.

In operation S1330, the application interface is transmitted to the client so that the client exposes the rendered application interface and performs an application test based on the operation for the rendered application interface.

In some embodiments, the method may further include the following operations.

Firstly, an application interface of target test equipment uploaded from a second server side is received, and the target test equipment is test equipment corresponding to the unique identification code of the test equipment.

And then, storing the application interface of the target test equipment in a specified storage space, wherein the image identifier of the application interface comprises the test equipment unique identification code of the test equipment for image interception, so that the client can download the application interface of the test equipment corresponding to the target test equipment unique identification code from the specified storage space.

In some embodiments, storing the application interface of the target test device in the designated storage space may include: the application interface is stored in a file server having a separate IP address.

In one particular embodiment, with respect to image services. It should be noted that the server having the independent IP address may be a server providing a file service.

For example, using nginx middleware, a directory is provided under the nginx directory where images can be stored.

A) Uploading an image:

a) the image is uploaded to the appointment directory using the scp command.

b) The image name is defined as < mobile device unique identifier >. jpg.

B) Downloading an image:

c) and accessing the IP address of the image server, the directory path, the unique identification code of the mobile equipment and jpg, and obtaining the image.

Fig. 14 is a flowchart illustrating another image transmission method according to an embodiment of the present invention.

Referring to fig. 14, the image transmission method performed by the second server side may include operations S1410 through S1430.

In operation S1410, at least one testing device connected to the second server is controlled to perform screenshot, so as to obtain an application interface of the at least one testing device.

In operation S1420, at least one test device connected to the second server terminal is controlled to each transmit the application interface to the second server terminal.

In operation S1430, the application interfaces uploaded by the respective at least one testing device are transmitted to the first server, so that the client downloads the application interface of the target testing device from the first server, and performs an application test based on an operation of the application interface for the target testing device.

In some embodiments, controlling at least one test device connected to the second server to perform respective screenshots may include: and in response to an operation command downloaded from the first server end to an application interface aiming at the target test equipment, controlling at least one test equipment connected with the second server end to respectively perform a specified number of screenshots according to a preset frequency.

Accordingly, controlling at least one testing device connected to the second server end to transmit each application interface to the second server end may include: and controlling at least one test device connected with the second server end to transmit the application interface to the specified file of the local storage space of the second server end.

In some embodiments, controlling at least one test device connected to the second server to perform a designated number of screenshots according to a preset frequency may include: and for each test device, controlling the test device to perform appointed number of screenshots according to preset frequency, and storing the application interface obtained through the screenshots in the test device.

In some embodiments, transmitting the application interface uploaded by each of the at least one test device to the first server side may include the following operations.

First, remotely logging in a first server.

Then, the application interfaces uploaded by the at least one test device are encrypted, and the encrypted application interfaces are copied to the specified directory of the first server side.

In one embodiment, this may be achieved by: and (5) capturing and uploading the screenshot of the android device.

After the adb command is successfully downloaded (in order to prevent resource waste caused by continuous uploading of screenshots when no user operates the adb command), 10 screenshots are uploaded after the adb command is successfully downloaded, and the interval between screenshots is 0.1 second.

A) And controlling screenshot of the android mobile device by using the adb command and storing the screenshot into the android device.

a) adb-s < device serial number > shell secure-p < save path + filename >.

B) And uploading the screenshot saved in the android device to a pc hard disk by using an adb command.

a) adb-s < device serial number > pull < picture path + file name > < pc save path + file name >.

C) And uploading the screenshots saved in the pc hard disk to a specified directory of the picture server by using a scp command.

a) scp < pc picture path + file name > < picture server login user name @ IP: resource directory >.

Fig. 15 is a flowchart illustrating an application testing method according to an embodiment of the present invention.

Referring to fig. 15, the application test method performed by the client may include operations S1510 through S1520.

In operation S1510, in response to a first operation on device information of a target test device in the test device information set, an application interface of the target test device is exposed in an exposure interface of the client.

In this embodiment, a client (e.g., a web client) may provide a device list presentation page (including device information of a plurality of test devices, such as test device identifications, idle states, and the like) so that a user may determine a target test device from the device list presentation page. Therefore, the client can download the application interface of the target test device so as to display the application interface of the target test device in the display area of the client. The application interface may include all images displayed on a display screen of the test device, such as status bars (e.g., remaining power, signal strength, etc.).

Fig. 16 is a schematic diagram illustrating a first operation according to an embodiment of the present invention.

Referring to fig. 16, a list (e.g., a test device information list) is displayed in the display area of the client, where the list includes related information of a plurality of test devices, such as identifiers of the test devices: a terminal 1, a terminal 2; terminal model of the test equipment: terminal model 1, terminal model 2; the terminal state: an occupied state, an idle state; display screen size information of the terminal device: a1 XB 1, A2 XB 2 and the like. It should be noted that only two pieces of information of the test devices are shown in fig. 16, and more or less pieces of information of the test devices may be shown. For example, when 100 test devices are currently registered at the first server, the list may show information of 100 test devices. Of course, only the information of the test devices currently in the idle state may be shown in the list. The list may also show only the information of the test devices with good network connection status. In addition, only a portion of each entry, such as only the terminal identification and terminal status, may be shown in fig. 16.

In fig. 16, when the user clicks the entry of the terminal 2, it may be determined that the test device corresponding to the terminal 2 is the target test device. The first operation is a click operation as an exemplary illustration, and the first operation may also be an operation capable of human-computer interaction, such as a long-press operation, a double-click operation, or a slide operation. When the user inputs the first operation, the terminal device may determine coordinate information of the first operation so as to determine an operation object of the first operation.

In operation S1520, in response to the second operation on the application interface exposed by the client, an operation command for the target test device is generated, and the operation command is transmitted to the second server via the first server, so as to control the target test device connected to the second server to perform the application test.

In this embodiment, a user may perform an application test based on the application interface, for example, click a certain component in the application interface, so as to jump to an interface corresponding to the component. After the user inputs the second operation, the second operation is converted into an operation command for the target test equipment, and the operation command is sent to the first server side, so that the second server side of the test equipment can be controlled to download the operation command, and the target test equipment is controlled to perform application test. For example, a user clicks a certain component in an application interface at a client, so that the application of the test device jumps to an interface corresponding to the component. The application test is achieved by the above manner.

In some embodiments, downloading the application interface of the target test device in response to the first operation, and presenting the application interface of the target test device in the presentation interface of the client may include the following operations.

Firstly, a test device data request is sent to a first server side. The test device data request may include a terminal device identifier or a client identifier, so that the first server returns test device data.

Then, test device data from the first server side is obtained, and a test device information set is generated based on the test device data. For example, the test device information set may be as shown in fig. 16.

Then, in response to a first operation on the device information of the target test device in the test device information set, an application interface of the target test device is downloaded, and the application interface of the target test device is displayed in a display interface of the client. Referring to fig. 16, if the user clicks the entry of the terminal 2, the server may return an application interface corresponding to the terminal 2 to the client, so that the user performs an application test on the client by using the test device corresponding to the terminal 2.

In some embodiments, to avoid command collision caused by multiple users using the same test device at the same time, a test device may be locked after the user selects the test device.

For example, test equipment data includes: at least some of the test devices have respective locked states, the locked states including: a locked state and an unlocked state.

For example, the device information of the test device in the locked state is in the gray operation disabled state. The equipment information of the test equipment in the unlocked state is in a normal state and can respond to a first operation input by a user.

In some embodiments, generating the operation command for the target test device in response to the second operation may include converting the second operation for the client to an operation for the target test device based on a difference between the first attribute of the target test device and the second attribute of the client to generate the operation command for the target test device based on the operation for the target test device. Wherein the first attribute and the second attribute can be used for characterizing the operation object. For example, when the same operation object is displayed on the display screens of the client and the test equipment, the attribute of the operation object changes. For example, the first attribute and the second attribute may be a location attribute, an action attribute, or the like.

For example, the position attribute may include a coordinate value, and the coordinate value of the same operation object in the coordinate system of the display interface of the client is different from the coordinate value of the same operation object in the coordinate system of the display screen of the test device.

For example, if an association relationship is established between a specific action and a specific operation, the action attribute may be the specific action corresponding to the specific operation. Such as a selection operation where successive dots correspond to a "yes" selection function. For example, an association relationship exists between double-clicking the right mouse button and closing the current application.

In some embodiments, the second operation of the presentation interface for the client may be converted to an operation of the application interface for the target test device based at least on the coordinate conversion. For example, the second operation includes: the method comprises at least one of click operation, sliding operation, long-time pressing operation and virtual key operation, wherein the target to which the virtual key operation aims comprises an entity key of the target test equipment.

Specifically, the following lists the conversion modes for different types of operations, respectively.

And for the click operation, zooming the coordinate value corresponding to the click operation according to a specific zoom ratio to obtain the coordinate value of the click operation aiming at the application interface.

And for the sliding operation, zooming the coordinate value of the start point coordinate corresponding to the sliding operation according to a specific zooming proportion to obtain the coordinate value of the sliding start point for the application interface, or zooming the coordinate value of the end point coordinate corresponding to the sliding operation according to the specific zooming proportion to obtain the coordinate value of the sliding end point for the application interface.

And for the long press operation, zooming the coordinate value of the click coordinate corresponding to the long press operation according to a specific zooming proportion, and combining the click duration to obtain the coordinate value and the click duration of the long press operation aiming at the application interface.

For the virtual key operation, the operation of the key corresponding to the virtual key for the test equipment is obtained based on the click operation of the virtual key displayed on the display interface of the client.

It should be noted that the technical solution of the present invention can be applied to test equipment installed with a plurality of different operating systems. Operating systems include, but are not limited to: android operating system, apple operating system (IOS), and the like.

In some embodiments, taking the example of a test device installing an android operating system, the operating command may conform to the specification of an android debug bridge (adb) command. It should be noted that the IOS system also has a corresponding debug command specification, which is not limited herein.

In a specific embodiment, taking the test device for installing the android operating system as an example, generating the operation command for the target test device in response to the second operation for the application interface exposed by the client may be as follows.

For the click operation, obtaining a click coordinate of a display interface for the client, zooming the coordinate value of the click coordinate according to a specific zoom ratio to obtain a coordinate value for the application interface, and taking the coordinate value for the application interface as a parameter of the adb click command, wherein the specific zoom ratio is determined based on the display interface of the client and the size (such as height or width) of a test equipment display screen of the target test equipment.

Fig. 17 is a schematic diagram illustrating a second operation according to an embodiment of the present invention.

Fig. 17 shows a presentation interface of a display of a desktop computer, in which a user can view an application interface of a target test device and operate the presented application interface in a presentation area. For example, the user may click the "second every day" component using a mouse to jump to the display interface of "second every day". The mouse click operation is an example of the second operation, and the second operation may also be a double-click operation, a drag operation, a long-press operation, or the like. When the user inputs the second operation, the terminal device may determine coordinate information of the second operation so as to determine an operation object of the second operation. For example, the coordinate information of the second operation is coordinate 1, and the "second kill on day and day" component is displayed at the position corresponding to coordinate 1, and the "second kill on day and day" component is the operation object of the second operation.

For the sliding operation, obtaining a starting point coordinate and an end point coordinate of the sliding operation aiming at a display interface of a client; zooming the coordinate value of the initial point coordinate according to a specific zooming proportion to obtain a sliding initial point coordinate value aiming at the application interface, or zooming the coordinate value of the end point coordinate according to the specific zooming proportion to obtain a sliding end point coordinate value aiming at the application interface; and taking the coordinate value of the sliding starting point and the coordinate value of the sliding ending point as the parameters of the adb sliding command.

Fig. 18 is a schematic diagram illustrating another second operation according to an embodiment of the present invention.

Fig. 18 shows a presentation interface of a display of a smartphone, in which a user can view an application interface of a target test device and operate the presented application interface in a presentation area. For example, the user may input a user operation to the presentation interface using a finger or a stylus. A slide operation is shown in fig. 18, where the user can slide a finger from the coordinate 2 position of the display area to the coordinate 3 position to operate the slide assembly. When the user inputs the sliding operation, at least a starting point coordinate and an ending point coordinate can be generated, and the sliding distance of the sliding operation can be determined based on the starting point coordinate and the ending point coordinate so as to determine the control instruction corresponding to the sliding operation.

For the long-press operation, obtaining a click coordinate and a click duration of a display interface of the client, zooming the coordinate value of the click coordinate according to a specific zoom ratio to obtain a sliding start point coordinate value and a sliding end point coordinate value of the application interface, and taking the coordinate value and the click duration of the application interface as parameters of the adb sliding command. It should be noted that the long-press operation is similar to the click operation, but there are a plurality of time parameters, and the time parameters represent the click duration. In addition, whether the current operation is a click operation or a long-press operation can also be judged through a time test. If the contact time length of the operation is less than the preset time length threshold value, the operation can be determined to be a click operation. If the contact time length of the operation is greater than or equal to the preset time length threshold value, the operation can be determined to be a long-press operation.

For the virtual key operation, obtaining a click operation aiming at a virtual key displayed on a display interface of a client, taking an operation parameter corresponding to the virtual key as a parameter of an adb virtual operation command, wherein the operation parameter corresponding to the virtual key is used for realizing at least one function of the following functions: shutdown, restart, long-time pressing of a power key, screen locking, returning, homepage turning, menu opening, screenshot and volume setting.

Fig. 19 is a schematic diagram illustrating another second operation according to an embodiment of the present invention.

Referring to fig. 19, a display area of a desktop display is shown. Since the desktop operates differently from the smartphone, the smartphone may have a lock button, a sound condition button, a Home button, etc. that the desktop does not have. In order to implement the function test for the keys, the keys may be simulated by setting the floating keys in the present embodiment, so as to implement the function test for the keys.

Four floating keys are shown in fig. 19, and in order from top to bottom, the first floating key may be a lock button, the second floating key may be an up button, the third floating key may be a down button, and the fourth floating key may be a Home button. The user can operate the several floating keys through the mouse to realize the required test method.

In some embodiments, since the display screen, resolution, etc. of the terminal device may be different from the display screen, resolution, etc. of the test device, in order to accurately convert operations directed to the terminal device to operations directed to the test device, the operations may be processed based on a particular scale. For example, the coordinate value of the contact point for the input operation of the application interface of the test equipment is obtained by performing a zoom operation on the coordinate value of the contact point for the input operation of the client.

Specifically, the specific scaling includes: the display device comprises a first scaling and a second scaling, wherein the first scaling is a scaling determined according to the height of a display screen of the test device and the height of a display interface, and the second scaling is a scaling determined according to the width of the display screen of the test device and the width of the display interface.

In some embodiments, in order to facilitate the user to visually see the operation effect corresponding to the second operation, the method may further include the following operations: after the operation command is transmitted to the second server side through the first server side, an updated application interface of the target test equipment is displayed in a display interface of the client side, wherein the updated application interface is an application interface which is updated by the target test equipment in response to the operation command. For example, the user performs a click operation on a "second-to-third-day" component in the application interface at the client, and the user can determine whether the second operation is successful through the application interface returned by the test device.

In some embodiments, the application interface or the updated application interface may be obtained as follows.

Firstly, an image downloading request is sent to a first server side, wherein the image downloading request comprises a resource path, and the resource path comprises a first server side IP address, a storage path and a testing equipment unique identification code. The unique identification code of the test device can be distributed by the second server side and is a globally unique identification code.

And then, obtaining an application interface or an updated application interface corresponding to the resource path from the first server, wherein the application interface or the updated application interface is an image obtained by the target test equipment through screenshot, and the target test equipment is equipment corresponding to the unique identification code of the test equipment. For example, the target test device responds to an operation command "click coordinate (x, y)" from the second server, and if the corresponding "second-day-killing" component is located at the coordinate (x, y), the target test device may jump to the application interface of "second-day-killing".

Then, the application interface is rendered or updated, and the rendered application interface or the updated application interface is displayed on the display interface of the client so as to perform application testing based on the operation of the rendered application interface or the updated application interface.

In some embodiments, in order to improve the display effect of the application interface of the test device exposed at the client, a scaling operation may be performed on the application interface of the target test device.

Specifically, before or after obtaining the application interface corresponding to the resource path from the first server, the method may further include the following operation.

First, size information of a test apparatus display screen of a target test apparatus is obtained. The size information may be at least one of height information, width information, resolution, pixel row number or pixel column number, which can represent the size information. Specifically, the height and/or width of the test device display screen may be obtained from the device information list.

Accordingly, rendering the application interface may include: rendering the presentation interface based on a particular scale, wherein the particular scale is a large scale of a first scale and a second scale, the first scale being a scale for the application interface determined based on a height of the test device display screen and a height of the presentation interface, the second scale being a scale for the application interface determined based on a width of the test device display screen and a width of the presentation interface.

In this embodiment, a user may perform an application test at a client by using a plurality of registered test devices, and user experience may be improved by improving a display effect.

Fig. 20 is a flowchart illustrating another application testing method according to an embodiment of the present invention.

Referring to fig. 20, the application test method performed by the first server may include operations S2010 to S2030.

In operation S2010, an application interface corresponding to a target test device is sent to the client, where the target test device is a test device corresponding to information in the test device information set targeted by the first operation. The application interface, the first operation, the target test device and the test device information set may refer to the above related contents, and will not be described in detail here.

In operation S2020, in response to an operation command for the target device from the client, the operation command is sent to the second server, so that the second server controls the target testing device to perform an application test based on the operation command, and obtains and sends an updated application interface to the first server. The second server may be a host, such as a computing device (e.g., a personal computer) that may be connected to at least one testing apparatus. For example, the second server may send a control command to the testing device to implement the application test.

In operation S2030, in response to an update image download request from the client, the update application interface is transmitted to the client so that the client presents the update application interface.

In this embodiment, the update application interface may be stored in the server or in a file server connected to the server. This facilitates the client to download the required updated application interface. Wherein the naming of the update application interface may include a test device unique identifier to facilitate determining the desired update application interface.

In some embodiments, sending the application interface corresponding to the target test device to the client may include the following operations.

First, a test device data request is obtained from a client. The test device data request may include address information of the client, so as to return the test device data based on the address information of the client.

And then, responding to the test equipment data request, sending the test equipment data from the at least one second server to the client so as to display the test equipment data in a display interface of the client.

And then, responding to an image downloading request from the client, and sending the application interface of the target test equipment to the client, wherein the image downloading request comprises the target test equipment data in the test equipment data.

Through the method, the first server side can provide the application interface of the target test device for the client side.

The test equipment data can be stored in the test equipment data set, the test equipment unique identification code and the test equipment data set identification in the test equipment data set are jointly used as a key (key) of the hash value, the test equipment information is used as a value (value) of the hash value, and the effective duration of the key (key) of the hash value is smaller than or equal to a preset duration threshold.

In some embodiments, the stability of the system can be improved by asynchronous uploading and downloading of application interfaces. Specifically, in response to an image download request from the client, transmitting the application interface of the target test device to the client may include the following operations.

First, an image download request from a client is obtained, the image download request including a resource path, the resource path including a storage path and a test device unique identification code.

And then, responding to the image downloading request, and determining an application interface corresponding to the unique identification code of the testing equipment based on the storage path and the unique identification code of the testing equipment, wherein the application interface is an image obtained by screenshot of target testing equipment, and the target testing equipment is equipment corresponding to the unique identification code of the testing equipment.

And then, sending the application interface corresponding to the unique identification code of the test equipment to the client.

In some embodiments, sending the operation command to the second server side in response to the operation command for the target device from the client side may include the following operations.

First, in response to obtaining an operation command from a client, the operation command is stored in a command data set, wherein the operation command is a command for a target test device corresponding to an application interface exposed by the client. The command data set and the test device data set may be stored in different storage spaces, respectively.

Then, an operation command downloading request from the second server side is obtained, wherein the operation command downloading request comprises the unique identification code of the testing equipment. The test device unique identification code makes it possible to determine the required operating command from the command data set.

And then, responding to the operation command downloading request, transmitting the operation command corresponding to the unique identification code of the test equipment in the command data set to the second server so that the second server executes the operation command and controls the target test equipment to perform application test.

In some embodiments, the operation command may be detected based on the parity segment to reduce the risk of performing malicious operations.

Specifically, the android system installed on the test equipment is taken as an example for illustrative explanation. The operation command conforms to the specification of an android debug bridge (adb) command. The verification segment may be an android debug bridge (adb) prefix.

In response to obtaining the operation command from the client, storing the operation command in the command data set may include the following operations.

Then, in response to the operation uploading request, generating a key (key) of the command data set, wherein the key (key) of the command data set comprises a unique identification code of the testing equipment and an android debug bridge (adb) prefix. The adb prefix may facilitate determining whether the operation command is a malicious command, such as an operation command without the adb prefix being a malicious command.

In some embodiments, to alleviate the problem of network fluctuation and the like resulting in easy loss of operation commands, operation redundancy space may be provided. Such as multiple operation commands may be stored in a command data set. In addition, to avoid a read error command, the operation command may be stored in a first-in-first-out manner.

Specifically, in response to the operation command downloading request, transmitting the operation command corresponding to the unique identification code of the test device in the command data set to the second server may include the following operations.

First, a command data set is looked up based on the unique identification code of the test device.

Then, the last command in the command data set is taken as an operation command corresponding to the unique identification code of the test equipment, and the last command is deleted. This allows the operation command to be stored using a small memory space and provides a redundant space.

In some embodiments, to avoid confusion caused by a plurality of users simultaneously using the same test device for application testing, the method may further include the following operations.

First, a test device lock request is obtained from a client, the test device lock request including a test device unique identification code of a target test device.

In this embodiment, the server side provides at least some of a heartbeat detection service for device registration discovery, a device list service, a locking/unlocking device service, an image transmission service, and an instruction center, so that a test device in a multi-user control distributed setting can perform an application test.

Fig. 21 is a flowchart illustrating another application testing method according to an embodiment of the present invention.

Referring to fig. 21, the application test method may include operations S2110 to S2120.

In operation S2110, local test device data is sent to the first server according to a preset period, where the local test device data includes test device data of at least one test device connected to the second server.

In the present embodiment, the preset period may be determined according to expert experience, user preference, or usage effect. For example, the preset period may be 1 second, 2 seconds, 3 seconds, 5 seconds, 8 seconds, 10 seconds, 15 seconds, or the like. The local test equipment data may be test equipment information data of test equipment connected to the second server side. Such as the unique identification code of the test equipment, the network connection status of the test equipment, etc. Hardware information of the test equipment, etc.

In operation S2120, in response to an operation command for a target test device from a first server, the target test device is controlled to perform an application test, where the target test device is a device corresponding to target data, the operation command is a command converted based on a second operation of an application interface of the target test device exposed by a client, and the target data is data determined by a first operation from a data set including local test device data.

Various related technologies may be adopted to implement the second server (e.g. PC) to control the target testing device to perform the application test.

In some embodiments, local test equipment data may be obtained in the following manner. Firstly, the equipment serial number of the external test equipment connected with the second server side is obtained. And acquiring the height of the display screen of the test equipment and the width of the display screen of the test equipment corresponding to the equipment serial number. The device serial number can facilitate global uniqueness of the unique identifier of the test equipment. The height of the test equipment display screen and the width of the test equipment display screen are convenient for adjusting the display effect of the application interface at the client.

In some embodiments, sending the local test equipment data to the first server according to the preset period may include the following operations. The method comprises the steps of requesting heartbeat detection service provided by a first server side, and sending local test equipment data to the first server side, wherein the local test equipment data comprise: the unique identification code of the test equipment and the test equipment information, the test equipment information comprises: at least one of a test equipment serial number, a height of a test equipment display screen, and a width of the test equipment display screen. The heartbeat report may be reported according to a frequency such as 3 seconds, 5 seconds, 10 seconds, 15 seconds, and the like. The heartbeat report is convenient for the first server side to update the data set of the test equipment. If the test device which does not perform heartbeat reporting is not considered to be suitable for performing application testing, for example, the connection is disconnected.

In some embodiments, in response to an operation command for the target test device from the first server, controlling the target test device to perform the application test may include the following operations.

Firstly, an operation command downloading request is sent to a first server side, and the operation command downloading request comprises a test equipment unique identification code in local test equipment data.

Then, an operation command corresponding to the unique identification code of the test equipment from the first server is obtained, and the operation command is executed to control the target test equipment to perform application test. Through similar queue type command uploading and command downloading, the reliability is higher compared with the mode that the operation command is directly transmitted.

In some embodiments, in response to an operation command for the target test device from the first server, controlling the target test device to perform the application test may include the following operations. And if the operation command comprises an android debug bridge (adb) prefix, controlling the target test equipment to perform application test in response to the operation command aiming at the target test equipment.

In some embodiments, the application interface of the target test device is obtained as follows.

Firstly, controlling at least one testing device connected with a second server end to respectively perform screenshot to obtain an application interface of each testing device.

And then, controlling at least one test device connected with the second server end to transmit the application interface to the second server end respectively.

Then, the application interface uploaded by each of the at least one testing device is transmitted to the first server side, so that the client side can download the application interface of the target testing device from the first server side.

In some embodiments, controlling at least one testing device connected to the second server side to perform screenshots each may include the following operations. And in response to an operation command downloaded from the first server end to an application interface aiming at the target test equipment, controlling at least one test equipment connected with the second server end to respectively perform a specified number of screenshots according to a preset frequency. Wherein the preset frequency may be 0.1 second, 0.2 second, 0.3 second, 0.5 second, 1 second, etc. The higher the preset frequency is, the more continuous the intercepted image is, so that the user can conveniently check the application test process at the client. However, if the preset frequency is too high, too much network resources may be occupied, and too much storage space may be occupied. The specified number of times may be set based on expert experience or user preference or the like. The appointed number of screenshots can better reflect the application test process (such as an interface jump process).

Accordingly, controlling at least one test device connected to the second server to transmit each application interface to the second server may include: and controlling at least one test device connected with the second server end to transmit the application interface to the specified file of the local storage space of the second server end.

By the method, the screen capturing times can be effectively reduced, the image uploading times can be reduced, and the network resource occupation amount can be further reduced.

In some embodiments, downloading the application interface may be accomplished by logging into a database, or the like. For example, transmitting the application interface uploaded by each of the at least one testing device to the first server side may include the following operations.

First, a first server is remotely logged in. For example, the image download request may include login account information for remotely logging into the database of the first server.

In this embodiment, the second server provides: the android device connected with the pc has a heartbeat reporting function, an adb command downloading and executing function and a test device screenshot capturing and uploading function. Based on at least part of the three functions, the test equipment which can realize the multi-user control distributed setting is enabled to carry out application test.

The invention also provides a remote control device which is arranged in the client.

Fig. 22 is a block diagram showing a configuration of a remote control apparatus according to an embodiment of the present invention.

Referring to fig. 22, the apparatus 2200 includes: an application interface presentation module 2210, a second operation obtaining module 2220, and an operation command generating module 2230.

The application interface presentation module 2210 is configured to present an application interface of a target test device in a presentation interface of a client, where the target test device is a device corresponding to target information, and the target information is information determined from a test device information set based on a first operation.

The second operation obtaining module 2220 is configured to obtain, through the presentation interface of the client, a second operation of the application interface for the target test device.

The operation command generating module 2230 is configured to generate an operation command for the target testing device in response to the second operation, and transmit the operation command to the second server, so that the second server controls the target testing device to perform the application test.

The invention also provides a remote control device which is arranged at the first server side.

Fig. 23 is a block diagram showing the configuration of another remote control apparatus according to the embodiment of the present invention.

Referring to fig. 23, the remote control device 2300 may include: an operation command storage module 2310, a command download request obtaining module 2320 and an operation command transmission module 2330.

The operation command storage module 2310 is used for storing operation commands in the command data set in response to obtaining the operation commands from the client, wherein the operation commands are commands for the target test equipment corresponding to the application interface.

The command download request obtaining module 2320 is configured to obtain an operation command download request from the second server, where the operation command download request includes the unique test equipment identification code.

The operation command transmitting module 2330 is configured to transmit, in response to the operation command downloading request, the operation command corresponding to the unique identification code of the test device in the command data set to the second server, so that the second server executes the operation command to control the target test device to perform the application test.

The invention also provides an application testing device which is arranged at the second server side.

Fig. 24 is a block diagram showing the configuration of another remote control apparatus according to the embodiment of the present invention.

Referring to fig. 24, the remote control device 2400 may include: a local test equipment data obtaining module 2410, a command download request sending module 2420 and an operation command executing module 2430.

The local test equipment data obtaining module 2410 is configured to obtain local test equipment data, where the local test equipment data includes a test equipment unique identification code of at least one test equipment connected to the second server.

The command download request sending module 2420 is configured to send an operation command download request to the first server, where the operation command download request includes a test device unique identifier in the local test device data.

The operation command executing module 2430 is configured to obtain an operation command corresponding to the unique identification code of the testing device from the first server, and execute the operation command to control the target testing device to perform the application test.

With regard to the apparatuses 2200, 2300 and 2400 in the above embodiments, the specific manner in which each module and unit performs operations has been described in detail in the embodiments related to the method, and will not be elaborated herein.

In another aspect of the invention, a remote control system is also provided.

Fig. 25 is a block diagram showing the structure of a remote control system according to an embodiment of the present invention.

Referring to fig. 25, the application test system 2500 may include: a client 2510, a first server 2520, and a second server 2530.

The client 2510 is used to perform the methods performed by the client as described above.

The first server 2520 is configured to perform the method as described above for the first server.

The second server 2530 is configured to perform the method as performed by the second server.

In this embodiment, the distributed test equipment can be displayed to the user in real time for the user to select. The operation input by the user at the client can be fed back to the remote testing equipment in real time so as to execute the operation command corresponding to the operation, and the testing equipment image in the testing process can be displayed in the display interface of the client in real time.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Fig. 26 is a block diagram illustrating a structure of a computing device according to an embodiment of the present invention. The computing device may be, for example, a configuration platform device, a web page side device, a client device, or the like.

Referring to fig. 26, computing device 2600 includes a memory 2610 and a processor 2620.

Processor 2620 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be a variety of conventional processors and the like.

The memory 2610 may include various types of storage units such as system memory, Read Only Memory (ROM), and a persistent storage device. Wherein the ROM may store static data or commands needed by the processor 1020 or other modules of the computer. The persistent storage device may be a read-write storage device. The persistent storage may be a non-volatile storage device that does not lose stored commands and data even after the computer is powered down. In some embodiments, the persistent storage device employs a mass storage device (e.g., magnetic or optical disk, flash memory) as the persistent storage device. In other embodiments, the permanent storage may be a removable storage device (e.g., floppy disk, optical drive). The system memory may be a read-write memory device or a volatile read-write memory device, such as a dynamic random access memory. The system memory may store commands and data that some or all of the processors require at runtime. In addition, the memory 2610 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (DRAM, SRAM, SDRAM, flash memory, programmable read only memory), magnetic or optical disks, or any combination thereof. In some embodiments, memory 2610 may include a removable storage device that is readable and/or writable, such as a Compact Disc (CD), a read-only digital versatile disc (e.g., DVD-ROM, dual layer DVD-ROM), a read-only Blu-ray disc, an ultra-density optical disc, a flash memory card (e.g., SD card, min SD card, Micro-SD card, etc.), a magnetic floppy disc, or the like. Computer-readable storage media do not contain carrier waves or transitory electronic signals transmitted by wireless or wired means.

The memory 2610 has stored thereon executable code that, when processed by the processor 2620, may cause the processor 2620 to perform some or all of the methods described above.

The aspects of the invention have been described in detail hereinabove with reference to the drawings. In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to the related descriptions of other embodiments. Those skilled in the art should also appreciate that the acts and modules referred to in the specification are not necessarily required by the invention. In addition, it can be understood that the steps in the method according to the embodiment of the present invention may be sequentially adjusted, combined, and deleted according to actual needs, and the modules in the device according to the embodiment of the present invention may be combined, divided, and deleted according to actual needs.

Furthermore, the method according to the invention may also be implemented as a computer program or computer program product comprising computer program code instructions for carrying out part or all of the steps of the above-described method of the invention.

Alternatively, the present invention may also be embodied as a non-transitory machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium) having stored thereon executable code (or a computer program, or computer command code) that, when executed by a processor of a computing device (or electronic apparatus, server, or the like), causes the processor to perform part or all of the steps of the above-described method according to the present invention.

Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the invention herein may be implemented as electronic hardware, computer software, or combinations of both.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems and methods according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable commands for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1.A remote control method performed by a client, comprising:

displaying an application interface of target test equipment in a display interface of the client, wherein the target test equipment is equipment corresponding to target information, and the target information is information determined from a test equipment information set based on a first operation;

obtaining a second operation of an application interface aiming at the target test equipment through a display interface of the client;

and responding to the second operation, generating an operation command for the target test equipment, and transmitting the operation command to a second server side so that the second server side controls the target test equipment to perform application test.

2. The method of claim 1, wherein generating an operation command for the target test device in response to the second operation comprises:

converting a second operation for the client to an operation for the target test device based on a difference between the first attribute of the target test device and the second attribute of the client to generate an operation command for the target test device based on the operation for the target test device.

3. The method of claim 2, wherein converting the second operation for the client to the operation for the target test device based on the difference between the first attribute of the target test device and the second attribute of the client comprises:

converting a second operation of the presentation interface for the client to an operation of the application interface for the target test device based at least on a coordinate conversion, the second operation comprising: at least one of click operation, sliding operation, long-time pressing operation and virtual key operation, wherein the target object aimed at by the virtual key operation comprises an entity key of the target test equipment.

4. The method of claim 3, wherein converting the second operation of presenting the interface to the client to the operation of applying the interface to the target test device based on at least the coordinate transformation comprises at least one of:

for the click operation, zooming the coordinate value corresponding to the click operation according to a specific zoom ratio to obtain the coordinate value of the click operation aiming at the application interface;

for the sliding operation, zooming the coordinate value of the start point coordinate corresponding to the sliding operation according to a specific zooming proportion to obtain a sliding start point coordinate value aiming at the application interface, and/or zooming the coordinate value of the end point coordinate corresponding to the sliding operation according to a specific zooming proportion to obtain a sliding end point coordinate value aiming at the application interface;

for the long press operation, zooming the coordinate value of the click coordinate corresponding to the long press operation according to a specific zoom ratio, and obtaining the coordinate value and the click duration of the long press operation aiming at the application interface by combining the click duration;

and for the virtual key operation, obtaining the operation of the key corresponding to the virtual key for the test equipment based on the clicking operation of the virtual key displayed on the display interface of the client.

5. The method of claim 4, further comprising:

obtaining the size of a test equipment display screen of the target test equipment and the size of a display interface of the client;

and determining the specific scaling according to the size of the display screen of the test equipment and the size of the display interface.

6. The method of claim 5, wherein:

the particular scaling includes: a first scaling determined according to the height of the test equipment display screen and the height of the display interface, or a second scaling determined according to the width of the test equipment display screen and the width of the display interface;

the method further comprises the following steps: storing the first scaling or the second scaling;

the converting, based on the coordinate conversion, a second operation of the presentation interface for the client to an operation of the application interface for the target test device includes:

converting a second operation of the presentation interface for the client into an operation of the application interface for the target test device based on the first scaling or the second scaling.

7. The method of claim 1, wherein:

the transmitting the operation command to the second server includes:

sending an operation uploading request to a first server side so as to store the operation command in the first server side, so that the second server side can download the operation command, wherein the operation uploading request comprises a test equipment unique identification code of the target test equipment and the operation command;

or

Sending an operation uploading request to the first server side, and sending a test device locking request to the first server side, wherein the test device locking request comprises a test device unique identification code of the target test device.

8. A remote control method performed by a first server, comprising:

in response to obtaining an operation command from a client, storing the operation command in a command data set, wherein the operation command is a command for a target test device, and the target test device is a device corresponding to an application interface displayed by the client;

obtaining an operation command downloading request from a second server, wherein the operation command downloading request comprises a unique identification code of the test equipment;

and responding to the operation command downloading request, and transmitting an operation command corresponding to the unique identification code of the test equipment in the command data set to the second server so that the second server executes the operation command and controls the target test equipment to perform application test.

9. The method of claim 8, wherein the transmitting, to the second server, the operation command corresponding to the unique identification code of the test device in the command data set in response to the operation command download request comprises:

searching a command set from the command data set based on the unique identification code of the test equipment;

and taking the last command in the command set as an operation command corresponding to the unique identification code of the test equipment, and deleting the last command.

10. The method of claim 9, further comprising:

obtaining a test equipment locking request from a client, wherein the test equipment locking request comprises a test equipment unique identification code of the target test equipment;

responding to the test equipment locking request, updating locking state data corresponding to the unique identification code of the test equipment in a test equipment state data set into a locking state, wherein the effective duration of the locking state is less than or equal to a preset duration threshold;

and if the duration of the locked state data corresponding to the unique identification code of the test equipment after being updated to the locked state exceeds the preset duration threshold and the test equipment locking request comprising the unique identification code of the test equipment of the target test equipment is not received again, updating the locked state data corresponding to the unique identification code of the test equipment to the unlocked state.

11. A remote control method executed by a second server, comprising:

obtaining local test equipment data, wherein the local test equipment data comprises a test equipment unique identification code of at least one test equipment connected with the second server end;

sending an operation command downloading request to a first server side, wherein the operation command downloading request comprises a test equipment unique identification code in the local test equipment data;

and obtaining an operation command corresponding to the unique identification code of the test equipment from the first server side, and executing the operation command to control the target test equipment corresponding to the unique identification code of the test equipment to perform application test.

12. The method of claim 11, wherein the executing the operation command comprises:

and if the operation command comprises a check prefix, executing the operation command.

13. A computing device, comprising:

a processor; and

a memory having executable code stored thereon, which when executed by the processor, causes the processor to perform the method of any of claims 1-12.