CN114116435A

CN114116435A - Game testing method, system, electronic device and computer readable storage medium

Info

Publication number: CN114116435A
Application number: CN202010872401.1A
Authority: CN
Inventors: 盛璇; 许永会; 朱宏波; 张超; 刘杰; 刘明玉
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-08-26
Filing date: 2020-08-26
Publication date: 2022-03-01

Abstract

The application belongs to the field of testing of application software and provides a game testing method, a game testing system, electronic equipment and a computer readable storage medium, wherein the game testing method comprises the following steps: when a game to be tested runs on the terminal to be tested, a first image of a display interface of the terminal to be tested is obtained, an operation instruction is generated according to the first image and a game strategy stored in advance, a manipulator which is in communication connection with the electronic equipment is instructed according to the operation instruction to perform gesture operation on the game to be tested, and when the game to be tested responds to the gesture operation, running state information of the game to be tested is obtained. The gesture operation of the manipulator on the game to be tested is equivalent to the gesture operation of the user on the game to be tested, so that the actual game operation scene can be simulated, the running state information of the game to be tested, which is acquired in the simulated actual game operation scene, can reflect the performance of the game to be tested when the game to be tested runs on the terminal to be tested, and the accuracy of the test result is improved.

Description

Game testing method, system, electronic device and computer readable storage medium

Technical Field

The present application relates to the field of testing application software, and in particular, to a game testing method, system, electronic device, and computer-readable storage medium.

Background

With the continuous improvement of functions and performances of intelligent terminal products such as mobile phones and the like, the types of mobile phone games are more and more, and after the mobile phone games are developed, the performances of the games need to be tested. In the existing game testing method, the source code of a game product is generally tested, and the testing result cannot reflect the performance of the game when the game runs on a mobile phone, so that the testing result is inaccurate.

Disclosure of Invention

The application provides a game testing method, a game testing system, electronic equipment and a computer readable storage medium, which can improve the accuracy of game testing.

In order to achieve the purpose, the technical scheme is as follows:

when a game to be tested runs on a terminal to be tested, acquiring a first image of a display interface of the terminal to be tested; generating an operation instruction according to the first image and a pre-stored game strategy; according to the operation instruction, a manipulator which is in communication connection with the electronic equipment is instructed to perform gesture operation on the game to be tested; and when the game to be tested responds to the gesture operation, acquiring the running state information of the game to be tested.

In the embodiment, when the game to be tested runs on the terminal to be tested, the electronic device obtains a first image of a display interface of the terminal to be tested, generates an operation instruction according to the first image and a game strategy stored in advance, instructs a manipulator in communication connection with the electronic device to perform gesture operation on the game to be tested according to the operation instruction, and obtains running state information of the game to be tested when the game to be tested responds to the gesture operation. The gesture operation of the manipulator on the game to be tested is equivalent to the gesture operation of the user on the game to be tested, so that the actual game operation scene can be simulated, the running state information of the game to be tested, which is acquired in the simulated actual game operation scene, can reflect the performance of the game to be tested when the game to be tested runs on the terminal to be tested, and the accuracy of the test result is improved.

In a possible implementation manner of the first aspect, the obtaining the running state information of the game to be tested when the game to be tested responds to the gesture operation includes:

when the game to be tested responds to the gesture operation, acquiring a second image of a display interface of the terminal to be tested; and determining first state information of the game to be tested according to the second image. The first state information comprises the response time of the game to be tested to the gesture operation, the morton information of the game to be tested and the like, and the performance information of the game to be tested during running can be analyzed through the second image of the display interface of the terminal to be tested.

In a possible implementation manner of the first aspect, the running state information includes second state information, and correspondingly, when the game to be tested responds to the gesture operation, acquiring the running state information of the game to be tested includes:

when the game to be tested responds to the gesture operation, acquiring a thermal imaging image of the surface of the terminal to be tested, which is sent by a thermal imaging camera in communication connection with the electronic equipment; and determining second state information of the game to be tested according to the thermal imaging image, wherein the second state analysis comprises heat information generated by the terminal to be tested when the game to be tested runs.

In a possible implementation manner of the first aspect, the running state information includes third state information, and correspondingly, when the game to be tested responds to the gesture operation, acquiring the running state information of the game to be tested includes:

when the game to be tested responds to the gesture operation, the performance information of the terminal to be tested and the power consumption information of the game to be tested, which are sent by the terminal to be tested, are obtained, the performance information and the power consumption information are used as third state information of the game to be tested, and the electronic equipment can analyze the requirement information of the game to be tested on the running environment by obtaining the third state information.

In a possible implementation manner of the first aspect, before the obtaining the running state information of the game to be tested, the method further includes:

acquiring environmental temperature information; and according to the environmental temperature information, indicating a temperature control device in communication connection with the electronic device to adjust the temperature in a preset space to a preset temperature, wherein the terminal to be tested is positioned in the preset space, so that the running states of the terminal to be tested at different environmental temperatures can be simulated.

In a possible implementation manner of the first aspect, the generating an operation instruction according to the first image and a pre-stored game policy includes:

inputting the first image into a preset scene recognition model, and acquiring a game scene output by the preset scene recognition model; and generating an operation instruction according to the game scene and the pre-stored game strategy. The game scene is identified through the scene identification model, so that the accuracy of scene identification can be improved, and meanwhile, the calculation speed is improved.

In a possible implementation manner of the first aspect, the obtaining a first image of a display interface of the terminal to be tested includes:

and acquiring a first image of a display interface of the terminal to be tested, which is sent by a first camera in communication connection with the electronic equipment.

and determining the moving distance of the manipulator in the preset direction according to the first image, the prestored game strategy and the mapping relation among the coordinate system of the first camera, the coordinate system of the terminal to be tested and the coordinate system of the manipulator, and determining the moving distance of the manipulator according to the mapping relation among the coordinate systems, so that the manipulator can move to an accurate position, and the accuracy of gesture operation is improved.

In a possible implementation manner of the first aspect, before determining the moving distance of the manipulator in the preset direction according to the first image, the pre-stored game strategy, and the mapping relationship among the coordinate system of the first camera, the coordinate system of the terminal to be tested, and the coordinate system of the manipulator, the method further includes:

when the display interface of the terminal to be tested displays a preset correction image, acquiring a third image of the display interface of the terminal to be tested, which is shot by the first camera, and acquiring a screenshot of the display interface sent by the terminal to be tested, wherein the preset correction image comprises mark points;

determining first coordinate information of the mark point in the third image in a coordinate system of the first camera and second coordinate information of the mark point in a screenshot of the display interface in the coordinate system of the terminal to be tested;

when the manipulator moves to the mark point, acquiring third coordinate information of the manipulator in a coordinate system of the manipulator;

and determining a mapping relation among the coordinate system of the first camera, the coordinate system of the terminal to be tested and the coordinate system of the manipulator according to the first coordinate information, the second coordinate information and the third coordinate information.

In a second aspect, there is provided a game testing apparatus comprising:

the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a first image of a display interface of a terminal to be tested when a game to be tested runs on the terminal to be tested;

the determining module is used for generating an operation instruction according to the first image and a pre-stored game strategy;

the indicating module is used for indicating a manipulator which is in communication connection with the electronic equipment to perform gesture operation on the game to be tested according to the operation instruction;

and the testing module is used for acquiring the running state information of the game to be tested when the game to be tested responds to the gesture operation.

In a possible implementation manner of the second aspect, the running state information includes first state information, and correspondingly, the test module is specifically configured to:

when the game to be tested responds to the gesture operation, acquiring a second image of a display interface of the terminal to be tested;

and determining first state information of the game to be tested according to the second image.

In a possible implementation manner of the second aspect, the running state information includes second state information, and correspondingly, the test module is specifically configured to:

when the game to be tested responds to the gesture operation, acquiring a thermal imaging image of the surface of the terminal to be tested, which is sent by a thermal imaging camera in communication connection with the electronic equipment;

and determining second state information of the game to be tested according to the thermal imaging image.

In a possible implementation manner of the second aspect, the running state information includes third state information, and correspondingly, the test module is specifically configured to:

when the game to be tested responds to the gesture operation, acquiring the performance information of the terminal to be tested and the power consumption information of the game to be tested, which are sent by the terminal to be tested;

and taking the performance information and the power consumption information as third state information of the game to be tested.

In a possible implementation manner of the second aspect, the indication module is further configured to:

acquiring environmental temperature information;

and according to the environmental temperature information, indicating a temperature control device in communication connection with the electronic device to adjust the temperature in a preset space to a preset temperature, wherein the terminal to be tested is located in the preset space.

In a possible implementation manner of the second aspect, the determining module is specifically configured to:

inputting the first image into a preset scene recognition model, and acquiring a game scene output by the preset scene recognition model;

and generating an operation instruction according to the game scene and the pre-stored game strategy.

In a possible implementation manner of the second aspect, the obtaining module is specifically configured to:

In a possible implementation manner of the second aspect, the operation instruction includes a moving distance of the manipulator in a preset direction, and correspondingly, the determining module is specifically configured to:

and determining the moving distance of the manipulator in the preset direction according to the first image, the prestored game strategy and the mapping relation among the coordinate system of the first camera, the coordinate system of the terminal to be tested and the coordinate system of the manipulator.

In a possible implementation manner of the second aspect, the determining module is specifically further configured to:

In a third aspect, there is provided an electronic device comprising a processor for executing a computer program stored in a memory to implement the game testing method as described in the first aspect above.

In a fourth aspect, a game testing system is provided, which comprises a terminal to be tested, a manipulator and the electronic device as described in the third aspect.

In a possible implementation manner of the fourth aspect, the game testing system further includes a first camera, a second camera, a thermal imaging camera and/or a temperature control device which are in communication connection with the electronic device.

In a fifth aspect, there is provided a computer readable storage medium storing a computer program which, when executed by a processor, implements a game testing method as described in the first aspect above.

A sixth aspect provides a computer program product for causing a terminal device to perform the game testing method of the first aspect when the computer program product is run on the terminal device.

It is understood that the beneficial effects of the second to sixth aspects can be seen from the description of the first aspect, and are not described herein again.

Drawings

FIG. 1 is a schematic diagram of a game testing system to which a game testing method according to an embodiment of the present disclosure is applied;

FIG. 2 is an architecture diagram of a game testing system provided in an embodiment of the present application;

FIG. 3 is a schematic flow chart illustrating a game testing method according to an embodiment of the present disclosure;

FIG. 4 is a schematic view of a game testing scenario provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of coordinate system calibration provided by an embodiment of the present application;

fig. 6 is a schematic view of an electronic device provided in an embodiment of the present application.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to" determining "or" in response to detecting ". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".

In addition, in the description of the present application, the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not to be construed as indicating or implying relative importance.

Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.

In the existing game testing method, the source code of a game product is generally tested, and the testing result cannot reflect the performance of the game when the game runs on a mobile phone, so that the testing result is inaccurate. Therefore, the game testing method provided by the embodiment of the application can simulate the actual game operation scene of a user operating a game, and then obtain the running state information of the game to be tested in the simulated actual game operation scene, wherein the running state information can reflect the performance of the game to be tested when the game to be tested runs on the terminal to be tested, so that the accuracy of the test result is improved.

The following describes an exemplary game testing method provided in the embodiments of the present application.

As shown in fig. 1, fig. 1 is a schematic view of a game testing system to which the game testing method provided in the embodiment of the present application is applied, where the game testing system includes an electronic device 100, a terminal 200 to be tested, and a gesture action device 300. The terminal to be tested 200 and the gesture motion device 300 are both in communication connection with the electronic device 100. The electronic device 100 may be a computing device such as a mobile phone, a computer, or a server. The terminal 200 to be tested may be a mobile phone or a tablet computer, and the game to be tested is run on the terminal 200 to be tested. The gesture motion apparatus 300 includes at least one robot and a position adjustment module corresponding to each robot, the position adjustment module being configured to drive the corresponding robot to move in the X-axis, Y-axis and Z-axis directions. The electronic device 100 is configured to obtain a first image of a display interface of the terminal to be tested 200 when the game to be tested runs on the terminal to be tested 200, generate an operation instruction according to the first image and a game strategy pre-stored in the electronic device 100, send the operation instruction to the position adjusting module, and the position adjusting module controls the manipulator to move according to the operation instruction, so as to perform gesture operation on the game to be tested. The gesture operation can be single click, double click, long press, dragging, sliding and the like, and can be single manipulator operation or simultaneous operation of two manipulators. When the game to be tested responds to the gesture operation, the electronic device 100 acquires the running state information of the game to be tested. The gesture operation of the manipulator on the game to be tested is equivalent to the gesture operation of the user on the game to be tested, so that the actual game operation scene can be simulated, the running state information of the game to be tested, which is acquired in the simulated actual game operation scene, can reflect the performance of the game to be tested when the game to be tested runs on the terminal to be tested, and the accuracy of the test result is improved.

In a possible implementation manner, the game testing system further includes a first camera 400 in communication connection with the electronic device 100, the first camera 400 is a high-definition camera, the first camera 400 may be disposed right above the terminal 200 to be tested, and is configured to collect a first image of a display interface of the terminal 200 to be tested, send the first image to the electronic device 100, and capture the first image with the first camera 400, so that image quality of the first image may be improved. The electronic equipment generates the operation instruction according to the first image and the game strategy, and the accuracy of the generated operation instruction is improved.

In a possible implementation manner, the game testing system further includes a second camera 500 communicatively connected to the electronic device 100, the second camera 500 is a high-speed camera, and the frame rate of acquisition of the second camera 500 is greater than 2 times the frame rate of the electronic device 100. The second camera 500 may be disposed right above the terminal to be tested 200, and is configured to collect a second image of the display interface of the terminal to be tested 200 and send the second image to the electronic device when the game to be tested responds to the gesture operation. The electronic device 200 is configured to determine first state information of the game to be tested according to the second image, where the first state information includes a response time of the game to be tested to the gesture operation, and a click-on information appearing on the terminal 200 to be tested during the running process of the game to be tested. The second camera 500 is further configured to monitor the gesture motion device 300, and generate corresponding prompt information when the gesture motion device 300 is abnormal. The first camera 400 and the second camera 500 may be the same camera or different cameras.

In a possible implementation manner, the game testing system further includes a thermal imaging device 600 communicatively connected to the electronic device 100, and the thermal imaging device 600 includes a thermal imaging camera, and the thermal imaging camera is configured to acquire a thermal imaging image of a surface (including a front surface and a back surface) of the terminal to be tested at a preset frequency (>1 time/minute) and transmit the thermal imaging image to the electronic device 100 when the game to be tested responds to the gesture operation. The electronic device 100 determines second state information of the game to be tested according to the thermal imaging image, wherein the second state information is heat information generated on the surface of the terminal to be tested in the running process of the game to be tested.

In a possible implementation manner, the game testing system further includes a temperature control device 700 in communication connection with the electronic device 100, where the temperature of the temperature control device 700 is in a range of 20 ℃ to 40 ℃, and the temperature control precision is less than 0.5 ℃. The electronic device 100 is configured to obtain ambient temperature information, and instruct the temperature control device 700 to adjust a temperature in a preset space to a preset temperature according to the ambient temperature information, where the terminal 200 to be tested is located in the preset space. The preset space can be a space in the incubator, namely the terminal 200 to be tested is placed in the incubator, and meanwhile, the two sides of the incubator are also provided with the ventilation convection holes, so that heat can be dissipated in time, the scenes of the terminal to be tested in different environment temperatures can be simulated, and the accuracy of game testing is improved.

In a possible implementation manner, the game testing system further includes a fixture device 800 communicatively connected to the electronic device 100, and the fixture device 800 is configured to fixedly hold the terminal 200 to be tested according to an instruction of the electronic device 100. The fixture device 800 may also control a power key, a volume up key, and a volume down key of the terminal 200 to be tested according to the instruction of the electronic device 100, and the fixture device 800 may control only one key or may control a plurality of keys simultaneously according to the instruction of the electronic device 100. The fixture device 800 is further provided with a communication interface, such as a USB interface, an earphone interface, a charging interface, and the like, for communicating with the terminal 200 to be tested, and the fixture device 800 can control a connection state between each communication interface and the terminal 200 to be tested according to an instruction of the electronic device 100.

Although not shown, the game testing system provided in the embodiment of the present application further includes a power module, a network interface, and the like, which are not described herein again.

As shown in fig. 2, a framework diagram of a game testing system to which the game testing method provided in the embodiment of the present application is applied is shown, where a software system of the electronic device 100 may adopt a layered architecture, the layered architecture divides software into a plurality of layers, and software interfaces are used between the layers for communication. In this embodiment, the software system of the electronic device 100 includes an application layer and a driver layer, the application layer includes an Artificial Intelligence (AI) action decision module, an AI scene recognition module, a state analysis module, and a game strategy behavior tree module, the driver layer includes a positioning navigation module, a temperature control module, a thermal collection module, a visual control module, a gesture simulation module, and a fixture control module, and the driver layer is in communication connection with the hardware layer. The hardware layer comprises a gesture action device, a first camera, a second camera, a thermal imaging device, a temperature control device and a clamp device.

The first camera shoots a first image, the first image is sent to the driving layer, and the visual control module of the driving layer sends the first image to the application layer. The AI scene recognition module of the application layer recognizes the first image, obtains a game scene according to the recognition result, and the AI action decision module generates an operation instruction according to the game scene and the game strategy behavior tree module and sends the operation instruction to the drive layer.

The fixture control module of the driving layer instructs the fixture device for clamping the terminal to be tested to execute corresponding key operation according to the operation instruction, and the positioning navigation module of the driving layer instructs the manipulator of the gesture action device to move according to the operation instruction, so that the manipulator moves to the preset position of the terminal to be tested. When the manipulator moves to the preset position, the gesture simulation module of the driving layer controls the manipulator to perform gesture operation according to the operation instruction.

When the manipulator carries out gesture operation, the second camera shoots a second image and sends the second image to the driving layer, the visual control module of the driving layer sends the second image to the application layer, and the state analysis module of the application layer determines first state information of a game to be tested according to the second image.

The state analysis module of the application layer acquires environment temperature information and sends the environment temperature information to the driving layer, and the temperature control module of the driving layer instructs the temperature control equipment to adjust the temperature in the space for placing the terminal to be tested according to the environment temperature information.

The thermal imaging device shoots a thermal imaging image of the surface of the terminal to be tested, the thermal imaging image is sent to the driving layer, the thermal acquisition module of the driving layer sends the thermal imaging image to the application layer, and the state analysis module of the application layer determines second state information of the game to be tested according to the thermal imaging image.

The following describes a game testing method provided in the embodiment of the present application, with reference to the game testing system shown in fig. 1 and 2.

As shown in fig. 3, the game testing method provided in the embodiment of the present application includes:

s101: when a game to be tested runs on a terminal to be tested, a first image of a display interface of the terminal to be tested is obtained.

Specifically, the terminal to be tested is fixed on the fixture device, the client application software of the game to be tested is installed on the terminal to be tested, the client application software can be opened by a user to run the game to be tested, and the electronic device can instruct the manipulator to open the client application software to run the game to be tested.

In a possible implementation manner, the electronic device comprises a camera, the electronic device controls the clamp device to move, so that the terminal to be tested is located at a position right opposite to the camera, and the camera shoots a first image of a display interface of the terminal to be tested.

In another possible implementation manner, the electronic device controls the fixture device to move, so that the terminal to be tested is located at a position right opposite to the first camera, the first camera shoots a first image of the display interface, and the first image is sent to the electronic device.

S102: and generating an operation instruction according to the first image and a pre-stored game strategy.

The game strategy comprises a game strategy behavior tree which is used for determining actions required to be executed in the current game scene. The electronic equipment identifies a game scene corresponding to the first image, determines an action to be executed according to the game scene and the game strategy, and determines a corresponding operation instruction according to the action to be executed. The game scene comprises the stage of the game, character information in the game, available prop information and the like, and the actions to be executed comprise actions of controlling characters in the game to advance towards a preset direction, controlling preset objects in the game to attack preset targets, controlling preset objects in the game to increase equipment and the like. The operation instruction comprises sliding towards a preset direction, long-pressing a preset control, clicking the preset control and the like.

For example, the game to be tested is a royal glory, if the identified game scene is that only two players remain in the teammates of one party and five players exist in the teammates of the other party, the action to be executed is determined to be back to city gate crystal according to the game scene and the game strategy, and the operation instruction is determined to be the sliding of the 'direction control' control in the back direction according to the action to be executed.

In one possible implementation manner, the electronic device identifies a game scene according to a preset scene identification model. Specifically, the electronic device inputs the first image into a preset scene recognition model, and obtains a game scene output by the scene recognition model. The scene recognition model is obtained by training the classification model by using a training sample by adopting a machine learning algorithm, wherein the training sample comprises an image of a display interface and a corresponding game scene. The scene recognition model is adopted to recognize the game scene, so that the game scene of the game to be tested running on the terminals to be tested of different models and different systems can be recognized, and the operation instruction is generated according to the recognized game scene and the game strategy, so that different scenes of the game to be tested can be tested.

S103: and instructing a manipulator in communication connection with the electronic equipment to perform gesture operation on the game to be tested according to the operation instruction.

Specifically, as shown in fig. 4, the electronic device instructs the manipulator 41 to move to a preset position of a display interface of the terminal to be tested according to the operation instruction, and performs a corresponding gesture operation, for example, after the manipulator moves to the preset position of the display interface, long-time pressing, sliding, clicking and the like are performed at the preset position. After the mechanical arm performs gesture operation on the game to be tested, the electronic device acquires a first image, generates an operation instruction according to the first image and a game strategy stored in advance, instructs the mechanical arm to perform gesture operation on the game to be tested according to the operation instruction, acquires the first image again after the mechanical arm performs gesture operation on the game to be tested, and executes the process until the game is finished.

In a possible implementation manner, before the electronic device instructs the manipulator to move according to the operation instruction, coordinate system correction is first performed, that is, a mapping relationship between the coordinate system of the first camera, the coordinate system of the terminal to be tested, and the coordinate system of the manipulator is determined.

Specifically, a preset application program is installed on the terminal to be tested, and when the preset application program is opened, a display interface of the terminal to be tested displays a correction image as shown in fig. 5, wherein the ground color of the correction image is pure white, the correction image includes 8 mark points a1, a2, A3, a4, a5, a6, a7 and A8, and the 8 mark points are all solid circles. The centers of the marked points A1, A2, A3 and A4 form a first rectangle, and the centers of the marked points A5, A6, A7 and A8 form a second rectangle. The corrected image further includes a third rectangle whose four vertices are a9, a10, a11, and a12, respectively, and whose area is smaller than that of the display interface. The first rectangle, the second rectangle and the third rectangle are similar rectangles, namely the proportion between the side lengths of the first rectangle, the proportion between the side lengths of the second rectangle and the proportion between the side lengths of the third rectangle are the same.

In one possible implementation manner, when the display interface displays the correction image, the first camera shoots a third image of the display interface, and the third image is sent to the electronic equipment. The electronic equipment establishes a coordinate system of the first camera according to the third image, identifies the position of the circle center of each marking point in the third image, and determines first coordinate information of the circle center of each marking point in the coordinate system of the first camera according to the position of the circle center of each marking point.

When the display interface displays the correction image, the electronic equipment instructs the manipulator and the clamp equipment to perform screen capture operation on the terminal to be tested, the terminal to be tested sends a screen capture of the display interface obtained by screen capture to the electronic equipment, the electronic equipment establishes a coordinate system of the terminal to be tested according to the screen capture of the display interface, identifies the position of the circle center of each mark point in the screen capture of the display interface, and determines second coordinate information of the circle center of each mark point in the coordinate system of the terminal to be tested according to the position of the circle center of each mark point.

And the electronic equipment can determine the mapping relation between the coordinate system of the first camera and the coordinate system of the terminal to be tested according to the first coordinate information and the second coordinate information.

In another possible implementation manner, when the display interface displays the correction image, after the electronic device identifies the second coordinate information of the circle center of each mark point in the screenshot of the display interface, the electronic device obtains the resolution information of the terminal to be tested from the terminal to be tested, and obtains the pixel information of the circle center of each mark point from a preset application program installed on the terminal to be tested. The electronic equipment can determine the pixel information of each vertex of the third rectangle according to the pixel information of the circle center of each mark point and the resolution information of the terminal to be tested, and can determine the coordinate information of each vertex of the third rectangle according to the corresponding relation between the pixel information of the circle center of each mark point and the second coordinate information and the pixel information of each vertex of the third rectangle.

After the electronic device determines the circle centers of the mark points and the coordinate information of the vertexes in the screenshot of the display interface, the distance d1 between the line segment A9a10 and the line segment A5a6 and the distance d2 between the line segment A1a2 and the line segment A5a6 in the screenshot of the display interface can be calculated. The electronic device may also determine the distance d3 between the line segment A1a2 and the line segment A5a6 in the third image according to the first coordinate information. In the third image, the distance between the line segment A9a10 and the line segment A5a6 is set to d4, and d4 can be calculated from the geometric relationship d1/d 2-d 4/d 3. Similarly, the distance between the line segments in the third image can be calculated according to the distance between the line segments in the screenshot of the display interface, the first coordinate information and the corresponding geometric relation, and then the coordinate information of each vertex of the third rectangle in the third image can be calculated according to the distance between the line segments and the first coordinate information, so that the center of a circle of each mark point in the third image and the coordinate information of each vertex are obtained.

And the electronic equipment can determine the mapping relation between the coordinate system of the first camera and the coordinate system of the terminal to be tested according to the circle center of each mark point and the coordinate information of each vertex in the screenshot of the display interface, the circle center of each mark point in the third image and the coordinate information of each vertex. The coordinate information in the screenshot of the display interface is calculated according to the pixels and the resolution of the terminal to be tested, so that the mapping relation between the coordinate system of the first camera and the coordinate system of the terminal to be tested can be determined for the terminals to be tested with different sizes and different resolutions, and the game testing method provided by the embodiment of the application can be adapted to different types of terminals to be tested.

The electronic equipment determines a mapping relation between a coordinate system of the first camera and a coordinate system of the terminal to be tested, and then instructs the manipulator to perform touch operation on a display interface of the terminal to be tested, when the manipulator performs touch operation on the display interface, a preset application program on the terminal to be tested generates touch coordinates corresponding to the touch operation, and the electronic equipment obtains the touch coordinates through the terminal to be tested. And when the electronic equipment judges that the manipulator is positioned at the circle center of the mark point according to the touch coordinate, acquiring second coordinate information of the mark point in a coordinate system of the terminal to be tested and third coordinate information of the manipulator in the coordinate system of the manipulator. And sequentially moving the manipulator to the circle center of each mark point, and acquiring corresponding second coordinate information and third coordinate information. The electronic equipment can determine the mapping relation between the coordinate system of the terminal to be tested and the coordinate system of the manipulator according to the second coordinate information and the third coordinate information, and further determine the mapping relation between the coordinate system of the first camera, the coordinate system of the terminal to be tested and the coordinate system of the manipulator.

After the electronic equipment determines the mapping relation among the coordinate system of the first camera, the coordinate system of the terminal to be tested and the coordinate system of the manipulator, determining the touch coordinate of the terminal to be tested corresponding to the operation instruction according to the first image and the mapping relation between the coordinate system of the first camera and the coordinate system of the terminal to be tested; and determining coordinate information of the manipulator according to the touch coordinate of the corresponding terminal to be tested in the operation instruction and the mapping relation between the coordinate system of the terminal to be tested and the coordinate system of the manipulator, and further instructing the manipulator to move and execute gesture operation according to the determined coordinate information of the manipulator.

S104: and when the game to be tested responds to the gesture operation, acquiring the running state information of the game to be tested.

Specifically, when the game to be tested responds to gesture operation and runs on the terminal to be tested, the running state information of the game to be tested on the terminal to be tested is obtained.

In a possible implementation manner, the running state information includes first state information, and the first state information includes information about response time of the game to be tested to the gesture operation, whether the terminal to be tested is stuck in the running process of the game to be tested, and the like. Specifically, when the game to be tested responds to the gesture operation, a second image of the display interface of the terminal to be tested is obtained, wherein the second image can be shot by the electronic equipment or a second camera, the second image comprises a plurality of continuous images, and the acquisition frame rate between every two images is 2 times greater than that of the terminal to be tested. The electronic equipment can obtain the change condition of the display interface of the terminal to be tested after the game to be tested responds to the gesture operation according to the second image, and can determine the response time of the game to be tested to the gesture operation and the morton information of the terminal to be tested according to the change condition of the display interface.

In a possible implementation manner, the running state information further includes second state information, and the second state information is heat information generated by the surface of the terminal to be tested in the running process of the game to be tested. Specifically, the electronic device obtains a thermal imaging image of the surface of the terminal to be tested, which is acquired by the thermal imaging device, and determines heat information generated by the surface of the terminal to be tested according to the thermal imaging image.

In a possible implementation manner, the running state information further includes third state information, and the third state information includes performance information of the terminal to be tested and power consumption information of the game to be tested. Specifically, when the game to be tested responds to the gesture operation, the electronic device obtains the performance information of the terminal to be tested and the power consumption information of the game to be tested, which are sent by the terminal to be tested, and can determine the running environment information required by the game to be tested according to the performance information of the terminal to be tested and the power consumption information of the game to be tested.

In a possible implementation mode, the electronic equipment further acquires environment temperature information, the temperature control equipment is instructed to adjust the temperature in the preset space to the preset temperature according to the environment temperature information, and the electronic equipment is arranged in the preset space, so that the running state information of the terminal to be tested can be simulated under different environment temperatures, and the accuracy of game testing is improved.

It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

Based on the same inventive concept, the embodiment of the application also provides the electronic equipment. Fig. 6 is a schematic structural diagram of an electronic device provided in an embodiment of the present application, and as shown in fig. 6, the electronic device provided in this embodiment may include: a processor 210, a memory 220, and a network interface 230. The processor 210, memory 220, and network interface 230 are connected by a communication bus 240.

The Processor 210 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, etc. Optionally, processor 210 may include one or more processing units.

The storage 220 may be an internal storage unit of the electronic device, such as a hard disk or a memory of the electronic device. The memory 220 may also be an external storage device of the electronic device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the electronic device. Further, the memory 220 may also include both an internal storage unit and an external storage device of the electronic device. The memory 220 is used for storing computer programs and other programs and data required by the electronic device. The memory 220 may also be used to temporarily store data that has been output or is to be output.

The network interface 230 may be used for transceiving information, and may include a wired interface and/or a wireless interface, which are generally used for establishing a communication connection between the electronic device and other electronic devices. For example, in the present application, the network interface 230 may receive an image transmitted by a first camera.

Optionally, the electronic device may further comprise a user interface 250, the user interface 250 may comprise a Display (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 250 may further comprise a standard wired interface, a wireless interface. Alternatively, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, or the like. The display, which may also be referred to as a display screen or display unit, is suitable, among other things, for displaying information processed in the electronic device and for displaying a visualized user interface.

Those skilled in the art will appreciate that fig. 6 is merely exemplary of an electronic device and is not intended to limit the electronic device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The electronic device provided by this embodiment may perform the above method embodiments, and the implementation principle and the technical effect are similar, which are not described herein again.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the processes in the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium and can implement the steps of the embodiments of the methods described above when the computer program is executed by a processor. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer readable medium may include at least: any entity or device capable of carrying computer program code to a photographing apparatus/electronic device, a recording medium, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), an electrical carrier signal, a telecommunications signal, and a software distribution medium. Such as a usb-disk, a removable hard disk, a magnetic or optical disk, etc.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus/network device and method may be implemented in other ways. For example, the above-described apparatus/network device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

Finally, it should be noted that: the above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A game testing method is applied to electronic equipment, and is characterized by comprising the following steps:

when a game to be tested runs on a terminal to be tested, acquiring a first image of a display interface of the terminal to be tested;

generating an operation instruction according to the first image and a pre-stored game strategy;

according to the operation instruction, a manipulator which is in communication connection with the electronic equipment is instructed to perform gesture operation on the game to be tested;

and when the game to be tested responds to the gesture operation, acquiring the running state information of the game to be tested.

2. The method of claim 1, wherein the running state information comprises first state information, and correspondingly, when the game to be tested responds to the gesture operation, the obtaining of the running state information of the game to be tested comprises:

3. The method of claim 1, wherein the running state information comprises second state information, and correspondingly, when the game to be tested responds to the gesture operation, the obtaining of the running state information of the game to be tested comprises:

4. The method of claim 1, wherein the running state information comprises third state information, and correspondingly, when the game to be tested responds to the gesture operation, acquiring the running state information of the game to be tested comprises:

5. The method according to any one of claims 1 to 4, wherein before the obtaining the running state information of the game to be tested, the method further comprises:

acquiring environmental temperature information;

6. The method according to any one of claims 1 to 5, wherein the generating of the operation instruction according to the first image and a pre-stored game strategy comprises:

7. The method of claim 1, wherein the obtaining a first image of a display interface of the terminal to be tested comprises:

8. The method of claim 7, wherein the operation instruction comprises a moving distance of the manipulator in a preset direction, and correspondingly, the generating the operation instruction according to the first image and a pre-stored game strategy comprises:

9. The method according to claim 8, wherein before determining the moving distance of the manipulator in a preset direction according to the first image, the pre-stored game strategy and the mapping relationship among the coordinate system of the first camera, the coordinate system of the terminal to be tested and the coordinate system of the manipulator, the method further comprises:

10. An electronic device comprising a processor for executing a computer program stored in a memory to implement the method of any of claims 1-9.

11. A game testing system comprising a terminal to be tested, a manipulator and an electronic device according to claim 10.

12. The game testing system of claim 11, wherein the system further comprises a first camera, a second camera, a thermal imaging camera, and/or a temperature control device communicatively coupled to the electronic device.

13. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 9.