WO2018161421A1 - 终端设备的触摸显示屏幕的性能测试方法和性能测试装置 - Google Patents

终端设备的触摸显示屏幕的性能测试方法和性能测试装置 Download PDF

Info

Publication number
WO2018161421A1
WO2018161421A1 PCT/CN2017/082355 CN2017082355W WO2018161421A1 WO 2018161421 A1 WO2018161421 A1 WO 2018161421A1 CN 2017082355 W CN2017082355 W CN 2017082355W WO 2018161421 A1 WO2018161421 A1 WO 2018161421A1
Authority
WO
WIPO (PCT)
Prior art keywords
sliding
displacement
sub
pictures
area
Prior art date
Application number
PCT/CN2017/082355
Other languages
English (en)
French (fr)
Inventor
陈军
张安军
朱勇
盛璇
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201780015008.7A priority Critical patent/CN108700989A/zh
Publication of WO2018161421A1 publication Critical patent/WO2018161421A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Definitions

  • the embodiments of the present invention relate to the field of terminals, and more specifically, to a performance testing method and a performance testing apparatus for a touch display screen of a terminal device.
  • terminal devices with touch display screens have been widely popularized due to their simple operation and ease of use by users.
  • the operation interface of the terminal device usually changes accordingly to display the response of the terminal device to the sliding operation of the user, for example, the user needs to find the contact in the terminal device.
  • the call record or the information is used, the user usually slides the contact list, the call record list, or the information list displayed on the operation interface of the terminal device, and the terminal device displays the dynamics of different lists on the operation interface according to the user's sliding operation. The screen responds to the user's sliding operation.
  • the embodiment of the present invention introduces a test method for the sliding performance of the touch display screen of the terminal device, so that the user can intuitively It is felt that the sliding performance of the touch display screen of the terminal device is good, which helps to improve the user experience of the terminal device.
  • the embodiment of the invention provides a performance testing method and a performance testing device for a touch display screen of a terminal device, which is beneficial for the user to intuitively feel the sliding performance of the terminal device, and helps to improve the user experience of the terminal device.
  • the first aspect provides a performance testing method for a touch display screen of a terminal device, including: acquiring N pictures collected when a sliding operation is performed on the touch display screen, where N is an integer not less than 2; Operating a position of the corresponding sliding contact in the N pictures to determine a displacement of the sliding contact during execution of the sliding operation; according to the display content in the operation interface displayed on the touch display screen Determining the displacement of the operation interface during the execution of the sliding operation according to the position in the N pictures; according to the displacement of the sliding contact during the execution of the sliding operation, and the sliding of the operation interface The displacement of the touch display screen is determined by the displacement during the execution of the operation.
  • the sliding performance of the touch display screen of the terminal device is determined by acquiring the displacement of the sliding contact and the displacement of the operation interface displayed by the touch display screen of the terminal device, so that the user can intuitively feel the terminal device.
  • the sliding performance is good or bad, which helps to improve the user experience of the terminal device.
  • the determining, according to a position of the display content in the operation interface displayed on the touch display screen in the N pictures, determining that the operation interface is Displacement during execution of the sliding operation includes: dividing an operation interface area in the N pictures into a first area and a second area, where the first area is an area not including the sliding contact, The second area is an area including the sliding contact; the first area is divided into M first sub-areas; according to the display in the M first sub-areas Position of the content in the N pictures, determining displacement of the M first sub-areas during execution of the sliding operation; and shifting according to the M first sub-areas during execution of the sliding operation Determining a displacement of the operation interface during execution of the sliding operation.
  • the sliding contact by dividing the operation display interface area in the acquired picture into the first area not including the sliding contact and the second area including the sliding contact, the sliding contact can be prevented from being displayed in the first area.
  • the occlusion of the content ensures that the accuracy of the displacement of the operator interface during the sliding operation is determined.
  • the determining, according to the displacement of the M first sub-areas during the sliding operation comprises: determining, when the displacements of the L first sub-regions in the M first sub-regions are equal during the execution of the sliding operation
  • the displacement of the first sub-area during execution of the sliding operation is a displacement of the operation interface during execution of the sliding operation, and the L is an integer greater than M/2.
  • the determination of the displacement of the operation interface during the sliding operation by the “voting mechanism” can ensure the accuracy of the displacement determination of the operation interface during the sliding operation.
  • the dividing the operation interface area in the N pictures into the first area and a second area including: determining a direction in which the sliding contact slides on the touch display screen according to a position of the sliding contact in the N pictures; displaying the touch according to the sliding contact
  • the direction of the sliding on the screen determines the direction of dividing the operation interface area in the N pictures; and dividing the operation interface area in the N pictures into the directions according to the direction of dividing the operation interface area in the N pictures.
  • the direction of the sliding contact on the touch display screen can effectively divide the operation interface area into an area including a sliding contact and an area not including the sliding contact, so that the operation interface can be The displacement determination is more accurate.
  • the sliding contact corresponding to the sliding operation is in the N pictures a position, before determining the displacement of the sliding contact during execution of the sliding operation, the method further comprising: identifying an image of the robot in the N pictures; and placing an image of the robot in the N sheets The position in the picture is determined as the position of the sliding contact in the N pictures.
  • the identifying an image of the robot in the N pictures includes: each of the N pictures At least one feature image in the picture is matched with a feature image of a preset robot; and when the matching degree of the feature image in the picture and the feature image of the robot is greater than or equal to a first preset threshold, determining the image The feature image in is an image of the robot.
  • the picture when the sliding operation is performed on the touch screen is collected by a high speed camera.
  • a performance testing apparatus for a touch display screen of a terminal device comprising the method and one or more modules for performing the first aspect.
  • a performance testing apparatus for a touch display screen of a terminal device includes a memory, a processor, the memory is configured to store program code, and the processor is configured to invoke the program code to implement the first aspect and The method of each implementation of the first aspect.
  • a computer readable medium for storing the wearable
  • the program code executed by the first terminal device the program code comprising instructions for performing the methods of the first aspect and the implementations of the first aspect.
  • FIG. 1 is a performance testing method of a touch display screen of a terminal device according to an embodiment of the present invention.
  • FIG. 2 is a time-distance diagram of the sliding performance of a touch display screen of different terminal devices in accordance with an embodiment of the present invention.
  • FIG. 3 is another performance testing method of a touch display screen of a terminal device according to an embodiment of the present invention.
  • FIG. 4 is a performance testing apparatus of a touch display screen of a terminal device according to an embodiment of the present invention.
  • FIG. 5 is another performance testing apparatus of a touch display screen of a terminal device according to an embodiment of the present invention.
  • FIG. 1 is a schematic flowchart of a method 100 for testing performance of a touch display screen of a terminal device according to an embodiment of the present invention. As shown in FIG. 1 , the method 100 includes:
  • Step 110 Obtain N pictures collected when a sliding operation is performed on a touch screen of the terminal device, where N is an integer not less than 2;
  • the sliding performance of the touch display screen of the terminal device is determined by acquiring the displacement of the sliding contact and the displacement of the operation interface displayed by the touch display screen of the terminal device, so that the user can intuitively feel the terminal device.
  • the sliding performance is good or bad, which helps to improve the user experience of the terminal device.
  • the picture when sliding on the touch screen of the terminal device may be collected by a high speed camera, and the high speed camera may synchronously record the entire process of performing the sliding operation on the touch display screen of the terminal device.
  • a picture of the transient state may be collected by a high speed camera, and the high speed camera may synchronously record the entire process of performing the sliding operation on the touch display screen of the terminal device.
  • the collected picture may be saved, and the terminal device needs to be analyzed.
  • the picture of each instantaneous state when the slide display on the touch screen of the terminal device is saved may be analyzed, and the currently collected picture may be analyzed.
  • the embodiment of the present invention is not limited thereto.
  • the sliding contact may be a sliding contact formed by a human finger, or may be another object that can slide on the touch display screen of the terminal device.
  • the sliding contact for example, may be a robot, etc., because the robot can control the parameters required for the sliding of its speed and trajectory by the program, so that the robot can slide the speed and the trajectory on the touch display screen of different terminal devices.
  • a robot is used to perform a sliding operation on the touch display screen of the terminal device to form a sliding contact.
  • the robotic simulation user can perform various different sliding operations on the touch display screen of the terminal device through program settings.
  • the method 100 before determining the displacement of the sliding contact during the execution of the sliding operation according to the position of the sliding contact corresponding to the sliding operation in the N pictures, the method 100 further includes: identifying the acquired The image of the robot of each picture in the N pictures, after identifying the image of the robot of each image, the position of the image of the robot in the N pictures can be determined as the position of the sliding contact corresponding to the sliding operation .
  • the position of the image of the robot in the N pictures is the position of the sliding contact in the N pictures. Therefore, the position of the image of the robot in the N pictures is taken as the position of the sliding contact in the N pictures.
  • the image of the robot that identifies each of the acquired N pictures comprises: at least one feature image of each of the N pictures and a feature image of a preset robot The matching is performed, and when the matching degree of the feature image in the picture and the feature image of the robot is greater than or equal to the first preset threshold, determining that the feature image in the picture is the image of the robot.
  • the N pictures may be reacquired.
  • the displacement of the image of the robot is analyzed to determine the displacement of the operating interface of the terminal device.
  • the specific process of determining the displacement of the operation interface during the execution of the sliding operation may be Dividing the operation interface area in the N pictures into a first area and a second area, the first area is an area not including a sliding contact, and the second area is an area including a sliding contact, and the first area is further Dividing into M first sub-regions, determining displacements of M first sub-regions during execution of the sliding operation according to positions of the display contents in the M first sub-regions; The displacement of the sub-area during the execution of the sliding operation determines the displacement of the operating interface during the execution of the sliding operation.
  • the display content in the operation interface displayed on the touch display screen may be the entire screen displayed in the display interface of the touch display screen of the terminal device, or may refer to a part of the screen displayed in the display interface of the touch display screen. This embodiment of the present invention does not limit this.
  • the embodiment of the present invention divides the operation interface area in the N pictures into the first area and the second area, so that when the position of the display content in the operation interface is determined, the display content in the operation interface is not If the sliding interface is not blocked, if the display content of the selected operation interface overlaps with the sliding contact, the position of the display content of the operation interface or the accuracy of the position of the sliding contact cannot be guaranteed.
  • determining the displacement of the operation interface during the execution of the sliding operation according to the displacement of the M first sub-regions during the execution of the sliding operation may be: in the M first sub-regions When the displacements of the L first sub-regions during the execution of the sliding operation are equal, determining the displacement of the L first sub-regions during the execution of the sliding operation is the displacement of the operation interface during the execution of the sliding operation, and L is greater than An integer of M/2.
  • the above-mentioned determination of the displacement of the operation interface during the execution of the sliding operation utilizes a “voting mechanism”, that is, when the displacement of the first sub-region having more than half is equal, the displacement of the first sub-region greater than half may be determined as the operation.
  • the displacement of the interface during the execution of the sliding operation thereby ensuring the accuracy of the displacement of the operating interface during the execution of the sliding operation.
  • the first area is divided into M first sub-areas for more accurate Determining the displacement of the operation interface during the execution of the sliding operation, because if the display content in the operation interface is part of the screen displayed in the display interface of the touch display screen, only part of the area on the operation interface is analyzed and determined.
  • the displacement of the operation interface during the execution of the sliding operation due to the fluency of the display content of different areas of the operation interface of the touch display screen of the terminal device, some display areas may be stuck, shaken, etc., resulting in The obtained operation interface is inconsistent with the actual displacement during the execution of the sliding operation, resulting in inaccurate test results.
  • the first region is divided into M first sub-regions, and the displacements of the M first sub-regions are respectively performed.
  • the test thereby determining the displacement of the operation interface of the terminal device by the displacement of the M first sub-regions, can avoid the problem of inaccurate displacement of the test due to the phenomenon of touching a portion of the display area on the display screen.
  • determining the displacement of the operation interface during the execution of the sliding operation according to the displacement of the M first sub-regions during the execution of the sliding operation may also be to adopt the M first sub-regions.
  • the maximum value in the displacement during the execution of the sliding operation is determined as the displacement during the execution of the sliding operation of the operation interface, or the average value of the displacements of the M first sub-regions during the execution of the sliding operation is determined as the sliding of the operation interface.
  • the M first sub-regions when determining the displacement of the operation interface during the execution of the sliding operation according to the displacement of the M first sub-regions during the execution of the sliding operation, may be The N first sub-regions are selected, and the displacements of the N first sub-regions are determined, and the displacement of the operation interface during the execution of the sliding operation is determined according to the displacements of the N first sub-regions.
  • L first first sub-regions may be selected in each of the first sub-regions of the M, and positions of the display content in the L first sub-regions on the N pictures may be determined according to the display in the L first sub-regions. Determining the displacement of the L first sub-regions by the position of the content on the N pictures, and determining the F first sub-regions when the displacements of the F first sub-regions are equal in the L first sub-regions The displacement is the displacement of the operation interface during the execution of the sliding operation, and the F is greater than L/2.
  • the maximum value of the displacements of the selected N first sub-regions may also be determined as the displacement of the operation interface during the execution of the sliding operation, or the average of the displacements of the selected N first sub-regions. It is determined that the displacement of the operation interface during the execution of the sliding operation is not limited thereto.
  • the determination of the displacement of the L first sub-regions in the M first sub-regions is to save the calculation amount of the displacement determination process and increase the calculation speed because the first region is divided into M numbers. After a sub-area, all the displacements of the M first sub-areas are calculated, although the displacement of the operation interface of the terminal device can be obtained more accurately, however, when the value of the M is large, and the collected N When the value of the picture is large, the amount of calculation will be correspondingly larger, and the calculation speed is lower.
  • L first sub-areas are selected in the M first sub-areas, as long as the L first The sub-areas can be evenly distributed on the entire operation interface of the terminal device, so that the accuracy of the displacement determination of the operation interface can be ensured, the calculation amount of the displacement calculation can be reduced, and the calculation speed can be improved.
  • the first first sub-region and the M-th of the M first sub-regions may be first The first sub-region is removed, and the L first sub-regions are selected in the remaining first sub-regions.
  • the first first sub-region and the last first sub-region of the M first sub-regions are removed in order to avoid that the first first sub-region or the last first sub-region is located on the touch display screen. In the case of the edge, the displacement determination of the first sub-area is affected.
  • the present invention is only described by taking the first first sub-area and the last first sub-area as an example, but the embodiment of the present invention is not limited.
  • the first two first sub-regions and the last two first sub-regions may also be removed, as long as the display content in the selected L first sub-regions is ensured at the terminal.
  • the operation interface of the device is clearly visible, and it is relatively easy to determine the displacement of the L first sub-regions according to the position of the display content in the L first sub-regions.
  • the L first sub-regions are selected in the remaining first sub-regions for selection.
  • the L first sub-regions may be evenly distributed on the entire operation interface of the touch display screen of the terminal device, thereby avoiding that the terminal is concentrated in a certain partial region of the operation interface due to the selected L first sub-regions, and the terminal is operated when sliding When the operation interface of the device is stuck or shaken, the displacement of the acquired operation interface is inconsistent with its actual displacement.
  • the direction in which the sliding contact slides on the touch display screen may be determined according to the position of the sliding contact in the N pictures, according to the sliding contact Determining the direction of the operation interface area in the N pictures by touching the direction of sliding on the display screen, and dividing the operation interface area in the N pictures into the first area according to the direction of dividing the operation interface area in the N pictures Second area.
  • the sliding direction of the sliding contact on the touch display screen is along the long side direction of the terminal device, and according to the direction, along the long side direction of the terminal device
  • the operation interface area in the N pictures is divided into a first area and a second area.
  • some of the selected first sub-regions of the L first sub-regions are caused by sliding of the operation interface. Blocked by the border of the terminal device, or disappeared.
  • the L first first sub-regions may be re-selected before some first sub-regions are about to disappear, and the re-selected L first sub-regions are determined. To ensure the accuracy of the operator interface displacement determination.
  • the displacements of the L first sub-regions during the execution of the sliding operation are equal, it indicates that the display content of each region of the operation interface of the terminal device is clearer at this time, and no jam occurs.
  • the phenomenon of jitter, etc., at this time the L first sub-areas can be re-selected on the operation interface of the terminal device, and the displacements of the re-selected L first sub-areas are continuously determined.
  • the displacement of the sliding contact during the execution of the sliding operation is compared with the displacement of the operation interface during the execution of the sliding operation, and the difference is obtained.
  • the more sensitive the response of the sliding operation is, that is to say, the better the sliding performance of the touch display screen of the terminal device, the better the corresponding user experience of the terminal device.
  • the sliding performance of the touch display screen of the terminal device may be determined according to the start time of the response of the operation interface of the terminal device to the sliding operation performed by the user, where the user interface is The earlier the start time of the response of the sliding operation, the more sensitive the response of the touch display screen of the terminal device to the sliding operation performed by the user, the better the sliding performance of the touch display screen of the terminal device, and the corresponding user experience of the terminal device The better the degree.
  • the displacement of the sliding contact in each time period of the sliding operation execution process and the displacement of the operation interface in each time period of the sliding operation execution process may be drawn in the same coordinate system,
  • the coordinate system takes time as the horizontal axis and the distance as the vertical axis, and forms a time-distance map about the sliding performance of the touch display screen of the terminal device.
  • the time-distance map can intuitively analyze the sliding of the touch display screen of the terminal device. Performance is good or bad.
  • FIG. 2 is a time-distance of sliding performance of a touch display screen of different terminal devices according to an embodiment of the present invention.
  • the operation speeds of the operation interfaces of different terminal devices are different for the sliding operation performed by the user, and the time when the operation interface of the terminal device changes for the first time on the vertical axis is the time of the terminal device.
  • the start time of the response of the operation interface to the sliding operation performed by the user the smaller the starting time, the better the sliding performance of the touch display screen of the terminal device, as can be seen from FIG.
  • the sliding performance of the touch display screen of the terminal device A The sliding performance of the touch display screen of the terminal device B is better than the sliding performance of the touch display screen of the terminal device C; the difference between the displacement of the operation interface of the terminal device and the displacement of the sliding contact of the user sliding in the same period of time
  • the position of the operation interface of the terminal device A and the position of the terminal device B The position of the sliding contact is substantially the same at the same time point, which is much smaller than the position of the operation interface of the terminal device C and the position of the sliding contact. Therefore, it can be concluded that the sliding performance of the touch display screen of the terminal device A is better than that.
  • the sliding performance of the touch display screen of the terminal device C, the sliding performance of the touch display screen of the terminal device B is better than the sliding performance of the touch display screen of the terminal device C, and the sliding performance of the touch display screen of the terminal device A and the terminal device B Good or bad, it is also possible to further determine the response time of the sliding operation performed by the user in combination with the operation interface of the terminal device.
  • the method for analyzing the sliding performance of the touch display screen of the terminal device by the time-distance map of the touch display screen of the different terminal devices is only an example, and the embodiment of the present invention may further include the sliding touch
  • the sliding performance of the touch display screen of the terminal device is determined by the displacement of the sliding contact during the execution of the sliding operation and the displacement of the operation interface displayed by the touch display screen of the terminal device, which can make the user intuitive Feel the performance of the terminal device, which helps to improve the user experience of the terminal device.
  • FIG. 3 is a schematic flowchart of a performance testing method 300 for a touch display screen of a terminal device according to an embodiment of the present invention. As shown in FIG. 3, the method 300 includes:
  • the analog user performs a sliding operation on the touch display screen of the terminal device.
  • step 305 can be performed by a robot that can be part of a test device corresponding to method 300.
  • the robot can perform sliding operations of different sliding trajectories according to different program settings.
  • step 310 can be performed by a high speed camera, which can also be part of a test device corresponding to method 300.
  • the high speed camera may capture a picture of a sliding operation of the N robots on the touch display screen, and the time interval between each of the N pictures may be the same.
  • step 315 may be performed by an analysis module, which may be part of a test device corresponding to method 300, which is used to acquire N pictures captured by a high speed camera, and The N pictures are analyzed to determine the sliding performance of the touch display screen of the terminal device.
  • an analysis module which may be part of a test device corresponding to method 300, which is used to acquire N pictures captured by a high speed camera, and The N pictures are analyzed to determine the sliding performance of the touch display screen of the terminal device.
  • the collected N pictures may be saved, and the terminal device needs to be analyzed.
  • you touch the display screen you can slide on the touch display screen of the terminal device that was previously saved.
  • the picture of each instantaneous state is analyzed, and the currently collected picture can also be analyzed.
  • the embodiment of the present invention is not limited thereto.
  • step 315 can all be performed by the above analysis module.
  • the specific process of identifying the image of the robot of each of the acquired N pictures may be at least one feature image of each picture of the N pictures and a preset robot The feature image is matched, and when the matching degree of the feature image in the picture and the feature image of the robot is greater than or equal to the first preset threshold, determining that the feature image in the image is the image of the robot.
  • the N pictures may be reacquired.
  • the displacement of the image of the robot is analyzed to determine the displacement of the operating interface of the terminal device.
  • the position of the image of the robot can be used as the position of the sliding contact.
  • the position of the image of the robot may be determined by measuring the position of the image of the picture robot from the edge of the picture, or by the pixel coordinates of the image of the robot in the picture, or may be determined by other methods. It is to be determined that the embodiments of the present invention are not limited thereto.
  • the sliding direction of the sliding contact that is, the direction in which the robot slides on the touch display screen of the terminal device, may be obtained according to different positions of the sliding contact in the N pictures.
  • the operation interface area of the N pictures is divided into the first area and the second area.
  • dividing the first area into M first sub-areas is to more accurately determine the displacement of the operation interface during the execution of the sliding operation, because if the display content in the operation interface is a touch When displaying part of the screen in the screen displayed on the display interface of the screen, only part of the area on the operation interface is analyzed to determine the displacement of the operation interface during the execution of the sliding operation. At this time, due to the operation of the touch display screen of the terminal device The fluency of the display content in different areas of the interface is different. Some display areas may be stuck or shaken, which may cause the displacement of the acquired operation interface during the sliding operation to be inconsistent with the actual displacement, resulting in inaccurate test results.
  • the first area is divided into M first sub-areas, and the displacements of the M first sub-areas are respectively tested, so that the displacement of the operation interface of the terminal device is determined by the displacement of the M first sub-areas, Avoid inaccurate displacement of the test due to the phenomenon of touching the surface of the display on a part of the screen The problem.
  • determining the displacement of the operation interface during the execution of the sliding operation according to the displacement of the M first sub-regions during the execution of the sliding operation may be: in the M first sub-regions There are L in the middle When the displacement of a sub-area during the execution of the sliding operation is equal, determining the displacement of the L first sub-areas during the execution of the sliding operation is the displacement of the operation interface during the execution of the sliding operation, and L is an integer greater than M/2 .
  • determining the displacement of the operation interface during the execution of the sliding operation according to the displacement of the M first sub-regions during the execution of the sliding operation may also be to adopt the M first sub-regions.
  • the maximum value in the displacement during the execution of the sliding operation is determined as the displacement during the execution of the sliding operation of the operation interface, or the average value of the displacements of the M first sub-regions during the execution of the sliding operation is determined as the sliding of the operation interface.
  • the M first sub-regions when determining the displacement of the operation interface during the execution of the sliding operation according to the displacement of the M first sub-regions during the execution of the sliding operation, may be The N first sub-regions are selected, and the displacements of the N first sub-regions are determined, and the displacement of the operation interface during the execution of the sliding operation is determined according to the displacements of the N first sub-regions.
  • L first first sub-regions may be selected in each of the first sub-regions of the M, and positions of the display content in the L first sub-regions on the N pictures may be determined according to the display in the L first sub-regions. Determining the displacement of the L first sub-regions by the position of the content on the N pictures, and determining the F first sub-regions when the displacements of the F first sub-regions are equal in the L first sub-regions The displacement is the displacement of the operation interface during the execution of the sliding operation, and the F is greater than L/2.
  • the maximum value of the displacements of the selected N first sub-regions may also be determined as the displacement of the operation interface during the execution of the sliding operation, or the average of the displacements of the selected N first sub-regions. It is determined that the displacement of the operation interface during the execution of the sliding operation is not limited thereto.
  • the determination of the displacement of the L first sub-regions in the M first sub-regions is to save the calculation amount of the displacement determination process and increase the calculation speed because the first region is divided into M numbers. After a sub-area, all the displacements of the M first sub-areas are calculated, although the displacement of the operation interface of the terminal device can be obtained more accurately, however, when the value of the M is large, and the collected N When the value of the picture is large, the amount of calculation will be correspondingly larger, and the calculation speed is lower.
  • L first sub-areas are selected in the M first sub-areas, as long as the L first The sub-areas can be evenly distributed on the entire operation interface of the terminal device, so that the accuracy of the displacement determination of the operation interface can be ensured, the calculation amount of the displacement calculation can be reduced, and the calculation speed can be improved.
  • the first first sub-region and the M-th of the M first sub-regions may be first The first sub-region is removed, and the L first sub-regions are selected in the remaining first sub-regions.
  • first first sub-region and the last first sub-region of the M first sub-regions are removed in order to avoid that the first first sub-region or the last first sub-region is located on the touch display screen. In the case of the edge, the displacement determination of the first sub-area is affected.
  • the present invention is only described by taking the first first sub-area and the last first sub-area as an example, but the embodiment of the present invention is not limited.
  • the first two first sub-regions and the last two first sub-regions may also be removed, as long as the display content in the selected L first sub-regions is clearly visible on the operation interface of the terminal device, which is relatively easy.
  • the displacement of the L first sub-regions may be determined according to the position of the display content in the L first sub-regions.
  • the L first sub-regions are selected in the remaining first sub-regions for selection.
  • the L first sub-regions may be evenly distributed on the entire operation interface of the touch display screen of the terminal device, thereby avoiding that the terminal is concentrated in a certain partial region of the operation interface due to the selected L first sub-regions, and the terminal is operated when sliding The operation interface of the device When the phenomenon of stagnation, jitter, etc. occurs, the displacement of the acquired operation interface is inconsistent with its actual displacement.
  • the displacement of the sliding contact during the execution of the sliding operation is compared with the displacement of the operation interface during the execution of the sliding operation, and the difference is obtained.
  • the more sensitive the response of the sliding operation is, that is to say, the better the sliding performance of the touch display screen of the terminal device, the better the corresponding user experience of the terminal device.
  • the sliding performance of the touch display screen of the terminal device may be determined according to the start time of the response of the operation interface of the terminal device to the sliding operation performed by the user, where the user interface is The earlier the start time of the response of the sliding operation, the more sensitive the response of the touch display screen of the terminal device to the sliding operation performed by the user, the better the sliding performance of the touch display screen of the terminal device, and the corresponding user experience of the terminal device The better the degree.
  • the analysis module in the test device corresponding to the method 300 may also be used to generate a time-distance map about the sliding performance of the touch display screen of the terminal device, where the coordinate system is on the horizontal axis. The distance is the vertical axis, and the time-distance map can intuitively analyze the sliding performance of the touch display screen of the terminal device.
  • the sliding performance of the touch display screen of the terminal device is determined by the displacement of the sliding contact during the execution of the sliding operation and the displacement of the operation interface displayed by the touch display screen of the terminal device, which can make the user intuitive Feel the performance of the terminal device, which helps to improve the user experience of the terminal device.
  • the embodiment of the method for the touch display screen of the embodiment of the present invention is described in detail below with reference to FIG. 4 and FIG.
  • the performance testing device embodiment corresponds to the method embodiment, and a similar description can refer to the method embodiment.
  • FIG. 4 is a schematic block diagram of a performance testing apparatus 400 for a touch display screen according to an embodiment of the present invention. As shown in FIG. 4, the performance testing apparatus 400 includes:
  • the obtaining module 410 is configured to acquire N pictures collected when the sliding operation is performed on the touch display screen, where N is an integer not less than 2;
  • the determining module 420 is configured to determine the displacement of the sliding contact during the sliding operation according to the position of the sliding contact corresponding to the sliding operation in the N pictures.
  • the determining module 420 is further configured to determine a displacement of the operation interface during the execution of the sliding operation according to the position of the display content in the operation interface displayed on the touch display screen in the N pictures.
  • the determining module 420 is further configured to determine a sliding performance of the touch display screen according to the displacement of the sliding contact during the execution of the sliding operation and the displacement of the operating interface during the execution of the sliding operation.
  • the performance testing device 400 determines the sliding performance of the touch display screen of the terminal device by acquiring the displacement of the sliding contact and the displacement of the operation interface displayed by the touch display screen of the terminal device, so that the user can intuitively feel
  • the sliding performance of the terminal device helps to improve the user experience of the terminal device.
  • the determining module 420 is specifically configured to: use an operation interface area in the N pictures
  • the domain is divided into a first area that is an area that does not include a sliding contact, and a second area that is an area that includes a sliding contact; the first area is divided into M first sub-areas Determining the displacement of the M first sub-areas during the execution of the sliding operation according to the positions of the display contents in the M first sub-areas in the N pictures; according to the M first sub-areas during the execution of the sliding operation Displacement determines the displacement of the operator interface during the execution of the sliding operation.
  • the embodiment of the present invention divides the operation interface area in the N pictures into the first area and the second area, so that when the position of the display content in the operation interface is determined, the display content in the operation interface is not If the sliding interface is not blocked, if the display content of the selected operation interface overlaps with the sliding contact, the position of the display content of the operation interface or the accuracy of the position of the sliding contact cannot be guaranteed.
  • the determining module 420 is specifically configured to determine, when the displacements of the L first sub-regions in the M first sub-regions are equal during the sliding operation, determining the L first sub-regions
  • the displacement during the execution of the sliding operation is the displacement of the operation interface during the execution of the sliding operation, and the L is an integer greater than M/2.
  • the above-mentioned determination of the displacement of the operation interface during the execution of the sliding operation utilizes a “voting mechanism”, that is, when the displacement of the first sub-region having more than half is equal, the displacement of the first sub-region greater than half may be determined as the operation.
  • the displacement of the interface during the execution of the sliding operation thereby ensuring the accuracy of the displacement of the operating interface during the execution of the sliding operation.
  • dividing the first area into M first sub-areas is to more accurately determine the displacement of the operation interface during the execution of the sliding operation, because if the display content in the operation interface is a touch When displaying part of the screen in the screen displayed on the display interface of the screen, only part of the area on the operation interface is analyzed to determine the displacement of the operation interface during the execution of the sliding operation. At this time, due to the operation of the touch display screen of the terminal device The fluency of the display content in different areas of the interface is different. Some display areas may be stuck or shaken, which may cause the displacement of the acquired operation interface during the sliding operation to be inconsistent with the actual displacement, resulting in inaccurate test results.
  • the first area is divided into M first sub-areas, and the displacements of the M first sub-areas are respectively tested, so that the displacement of the operation interface of the terminal device is determined by the displacement of the M first sub-areas, Avoid inaccurate displacement of the test due to the phenomenon of touching the surface of the display on a part of the screen The problem.
  • the determining module 420 is further configured to determine a maximum value of the displacements of the M first sub-regions during the execution of the sliding operation as a displacement during the sliding operation of the operation interface, Alternatively, the average value of the displacements of the M first sub-areas during the execution of the sliding operation is determined as the displacement during the execution of the sliding operation of the operation interface, or other possible cases, and the embodiment of the present invention is not limited thereto.
  • the determining module 420 is further configured to select N first sub-regions among the M first sub-regions, and then determine displacements of the N first sub-regions, according to the N The displacement of the first sub-region determines the displacement of the operator interface during the execution of the sliding operation.
  • the determining module 420 may further select L first sub-regions among the M first sub-regions, and determine a position of the display content in the L first sub-regions on the N pictures, according to the L first Determining the displacement of the L first sub-regions by the position of the display content in the sub-region on the N pictures, and determining the F when the displacements of the F first sub-regions are equal in the L first sub-regions
  • the displacement of the first sub-region is the displacement of the operation interface during the execution of the sliding operation, and the F is greater than L/2.
  • the determining module 420 may also determine a maximum value of the displacements of the selected N first sub-regions as a displacement of the operation interface during the execution of the sliding operation, or a displacement of the selected N first sub-regions.
  • the average value is determined as the displacement of the operation interface during the execution of the sliding operation, and the embodiment of the present invention is not limited thereto.
  • the determination of the displacement of the L first sub-regions in the M first sub-regions is to save the calculation amount of the displacement determination process and increase the calculation speed because the first region is divided into M numbers. After a sub-area, all the displacements of the M first sub-areas are calculated, although the displacement of the operation interface of the terminal device can be obtained more accurately, however, when the value of the M is large, and the collected N When the value of the picture is large, the amount of calculation will be correspondingly larger, and the calculation speed is lower.
  • L first sub-areas are selected in the M first sub-areas, as long as the L first The sub-areas can be evenly distributed on the entire operation interface of the terminal device, so that the accuracy of the displacement determination of the operation interface can be ensured, the calculation amount of the displacement calculation can be reduced, and the calculation speed can be improved.
  • the first first sub-region of the M first sub-regions may be first And removing the M first first sub-regions, and then selecting the L first sub-regions in the remaining first sub-regions.
  • first first sub-region and the last first sub-region of the M first sub-regions are removed in order to avoid that the first first sub-region or the last first sub-region is located on the touch display screen. In the case of the edge, the displacement determination of the first sub-area is affected.
  • the present invention is only described by taking the first first sub-area and the last first sub-area as an example, but the embodiment of the present invention is not limited.
  • the first two first sub-regions and the last two first sub-regions may also be removed, as long as the display content in the selected L first sub-regions is clearly visible on the operation interface of the terminal device, which is relatively easy.
  • the displacement of the L first sub-regions may be determined according to the position of the display content in the L first sub-regions.
  • the L first sub-regions are selected in the remaining first sub-regions for selection.
  • the L first sub-regions may be evenly distributed on the entire operation interface of the touch display screen of the terminal device, thereby avoiding that the terminal is concentrated in a certain partial region of the operation interface due to the selected L first sub-regions, and the terminal is operated when sliding When the operation interface of the device is stuck or shaken, the displacement of the acquired operation interface is inconsistent with its actual displacement.
  • the determining module 420 is specifically configured to determine a direction in which the sliding contact slides on the touch display screen according to the position of the sliding contact in the N pictures; according to the sliding contact on the touch display screen The direction of the sliding determines the direction of dividing the operation interface area in the N pictures; and divides the operation interface area in the N pictures into the first area and the second area according to the direction of dividing the operation interface area in the N pictures.
  • the performance testing apparatus 400 further includes:
  • the identification module 430 is configured to identify an image of the robot in the N pictures.
  • the determining module 420 is further configured to determine a position of the image of the robot in the N pictures as a position of the sliding contact in the N pictures.
  • the identification module 430 is specifically configured to match at least one feature image in each picture of the N pictures with a feature image of a preset robot; the feature image and the robot in the picture When the matching degree of the feature image is greater than or equal to the first preset threshold, it is determined that the feature image in the picture is an image of the robot.
  • the acquisition module 410 can be a high speed camera that can be used to capture a picture when a sliding operation is performed on the touch display screen.
  • FIG. 5 is a schematic structural diagram of a wearable terminal device 500 according to an embodiment of the present invention.
  • the terminal device 500 includes a memory 510 and a processor 520, and the memory 510 and the processor 520 pass through Internal connection paths communicate with one another to communicate control and/or data signals.
  • the memory 510 is configured to store program code
  • the processor 520 is configured to invoke the program code to implement the methods in the various embodiments of the present invention.
  • the processor 520 may be a central processing unit (CPU), a network processor (NP), or a combination of a CPU and an NP.
  • the processor may further include a hardware chip.
  • the hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof.
  • the embodiment of the present invention provides a computer readable medium for storing computer program code, the computer program comprising instructions for performing the performance test method of the touch display screen of the terminal device of the embodiment of the present invention shown in FIG. 1 to FIG. .
  • the readable medium may be a read-only memory (ROM) or a random access memory (RAM), which is not limited in the embodiment of the present invention.
  • the disclosed systems, devices, and methods may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product.
  • the technical solution of the present invention which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including
  • the instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种终端设备的触摸显示屏幕的性能测试方法和性能测试装置，该方法包括：获取在触摸显示屏幕上进行滑动操作时采集的N张图片，N为不小于2的整数（110）；根据滑动操作对应的滑动触点在N张图片中的位置，确定滑动触点在滑动操作中的位移（120）；根据触摸显示屏幕上的操作界面中的显示内容在N张图片中的位置，确定操作界面在滑动操作中的位移（130）；根据滑动触点在滑动操作中的位移，以及操作界面在滑动操作中的位移，确定触摸显示屏幕的滑动性能（140）。通过确定触摸显示屏幕上滑动触点的位移以及操作界面的位移，可以确定操作界面的滑动性能，可以使用户直观的感受到终端设备性能的好坏，有助于提高用户对终端设备的体验度。

Description

终端设备的触摸显示屏幕的性能测试方法和性能测试装置 技术领域
本发明实施例涉及终端领域，并且更加具体的，涉及一种终端设备的触摸显示屏幕的性能测试方法和性能测试装置。
背景技术
随着终端设备的迅速发展，具有触摸显示屏幕的终端设备由于其操作简单，易于用户使用，得到了广泛的普及。
用户在终端设备的触摸显示屏幕上进行滑动操作时，终端设备的操作界面通常会发生相应的变化，以显示终端设备对用户的滑动操作的响应，例如，在用户需要在终端设备中查找联系人、通话记录或者信息时，用户通常会对终端设备的操作界面上显示的联系人列表、通话记录列表或信息列表等进行滑动操作，终端设备根据用户的滑动操作在操作界面上显示不同列表的动态画面，以响应用户的滑动操作。
在用户执行滑动操作的过程中，大多数用户看重于终端设备的触摸显示屏幕的操作界面对用户执行的滑动操作的响应速度，即该终端设备的触摸显示屏幕的滑动性能，在终端设备的触摸显示屏幕的操作界面对用户进行的滑动操作的响应较快时，用户的体验也会较好，因此，本发明实施例介绍了终端设备的触摸显示屏幕的滑动性能的测试方法，使用户可以直观的感受到终端设备的触摸显示屏幕的滑动性能的好坏，有助于提高用户对终端设备的体验度。
发明内容
本发明实施例提供一种终端设备的触摸显示屏幕的性能测试方法和性能测试装置，有利于用户直观地感受终端设备的滑动性能的好坏，有助于提高用户对终端设备的体验度。
第一方面，提供一种终端设备的触摸显示屏幕的性能测试方法，包括：获取在所述触摸显示屏幕上进行滑动操作时采集的N张图片，N为不小于2的整数；根据所述滑动操作对应的滑动触点在所述N张图片中的位置，确定所述滑动触点在所述滑动操作执行过程中的位移；根据所述触摸显示屏幕上显示的操作界面中的显示内容在所述N张图片中的位置，确定所述操作界面在所述滑动操作执行过程中的位移；根据所述滑动触点在所述滑动操作执行过程中的位移，以及所述操作界面在所述滑动操作执行过程中的位移，确定所述触摸显示屏幕的滑动性能。
在本发明实施例中，通过获取滑动触点的位移和终端设备的触摸显示屏幕显示的操作界面的位移，确定终端设备的触摸显示屏幕的滑动性能，从而使用户可以直观地感受到终端设备的滑动性能的好坏，有助于提高用户对终端设备的体验度。
结合第一方面，在第一方面的第一种实现方式中，所述根据所述触摸显示屏幕上显示的操作界面中的显示内容在所述N张图片中的位置，确定所述操作界面在所述滑动操作执行过程中的位移，包括：将所述N张图片中的操作界面区域划分为第一区域和第二区域，所述第一区域为不包括所述滑动触点的区域，所述第二区域为包括所述滑动触点的区域；将所述第一区域划分为M个第一子区域；根据所述M个第一子区域中的显示 内容在所述N张图片中的位置，确定所述M个第一子区域在所述滑动操作执行过程中的位移；根据所述M个第一子区域在所述滑动操作执行过程中的位移，确定所述操作界面在所述滑动操作执行过程中的位移。
在本发明实施例中，通过将获取的图片中的操作显示界面区域划分为不包括滑动触点的第一区域和包括滑动触点的第二区域，可以避免滑动触点对第一区域中显示内容的遮挡，从而保证确定操作界面在滑动操作过程中发生的位移的准确性。
结合第一方面，第一方面的第一种实现方式，在第一方面的第二种实现方式中，所述根据所述M个第一子区域在所述滑动操作过程中的位移，确定所述操作界面在所述滑动操作过程中的位移，包括：在所述M个第一子区域中有L个第一子区域在所述滑动操作执行过程中的位移相等时，确定所述L个第一子区域在所述滑动操作执行过程中的位移为所述操作界面在所述滑动操作执行过程中的位移，所述L为大于M/2的整数。
在本发明实施例中，通过“投票机制”对操作界面在滑动操作过程中的位移的确定，可以保证操作界面在滑动操作过程中发生的位移确定的准确性。
结合第一方面，第一方面的第一种和第二种实现方式，在第一方面的第三种实现方式中，所述将所述N张图片中的操作界面区域划分为第一区域和第二区域，包括：根据所述滑动触点在所述N张图片中的位置，确定所述滑动触点在所述触摸显示屏幕上滑动的方向；根据所述滑动触点在所述触摸显示屏幕上滑动的方向，确定划分所述N张图片中的操作界面区域的方向；根据划分所述N张图片中的操作界面区域的方向，将所述N张图片中的操作界面区域划分为所述第一区域和所述第二区域。
在本发明实施例中，通过滑动触点在触摸显示屏幕上滑动的方向，可以有效的将操作界面区域划分为包括滑动触点的区域和不包括滑动触点的区域，从而可以使操作界面的位移确定更准确。
结合第一方面，第一方面的第一种至第三种实现方式，在第一方面的第四种实现方式中，所述根据所述滑动操作对应的滑动触点在所述N张图片中的位置，确定所述滑动触点在所述滑动操作执行过程中的位移之前，所述方法还包括：识别所述N张图片中的机械手的图像；将所述机械手的图像在所述N张图片中的位置确定为所述滑动触点在所述N张图片中的位置。
结合第一方面的第四种实现方式中，在第一发面的第五种实现方式中，所述识别所述N张图片中的机械手的图像，包括：将所述N张图片的每张图片中的至少一个特征图像与预先设置的机械手的特征图像进行匹配；在所述图片中的特征图像与所述机械手的特征图像的匹配度大于或等于第一预设阈值时，确定所述图片中的特征图像为所述机械手的图像。
结合第一方面，第一方面的第一种至第五种实现方式，在第一方面的第六种实现方式中，在所述触摸屏幕上进行滑动操作时的图片由高速相机采集。
第二方面，提供一种终端设备的触摸显示屏幕的性能测试装置，包括用于执行第一方面中的方法和一个或多个模块。
第三方面，提供一种终端设备的触摸显示屏幕的性能测试装置，包括存储器、处理器，所述存储器用于存储程序代码，所述处理器用于调用所述程序代码以实现上述第一方面及所述第一方面的各实现方式中的方法。
第四方面，提供一种计算机可读介质，所述计算机可读介质用于存储可被所述可穿 戴的第一终端设备执行的程序代码，所述程序代码包括用于执行上述第一方面及所述第一方面的各实现方式中的方法的指令。
附图说明
图1是根据本发明实施例的终端设备的触摸显示屏幕的性能测试方法。
图2是根据本发明实施例的不同终端设备的触摸显示屏幕的滑动性能的时间-距离图。
图3是根据本发明实施例的终端设备的触摸显示屏幕的另一性能测试方法。
图4是根据本发明实施例的终端设备的触摸显示屏幕的性能测试装置。
图5是根据本发明实施例的终端设备的触摸显示屏幕另一性能测试装置。
具体实施方式
下面将结合附图，对本发明实施例中的技术方案进行描述。
图1所示为本发明实施例的终端设备的触摸显示屏幕的性能测试方法100的示意性流程图，如图1所示，该方法100包括：
110，获取在终端设备的触摸屏幕上进行滑动操作时采集的N张图片，N为不小于2的整数；
120，根据滑动操作对应的滑动触点在N张图片中的位置，确定滑动触点在滑动操作执行过程中的位移；
130，根据触摸显示屏幕上显示的操作界面中的显示内容在N张图片中的位置，确定操作界面在滑动操作执行过程中的位移；
140，根据滑动触点在滑动操作执行过程中的位移，以及操作界面在滑动操作执行过程中的位移，确定触摸显示屏幕的滑动性能。
在本发明实施例中，通过获取滑动触点的位移和终端设备的触摸显示屏幕显示的操作界面的位移，确定终端设备的触摸显示屏幕的滑动性能，从而使用户可以直观地感受到终端设备的滑动性能的好坏，有助于提高用户对终端设备的体验度。
可选的，在一些实施例中，在终端设备的触摸屏幕上进行滑动时的图片可以通过高速相机采集，该高速相机可以同步记录在终端设备的触摸显示屏幕上进行滑动操作的整个过程的每个瞬时状态的图片。
可选的，在一些实施例中，在通过高速相机采集到在终端设备的触摸显示屏幕上进行滑动时各个瞬时状态的一组图片之后，可以将该采集的图片进行保存，在需要分析终端设备的触摸显示屏幕时，可以对之前保存的在终端设备的触摸显示屏幕上进行滑动时各个瞬时状态的图片进行分析，也可以对当前采集的图片进行分析，本发明实施例不限定于此。
可选的，在一些实施例中，在本发明实施例中，该滑动触点可以是人体手指形成的滑动触点，也可以是其他的能在终端设备的触摸显示屏幕上进行滑动的物体形成的滑动触点，例如，可以是机械手等，由于机械手可以通过程序对其速度和轨迹等滑动所需要的参数进行控制，使机械手在不同终端设备的触摸显示屏幕上进行滑动的速度和轨迹等参数基本相同，所以在对终端设备的触摸显示屏幕的滑动性能进行测试时可以不用考虑不同的滑动对触摸显示屏幕的滑动性能的影响，因此，为了确保测试结果的准确性，本 发明实施例中使用机械手对终端设备的触摸显示屏幕进行滑动操作以形成滑动触点。
可选的，在一些实施例中，可以通过程序设置使机械手模拟用户对终端设备的触摸显示屏幕执行各种不同的滑动操作。
可选的，在一些实施例中，在根据滑动操作对应的滑动触点在N张图片中的位置，确定滑动触点在滑动操作执行过程中的位移之前，该方法100还包括：识别获取的N张图片中的每张图片的机械手的图像，在识别出每张图像的机械手的图像之后，可以将该机械手的图像在N张图片中的位置，确定为滑动操作对应的滑动触点的位置。
应理解，由于本发明实施例以机械手作为对终端设备的触摸显示屏幕进行滑动操作的执行体，所以该机械手的图像在N张图片中的位置也就是滑动触点在N张图片中的位置，所以将机械手的图像在N张图片中的位置作为滑动触点在N张图片中的位置。
可选的，在一些实施例中，识别获取的N张图片中的每张图片的机械手的图像包括：将该N张图片的每张图片中的至少一个特征图像与预先设置的机械手的特征图像进行匹配，在图片中的特征图像与机械手的特征图像的匹配度大于或等于第一预设阈值时，确定图片中的特征图像为所述机械手的图像。
可选的，在一些实施例中，在获取的N张图片中有至少一张图片未识别出机械手的图像时，为了确保终端设备的操作界面的位移确定的准确性，可以重新获取N张图片并对其中的机械手的图像的位移进行分析，以确定终端设备的操作界面的位移。
可选的，在一些实施例中，该根据触摸显示屏幕上显示的操作界面中的显示内容在N张图片中的位置，确定操作界面在滑动操作执行过程中的位移的方法的具体过程可以为：将该N张图片中的操作界面区域划分为第一区域和第二区域，第一区域为不包括滑动触点的区域，第二区域为包括滑动触点的区域，再将该第一区域划分为M个第一子区域，根据该M个第一子区域中的显示内容在N张图片中的位置，确定M个第一子区域在滑动操作执行过程中的位移；根据M个第一子区域在滑动操作执行过程中的位移，确定操作界面在所述滑动操作执行过程中的位移。
应理解，该触摸显示屏幕上显示的操作界面中的显示内容可以为终端设备的触摸显示屏幕的显示界面中显示的整个画面，也可以指触摸显示屏幕的显示界面中显示的画面中的部分画面，本发明实施例对此不做限定。
应理解，本发明实施例将N张图片中的操作界面区域划分为第一区域和第二区域，是为了在确定操作界面中的显示内容的位置时，该操作界面中的显示内容不会被滑动触点遮挡，如果不对操作界面区域进行划分，若选择的操作界面的显示内容与滑动触点重叠时，此时，无法保证操作界面的显示内容的位置或滑动触点的位置获取的准确性。
可选的，在一些实施例中，根据M个第一子区域在滑动操作执行过程中的位移，确定操作界面在所述滑动操作执行过程中的位移，可以为：在M个第一子区域中有L个第一子区域在滑动操作执行过程中的位移相等时，确定该L个第一子区域在滑动操作执行过程中的位移为操作界面在滑动操作执行过程中的位移，L为大于M/2的整数。
应理解，上述确定操作界面在滑动操作执行过程中的位移利用“投票机制”，即有大于半数的第一子区域的位移相等时，可以将该大于半数的第一子区域的位移确定为操作界面在滑动操作执行过程中的位移，从而可以确保操作界面在滑动操作执行过程中的位移的准确性。
应理解，在本发明实施例中，将第一区域划分为M个第一子区域是为了更加准确的 确定操作界面在滑动操作执行过程中的位移，因为，如果操作界面中的显示内容为触摸显示屏幕的显示界面中显示的画面中的部分画面时，只对操作界面上的部分区域进行分析，确定操作界面在滑动操作执行过程中的位移，此时，由于终端设备的触摸显示屏幕的操作界面的不同区域的显示内容的流畅度不同，有的显示区域可能出现卡顿、抖动等现象，从而导致获取的操作界面在滑动操作执行过程中的位移与实际的位移不一致，导致测试结果不准确，所以，将第一区域划分为M个第一子区域，分别对M个第一子区域的位移进行测试，从而通过该M个第一子区域的位移确定终端设备的操作界面的位移，可以避免由于触摸显示屏幕上部分区域的卡顿等现象出现的测试的位移不准确的问题。
可选的，在一些实施例中，根据M个第一子区域在滑动操作执行过程中的位移，确定操作界面在所述滑动操作执行过程中的位移，也可以为将M个第一子区域在滑动操作执行过程中的位移中的最大值确定为操作界面的滑动操作执行过程中的位移，或者将M个第一子区域在滑动操作执行过程中的位移的平均值确定为操作界面的滑动操作执行过程中的位移，或者其他可能的情况，本发明实施例并不限定于此。
可选的，在一些实施例中，在根据M个第一子区域在滑动操作执行过程中的位移，确定操作界面在所述滑动操作执行过程中的位移时，可以在M个第一子区域中选取N个第一子区域，再确定该N个第一子区域的位移，根据该N个第一子区域的位移确定操作界面在滑动操作执行过程中的位移。
例如，可以在M各第一子区域中选取L个第一子区域，确定该L个第一子区域中的显示内容在N张图片上的位置，根据该L个第一子区域中的显示内容在N张图片上的位置，确定该L个第一子区域的位移，在该L个第一子区域中有F个第一子区域的位移相等时，确定该F个第一子区域的位移为操作界面在滑动操作执行过程中的位移，该F大于L/2。
同样的，也可以将该选取的N个第一子区域的位移中的最大值确定为操作界面在滑动操作执行过程中的位移，或者将选取的N个第一子区域的位移中的平均值确定为操作界面在滑动操作执行过程中的位移，本发明实施例并不限定于此。
应理解，在M个第一子区域中选取L个第一子区域进行位移的确定，是为了节省该位移确定过程的计算量，提高计算速度，因为，在将第一区域划分为M个第一子区域之后，在对该M个第一子区域的位移全部进行计算，虽然可以更精确地得到该终端设备的操作界面的位移，然而，在该M的数值较大时，且采集的N张图片的数值较大时，带来的计算量也会相应的较大，计算速度较低，因此，在该M个第一子区域中选取L个第一子区域，只要该L个第一子区域可以均匀的分布在终端设备的整个操作界面上，这样既可以保证操作界面的位移确定的准确性，也可以减小位移计算的计算量，提高计算速度。
可选的，在一些实施例中，在M个第一子区域中选取L个第一子区域时，可以先将该M个第一子区域中的第一个第一子区域和第M个第一子区域去除，再在剩余的第一子区域中间隔的选取L个第一子区域。
应理解，将M个第一子区域中的第一个第一子区域和最后一个第一子区域去除，是为了避免在第一个第一子区域或最后一个第一子区域位于触摸显示屏幕的边缘时，会对第一子区域的位移确定产生影响，然而，本发明仅以去除第一个第一子区域和最后一个第一子区域为例进行说明，但本发明实施例并不限定于此，例如，也可以去除前两个第一子区域和最后两个第一子区域，只要确保选取的L个第一子区域中的显示内容在终端 设备的操作界面上清晰可见，比较容易地根据该L个第一子区域中的显示内容的位置，确定该L个第一子区域的位移即可。
应理解，在M个第一子区域中去除第一个第一子区域和最后一个第一子区域之后，在剩余的第一子区域中间隔的选取L个第一子区域是为了使选取的L个第一子区域可以均匀的分布在终端设备的触摸显示屏幕的整个操作界面上，从而避免了由于选取的L个第一子区域集中在操作界面的某一部分区域，在进行操作滑动时终端设备的操作界面出现卡顿、抖动等现象时，造成获取的操作界面的位移与其实际的位移不一致的现象。
可选的，在一些实施例中，在对操作界面区域进行划分时，可以根据滑动触点在N张图片中的位置，确定滑动触点在触摸显示屏幕上滑动的方向，根据该滑动触点在触摸显示屏幕上滑动的方向，确定划分N张图片中的操作界面区域的方向，根据划分N张图片中的操作界面区域的方向，将N张图片中的操作界面区域划分为第一区域和第二区域。
例如，在根据滑动触点在N张图片中的位置，确定出滑动触点在触摸显示屏幕上的滑动方向是沿终端设备的长边方向时，可以根据该方向，沿终端设备的长边方向将N张图片中的操作界面区域划分为第一区域和第二区域。
可选的，在一些实施例中，如果在对终端设备的触摸显示屏幕的操作界面进行滑动操作时，选取的L个第一子区域中的某些第一子区域由于操作界面的滑动，导致被终端设备的边框遮挡，或者消失不见，此时，可以在出现某些第一子区域即将消失的情况之前，重新选取L个第一子区域，确定该重新选取的L个第一子区域位移，以确保操作界面位移确定的准确性。
可选的，在一些实施例中，在L个第一子区域在滑动操作执行过程中的位移相等时，说明此时终端设备的操作界面的各个区域的显示内容都较为清晰，没有出现卡顿、抖动等现象，此时可以在终端设备的操作界面上重新选取L个第一子区域，对该重新选取的L个第一子区域的位移继续进行确定。
可选的，在一些实施例中，在根据滑动触点在滑动操作执行过程中的位移，以及操作界面在滑动操作执行过程中的位移，确定终端设备的触摸显示屏幕的滑动性能时，可以将滑动触点在滑动操作执行过程中的位移与操作界面在滑动操作执行过程中的位移进行比较，求其差值，上述两个位移的差值越小，说明终端设备的触摸显示屏幕对用户执行的滑动操作的响应越灵敏，也就是说终端设备的触摸显示屏幕的滑动性能越好，相应的用户对终端设备的体验度也就越好。
可选的，在一些实施例中，还可以根据终端设备的操作界面对用户执行的滑动操作的响应的开始时间来确定终端设备的触摸显示屏幕的滑动性能的好坏，在操作界面对用户的滑动操作的响应的开始时间越早，说明该终端设备的触摸显示屏幕对用户执行的滑动操作的响应越灵敏，终端设备的触摸显示屏幕的滑动性能越好，相应的用户对该终端设备的体验度越好。
可选的，在一些实施例中，可以将滑动触点在滑动操作执行过程的各个时间段内的位移以及操作界面在滑动操作执行过程的各个时间段内的位移绘制在同一个坐标系中，该坐标系以时间为横轴，距离为纵轴，形成关于终端设备的触摸显示屏幕的滑动性能的时间-距离图，通过该时间-距离图可以直观的分析出终端设备的触摸显示屏幕的滑动性能的好坏。
图2所示为本发明实施例的不同终端设备的触摸显示屏幕的滑动性能的时间-距离 图，如图2所示，不同的终端设备的操作界面对用户执行的滑动操作的响应速度各不相同，终端设备的操作界面在纵轴上第一次有位移变化的时间为该终端设备的操作界面对用户执行的滑动操作的响应的开始时间，该开始时间越小，说明终端设备的触摸显示屏幕的滑动性能越好，由图2可以看出，终端设备A的触摸显示屏幕的滑动性能好于终端设备B的触摸显示屏幕的滑动性能好于终端设备C的触摸显示屏幕的滑动性能；在同一段时间段内，终端设备的操作界面的位移与用户滑动的滑动触点的位移的差值越小，说明该终端设备的触摸显示屏幕的滑动性能越好，也就是说，在同一个时间点，不同终端设备的操作界面与滑动触点的位置的相对距离越小，说明终端设备的触摸显示屏幕的滑动性能越好，由图2可以看出，终端设备A的操作界面的位置与终端设备B的位置在同一个时间点距离滑动触点的位置基本上相同，远小于终端设备C的操作界面的位置距离滑动触点的位置，因此，可以得出终端设备A的触摸显示屏幕的滑动性能好于终端设备C的触摸显示屏幕的滑动性能，终端设备B的触摸显示屏幕的滑动性能好于终端设备C的触摸显示屏幕的滑动性能，至于终端设备A与终端设备B的触摸显示屏幕的滑动性能的好坏，还可以进一步结合终端设备的操作界面对用户执行的滑动操作的响应时间决定。
应理解，上述通过不同终端设备的触摸显示屏幕的滑动性能的时间-距离图，分析终端设备的触摸显示屏幕的滑动性能的方法仅为一种举例说明，本发明实施例还可以包括对滑动触点在滑动操作执行过程中的位移以及操作界面在滑动操作执行过程中的位移进行其他形式的分析，以确定终端设备的触摸显示屏幕的滑动性能的方法。
在本发明实施例中，通过滑动触点在滑动操作执行过程中的位移，以及终端设备的触摸显示屏幕显示的操作界面的位移，确定终端设备的触摸显示屏幕的滑动性能，可以使用户直观的感受到终端设备的性能的好坏，有助于提高用户对终端设备的体验度。
图3所述为本发明实施例的终端设备的触摸显示屏幕的性能测试方法300的示意性流程图，如图3所示，该方法300包括：
305，模拟用户在终端设备的触摸显示屏幕上执行滑动操作。
可选的，在一些实施例中，步骤305可以由机械手执行，该机械手可以作为与方法300相对应的测试装置中的一部分。
可选的，在一些实施例中，该机械手可以根据不同的程序设置，执行不同的滑动轨迹的滑动操作。
310，采集机械手在触摸显示屏幕上进行滑动操作过程中每个瞬时状态的图片。
可选的，在一些实施例中，步骤310可以由高速相机执行，该高速相机也可以作为与方法300相对应的测试装置中的一部分。
可选的，在一些实施例中，高速相机可以采集N张机械手在触摸显示屏幕上进行滑动操作的图片，该N张图片中的每张图片之间的时间间隔可以相同。
315，获取高速相机采集的N张图片。
可选的，在一些实施例中，步骤315可以由分析模块执行，该分析模块可以为与方法300相对应的测试装置中的一部分，该分析模块用于获取高速相机采集的N张图片，并对该N张图片进行分析，以确定终端设备的触摸显示屏幕的滑动性能。
可选的，在一些实施例中，在通过高速相机采集到在终端设备的触摸显示屏幕上进行滑动时各个瞬时状态的N图片之后，可以将该采集的N图片进行保存，在需要分析终端设备的触摸显示屏幕时，可以对之前保存的在终端设备的触摸显示屏幕上进行滑动时 各个瞬时状态的图片进行分析，也可以对当前采集的图片进行分析，本发明实施例不限定于此。
应理解，在步骤315以后的步骤均可以由上述分析模块执行。
320，识别N张图片中的机械手的图像。
可选的，在一些实施例中，识别获取的N张图片中的每张图片的机械手的图像的具体过程可以为将该N张图片的每张图片中的至少一个特征图像与预先设置的机械手的特征图像进行匹配，在图片中的特征图像与机械手的特征图像的匹配度大于或等于第一预设阈值时，确定图片中的特征图像为所述机械手的图像。
325，在N张图片中有未识别机械手图像的图片时，重新获取高速相机采集的图片。
可选的，在一些实施例中，在获取的N张图片中有至少一张图片未识别出机械手的图像时，为了确保终端设备的操作界面的位移确定的准确性，可以重新获取N张图片并对其中的机械手的图像的位移进行分析，以确定终端设备的操作界面的位移。
330，将N张图片中的机械手的图像的位置确定为滑动触点的位置。
可选的，在一些实施例中，由于将机械手作为在终端设备的触摸显示屏幕上进行滑动操作的执行体，所以可以将机械手的图像的位置作为滑动触点的位置。
可选的，在一些实施例中，机械手的图像的位置可以通过测量图片机械手的图像距离该图片的边缘的位置确定，或者通过机械手的图像在图片中的像素坐标确定，或者可以通过其他的方法确定，本发明实施例并不限定于此。
335，根据滑动触点在N张图片中的位置，确定滑动触点在滑动操作执行过程中的位移。
340，根据滑动触点在N张图片中的位置，确定滑动触点在触摸显示屏幕上滑动的方向。
可选的，在一些实施例中，可以根据滑动触点在N张图片中的不同位置，可以得到该滑动触点的滑动方向，即机械手在终端设备的触摸显示屏幕上滑动的方向。
345，根据滑动触点在触摸显示屏幕上滑动的方向，将N张图片的操作界面区域划分为第一区域和第二区域。
350，将第一区域划分为M个第一子区域。
应理解，在本发明实施例中，将第一区域划分为M个第一子区域是为了更加准确的确定操作界面在滑动操作执行过程中的位移，因为，如果操作界面中的显示内容为触摸显示屏幕的显示界面中显示的画面中的部分画面时，只对操作界面上的部分区域进行分析，确定操作界面在滑动操作执行过程中的位移，此时，由于终端设备的触摸显示屏幕的操作界面的不同区域的显示内容的流畅度不同，有的显示区域可能出现卡顿、抖动等现象，从而导致获取的操作界面在滑动操作执行过程中的位移与实际的位移不一致，导致测试结果不准确，所以，将第一区域划分为M个第一子区域，分别对M个第一子区域的位移进行测试，从而通过该M个第一子区域的位移确定终端设备的操作界面的位移，可以避免由于触摸显示屏幕上部分区域的卡顿等现象出现的测试的位移不准确的问题。
355，根据M个第一子区域中的显示内容的位置，确定M个第一子区域的位移。
360，根据M个第一子区域的位移，确定操作界面在滑动操作执行过程中的位移。
可选的，在一些实施例中，根据M个第一子区域在滑动操作执行过程中的位移，确定操作界面在所述滑动操作执行过程中的位移，可以为：在M个第一子区域中有L个第 一子区域在滑动操作执行过程中的位移相等时，确定该L个第一子区域在滑动操作执行过程中的位移为操作界面在滑动操作执行过程中的位移，L为大于M/2的整数。
可选的，在一些实施例中，根据M个第一子区域在滑动操作执行过程中的位移，确定操作界面在所述滑动操作执行过程中的位移，也可以为将M个第一子区域在滑动操作执行过程中的位移中的最大值确定为操作界面的滑动操作执行过程中的位移，或者将M个第一子区域在滑动操作执行过程中的位移的平均值确定为操作界面的滑动操作执行过程中的位移，或者其他可能的情况，本发明实施例并不限定于此。
可选的，在一些实施例中，在根据M个第一子区域在滑动操作执行过程中的位移，确定操作界面在所述滑动操作执行过程中的位移时，可以在M个第一子区域中选取N个第一子区域，再确定该N个第一子区域的位移，根据该N个第一子区域的位移确定操作界面在滑动操作执行过程中的位移。
例如，可以在M各第一子区域中选取L个第一子区域，确定该L个第一子区域中的显示内容在N张图片上的位置，根据该L个第一子区域中的显示内容在N张图片上的位置，确定该L个第一子区域的位移，在该L个第一子区域中有F个第一子区域的位移相等时，确定该F个第一子区域的位移为操作界面在滑动操作执行过程中的位移，该F大于L/2。
同样的，也可以将该选取的N个第一子区域的位移中的最大值确定为操作界面在滑动操作执行过程中的位移，或者将选取的N个第一子区域的位移中的平均值确定为操作界面在滑动操作执行过程中的位移，本发明实施例并不限定于此。
应理解，在M个第一子区域中选取L个第一子区域进行位移的确定，是为了节省该位移确定过程的计算量，提高计算速度，因为，在将第一区域划分为M个第一子区域之后，在对该M个第一子区域的位移全部进行计算，虽然可以更精确地得到该终端设备的操作界面的位移，然而，在该M的数值较大时，且采集的N张图片的数值较大时，带来的计算量也会相应的较大，计算速度较低，因此，在该M个第一子区域中选取L个第一子区域，只要该L个第一子区域可以均匀的分布在终端设备的整个操作界面上，这样既可以保证操作界面的位移确定的准确性，也可以减小位移计算的计算量，提高计算速度。
可选的，在一些实施例中，在M个第一子区域中选取L个第一子区域时，可以先将该M个第一子区域中的第一个第一子区域和第M个第一子区域去除，再在剩余的第一子区域中间隔的选取L个第一子区域。
应理解，将M个第一子区域中的第一个第一子区域和最后一个第一子区域去除，是为了避免在第一个第一子区域或最后一个第一子区域位于触摸显示屏幕的边缘时，会对第一子区域的位移确定产生影响，然而，本发明仅以去除第一个第一子区域和最后一个第一子区域为例进行说明，但本发明实施例并不限定于此，例如，也可以去除前两个第一子区域和最后两个第一子区域，只要确保选取的L个第一子区域中的显示内容在终端设备的操作界面上清晰可见，比较容易地根据该L个第一子区域中的显示内容的位置，确定该L个第一子区域的位移即可。
应理解，在M个第一子区域中去除第一个第一子区域和最后一个第一子区域之后，在剩余的第一子区域中间隔的选取L个第一子区域是为了使选取的L个第一子区域可以均匀的分布在终端设备的触摸显示屏幕的整个操作界面上，从而避免了由于选取的L个第一子区域集中在操作界面的某一部分区域，在进行操作滑动时终端设备的操作界面出 现卡顿、抖动等现象时，造成获取的操作界面的位移与其实际的位移不一致的现象。
365，根据滑动触点的在滑动操作执行过程中的位移，以及操作界面在滑动操作执行过程中的位移，确定终端设备的触摸显示屏幕的滑动性能。
可选的，在一些实施例中，在根据滑动触点在滑动操作执行过程中的位移，以及操作界面在滑动操作执行过程中的位移，确定终端设备的触摸显示屏幕的滑动性能时，可以将滑动触点在滑动操作执行过程中的位移与操作界面在滑动操作执行过程中的位移进行比较，求其差值，上述两个位移的差值越小，说明终端设备的触摸显示屏幕对用户执行的滑动操作的响应越灵敏，也就是说终端设备的触摸显示屏幕的滑动性能越好，相应的用户对终端设备的体验度也就越好。
可选的，在一些实施例中，还可以根据终端设备的操作界面对用户执行的滑动操作的响应的开始时间来确定终端设备的触摸显示屏幕的滑动性能的好坏，在操作界面对用户的滑动操作的响应的开始时间越早，说明该终端设备的触摸显示屏幕对用户执行的滑动操作的响应越灵敏，终端设备的触摸显示屏幕的滑动性能越好，相应的用户对该终端设备的体验度越好。
可选的，在一些实施例中，还可以利用与方法300对应的测试装置中的分析模块生成关于终端设备的触摸显示屏幕的滑动性能的时间-距离图，该坐标系以时间为横轴，距离为纵轴，通过该时间-距离图可以直观的分析出终端设备的触摸显示屏幕的滑动性能的好坏。
根据该关于终端设备的触摸显示屏幕的滑动性能的时间-距离图分析终端设备的触摸显示屏幕的滑动性能的方法已经在方法100中进行了详细的描述在，在此不再赘述。
在本发明实施例中，通过滑动触点在滑动操作执行过程中的位移，以及终端设备的触摸显示屏幕显示的操作界面的位移，确定终端设备的触摸显示屏幕的滑动性能，可以使用户直观的感受到终端设备的性能的好坏，有助于提高用户对终端设备的体验度。
上文结合图1至图3，详细描述了本发明实施例的方法实施例，下文将结合图4和图5，详细描述本发明实施例的触摸显示屏幕的性能测试装置的实施例，应理解，该性能测试装置实施例与方法实施例相对应，类似的描述可以参照方法实施例。
图4所示为本发明实施例的触摸显示屏幕的性能测试装置400的示意性框架图，下如图4所示，该性能测试装置400包括：
获取模块410，用于获取在触摸显示屏幕上进行滑动操作时采集的N张图片，N为不小于2的整数；
确定模块420，用于根据滑动操作对应的滑动触点在N张图片中的位置，确定滑动触点在滑动操作执行过程中的位移。
可选的，在一些实施例中，确定模块420还用于根据触摸显示屏幕上显示的操作界面中的显示内容在N张图片中的位置，确定操作界面在滑动操作执行过程中的位移。
可选的，在一些实施例中，确定模块420还用于根据滑动触点在滑动操作执行过程中的位移，以及操作界面在滑动操作执行过程中的位移，确定触摸显示屏幕的滑动性能。
在本发明实施例中，性能测试装置400通过获取滑动触点的位移和终端设备的触摸显示屏幕显示的操作界面的位移，确定终端设备的触摸显示屏幕的滑动性能，从而使用户可以直观地感受到终端设备的滑动性能的好坏，有助于提高用户对终端设备的体验度。
可选的，在一些实施例中，确定模块420具体用于将所述N张图片中的操作界面区 域划分为第一区域和第二区域，所述第一区域为不包括滑动触点的区域，所述第二区域为包括滑动触点的区域；将第一区域划分为M个第一子区域；根据M个第一子区域中的显示内容在N张图片中的位置，确定M个第一子区域在滑动操作执行过程中的位移；根据M个第一子区域在滑动操作执行过程中的位移，确定操作界面在滑动操作执行过程中的位移。
应理解，本发明实施例将N张图片中的操作界面区域划分为第一区域和第二区域，是为了在确定操作界面中的显示内容的位置时，该操作界面中的显示内容不会被滑动触点遮挡，如果不对操作界面区域进行划分，若选择的操作界面的显示内容与滑动触点重叠时，此时，无法保证操作界面的显示内容的位置或滑动触点的位置获取的准确性。
可选的，在一些实施例中，确定模块420具体用于在M个第一子区域中有L个第一子区域在滑动操作执行过程中的位移相等时，确定L个第一子区域在所述滑动操作执行过程中的位移为操作界面在所述滑动操作执行过程中的位移，所述L为大于M/2的整数。
应理解，上述确定操作界面在滑动操作执行过程中的位移利用“投票机制”，即有大于半数的第一子区域的位移相等时，可以将该大于半数的第一子区域的位移确定为操作界面在滑动操作执行过程中的位移，从而可以确保操作界面在滑动操作执行过程中的位移的准确性。
应理解，在本发明实施例中，将第一区域划分为M个第一子区域是为了更加准确的确定操作界面在滑动操作执行过程中的位移，因为，如果操作界面中的显示内容为触摸显示屏幕的显示界面中显示的画面中的部分画面时，只对操作界面上的部分区域进行分析，确定操作界面在滑动操作执行过程中的位移，此时，由于终端设备的触摸显示屏幕的操作界面的不同区域的显示内容的流畅度不同，有的显示区域可能出现卡顿、抖动等现象，从而导致获取的操作界面在滑动操作执行过程中的位移与实际的位移不一致，导致测试结果不准确，所以，将第一区域划分为M个第一子区域，分别对M个第一子区域的位移进行测试，从而通过该M个第一子区域的位移确定终端设备的操作界面的位移，可以避免由于触摸显示屏幕上部分区域的卡顿等现象出现的测试的位移不准确的问题。
可选的，在一些实施例中，该确定模块420还可以用于将M个第一子区域在滑动操作执行过程中的位移中的最大值确定为操作界面的滑动操作执行过程中的位移，或者将M个第一子区域在滑动操作执行过程中的位移的平均值确定为操作界面的滑动操作执行过程中的位移，或者其他可能的情况，本发明实施例并不限定于此。
可选的，在一些实施例中，该确定模块420还可以用于在M个第一子区域中选取N个第一子区域，再确定该N个第一子区域的位移，根据该N个第一子区域的位移确定操作界面在滑动操作执行过程中的位移。
例如，该确定模块420还可以在M个第一子区域中选取L个第一子区域，确定该L个第一子区域中的显示内容在N张图片上的位置，根据该L个第一子区域中的显示内容在N张图片上的位置，确定该L个第一子区域的位移，在该L个第一子区域中有F个第一子区域的位移相等时，确定该F个第一子区域的位移为操作界面在滑动操作执行过程中的位移，该F大于L/2。
同样的，该确定模块420也可以将该选取的N个第一子区域的位移中的最大值确定为操作界面在滑动操作执行过程中的位移，或者将选取的N个第一子区域的位移中的平均值确定为操作界面在滑动操作执行过程中的位移，本发明实施例并不限定于此。
应理解，在M个第一子区域中选取L个第一子区域进行位移的确定，是为了节省该位移确定过程的计算量，提高计算速度，因为，在将第一区域划分为M个第一子区域之后，在对该M个第一子区域的位移全部进行计算，虽然可以更精确地得到该终端设备的操作界面的位移，然而，在该M的数值较大时，且采集的N张图片的数值较大时，带来的计算量也会相应的较大，计算速度较低，因此，在该M个第一子区域中选取L个第一子区域，只要该L个第一子区域可以均匀的分布在终端设备的整个操作界面上，这样既可以保证操作界面的位移确定的准确性，也可以减小位移计算的计算量，提高计算速度。
可选的，在一些实施例中，在确定模块420在M个第一子区域中选取L个第一子区域时，可以先将该M个第一子区域中的第一个第一子区域和第M个第一子区域去除，再在剩余的第一子区域中间隔的选取L个第一子区域。
应理解，将M个第一子区域中的第一个第一子区域和最后一个第一子区域去除，是为了避免在第一个第一子区域或最后一个第一子区域位于触摸显示屏幕的边缘时，会对第一子区域的位移确定产生影响，然而，本发明仅以去除第一个第一子区域和最后一个第一子区域为例进行说明，但本发明实施例并不限定于此，例如，也可以去除前两个第一子区域和最后两个第一子区域，只要确保选取的L个第一子区域中的显示内容在终端设备的操作界面上清晰可见，比较容易地根据该L个第一子区域中的显示内容的位置，确定该L个第一子区域的位移即可。
应理解，在M个第一子区域中去除第一个第一子区域和最后一个第一子区域之后，在剩余的第一子区域中间隔的选取L个第一子区域是为了使选取的L个第一子区域可以均匀的分布在终端设备的触摸显示屏幕的整个操作界面上，从而避免了由于选取的L个第一子区域集中在操作界面的某一部分区域，在进行操作滑动时终端设备的操作界面出现卡顿、抖动等现象时，造成获取的操作界面的位移与其实际的位移不一致的现象。
可选的，在一些实施例中，确定模块420具体用于根据滑动触点在N张图片中的位置，确定滑动触点在触摸显示屏幕上滑动的方向；根据滑动触点在触摸显示屏幕上滑动的方向，确定划分N张图片中的操作界面区域的方向；根据划分N张图片中的操作界面区域的方向，将N张图片中的操作界面区域划分为第一区域和第二区域。
可选的，在一些实施例中，该性能测试装置400还包括：
识别模块430，用于识别所述N张图片中的机械手的图像。
可选的，在一些实施例中，确定模块420还用于将机械手的图像在N张图片中的位置确定为滑动触点在N张图片中的位置。
可选的，在一些实施例中，该识别模块430具体用于将N张图片的每张图片中的至少一个特征图像与预先设置的机械手的特征图像进行匹配；在图片中的特征图像与机械手的特征图像的匹配度大于或等于第一预设阈值时，确定图片中的特征图像为机械手的图像。
可选的，在一些实施例中，该获取模块410可以是高速相机，该高速相机可以用于采集在触摸显示屏幕上进行滑动操作时的图片。
应理解，根据本发明实施例的性能测试装置400中的各个模块的上述和其他操作和/或功能分别实现图1至图3中的各个方法的相应流程，为了简洁，在此不再赘述。
图5是根据本发明实施例的可穿戴的终端设备500的示意性结构图。如图5所示，所述终端设备500包括存储器510和处理器520，所述存储器510和处理器520之间通过 内部连接通路互相通信，传递控制和/或数据信号。
所述存储器510用于存储程序代码；
所述处理器520用于调用所述程序代码以实现本发明上述各实施例中的方法。
在本发明实施例中，处理器520可以是中央处理器(central processing unit，CPU)，网络处理器(network processor，NP)或者CPU和NP的组合。处理器还可以进一步包括硬件芯片。上述硬件芯片可以是专用集成电路(application-specific integrated Circuit，ASIC)，可编程逻辑器件(programmable logic device，PLD)或其组合。
本发明实施例提供了一种计算机可读介质，用于存储计算机程序代码，该计算机程序包括用于执行上述图1至图3中本发明实施例终端设备的触摸显示屏幕的性能测试方法的指令。该可读介质可以是只读存储器(read-only memory，ROM)或随机存取存储器(random access memory，RAM)，本发明实施例对此不做限制。
应理解，本文中术语“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，本文中字符“/”，一般表示前后关联对象是一种“或”的关系。
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本发明的范围。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的系统、装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等各种可以 存储程序代码的介质。
以上所述，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应所述以权利要求的保护范围为准。

Claims (14)

  1. 一种终端设备的触摸显示屏幕的性能测试方法，其特征在于，所述方法包括：
    获取在所述触摸显示屏幕上进行滑动操作时采集的N张图片，N为不小于2的整数；
    根据所述滑动操作对应的滑动触点在所述N张图片中的位置，确定所述滑动触点在所述滑动操作执行过程中的位移；
    根据所述触摸显示屏幕上显示的操作界面中的显示内容在所述N张图片中的位置，确定所述操作界面在所述滑动操作执行过程中的位移；
    根据所述滑动触点在所述滑动操作执行过程中的位移，以及所述操作界面在所述滑动操作执行过程中的位移，确定所述触摸显示屏幕的滑动性能。
  2. 根据权利要求1所述的方法，其特征在于，所述根据所述触摸显示屏幕上显示的操作界面中的显示内容在所述N张图片中的位置，确定所述操作界面在所述滑动操作执行过程中的位移，包括：
    将所述N张图片中的操作界面区域划分为第一区域和第二区域，所述第一区域为不包括所述滑动触点的区域，所述第二区域为包括所述滑动触点的区域；
    将所述第一区域划分为M个第一子区域；
    根据所述M个第一子区域中的显示内容在所述N张图片中的位置，确定所述M个第一子区域在所述滑动操作执行过程中的位移；
    根据所述M个第一子区域在所述滑动操作执行过程中的位移，确定所述操作界面在所述滑动操作执行过程中的位移。
  3. 根据权利要求2所述的方法，其特征在于，所述根据所述M个第一子区域在所述滑动操作过程中的位移，确定所述操作界面在所述滑动操作过程中的位移，包括：
    在所述M个第一子区域中有L个第一子区域在所述滑动操作执行过程中的位移相等时，确定所述L个第一子区域在所述滑动操作执行过程中的位移为所述操作界面在所述滑动操作执行过程中的位移，所述L为大于M/2的整数。
  4. 根据权利要求2或3所述的方法，其特征在于，所述将所述N张图片中的操作界面区域划分为第一区域和第二区域，包括：
    根据所述滑动触点在所述N张图片中的位置，确定所述滑动触点在所述触摸显示屏幕上滑动的方向；
    根据所述滑动触点在所述触摸显示屏幕上滑动的方向，确定划分所述N张图片中的操作界面区域的方向；
    根据划分所述N张图片中的操作界面区域的方向，将所述N张图片中的操作界面区域划分为所述第一区域和所述第二区域。
  5. 根据权利要求1至4中任一项所述的方法，其特征在于，所述根据所述滑动操作对应的滑动触点在所述N张图片中的位置，确定所述滑动触点在所述滑动操作执行过程中的位移之前，所述方法还包括：
    识别所述N张图片中的机械手的图像；
    将所述机械手的图像在所述N张图片中的位置确定为所述滑动触点在所述N张图片中的位置。
  6. 根据权利要求5所述的方法，其特征在于，所述识别所述N张图片中的机械手的图像，包括：
    将所述N张图片的每张图片中的至少一个特征图像与预先设置的机械手的特征图像进行匹配；
    在所述图片中的特征图像与所述机械手的特征图像的匹配度大于或等于第一预设阈值时，确定所述图片中的特征图像为所述机械手的图像。
  7. 根据权利要求1至6中任一项所述的方法，其特征在于，在所述触摸屏幕上进行滑动操作时的图片由高速相机采集。
  8. 一种终端设备的触摸显示屏的性能测试装置，其特征在于，所述性能测试装置包括：
    获取模块，用于获取在所述触摸显示屏幕上进行滑动操作时采集的N张图片，N为不小于2的整数；
    确定模块，用于根据所述滑动操作对应的滑动触点在所述N张图片中的位置，确定所述滑动触点在所述滑动操作执行过程中的位移；
    所述确定模块还用于根据所述触摸显示屏幕上显示的操作界面中的显示内容在所述N张图片中的位置，确定所述操作界面在所述滑动操作执行过程中的位移；
    所述确定模块还用于根据所述滑动触点在所述滑动操作执行过程中的位移，以及所述操作界面在所述滑动操作执行过程中的位移，确定所述触摸显示屏幕的滑动性能。
  9. 根据权利要求8所述的性能测试装置，其特征在于，所述确定模块具体用于：
    将所述N张图片中的操作界面区域划分为第一区域和第二区域，所述第一区域为不包括所述滑动触点的区域，所述第二区域为包括所述滑动触点的区域；
    将所述第一区域划分为M个第一子区域；
    根据所述M个第一子区域中的显示内容在所述N张图片中的位置，确定所述M个第一子区域在所述滑动操作执行过程中的位移；
    根据所述M个第一子区域在所述滑动操作执行过程中的位移，确定所述操作界面在所述滑动操作执行过程中的位移。
  10. 根据权利要求9所述的性能测试装置，其特征在于，所述确定模块具体用于在所述M个第一子区域中有L个第一子区域在所述滑动操作执行过程中的位移相等时，确定所述L个第一子区域在所述滑动操作执行过程中的位移为所述操作界面在所述滑动操作执行过程中的位移，所述L为大于M/2的整数。
  11. 根据权利要求9或10所述的性能测试装置，其特征在于，所述确定模块具体用于：
    根据所述滑动触点在所述N张图片中的位置，确定所述滑动触点在所述触摸显示屏幕上滑动的方向；
    根据所述滑动触点在所述触摸显示屏幕上滑动的方向，确定划分所述N张图片中的操作界面区域的方向；
    根据划分所述N张图片中的操作界面区域的方向，将所述N张图片中的操作界面区域划分为所述第一区域和所述第二区域。
  12. 根据权利要求8至11中任一项所述的性能测试装置，其特征在于，所述性能测试装置还包括：
    识别模块，用于识别所述N张图片中的机械手的图像；
    所述确定模块还用于将所述机械手的图像在所述N张图片中的位置确定为所述滑动 触点在所述N张图片中的位置。
  13. 根据权利要求12所述的性能测试装置，其特征在于，所述识别模块具体用于：
    将所述N张图片的每张图片中的至少一个特征图像与预先设置的机械手的特征图像进行匹配；
    在所述图片中的特征图像与所述机械手的特征图像的匹配度大于或等于第一预设阈值时，确定所述图片中的特征图像为所述机械手的图像。
  14. 根据权利要求8至11中任一项所述的性能测试装置，其特征在于，所述获取模块为高速相机。
PCT/CN2017/082355 2017-03-08 2017-04-28 终端设备的触摸显示屏幕的性能测试方法和性能测试装置 WO2018161421A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201780015008.7A CN108700989A (zh) 2017-03-08 2017-04-28 终端设备的触摸显示屏幕的性能测试方法和性能测试装置

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710134179 2017-03-08
CN201710134179.3 2017-03-08

Publications (1)

Publication Number Publication Date
WO2018161421A1 true WO2018161421A1 (zh) 2018-09-13

Family

ID=63447147

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/082355 WO2018161421A1 (zh) 2017-03-08 2017-04-28 终端设备的触摸显示屏幕的性能测试方法和性能测试装置

Country Status (2)

Country Link
CN (1) CN108700989A (zh)
WO (1) WO2018161421A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113851065B (zh) * 2020-06-09 2023-08-22 华为技术有限公司 显示面板测试装置及显示面板测试箱

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104317511A (zh) * 2014-10-14 2015-01-28 中国联合网络通信集团有限公司 屏幕流畅度测试方法及装置
CN104468916A (zh) * 2014-10-24 2015-03-25 天津市康凯特软件科技有限公司 基于手机反应时间测试方法
CN104679307A (zh) * 2013-11-27 2015-06-03 中国移动通信集团公司 一种检测触摸屏幕滑动灵敏度的方法及装置
CN104881221A (zh) * 2015-05-27 2015-09-02 上海与德通讯技术有限公司 一种滑动控制方法及触控终端
CN105786336A (zh) * 2014-12-22 2016-07-20 中国移动通信集团终端有限公司 一种终端触摸屏流畅度评定方法、装置及系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104679307A (zh) * 2013-11-27 2015-06-03 中国移动通信集团公司 一种检测触摸屏幕滑动灵敏度的方法及装置
CN104317511A (zh) * 2014-10-14 2015-01-28 中国联合网络通信集团有限公司 屏幕流畅度测试方法及装置
CN104468916A (zh) * 2014-10-24 2015-03-25 天津市康凯特软件科技有限公司 基于手机反应时间测试方法
CN105786336A (zh) * 2014-12-22 2016-07-20 中国移动通信集团终端有限公司 一种终端触摸屏流畅度评定方法、装置及系统
CN104881221A (zh) * 2015-05-27 2015-09-02 上海与德通讯技术有限公司 一种滑动控制方法及触控终端

Also Published As

Publication number Publication date
CN108700989A (zh) 2018-10-23

Similar Documents

Publication Publication Date Title
US20160004373A1 (en) Method for providing auxiliary information and touch control display apparatus using the same
US8670023B2 (en) Apparatuses and methods for providing a 3D man-machine interface (MMI)
US20110157040A1 (en) Touchpanel device, and control method and program for the device
WO2011142317A1 (ja) ジェスチャー認識装置、方法、プログラム、および該プログラムを格納したコンピュータ可読媒体
WO2017041433A1 (zh) 可穿戴设备的触控响应方法、装置及可穿戴设备
US9846529B2 (en) Method for processing information and electronic device
JP5802247B2 (ja) 情報処理装置
US9916043B2 (en) Information processing apparatus for recognizing user operation based on an image
US9836130B2 (en) Operation input device, operation input method, and program
JP2013137613A (ja) 情報処理プログラム、情報処理装置、情報処理システム、および、情報処理方法
EP2905680A1 (en) Information processing apparatus, information processing method, and program
CN107239222B (zh) 一种触摸屏的操控方法及终端设备
US10656746B2 (en) Information processing device, information processing method, and program
CN106662923A (zh) 信息处理装置、信息处理方法和程序
JP5760886B2 (ja) 画像表示装置、画像表示方法及び画像表示プログラム
WO2018205392A1 (zh) 控制响应区域显示控制方法、电子装置及存储介质
US10394442B2 (en) Adjustment of user interface elements based on user accuracy and content consumption
CN112783406B (zh) 操作执行方法、装置和电子设备
JP6229554B2 (ja) 検出装置および検出方法
WO2018161421A1 (zh) 终端设备的触摸显示屏幕的性能测试方法和性能测试装置
CN110308821B (zh) 触控响应方法及电子设备
WO2019201223A1 (zh) 屏幕显示的切换方法以及装置及存储介质
EP3605299A1 (en) Touch panel device, method for display control thereof, and program
EP3088991A1 (en) Wearable device and method for enabling user interaction
WO2015090092A1 (zh) 一种用于生成个性化输入面板的方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17899618

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17899618

Country of ref document: EP

Kind code of ref document: A1