CN114625588A

CN114625588A - Method, device and equipment for measuring touch operation response time and storage medium

Info

Publication number: CN114625588A
Application number: CN202210287794.9A
Authority: CN
Inventors: 刘洋; 朱平涛
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2022-03-22
Filing date: 2022-03-22
Publication date: 2022-06-14

Abstract

The application discloses a method, a device, equipment and a storage medium for measuring touch operation response time. The method comprises the following steps: acquiring a trigger starting time point and a trigger ending time point; the touch control mechanism is used for triggering a touch control operation on the touch control screen; acquiring a first time point of a touch event generated by the touch screen based on touch operation; acquiring a second time point of the touch screen responding to the touch event and generating display change; and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the second time point. By the method, the accuracy of the measured response time is improved.

Description

Method, device and equipment for measuring touch operation response time and storage medium

Technical Field

The present disclosure relates to the field of touch technologies, and in particular, to a method, an apparatus, a device, and a storage medium for measuring response time of touch operations.

Background

The electronic device usually has a touch screen for displaying corresponding content and receiving a touch operation of a user to perform content switching. The time from receiving touch to responding to touch of the electronic equipment is extremely important, and within a human body perception range, the response time is shortened, so that the touch experience of a user can be improved.

Therefore, how to accurately measure the response time is an urgent problem to be solved.

Disclosure of Invention

The application provides a method, a device, equipment and a storage medium for measuring touch operation response time, which can improve the accuracy of the measured response time.

In a first aspect, an embodiment of the present application provides a method for measuring response time of touch operations, where the method includes: acquiring a trigger starting time point and a trigger ending time point; the touch control mechanism is used for triggering a touch control screen to perform touch control operation, wherein the triggering starting time point and the triggering ending time point are generated by an external first sensing assembly responding to the touch control mechanism to perform touch control operation on the touch control screen; acquiring a first time point of a touch event generated by the touch screen based on touch operation; acquiring a second time point of the touch screen responding to the touch event and generating display change; and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the second time point.

In a second aspect, an embodiment of the present application provides a device for measuring response time of touch operation, where the device includes: the first acquisition module is used for acquiring a trigger starting time point and a trigger ending time point; the touch control mechanism is used for triggering a touch control operation on the touch control screen; the second acquisition module is used for acquiring a first time point of a touch event generated by the touch screen based on touch operation; the third acquisition module is used for acquiring a second time point of the touch screen responding to the touch event and generating display change; the determining module is used for determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the second time point.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, and a memory and a touch screen coupled to the processor, where the memory stores a computer program, and the processor is configured to execute the computer program to implement the method for measuring response time of touch operation provided in the foregoing embodiment.

In a fourth aspect, an embodiment of the present application provides a device for measuring response time of touch operation, where the device includes: the electronic equipment comprises a touch screen; the first sensing assembly is in communication connection with the electronic equipment and is used for sending a trigger starting time point and a trigger ending time point generated by responding to the touch mechanism to trigger touch operation on the touch screen to the electronic equipment; the electronic equipment is used for acquiring a first time point of a touch event generated by the touch screen based on touch operation; acquiring a second time point of the touch screen responding to the touch event and generating display change; and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the second time point.

In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the method for measuring response time of touch operation provided in the foregoing embodiment is implemented.

The beneficial effect of this application is: different from the prior art, the application provides a method, a device, equipment and a storage medium for measuring touch operation response time, wherein the method comprises the steps of obtaining a trigger starting time point and a trigger ending time point of a first sensing assembly, and obtaining a first time point of a touch screen generating a touch event; and acquiring a second time point when the touch screen generates display change, determining a mode of a first response time corresponding to the touch operation, and determining the first response time corresponding to the touch operation by using the time point of each stage in the electronic equipment of the touch screen and the time point of the first sensor component, so that the response time is associated with the time point of each stage in the electronic equipment of the touch screen, and the accuracy of the measured response time can be improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Wherein:

fig. 1 is a schematic flowchart illustrating an embodiment of a method for measuring response time of touch operations according to the present disclosure;

fig. 2 is a schematic flowchart illustrating a method for measuring response time of touch operation according to another embodiment of the present disclosure;

FIG. 3 is a schematic flow chart diagram illustrating an embodiment of step 24 provided herein;

FIG. 4 is a schematic flow chart diagram illustrating an embodiment of step 241 provided herein;

fig. 5 is a schematic flowchart illustrating a method for measuring response time of touch operation according to another embodiment of the present disclosure;

FIG. 6 is a schematic flow chart diagram illustrating one embodiment of step 55 provided herein;

fig. 7 is a schematic flowchart illustrating a method for measuring response time of touch operation according to another embodiment of the present disclosure;

fig. 8 is a schematic flowchart illustrating a method for measuring response time of touch operation according to another embodiment of the present disclosure;

fig. 9 is a schematic structural diagram of an embodiment of a device for measuring response time of touch operations according to the present disclosure;

FIG. 10 is a schematic structural diagram of an embodiment of an electronic device provided in the present application;

FIG. 11 is a schematic structural diagram of another embodiment of an electronic device provided herein;

FIG. 12 is a schematic structural diagram of an embodiment of a measurement apparatus provided herein;

FIG. 13 is a schematic structural diagram of one embodiment of a first sensing assembly provided herein;

FIG. 14 is a schematic structural diagram of another embodiment of a measurement device provided herein;

fig. 15, fig. 16, fig. 17 and fig. 18 are schematic views of an application scenario of the method for measuring response time of touch operation provided in the present application;

FIG. 19 is a schematic structural diagram of another embodiment of a measurement device provided herein;

FIG. 20 is a schematic structural diagram of an embodiment of a computer-readable storage medium provided in the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

Referring to fig. 1, fig. 1 is a schematic flowchart illustrating an embodiment of a method for measuring response time of touch operation according to the present disclosure. The method comprises the following steps:

step 11: acquiring a trigger starting time point and a trigger ending time point; the touch control mechanism is used for triggering the touch control screen to touch the touch control screen, wherein the triggering starting time point and the triggering ending time point are generated by an external first sensing assembly in response to the touch control mechanism triggering touch control operation on the touch control screen.

In some embodiments, the touch screen is a part of the electronic device for providing interface display and touch function to enable the electronic device to interact with different operators. The touch screen can be a capacitive screen or a resistive screen.

The touch mechanism may be a mechanical arm, a stylus, a finger, or other object that can trigger a touch operation on the touch screen.

In some embodiments, the first sensing element may be disposed on a side of the touch screen. For example, the first sensing element may comprise a proximity switch. When the touch mechanism triggers the touch operation on the touch screen, the touch mechanism approaches the proximity switch, and the proximity switch is triggered to generate a corresponding trigger starting time point. And when the touch mechanism is far away from the proximity switch, the proximity switch is closed, and a trigger ending time point is generated.

The touch operation may be sliding on the touch screen or clicking on the touch screen.

Step 12: the method includes the steps of obtaining a first time point of a touch event generated by a touch screen based on touch operation.

During touch operation, a corresponding report point is generated on the touch screen. Generating a touch event means generating a touch event. Therefore, the electronic device can record a first time point of generating the touch event.

The touch point reporting is coordinate values of a touch point corresponding to the touch operation detected by the touch screen, namely, abscissa values and ordinate values. For example, when the user performs a sliding operation on the touch screen, the touch screen continuously detects a plurality of touch points and reports the touch points to form a plurality of report points.

Step 13: and acquiring a second time point of the touch screen responding to the touch event and generating display change.

After the touch event is generated, the electronic device generates corresponding processing based on the touch event. For example, based on the touch event, the display of the touch screen is switched. Such as switching from the current interface to another interface. For another example, based on the touch event, the display of the corresponding area of the touch screen is switched, and then the display of the corresponding area is changed. Such as a change in color of the corresponding region.

Therefore, the change of the touch screen can be monitored, and a second time point when the touch screen responds to the touch event and generates the display change is obtained.

Step 14: and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the second time point.

The time from the touch start to the touch event generated on the touch screen can be determined by using the trigger start time point, the trigger end time point and the first time point.

The trigger starting time point, the trigger ending time point and the first time point are determined, and corresponding report points can be generated on the touch screen during touch operation, and the positions of the report points can be recorded at the moment. Thus, a linear relationship can be determined based on the trigger start time point and the trigger end time point, and the time point of the report point can be determined based on the recorded position of the report point. Then, the time from the point reporting to the touch event generation based on the point reporting is determined by using the first time point and the time point of the point reporting.

Then, the time for generating the display change in response to the touch event can be determined by using the second time point and the first time point.

Therefore, the response time from the touch operation to the display change of the touch screen can be determined.

In an application scenario, the method for measuring the response time of the touch operation is applied to an electronic device, and the electronic device comprises a touch screen.

The electronic equipment is in communication connection with the first sensing assembly and is used for acquiring a trigger starting time point and a trigger ending time point; the touch control mechanism is used for triggering the touch control screen to touch the touch control screen, wherein the triggering starting time point and the triggering ending time point are generated by an external first sensing assembly in response to the touch control mechanism triggering touch control operation on the touch control screen. The electronic device can be connected to the first sensing component through bluetooth, USB (Universal Serial Bus), networking and other communication methods.

The method comprises the steps that the electronic equipment obtains a first time point of a touch event generated by a touch screen based on touch operation; acquiring a second time point of the touch screen responding to the touch event and generating display change; and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the second time point.

In another application scenario, the method for measuring touch operation response time provided by the present application is applied to a measuring apparatus, and the measuring apparatus includes a processing device.

The processing device is in communication connection with the electronic device and the first sensing assembly, respectively. The processing equipment is used for acquiring a trigger starting time point and a trigger ending time point; the touch control mechanism is used for triggering a touch control screen to perform touch control operation, wherein the triggering starting time point and the triggering ending time point are generated by an external first sensing assembly responding to the touch control mechanism to perform touch control operation on the touch control screen; acquiring a first time point of a touch event generated by a touch screen of the electronic equipment based on touch operation; acquiring a second time point of the touch screen responding to the touch event and generating display change; and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the second time point.

In the embodiment, a trigger starting time point and a trigger ending time point of a first sensing assembly are obtained, and a first time point of a touch event generated by a touch screen is obtained; and acquiring a second time point when the touch screen generates display change, determining a mode of a first response time corresponding to the touch operation, and determining the first response time corresponding to the touch operation by using the time point of each stage in the electronic equipment of the touch screen and the time point of the first sensor component, so that the response time is associated with the time point of each stage in the electronic equipment of the touch screen, and the accuracy of the measured response time can be improved.

Furthermore, response improvement can be performed according to the time points of each stage in the electronic equipment, so that the response time of touch operation is shortened.

Referring to fig. 2, fig. 2 is a schematic flowchart illustrating another embodiment of a method for measuring response time of touch operation according to the present application. The method comprises the following steps:

step 21: acquiring a trigger starting time point and a trigger ending time point; the touch control mechanism is used for triggering the touch control screen to touch the touch control screen, wherein the triggering starting time point and the triggering ending time point are generated by an external first sensing assembly in response to the touch control mechanism triggering touch control operation on the touch control screen.

In some embodiments, the first sensing assembly includes a transmitter, a receiver, and a communication module. The transmitter is used for transmitting optical signals, and the receiver is used for receiving optical signals. When the touch mechanism performs touch operation on the touch screen, the receiver is blocked from receiving the optical signal, and a trigger starting time point is generated. After the touch mechanism is far away from the transmitter, the receiver receives the optical signal again, and then a trigger end time point is generated. And then the triggering starting time point and the triggering ending time point are sent to corresponding processing equipment through the communication module. The processing device may have the electronic device itself of the touch screen, or may be a separate processing device.

Step 22: the method includes the steps that a first time point of a touch event generated by a touch screen based on touch operation is obtained.

Steps 21 to 22 have the same or similar technical solutions as those in the above embodiments, and are not described herein again.

Step 23: acquiring a third time point when the external second sensing assembly is triggered; the second sensing assembly is triggered by display change generated by the touch screen.

The second sensing assembly can comprise a photoelectric sensor and a communication module, and when the touch screen displays changes, the touch screen inevitably changes light, so that whether the touch screen displays changes is detected by the photoelectric sensor. If yes, the photoelectric sensor is triggered, and a third time point when the photoelectric sensor is triggered is recorded.

And the photoelectric sensor is connected with the communication module, and the communication module is used for sending the third time point to the corresponding processing equipment.

Wherein the third time point is taken as the second time point in the above embodiment.

Step 24: and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the third time point.

In some embodiments, referring to fig. 3, step 24 may be the following flow:

step 31: the first time period is determined based on the trigger start time point, the trigger end time point, and the first time point.

The time period from the start of triggering to the end of triggering of the touch mechanism can be calculated by using the starting time point of triggering and the ending time point of triggering, and a linear relation can be determined based on the two time points.

And determining the time from the target sliding to the touch screen to the target report point through a linear interpolation mode.

In an application scenario, if the touch operation is a sliding operation, a corresponding report point is generated during the sliding process. The touch screen generates a subsequent corresponding touch event after detecting the touch point. On the touch screen, when the touch point is determined, the coordinates of the touch point can be synchronously known. Therefore, the time from the generation of the report point to the generation of the touch event can be further determined according to the coordinates of the report point.

The description is made with reference to fig. 4:

step 41: the method comprises the steps of obtaining coordinates of a report point for triggering touch operation on a touch screen, a first coordinate corresponding to a trigger starting time point and a second coordinate corresponding to a trigger ending time point.

Step 42: and determining a target time point generated by the report point based on the coordinate of the report point, the first coordinate, the second coordinate, the trigger starting time point and the trigger ending time point.

It can be understood that, during the sliding operation, the touch screen can only determine the coordinates of the report point when the report point is generated. Therefore, calculation needs to be performed by combining the relevant information of the first sensing assembly to obtain the target time point of the generation of the report point.

For example, the sliding operation is uniform sliding or linear sliding. Such as a proportional slip velocity that is progressively greater or a proportional slip velocity that is progressively less. Therefore, when the trigger starting time point and the trigger ending time point are determined, the first coordinate corresponding to the trigger starting time point and the second coordinate corresponding to the trigger ending time point can be synchronously determined. Then, according to the distance between the first coordinate and the second coordinate and the sliding proportion, the time required by sliding in the unit distance can be calculated. Furthermore, the time of generating the report point can be determined based on the coordinates of the report point triggering the touch operation.

The time for generating the touch trigger may be before the trigger start time point, after the trigger end time point, or between the trigger start time point and the trigger end time point. After the sliding track is determined by using the first coordinate, the second coordinate, the trigger starting time point and the trigger ending time point, the generation time of any report point can be determined.

Step 43: a first time period is determined using the first time point and the target time point.

And subtracting the target time point from the first time point to obtain a first time period. The first time period may represent a time taken from generation of the touch event to generation of the touch event.

Step 32: based on the third point in time and the first point in time, a second time period is determined.

And subtracting the first time point from the third time point to obtain a second time period. The second time period may characterize a time that the touch screen responds to the touch event.

Step 33: a first response time is determined based on the first time period and the second time period.

The first time period and the second time period are added to determine a first response time. The first response time represents a time for the touch screen to respond to the touch event.

In the embodiment, a trigger starting time point and a trigger ending time point of a first sensing assembly are obtained, and a first time point of a touch event generated by a touch screen is obtained; and acquiring a third time point when the external second sensing component is triggered, determining a first response time corresponding to the touch operation, and determining the first response time corresponding to the touch operation by using the time points of the stages in the electronic equipment of the touch screen and the time points of the first sensor component and the second sensing component, so that the response time is associated with the time points of the stages in the electronic equipment of the touch screen, and the accuracy of the measured response time can be improved.

Referring to fig. 5, fig. 5 is a schematic flowchart illustrating another embodiment of a method for measuring response time of touch operation according to the present application. The method comprises the following steps:

step 51: acquiring a trigger starting time point and a trigger ending time point; the touch control mechanism is used for triggering the touch control screen to touch the touch control screen, wherein the triggering starting time point and the triggering ending time point are generated by an external first sensing assembly in response to the touch control mechanism triggering touch control operation on the touch control screen.

Step 52: the method includes the steps of obtaining a first time point of a touch event generated by a touch screen based on touch operation.

Steps 51 to 52 have the same or similar technical solutions as any of the above embodiments, and are not described herein again.

Step 53: and acquiring a fourth time point when the target application in the electronic equipment corresponding to the touch screen receives the touch event.

The touch screen is in communication connection with the processor of the electronic device, so that when the touch screen generates a touch event, the touch event is sent to the processor of the electronic device, and the processor is loaded with a corresponding operating system. Wherein, the operating system can run corresponding application programs. And then processed by the relevant application of the operating system in the electronic device. For example, the application may be a game-type application, a communication-type application, or the like.

Therefore, a fourth time point when the target application in the electronic equipment receives the touch event can be recorded.

Step 54: acquiring a second time point when the touch screen generates display change; wherein the fourth time point is less than the second time point.

Step 54 has the same or similar technical solutions as any of the above embodiments, and is not described herein.

Step 55: and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point, the fourth time point and the second time point.

In some embodiments, referring to fig. 6, step 55 may be the following flow:

step 551: the first time period is determined based on the trigger start time point, the trigger end time point, and the first time point.

Specifically, coordinates of a report point for triggering touch operation on the touch screen, a first coordinate corresponding to a trigger start time point, and a second coordinate corresponding to a trigger end time point are obtained.

And determining a target time point generated by the touch operation triggering report point based on the coordinate of the touch operation triggering report point, the first coordinate, the second coordinate, the trigger starting time point and the trigger ending time point.

For example, the sliding operation is a constant speed sliding or a linear regular sliding. Such as a proportional sliding speed that is gradually greater or a proportional sliding speed that is gradually less. Therefore, when the trigger starting time point and the trigger ending time point are determined, the first coordinate corresponding to the trigger starting time point and the second coordinate corresponding to the trigger ending time point can be synchronously determined. Then, according to the distance between the first coordinate and the second coordinate and the sliding proportion, the time required by sliding in the unit distance can be calculated. Furthermore, the time of generating the report point can be determined based on the coordinates of the report point triggering the touch operation.

Step 552: based on the fourth point in time and the first point in time, a second time period is determined.

And subtracting the first time point from the fourth time point to obtain a second time period. The second time period may represent a time from the generation of the touch event to the reception of the touch event by the target application.

Step 553: based on the fourth point in time and the second point in time, a third time period is determined.

And subtracting the fourth time point from the second time point to obtain a third time period. The third time period may represent a time from when the target application receives the touch event to when the target application touch screen generates a display change.

Step 554: a first response time is determined based on the first time period, the second time period, and the third time period.

And adding the first time period, the second time period and the third time period to determine a first response time.

In the embodiment, a trigger starting time point and a trigger ending time point of a first sensing assembly are obtained, and a first time point of a touch event generated by a touch screen is obtained; and a target application in the electronic device receives a fourth time point of the touch event, acquires a second time point of the touch screen generating display change, determines a first response time corresponding to the touch operation, and determines the first response time corresponding to the touch operation by using the time point of each stage in the electronic device of the touch screen and the time point of the first sensor component, so that the response time is associated with the time point of each stage in the electronic device of the touch screen, and the accuracy of the measured response time can be improved.

Referring to fig. 7, fig. 7 is a schematic flowchart illustrating another embodiment of a method for measuring response time of touch operation according to the present application. The method comprises the following steps:

step 71: acquiring a trigger starting time point and a trigger ending time point; the touch control mechanism is used for triggering the touch control screen to touch the touch control screen, wherein the triggering starting time point and the triggering ending time point are generated by an external first sensing assembly in response to the touch control mechanism triggering touch control operation on the touch control screen.

Step 72: and acquiring a fifth time point of the response of the firmware corresponding to the touch screen to the touch operation.

After responding to the touch operation by a firmware, the touch screen sends the touch operation to the kernel of the electronic equipment, and the kernel generates a corresponding touch event. Thus, a fifth time point when the firmware responds to the touch operation can be determined.

Step 73: acquiring a first time point of a touch event generated by a kernel in the electronic equipment; wherein the fifth time point is less than the first time point.

The kernel in the electronic device may be a kernel based on Linux, or a kernel based on other operating systems. Such as Windows operating system, IOS operating system, and android operating system.

When the kernel generates a touch event, corresponding application is determined from the system according to the touch event, and then color rendering is performed on the touch screen according to the touch event.

Step 74: and acquiring a second time point of the touch screen responding to the touch event and generating display change.

The touch screen responds to the touch event, color rendering is carried out on the corresponding pixel points, and the touch screen generates display change. The display change of the touch screen can be monitored by adopting a photoelectric sensor, and a second time point of the display change is recorded.

Step 75: and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the fifth time point, the first time point and the second time point.

For example, the first time period is determined based on the trigger start time point, the trigger end time point and the fifth time point.

A second time period is then determined based on the first time point and the fifth time point.

A third time period is determined based on the second point in time and the first point in time.

The first time period, the second time period and the third time period are then added to determine a first response time.

In this embodiment, a trigger start time point and a trigger end time point of the first sensing element, a fifth time point of a firmware response touch operation corresponding to the touch screen, and a first time point of a touch event generated by a kernel in the electronic device are obtained; and determining a first response time corresponding to the touch operation by using the time point of each stage in the electronic equipment of the touch screen and the time point of the first sensor assembly, so that the response time is associated with the time point of each stage in the electronic equipment of the touch screen, and the accuracy of the measured response time can be improved.

In some embodiments, after the first response time is determined by using any of the embodiments, the first response time needs to be checked, and based on this, referring to fig. 8, fig. 8 is a schematic flowchart of another embodiment of the method for measuring response time of touch operation provided in the present application.

Step 81: and receiving an image stream from the generation of the touch operation to the generation of the display change of the touch screen.

In some embodiments, the image acquisition device is used for acquiring a touch mechanism to perform touch operation on the touch screen, and an image stream with display change is generated on the touch screen.

Step 82: and determining a second response time corresponding to the touch operation based on the image stream.

And then fitting the track of the touch operation of the touch mechanism on the touch screen in the image stream, and determining a second response time corresponding to the touch operation according to the frame rate of the image acquisition device.

Step 83: the first response time is checked with the second response time.

If the difference between the second response time and the first response time is greater than the set threshold, the method for measuring the first response time needs to be corrected again.

If the difference between the second response time and the first response time is less than or equal to the set threshold, it is determined that the first response time meets the measurement requirement.

In an application scenario, the touch mechanism is a mechanical arm. Shooting and recording a measurement whole process from the generation of touch operation to the generation of display change of a touch screen by using a high-speed camera; tracking the track of the mechanical arm and the dragged object through the openCV; fitting the time track motion curves corresponding to the mechanical arm and the dragged object through the captured tracks of the mechanical arm and the dragged object; calculating the phase difference of the two curves; and converting the delay between the object and the mechanical arm according to the phase difference and the frame rate of the high-speed camera, and further determining second response time.

In this embodiment, the second response time is determined by means of image detection to verify the first response time, so that the accuracy of the first response time can be improved.

Referring to fig. 9, fig. 9 is a schematic structural diagram of an embodiment of a device for measuring response time of touch operation provided in the present application. The touch operation response time measuring device 1000 includes: a first obtaining module 201, a second obtaining module 202, a third obtaining module 203 and a determining module 204.

The first obtaining module 201 is configured to obtain a trigger start time point and a trigger end time point; the touch control mechanism is used for triggering the touch control screen to touch the touch control screen, wherein the triggering starting time point and the triggering ending time point are generated by an external first sensing assembly in response to the touch control mechanism triggering touch control operation on the touch control screen.

The second obtaining module 202 is configured to obtain a first time point of a touch event generated by the touch screen based on the touch operation.

The third obtaining module 203 is configured to obtain a second time point when the touch screen generates a display change in response to the touch event.

The determining module 204 is configured to determine a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point, and the second time point.

In some embodiments, the third acquiring module 203 is further configured to acquire a third time point when the external second sensing component is triggered; the second sensing assembly is triggered by display change generated by the touch screen; and taking the third time point as the second time point.

Specifically, the determining module 204 is further configured to determine a first time period based on the trigger start time point, the trigger end time point, and the first time point; and determining a second time period based on the second time point and the first time point; and determining a first response time based on the first time period and the second time period.

In some embodiments, the third obtaining module 203 is further configured to obtain a fourth time point when a target application in the electronic device corresponding to the touch screen receives the touch event;

the determining module 204 is further configured to determine a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point, the fourth time point, and the second time point.

Specifically, the determining module 204 is further configured to determine a first time period based on the trigger start time point, the trigger end time point, and the first time point; and determining a second time period based on the fourth time point and the first time point; and determining a third time period based on the fourth time point and the second time point; and determining a first response time based on the first time period, the second time period, and the third time period.

Specifically, the determining module 204 is further configured to obtain coordinates of a report point on the touch screen, where the report point triggers the touch operation, and a first coordinate corresponding to the trigger start time point and a second coordinate corresponding to the trigger end time point; determining a target time point generated by the report point based on the coordinate of the report point, the first coordinate, the second coordinate, the trigger starting time point and the trigger ending time point; a first time period is determined using the first time point and the target time point.

In some embodiments, the second obtaining module 202 is further configured to obtain a fifth time point when the firmware corresponding to the touch screen responds to the touch operation.

The determining module 204 is further configured to determine a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the fifth time point, the first time point, and the second time point.

It is understood that the electronic device 200 is capable of implementing the method of any of the above embodiments, and the detailed description thereof is omitted here.

Referring to fig. 10, fig. 10 is a schematic structural diagram of an embodiment of an electronic device provided in the present application. The electronic device 200 comprises a processor 205, and a memory 206 and a touch screen 207 coupled to the processor 205, wherein a computer program is stored in the memory 206, and the processor 205 is configured to execute the computer program to implement the following method:

acquiring a trigger starting time point and a trigger ending time point; the touch control mechanism is used for triggering a touch control screen to perform touch control operation, wherein the triggering starting time point and the triggering ending time point are generated by an external first sensing assembly responding to the touch control mechanism to perform touch control operation on the touch control screen; acquiring a first time point of a touch event generated by the touch screen based on touch operation; acquiring a second time point of the touch screen responding to the touch event and generating display change; and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the second time point.

It is understood that the processor 205 is also used for executing a computer program to implement the method of any of the above embodiments, which is not described herein.

Referring to fig. 11, fig. 11 is a schematic structural diagram of another embodiment of an electronic device provided in the present application. The electronic device 200 may be, for example, a mobile electronic device, and the electronic device 200 may include: a memory 206, a processor (CPU) 205, a circuit board (not shown), a power supply circuit, and a microphone 217. The circuit board is arranged in a space enclosed by the shell; the processor 205 and the memory 206 are disposed on the circuit board; the power supply circuit is used for supplying power to each circuit or device of the electronic equipment; the memory 206 is used to store executable program code; the processor 205 runs a computer program corresponding to the executable program code by reading the executable program code stored in the memory 206, so as to identify the identification information to realize the unlocking and waking functions.

The electronic device may further include: peripheral interface 208, RF (Radio Frequency) circuitry 210, audio circuitry 211, speakers 216, power management chip 213, input/output (I/O) subsystem 214, other input/control devices 215, touch screen 207, other input/control devices 215, and external port 209, which communicate via one or more communication buses or signal lines 212. The touch screen 207 may be the display screen 10 in the foregoing embodiment.

The memory 206 may be accessed by the processor 205, the peripheral interface 208, and the like, and the memory 206 may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other volatile solid-state storage devices. The peripherals interface 208 may connect input and output peripherals of the device to the processor 205 and the memory 206.

The I/O subsystem 214 may connect input and output peripherals on the device, such as the touch screen 207 and other input/control devices 215, to the peripheral interface 208. The I/O subsystem 214 may include a display controller 2141 and one or more input controllers 2142 for controlling the other input/control devices 215. Where one or more input controllers 2142 receive electrical signals from or transmit electrical signals to other input/control devices 215, the other input/control devices 215 may include physical buttons (push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels. It is worth noting that the input controller 9092 may be connected with any one of the following: a keyboard, an infrared port, a USB interface, and a pointing device such as a mouse.

The touch screen 207 is an input interface and an output interface between the consumer electronic device and the user, displaying visual output to the user, which may include graphics, text, icons, video, and the like.

The display controller 2141 in the I/O subsystem 214 receives electrical signals from the touch screen 207 or sends electrical signals to the touch screen 207. The touch screen 207 detects a contact on the touch screen, and the display controller 2141 converts the detected contact into an interaction with a user interface object displayed on the touch screen 207, that is, implements a human-computer interaction, where the user interface object displayed on the touch screen 912 may be an icon for running a game, an icon networked to a corresponding network, or the like.

The RF circuit 210 is mainly used to establish communication between the mobile phone and the wireless network (i.e., the network side), so as to receive and transmit data between the mobile phone and the wireless network. Such as sending and receiving short messages, e-mails, etc. In particular, the RF circuitry 210 receives and transmits RF signals, also referred to as electromagnetic signals, through which the RF circuitry 210 converts electrical signals to or from electromagnetic signals and communicates with communication networks and other devices. RF circuitry 905 may include known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a Subscriber Identity Module (SIM), and so forth.

The audio circuit 211 is primarily used to receive audio data from the peripheral interface 208, convert the audio data to an electrical signal, and send the electrical signal to the speaker 216. The speaker 216 is used to convert the voice signal received by the handset from the wireless network through the RF circuit 210 into sound and play the sound to the user. And a power management chip 213 for supplying power and managing power to the hardware connected to the processor 205, the I/O subsystem 214, and the peripheral interface 208.

Referring to fig. 12, fig. 12 is a schematic structural diagram of an embodiment of a device for measuring response time of touch operation provided in the present application. The measuring device 1000 includes: electronic device 200, first sensing component 300.

The electronic device 200 includes a touch screen 207.

The first sensing component 300 is in communication connection with the electronic device 200, and is configured to send a trigger start time point and a trigger end time point generated in response to a touch mechanism triggering a touch operation on the touch screen to the electronic device 200.

The electronic device 200 is configured to acquire a first time point at which the touch screen 207 generates a touch event based on a touch operation; acquiring a second time point when the touch screen 106 responds to the touch event and generates display change; and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the second time point.

Referring to fig. 13, the first sensing assembly 300 includes a transmitter 301, a receiver 302, and a communication module 303.

The transmitter 301 and the receiver 302 are disposed on two sides of the touch screen 207, and the receiver can receive the optical signal sent by the transmitter 301.

The communication module 303 is respectively connected to the receiver 302 and the electronic device 200, and is configured to receive the trigger start time point and the trigger end time point sent by the receiver 302, and send the trigger start time point and the trigger end time point to the electronic device 200.

In some embodiments, the transmitter 301 may be a laser transmitter, such as an infrared light transmitter. The receiver 302 is an electro-optical receiver, such as a photosensitive sensor, for receiving the optical signal transmitted by the transmitter 301.

The first sensing element 300 is mainly used for accurately detecting the time when the touch mechanism slides to a specific position of the touch screen. The realization principle is as follows: the light-sensitive sensor may receive a light signal of the laser emitter.

The laser emitter and the photosensitive sensor are respectively arranged on the left side and the right side of the touch screen, and laser signals are emitted onto the photosensitive sensor. The touch mechanism slides on the touch screen, and the first sensing assembly 300 can accurately capture the time when the touch screen enters and leaves the photosensitive sensor.

Further, the first sensing assembly 300 includes a control module (not shown) for controlling the transmitter 301, the receiver 302 and the communication module 303 to perform the above operations.

It is understood that the measurement apparatus 1000 can implement the method of any of the above embodiments, and details are not described herein.

Referring to fig. 14, fig. 14 is a schematic structural diagram of another embodiment of the device for measuring response time of touch operation provided in the present application. The measuring device 1000 includes: electronic device 200, first sensing assembly 300, and second sensing assembly 400.

The second sensing assembly 400 is in communication connection with the electronic device 200, and is configured to send a third time point at which the second sensing assembly 400 is triggered to the electronic device 200; the second sensing assembly is triggered by the display change of the touch screen.

The second sensing assembly 400 may include a photo sensor (not shown) and a communication module (not shown). The photoelectric sensor is used for monitoring the display change of the touch screen, and then a third time point is generated when the touch screen is triggered. The communication module is configured to send the third time point to the electronic device 200.

In an application scenario, the following is explained with reference to fig. 15 to 18:

as shown in fig. 15, the first sensing assembly 300 includes a transmitter 301, a receiver 302, and a communication module 303. The communication module 303 and the communication module of the electronic device 200 maintain clock synchronization.

The transmitter 301 and the receiver 302 are disposed on two sides of the touch screen 207, and the receiver can receive the optical signal transmitted by the transmitter 301.

The electronic device 200 includes a touch screen 207 and a main body 240. The touch screen 207 includes a touch scan module 2071, a firmware module 2072 and an interrupt module 2073. The body 240 includes a communication module 245 and a system 242. Among other things, the system 242 includes a kernel module 2421, a system framework 2422, a target application 2423, and a composite display module 244.

The communication module 303 of the first sensing assembly 300 is connected to the communication module 245, and is configured to send the trigger start time point and the trigger end time point to the communication module 245.

The touch scanning module 2071 is configured to scan the touch points corresponding to the touch operation to determine the relevant information of the touch points corresponding to the touch points.

The firmware module 2072 is configured to receive the information of the report point sent by the touch scanning module 2071, and send the information to the interrupt module 2073.

The interrupt module 2073 sends the information of the breakpoint to the kernel module 2421.

The kernel module 2421 generates a touch event based on the breakpoint information, and sends the touch event to the system framework 2422.

The system framework 2422 determines a corresponding target application 2423.

The target application 2423 controls the composite display module 244 based on the touch event to cause the composite display module 244 to generate a corresponding signal.

The display module 244 sends a corresponding control signal to the touch screen 207 to control the touch screen 207 to generate a display change.

For example, referring to FIG. 16, the application to be tested is started first, and then the user is asked to authorize clock synchronization. Upon receiving the authorization execution, the first sensing component 300 and the electronic device 200 are clocked.

Then a click-to-start test is performed to determine whether the electronic device is successfully connected. Upon successful connection of the electronic device 200, it is determined whether the first sensing assembly 300 is normal.

In the normal case of the first sensing assembly 300, the robotic arm is controlled to begin sliding on the touch screen 207.

During the sliding process, a time point 1 when the robot arm enters the first sensing assembly 300 and a time point 2 when the robot arm leaves the first sensing assembly 300 are acquired.

Synchronously, during the sliding process, the firmware of the touch screen 207 scans the touch data, thereby generating an interrupt signal. The touch data is sent to the kernel module 241 based on the interrupt signal, and the kernel module 241 generates a touch event and records a time point 3.

Further, the touch event is reported to the system framework 242.

The system framework 242 dispatches the touch event to the target application 243.

The target application 243 performs a touch callback and records time point 4.

The response time required for the touch generation to the target application 243 to respond can be determined according to the time point 1, the time point 2, the time point 3 and the time point 4. Specifically, the response time of each stage can be calculated.

And further, determining whether the test times are reached, and counting the test result when the test times are reached.

As shown in fig. 17, the second sensing assembly 400 may include a photosensor 401 and a communication module 402.

The communication module 402 is configured to send a time point generated by the photo sensor when the photo sensor is triggered to the electronic device 200.

For example, referring to FIG. 18, the application to be tested is first started and the user is asked to authorize clock synchronization. After receiving the authorization execution, the second sensing assembly 400 and the electronic device 200 are clock synchronized.

A click-to-start test is then performed to determine whether the electronic device 200 is successfully connected. Upon successful connection of the electronic apparatus, a robot arm slide operation as in fig. 16 is performed.

The target application sends a change color command and records point in time 5.

The composite display module 244 performs response drawing and controls the touch screen to respond.

At this time, the second sensing element 400 senses the display change of the touch screen, and records the time point 6.

From time point 5 and time point 6, the time of the drawing display can be determined.

Thus, the overall response time can be determined according to the response time required for the touch generation to the target application 243 to respond and the time for drawing the display.

It is understood that the measurement apparatus 1000 can implement the method of any of the above embodiments, and the detailed description thereof is omitted here.

Referring to fig. 19, fig. 19 is a schematic structural diagram of another embodiment of the device for measuring response time of touch operation provided in the present application. The measuring device 1000 includes: an electronic device 200, a first sensing assembly 300, and a processing device 500.

The electronic device 200 is communicatively connected to the processing device 500, and the electronic device 200 includes a touch screen 207.

The first sensing component 300 is communicatively connected to the processing device 500, and is configured to send a trigger start time point and a trigger end time point generated in response to a touch mechanism triggering a touch operation on the touch screen to the processing device 500.

The processing device 500 is configured to acquire a first time point at which the touch screen 207 generates a touch event based on a touch operation; acquiring a second time point when the touch screen 207 responds to the touch event and generates display change; and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the second time point.

In some embodiments, the measurement apparatus 1000 may be designed in an automatic mode, and combines the big data function to count the magnitude of the delay of each stage of the electronic device 200 and the fluctuation condition.

Referring to fig. 20, fig. 20 is a schematic structural diagram of an embodiment of a computer-readable storage medium provided in the present application. The computer-readable storage medium 220 stores a computer program 221, the computer program 221, when executed by a processor, implementing the method of:

It is understood that the computer program 221, when executed by the processor, can implement the method of any of the above embodiments, which is not described herein.

In the several embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented in other manners. For example, the above-described device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed.

The integrated units in the other embodiments described above may be stored in a computer-readable storage medium if they are implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

The above description is only for the purpose of illustrating embodiments of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application or are directly or indirectly applied to other related technical fields, are also included in the scope of the present application.

Claims

1. A method for measuring response time of touch operation is characterized by comprising the following steps:

acquiring a trigger starting time point and a trigger ending time point; the touch control mechanism is used for triggering a touch control screen to perform touch control operation, wherein the triggering starting time point and the triggering ending time point are generated by an external first sensing assembly responding to the touch control mechanism to trigger the touch control operation on the touch control screen; and

acquiring a first time point of a touch event generated by the touch screen based on the touch operation;

acquiring a second time point when the touch screen responds to the touch event and generates display change;

and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the second time point.

2. The method of claim 1, wherein the obtaining a second point in time at which the touch screen changes display in response to the touch event comprises:

acquiring a third time point when the external second sensing assembly is triggered; the second sensing assembly is triggered by display change generated by the touch screen; and taking the third time point as the second time point.

3. The method according to claim 2, wherein the determining a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point, and the second time point comprises:

determining a first time period based on the trigger start time point, the trigger end time point, and the first time point;

determining a second time period based on the second time point and the first time point;

determining the first response time based on the first time period and the second time period.

4. The method of claim 1, prior to obtaining the second point in time, comprising:

acquiring a fourth time point when a target application in the electronic equipment corresponding to the touch screen receives the touch event;

the determining a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point, and the second time point includes:

and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point, the fourth time point and the second time point.

5. The method according to claim 4, wherein the determining a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point, a fourth time point, and the second time point comprises:

determining a second time period based on the fourth time point and the first time point;

determining a third time period based on the fourth time point and the second time point;

determining the first response time based on the first time period, the second time period, and a third time period.

6. The method of claim 5 or 3, wherein determining a first time period based on the trigger start time point, the trigger end time point and the first time point comprises:

acquiring coordinates of a report point for triggering touch operation on the touch screen, and a first coordinate corresponding to the trigger starting time point and a second coordinate corresponding to the trigger ending time point;

determining a target time point generated by the newspaper point based on the coordinates of the newspaper point, the first coordinates, the second coordinates, the trigger start time point and the trigger end time point;

determining the first time period using the first time point and the target time point.

7. The method of claim 1, prior to obtaining the first point in time, comprising:

acquiring a fifth time point when the firmware corresponding to the touch screen responds to the touch operation;

determining a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the fifth time point, the first time point and the second time point.

8. The method according to any one of claims 1-7, further comprising:

receiving an image stream generated from the touch operation to the touch screen to generate display change;

determining a second response time corresponding to the touch operation based on the image stream;

and checking the first response time by utilizing the second response time.

9. A device for measuring response time of touch operation, the device comprising:

the first acquisition module is used for acquiring a trigger starting time point and a trigger ending time point; the touch control mechanism is used for triggering a touch control screen to perform touch control operation, wherein the triggering starting time point and the triggering ending time point are generated by an external first sensing assembly responding to the touch control mechanism to trigger the touch control operation on the touch control screen; and

the second acquisition module is used for acquiring a first time point of a touch event generated by the touch screen based on the touch operation;

the third acquisition module is used for acquiring a second time point when the touch screen responds to the touch event and generates display change;

and the determining module is used for determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the second time point.

10. An electronic device, comprising a processor, and a memory and a touch screen coupled to the processor, the memory having stored therein a computer program, the processor being configured to execute the computer program to implement the method of any of claims 1-8.

11. A device for measuring response time of touch operation, the device comprising:

the electronic equipment comprises a touch screen;

the first sensing assembly is in communication connection with the electronic equipment and is used for sending a trigger starting time point and a trigger ending time point generated by responding to the touch mechanism to trigger touch operation on the touch screen to the electronic equipment;

the electronic equipment is used for acquiring a first time point of a touch event generated by the touch screen based on the touch operation; acquiring a second time point when the touch screen responds to the touch event and generates display change; and determining a first response time corresponding to the touch operation based on the trigger starting time point, the trigger ending time point, the first time point and the second time point.

12. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which, when executed by a processor, implements the method according to any one of claims 1-8.