CN114792313A - Touch detection method, device, equipment and storage medium - Google Patents
Touch detection method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN114792313A CN114792313A CN202210701915.XA CN202210701915A CN114792313A CN 114792313 A CN114792313 A CN 114792313A CN 202210701915 A CN202210701915 A CN 202210701915A CN 114792313 A CN114792313 A CN 114792313A
- Authority
- CN
- China
- Prior art keywords
- touch
- detection
- display screen
- detected
- touch position
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 371
- 238000000034 method Methods 0.000 claims abstract description 24
- 238000006243 chemical reaction Methods 0.000 claims description 11
- 238000012795 verification Methods 0.000 claims description 11
- 238000011897 real-time detection Methods 0.000 claims description 8
- 238000005259 measurement Methods 0.000 abstract description 5
- 238000012360 testing method Methods 0.000 description 20
- 238000004891 communication Methods 0.000 description 10
- 238000002372 labelling Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000004044 response Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30204—Marker
Abstract
The invention discloses a touch detection method, a touch detection device, touch detection equipment and a storage medium, wherein the method comprises the following steps: the method comprises the steps of obtaining a detection image corresponding to a display screen to be detected, determining a detection track based on the detection image, executing touch operation on the display screen to be detected according to the detection track, obtaining an actual touch position when the touch operation is executed, receiving a detection touch position fed back by the display screen to be detected, and generating a touch detection result of the display screen to be detected based on the actual touch position and the detection touch position. Because the touch operation is executed on the display screen to be detected through the detection track, and then the touch detection result of the display screen to be detected is generated according to the actual touch position and the detection touch position corresponding to the touch operation, compared with the method for performing touch detection on the display screen through a finger or a touch pen in the prior art, the touch detection method reduces artificial interference, thereby improving the accuracy of measurement.
Description
Technical Field
The invention relates to the technical field of display screens, in particular to a touch detection method, a touch detection device, touch detection equipment and a storage medium.
Background
Along with the development of intellectualization and science and technology of the automobile industry, the display screen is increasingly applied to the vehicle-mounted interior, the display screen is used as a window for man-machine interaction, and the accuracy and the real-time performance of touch response can directly influence the experience of a user.
In a conventional test, a tester touches an application program of a display screen with a finger or a stylus, the application program performs response processing, and the tester judges whether the application program responds to touch operation according to changes of an interface. In the prior art, the test method uses an application program of a finger or a touch pen to touch a display screen in the test process, interference of human factors occurs, and measurement is inaccurate.
The above is only for the purpose of assisting understanding of the technical solution of the present invention, and does not represent an admission that the above is the prior art.
Disclosure of Invention
The invention mainly aims to provide a touch detection method, a touch detection device, touch detection equipment and a storage medium, and aims to solve the technical problem that in the prior art, when a finger or a touch pen is used for performing touch detection on a display screen, interference of human factors exists, and therefore measurement is inaccurate.
In order to achieve the above object, the present invention provides a touch detection method, including the steps of:
acquiring a detection image corresponding to a display screen to be detected, and determining a detection track based on the detection image;
executing touch operation on the display screen to be detected according to the detection track, and acquiring an actual touch position when the touch operation is executed;
receiving a detection touch position fed back by the display screen to be detected;
and generating a touch detection result of the display screen to be detected based on the actual touch position and the detection touch position.
Optionally, the step of obtaining a detection image corresponding to the display screen to be detected and determining a detection track based on the detection image includes:
acquiring a detection image corresponding to a display screen to be detected, and identifying the position of a pixel annotation point in the detection image;
converting the pixel marking point position into a display screen marking point position;
and when the position of the mark point of the display screen meets a preset precision condition, determining a detection track based on the detection image.
Optionally, when the position of the display screen annotation point meets a preset precision condition, the step of determining a detection track based on the detection image includes:
when the position of the marking point of the display screen meets a preset precision condition, acquiring a serial number of a marking point in the detection image;
acquiring a marking point corresponding to the marking point serial number, and acquiring a marking coordinate of the marking point;
performing coordinate conversion on the labeling coordinates to obtain world coordinates corresponding to the labeling points;
and determining a detection track based on the world coordinates corresponding to the marking points.
Optionally, after the step of generating the touch detection result of the display screen to be detected based on the actual touch position and the detected touch position, the method further includes:
and when the marking point sequence number is smaller than a preset sequence number, adjusting the marking point sequence number, and returning to the step of acquiring the marking point sequence number in the detection image when the marking point position of the display screen meets a preset precision condition until the marking point sequence number is larger than or equal to the preset sequence number.
Optionally, the step of generating a touch detection result of the display screen to be detected based on the actual touch position and the detected touch position includes:
taking the distance from the detected touch position to the actual touch position as a first touch distance;
taking the distance from the detection touch position to the detection track as a second touch distance;
detecting whether the display screen to be detected meets the accuracy requirement or not according to the first touch distance and the second touch distance;
and generating a touch detection result of the display screen to be detected according to the accuracy detection result.
Optionally, the step of generating a touch detection result of the display screen to be detected based on the actual touch position and the detected touch position includes:
when the detected touch position is a detected track end position, acquiring actual touch time of the touch operation, and acquiring detected touch time fed back by the display screen to be detected;
detecting whether the display screen to be detected meets the real-time requirement or not according to the actual touch time and the detection touch time;
and generating a touch detection result of the display screen to be detected according to the real-time detection result, the actual touch position and the detection touch position.
Optionally, before the step of obtaining a detection image corresponding to the display screen to be detected and determining a detection track based on the detection image, the method further includes:
acquiring information of a display screen to be tested, and verifying the display screen to be tested according to the information of the display screen to be tested;
and after the verification is passed, sending a detection instruction carrying a detection image to the display screen to be detected so that the display screen to be detected displays the detection image according to the detection instruction.
In addition, to achieve the above object, the present invention further provides a touch detection device, including:
the detection track determining module is used for acquiring a detection image corresponding to the display screen to be detected and determining a detection track based on the detection image;
the actual touch position acquisition module is used for executing touch operation on the display screen to be detected according to the detection track and acquiring an actual touch position when the touch operation is executed;
the detection touch position receiving module is used for receiving a detection touch position fed back by the display screen to be detected;
and the detection result generation module is used for generating a touch detection result of the display screen to be detected based on the actual touch position and the detection touch position.
In addition, to achieve the above object, the present invention further provides a touch detection device, including: a memory, a processor and a touch detection program stored on the memory and executable on the processor, the touch detection program being configured to implement the steps of the touch detection method as described above.
In addition, to achieve the above object, the present invention further provides a storage medium, where a touch detection program is stored, and the touch detection program implements the steps of the touch detection method as described above when executed by a processor.
According to the method, a detection image corresponding to the display screen to be detected is obtained, and a detection track is determined based on the detection image; performing touch operation on the display screen to be detected according to the detection track, and acquiring an actual touch position when the touch operation is performed; receiving a detection touch position fed back by a display screen to be detected; and generating a touch detection result of the display screen to be detected based on the actual touch position and the detection touch position. Because the touch operation is executed on the display screen to be detected through the detection track, and then the touch detection result of the display screen to be detected is generated according to the actual touch position and the detection touch position corresponding to the touch operation, compared with the method for performing touch detection on the display screen through a finger or a touch pen in the prior art, the touch detection method reduces artificial interference, thereby improving the accuracy of measurement.
Drawings
Fig. 1 is a schematic structural diagram of a touch detection device in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a schematic flowchart illustrating a touch detection method according to a first embodiment of the present invention;
FIG. 3 is a flowchart illustrating a touch detection method according to a second embodiment of the present invention;
FIG. 4 is a schematic diagram illustrating identification information of a detected image according to a first embodiment of the present invention;
FIG. 5 is a flowchart illustrating a touch detection method according to a third embodiment of the present invention;
fig. 6 is a block diagram of a touch detection device according to a first embodiment of the invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a touch detection device in a hardware operating environment according to an embodiment of the present invention.
As shown in fig. 1, the touch detection apparatus may include: a processor 1001, such as a Central Processing Unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to implement connection communication among these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (Wi-Fi) interface). The Memory 1005 may be a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as a disk Memory. The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the configuration shown in fig. 1 does not constitute a limitation of the touch detection device, and may include more or fewer components than those shown, or some components in combination, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a storage medium, may include therein an operating system, a network communication module, a user interface module, and a touch detection program.
In the touch detection device shown in fig. 1, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 of the touch detection device of the present invention may be disposed in the touch detection device, and the touch detection device calls the touch detection program stored in the memory 1005 through the processor 1001 and executes the touch detection method provided by the embodiment of the present invention.
An embodiment of the invention provides a touch detection method, and referring to fig. 2, fig. 2 is a flowchart illustrating a touch detection method according to a first embodiment of the invention.
In this embodiment, the touch detection method includes the following steps:
step S10: and acquiring a detection image corresponding to the display screen to be detected, and determining a detection track based on the detection image.
It should be noted that the main body of the touch detection method in this embodiment may be a touch detection device with data processing, network communication, and program running functions, for example, a mobile phone, a tablet computer, a personal computer, and the like, and may also be other electronic devices capable of implementing the same or similar functions.
It can be understood that the display screen to be detected is the display screen required to be detected, and can display a detection image.
It should be noted that the detection image may be an image for detecting the touch accuracy of the display screen to be detected, and the detection image may be displayed after the display screen to be detected is powered on. The detection image can be prestored in the display screen to be detected by a worker according to the touch detection requirement, and can also be acquired from the cloud end in a binary instruction form through the Ethernet and transmitted to the display screen to be detected when the touch detection equipment is started.
It can be understood that the detection track may be a motion track of the touch detection device during the touch detection operation.
In a specific implementation, the touch detection device may acquire a detection image displayed in the display screen to be detected through the industrial camera, identify identification information in the detection image, and determine the detection track according to the identification information.
It should be understood that the industrial camera may be provided inside the touch detection device through a Software Development Kit (SDK) interface for acquiring the detection image.
Further, in order to ensure that the display screen to be detected is the display screen that needs to be detected, and improve reliability of touch detection, before step S10, in this embodiment, the method further includes:
step S01: and acquiring information of the display screen to be tested, and verifying the display screen to be tested according to the information of the display screen to be tested.
It should be noted that the information of the display screen to be detected may include an identification serial Number (PSN) and a version Number, where the PSN may be used to identify each display screen to determine whether the display screen to be detected is a display screen that needs to be detected, and the version Number may be used to represent a system version of the display screen to be detected to determine whether the system version of the display screen to be detected is a preset version.
Understandably, the display screen to be detected can be connected with the touch detection equipment through the serial communication bus.
In specific implementation, the touch detection device can be connected with the cloud server when being started, information required for detection is acquired from the cloud server, the information comprises the PSN and the version number of the display screen to be detected, the information of the display screen to be detected is read through the serial communication bus, and the PSN and the version number in the information of the display screen to be detected are verified with the PSN and the version number acquired from the cloud server.
It should be understood that the cloud server contains a series of detection data related to touch detection, and the data includes the above-mentioned display screen information. Technicians can construct corresponding detection images and corresponding touch control test standards according to the display information of the display screen to be tested.
Step S02: and after the verification is passed, sending a detection instruction carrying a detection image to the display screen to be detected so that the display screen to be detected displays the detection image according to the detection instruction.
In specific implementation, when the PSN and the version number in the information of the display screen to be detected are consistent with those in the cloud server, the verification is passed, the detection touch device can send a detection instruction carrying a detection image to the display screen to be detected, and the display screen to be detected can display the detection image according to the instruction.
It should be understood that when the PSN and the version number in the information of the display screen to be tested are consistent with those in the cloud server, the verification fails, the touch detection device prompts that the verification fails, the touch detection fails at this time, and test data and test results are uploaded to the cloud server.
The touch detection device can be used for verifying the display screen to be detected through communication with the cloud end, and sending a detection instruction carrying a detection image to the display screen to be detected after the verification is passed, so that the display screen to be detected displays the detection image according to the detection instruction.
Step S20: and executing touch operation on the display screen to be detected according to the detection track, and acquiring an actual touch position when the touch operation is executed.
In a specific implementation, the touch detection device may move on the display screen to be detected according to a route corresponding to the detection track through a touch head on the internal mechanical arm, record and store motion track information in the touch operation process in real time, and read an actual touch position in the motion track information at a preset period (e.g., 10 ms).
It should be understood that the actual touch position may be an actual position corresponding to the touch head on the robot arm during movement, and is stored in the movement track information in the form of coordinate data.
It can be understood that the robot arm may be disposed inside the touch detection device through the SDK interface, and is configured to perform a touch operation when the touch detection device detects the touch operation.
Step S30: and receiving a detection touch position fed back by the display screen to be detected.
It should be noted that the detected touch position is an actual detected position of the display screen to be detected, which is responded by the touch operation of the touch detection device.
In a specific implementation, when a mechanical arm of the touch detection device performs a touch operation on a display screen to be detected, the display screen to be detected can respond to the touch operation to generate corresponding detection touch data, and the detection touch data is fed back to the touch detection device through a serial communication bus, and the touch detection device can receive the detection touch data fed back by the display screen to be detected and read a detection touch position in the detection touch data.
Step S40: and generating a touch detection result of the display screen to be detected based on the actual touch position and the detection touch position.
It should be noted that, if the actual touch position coincides with the detected touch position, the state is an ideal state, and the touch accuracy of the display screen to be detected can be judged to meet the requirement, if the actual touch position deviates from the detected touch position, the deviation is judged, and if the deviation is lower than the preset touch accuracy condition, the accuracy can be judged to meet the requirement.
It can be understood that the preset touch precision condition may be a condition preset in the touch detection device by a technician for determining whether the precision meets the requirement, and the preset touch precision may be a specific numerical value.
In concrete realization, touch-control detection equipment can be to actual touch-control position and the coordinate that detects the touch-control position ask for the difference, if this difference is less than when predetermineeing the precision, then can judge that the accuracy of the display screen that awaits measuring meets the requirements, and generate this judged result as the testing result, if this difference is greater than when predetermineeing the precision, can judge that the accuracy of the display screen that awaits measuring does not meet the requirements, touch-control detection equipment suggestion verification fails, this time touch-control detection fails, upload test data and test result to high in the clouds server.
In the embodiment, a detection track is determined by acquiring a detection image corresponding to a display screen to be detected and based on the detection image; performing touch operation on the display screen to be detected according to the detection track, and acquiring an actual touch position when the touch operation is performed; receiving a detection touch position fed back by a display screen to be detected; and generating a touch detection result of the display screen to be detected based on the actual touch position and the detection touch position. Because the touch operation is performed on the display screen to be detected through the detection track, and the touch detection result of the display screen to be detected is generated according to the actual touch position and the detection touch position corresponding to the touch operation, compared with the method for performing touch detection on the display screen through a finger or a stylus in the prior art, the touch detection method reduces human interference, and thus improves the accuracy of measurement.
Referring to fig. 3, fig. 3 is a flowchart illustrating a touch detection method according to a second embodiment of the invention.
Based on the first embodiment, in this embodiment, in order to avoid the detection image being displayed in the display screen to be detected with a wrong position, the step S10 may include:
step S101: and acquiring a detection image corresponding to the display screen to be detected, and identifying the position of a pixel annotation point in the detection image.
The detection image may include identification information for identifying the touch detection device, and referring to fig. 4, fig. 4 is the identification information of the detection image, and the identification information may include annotation points P0 (X0, Y0), P1 (X1, Y1), P2 (X2, Y2) and P3 (X3, Y3) located at vertices of a rectangle of the detection image, where P is an annotation point, 0 to 3 are annotation point numbers, and X0, Y0 to (X3, Y3) are annotation point coordinates. Fig. 4 is an identification information of a detected image, which is not limited to the above, and may be adjusted according to a detection requirement, and fig. 4 is taken as an example in this embodiment and the following embodiments.
It should be noted that the touch detection device obtains a detection image in the display screen to be detected through the industrial camera, so that the annotation point is in a form corresponding to the camera coordinate system.
In specific implementation, the touch detection device can obtain a detection image through an industrial camera, and call an image recognition algorithm to recognize the detection image, firstly recognize a vertex in the detection image, then recognize a mark point in the detection image, obtain a camera mark point position under an industrial camera coordinate system, and then convert the camera mark point position into a pixel mark point position in a pixel form.
Furthermore, the touch detection device can acquire camera parameters from the cloud, determine a coordinate conversion formula according to the camera parameters, and convert the position of the camera annotation point into the position of a pixel annotation point in a pixel form according to the coordinate conversion formula.
When the pixel labeling point is converted, the world coordinate and the image coordinate system of the labeling point are obtained first, and the corresponding conversion formula is as follows.
The conversion formula of the world coordinate system and the camera coordinate system is as follows:
wherein X w 、Y w And Z w Value, X, representing world coordinate corresponding to the location of the annotation point c 、Y c And Z c Representing the coordinate value of the camera mark point corresponding to the mark point position, R representing a rotation matrix, t x 、t y And t z And the offset vectors x, y and z of the annotation point under the image coordinate are represented, and the value of the annotation point corresponding to the image coordinate is represented. The world coordinate system is an absolute coordinate system of the system, coordinates of all points on a picture are determined by the origin of the coordinate system before the camera coordinate system is established, the camera coordinate system is a coordinate system of the annotation point under camera parameters, and the image coordinate system is a coordinate system of the annotation point under a camera image.
The conversion formula of the camera coordinate system and the image coordinate system is as follows:
wherein X and y represent the value of the image coordinate corresponding to the position of the mark point, f represents the focal length, and X c 、Y c And Z c And representing the value of the coordinate of the camera marking point corresponding to the marking point position.
The conversion formula of the image coordinate system and the pixel coordinate system is as follows:
wherein u and v represent the values of the pixel coordinates corresponding to the marking point position, p (u, v) represents the pixel coordinates corresponding to the marking point position, f x Representing the focal length, f, corresponding to the x value of the image coordinate y Denotes the focal length, u, corresponding to the y value of the image coordinate 0 And v 0 Denotes an offset, X w 、Y w And Z w And representing the value of the world coordinate corresponding to the position of the marked point.
Step S102: and converting the pixel marking point position into a display screen marking point position.
It should be noted that the pixel coordinate is a position coordinate in the camera, and it needs to be converted into a display screen coordinate that can be recognized by the display screen to determine whether the display position of the detection image in the display screen to be detected is correct.
It can be understood that the conversion between the pixel coordinate and the display screen coordinate needs to use the world coordinate, and the world coordinate system and the pixel coordinate system can also be converted according to the following formula:
wherein:
wherein, X w 、Y w And Z w Representing the world coordinate value corresponding to the mark point position, u and v representing the pixel coordinate value corresponding to the mark point position, R representing a rotation matrix, t representing an offset vector, f x Representing the focal length, f, corresponding to the x value of the image coordinate y And the focal distance corresponding to the y value of the image coordinate is represented.
It should be understood that, after obtaining the world coordinates, the touch detection device may obtain the size and the resolution of the display screen to be detected from the cloud, and the world coordinates and the display screen coordinates may be converted according to the following formula:
wherein, X is d And Y d Representing the position of the marking point by the value of the display screen coordinate, a and b representing the resolution of the display screen, w and h representing the size of the display screen, X w And Y w And representing the value of the world coordinate corresponding to the position of the marked point.
Step S103: and when the position of the mark point of the display screen meets a preset precision condition, determining a detection track based on the detection image.
In specific implementation, the touch detection device can acquire a display screen marking point position preset in a cloud end through the Ethernet, calculate a distance between a coordinate corresponding to the display screen marking point position and a coordinate corresponding to the cloud end display screen marking point position, and when the distance meets a preset precision condition, indicate that the position of the display screen to be detected is accurately introduced, and at the moment, the detection track can be determined based on identification information of a detection image.
It should be understood that if the distance does not meet the preset precision condition, it indicates that an error is introduced into the position of the display screen to be detected, the touch detection device may acquire the detection image again to identify the detection image, and after the detection image is continuously repeated for a preset number of times (for example, 3 times), the touch detection device prompts that the verification fails, and when the touch detection fails, the touch detection device uploads the test data and the test result to the cloud server. The preset times can be set according to actual detection requirements.
Further, in order to improve the accuracy of acquiring the detection track, step 103 in this embodiment may include:
step S1031: and when the position of the marking point of the display screen meets the preset precision condition, acquiring the serial number of the marking point in the detection image.
Note that, referring to the identification information in the detection image described in fig. 4, the scribe line may be any two adjacent marking points in fig. 4.
It can be understood that the touch detection device may select one of the two adjacent mark points in fig. 4 as an initial scribe point (start point) and the other mark point as a secondary scribe point (end point) to scribe a line, so as to form a detection track of the touch detection device, for example, if a line is scribed by selecting P0 as the start point and P1 as the end point, P0 is an initial scribe point, P1 is a secondary scribe point, and a connection line between P0 and P1 is a detection track.
In a specific implementation, when the position of the marking point on the display screen meets a preset accuracy condition, the touch detection device may select any two adjacent marking point serial numbers (e.g., 0 and 1), and obtain marking points (e.g., P0 and P1) corresponding to the serial numbers.
Step S1032: and acquiring a marking point corresponding to the marking point serial number, and acquiring a marking coordinate of the marking point.
In a specific implementation, the touch detection device may obtain corresponding annotation points (e.g., P0 and P1, where P0 may be used as an initial line drawing point and P1 may be used as a secondary line drawing point) according to the serial numbers (e.g., 0 and 1) of the line drawing points, and obtain annotation coordinates of the annotation points, such as P0 (X0, Y0), and P1 (X1, Y1).
Step S1033: and carrying out coordinate conversion on the labeling coordinates to obtain world coordinates corresponding to the labeling points.
In a specific implementation, the touch detection device may convert the annotation coordinates of the annotation points into corresponding world coordinates according to the above conversion formula.
Step S1034: and determining a detection track based on the world coordinates corresponding to the marking points.
In a specific implementation, the touch detection device may select one of two adjacent marked points in fig. 4 as an initial line drawing point (starting point), and the other as a secondary line drawing point (end point) to draw a line, so as to form a detection track of the touch detection device, for example, if the line is drawn by selecting P0 as the starting point and P1 as the end point, then P0 is the initial line drawing point, P1 is the secondary line drawing point, and a connection line between P0 and P1 is the detection track.
According to the embodiment, the detection track of the touch detection equipment is determined by detecting the world coordinates corresponding to the mark points in the image, so that the problem that the position introduced by the detection track is inaccurate due to the fact that the detection track is determined directly by the pixel coordinates is avoided, and the accuracy of touch detection is improved.
Further, in order to make the touch detection data more comprehensive and improve the accuracy of the test, in this embodiment, after the step S40, the method further includes:
step S50: and when the marking point sequence number is smaller than a preset sequence number, adjusting the marking point sequence number, and returning to the step of acquiring the marking point sequence number in the detection image when the marking point position of the display screen meets a preset precision condition until the marking point sequence number is larger than or equal to the preset sequence number.
It should be noted that the number of annotation points in the detection image is limited, that is, the number of scribe lines is lower than a preset value, where the preset value is the maximum value of the annotation point number or the scribe line number, for example, referring to fig. 4, if the detection image has 4 annotation points P0, P1, P2, and P3, the preset value is 3.
In a specific implementation, the touch detection device may perform determination after generating the detection result, determine whether the selected scribing point reaches a preset value 3, and if the scribing point is lower than the preset value 3, add 1 to the scribing point to obtain a new scribing point, and continue to perform the step S1031 and subsequent touch detection steps. When the serial number of the line marking points reaches a preset value, the touch detection equipment judges that the line marking points are selected, stops touch operation, and uploads test data and test results to the cloud server. For example, if the initial scribe points P0 and P1 do not exceed the preset values, the scribe points are added by 1 to obtain new scribe points P1 and P2, and the touch detection steps in step S1031 and thereafter are continuously performed until the scribe points P2 and P3 (because the scribe points P2 and P3 are the final scribe points because the scribe points P3 added by 1 are P4 exceeding the preset value 3), the touch detection device terminates the touch operation, and uploads the test data and the test results to the cloud server.
In the above manner of this embodiment, when the detection result is generated, if the serial number of the scribe line is not selected, a new serial number of the scribe line is generated by self-addition, so that the touch detection data is further more comprehensive, and the accuracy of the test is improved.
Referring to fig. 5, fig. 5 is a flowchart illustrating a touch detection method according to a third embodiment of the invention.
Based on the foregoing embodiments, in order to implement the accuracy detection of the display screen to be detected, in this embodiment, step S40 may include:
step S401: and taking the distance from the detected touch position to the actual touch position as a first touch distance.
It should be noted that the first touch distance may be a distance between a coordinate corresponding to the detected touch position and a coordinate corresponding to the actual touch position, or may be a linear distance between the detected touch position and the actual touch position.
It can be understood that the detected touch position is a touch position displayed on the display screen to be detected, the actual touch position is a position of a touch head of the touch detection device, the detected touch position and the actual touch position should be consistent in an ideal state, and in an actual situation, a deviation occurs when the touch head of the touch detection device touches the display screen to be detected, which is also one of reasons for influencing accuracy, and if the deviation of the distance between the detected touch position and the detection track (the first touch distance) is lower than a preset accuracy condition, it can be determined that the detected touch position and the actual touch position are approximately coincident.
Step S402: and taking the distance from the detection touch position to the detection track as a second touch distance.
The second touch distance may be a distance from a coordinate corresponding to the detected touch position to the detected track, or a straight-line distance from the detected touch position to the detected track.
It can be understood that the detected touch position is a touch position displayed on the display screen to be detected, and the detected touch position should coincide with the detected track in an ideal state, and in an actual situation, a touch head of the touch detection device may deviate when touching the display screen to be detected, and further the detected track and the detected touch position may deviate, that is, one of the reasons affecting the accuracy, and if the deviation of the distance between the detected touch position and the detected track (the second touch distance) is lower than the preset accuracy condition, it may be determined that the detected touch position approximately falls on the detected track.
Step S403: and detecting whether the display screen to be detected meets the accuracy requirement or not according to the first touch distance and the second touch distance.
It should be noted that, through the above analysis, when both the first touch distance and the second touch distance are lower than the preset precision condition (the preset precision condition may be a specific numerical value), it may be determined that the detected touch position is approximately overlapped with the actual touch position, and the detected touch position approximately falls on the detection track, that is, the accuracy of the display screen to be detected meets the requirement.
It can be understood that when the first touch distance and the second touch distance reach the preset precision condition, the accuracy can be judged not to meet the requirement, the touch detection equipment prompts that the verification fails, the touch detection fails at the time, and test data and test results are uploaded to the cloud server.
Step S404: and generating a touch detection result of the display screen to be detected according to the accuracy detection result.
In specific implementation, the touch detection device can take the detection result as a touch detection result of the display screen to be detected, and upload the touch detection result to the cloud server.
It should be understood that, the generating of the touch detection result of the display screen to be detected according to the accuracy detection result may be directly taking the accuracy detection result as the touch detection result of the display screen to be detected, or may further perform real-time detection on the display screen to be detected, and taking the accuracy detection result and the real-time detection result as the touch detection result of the display screen to be detected.
Further, to implement real-time detection of the display screen to be detected, step S40 may include:
step S401': and when the detected touch position is the detected track end position, acquiring the actual touch time of the touch operation, and acquiring the detected touch time fed back by the display screen to be detected.
In a specific implementation, the touch detection device may obtain an actual touch initial time at the moment when the touch head (as described above, a position where the touch head moves on the display screen to be detected is a detected touch position) starts to move on the display screen to be detected according to the detection track, obtain an actual touch end time at the moment when the touch head moves to a detection track end point on the display screen to be detected, and determine the actual touch time of the touch operation according to the detected touch initial time and the detected touch end time. Similarly, the display screen to be detected can also respond according to the motion of the touch head, record the detection touch start time when the touch head starts to move and the detection touch end time when the touch head stops moving, determine the detection touch time according to the detection touch start time and the detection touch end time, and send the detection touch time to the touch detection equipment through the Ethernet.
Step S402': and detecting whether the display screen to be detected meets the real-time requirement or not according to the actual touch time and the detection touch time.
It should be noted that the actual touch time when the touch detection device performs the touch operation and the detection touch time responded by the display screen to be detected should be ideally consistent, and in an actual situation, the actual touch time and the detection touch time have a deviation, so that the real-time property of the display screen to be detected needs to be detected.
It can be understood that when the deviation between the actual touch time and the detected touch time is lower than the preset response time, the touch detection device can determine that the actual touch time and the detected touch time are consistent, and the real-time performance of the display screen to be detected meets the requirement. Further, when the deviation between the actual touch time and the detected touch time reaches the preset response time, the touch detection equipment judges that the real-time performance does not meet the requirement, prompts that the verification fails, and uploads the test data and the test result to the cloud server when the touch detection fails.
It should be understood that the preset response time may be a time preset in the cloud for determining real-time performance. The touch detection equipment can select corresponding preset corresponding time from the cloud according to the information of the display screen to be detected.
Step S403': and generating a touch detection result of the display screen to be detected according to the real-time detection result, the actual touch position and the detection touch position.
In specific implementation, the touch detection device can generate a touch detection result of the display screen to be detected according to the real-time detection result and an accuracy judgment result determined by the actual touch position and the detected touch position, and upload the touch detection result to the cloud server.
According to the embodiment, the accuracy detection is realized by detecting whether the touch position, the actual touch position and the detection track meet the preset accuracy condition, and correspondingly, the real-time detection is realized by detecting whether the actual touch time and the detection touch time meet the preset response time.
In addition, an embodiment of the present invention further provides a storage medium, where a touch detection program is stored on the storage medium, and the touch detection program, when executed by a processor, implements the steps of the touch detection method described above.
Referring to fig. 6, fig. 6 is a block diagram of a touch detection device according to a first embodiment of the invention.
As shown in fig. 6, the touch detection device according to the embodiment of the present invention includes:
a detection track determining module 501, configured to obtain a detection image corresponding to a display screen to be detected, and determine a detection track based on the detection image;
an actual touch position obtaining module 502, configured to perform a touch operation on the display screen to be tested according to the detection track, and obtain an actual touch position when the touch operation is performed;
a detection touch position receiving module 503, configured to receive a detection touch position fed back by the display screen to be detected;
a detection result generating module 504, configured to generate a touch detection result of the display screen to be detected based on the actual touch position and the detected touch position.
In the embodiment, a detection image corresponding to a display screen to be detected is obtained, and a detection track is determined based on the detection image; performing touch operation on the display screen to be detected according to the detection track, and acquiring an actual touch position when the touch operation is performed; receiving a detection touch position fed back by a display screen to be detected; and generating a touch detection result of the display screen to be detected based on the actual touch position and the detection touch position. In the embodiment, the touch operation is performed on the display screen to be detected through the detection track, and then the touch detection result of the display screen to be detected is generated according to the actual touch position and the detection touch position corresponding to the touch operation.
Other embodiments or specific implementations of the touch detection device of the present invention may refer to the above method embodiments, and are not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the description of the foregoing embodiments, it is clear to those skilled in the art that the method of the foregoing embodiments may be implemented by software plus a necessary general hardware platform, and certainly may also be implemented by hardware, but in many cases, the former is a better implementation. Based on such understanding, the technical solutions of the present invention or portions thereof contributing to the prior art may be embodied in the form of a software product, where the computer software product is stored in a storage medium (such as a rom/ram, a magnetic disk, and an optical disk), and includes several instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A touch detection method is characterized by comprising the following steps:
acquiring a detection image corresponding to a display screen to be detected, and determining a detection track based on the detection image;
performing touch operation on the display screen to be detected according to the detection track, and acquiring an actual touch position when the touch operation is performed;
receiving a detection touch position fed back by the display screen to be detected;
and generating a touch detection result of the display screen to be detected based on the actual touch position and the detection touch position.
2. The touch detection method according to claim 1, wherein the step of obtaining a detection image corresponding to the display screen to be detected and determining the detection track based on the detection image includes:
acquiring a detection image corresponding to a display screen to be detected, and identifying the position of a pixel annotation point in the detection image;
converting the pixel marking point position into a display screen marking point position;
and when the position of the mark point of the display screen meets a preset precision condition, determining a detection track based on the detection image.
3. The touch detection method according to claim 2, wherein the step of determining a detection track based on the detection image when the position of the display screen annotation point meets a preset precision condition includes:
when the position of the marking point of the display screen meets a preset precision condition, acquiring a serial number of a marking point in the detection image;
acquiring a marking point corresponding to the marking point serial number, and acquiring a marking coordinate of the marking point;
performing coordinate conversion on the marked coordinates to obtain world coordinates corresponding to the marked points;
and determining a detection track based on the world coordinates corresponding to the marking points.
4. The touch detection method of claim 3, wherein after the step of generating the touch detection result of the display screen to be detected based on the actual touch position and the detected touch position, the method further comprises:
and when the scribing point sequence number is smaller than a preset sequence number, adjusting the scribing point sequence number, and returning to the step of acquiring the scribing point sequence number in the detection image when the position of the marking point on the display screen meets the preset precision condition until the scribing point sequence number is larger than or equal to the preset sequence number.
5. The touch detection method according to any one of claims 1 to 4, wherein the step of generating the touch detection result of the display screen to be detected based on the actual touch position and the detected touch position comprises:
taking the distance from the detected touch position to the actual touch position as a first touch distance;
taking the distance from the detection touch position to the detection track as a second touch distance;
detecting whether the display screen to be detected meets the accuracy requirement or not according to the first touch distance and the second touch distance;
and generating a touch detection result of the display screen to be detected according to the accuracy detection result.
6. The touch detection method according to any one of claims 1 to 4, wherein the step of generating the touch detection result of the display screen to be detected based on the actual touch position and the detected touch position comprises:
when the detected touch position is a detected track end position, acquiring actual touch time of the touch operation, and acquiring detected touch time fed back by the display screen to be detected;
detecting whether the display screen to be detected meets the real-time requirement or not according to the actual touch time and the detection touch time;
and generating a touch detection result of the display screen to be detected according to the real-time detection result, the actual touch position and the detection touch position.
7. The touch detection method according to any one of claims 1 to 4, wherein before the step of obtaining a detection image corresponding to the display screen to be detected and determining a detection track based on the detection image, the method further comprises:
acquiring information of a display screen to be tested, and verifying the display screen to be tested according to the information of the display screen to be tested;
and after the verification is passed, sending a detection instruction carrying a detection image to the display screen to be detected so that the display screen to be detected displays the detection image according to the detection instruction.
8. A touch detection device, the device comprising:
the detection track determining module is used for acquiring a detection image corresponding to the display screen to be detected and determining a detection track based on the detection image;
the actual touch position acquisition module is used for executing touch operation on the display screen to be detected according to the detection track and acquiring an actual touch position when the touch operation is executed;
the detection touch position receiving module is used for receiving a detection touch position fed back by the display screen to be detected;
and the detection result generation module is used for generating a touch detection result of the display screen to be detected based on the actual touch position and the detection touch position.
9. A touch detection device, the device comprising: a memory, a processor and a touch detection program stored on the memory and executable on the processor, the touch detection program being configured to implement the steps of the touch detection method according to any of claims 1 to 7.
10. A storage medium having a touch detection program stored thereon, wherein the touch detection program, when executed by a processor, implements the steps of the touch detection method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210701915.XA CN114792313A (en) | 2022-06-21 | 2022-06-21 | Touch detection method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210701915.XA CN114792313A (en) | 2022-06-21 | 2022-06-21 | Touch detection method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114792313A true CN114792313A (en) | 2022-07-26 |
Family
ID=82463808
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210701915.XA Pending CN114792313A (en) | 2022-06-21 | 2022-06-21 | Touch detection method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114792313A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116204366A (en) * | 2023-05-06 | 2023-06-02 | 深圳卓创智能科技有限公司 | Tablet personal computer quality detection method, device, equipment and storage medium |
| CN117193566A (en) * | 2023-11-02 | 2023-12-08 | 广州众远智慧科技有限公司 | Touch screen detection method and device, electronic equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105302381A (en) * | 2015-12-07 | 2016-02-03 | 广州华欣电子科技有限公司 | Infrared touch screen precision adjusting method and device |
| CN106453941A (en) * | 2016-10-31 | 2017-02-22 | 努比亚技术有限公司 | Double-screen operation method and mobile terminal |
| CN107562288A (en) * | 2017-08-31 | 2018-01-09 | 广东美的制冷设备有限公司 | Response method based on infrared contactor control device, infrared contactor control device and medium |
| CN108334214A (en) * | 2017-01-19 | 2018-07-27 | 宏碁股份有限公司 | The detection method and system of touch device |
| CN108593672A (en) * | 2018-03-01 | 2018-09-28 | 深圳回收宝科技有限公司 | A kind of detection method, detection device and the storage medium of terminal touch screen |
| CN109117067A (en) * | 2017-06-26 | 2019-01-01 | 深圳回收宝科技有限公司 | The detection method and its device of terminal touch-control performance |
| CN111025039A (en) * | 2019-10-24 | 2020-04-17 | 广州视源电子科技股份有限公司 | Method, device, equipment and medium for testing accuracy of touch display screen |
| CN113986630A (en) * | 2021-10-15 | 2022-01-28 | 中航华东光电有限公司 | Touch performance test method and system of touch screen |
-
2022
- 2022-06-21 CN CN202210701915.XA patent/CN114792313A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105302381A (en) * | 2015-12-07 | 2016-02-03 | 广州华欣电子科技有限公司 | Infrared touch screen precision adjusting method and device |
| CN106453941A (en) * | 2016-10-31 | 2017-02-22 | 努比亚技术有限公司 | Double-screen operation method and mobile terminal |
| CN108334214A (en) * | 2017-01-19 | 2018-07-27 | 宏碁股份有限公司 | The detection method and system of touch device |
| CN109117067A (en) * | 2017-06-26 | 2019-01-01 | 深圳回收宝科技有限公司 | The detection method and its device of terminal touch-control performance |
| CN107562288A (en) * | 2017-08-31 | 2018-01-09 | 广东美的制冷设备有限公司 | Response method based on infrared contactor control device, infrared contactor control device and medium |
| CN108593672A (en) * | 2018-03-01 | 2018-09-28 | 深圳回收宝科技有限公司 | A kind of detection method, detection device and the storage medium of terminal touch screen |
| CN111025039A (en) * | 2019-10-24 | 2020-04-17 | 广州视源电子科技股份有限公司 | Method, device, equipment and medium for testing accuracy of touch display screen |
| CN113986630A (en) * | 2021-10-15 | 2022-01-28 | 中航华东光电有限公司 | Touch performance test method and system of touch screen |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116204366A (en) * | 2023-05-06 | 2023-06-02 | 深圳卓创智能科技有限公司 | Tablet personal computer quality detection method, device, equipment and storage medium |
| CN116204366B (en) * | 2023-05-06 | 2023-08-11 | 深圳卓创智能科技有限公司 | Tablet personal computer quality detection method, device, equipment and storage medium |
| CN117193566A (en) * | 2023-11-02 | 2023-12-08 | 广州众远智慧科技有限公司 | Touch screen detection method and device, electronic equipment and storage medium |
| CN117193566B (en) * | 2023-11-02 | 2024-03-01 | 广州众远智慧科技有限公司 | Touch screen detection method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114792313A (en) | Touch detection method, device, equipment and storage medium | |
| CN107678935B (en) | Data generation method, terminal and computer readable storage medium | |
| CN111860300A (en) | Key point detection method and device, terminal equipment and storage medium | |
| CN110226095B (en) | Universal automated testing of embedded systems | |
| CN107783898B (en) | Test method and test equipment for mobile application | |
| KR20130073621A (en) | Method for controlling flexible display in portable terminal and apparatus thereof | |
| CN112100431B (en) | Evaluation method, device and equipment of OCR system and readable storage medium | |
| CN109359043B (en) | Mobile game automatic testing method based on machine learning | |
| CN108882156B (en) | Method and device for calibrating and positioning base station coordinate system | |
| CN111027531A (en) | Pointer instrument information identification method and device and electronic equipment | |
| CN111443337A (en) | Radar-IMU calibration method based on hand-eye calibration | |
| CN112258161A (en) | Intelligent software testing system and testing method based on robot | |
| JP6525043B2 (en) | DATA GENERATION DEVICE, DATA GENERATION METHOD, AND PROGRAM | |
| CN113553261A (en) | Software automation test method, equipment and computer readable storage medium | |
| CN110779460B (en) | Offline guidance device, measurement control device, and storage medium | |
| US20130093698A1 (en) | Contact detecting device, record display device, non-transitory computer readable medium, and contact detecting method | |
| CN111143912A (en) | Display labeling method and related product | |
| CN110704252A (en) | Automatic testing device and testing method based on cloud dynamic management | |
| CN102262456A (en) | Information input device and method | |
| CN110953989B (en) | Method, device, equipment and medium for measuring product mark position deviation | |
| CN111124862A (en) | Intelligent equipment performance testing method and device and intelligent equipment | |
| JP7169922B2 (en) | Information processing system and program | |
| JP7316134B2 (en) | POSITION AND POSTURE IDENTIFICATION APPARATUS, POSITION AND POSTURE IDENTIFICATION METHOD, AND POSITION AND POSTURE IDENTIFICATION PROGRAM | |
| CN116631065B (en) | Gesture recognition method and device | |
| JP2023065278A (en) | Pointing-out support device, pointing-out support method and pointing-out support program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220726 |
|
| RJ01 | Rejection of invention patent application after publication |