CN105786336A - Method, device and system for evaluating fluency of terminal touch screen - Google Patents
Method, device and system for evaluating fluency of terminal touch screen Download PDFInfo
- Publication number
- CN105786336A CN105786336A CN201410806589.4A CN201410806589A CN105786336A CN 105786336 A CN105786336 A CN 105786336A CN 201410806589 A CN201410806589 A CN 201410806589A CN 105786336 A CN105786336 A CN 105786336A
- Authority
- CN
- China
- Prior art keywords
- terminal
- screen
- image
- fluency
- sliding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000011156 evaluation Methods 0.000 claims abstract description 55
- 238000012545 processing Methods 0.000 claims description 30
- 238000010586 diagram Methods 0.000 description 4
- 239000000203 mixture Substances 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method for evaluating the fluency of a terminal touch screen. The method comprises the following steps: obtaining a sliding image of a specified icon in the terminal screen; and analyzing the image to obtain an evaluation parameter for evaluating the fluency of the terminal touch screen. The invention further discloses a device and a system for evaluating the fluency of the terminal touch screen.
Description
Technical Field
The invention relates to a terminal screen evaluation technology, in particular to a method, a device and a system for evaluating fluency of a terminal touch screen.
Background
With the rapid development of the touch screen technology, the touch screen is more and more applied in daily life of people, and the touch screen not only can meet the requirement of people for quickly searching useful information, but also has the advantages of high response speed, space saving and the like; the most direct communication bridge between human and machine, namely the terminal screen, has very important influence on the terminal as the window of the intelligent mobile terminal.
Therefore, technologies and tools for detecting the performance of the touch screen continuously appear, and the traditional touch screen test mainly focuses on the hardware performances such as sensitivity, linearity and pressure resistance; however, in the process of using the terminal screen, the problems that the screen lag, the screen jam, the unsmooth and the like affect the user perception are more encountered, and therefore, providing a technical solution capable of effectively evaluating the fluency of the terminal screen is a problem to be solved urgently.
Disclosure of Invention
In view of this, the embodiments of the present invention are expected to provide a method, an apparatus, and a system for evaluating fluency of a touch screen of a terminal, which can effectively evaluate fluency of a screen of the terminal and greatly improve user experience.
In order to achieve the above purpose, the technical solution of the embodiment of the present invention is realized as follows:
the embodiment of the invention provides a method for evaluating fluency of a terminal touch screen, which comprises the following steps:
acquiring an image of a sliding of a designated icon in a terminal screen;
and analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen.
In the above scheme, before the obtaining of the image in which the designated icon slides in the terminal screen, the method further includes:
and controlling the execution equipment to perform sliding operation on the designated icon in the terminal screen.
In the above scheme, the acquiring an image of the sliding of the designated icon in the terminal screen includes:
and acquiring a real-time image acquired by image acquisition equipment and obtained by sliding the designated icon in the terminal screen.
In the above scheme, the analyzing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen includes:
analyzing the images frame by frame to obtain the frame number of the adjacent two screen refreshing intervals of the terminal in the images, and calculating the frame number of all the intervals in the obtained images to obtain the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal; the mean square error is used for evaluating the fluency of the terminal screen.
In the above scheme, the method further comprises: and acquiring the first refreshing time delay of the terminal screen in the image, wherein the first refreshing time delay is used for assisting in evaluating the fluency of the terminal screen.
The embodiment of the invention also provides a device for evaluating the fluency of the touch screen of the terminal, which comprises: an acquisition module and a processing module; wherein,
the acquisition module is used for acquiring an image of the sliding of the designated icon in the terminal screen;
and the processing module is used for analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen.
In the above scheme, the apparatus further includes a control module, configured to control an execution device to perform a sliding operation on a designated icon in the terminal screen.
In the above scheme, the obtaining module is specifically configured to obtain a real-time image acquired by the image acquisition device and in which the designated icon slides in the terminal screen.
In the above scheme, the processing module is specifically configured to analyze the image frame by frame, acquire the number of frames in the image between two adjacent screen refreshing intervals of the terminal, and calculate the number of frames in all the acquired images to obtain a mean square error of the number of frames in the image between two adjacent screen refreshing intervals of the terminal; the mean square error is used for evaluating the fluency of the terminal screen.
In the above scheme, the processing module is further configured to obtain a first refreshing time delay of the terminal screen in the image, where the first refreshing time delay is used to assist in evaluating the fluency of the terminal screen.
The embodiment of the invention also provides a fluency evaluation system for the touch screen of the terminal, which comprises the following steps: the system comprises an execution device, an image acquisition device and a terminal touch screen fluency evaluation device; wherein,
the execution equipment is used for performing sliding operation on the designated icon in the terminal screen;
the image acquisition equipment is used for acquiring an image of sliding of a designated icon in the terminal screen and sending the image to the fluency evaluation device of the terminal touch screen;
the terminal touch screen fluency assessment device is the terminal touch screen fluency assessment device according to any one of claims 6 to 10.
According to the method, the device and the system for evaluating the fluency of the terminal touch screen, provided by the embodiment of the invention, the image of the sliding of the designated icon in the terminal screen is obtained; and analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen. Therefore, the fluency of the terminal screen can be effectively evaluated through the obtained evaluation parameters for evaluating the fluency of the terminal screen, the defects of the prior art are overcome, and the user experience is greatly improved.
Drawings
Fig. 1 is a schematic flow chart of a method for evaluating fluency of a touch screen of a terminal according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a second method for assessing fluency of a touch screen of a terminal according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a composition structure of a device for assessing fluency of a touch screen of a terminal according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a composition structure of a system for assessing fluency of a touch screen of a terminal according to an embodiment of the invention.
Detailed Description
In the embodiment of the invention, an image of sliding of a designated icon in a terminal screen is acquired; and analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen.
Fig. 1 is a schematic flow chart of a method for evaluating fluency of a touch screen of a terminal according to an embodiment of the present invention; as shown in fig. 1, a flow of a method for evaluating fluency of a touch screen of a terminal according to an embodiment of the present invention includes:
step 101: acquiring an image of a sliding of a designated icon in a terminal screen;
before this step, the method further comprises: controlling an execution device to perform sliding operation on a designated icon in the terminal screen; the method specifically comprises the following steps: sending a sliding instruction to an execution device, wherein the sliding instruction is used for controlling the execution device to perform corresponding sliding operation on a designated icon in the terminal screen;
wherein the slide instruction comprises: a slide start time, a slide trajectory, a slide speed, and the like; here, the sliding start time, the sliding track, and the sliding speed may be specifically set according to actual situations, in an embodiment, the designated icon is at the leftmost side of the terminal, and the sliding track may be sliding from left to right to the rightmost side of the screen; the sliding speed may be 300 mm/s; the designated icon can be any icon in the terminal screen;
in an embodiment of the present invention, the performing apparatus may be a robot arm.
Further, before the control execution device performs a sliding operation on the designated icon in the terminal screen, the method further includes: positioning and calibrating the position of the terminal; the method specifically comprises the following steps: the method comprises the steps of obtaining a position image of the terminal fixed on an operation desk and sent by image acquisition equipment, extracting position coordinate information of the terminal in the position image, matching the position coordinate information with preset target position information, and completing positioning and calibration of the position of the terminal when the matching is determined to be successful.
Further, the acquiring the image of the sliding of the designated icon in the terminal screen includes: acquiring a real-time image acquired by image acquisition equipment and indicating sliding of an appointed icon in the terminal screen; the method specifically comprises the following steps: sending an image acquisition instruction to the image acquisition equipment, and receiving a real-time image returned by the image acquisition equipment and indicating the sliding of the designated icon in the terminal screen; wherein the image acquisition instructions comprise: image acquisition start time;
here, the image pickup apparatus includes a high-speed camera; in one embodiment, the high speed camera may be a 100FPS high speed camera.
Step 102: analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen;
here, the evaluation parameter for evaluating the fluency of the terminal screen includes: the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal and the time delay of the first refreshing of the terminal screen;
wherein, obtaining the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal comprises:
analyzing the images frame by frame to obtain the frame number of the adjacent two screen refreshing intervals of the terminal in the images, and calculating the frame number of all the intervals in the obtained images to obtain the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal;
wherein σ is the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal, N is the acquired number of times of the two adjacent screen refreshing intervals of the terminal, μ is the average value of the frame number of the two adjacent screen refreshing intervals of the terminal for N times, and xiObtaining the number of frames between two adjacent screen refreshing intervals of the ith time of the terminal, wherein i is a positive integer, and i ∈ [1, N]And N is a positive integer.
The obtaining of the time delay of the first refreshing of the terminal screen comprises: analyzing the images frame by frame to obtain the first refreshing time of the terminal in the images, and obtaining the first refreshing time delay of the terminal screen according to the first refreshing time and the preset sliding starting time;
the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is used as a main evaluation parameter for evaluating the fluency of the terminal screen, the first refreshing time delay of the terminal screen is used as an evaluation parameter for auxiliary evaluation of the fluency of the terminal screen, and the smaller the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal and the first refreshing time delay of the terminal screen are, the higher the fluency of the screen of the terminal is; in an embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is [0, 0.6] frame, and the value range of the time delay of the first refreshing of the screen of the terminal is [0, 0.15] second.
Furthermore, the sliding instruction may further include a sliding number n, where n is a positive integer; when the sliding times are more than 1, analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen comprises the following steps:
analyzing the images frame by frame to obtain the mean square error of the frame number of the screen refreshing interval of the terminal adjacent to two times when the designated icon in the terminal screen is slid each time, and averaging the mean square error of the frame number of the screen refreshing interval of the terminal adjacent to two times when the designated icon in the terminal screen is slid for multiple times, wherein the average is used for evaluating the evaluation parameter of the fluency of the terminal screen; in one embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the average value is [0, 0.6] frame;
wherein, the mean value of the mean square error of the frame numbers of the two adjacent screen refreshing intervals of the terminal obtained by sliding the designated icon in the terminal screen for multiple times is sigmajIn order to obtain the mean square error of the number of frames between two adjacent screen refreshing intervals of the terminal when the designated icon in the screen of the terminal is slid for the jth time, wherein j is a positive integer, and j ∈ [1, n-1 ]]。
FIG. 2 is a schematic flow chart of a second method for assessing fluency of a touch screen of a terminal according to an embodiment of the present invention; as shown in fig. 2, the method for evaluating fluency of a touch screen of a second terminal according to the embodiment of the present invention includes:
step 201: controlling an execution device to perform sliding operation on a designated icon in the terminal screen;
the method specifically comprises the following steps: sending a sliding instruction to an execution device, wherein the sliding instruction is used for controlling the execution device to perform corresponding sliding operation on a designated icon in the terminal screen; wherein the slide instruction comprises: a slide start time, a slide trajectory, a slide speed, and the like;
here, the sliding start time, the sliding track, and the sliding speed may be specifically set according to actual situations, in an embodiment, the designated icon is at the leftmost side of the terminal, and the sliding track may be sliding from left to right to the rightmost side of the screen; the sliding speed may be 300 mm/s; the designated icon can be any icon in the terminal screen;
in an embodiment of the present invention, the performing apparatus may be a robot arm.
Further, before this step, the method further includes: positioning and calibrating the position of the terminal; the method specifically comprises the following steps: the method comprises the steps of obtaining a position image of the terminal fixed on an operation desk and sent by image acquisition equipment, extracting position coordinate information of the terminal in the position image, matching the position coordinate information with preset target position information, and completing positioning and calibration of the position of the terminal when the matching is determined to be successful.
Step 202: acquiring an image of a sliding of a designated icon in a terminal screen;
the method specifically comprises the following steps: acquiring a real-time image acquired by image acquisition equipment and indicating sliding of an appointed icon in the terminal screen; the method specifically comprises the following steps: sending an image acquisition instruction to the image acquisition equipment, and receiving a real-time image returned by the image acquisition equipment and indicating the sliding of the designated icon in the terminal screen; wherein the image acquisition instructions comprise: image acquisition start time;
here, the image pickup apparatus includes a high-speed camera; in one embodiment, the high speed camera may be a 100FPS high speed camera.
Step 203: analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen;
here, the evaluation parameter for evaluating the fluency of the terminal screen includes: the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal and the time delay of the first refreshing of the terminal screen;
wherein, obtaining the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal comprises:
analyzing the images frame by frame to obtain the frame number of the adjacent two screen refreshing intervals of the terminal in the images, and calculating the frame number of all the intervals in the obtained images to obtain the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal;
wherein σ is the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal, N is the acquired number of times of the two adjacent screen refreshing intervals of the terminal, μ is the average value of the frame number of the two adjacent screen refreshing intervals of the terminal for N times, and xiObtaining the number of frames between two adjacent screen refreshing intervals of the ith time of the terminal, wherein i is a positive integer, and i ∈ [1, N]And N is a positive integer.
The obtaining of the time delay of the first refreshing of the terminal screen comprises: analyzing the images frame by frame to obtain the first refreshing time of the terminal in the images, and obtaining the first refreshing time delay of the terminal screen according to the first refreshing time and the preset sliding starting time;
the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is used as a main evaluation parameter for evaluating the fluency of the terminal screen, the first refreshing time delay of the terminal screen is used as an evaluation parameter for auxiliary evaluation of the fluency of the terminal screen, and the smaller the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal and the first refreshing time delay of the terminal screen are, the higher the fluency of the screen of the terminal is; in an embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is [0, 0.6] frame, and the value range of the time delay of the first refreshing of the screen of the terminal is [0, 0.15] second.
Further, the sliding instruction may further include a sliding number; when the sliding times are more than 1, analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen comprises the following steps:
analyzing the images frame by frame to obtain the mean square error of the frame number of the screen refreshing interval of the terminal adjacent to two times when the designated icon in the terminal screen is slid each time, and averaging the mean square error of the frame number of the screen refreshing interval of the terminal adjacent to two times when the designated icon in the terminal screen is slid for multiple times, wherein the average is used for evaluating the evaluation parameter of the fluency of the terminal screen; in one embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the average value is [0, 0.6] frame;
wherein, the mean value of the mean square error of the frame numbers of the two adjacent screen refreshing intervals of the terminal obtained by sliding the designated icon in the terminal screen for multiple times is sigmajIn order to obtain the mean square error of the number of frames between two adjacent screen refreshing intervals of the terminal when the designated icon in the screen of the terminal is slid for the jth time, wherein j is a positive integer, and j ∈ [1, n-1 ]]。
FIG. 3 is a schematic diagram of a composition structure of a device for assessing fluency of a touch screen of a terminal according to an embodiment of the present invention; as shown in fig. 3, the fluency assessment apparatus for a touch screen of a terminal according to an embodiment of the present invention includes: an acquisition module 31 and a processing module 32; wherein,
the acquiring module 31 is configured to acquire an image in which a designated icon slides in a terminal screen;
and the processing module 32 is configured to analyze and process the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen.
Further, the device further comprises a control module 33, configured to control an execution device to perform a sliding operation on a designated icon in the terminal screen;
the control module 33 controls the execution device to perform sliding operation on the designated icon in the terminal screen, including:
the control module 33 sends a sliding instruction to an execution device, where the sliding instruction is used to control the execution device to perform corresponding sliding operation on a designated icon in the terminal screen; wherein the slide instruction comprises: a slide start time, a slide trajectory, a slide speed, and the like; here, the sliding start time, the sliding track, and the sliding speed may be specifically set according to actual situations, in an embodiment, the designated icon is at the leftmost side of the terminal, and the sliding track may be sliding from left to right to the rightmost side of the screen; the sliding speed may be 300 mm/s; the designated icon can be any icon in the terminal screen;
in an embodiment of the present invention, the performing apparatus may be a robot arm.
Further, the apparatus further includes a positioning and calibrating module 34, configured to position and calibrate the position of the terminal;
the positioning and calibrating module 34 performs positioning and calibrating on the position of the terminal, including: the method comprises the steps of obtaining a position image of the terminal fixed on an operation desk and sent by image acquisition equipment, extracting position coordinate information of the terminal in the position image, matching the position coordinate information with preset target position information, and completing positioning and calibration of the position of the terminal when the matching is determined to be successful.
Further, the acquiring module 31 acquires the image of the sliding of the designated icon in the terminal screen, including:
the obtaining module 31 obtains a real-time image acquired by an image acquisition device and in which a designated icon slides in the terminal screen;
the obtaining module 31 is specifically configured to send an image acquisition instruction to the image acquisition device, and receive a real-time image of sliding of a designated icon in the terminal screen returned by the image acquisition device; wherein the image acquisition instructions comprise: image acquisition start time;
here, the image pickup apparatus includes a high-speed camera; in one embodiment, the high speed camera may be a 100FPS high speed camera.
Further, the evaluation parameter for evaluating the fluency of the terminal screen comprises: the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal and the time delay of the first refreshing of the terminal screen;
the obtaining, by the processing module 32, the mean square error of the frame numbers of two adjacent screen refresh intervals of the terminal includes:
the processing module 32 analyzes the image frame by frame, obtains the number of frames of the two adjacent screen refreshing intervals of the terminal in the image, and calculates the obtained number of frames of all the intervals in the image to obtain the mean square error of the number of frames of the two adjacent screen refreshing intervals of the terminal;
wherein σ is the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal, N is the acquired number of times of the frame number of the two adjacent screen refreshing intervals of the terminal, μ is the average value of the frame number of the two adjacent screen refreshing intervals of the terminal for N times, and xiObtaining the number of frames between two adjacent screen refreshing intervals of the ith time of the terminal, wherein i is a positive integer, and i ∈ [1, N]And N is a positive integer.
The obtaining, by the processing module 32, the time delay for the first refreshing of the terminal screen includes:
the processing module 32 analyzes the image frame by frame to obtain the first refreshing time of the terminal in the image, and obtains the first refreshing time delay of the terminal screen according to the first refreshing time and the preset sliding start time;
the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is used as a main evaluation parameter for evaluating the fluency of the terminal screen, the first refreshing time delay of the terminal screen is used as an evaluation parameter for auxiliary evaluation of the fluency of the terminal screen, and the smaller the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal and the first refreshing time delay of the terminal screen are, the higher the fluency of the screen of the terminal is; in an embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is [0, 0.6] frame, and the value range of the time delay of the first refreshing of the screen of the terminal is [0, 0.15] second.
Further, the sliding instruction may further include a sliding number; when the sliding times are greater than 1, the processing module 32 performs analysis processing on the image, and obtaining an evaluation parameter for evaluating the fluency of the terminal screen includes:
the processing module 32 analyzes the images frame by frame to obtain the mean square error of the frame number of the screen refreshing interval between two adjacent screens of the terminal when the designated icon in the terminal screen is slid each time, and averages the mean square error of the frame number of the screen refreshing interval between two adjacent screens of the terminal when the designated icon in the terminal screen is slid for multiple times, wherein the average is used for evaluating the evaluation parameter of the fluency of the terminal screen; in one embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the average value is [0, 0.6] frame;
wherein, the mean value of the mean square error of the frame numbers of the two adjacent screen refreshing intervals of the terminal obtained by sliding the designated icon in the terminal screen for multiple times is sigmajIn order to obtain the mean square error of the number of frames between two adjacent screen refreshing intervals of the terminal when the designated icon in the screen of the terminal is slid for the jth time, wherein j is a positive integer, and j ∈ [1, n-1 ]]。
FIG. 4 is a schematic diagram of a composition structure of a system for assessing fluency of a touch screen of a terminal according to an embodiment of the present invention; as shown in fig. 4, the fluency assessment system for a touch screen of a terminal according to the embodiment of the present invention includes: the execution device 41, the image acquisition device 42 and the terminal touch screen fluency evaluation device 43; wherein,
the execution device 41 is configured to perform a sliding operation on a designated icon in the terminal screen;
the image acquisition device 42 is configured to acquire an image in which a designated icon slides in the terminal screen, and send the image to the terminal touch screen fluency evaluation apparatus;
the device 43 for evaluating fluency of the terminal touch screen is configured to obtain an image in which a designated icon in the terminal screen slides, analyze the image, and obtain an evaluation parameter for evaluating fluency of the terminal screen.
Further, the device 43 for evaluating fluency of the terminal touch screen is configured to control an execution device to perform a sliding operation on a designated icon in the terminal screen;
the control of the execution device by the terminal touch screen fluency assessment apparatus 43 to perform sliding operation on the designated icon in the terminal screen includes:
the terminal touch screen fluency evaluation device 43 sends a sliding instruction to the execution device 41, and the execution device 41 performs corresponding sliding operation on the designated icon in the terminal screen according to the sliding instruction; wherein the slide instruction comprises: a slide start time, a slide trajectory, a slide speed, and the like; here, the sliding start time, the sliding track, and the sliding speed may be specifically set according to actual situations, in an embodiment, the designated icon is at the leftmost side of the terminal, and the sliding track may be sliding from left to right to the rightmost side of the screen; the sliding speed may be 300 mm/s; the designated icon can be any icon in the terminal screen;
in an embodiment of the present invention, the performing apparatus may be a robot arm.
Further, the device 43 for evaluating fluency of touch screen of the terminal is further configured to locate and calibrate the position of the terminal;
the positioning and calibration of the terminal touch screen fluency assessment device 43 on the position of the terminal includes:
the fluency evaluation device 43 of the terminal touch screen acquires the position image of the terminal fixed on the console sent by the image acquisition device 42, extracts the position coordinate information of the terminal in the position image, matches the position coordinate information with the preset target position information, and completes the positioning and calibration of the terminal position when the matching is successful.
Further, the image capturing device 42 capturing the image of the sliding of the designated icon in the terminal screen includes: the image acquisition device 42 acquires a real-time image of sliding of a designated icon in the terminal screen;
the acquiring of the image of the sliding of the designated icon in the terminal screen by the terminal touch screen fluency assessment device 43 includes:
the fluency evaluation device 43 of the terminal touch screen sends an image acquisition instruction to the image acquisition equipment 42, and receives a real-time image returned by the image acquisition equipment 42 and indicating the sliding of the designated icon in the terminal screen; wherein the image acquisition instructions comprise: image acquisition start time;
here, the image pickup device 42 includes a high-speed camera; in one embodiment, the high speed camera may be a 100FPS high speed camera.
Further, the evaluation parameter for evaluating the fluency of the terminal screen comprises: the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal and the time delay of the first refreshing of the terminal screen;
the obtaining the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal by the terminal touch screen fluency evaluation device 43 comprises:
the fluency evaluation device 43 of the terminal touch screen analyzes the image frame by frame, acquires the frame number of the two adjacent screen refreshing intervals of the terminal in the image, and calculates the frame number of all the intervals in the acquired image to obtain the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal;
wherein σ is the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal, N is the acquired number of times of the frame number of the two adjacent screen refreshing intervals of the terminal, μ is the average value of the frame number of the two adjacent screen refreshing intervals of the terminal for N times, and xiObtaining the number of frames between two adjacent screen refreshing intervals of the ith time of the terminal, wherein i is a positive integer, and i ∈ [1, N]And N is a positive integer.
The obtaining of the time delay of the first refreshing of the terminal screen by the terminal touch screen fluency evaluation device 43 includes:
the fluency evaluation device 43 of the terminal touch screen analyzes the image frame by frame to obtain the first refreshing time of the terminal in the image, and obtains the first refreshing time delay of the terminal screen according to the first refreshing time and the preset sliding start time;
the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is used as a main evaluation parameter for evaluating the fluency of the terminal screen, the first refreshing time delay of the terminal screen is used as an evaluation parameter for auxiliary evaluation of the fluency of the terminal screen, and the smaller the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal and the first refreshing time delay of the terminal screen are, the higher the fluency of the screen of the terminal is; in an embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is [0, 0.6] frame, and the value range of the time delay of the first refreshing of the screen of the terminal is [0, 0.15] second.
Further, the sliding instruction may further include a sliding number; when the sliding frequency is greater than 1, the terminal touch screen fluency evaluation device 43 performs analysis processing on the image, and obtaining an evaluation parameter for evaluating the terminal touch screen fluency includes:
the terminal touch screen fluency evaluation device 43 analyzes the image frame by frame to obtain the mean square error of the frame number of the screen refreshing interval between two adjacent screens of the terminal when the designated icon is slid each time, and averages the mean square error of the frame number of the screen refreshing interval between two adjacent screens of the terminal obtained by sliding the designated icon in the terminal screen for multiple times, wherein the average is used for evaluating the evaluation parameter of the fluency of the terminal screen; in one embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the average value is [0, 0.6] frame;
wherein, the mean value of the mean square error of the frame numbers of the two adjacent screen refreshing intervals of the terminal obtained by sliding the designated icon in the terminal screen for multiple times is sigmajIn order to obtain the mean square error of the number of frames between two adjacent screen refreshing intervals of the terminal when the designated icon in the screen of the terminal is slid for the jth time, wherein j is a positive integer, and j ∈ [1, n-1 ]]。
In the embodiment of the present invention, the obtaining module 31, the processing module 32, the control module 33, and the positioning and calibrating module 34 may be implemented by a Central Processing Unit (CPU) or a Digital Signal Processor (DSP), or a Field Programmable Gate Array (FPGA) in a server.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention.
Claims (11)
1. A method for evaluating fluency of a terminal touch screen is characterized by comprising the following steps:
acquiring an image of a sliding of a designated icon in a terminal screen;
and analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen.
2. The method of claim 1, wherein before the acquiring the image of the sliding of the designated icon in the terminal screen, the method further comprises:
and controlling the execution equipment to perform sliding operation on the designated icon in the terminal screen.
3. The method according to claim 1 or 2, wherein the acquiring the image of the sliding of the designated icon in the terminal screen comprises:
and acquiring a real-time image acquired by image acquisition equipment and obtained by sliding the designated icon in the terminal screen.
4. The method according to claim 1 or 2, wherein the analyzing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen comprises:
analyzing the images frame by frame to obtain the frame number of the adjacent two screen refreshing intervals of the terminal in the images, and calculating the frame number of all the intervals in the obtained images to obtain the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal; the mean square error is used for evaluating the fluency of the terminal screen.
5. The method according to claim 1 or 2, characterized in that the method further comprises: and acquiring the first refreshing time delay of the terminal screen in the image, wherein the first refreshing time delay is used for assisting in evaluating the fluency of the terminal screen.
6. An apparatus for assessing fluency of a touch screen of a terminal, the apparatus comprising: an acquisition module and a processing module; wherein,
the acquisition module is used for acquiring an image of the sliding of the designated icon in the terminal screen;
and the processing module is used for analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen.
7. The apparatus according to claim 6, further comprising a control module for controlling an execution device to perform a sliding operation on a designated icon in the terminal screen.
8. The apparatus according to claim 6 or 7, wherein the obtaining module is specifically configured to obtain a real-time image captured by an image capturing device and obtained by sliding a designated icon in the terminal screen.
9. The apparatus according to claim 6 or 7, wherein the processing module is specifically configured to analyze the image frame by frame, obtain the number of frames between two adjacent screen refresh intervals of the terminal in the image, and calculate the obtained number of frames between all the intervals in the image to obtain a mean square error of the number of frames between two adjacent screen refresh intervals of the terminal; the mean square error is used for evaluating the fluency of the terminal screen.
10. The apparatus according to claim 6 or 7, wherein the processing module is further configured to obtain a first refresh delay of the terminal screen in the image, and the first refresh delay is used to assist in assessing fluency of the terminal screen.
11. A system for assessing fluency of a touch screen of a terminal, the system comprising: the system comprises an execution device, an image acquisition device and a terminal touch screen fluency evaluation device; wherein,
the execution equipment is used for performing sliding operation on the designated icon in the terminal screen;
the image acquisition equipment is used for acquiring an image of sliding of a designated icon in the terminal screen and sending the image to the fluency evaluation device of the terminal touch screen;
the terminal touch screen fluency assessment device is the terminal touch screen fluency assessment device according to any one of claims 6 to 10.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410806589.4A CN105786336A (en) | 2014-12-22 | 2014-12-22 | Method, device and system for evaluating fluency of terminal touch screen |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410806589.4A CN105786336A (en) | 2014-12-22 | 2014-12-22 | Method, device and system for evaluating fluency of terminal touch screen |
Publications (1)
Publication Number | Publication Date |
---|---|
CN105786336A true CN105786336A (en) | 2016-07-20 |
Family
ID=56385288
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410806589.4A Pending CN105786336A (en) | 2014-12-22 | 2014-12-22 | Method, device and system for evaluating fluency of terminal touch screen |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105786336A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018161421A1 (en) * | 2017-03-08 | 2018-09-13 | 华为技术有限公司 | Performance test method and performance test apparatus for touch display screen of terminal device |
CN109117067A (en) * | 2017-06-26 | 2019-01-01 | 深圳回收宝科技有限公司 | The detection method and its device of terminal touch-control performance |
CN115470153A (en) * | 2022-11-14 | 2022-12-13 | 成都安易迅科技有限公司 | Method, system and equipment for evaluating stability fluency of UI (user interface) of intelligent terminal system |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103067552A (en) * | 2013-01-22 | 2013-04-24 | 刘伟 | Automatical detecting system of mobile phone |
CN103076917A (en) * | 2012-12-28 | 2013-05-01 | 华为终端有限公司 | Method for adjusting fluency of display interface and terminal |
CN103268194A (en) * | 2013-04-18 | 2013-08-28 | 广州视睿电子科技有限公司 | Delay time testing method and testing tool for interactive intelligent panel |
-
2014
- 2014-12-22 CN CN201410806589.4A patent/CN105786336A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103076917A (en) * | 2012-12-28 | 2013-05-01 | 华为终端有限公司 | Method for adjusting fluency of display interface and terminal |
CN103067552A (en) * | 2013-01-22 | 2013-04-24 | 刘伟 | Automatical detecting system of mobile phone |
CN103268194A (en) * | 2013-04-18 | 2013-08-28 | 广州视睿电子科技有限公司 | Delay time testing method and testing tool for interactive intelligent panel |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018161421A1 (en) * | 2017-03-08 | 2018-09-13 | 华为技术有限公司 | Performance test method and performance test apparatus for touch display screen of terminal device |
CN109117067A (en) * | 2017-06-26 | 2019-01-01 | 深圳回收宝科技有限公司 | The detection method and its device of terminal touch-control performance |
CN115470153A (en) * | 2022-11-14 | 2022-12-13 | 成都安易迅科技有限公司 | Method, system and equipment for evaluating stability fluency of UI (user interface) of intelligent terminal system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105302701B (en) | Method, device and equipment for testing reaction time of terminal user interface | |
CN108012143B (en) | Binocular camera calibration method and device | |
WO2017134416A3 (en) | Touchscreen panel signal processing | |
EP3226138B1 (en) | Data acquisition chip test system and device and control method therefor | |
TW200623232A (en) | Alignment information display method, program thereof, alignment method, exposure method, device manufacturing method, display system, display device, program, and measurement/inspection device | |
RU2013148400A (en) | TEST DEVICE | |
CN104468916A (en) | Test method based on cell phone response time | |
WO2020139018A3 (en) | Signal processing device and image display apparatus including the same | |
WO2009057278A1 (en) | Correction device to be incorporated into brain wave interface system, its method, and computer program | |
WO2009083995A3 (en) | Process and apparatus for testing a component using an omni-directional eddy current probe | |
WO2019134684A1 (en) | Oscilloscope signal processing method and device and oscilloscope | |
CN111402220B (en) | Method and device for acquiring information | |
EP3349148A3 (en) | Fingerprint identification method and apparatus | |
EP2182364A3 (en) | Sample analyzer and calibration method of sample analyzer | |
EP2698727A3 (en) | Terminal and method for determining type of input method editor | |
CN108871185B (en) | Method, device and equipment for detecting parts and computer readable storage medium | |
CN105786336A (en) | Method, device and system for evaluating fluency of terminal touch screen | |
WO2020225958A1 (en) | Work analysis device, work analysis method and program | |
CN105405115A (en) | Image module group alignment system and method thereof | |
CN103837828A (en) | Travel curve test method and system of camera-shooting mode motor and mobile terminal | |
WO2019024450A1 (en) | Device fault detection method and apparatus | |
CN104180823B (en) | A kind of temperature compensation and device | |
EP3670109A3 (en) | Method and apparatus for controlling behavior of service robot | |
CN104639714A (en) | Test method of mobile phone response time | |
CN101340811A (en) | Image optimized matching system and method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160720 |
|
RJ01 | Rejection of invention patent application after publication |