CN105786336A - Method, device and system for evaluating fluency of terminal touch screen - Google Patents

Method, device and system for evaluating fluency of terminal touch screen Download PDF

Info

Publication number
CN105786336A
CN105786336A CN201410806589.4A CN201410806589A CN105786336A CN 105786336 A CN105786336 A CN 105786336A CN 201410806589 A CN201410806589 A CN 201410806589A CN 105786336 A CN105786336 A CN 105786336A
Authority
CN
China
Prior art keywords
terminal
screen
image
fluency
sliding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410806589.4A
Other languages
Chinese (zh)
Inventor
李雪菊
唐剑峰
汪恒江
刘立森
邵玮
张伟
陈景岩
张俊龙
陈燕
王尚华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN201410806589.4A priority Critical patent/CN105786336A/en
Publication of CN105786336A publication Critical patent/CN105786336A/en
Pending legal-status Critical Current

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a method for evaluating the fluency of a terminal touch screen. The method comprises the following steps: obtaining a sliding image of a specified icon in the terminal screen; and analyzing the image to obtain an evaluation parameter for evaluating the fluency of the terminal touch screen. The invention further discloses a device and a system for evaluating the fluency of the terminal touch screen.

Description

Method, device and system for evaluating fluency of terminal touch screen
Technical Field
The invention relates to a terminal screen evaluation technology, in particular to a method, a device and a system for evaluating fluency of a terminal touch screen.
Background
With the rapid development of the touch screen technology, the touch screen is more and more applied in daily life of people, and the touch screen not only can meet the requirement of people for quickly searching useful information, but also has the advantages of high response speed, space saving and the like; the most direct communication bridge between human and machine, namely the terminal screen, has very important influence on the terminal as the window of the intelligent mobile terminal.
Therefore, technologies and tools for detecting the performance of the touch screen continuously appear, and the traditional touch screen test mainly focuses on the hardware performances such as sensitivity, linearity and pressure resistance; however, in the process of using the terminal screen, the problems that the screen lag, the screen jam, the unsmooth and the like affect the user perception are more encountered, and therefore, providing a technical solution capable of effectively evaluating the fluency of the terminal screen is a problem to be solved urgently.
Disclosure of Invention
In view of this, the embodiments of the present invention are expected to provide a method, an apparatus, and a system for evaluating fluency of a touch screen of a terminal, which can effectively evaluate fluency of a screen of the terminal and greatly improve user experience.
In order to achieve the above purpose, the technical solution of the embodiment of the present invention is realized as follows:
the embodiment of the invention provides a method for evaluating fluency of a terminal touch screen, which comprises the following steps:
acquiring an image of a sliding of a designated icon in a terminal screen;
and analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen.
In the above scheme, before the obtaining of the image in which the designated icon slides in the terminal screen, the method further includes:
and controlling the execution equipment to perform sliding operation on the designated icon in the terminal screen.
In the above scheme, the acquiring an image of the sliding of the designated icon in the terminal screen includes:
and acquiring a real-time image acquired by image acquisition equipment and obtained by sliding the designated icon in the terminal screen.
In the above scheme, the analyzing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen includes:
analyzing the images frame by frame to obtain the frame number of the adjacent two screen refreshing intervals of the terminal in the images, and calculating the frame number of all the intervals in the obtained images to obtain the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal; the mean square error is used for evaluating the fluency of the terminal screen.
In the above scheme, the method further comprises: and acquiring the first refreshing time delay of the terminal screen in the image, wherein the first refreshing time delay is used for assisting in evaluating the fluency of the terminal screen.
The embodiment of the invention also provides a device for evaluating the fluency of the touch screen of the terminal, which comprises: an acquisition module and a processing module; wherein,
the acquisition module is used for acquiring an image of the sliding of the designated icon in the terminal screen;
and the processing module is used for analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen.
In the above scheme, the apparatus further includes a control module, configured to control an execution device to perform a sliding operation on a designated icon in the terminal screen.
In the above scheme, the obtaining module is specifically configured to obtain a real-time image acquired by the image acquisition device and in which the designated icon slides in the terminal screen.
In the above scheme, the processing module is specifically configured to analyze the image frame by frame, acquire the number of frames in the image between two adjacent screen refreshing intervals of the terminal, and calculate the number of frames in all the acquired images to obtain a mean square error of the number of frames in the image between two adjacent screen refreshing intervals of the terminal; the mean square error is used for evaluating the fluency of the terminal screen.
In the above scheme, the processing module is further configured to obtain a first refreshing time delay of the terminal screen in the image, where the first refreshing time delay is used to assist in evaluating the fluency of the terminal screen.
The embodiment of the invention also provides a fluency evaluation system for the touch screen of the terminal, which comprises the following steps: the system comprises an execution device, an image acquisition device and a terminal touch screen fluency evaluation device; wherein,
the execution equipment is used for performing sliding operation on the designated icon in the terminal screen;
the image acquisition equipment is used for acquiring an image of sliding of a designated icon in the terminal screen and sending the image to the fluency evaluation device of the terminal touch screen;
the terminal touch screen fluency assessment device is the terminal touch screen fluency assessment device according to any one of claims 6 to 10.
According to the method, the device and the system for evaluating the fluency of the terminal touch screen, provided by the embodiment of the invention, the image of the sliding of the designated icon in the terminal screen is obtained; and analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen. Therefore, the fluency of the terminal screen can be effectively evaluated through the obtained evaluation parameters for evaluating the fluency of the terminal screen, the defects of the prior art are overcome, and the user experience is greatly improved.
Drawings
Fig. 1 is a schematic flow chart of a method for evaluating fluency of a touch screen of a terminal according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a second method for assessing fluency of a touch screen of a terminal according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a composition structure of a device for assessing fluency of a touch screen of a terminal according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a composition structure of a system for assessing fluency of a touch screen of a terminal according to an embodiment of the invention.
Detailed Description
In the embodiment of the invention, an image of sliding of a designated icon in a terminal screen is acquired; and analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen.
Fig. 1 is a schematic flow chart of a method for evaluating fluency of a touch screen of a terminal according to an embodiment of the present invention; as shown in fig. 1, a flow of a method for evaluating fluency of a touch screen of a terminal according to an embodiment of the present invention includes:
step 101: acquiring an image of a sliding of a designated icon in a terminal screen;
before this step, the method further comprises: controlling an execution device to perform sliding operation on a designated icon in the terminal screen; the method specifically comprises the following steps: sending a sliding instruction to an execution device, wherein the sliding instruction is used for controlling the execution device to perform corresponding sliding operation on a designated icon in the terminal screen;
wherein the slide instruction comprises: a slide start time, a slide trajectory, a slide speed, and the like; here, the sliding start time, the sliding track, and the sliding speed may be specifically set according to actual situations, in an embodiment, the designated icon is at the leftmost side of the terminal, and the sliding track may be sliding from left to right to the rightmost side of the screen; the sliding speed may be 300 mm/s; the designated icon can be any icon in the terminal screen;
in an embodiment of the present invention, the performing apparatus may be a robot arm.
Further, before the control execution device performs a sliding operation on the designated icon in the terminal screen, the method further includes: positioning and calibrating the position of the terminal; the method specifically comprises the following steps: the method comprises the steps of obtaining a position image of the terminal fixed on an operation desk and sent by image acquisition equipment, extracting position coordinate information of the terminal in the position image, matching the position coordinate information with preset target position information, and completing positioning and calibration of the position of the terminal when the matching is determined to be successful.
Further, the acquiring the image of the sliding of the designated icon in the terminal screen includes: acquiring a real-time image acquired by image acquisition equipment and indicating sliding of an appointed icon in the terminal screen; the method specifically comprises the following steps: sending an image acquisition instruction to the image acquisition equipment, and receiving a real-time image returned by the image acquisition equipment and indicating the sliding of the designated icon in the terminal screen; wherein the image acquisition instructions comprise: image acquisition start time;
here, the image pickup apparatus includes a high-speed camera; in one embodiment, the high speed camera may be a 100FPS high speed camera.
Step 102: analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen;
here, the evaluation parameter for evaluating the fluency of the terminal screen includes: the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal and the time delay of the first refreshing of the terminal screen;
wherein, obtaining the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal comprises:
analyzing the images frame by frame to obtain the frame number of the adjacent two screen refreshing intervals of the terminal in the images, and calculating the frame number of all the intervals in the obtained images to obtain the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal;
σ = 1 N Σ i = 1 N ( x i - μ ) 2 ;
wherein σ is the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal, N is the acquired number of times of the two adjacent screen refreshing intervals of the terminal, μ is the average value of the frame number of the two adjacent screen refreshing intervals of the terminal for N times, and xiObtaining the number of frames between two adjacent screen refreshing intervals of the ith time of the terminal, wherein i is a positive integer, and i ∈ [1, N]And N is a positive integer.
The obtaining of the time delay of the first refreshing of the terminal screen comprises: analyzing the images frame by frame to obtain the first refreshing time of the terminal in the images, and obtaining the first refreshing time delay of the terminal screen according to the first refreshing time and the preset sliding starting time;
the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is used as a main evaluation parameter for evaluating the fluency of the terminal screen, the first refreshing time delay of the terminal screen is used as an evaluation parameter for auxiliary evaluation of the fluency of the terminal screen, and the smaller the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal and the first refreshing time delay of the terminal screen are, the higher the fluency of the screen of the terminal is; in an embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is [0, 0.6] frame, and the value range of the time delay of the first refreshing of the screen of the terminal is [0, 0.15] second.
Furthermore, the sliding instruction may further include a sliding number n, where n is a positive integer; when the sliding times are more than 1, analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen comprises the following steps:
analyzing the images frame by frame to obtain the mean square error of the frame number of the screen refreshing interval of the terminal adjacent to two times when the designated icon in the terminal screen is slid each time, and averaging the mean square error of the frame number of the screen refreshing interval of the terminal adjacent to two times when the designated icon in the terminal screen is slid for multiple times, wherein the average is used for evaluating the evaluation parameter of the fluency of the terminal screen; in one embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the average value is [0, 0.6] frame;
δ = 1 ( n - 1 ) ( σ 1 + σ 2 + . . . + σ j + . . . + σ ( n - 1 ) ) ;
wherein, the mean value of the mean square error of the frame numbers of the two adjacent screen refreshing intervals of the terminal obtained by sliding the designated icon in the terminal screen for multiple times is sigmajIn order to obtain the mean square error of the number of frames between two adjacent screen refreshing intervals of the terminal when the designated icon in the screen of the terminal is slid for the jth time, wherein j is a positive integer, and j ∈ [1, n-1 ]]。
FIG. 2 is a schematic flow chart of a second method for assessing fluency of a touch screen of a terminal according to an embodiment of the present invention; as shown in fig. 2, the method for evaluating fluency of a touch screen of a second terminal according to the embodiment of the present invention includes:
step 201: controlling an execution device to perform sliding operation on a designated icon in the terminal screen;
the method specifically comprises the following steps: sending a sliding instruction to an execution device, wherein the sliding instruction is used for controlling the execution device to perform corresponding sliding operation on a designated icon in the terminal screen; wherein the slide instruction comprises: a slide start time, a slide trajectory, a slide speed, and the like;
here, the sliding start time, the sliding track, and the sliding speed may be specifically set according to actual situations, in an embodiment, the designated icon is at the leftmost side of the terminal, and the sliding track may be sliding from left to right to the rightmost side of the screen; the sliding speed may be 300 mm/s; the designated icon can be any icon in the terminal screen;
in an embodiment of the present invention, the performing apparatus may be a robot arm.
Further, before this step, the method further includes: positioning and calibrating the position of the terminal; the method specifically comprises the following steps: the method comprises the steps of obtaining a position image of the terminal fixed on an operation desk and sent by image acquisition equipment, extracting position coordinate information of the terminal in the position image, matching the position coordinate information with preset target position information, and completing positioning and calibration of the position of the terminal when the matching is determined to be successful.
Step 202: acquiring an image of a sliding of a designated icon in a terminal screen;
the method specifically comprises the following steps: acquiring a real-time image acquired by image acquisition equipment and indicating sliding of an appointed icon in the terminal screen; the method specifically comprises the following steps: sending an image acquisition instruction to the image acquisition equipment, and receiving a real-time image returned by the image acquisition equipment and indicating the sliding of the designated icon in the terminal screen; wherein the image acquisition instructions comprise: image acquisition start time;
here, the image pickup apparatus includes a high-speed camera; in one embodiment, the high speed camera may be a 100FPS high speed camera.
Step 203: analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen;
here, the evaluation parameter for evaluating the fluency of the terminal screen includes: the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal and the time delay of the first refreshing of the terminal screen;
wherein, obtaining the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal comprises:
analyzing the images frame by frame to obtain the frame number of the adjacent two screen refreshing intervals of the terminal in the images, and calculating the frame number of all the intervals in the obtained images to obtain the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal;
σ = 1 N Σ i = 1 N ( x i - μ ) 2 ;
wherein σ is the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal, N is the acquired number of times of the two adjacent screen refreshing intervals of the terminal, μ is the average value of the frame number of the two adjacent screen refreshing intervals of the terminal for N times, and xiObtaining the number of frames between two adjacent screen refreshing intervals of the ith time of the terminal, wherein i is a positive integer, and i ∈ [1, N]And N is a positive integer.
The obtaining of the time delay of the first refreshing of the terminal screen comprises: analyzing the images frame by frame to obtain the first refreshing time of the terminal in the images, and obtaining the first refreshing time delay of the terminal screen according to the first refreshing time and the preset sliding starting time;
the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is used as a main evaluation parameter for evaluating the fluency of the terminal screen, the first refreshing time delay of the terminal screen is used as an evaluation parameter for auxiliary evaluation of the fluency of the terminal screen, and the smaller the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal and the first refreshing time delay of the terminal screen are, the higher the fluency of the screen of the terminal is; in an embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is [0, 0.6] frame, and the value range of the time delay of the first refreshing of the screen of the terminal is [0, 0.15] second.
Further, the sliding instruction may further include a sliding number; when the sliding times are more than 1, analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen comprises the following steps:
analyzing the images frame by frame to obtain the mean square error of the frame number of the screen refreshing interval of the terminal adjacent to two times when the designated icon in the terminal screen is slid each time, and averaging the mean square error of the frame number of the screen refreshing interval of the terminal adjacent to two times when the designated icon in the terminal screen is slid for multiple times, wherein the average is used for evaluating the evaluation parameter of the fluency of the terminal screen; in one embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the average value is [0, 0.6] frame;
δ = 1 ( n - 1 ) ( σ 1 + σ 2 + . . . + σ j + . . . + σ ( n - 1 ) ) ;
wherein, the mean value of the mean square error of the frame numbers of the two adjacent screen refreshing intervals of the terminal obtained by sliding the designated icon in the terminal screen for multiple times is sigmajIn order to obtain the mean square error of the number of frames between two adjacent screen refreshing intervals of the terminal when the designated icon in the screen of the terminal is slid for the jth time, wherein j is a positive integer, and j ∈ [1, n-1 ]]。
FIG. 3 is a schematic diagram of a composition structure of a device for assessing fluency of a touch screen of a terminal according to an embodiment of the present invention; as shown in fig. 3, the fluency assessment apparatus for a touch screen of a terminal according to an embodiment of the present invention includes: an acquisition module 31 and a processing module 32; wherein,
the acquiring module 31 is configured to acquire an image in which a designated icon slides in a terminal screen;
and the processing module 32 is configured to analyze and process the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen.
Further, the device further comprises a control module 33, configured to control an execution device to perform a sliding operation on a designated icon in the terminal screen;
the control module 33 controls the execution device to perform sliding operation on the designated icon in the terminal screen, including:
the control module 33 sends a sliding instruction to an execution device, where the sliding instruction is used to control the execution device to perform corresponding sliding operation on a designated icon in the terminal screen; wherein the slide instruction comprises: a slide start time, a slide trajectory, a slide speed, and the like; here, the sliding start time, the sliding track, and the sliding speed may be specifically set according to actual situations, in an embodiment, the designated icon is at the leftmost side of the terminal, and the sliding track may be sliding from left to right to the rightmost side of the screen; the sliding speed may be 300 mm/s; the designated icon can be any icon in the terminal screen;
in an embodiment of the present invention, the performing apparatus may be a robot arm.
Further, the apparatus further includes a positioning and calibrating module 34, configured to position and calibrate the position of the terminal;
the positioning and calibrating module 34 performs positioning and calibrating on the position of the terminal, including: the method comprises the steps of obtaining a position image of the terminal fixed on an operation desk and sent by image acquisition equipment, extracting position coordinate information of the terminal in the position image, matching the position coordinate information with preset target position information, and completing positioning and calibration of the position of the terminal when the matching is determined to be successful.
Further, the acquiring module 31 acquires the image of the sliding of the designated icon in the terminal screen, including:
the obtaining module 31 obtains a real-time image acquired by an image acquisition device and in which a designated icon slides in the terminal screen;
the obtaining module 31 is specifically configured to send an image acquisition instruction to the image acquisition device, and receive a real-time image of sliding of a designated icon in the terminal screen returned by the image acquisition device; wherein the image acquisition instructions comprise: image acquisition start time;
here, the image pickup apparatus includes a high-speed camera; in one embodiment, the high speed camera may be a 100FPS high speed camera.
Further, the evaluation parameter for evaluating the fluency of the terminal screen comprises: the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal and the time delay of the first refreshing of the terminal screen;
the obtaining, by the processing module 32, the mean square error of the frame numbers of two adjacent screen refresh intervals of the terminal includes:
the processing module 32 analyzes the image frame by frame, obtains the number of frames of the two adjacent screen refreshing intervals of the terminal in the image, and calculates the obtained number of frames of all the intervals in the image to obtain the mean square error of the number of frames of the two adjacent screen refreshing intervals of the terminal;
σ = 1 N Σ i = 1 N ( x i - μ ) 2 ;
wherein σ is the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal, N is the acquired number of times of the frame number of the two adjacent screen refreshing intervals of the terminal, μ is the average value of the frame number of the two adjacent screen refreshing intervals of the terminal for N times, and xiObtaining the number of frames between two adjacent screen refreshing intervals of the ith time of the terminal, wherein i is a positive integer, and i ∈ [1, N]And N is a positive integer.
The obtaining, by the processing module 32, the time delay for the first refreshing of the terminal screen includes:
the processing module 32 analyzes the image frame by frame to obtain the first refreshing time of the terminal in the image, and obtains the first refreshing time delay of the terminal screen according to the first refreshing time and the preset sliding start time;
the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is used as a main evaluation parameter for evaluating the fluency of the terminal screen, the first refreshing time delay of the terminal screen is used as an evaluation parameter for auxiliary evaluation of the fluency of the terminal screen, and the smaller the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal and the first refreshing time delay of the terminal screen are, the higher the fluency of the screen of the terminal is; in an embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is [0, 0.6] frame, and the value range of the time delay of the first refreshing of the screen of the terminal is [0, 0.15] second.
Further, the sliding instruction may further include a sliding number; when the sliding times are greater than 1, the processing module 32 performs analysis processing on the image, and obtaining an evaluation parameter for evaluating the fluency of the terminal screen includes:
the processing module 32 analyzes the images frame by frame to obtain the mean square error of the frame number of the screen refreshing interval between two adjacent screens of the terminal when the designated icon in the terminal screen is slid each time, and averages the mean square error of the frame number of the screen refreshing interval between two adjacent screens of the terminal when the designated icon in the terminal screen is slid for multiple times, wherein the average is used for evaluating the evaluation parameter of the fluency of the terminal screen; in one embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the average value is [0, 0.6] frame;
δ = 1 ( n - 1 ) ( σ 1 + σ 2 + . . . + σ j + . . . + σ ( n - 1 ) ) ;
wherein, the mean value of the mean square error of the frame numbers of the two adjacent screen refreshing intervals of the terminal obtained by sliding the designated icon in the terminal screen for multiple times is sigmajIn order to obtain the mean square error of the number of frames between two adjacent screen refreshing intervals of the terminal when the designated icon in the screen of the terminal is slid for the jth time, wherein j is a positive integer, and j ∈ [1, n-1 ]]。
FIG. 4 is a schematic diagram of a composition structure of a system for assessing fluency of a touch screen of a terminal according to an embodiment of the present invention; as shown in fig. 4, the fluency assessment system for a touch screen of a terminal according to the embodiment of the present invention includes: the execution device 41, the image acquisition device 42 and the terminal touch screen fluency evaluation device 43; wherein,
the execution device 41 is configured to perform a sliding operation on a designated icon in the terminal screen;
the image acquisition device 42 is configured to acquire an image in which a designated icon slides in the terminal screen, and send the image to the terminal touch screen fluency evaluation apparatus;
the device 43 for evaluating fluency of the terminal touch screen is configured to obtain an image in which a designated icon in the terminal screen slides, analyze the image, and obtain an evaluation parameter for evaluating fluency of the terminal screen.
Further, the device 43 for evaluating fluency of the terminal touch screen is configured to control an execution device to perform a sliding operation on a designated icon in the terminal screen;
the control of the execution device by the terminal touch screen fluency assessment apparatus 43 to perform sliding operation on the designated icon in the terminal screen includes:
the terminal touch screen fluency evaluation device 43 sends a sliding instruction to the execution device 41, and the execution device 41 performs corresponding sliding operation on the designated icon in the terminal screen according to the sliding instruction; wherein the slide instruction comprises: a slide start time, a slide trajectory, a slide speed, and the like; here, the sliding start time, the sliding track, and the sliding speed may be specifically set according to actual situations, in an embodiment, the designated icon is at the leftmost side of the terminal, and the sliding track may be sliding from left to right to the rightmost side of the screen; the sliding speed may be 300 mm/s; the designated icon can be any icon in the terminal screen;
in an embodiment of the present invention, the performing apparatus may be a robot arm.
Further, the device 43 for evaluating fluency of touch screen of the terminal is further configured to locate and calibrate the position of the terminal;
the positioning and calibration of the terminal touch screen fluency assessment device 43 on the position of the terminal includes:
the fluency evaluation device 43 of the terminal touch screen acquires the position image of the terminal fixed on the console sent by the image acquisition device 42, extracts the position coordinate information of the terminal in the position image, matches the position coordinate information with the preset target position information, and completes the positioning and calibration of the terminal position when the matching is successful.
Further, the image capturing device 42 capturing the image of the sliding of the designated icon in the terminal screen includes: the image acquisition device 42 acquires a real-time image of sliding of a designated icon in the terminal screen;
the acquiring of the image of the sliding of the designated icon in the terminal screen by the terminal touch screen fluency assessment device 43 includes:
the fluency evaluation device 43 of the terminal touch screen sends an image acquisition instruction to the image acquisition equipment 42, and receives a real-time image returned by the image acquisition equipment 42 and indicating the sliding of the designated icon in the terminal screen; wherein the image acquisition instructions comprise: image acquisition start time;
here, the image pickup device 42 includes a high-speed camera; in one embodiment, the high speed camera may be a 100FPS high speed camera.
Further, the evaluation parameter for evaluating the fluency of the terminal screen comprises: the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal and the time delay of the first refreshing of the terminal screen;
the obtaining the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal by the terminal touch screen fluency evaluation device 43 comprises:
the fluency evaluation device 43 of the terminal touch screen analyzes the image frame by frame, acquires the frame number of the two adjacent screen refreshing intervals of the terminal in the image, and calculates the frame number of all the intervals in the acquired image to obtain the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal;
σ = 1 N Σ i = 1 N ( x i - μ ) 2 ;
wherein σ is the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal, N is the acquired number of times of the frame number of the two adjacent screen refreshing intervals of the terminal, μ is the average value of the frame number of the two adjacent screen refreshing intervals of the terminal for N times, and xiObtaining the number of frames between two adjacent screen refreshing intervals of the ith time of the terminal, wherein i is a positive integer, and i ∈ [1, N]And N is a positive integer.
The obtaining of the time delay of the first refreshing of the terminal screen by the terminal touch screen fluency evaluation device 43 includes:
the fluency evaluation device 43 of the terminal touch screen analyzes the image frame by frame to obtain the first refreshing time of the terminal in the image, and obtains the first refreshing time delay of the terminal screen according to the first refreshing time and the preset sliding start time;
the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is used as a main evaluation parameter for evaluating the fluency of the terminal screen, the first refreshing time delay of the terminal screen is used as an evaluation parameter for auxiliary evaluation of the fluency of the terminal screen, and the smaller the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal and the first refreshing time delay of the terminal screen are, the higher the fluency of the screen of the terminal is; in an embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the mean square error of the frame number of the two adjacent screen refreshing intervals of the terminal is [0, 0.6] frame, and the value range of the time delay of the first refreshing of the screen of the terminal is [0, 0.15] second.
Further, the sliding instruction may further include a sliding number; when the sliding frequency is greater than 1, the terminal touch screen fluency evaluation device 43 performs analysis processing on the image, and obtaining an evaluation parameter for evaluating the terminal touch screen fluency includes:
the terminal touch screen fluency evaluation device 43 analyzes the image frame by frame to obtain the mean square error of the frame number of the screen refreshing interval between two adjacent screens of the terminal when the designated icon is slid each time, and averages the mean square error of the frame number of the screen refreshing interval between two adjacent screens of the terminal obtained by sliding the designated icon in the terminal screen for multiple times, wherein the average is used for evaluating the evaluation parameter of the fluency of the terminal screen; in one embodiment, when the smoothness of the screen of the terminal is evaluated, the value range of the average value is [0, 0.6] frame;
δ = 1 ( n - 1 ) ( σ 1 + σ 2 + . . . + σ j + . . . + σ ( n - 1 ) ) ;
wherein, the mean value of the mean square error of the frame numbers of the two adjacent screen refreshing intervals of the terminal obtained by sliding the designated icon in the terminal screen for multiple times is sigmajIn order to obtain the mean square error of the number of frames between two adjacent screen refreshing intervals of the terminal when the designated icon in the screen of the terminal is slid for the jth time, wherein j is a positive integer, and j ∈ [1, n-1 ]]。
In the embodiment of the present invention, the obtaining module 31, the processing module 32, the control module 33, and the positioning and calibrating module 34 may be implemented by a Central Processing Unit (CPU) or a Digital Signal Processor (DSP), or a Field Programmable Gate Array (FPGA) in a server.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention.

Claims (11)

1. A method for evaluating fluency of a terminal touch screen is characterized by comprising the following steps:
acquiring an image of a sliding of a designated icon in a terminal screen;
and analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen.
2. The method of claim 1, wherein before the acquiring the image of the sliding of the designated icon in the terminal screen, the method further comprises:
and controlling the execution equipment to perform sliding operation on the designated icon in the terminal screen.
3. The method according to claim 1 or 2, wherein the acquiring the image of the sliding of the designated icon in the terminal screen comprises:
and acquiring a real-time image acquired by image acquisition equipment and obtained by sliding the designated icon in the terminal screen.
4. The method according to claim 1 or 2, wherein the analyzing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen comprises:
analyzing the images frame by frame to obtain the frame number of the adjacent two screen refreshing intervals of the terminal in the images, and calculating the frame number of all the intervals in the obtained images to obtain the mean square error of the frame number of the adjacent two screen refreshing intervals of the terminal; the mean square error is used for evaluating the fluency of the terminal screen.
5. The method according to claim 1 or 2, characterized in that the method further comprises: and acquiring the first refreshing time delay of the terminal screen in the image, wherein the first refreshing time delay is used for assisting in evaluating the fluency of the terminal screen.
6. An apparatus for assessing fluency of a touch screen of a terminal, the apparatus comprising: an acquisition module and a processing module; wherein,
the acquisition module is used for acquiring an image of the sliding of the designated icon in the terminal screen;
and the processing module is used for analyzing and processing the image to obtain an evaluation parameter for evaluating the fluency of the terminal screen.
7. The apparatus according to claim 6, further comprising a control module for controlling an execution device to perform a sliding operation on a designated icon in the terminal screen.
8. The apparatus according to claim 6 or 7, wherein the obtaining module is specifically configured to obtain a real-time image captured by an image capturing device and obtained by sliding a designated icon in the terminal screen.
9. The apparatus according to claim 6 or 7, wherein the processing module is specifically configured to analyze the image frame by frame, obtain the number of frames between two adjacent screen refresh intervals of the terminal in the image, and calculate the obtained number of frames between all the intervals in the image to obtain a mean square error of the number of frames between two adjacent screen refresh intervals of the terminal; the mean square error is used for evaluating the fluency of the terminal screen.
10. The apparatus according to claim 6 or 7, wherein the processing module is further configured to obtain a first refresh delay of the terminal screen in the image, and the first refresh delay is used to assist in assessing fluency of the terminal screen.
11. A system for assessing fluency of a touch screen of a terminal, the system comprising: the system comprises an execution device, an image acquisition device and a terminal touch screen fluency evaluation device; wherein,
the execution equipment is used for performing sliding operation on the designated icon in the terminal screen;
the image acquisition equipment is used for acquiring an image of sliding of a designated icon in the terminal screen and sending the image to the fluency evaluation device of the terminal touch screen;
the terminal touch screen fluency assessment device is the terminal touch screen fluency assessment device according to any one of claims 6 to 10.
CN201410806589.4A 2014-12-22 2014-12-22 Method, device and system for evaluating fluency of terminal touch screen Pending CN105786336A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410806589.4A CN105786336A (en) 2014-12-22 2014-12-22 Method, device and system for evaluating fluency of terminal touch screen

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410806589.4A CN105786336A (en) 2014-12-22 2014-12-22 Method, device and system for evaluating fluency of terminal touch screen

Publications (1)

Publication Number Publication Date
CN105786336A true CN105786336A (en) 2016-07-20

Family

ID=56385288

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410806589.4A Pending CN105786336A (en) 2014-12-22 2014-12-22 Method, device and system for evaluating fluency of terminal touch screen

Country Status (1)

Country Link
CN (1) CN105786336A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018161421A1 (en) * 2017-03-08 2018-09-13 华为技术有限公司 Performance test method and performance test apparatus for touch display screen of terminal device
CN109117067A (en) * 2017-06-26 2019-01-01 深圳回收宝科技有限公司 The detection method and its device of terminal touch-control performance
CN115470153A (en) * 2022-11-14 2022-12-13 成都安易迅科技有限公司 Method, system and equipment for evaluating stability fluency of UI (user interface) of intelligent terminal system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103067552A (en) * 2013-01-22 2013-04-24 刘伟 Automatical detecting system of mobile phone
CN103076917A (en) * 2012-12-28 2013-05-01 华为终端有限公司 Method for adjusting fluency of display interface and terminal
CN103268194A (en) * 2013-04-18 2013-08-28 广州视睿电子科技有限公司 Delay time testing method and testing tool for interactive intelligent panel

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103076917A (en) * 2012-12-28 2013-05-01 华为终端有限公司 Method for adjusting fluency of display interface and terminal
CN103067552A (en) * 2013-01-22 2013-04-24 刘伟 Automatical detecting system of mobile phone
CN103268194A (en) * 2013-04-18 2013-08-28 广州视睿电子科技有限公司 Delay time testing method and testing tool for interactive intelligent panel

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018161421A1 (en) * 2017-03-08 2018-09-13 华为技术有限公司 Performance test method and performance test apparatus for touch display screen of terminal device
CN109117067A (en) * 2017-06-26 2019-01-01 深圳回收宝科技有限公司 The detection method and its device of terminal touch-control performance
CN115470153A (en) * 2022-11-14 2022-12-13 成都安易迅科技有限公司 Method, system and equipment for evaluating stability fluency of UI (user interface) of intelligent terminal system

Similar Documents

Publication Publication Date Title
CN105302701B (en) Method, device and equipment for testing reaction time of terminal user interface
CN108012143B (en) Binocular camera calibration method and device
WO2017134416A3 (en) Touchscreen panel signal processing
EP3226138B1 (en) Data acquisition chip test system and device and control method therefor
TW200623232A (en) Alignment information display method, program thereof, alignment method, exposure method, device manufacturing method, display system, display device, program, and measurement/inspection device
RU2013148400A (en) TEST DEVICE
CN104468916A (en) Test method based on cell phone response time
WO2020139018A3 (en) Signal processing device and image display apparatus including the same
WO2009057278A1 (en) Correction device to be incorporated into brain wave interface system, its method, and computer program
WO2009083995A3 (en) Process and apparatus for testing a component using an omni-directional eddy current probe
WO2019134684A1 (en) Oscilloscope signal processing method and device and oscilloscope
CN111402220B (en) Method and device for acquiring information
EP3349148A3 (en) Fingerprint identification method and apparatus
EP2182364A3 (en) Sample analyzer and calibration method of sample analyzer
EP2698727A3 (en) Terminal and method for determining type of input method editor
CN108871185B (en) Method, device and equipment for detecting parts and computer readable storage medium
CN105786336A (en) Method, device and system for evaluating fluency of terminal touch screen
WO2020225958A1 (en) Work analysis device, work analysis method and program
CN105405115A (en) Image module group alignment system and method thereof
CN103837828A (en) Travel curve test method and system of camera-shooting mode motor and mobile terminal
WO2019024450A1 (en) Device fault detection method and apparatus
CN104180823B (en) A kind of temperature compensation and device
EP3670109A3 (en) Method and apparatus for controlling behavior of service robot
CN104639714A (en) Test method of mobile phone response time
CN101340811A (en) Image optimized matching system and method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160720

RJ01 Rejection of invention patent application after publication