WO2015196601A1 - 用户界面反应时间的方法、装置及设备、存储介质 - Google Patents

用户界面反应时间的方法、装置及设备、存储介质 Download PDF

Info

Publication number
WO2015196601A1
WO2015196601A1 PCT/CN2014/087216 CN2014087216W WO2015196601A1 WO 2015196601 A1 WO2015196601 A1 WO 2015196601A1 CN 2014087216 W CN2014087216 W CN 2014087216W WO 2015196601 A1 WO2015196601 A1 WO 2015196601A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
time
terminal
acquisition
screen
Prior art date
Application number
PCT/CN2014/087216
Other languages
English (en)
French (fr)
Inventor
朴重烈
谢天助
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2015196601A1 publication Critical patent/WO2015196601A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software

Definitions

  • the present invention relates to the field of communication and testing, and in particular, to a method, device and device, and storage medium for testing a response time of a user interface (UI).
  • UI user interface
  • the interaction between the terminal product and the user needs to be completed by borrowing the UI of the terminal, and the terminal responds to the user's operation through the switching of the UI interface.
  • the response time of the UI is the most direct manifestation of the performance of the terminal UI, which directly affects the user's experience of using the terminal.
  • test process will affect the real reaction time of the terminal when running, slowing down the reaction speed of the terminal, resulting in inaccurate test results.
  • Embodiments of the present invention provide a method, a device, a device, and a storage medium for testing a UI UI response time.
  • the existing test methods are mostly based on instructions or running scripts, and the testing process affects the real reaction of the terminal during operation. Time, slowing down the reaction speed of the terminal, resulting in an inaccurate test result.
  • an embodiment of the present invention provides a method for testing a UI UI response time, including:
  • collecting the image on the screen of the terminal according to the image frame, and recording the time information corresponding to the image includes:
  • the preset condition includes: the heat value of the capacitor corresponding to the screen reaches a preset heat threshold, and/or the pressure value of the corresponding inductor of the screen reaches a preset pressure threshold; if the screen meets the preset condition And starting to collect images on the screen of the terminal according to the image frame, and recording time information corresponding to each image.
  • determining, according to the change rate of the difference between the adjacent two frames of images, the time point of stopping the acquisition of the last frame image includes:
  • the image is stopped, and the time information corresponding to the first frame image in the consecutive two frames of images when the preset difference threshold is reached is the time point when the acquisition is stopped.
  • the method further includes:
  • the image on the screen of the terminal is continuously collected, and the time information corresponding to each image is recorded; in the case that the action is not an erroneous operation, according to the image of the first frame in the collecting process
  • the acquisition time information and the time point when the acquisition is stopped determine the reaction time of the terminal UI.
  • the embodiment of the present invention further provides an apparatus for testing a UI UI response time, including:
  • the acquiring module is configured to collect an image on the screen of the terminal according to the image frame, and record time information corresponding to the image;
  • a first determining module configured to determine to stop collecting according to a change rate of the adjacent two frames of images The time point of the last frame of the image;
  • the second determining module is configured to determine a reaction time of the terminal UI according to the collection time information of the first frame image and the time point of the last frame image in the collecting process.
  • the collection module comprises:
  • the first detecting unit is configured to detect whether the terminal screen meets a preset condition, where the preset condition includes: the heat value of the capacitor corresponding to the screen reaches a preset heat threshold, and/or the pressure of the corresponding inductor of the screen The value reaches a preset pressure threshold;
  • the collecting unit is configured to, when the screen satisfies the preset condition, start collecting images on the screen of the terminal according to the image frame, and record time information corresponding to each image.
  • the first determining module comprises:
  • the determining unit is configured to determine whether a difference rate of change between adjacent two frames of images reaches a preset difference threshold
  • the determining unit is configured to stop acquiring the image when the change difference rate reaches the preset difference threshold, and determine that the time information corresponding to the first frame image in the consecutive two frames of images when the preset difference threshold is reached is stop collecting Time point.
  • the first determining module further includes:
  • a second detecting unit configured to detect whether the action of stopping the image capturing is an erroneous operation
  • the determining module determines the reaction time of the terminal UI according to the collection time information of the first frame image in the collection process and the time point when the collection is stopped.
  • the embodiment of the present invention further provides an apparatus for testing a UI UI response time, including:
  • a data collector for collecting time information and image information
  • a memory for saving the time information collected by the data collector and the image information
  • a processor configured to perform data processing on the information in the memory to determine a reaction time of the terminal UI.
  • the processor is further configured to calculate a change rate of change of two adjacent frames of images stored in the memory, and trigger the data collector to stop acquiring images when the change difference rate reaches a preset difference threshold And determining that the time information corresponding to the first frame image in the consecutive two frames of images when the preset difference threshold is reached is a time point when the acquisition is stopped, and according to the collection time information of the first frame image in the collecting process, The time point at which the acquisition is stopped determines the reaction time of the terminal UI.
  • an embodiment of the present invention provides a computer storage medium, where the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute a test terminal UI reaction time provided by the first aspect of the embodiments of the present invention.
  • the image on the screen of the terminal is collected, and the change rate of the image is determined by the collected image to further determine the reaction time of the terminal UI.
  • the test is not used to occupy the terminal running process, and thus does not affect the terminal running time.
  • the reaction speed and the test result are accurate.
  • the existing test methods are mostly based on instructions or running scripts. The test process will affect the real reaction time of the terminal, slow down the reaction speed of the terminal, and lead to inaccurate test results.
  • FIG. 1 is a flowchart of a method for testing a UI UI reaction time in an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of an apparatus for testing a UI UI reaction time in an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a device collection module for testing a UI UI reaction time in an embodiment of the present invention
  • FIG. 4 is a schematic structural diagram of a first determining module of a device for testing a UI UI reaction time according to an embodiment of the present invention
  • FIG. 5 is a schematic structural diagram of an apparatus for testing a UI UI reaction time in an embodiment of the present invention
  • FIG. 6 is a schematic structural diagram of an apparatus for testing a response time of a UI of a mobile terminal in a preferred embodiment of the present invention
  • FIG. 7 is a schematic flow chart of a method for testing a UI reaction time of a mobile terminal in a preferred embodiment of the present invention.
  • test process affects the real reaction time of the terminal, and slows down the reaction speed of the terminal, resulting in inaccurate test results.
  • the method, the device and the device for testing the UI UI reaction time are further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of the invention and are not intended to limit the scope of the invention.
  • An embodiment of the present invention provides a method for testing a UI UI response time.
  • the process is as shown in FIG. 1 and includes steps S102 to S106:
  • Step S102 collecting an image on the screen of the terminal according to the image frame, and recording time information corresponding to the image;
  • Step S104 determining, according to the change rate of the difference between the adjacent two frames of images, a time point at which the acquisition of the last frame image is stopped;
  • Step S106 Determine the reaction time of the terminal UI according to the acquisition time information of the first frame image and the time point of the last frame image in the collection process.
  • the embodiment of the invention collects the image on the screen of the terminal, determines the change rate of the change through the collected image, and further determines the reaction time of the terminal UI.
  • the test is performed without using the terminal, so the reaction speed of the terminal is not affected.
  • the test results are accurate, and the existing test methods are mostly based on instructions or running scripts.
  • the test process will affect the real reaction time of the terminal when running, slow down the reaction speed of the terminal, and lead to inaccurate test results.
  • collecting the image on the screen of the terminal according to the image frame, and recording the time information corresponding to the image includes: detecting whether the screen of the terminal meets the preset condition, wherein the preset condition includes: the heat value of the capacitor corresponding to the screen reaches the preset heat The threshold value, and/or the pressure value of the corresponding inductor of the screen reaches a preset pressure threshold; if the screen meets the preset condition, the image on the screen of the terminal is collected according to the image frame, and the time information corresponding to each image is recorded.
  • the preset condition includes: the heat value of the capacitor corresponding to the screen reaches the preset heat The threshold value, and/or the pressure value of the corresponding inductor of the screen reaches a preset pressure threshold; if the screen meets the preset condition, the image on the screen of the terminal is collected according to the image frame, and the time information corresponding to each image is recorded.
  • a person skilled in the art can set different trigger conditions according to different terminal screens, for example, using the pressure index as an initial
  • the process of determining the time point of stopping the acquisition of the last frame image according to the change rate of the adjacent two frames of images may be first determining whether the change rate of the difference between the adjacent two frames reaches the preset difference threshold; When the rate reaches the preset difference threshold, the image is stopped, and the time information corresponding to the first frame image in the consecutive two frames of images when the preset difference threshold is reached is the time point when the acquisition is stopped.
  • the preset difference threshold may be set according to the accuracy of the user's requirement. In the normal case, the preset difference threshold is 0%, and a person skilled in the art may finely adjust the percentage according to user requirements.
  • the terminal may have an erroneous operation during operation. For example, when the user waits for the webpage to be opened, the page is not refreshed, and the image change rate of two consecutive frames may be judged as 0%. At this time, it is an erroneous operation. Therefore, after determining that the time information corresponding to the first frame image in the consecutive two frames of images when the preset difference threshold is reached is the time point when the acquisition is stopped, it is also possible to detect that the last frame of the image is stopped.
  • the action is a misoperation; if the action is a misoperation, continue to collect the image on the screen of the terminal, and record the time information corresponding to each image; in the case that the action is not an erroneous operation, according to the image of the first frame in the acquisition process
  • the acquisition time information and the time point when the acquisition is stopped determine the reaction time of the terminal UI.
  • An embodiment of the present invention further provides a device for testing a UI UI response time.
  • the structure of the device is shown in FIG. 2, and includes:
  • the acquisition module 10 is configured to collect an image on the screen of the terminal according to the image frame, and record the image Corresponding time information;
  • the first determining module 20 is coupled to the collecting module 10, and configured to determine, according to the change rate of the adjacent two frames of images, a time point at which the last frame of the image is stopped.
  • the second determining module 30 is coupled to the first determining module 20 and configured to determine the reaction time of the terminal UI according to the collecting time information of the first frame image and the time point of the last frame image in the collecting process.
  • FIG. 3 is a schematic structural diagram of the collection module 10.
  • the collection module 10 further includes:
  • the first detecting unit 101 is configured to detect whether the terminal screen meets a preset condition, where the preset condition includes: the heat value of the capacitor corresponding to the screen reaches a preset heat threshold, and/or the pressure value of the corresponding inductor of the screen reaches a preset value Set the pressure threshold;
  • the collecting unit 102 is coupled to the first detecting unit 101 and configured to collect images on the screen of the terminal according to the image frame and record time information corresponding to each image if the screen meets the preset condition.
  • FIG. 4 is a schematic structural diagram of the first determining module 20, where the first determining module 20 includes:
  • the determining unit 201 is configured to determine whether a difference rate of change between adjacent two frames of images reaches a preset difference threshold
  • the determining unit 202 is coupled to the determining unit 201, configured to stop acquiring images when the change difference rate reaches the preset difference threshold, and determine time information corresponding to the first frame image in consecutive two frames of images when the preset difference threshold is reached. The point in time at which to stop the acquisition.
  • the first determining module 20 may further include:
  • the second detecting unit is coupled to the determining unit 202, configured to detect whether the action of stopping the image capturing is an erroneous operation; and in the case that the action is a erroneous operation, the triggering collecting module continues to collect the image on the screen of the terminal, and records the corresponding image. Time information; in the case that the action is not an erroneous operation, the triggering second determining module determines the reaction time of the terminal UI according to the acquisition time information of the first frame image in the acquisition process and the time point when the acquisition is stopped.
  • An embodiment of the present invention further provides a device for testing a UI UI response time.
  • the architecture of the device is shown in FIG. 5, and includes:
  • a data collector 1 for collecting time information and image information
  • the memory 2 is coupled to the data collector 1 for storing time information and image information collected by the data collector;
  • the processor 3 is coupled to the memory 2 for performing data processing on the information in the memory to determine the reaction time of the terminal UI.
  • the processor 3 is further configured to calculate a change rate of the difference between two adjacent frames of the image stored in the memory.
  • the change difference rate reaches a preset difference threshold
  • the data collector is triggered to stop collecting the image, and determining that the preset difference threshold is reached.
  • the time information corresponding to the first frame image in the consecutive two frames of the image is the time point when the acquisition is stopped, and then the reaction time of the terminal UI is determined according to the acquisition time information of the first frame image during the acquisition process and the time point when the acquisition is stopped. .
  • the device for testing the response time of the UI of the terminal includes a plurality of modules, and those skilled in the art know that the device can be set as a separate processor or disposed in a certain processor, and details are not described herein. .
  • the embodiment of the present invention provides a method for testing the UI reaction time by using an image analysis method, which can objectively evaluate the user experience of the UI terminal response time of the mobile terminal.
  • An embodiment of the present invention provides a device for testing a UI reaction time by using an image analysis method.
  • the device includes: a data collector, a memory, and a processor.
  • various parts of the device may be designed as A chip unit capable of realizing its function.
  • the data collector is named as an image acquisition unit and a startup recording unit
  • the memory is named as a storage unit
  • the processor is named as a data analysis unit.
  • the above units are only changed in name, and the functions they implement are the same. Those skilled in the art can design according to The demand changes the unit name.
  • the image acquisition unit is configured to record the change of the UI UI of the terminal during the operation of the mobile terminal, and send the collected image to the storage unit.
  • the image acquisition unit may Is a collector of the camera type;
  • the recording unit is configured to record the start time of the operation of the mobile terminal by the user, and the time of each picture collected, and send the data to the storage unit, so that the data analysis unit analyzes the data;
  • a storage unit configured to receive image resources sent by the image collection unit, and sort the image resources according to time stamps, and provide a data analysis unit to make the call;
  • a data analysis unit for selecting an image analysis target and calculating the time.
  • the image acquisition unit controls image recording by the startup recording unit, and the data analysis unit startup time data is provided by the image acquisition unit to determine the starting point of the image data.
  • a signal that triggers the start of operation of the image acquisition unit is transmitted by sensing the pressure of the terminal screen.
  • the change of the pressure of the touch screen of the mobile phone is felt, and the information of the pressure change is converted into an electrical signal and sent to the data analysis unit, and the data analysis unit determines the starting time of the time required for the analysis according to the received pressure signal.
  • the embodiment of the invention further provides a method for testing the reaction time of the UI of the mobile terminal by using image analysis, which is implemented by the above device for testing the UI reaction time, which comprises the following process:
  • the data analyzing unit extracts the starting picture information of the mobile terminal UI according to the signal of the receiving time recording unit, and combines the image information provided by the image collecting unit, and determines the reaction start time, and displays the image of the change start time in the data.
  • the analysis unit is for confirmation by the analyst;
  • the data analysis unit analyzes and calculates the change rate of the two consecutive frames according to the image of the image acquisition unit continuously changing the UI interface of the mobile terminal, and determines that the two frames of the change rate of 0% automatically stop the image recording, and then the image can be displayed.
  • the data analysis unit for analysts Confirmation In the data analysis unit for analysts Confirmation
  • the time period difference information of the two frames of images is automatically calculated according to the data analysis unit to automatically determine or analyze the image of the selected start time image and the change deadline, and the time period information of the change process is generated.
  • the time recording unit records the corresponding time information according to the pressure change, and the image acquired by the image acquisition unit corresponding to the pressure change time.
  • the image obtained by the image acquisition unit has an image with a difference rate of 0 for two consecutive frames, and the first image with time difference information of 0%.
  • the method for testing the response time of the mobile terminal UI by using the image analysis controls the image acquisition unit to start image collection by the time recording unit, and marks the time information, and sends the information to the storage unit for saving; the data analysis unit performs the continuous image.
  • the user can automatically select an image in the data analysis unit or calculate the time according to the manual selection of the image, objectively calculate the UI change time of the UI to obtain the UI reaction time data, compare the time data with the same type of product, and objectively evaluate the movement. Terminal UI performance level.
  • FIG. 6 is a schematic structural diagram of an apparatus for testing a reaction time of a UI of a mobile terminal according to an embodiment of the present invention. As shown in FIG. 6, the method includes: an image collection unit 11, a time recording unit 12, a storage unit 13, and a data analysis unit 14.
  • the image collecting unit 11 is configured to record, when the user operates the mobile terminal, the change of the UI UI of the terminal during all operations, and send the collected image to the storage unit 13; and also be used for the automatic recording and time recording unit.
  • 12 provides the image information matching the startup time information, and sends the image information matching the startup time information to the storage unit 13; and is further used by the data analysis unit 14 to automatically close the image acquisition process after the image acquisition signal is stopped, and versus The image information whose image acquisition stop signal time information matches is transmitted to the storage unit 13.
  • the image collection unit 11 starts image collection for the entire operation process and the UI change process, and specifically includes: the user starts the mobile terminal UI reaction time evaluation system in the data analysis unit 14 , and the image acquisition system 11
  • the image acquisition state is immediately entered, and the acquired images are sent to the storage unit 13 for storage.
  • Each image is recorded with corresponding time information, and is sequentially stored in the storage unit 13 according to the time label.
  • the time recording unit 12 the user places the mobile terminal on the operation plane of the time recording unit 12, and when the user performs the manual operation on the mobile terminal by the time recording unit 12, the finger operates on the screen of the mobile terminal to activate the time recording unit 12 to record the user's finger contact.
  • the terminal screen is moved and the time information when the pressure changes is generated, and the time recording unit 12 sends the time information to the data analysis unit 14 for recording.
  • the storage unit 13 stores the image resources collected by the image collection unit 11 in an orderly manner according to the time stamp information, and opens information such as image resources and time labels to the data analysis unit 14 for retrieval and analysis at any time.
  • the data analyzing unit 14 controls the image capturing unit 11 and the time recording unit 12 to start or stop the operation, and performs data parsing according to the time tag information and the image information provided by the time starting unit 12 and the storage unit 13 for the user to change the process of the mobile terminal UI.
  • the start and end images are confirmed, and the time period of the change process of the mobile terminal UI is automatically calculated.
  • the data analysis unit 14 initiates image analysis of the entire operation process and the UI change process, and specifically includes: analyzing the storage unit 13 according to the time information data sent by the time recording unit 12.
  • the image information of the time information object transmitted with the time recording unit 12 is stored, and the image information is displayed at the start image position in the data analysis unit 14 for manual confirmation by the user.
  • the difference rate analysis of the consecutive two frames of images is performed, and the image of the first time sequence of two frames with a difference rate of 0% is automatically filtered, and the stop image collection is simultaneously sent.
  • the instruction to image acquisition unit 11 stops image acquisition and displays the image at the end image position of the data analysis unit 14 for manual confirmation by the user.
  • the user can manually select the start image and the end image in the data analysis unit 14. After the user confirms the start image and the end image in the data analysis unit 14, the data analysis unit 14 will pair the storage unit 13 according to the image time label determined by the user. The image resources are collated, and only the first and last 100 frames of images corresponding to the determined start and end time tags are reserved for data analysis by the data analysis unit 14. The image resources of other storage units for the current mobile terminal UI change process will be cleaned up.
  • the data analysis unit 14 automatically calculates the time period of the change process of the mobile terminal UI according to the final image of the start image and the end image determined by the user, and displays it in the data analysis unit for the user to read.
  • FIG. 7 is a schematic flowchart of a method for testing a UI reaction time of a mobile terminal according to an embodiment of the present invention. As shown in FIG. 7, a method for testing a response time of a mobile terminal UI by using image analysis includes steps S701 to S703.
  • the data analysis unit extracts, according to the signal of the receiving time recording unit, the image information provided by the image capturing unit, the starting picture information of the mobile terminal UI, and determines the reaction start time, and displays the image of the change start time. In the data analysis unit for the analyst to confirm.
  • the image acquisition unit saves the collected image to the storage unit at a time; the time recording unit records the time information when the change occurs when the pressure is changed; the data analysis unit combines the time data provided by the time recording unit, and The image resource time stamps stored in the storage unit are parsed and matched, and the image information with the same time stamp information is displayed in the start image position of the data analysis unit for the analyst to confirm.
  • Step S702 the data analysis unit analyzes and calculates the change rate of the change of the consecutive two frames according to the image of the image acquisition unit continuously changing the UI interface of the mobile terminal, and determines the change rate of the change.
  • the 0% two-frame image automatically stops image recording and displays the image in the data analysis unit for analysis by the analyst.
  • the data analysis unit analyzes the change rate of the continuous two frames of images at the same time as the storage unit performs image storage, and when the obtained difference rate is 0%, the signal is sent to the image acquisition unit and the time recording unit stops working;
  • the analyzing unit displays the first frame image of the consecutive two frames of the image difference rate of 0% in the data analysis unit end time image position for confirmation by the analyst.
  • Step S703 automatically determining or analyzing the image of the selected start time image and the change deadline according to the data analysis unit, and automatically calculating the time difference of the two frame images to generate time period information of the change process.
  • the data analysis unit respectively displays the images of the corresponding time in the start time image and the change deadline time, and the analyst can use the image front and rear selection buttons provided by the data analysis unit to perform manual image confirmation to avoid automatic selection of the image. deviation.
  • the data analysis unit automatically calculates the time difference between the two images after the analyst confirms the start and cutoff position images, and obtains time period information of the UI change process of the mobile terminal; the data analysis unit sends the command to the storage unit, according to The time tag information of the start and cutoff images determined by the analyst, the 100 frames of images before and after the time tag are reserved as data queries, and the remaining image resources are automatically deleted to control the image unit space.
  • the method provided by the embodiment of the invention is an objective, accurate and quantitative means for reflecting the time measurement of the UI of the mobile terminal product, and the UI reaction time feeling in the process of using the mobile terminal is quantified by time data, and the evaluation and analysis process is realized. All of the automation, data accuracy can also be accurate to the order of ms, can effectively guide the improvement and improvement of the UI response time user experience of mobile terminal products.
  • the collecting module, the first determining module and the second determining module in the device for testing the reaction time of the user interface of the terminal provided by the embodiment of the present invention, and the units included in the collecting module, the first Determining the modules and the like included in the module can be implemented by a processor in the terminal; of course, the functions performed by the processor can also be implemented by specific logic circuits; in the process of the specific embodiment, the processor can be a central processing unit ( CPU), microprocessor (MPU), digital signal processor (DSP) or field programmable gate array (FPGA).
  • CPU central processing unit
  • MPU microprocessor
  • DSP digital signal processor
  • FPGA field programmable gate array
  • the method for testing the reaction time of the user interface of the terminal is implemented in the form of a software function module, and is sold or used as a stand-alone product, it may also be stored in a computer readable storage medium. in.
  • the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions.
  • a computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read only memory (ROM), a magnetic disk, or an optical disk.
  • program codes such as a USB flash drive, a mobile hard disk, a read only memory (ROM), a magnetic disk, or an optical disk.
  • the embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores computer executable instructions for performing test terminal user interface reaction time provided in various embodiments of the present invention. Methods.
  • the image on the screen of the terminal is collected according to the image frame, and the time information corresponding to the image is recorded; and the time point at which the last frame image is stopped is determined according to the change rate of the adjacent two frames; Acquisition time information and last frame image of one frame of image
  • the time point determines the reaction time of the terminal user interface; thus, the response time of the terminal user interface is determined by the collected image to determine the reaction time of the terminal user interface, and does not occupy the terminal running process, so the reaction speed of the terminal operation is not affected, and the test result is accurate. It solves the problem that the existing test methods are mostly based on instructions or running scripts, and the test process will affect the real reaction time of the terminal when running, slow down the reaction speed of the terminal, and lead to the problem that the test result is not accurate enough.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

提供一种测试终端用户界面反应时间的方法、装置及设备、存储介质，该方法包括：按照图像帧采集终端屏幕上的图像，并记录图像对应的时间信息（S102）；根据相邻两帧图像的变化差异率确定停止采集最后一帧图像的时间点（S104）；根据采集过程中第一帧图像的采集时间信息和最后一帧图像的时间点确定终端用户界面的反应时间（S106）。

Description

用户界面反应时间的方法、装置及设备、存储介质 技术领域
本发明涉及通讯和测试领域，特别是涉及一种测试终端用户界面(UI，User Interface)反应时间的方法、装置及设备、存储介质。
背景技术
终端类产品与用户的交互需要借用终端的UI来完成，终端通过UI界面的切换来对用户的操作进行相应的反馈。UI的反应时间是终端UI性能最直接的体现，直接影响用户对于终端的使用感受。
现有的测试方法大都基于指令或运行脚本进行测试，其测试过程会影响终端运行时的真实反应时间，拖慢终端反应速度，导致测试结果不够准确。
发明内容
本发明实施例提供一种测试终端UI反应时间的方法、装置及设备、存储介质，用以解决现有的测试方法大都基于指令或运行脚本进行测试，其测试过程会影响终端运行时的真实反应时间，拖慢终端反应速度，导致测试结果不够准确的问题。
为解决上述技术问题，第一方面，本发明实施例提供一种测试终端UI反应时间的方法，包括：
按照图像帧采集终端屏幕上的图像，并记录所述图像对应的时间信息；根据相邻两帧图像的变化差异率确定停止采集最后一帧图像的时间点；根据采集过程中第一帧图像的采集时间信息和所述最后一帧图像的时间点确定终端UI的反应时间。
优选地，按照图像帧采集终端屏幕上的图像，并记录所述图像对应的时间信息包括：
检测所述终端屏幕是否满足预设条件，其中，
所述预设条件包括：屏幕对应的电容的热量值达到预设热量阈值，和/或，屏幕对应的电感的压力值达到预设压力阈值；在所述屏幕满足所述预设条件的情况下，开始按照图像帧采集所述终端屏幕上的图像，并记录各个图像对应的时间信息。
优选地，根据相邻两帧图像的变化差异率确定停止采集最后一帧图像的时间点包括：
判断相邻两帧图像间的变化差异率是否达到预设差异阈值；
在所述变化差异率达到预设差异阈值时，停止采集图像，并确定达到所述预设差异阈值时的连续两帧图像中的第一帧图像对应的时间信息为停止采集时的时间点。
优选地，确定达到所述预设差异阈值时的连续两帧图像中的第一帧图像对应的时间信息为停止采集的时间点之后，还包括：
检测停止采集图像的动作是否为误操作；
在所述动作是误操作的情况下，继续采集终端屏幕上的图像，并记录各个图像对应的时间信息；在所述动作不是误操作的情况下，根据所述采集过程中第一帧图像的采集时间信息和所述停止采集时的时间点确定终端UI的反应时间。
第二方面，本发明实施例还提供一种测试终端UI反应时间的装置，包括：
采集模块，配置为按照图像帧采集终端屏幕上的图像，并记录所述图像对应的时间信息；
第一确定模块，配置为根据相邻两帧图像的变化差异率确定停止采集 最后一帧图像的时间点；
第二确定模块，配置为根据采集过程中第一帧图像的采集时间信息和所述最后一帧图像的时间点确定终端UI的反应时间。
优选地，所述采集模块包括：
第一检测单元，配置为检测所述终端屏幕是否满足预设条件，其中，所述预设条件包括：屏幕对应的电容的热量值达到预设热量阈值，和/或，屏幕对应的电感的压力值达到预设压力阈值；
采集单元，配置为在所述屏幕满足所述预设条件的情况下，开始按照图像帧采集所述终端屏幕上的图像，并记录各个图像对应的时间信息。
优选地，所述第一确定模块包括：
判断单元，配置为判断相邻两帧图像间的变化差异率是否达到预设差异阈值；
确定单元，配置为在所述变化差异率达到预设差异阈值时，停止采集图像，并确定达到所述预设差异阈值时的连续两帧图像中的第一帧图像对应的时间信息为停止采集时的时间点。
优选地，所述第一确定模块还包括：
第二检测单元，配置为检测停止采集图像的动作是否为误操作；
并在所述动作是误操作的情况下，触发所述采集模块继续采集终端屏幕上的图像，并记录各个图像对应的时间信息；在所述动作不是误操作的情况下，触发所述第二确定模块根据所述采集过程中第一帧图像的采集时间信息和所述停止采集时的时间点确定终端UI的反应时间。
第三方面，本发明实施例还提供一种测试终端UI反应时间的设备，包括：
数据采集器，用于采集时间信息和图像信息；
存储器，用于保存所述数据采集器采集到的所述时间信息和所述图像 信息；
处理器，用于对所述存储器内的信息进行数据处理，以确定终端UI的反应时间。
优选地，所述处理器，还配置为计算所述存储器内存储的相邻两帧图像的变化差异率，在所述变化差异率达到预设差异阈值时，触发所述数据采集器停止采集图像，并确定达到所述预设差异阈值时的连续两帧图像中的第一帧图像对应的时间信息为停止采集时的时间点，再根据采集过程中第一帧图像的采集时间信息和所述停止采集时的时间点确定终端UI的反应时间。
第四方面，本发明实施例提供一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，该计算机可执行指令用于执行本发明实施例第一方面提供的测试终端UI反应时间的方法。
本发明实施例提供中，采集终端屏幕上的图像，通过采集到的图像确定变化差异率，进一步确定终端UI的反应时间，使用该方法进行测试不占用终端运行进程，因此不影响终端运行时的反应速度，测试结果准确，解决了现有的测试方法大都基于指令或运行脚本进行测试，其测试过程会影响终端运行时的真实反应时间，拖慢终端反应速度，导致测试结果不够准确的问题。
附图说明
图1是本发明实施例中测试终端UI反应时间的方法的流程图；
图2是本发明实施例中测试终端UI反应时间的装置的结构示意图；
图3是本发明实施例中测试终端UI反应时间的装置采集模块的结构示意图；
图4是本发明实施例中测试终端UI反应时间的装置第一确定模块的结构示意图；
图5是本发明实施例中测试终端UI反应时间的设备的架构示意图；
图6是本发明优选实施例中测试移动终端UI反应时间的设备的结构示意图；
图7是本发明优选实施例中测试移动终端UI反应时间的方法的流程示意图。
具体实施方式
为了解决现有的测试方法大都基于指令或运行脚本进行测试，其测试过程会影响终端运行时的真实反应时间，拖慢终端反应速度，导致测试结果不够准确的问题，本发明实施例提供了一种测试终端UI反应时间的方法、装置及设备，以下结合附图以及实施例，对本发明实施例进行进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明的技术方案，并不限定本发明的保护范围。
本发明实施例提供了一种测试终端UI反应时间的方法，其流程如图1所示，包括步骤S102至步骤S106：
步骤S102，按照图像帧采集终端屏幕上的图像，并记录图像对应的时间信息；
步骤S104，根据相邻两帧图像的变化差异率确定停止采集最后一帧图像的时间点；
步骤S106，根据采集过程中第一帧图像的采集时间信息和最后一帧图像的时间点确定终端UI的反应时间。
本发明实施例采集终端屏幕上的图像，通过采集到的图像确定变化差异率，进一步确定终端UI的反应时间，使用该方法进行测试不占用终端运行进程，因此不影响终端运行时的反应速度，测试结果准确，解决了现有的测试方法大都基于指令或运行脚本进行测试，其测试过程会影响终端运行时的真实反应时间，拖慢终端反应速度，导致测试结果不够准确的问题。
测试过程中，按照图像帧采集终端屏幕上的图像，并记录图像对应的时间信息包括：检测终端屏幕是否满足预设条件，其中，预设条件包括：屏幕对应的电容的热量值达到预设热量阈值，和/或，屏幕对应的电感的压力值达到预设压力阈值；在屏幕满足预设条件的情况下，开始按照图像帧采集终端屏幕上的图像，并记录各个图像对应的时间信息。本领域技术人员可以根据终端屏幕不同而设置不同的触发条件，例如将压力指数作为触发采集图像的初始信号。
实现时，根据相邻两帧图像的变化差异率确定停止采集最后一帧图像的时间点的过程可以是先判断相邻两帧图像间的变化差异率是否达到预设差异阈值；再在变化差异率达到预设差异阈值时，停止采集图像，并确定达到预设差异阈值时的连续两帧图像中的第一帧图像对应的时间信息为停止采集时的时间点。其中，预设差异阈值可以根据用户需求的准确度不同来进行设置，在通常情况下，该预设差异阈值为0％，本领域技术人员根据用户需求，可以对该百分比进行细微的上调。
由于用户对终端的操作存在多元化，因此，终端在操作时可能会存在误操作，例如，在用户等待打开网页时，页面未刷新出来，则连续两帧图像变化差异率可能被判为0％，此时就是误操作，因此，在确定达到预设差异阈值时的连续两帧图像中的第一帧图像对应的时间信息为停止采集时的时间点之后，还可以检测停止采集最后一帧图像的动作是否为误操作；在动作是误操作的情况下，继续采集终端屏幕上的图像，并记录各个图像对应的时间信息；在动作不是误操作的情况下，根据采集过程中第一帧图像的采集时间信息和停止采集时的时间点确定终端UI的反应时间。
本发明实施例还提供一种测试终端UI反应时间的装置，该装置的结构示意如图2所示，包括：
采集模块10，配置为按照图像帧采集终端屏幕上的图像，并记录图像 对应的时间信息；
第一确定模块20，与采集模块10耦合，配置为根据相邻两帧图像的变化差异率确定停止采集最后一帧图像的时间点；
第二确定模块30，与第一确定模块20耦合，配置为根据采集过程中第一帧图像的采集时间信息和最后一帧图像的时间点确定终端UI的反应时间。
图3示出了采集模块10的结构示意图，采集模块10还包括：
第一检测单元101，配置为检测终端屏幕是否满足预设条件，其中，预设条件包括：屏幕对应的电容的热量值达到预设热量阈值，和/或，屏幕对应的电感的压力值达到预设压力阈值；
采集单元102，与第一检测单元101耦合，配置为在屏幕满足预设条件的情况下，开始按照图像帧采集终端屏幕上的图像，并记录各个图像对应的时间信息。
图4示出了第一确定模块20的结构示意图，第一确定模块20包括：
判断单元201，配置为判断相邻两帧图像间的变化差异率是否达到预设差异阈值；
确定单元202，与判断单元201耦合，配置为在变化差异率达到预设差异阈值时，停止采集图像，并确定达到预设差异阈值时的连续两帧图像中的第一帧图像对应的时间信息为停止采集时的时间点。
优选的，第一确定模块20还可以包括：
第二检测单元，与确定单元202耦合，配置为检测停止采集图像的动作是否为误操作；并在动作是误操作的情况下，触发采集模块继续采集终端屏幕上的图像，并记录各个图像对应的时间信息；在动作不是误操作的情况下，触发第二确定模块根据采集过程中第一帧图像的采集时间信息和停止采集时的时间点确定终端UI的反应时间。
本发明实施例还提供一种测试终端UI反应时间的设备，其架构示意如图5所示，包括：
数据采集器1，用于采集时间信息和图像信息；
存储器2，与数据采集器1耦合，用于保存数据采集器采集到的时间信息和图像信息；
处理器3，与存储器2耦合，用于对存储器内的信息进行数据处理，以确定终端UI的反应时间。
其中，处理器3，还用于计算存储器内存储的相邻两帧图像的变化差异率，在变化差异率达到预设差异阈值时，触发数据采集器停止采集图像，并确定达到预设差异阈值时的连续两帧图像中的第一帧图像对应的时间信息为停止采集时的时间点，再根据采集过程中第一帧图像的采集时间信息和停止采集时的时间点确定终端UI的反应时间。
在上述实施例中，测试终端UI反应时间的装置包括多个模块，本领域技术人员知晓，可以将该装置设置成为一个独立的处理器或设置在某一个处理器之中，此处不再赘述。
优选实施例
基于现有技术检测UI反应时间的技术都不够精确，因此，本发明实施例提供一种利用图像分析的方式测试UI反应时间的方法，该方法能够客观的评估移动终端UI反应时间的用户感受。
本发明实施例提供了一种利用图像分析的方式测试UI反应时间的设备，该设备包括：数据采集器、存储器、处理器，本领域技术人员在设计时，可以将该设备的各个部分设计为能够实现其功能的芯片单元，例如，本发明实施例中，将数据采集器命名为图像采集单元和启动记录单元，将存储器命名为存储单元，将处理器命名为数据分析单元。上述各单元只是名称有所改变，其实现的功能相同，本领域技术人员在设计时，可以根据 需求改变单元名称。
其中，图像采集单元，用于在用户对移动终端进行操作时，记录全部操作过程中终端UI界面的变化情况，并将采集的图像发送给存储单元，在本实施例中，该图像采集单元可以是摄像头类的采集器；
启动记录单元，用于记录用户对移动终端操作的起始时间，和采集到的各个图片的时间，并将数据发送给存储单元，以便数据分析单元对其进行分析处理；
存储单元，用于接收图像采集单元发送的图像资源，并将图像资源根据时间标记进行排序，提供数据分析单元进行调用；
数据分析单元，用于图像分析目标的选取和时间的计算。
实现时，图像采集单元由启动记录单元控制启动图像记录，数据分析单元启动时间数据由图像采集单元提供图像数据确定分析起点。
例如，对于电阻式屏幕的终端，通过感应终端屏幕的压力来发送触发图像采集单元开始工作的信号。在用户操作移动终端时，感受手机触摸屏幕压力的变化，并将压力变化的信息转化为电信号，并发送至数据分析单元，数据分析单元根据所接收的压力信号确定分析所需的时间起点。
本发明实施例还提供了一种利用图像分析来测试移动终端UI反应时间的方法，该方法通过上述测试UI反应时间的设备来实现，其包括如下过程：
数据分析单元根据接收时间记录单元的信号，结合图像采集单元提供的图像信息，提取移动终端UI发生变化的起始图片信息，并且确定反应起始时间，并将变化起始时间的图像显示在数据分析单元供分析人员进行确认；
数据分析单元根据图像采集单元在移动终端UI界面连续变化过程的图像，分析计算连续两帧图像的变化差异率，确定变化差异率为0％的两帧图像自动停止图像记录，之后可以将图像显示在数据分析单元供分析人员进 行确认；
根据数据分析单元自动判断或者分析人员人为选定的起始时间图像、变化截至时间的图像，自动计算两帧图像的时间差值生成该变化过程的时间周期信息。
起始图像资源中，时间记录单元根据压力变化记录其对应的时间信息，图像采集单元所采集的与压力变化时间相对应的图像。停止图像资源中，图像采集单元采集的连续两帧图像差异率为0的图像，差异率为0％的第一张包含时间信息的图像。
本发明实施例所提供的利用图像分析来测试移动终端UI反应时间的方法，通过时间记录单元控制图像采集单元启动图像采集，并标记时间信息，发送给存储单元进行保存；数据分析单元进行连续图像的差异率分析，并控制图像采集单元停止图像采集动作，将UI变化完成时间的图像发送存储单元进行保存。同时用户可以在数据分析单元中自动选择图像或者根据人工选择图像进行时间的计算，客观的计算整个UI变化过程时间得出UI反应时间数据，以时间数据与同类型产品进行横向比较，客观评价移动终端UI性能水平。
下面结合附图对本发明的技术方案进一步详细阐述。
图6为本发明实施例测试移动终端UI反应时间的设备的结构示意图，如图6所示，包括：图像采集单元11、时间记录单元12、存储单元13和数据分析单元14。
其中，图像采集单元11，用于在用户对移动终端进行操作时，记录全部操作过程中终端UI界面的变化情况，并将采集的图像发送给存储单元13；还用于自动记录与时间记录单元12提供的启动时间信息相匹配的图像信息，并将与启动时间信息相匹配的图像信息发送至存储单元13；还用于数据分析单元14提供停止图像采集信号后自动关闭图像采集过程，并将与 图像采集停止信号时间信息相匹配的图像信息发送至存储单元13。在用户进行移动终端某一场景操作时，图像采集单元11启动对整个操作过程、UI变化过程的图像采集，具体包括：用户在数据分析单元14启动移动终端UI反应时间评价系统，图像采集系统11即刻进入图像采集状态，并将所采集的图像发送到存储单元13进行保存，每一幅图像都记录有相应的时间信息，并在存储单元13按照时间标签进行有序存放。
时间记录单元12，用户将移动终端放置在时间记录单元12操作平面，用户在时间记录单元12对移动终端进行人工操作时，手指在移动终端屏幕进行操作会启动时间记录单元12，记录用户手指接触移动终端屏幕并产生压力变化时的时间信息，时间记录单元12会将该时间信息发动给数据分析单元14进行记录。
存储单元13，将图像采集单元11采集的图像资源，按照时间标签信息有序存放，并将图像资源、时间标签等信息开放给数据分析单元14进行随时调取、解析。
数据分析单元14，控制图像采集单元11、时间记录单元12启动或者停止工作，并根据时间启动单元12、存储单元13提供的时间标签信息、图像信息进行数据解析，供用户对移动终端UI变化过程的起止图像进行确认，并自动计算移动终端UI变化过程的时间周期。
具体的，在用户进行移动终端某一场景操作时，数据分析单元14启动对整个操作过程、UI变化过程的图像解析，具体包括：根据时间记录单元12发送的时间信息数据，解析存储单元13中存储的与时间记录单元12发送的时间信息对象的图像信息，并将该图像信息显示在数据分析单元14中的起始图像位置，供用户进行人工确认。
根据存储单元13保存的图像数据，进行连续两帧图像的差异率解析，自动筛选第一时间顺序的两帧差异率为0％的图像，同时发送停止图像采集 指令至图像采集单元11停止图像采集，并将该图像显示在数据分析单元14种的结束图像位置，供用户进行人工进行确认。
用户可以在数据分析单元14对于起始图像、结束图像进行人工选择，用户在数据分析单元14确认起始图像、结束图像之后，数据分析单元14将根据用户确定的图像时间标签，对存储单元13的图像资源进行整理，仅保留确定的起始、结束时间标签对应的前后100帧图像供数据分析单元14进行数据解析使用，其他存储单元针对当前移动终端UI变化过程的图像资源将被清理。
数据分析单元14，根据用户最终确定的起始图像、结束图像的时间标签信息，自动计算移动终端UI变化过程的时间周期，并显示在数据分析单元供用户读取。
图7为本发明实施例测试移动终端UI反应时间的方法的流程示意图，如图7所示，利用图像分析测试移动终端UI反应时间的方法包括步骤S701至S703。
S701，数据分析单元根据接收时间记录单元的信号，结合图像采集单元提供的图像信息，提取移动终端UI发生变化的起始图片信息，并且确定反应起始时间，并将变化起始时间的图像显示在数据分析单元供分析人员进行确认。
具体的，图像采集单元，将采集的图像时时保存至存储单元；时间记录单元，在感应到压力产生变化时，记录变化时的时间信息；数据分析单元，结合时间记录单元提供的时间数据，与存储单元中保存的图像资源时间标签进行解析匹配，将时间标签信息一致的图像信息，显示在数据分析单元起始图像位置，供分析人员进行确认。
步骤S702，数据分析单元根据图像采集单元在移动终端UI界面连续变化过程的图像，分析计算连续两帧图像的变化差异率，确定变化差异率为 0％的两帧图像自动停止图像记录，并将图像显示在数据分析单元供分析人员进行确认。
具体的，数据分析单元，在存储单元进行图像存储的同时，时时解析连续两帧图像的变化差异率，当所得差异率为0％时，发送信号至图像采集单元、时间记录单元停止工作；数据分析单元，将图像差异率为0％的连续两帧图像中的第一帧图像，显示在数据分析单元结束时间图像位置，供分析人员进行确认。
步骤S703，根据数据分析单元自动判断或者分析人员人为选定的起始时间图像、变化截至时间的图像，自动计算两帧图像的时间差值生成该变化过程的时间周期信息。
具体的，数据分析单元在起始时间图像、变化截至时间位置分别线显示相应时间的图像，分析人员可以使用数据分析单元提供的图像前、后选择按键，进行人工图像确认避免自动选择图像存在的偏差。
数据分析单元，在分析人员确认起始、截止位置图像后，自动计算两幅图像的时间差值，得出移动终端该UI变化过程的时间周期信息；数据分析单元，发送指令至存储单元，根据分析人员确定的起始、截止图像的时间标签信息，将该时间标签前后100帧图像保留做为数据查询，其余图像资源自动删除已经控制图像单元空间。
本发明实施例提供的方法是一种客观、准确、定量的移动终端产品UI反映时间测评的手段，将移动终端用户使用过程中的UI反应时间感受通过时间数据予以量化，并且实现了评价分析过程的全部自动化，数据精度亦可以精确至ms数量级，能够有效地指导移动终端产品的UI反应时间用户体验的改进和提升。
本发明实施例提供的测试终端用户界面反应时间的装置中的采集模块、第一确定模块和第二确定模块，以及采集模块所包括的各单元、第一 确定模块所包括的各单元等都可以通过终端中的处理器来实现；当然处理器执行的功能也可通过具体的逻辑电路实现；在具体实施例的过程中，处理器可以为中央处理器(CPU)、微处理器(MPU)、数字信号处理器(DSP)或现场可编程门阵列(FPGA)等。
需要说明的是，本发明实施例中，如果以软件功能模块的形式实现上述测试终端用户界面反应时间的方法，并作为独立的产品销售或使用时，也可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明实施例的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机、服务器、或者网络设备等)执行本发明各个实施例所述方法的全部或部分。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read Only Memory)、磁碟或者光盘等各种可以存储程序代码的介质。这样，本发明实施例不限制于任何特定的硬件和软件结合。
相应地，本发明实施例再提供一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，该计算机可执行指令用于执行本发明各实施例中提供的测试终端用户界面反应时间的方法。
尽管为示例目的，已经公开了本发明的优选实施例，本领域的技术人员将意识到各种改进、增加和取代也是可能的，因此，本发明的范围应当不限于上述实施例。
工业实用性
本发明实施例中，按照图像帧采集终端屏幕上的图像，并记录图像对应的时间信息；根据相邻两帧图像的变化差异率确定停止采集最后一帧图像的时间点；根据采集过程中第一帧图像的采集时间信息和最后一帧图像 的时间点确定终端用户界面的反应时间；如此，通过采集到的图像确定变化差异率确定终端用户界面的反应时间，不占用终端运行进程，因此不影响终端运行时的反应速度，测试结果准确，解决了现有的测试方法大都基于指令或运行脚本进行测试，其测试过程会影响终端运行时的真实反应时间，拖慢终端反应速度，导致测试结果不够准确的问题。

Claims (11)

  1. 一种测试终端用户界面反应时间的方法，包括：
    按照图像帧采集终端屏幕上的图像，并记录所述图像对应的时间信息；
    根据相邻两帧图像的变化差异率确定停止采集最后一帧图像的时间点；
    根据采集过程中第一帧图像的采集时间信息和所述最后一帧图像的时间点确定终端用户界面的反应时间。
  2. 如权利要求1所述的方法，其中，按照图像帧采集终端屏幕上的图像，并记录所述图像对应的时间信息包括：
    检测所述终端屏幕是否满足预设条件，其中，所述预设条件包括：屏幕对应的电容的热量值达到预设热量阈值，和/或，屏幕对应的电感的压力值达到预设压力阈值；
    在所述屏幕满足所述预设条件的情况下，开始按照图像帧采集所述终端屏幕上的图像，并记录所述图像对应的时间信息。
  3. 如权利要求1所述的方法，其中，根据相邻两帧图像的变化差异率确定停止采集最后一帧图像的时间点包括：
    判断相邻两帧图像间的变化差异率是否达到预设差异阈值；
    在所述变化差异率达到预设差异阈值时，停止采集图像，并确定达到所述预设差异阈值时的连续两帧图像中的第一帧图像对应的时间信息为停止采集时的时间点。
  4. 如权利要求3所述的方法，其中，确定达到所述预设差异阈值时的连续两帧图像中的第一帧图像对应的时间信息为停止采集的时间点之后，还包括：
    检测停止采集图像的动作是否为误操作；
    在所述动作是误操作的情况下，继续采集终端屏幕上的图像，并记录各个图像对应的时间信息；
    在所述动作不是误操作的情况下，根据所述采集过程中第一帧图像的采集时间信息和所述停止采集时的时间点确定终端用户界面的反应时间。
  5. 一种测试终端用户界面反应时间的装置，包括：
    采集模块，配置为按照图像帧采集终端屏幕上的图像，并记录所述图像对应的时间信息；
    第一确定模块，配置为根据相邻两帧图像的变化差异率确定停止采集最后一帧图像的时间点；
    第二确定模块，配置为根据采集过程中第一帧图像的采集时间信息和所述最后一帧图像的时间点确定终端用户界面的反应时间。
  6. 如权利要求5所述的装置，其中，所述采集模块包括：
    第一检测单元，配置为检测所述终端屏幕是否满足预设条件，其中，所述预设条件包括：屏幕对应的电容的热量值达到预设热量阈值，和/或，屏幕对应的电感的压力值达到预设压力阈值；
    采集单元，配置为在所述屏幕满足所述预设条件的情况下，开始按照图像帧采集所述终端屏幕上的图像，并记录所述图像对应的时间信息。
  7. 如权利要求5所述的装置，其中，所述第一确定模块包括：
    判断单元，配置为判断相邻两帧图像间的变化差异率是否达到预设差异阈值；
    确定单元，配置为在所述变化差异率达到预设差异阈值时，停止采集图像，并确定达到所述预设差异阈值时的连续两帧图像中的第一帧图像对应的时间信息为停止采集时的时间点。
  8. 如权利要求7所述的装置，其中，所述第一确定模块还包括：
    第二检测单元，配置为检测停止采集图像的动作是否为误操作；
    并在所述动作是误操作的情况下，触发所述采集模块继续采集终端屏幕上的图像，并记录各个图像对应的时间信息；在所述动作不是误操作的情况下，触发所述第二确定模块根据所述采集过程中第一帧图像的采集时间信息和所述停止采集时的时间点确定终端用户界面的反应时间。
  9. 一种测试终端用户界面反应时间的设备，包括：
    数据采集器，用于采集时间信息和图像信息；
    存储器，用于保存所述数据采集器采集到的所述时间信息和所述图像信息；
    处理器，用于对所述存储器内的信息进行数据处理，以确定终端用户界面的反应时间。
  10. 如权利要求9所述的设备，其中，所述处理器，还用于计算所述存储器内存储的相邻两帧图像的变化差异率，在所述变化差异率达到预设差异阈值时，触发所述数据采集器停止采集图像，并确定达到所述预设差异阈值时的连续两帧图像中的第一帧图像对应的时间信息为停止采集时的时间点，再根据采集过程中第一帧图像的采集时间信息和所述停止采集时的时间点确定终端用户界面的反应时间。
  11. 一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，该计算机可执行指令用于执行权利要求1至4任一项所述测试终端用户界面反应时间的方法。
PCT/CN2014/087216 2014-06-23 2014-09-23 用户界面反应时间的方法、装置及设备、存储介质 WO2015196601A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410282610.5 2014-06-23
CN201410282610.5A CN105302701B (zh) 2014-06-23 2014-06-23 一种测试终端用户界面反应时间的方法、装置及设备

Publications (1)

Publication Number Publication Date
WO2015196601A1 true WO2015196601A1 (zh) 2015-12-30

Family

ID=54936548

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/CN2014/084422 WO2015196540A1 (zh) 2014-06-23 2014-08-14 一种测试终端用户界面反应时间的方法、装置及设备
PCT/CN2014/087216 WO2015196601A1 (zh) 2014-06-23 2014-09-23 用户界面反应时间的方法、装置及设备、存储介质

Family Applications Before (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/084422 WO2015196540A1 (zh) 2014-06-23 2014-08-14 一种测试终端用户界面反应时间的方法、装置及设备

Country Status (2)

Country Link
CN (1) CN105302701B (zh)
WO (2) WO2015196540A1 (zh)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106951346A (zh) * 2016-01-06 2017-07-14 阿里巴巴集团控股有限公司 一种响应时间的测试方法和装置
CN111324521A (zh) * 2018-12-13 2020-06-23 华为技术有限公司 一种图形界面性能测试方法及测试设备
CN112180241A (zh) * 2020-10-13 2021-01-05 合肥泽延微电子有限公司 一种集成电路模拟调试机时管理系统
CN112306892A (zh) * 2020-11-26 2021-02-02 深圳市房多多网络科技有限公司 一种页面响应时长的测试方法以及相关设备
CN113219953A (zh) * 2021-05-10 2021-08-06 中国能源建设集团华南电力试验研究院有限公司 基于激光漫反射光电开关对dcs画面响应时间测试方法
CN113688019A (zh) * 2021-08-10 2021-11-23 荣耀终端有限公司 响应时长检测方法及装置
CN113721582A (zh) * 2021-08-03 2021-11-30 安徽江淮汽车集团股份有限公司 座舱系统响应效率测试方法、设备、存储介质及装置
CN115470153A (zh) * 2022-11-14 2022-12-13 成都安易迅科技有限公司 智能终端系统ui的稳定流畅度评测方法和系统、设备

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106028027A (zh) * 2016-06-01 2016-10-12 乐视控股（北京）有限公司 检测信号操作时长的方法及装置
CN106227632B (zh) * 2016-08-05 2020-03-20 北京小米移动软件有限公司 判定设备响应时长的方法及装置、电子设备
CN107870856B (zh) * 2016-09-28 2021-06-11 阿里巴巴（中国）有限公司 视频播放启动时长测试方法、装置及电子终端
CN107329883A (zh) * 2017-06-19 2017-11-07 中国信息通信研究院 智能终端应用程序交互响应时延的自动计算方法及系统
CN110442499B (zh) * 2019-07-10 2023-08-04 创新先进技术有限公司 测试、提高页面响应性能的方法和装置、终端设备
CN110598612B (zh) * 2019-08-30 2023-06-09 深圳智慧林网络科技有限公司 基于移动终端的病人看护方法、移动终端和可读存储介质
CN110928765B (zh) * 2019-10-11 2021-08-03 京东数字科技控股有限公司 一种链路测试方法及装置
CN111090570A (zh) * 2019-12-13 2020-05-01 Oppo广东移动通信有限公司 一种终端屏幕响应时间测量方法、装置及终端设备
CN111858318B (zh) * 2020-06-30 2024-04-02 北京百度网讯科技有限公司 一种响应时间的测试方法、装置、设备和计算机存储介质
CN112203042B (zh) * 2020-09-10 2022-08-05 福建升腾资讯有限公司 一种云桌面操作响应时间测试方法、系统、设备及介质
CN112306212B (zh) * 2020-10-29 2024-02-23 西安万像电子科技有限公司 终端控制方法及装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1781460A (zh) * 2004-10-30 2006-06-07 声慧公司 包含改进的取样放大控制的医学成像用户接口
CN103428406A (zh) * 2012-05-23 2013-12-04 中兴通讯股份有限公司 监控录像分析方法和装置
CN103489387A (zh) * 2013-09-24 2014-01-01 国家电网公司 显示器画面切换响应时间测试系统和方法

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1763865B1 (en) * 2004-07-08 2018-08-22 Microsoft Technology Licensing, LLC Automatic image capture for generating content
JP5531710B2 (ja) * 2010-03-29 2014-06-25 ソニー株式会社 記録装置および記録方法
CN102662839B (zh) * 2012-03-29 2015-02-18 北京奇虎科技有限公司 一种软件的界面状态变化时间的测试方法和装置
US9032335B2 (en) * 2012-08-14 2015-05-12 Christopher V. Beckman User interface techniques reducing the impact of movements
CN103685657B (zh) * 2012-09-17 2018-01-30 腾讯科技（深圳）有限公司 电子终端测试方法及装置
TWI490773B (zh) * 2012-10-09 2015-07-01 Ind Tech Res Inst 使用者介面操控方法及具有使用者介面的電子裝置以及內儲操控使用者介面的程式之程式產品
CN103812713A (zh) * 2012-11-06 2014-05-21 腾讯科技（深圳）有限公司 一种网页加载时间的测试方法和装置
CN103237108B (zh) * 2013-05-13 2015-11-25 百度在线网络技术（北京）有限公司 用于移动终端的测试方法和测试终端

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1781460A (zh) * 2004-10-30 2006-06-07 声慧公司 包含改进的取样放大控制的医学成像用户接口
CN103428406A (zh) * 2012-05-23 2013-12-04 中兴通讯股份有限公司 监控录像分析方法和装置
CN103489387A (zh) * 2013-09-24 2014-01-01 国家电网公司 显示器画面切换响应时间测试系统和方法

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106951346B (zh) * 2016-01-06 2020-07-24 阿里巴巴集团控股有限公司 一种响应时间的测试方法和装置
CN106951346A (zh) * 2016-01-06 2017-07-14 阿里巴巴集团控股有限公司 一种响应时间的测试方法和装置
CN111324521A (zh) * 2018-12-13 2020-06-23 华为技术有限公司 一种图形界面性能测试方法及测试设备
CN111324521B (zh) * 2018-12-13 2023-03-28 花瓣云科技有限公司 一种图形界面性能测试方法及测试设备
CN112180241A (zh) * 2020-10-13 2021-01-05 合肥泽延微电子有限公司 一种集成电路模拟调试机时管理系统
CN112180241B (zh) * 2020-10-13 2024-04-12 合肥泽延微电子有限公司 一种集成电路模拟调试机时管理系统
CN112306892A (zh) * 2020-11-26 2021-02-02 深圳市房多多网络科技有限公司 一种页面响应时长的测试方法以及相关设备
CN112306892B (zh) * 2020-11-26 2022-04-12 深圳市房多多网络科技有限公司 一种页面响应时长的测试方法以及相关设备
CN113219953B (zh) * 2021-05-10 2023-06-23 中国能源建设集团华南电力试验研究院有限公司 基于激光漫反射光电开关对dcs画面响应时间测试方法
CN113219953A (zh) * 2021-05-10 2021-08-06 中国能源建设集团华南电力试验研究院有限公司 基于激光漫反射光电开关对dcs画面响应时间测试方法
CN113721582A (zh) * 2021-08-03 2021-11-30 安徽江淮汽车集团股份有限公司 座舱系统响应效率测试方法、设备、存储介质及装置
CN113688019A (zh) * 2021-08-10 2021-11-23 荣耀终端有限公司 响应时长检测方法及装置
CN115470153A (zh) * 2022-11-14 2022-12-13 成都安易迅科技有限公司 智能终端系统ui的稳定流畅度评测方法和系统、设备

Also Published As

Publication number Publication date
CN105302701A (zh) 2016-02-03
CN105302701B (zh) 2020-02-28
WO2015196540A1 (zh) 2015-12-30

Similar Documents

Publication Publication Date Title
WO2015196601A1 (zh) 用户界面反应时间的方法、装置及设备、存储介质
US10169900B2 (en) Picture processing method and apparatus
CN107679578B (zh) 目标识别算法的测试方法、装置及系统
CN104978133A (zh) 一种用于智能终端的截屏方法和装置
CN104956339B (zh) 从视频生成软件测试脚本
US9817484B2 (en) Method for capturing screen content of mobile terminal and device thereof
CN111726689B (zh) 一种视频播放控制方法及装置
CN111405218A (zh) 触摸屏时延检测方法、系统、装置、设备和存储介质
JP2017010277A (ja) 作業分析システム及び作業分析方法
CN104881225A (zh) 一种调节条的控制方法和装置
WO2015131590A1 (zh) 一种控制黑屏手势处理的方法及终端
CN111382691A (zh) 一种屏幕内容翻页的方法及移动终端
US20160085408A1 (en) Information processing method and electronic device thereof
US9817447B2 (en) Method, device, and system for recognizing gesture based on multi-terminal collaboration
WO2017162031A1 (zh) 一种信息采集方法和装置，以及一种智能终端
CN112866570B (zh) 一种图码联采、目标对象轨迹生成方法及装置
WO2019101002A1 (zh) 一种鞋的数据获取方法和设备以及计算机存储介质
CN111147778B (zh) 基于数字视频录像机的轨迹录像方法、装置及存储介质
CN104170367A (zh) 虚拟快门图像捕获
WO2015096824A1 (zh) 分析装置和分析方法
WO2018227475A1 (zh) 指纹芯片检测方法、装置及系统
WO2017088310A1 (zh) 一种拍照方法、装置及终端
TW201222430A (en) Method for detecting objects and a corresponding control computer
CN109341832A (zh) 一种商品称量方法和电子秤
CN108228433B (zh) 电子设备、移动应用访次停留时长统计方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14895915

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14895915

Country of ref document: EP

Kind code of ref document: A1