KR20200022329A - Method and device for determining response time - Google Patents

Abstract

An embodiment of the present application discloses a method and device for determining a response time. One specific embodiment of the method for determining response time comprises the steps of: obtaining a video of a previously photographed image displayed on a screen when a device to be detected executes a target operation command; parsing the video into a frame sequence; determining a start frame and end frame in the frame sequence, wherein the start frame includes an image displayed on the screen when the device to be detected starts to execute the target operation command and the end frame includes an image displayed on the screen when the device to be detected completes the execution of the target operation command; and determining response time when the target operation command of the device to be detected is executed based on the start frame and end frame. The embodiment of the present invention improves the accuracy of the obtained response time.

Description

METHOD AND DEVICE FOR DETERMINING RESPONSE TIME}

The present application relates to the field of computer technology, and more particularly, to a method and apparatus for determining a response time.

With the continuous development of internet technology and the rapid spread of mobile terminals, various types of applications (apps, applications) are constantly appearing. When a user uses such an app, lag and time delay often occur. To solve this problem, you need to test your app's response time. Currently, you typically test your app's response time using methods such as manual testing or log analysis.

Embodiments of the present application provide a method and apparatus for determining a response time.

In a first aspect, an embodiment of the present application provides a method for determining a response time, the method comprising: acquiring a video of a pre-photographed image displayed on a screen when a target device executes a target operation command; Parsing the video into a frame sequence; Determining a start frame and an end frame in a frame sequence, where the start frame includes an image displayed on the screen when the detected device starts to execute a target operation command, and the end frame includes the execution of the target operation command by the detected device. Contains the image displayed on the screen upon completion-; And determining the response time when the detected device executes the target operation command based on the start frame and the end frame.

In some embodiments, the method further includes outputting prompt information to indicate that the response time is greater than the target threshold in response to determining that the response time is greater than the target threshold.

In some embodiments, the target threshold value comprises: obtaining a set of past response times; And determining a target threshold based on a past set of response times.

In some embodiments, prior to the step of acquiring a video of a pre-captured image displayed on the screen when the target device executes the target operation command, the method may further include that the target device has started executing the target operation command. In response to receiving the signal to indicate, transmitting a start command to the client to indicate the start of video recording; In response to receiving a signal to indicate that the device to be detected has completed execution of the target operation command, sending a stop command to the client to indicate a video recording stop; And receiving the target video transmitted from the client, and determining the target video as the video of the image displayed on the screen when the detected device executes the target operation command, wherein the target video performs recording in response to the client receiving the start command. Starting and stopping the recording in response to receiving the stop command.

In some embodiments, determining the start frame and the end frame in the frame sequence comprises determining that the similarity of two adjacent frames in the frame sequence is determined to be greater than a predetermined threshold value. Determining the frame as a start frame or an end frame.

In a second aspect, an embodiment of the present application provides an apparatus for determining a response time, wherein the apparatus is configured to acquire a video of a pre-photographed image displayed on a screen when a target operating command is executed by a detected device. unit; A parsing unit configured to parse the video into a frame sequence; A key frame determination unit configured to confirm a start frame and an end frame in a frame sequence, wherein the start frame includes an image displayed on the screen when the detected device starts to execute a target operation command, and the end frame includes the target device operating on the target. Contains the image displayed on the screen when the command completes execution; And a response time determination unit configured to determine a response time when the detected device executes the target operation command based on the start frame and the end frame.

In some embodiments, the apparatus further comprises an output unit, configured to output prompt information for indicating that the response time is greater than the target threshold in response to determining that the response time is greater than the target threshold.

In some embodiments, the target threshold value comprises: obtaining a set of past response times; And determining a target threshold based on a past set of response times.

In some embodiments, the apparatus is further configured to: send a start command configured to transmit a start command to the client to indicate the start of video recording in response to receiving a signal to indicate that the target device has started to execute a target operation command. unit; A stop instruction sending unit, configured to send a stop instruction for indicating a video recording stop to a client in response to receiving the signal indicating that the device to be detected has completed execution of the target operation instruction; And receiving the target video transmitted from the client, and determining the target video as the video of the image displayed on the screen when the detected device executes the target operation command, wherein the target video starts recording in response to the client receiving the start command. And a receiving unit which is a video obtained by stopping recording in response to receiving the stop command.

In some embodiments, the key frame determination unit is further configured to select one of two adjacent frames as a start frame or an end frame in response to the similarity of two adjacent frames being determined to be greater than a preset threshold. It is configured to confirm.

In a third aspect, an embodiment of the present application includes one or a plurality of processors; And a storage device in which one or a plurality of programs are stored, wherein when the one or the plurality of programs is executed by the one or the plurality of processors, the one or the plurality of processors implements any one of the first aspect. Implement the response time determination method according to the type.

In a fourth aspect, an embodiment of the present application provides a computer readable medium having a computer program stored thereon, and when the program is executed by a processor, to implement a response time determining method according to any one of the first aspects. do.

The method and apparatus for determining a response time provided by an embodiment of the present application may determine a response time based on a start frame and an end frame since the start frame and the end frame are first determined in a frame sequence of the video. Compared with manual tests, the analysis can be performed at a particle size that exceeds the human eye's perceived particle size, improving the accuracy of the response time obtained. In addition, it also improves the accuracy of the response time obtained because it prevents errors due to asynchronous operations compared to the log analysis method.

Other features, objects, and advantages of the present application will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings.
1 is an exemplary system structure diagram that may be applied to an embodiment of the present application.
2 is a flowchart of an embodiment of a response time determination method according to the present application.
3 is a schematic diagram of one application scenario of the response time determination method according to an embodiment of the present application.
4 is a flowchart of another embodiment of a method for determining a response time according to the present application.
5 is a structural schematic diagram of an embodiment of a response time determination device according to the present application.
6 is a structural diagram of a computer system applied to implement a server according to an embodiment of the present application.

Hereinafter, the present application will be described in more detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely for interpreting the invention and are not limitations on the invention. In addition, only those parts related to the present invention are shown in the drawings for convenience of explanation.

It should be explained that the embodiments according to the present application and the features of the embodiments may be combined with each other as long as they do not contradict. Hereinafter, the present application will be described in detail with reference to the accompanying drawings.

1 illustrates an exemplary system structure of a response time determination method or a response time determination apparatus applicable to an embodiment of the present application.

As shown in FIG. 1, system architecture 100 may include a server 101, a client 102, a device to be detected 103, and a network 104, 105. The network 104 here is a medium for providing a communication link between the server 101 and the client 102. The network 105 is a medium for providing a communication link between the server 101 and the device to be detected 103. Networks 104 and 105 may include various types of connections, such as wired communication links, wireless communication links or fiber optic cables.

The client 102 communicates with the server 101 via the network 104 to send and receive messages and the like. The detected device 103 communicates with the server 101 via the network 105 to transmit and receive messages and the like.

The server 101 may be a server that provides various services, and may be, for example, a video processing server capable of performing parsing or the like on a video captured by the client 102. The video processing server may perform processing such as parsing on the received video to obtain a processing result (for example, response time).

The device to be detected 103 may be hardware or software. When the device to be detected 103 is hardware, it may be a variety of electronic devices having a screen and supporting application installation, and include, but are not limited to, a smartphone, a tablet computer, a laptop computer, a desktop computer, and the like. When the detected device 103 is software, it can be installed in the above-listed electronic device. The detected device 103 may be implemented by a plurality of software or software modules, or may be implemented by one software or software module, but is not limited thereto.

It should be explained that the response time determination method provided by the embodiment of the present application is generally performed by the server 101, and correspondingly, the response time determination apparatus is generally installed in the server 101.

Server 101 and client 102 may be hardware or may be software. When the server 101 and the client 102 are hardware, the server 101 and the client 102 may be implemented as a distributed device cluster including a plurality of devices, or may be implemented as a single device. When the server 101 and the client 102 are software, they may be implemented by a plurality of software or software modules, or may be implemented by a single software or software module, but are not limited thereto.

It should be understood that the number of servers, clients, detected devices, and networks in FIG. 1 is merely exemplary. Any number of servers, clients, devices to be detected and networks can be provided, depending on the needs of the implementation.

With continued reference to FIG. 2, FIG. 2 shows a process 200 of one embodiment of a method for determining a response time in accordance with the present application.

In step 201, when the target device executes the target operation command, a video of a pre-photographed image displayed on the screen is acquired.

In the embodiment of the present application, the subject of execution of the response time determination method (for example, the server 101 shown in FIG. 1) is pre-determined from a client who has lost communication (for example, the client 102 shown in FIG. 1). The detected device (e.g., the detected device 103 shown in FIG. 1) photographed in FIG. 1 may acquire a video of the image displayed on the screen when executing the target operation command. Here, the operation instruction may be an instruction for instructing the computer to perform a certain operation. In practice, the operating instructions can be expressed in a variety of existing computer languages (eg machine language, assembly language, high-level language). The target operation command may be an operation command input by a technician or a command triggered by some operation of a user.

When the detected device executes the target operation command, the screen of the detected device may display a corresponding image. As an example, before the detected device executes the target operation command, the technician may turn on the photographing function of the client to align with the screen of the device to start photographing. After the device to be detected has completed execution of the target operation command, the photographing can be stopped. This allows you to obtain a video of the image displayed on the screen when the target device executes the target operating command. As another example, photographing may be completed through an application having a screen recording function installed in the device to be detected. This allows you to obtain a video of the image displayed on the screen when the target device executes the target operating command.

In addition, a video of an image displayed on a screen when the detected device executes a target operation command may be stored locally in the execution subject. In this case, the execution subject may directly obtain a video of an image displayed on the screen locally when the detected device executes a target operation command.

In step 202, the video is parsed into a frame sequence.

In an embodiment of the present application, the execution agent may parse the video obtained in step 201 into a frame sequence by various methods. In practice, the video consists of a plurality of static images, and the human eye has a visual afterimage effect, so that the continuous eye is observed by the human eye when the number of frames per second exceeds a certain number. Thus, video can be reconstructed into frame sequences through various types of existing video processing software. In practice, the frame rate of the video may represent frames per second. Optionally, the frame rate of the video (which may be 240 fps for example) can be improved to increase the number of images in the frame sequence, thereby facilitating subsequent processing.

In step 203, a start frame and an end frame are determined in a frame sequence.

In an embodiment of the present application, the execution subject may determine the start frame and the end frame through various methods. Here, the start frame includes an image displayed on the screen when the detected device starts to execute the target operation command, and the end frame includes an image displayed on the screen when the detected device finishes executing the target operation command. .

For example, the execution subject may determine the start frame and the end frame through the following method.

In the first step, each image in the frame sequence is divided into parts so as to reduce noise information in the image to facilitate subsequent processing.

In the second step, for each image of the divided frame sequences, the connected of each image is determined to facilitate subsequent work. This distinguishes a plurality of objects displayed in each image.

In the third step, the similarity between adjacent frames of each group can be calculated for the image of the frame sequence processed in the second step. Based on this, two groups of adjacent frames are selected in order of similarity. According to the position in the time axis of the adjacent frames of the two selected groups, the adjacent frame of the group whose time is relatively fast is determined as the first adjacent frame, and the adjacent frame of the group whose time is relatively late is determined as the second adjacent frame. Also, for example, a frame having a relatively quick time among the two frames may be determined as a start frame with respect to two frames of the first adjacent frame. For two frames of the second adjacent frame, a frame having a relatively quick time among the two frames may be determined as the end frame.

In some selectable embodiments of embodiments of the present application, determining the start frame and the end frame in the frame sequence is performed in response to determining that the similarity of two adjacent frames in the frame sequence is greater than a preset threshold. Determining one frame of the adjacent frames as a start frame or an end frame.

In step 204, based on the start frame and the end frame, the response time when the target device executes the target operation command is determined.

In an embodiment of the present application, the execution subject may determine a response time when the target device executes the target operation command based on the start frame and the end frame. In practice, each frame of the video corresponds to one viewpoint on the time axis because the video includes a time axis. Accordingly, two viewpoints corresponding to the start frame and the end frame on the time axis can be determined. The difference value between the two time points can then be determined as the response time when the detected device executes the target operation command.

In some selectable embodiments of embodiments of the present application, the method further comprises, in response to determining that the response time is greater than the target threshold, outputting prompt information to indicate that the response time is greater than the target threshold. It may include.

In some selectable embodiments of embodiments of the present application, the target threshold may include obtaining a set of past response times; And determining a target threshold based on a past set of response times.

3, FIG. 3 is a schematic diagram of an application scenario of a response time determination method according to an embodiment of the present application. In the application scenario of FIG. 3, the executing agent of the response time determining method may be the server 301. The device to be detected may be a tablet computer 302 and installs an instant messaging application thereon. The figure shows the login interface of the instant messaging application. The server 301 and the smartphone 300 is connected by Bluetooth. The server 301 and the tablet computer 302 may be connected by a data cable. Since the smartphone 300 may previously capture an image displayed on the screen when the tablet computer 302 executes a login command, the smartphone 300 may obtain a video of the image displayed on the screen when the tablet computer 302 executes the login command. . Next, the server 301 may obtain the video 3011 from the smartphone 300. The video may then be parsed into a frame sequence 3012. Based on this, the similarity of the adjacent images of the frame sequence 3012 is calculated to determine the start frame 3013 and the end frame 3014 in the frame sequence 3012. Response time 3015 when the tablet computer 302 executes the login operation command of the instant messaging application based on the difference between the two points of time in which the start frame 3013 and the end frame 3014 correspond on the time base. ).

The method provided by the above embodiment of the present application may first determine a start frame and an end frame by parsing the video into a frame sequence. Based on this, the response time when the detected device executes a target operation command based on the start frame and the end frame is determined. Compared with manual measurements, the analysis can be performed at a particle size that exceeds the human eye's detectable particle size, improving the accuracy of the response time obtained. In addition, it also improves the accuracy of the response time obtained because it prevents errors due to asynchronous operations compared to the log analysis method.

4, FIG. 4 illustrates a process 400 of another embodiment of a response time determination method. Process 400 of the response time determination method includes the following steps.

In step 401, in response to receiving a signal to indicate that the detected device has started to execute the target operation command, a start command is sent to the client to indicate the start of video recording.

In the embodiment of the present application, in response to receiving a signal indicating that the target device has started executing the target operation command, the subject of execution of the response time determination method (for example, the server 101 shown in FIG. 1). ) May transmit a start command to the client (eg, client 102 shown in FIG. 1) to indicate the start of video recording. Here, the signal for indicating that the detected device starts to execute the target operation command may be a signal transmitted by the detected device to the execution subject.

In practice, the technician can pre-write test cases for testing the device to be detected. One test case may correspond to one or more operations of a user. For example, the login test case may correspond to a user's login operation. The update test case may correspond to the update operation of the user. Pre-written test cases may be stored locally on the execution subject.

For example, if it is necessary to test a response time when the test device executes a login command (command triggered by a user login operation), the executing agent may send a login test case to the device under test. This allows the device under test to execute a login test case to achieve the same effect as the login operation performed by the user on the device under test. In response to starting the login test case execution, the device under test can send a signal to the execution entity to indicate that the target device has started executing the target operation command. For example, it may be a stop signal. The execution subject can thereby receive a signal to indicate that the device to be detected has begun executing the target operation command. Based on this, the execution entity may transmit a start command to the client to indicate the start of video recording.

In step 402, in response to receiving a signal to indicate that the detected device has completed execution of the target operation command, a stop command is sent to the client to indicate a video recording stop.

In an embodiment of the present application, in response to receiving a signal indicating that the detected device has completed execution of a target operation command, the executing agent may transmit a stop command to the client to indicate stop of video recording. have.

Taking the login test case in step 401 as an example, in response to the completion of the execution of the login test case, the device under test can send a signal to the execution entity to indicate that the detected device has completed execution of the target operation instruction. have. For example, it may be a stop signal. In this way, the execution subject may receive a signal indicating that the detected device has completed execution of a target operation command. Based on this, the executing agent may transmit a stop command to the client to indicate stop of video recording.

In step 403, the target video transmitted from the client is received, and the target video is determined as the video of the image displayed on the screen when the detected device executes the target operation command.

In an embodiment of the present application, the executing agent receives the target video transmitted from the client, and determines the target video as the video of the image displayed on the screen when the detected device executes the target operation command. The target video is a video obtained by the client starting recording in response to receiving the start command and stopping recording in response to receiving the stop command.

In step 404, a video of a pre-photographed image displayed on the screen is obtained when the target device executes the target operation command.

In step 405, the video is parsed into a frame sequence.

In step 406, a start frame and an end frame are determined in a frame sequence.

The start frame includes an image displayed on the screen when the detected device starts to execute the target operation command, and the end frame includes an image displayed on the screen when the detected device finishes executing the target operation command.

In step 407, based on the start frame and the end frame, the response time when the target device executes the target operation command is determined.

In the embodiment of the present application, the specific implementation of steps 404-407 and the technical effects obtained therefrom may refer to steps 201-204 of the embodiment corresponding to FIG. 2 and will not be described herein any further.

As can be seen from FIG. 4, compared to the embodiment corresponding to FIG. 2, the response time determining method according to the embodiment of the present application controls the client to complete video recording by transmitting a start command and a stop command to the client. do. Implement automatic recording compared to recording video manually.

Referring also to Figure 5, as an implementation of the method shown in each of the drawings, the present application provides a response time determination device, the device embodiment and the method embodiment shown in Figure 2 correspond and the device is specifically It can be applied to various electronic devices.

As shown in FIG. 5, the response time determination device according to the embodiment of the present application includes an acquisition unit 501, a parsing unit 502, a key frame determination unit 503, and a response time determination unit 504. . The acquisition unit 501 is configured to acquire a video of a pre-photographed image displayed on the screen when the target device executes the target operation command. Parsing unit 502 is configured to parse the video into a frame sequence. The key frame determination unit 503 is configured to confirm the start frame and the end frame in the frame sequence. The start frame includes an image displayed on the screen when the detected device starts to execute the target operation command, and the end frame includes an image displayed on the screen when the detected device finishes executing the target operation command. The response time confirmation unit 504 is configured to determine a response time when the detected device executes the target operation command based on the start frame and the end frame.

In the embodiment of the present application, specific processing for the acquiring unit 501, the parsing unit 502, the key frame determination unit 503, and the response time determination unit 504 of the response time determination device 500, and therefrom. The technical effect obtained is similar to steps 201-204 of the embodiment corresponding to FIG. 2 and will not be described herein any further.

In some selectable embodiments of embodiments of the present application, the apparatus 500 may further include an output unit (not shown). The output unit is configured to output prompt information for indicating that the response time is greater than the target threshold in response to being determined that the response time is greater than the target threshold.

In some selectable embodiments of embodiments of the present application, the target threshold may include obtaining a set of past response times; And determining a target threshold based on a past set of response times.

In some selectable embodiments of embodiments of the present application, the apparatus 500 further includes a start command sending unit (not shown), a stop command sending unit (not shown), and a receiving unit (not shown). The start command sending unit is configured to, in response to receiving the signal indicating that the detected device has started to execute the target operation command, send a start command to the client to indicate the start of video recording. The stop instruction sending unit is configured to, in response to receiving a signal indicating that the detected device has completed execution of the target actuation instruction, send a stop instruction to the client to indicate the video recording stop. The receiving unit is configured to receive the target video transmitted from the client and determine the target video as the video of the image displayed on the screen when the detected device executes the target operation instruction. The target video is a video obtained by the client starting recording in response to receiving the start command and stopping recording in response to receiving the stop command.

In some selectable embodiments of the embodiments of the present application, the key frame determination unit 503 also determines that the similarity of two adjacent frames in the frame sequence is determined to be greater than a preset threshold, among the two adjacent frames. It is configured to determine one frame as a start frame or an end frame.

In the embodiment of the present application, the parsing unit 502 of the response time determining device 500 may first parse the video acquired by the acquiring unit 501 into a frame sequence, and the key frame determining unit 503 Can determine the start frame and the end frame. Based on this, the response time determining unit 504 may determine the response time of the detected device when executing the target operation command based on the start frame and the end frame. Compared with manual measurements, the analysis can be performed at a particle size that exceeds the human eye's detectable particle size, improving the accuracy of the response time obtained. In addition, it also improves the accuracy of the response time obtained because it prevents errors due to asynchronous operations compared to the log analysis method.

Referring to FIG. 6, FIG. 6 shows a schematic diagram of a computer system 600 for implementing a server according to an embodiment of the present application. The server shown in FIG. 6 is only one example and is not intended to limit the functionality and scope of use of the embodiments of the present application.

As shown in FIG. 6, computer system 600 includes a central processing unit (CPU) 601 and random access memory (RAM) from a program or storage portion 608 of read-only memory (ROM) 602. Various suitable operations and processes can be performed according to the program loaded in 603. The RAM 603 stores various programs and data for operating the system 600. The CPU 601, the ROM 602 and the RAM 603 are connected to each other via the bus 604. Input / output (I / O) interface 605 is also coupled to bus 604.

Input portion 606 including keywords, mice, and the like; An output portion 607 including a liquid crystal display (LCD) and the like and a speaker and the like; A storage portion 608 including a hard driver and the like; And components such as communication portion 609 including network interface cards such as LAN cards, modems, and the like, are coupled to I / O interface 605. The communication portion 609 performs communication processing over a network such as the Internet. Driver 610 is also coupled to I / O interface 605 as needed. Removable media 611, such as a disk, CD, magneto-optical disk, semiconductor memory, and the like, are installed in the driver 610 as necessary to easily install the computer program read thereby into the storage portion 608 as necessary.

In particular, according to an embodiment of the present application, the process described with reference to the flowchart above may be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product and includes a computer program mounted on a computer readable medium, the computer program including program code for performing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded or installed from the network via the communication portion 609 and / or may be installed from the removable medium 611. When the computer program is executed by a central processing unit (CPU) 601, it performs the functions defined in the method according to the present application.

It should be described that the computer readable medium described in the present application may be a computer readable signal medium or a computer readable storage medium or any combination of the above. For example, a computer readable storage medium may be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared or semiconductor system, device or device, or any combination thereof. More specific examples of computer readable storage media include electrical connections having one or more conductors, portable computer disks, hard disks, RAM, ROM, erasable programmable ROM (EPROM or flash memory), optical fibers, CD-ROMs, optical Storage elements, magnetic storage elements, or any suitable combination of the above. In the present application, a computer readable storage medium may be any tangible medium containing or storing a program, and the program may be used by an instruction execution system, apparatus or device, or a combination thereof. In the present application, a computer readable signal medium may be included in a data signal propagated as part of a baseband or carrier wave and loaded with computer readable program code. The data signal propagated in this way may use a variety of formats, including but not limited to electromagnetic signals, scientific signals, or any suitable combination of the above. The computer readable signal medium may be any computer readable medium other than a computer readable storage medium, and the computer readable medium may transmit, propagate or Can transmit The program code included in the computer readable medium may be transmitted on any suitable medium, including but not limited to wireless, electric wire, optical cable, RF, or any suitable combination of the above.

Computer program code for performing the operation of the present application may be written by a kind or various program design languages or a combination thereof, the program design language including a program design language for an object such as Java, Smalltalk, C ++, It further includes a conventional procedural program design language, such as C language or similar program design language. The program code may run entirely on the user's computer, may run partially on the user's computer, run as an independent software package, some may run on the user's computer, some may run on the remote computer, or all may run on the remote computer or server Can be. In the case of a remote computer, the remote computer may be connected to the user's computer by any type of network, including a LAN or WAN, or may be connected to an external computer (eg, connected to the Internet using an Internet service provider).

In the drawings, flowcharts and block diagrams illustrate architectures, functions, and operations that may be implemented in accordance with systems, methods, and computer program products according to embodiments of the present application. In this regard, each block in the flowchart or block diagram may represent a module, program block, or a portion of code, the portion of the module, program or code being executed to implement one or a plurality of constant logic functions. Includes possible instructions. It should be noted that in some replacement implementations, the functions noted in the blocks may occur out of the order shown in the figures. For example, two consecutively represented blocks may be performed substantially in parallel and may be executed in reverse order, which is determined by the function involved. It should also be noted that each block and / or combination of blocks in the block diagrams and / or flowcharts may be implemented by a dedicated hardware-based system for performing certain functions or operations, or may be implemented by dedicated hardware and a computer. It can be implemented by a combination of instructions.

The unit mentioned in the course of describing the embodiments of the present application may be implemented by software or may be implemented by hardware. The described unit may be installed in a processor and may be described as, for example, a processor including an acquisition unit, a parsing unit, a key frame determination unit, and a response time determination unit. The names of these units are not limited to the unit itself under any circumstances, for example, the acquiring unit may be configured to obtain a video of a pre-recorded image displayed on the screen when the detected device executes a target operation command. Unit ”.

On the other hand, the present application further provides a computer-readable medium, which may be included in the server described in the embodiment or may exist independently without being assembled to the server. The computer-readable medium may include one or a plurality of programs, and when the one or the plurality of programs are executed by the server, the server may include a previously photographed image displayed on a screen when the detected device executes a target operation command. Obtain a video of the; Parse the video into a frame sequence; Determine a start frame and an end frame in the frame sequence, wherein the start frame includes an image displayed on the screen when the detected device starts to execute the target operation command, and the end frame includes: An image displayed on the screen upon completion of execution of the target operation instruction; Based on the start frame and the end frame, the response time of the detected device at the time of executing the target operation command is determined.

The above description is merely a description of the preferred embodiment of the present application and the applied technical principle. Those skilled in the art should not be construed as limited to the technical solution by the specific combination of the above technical features, but also to the above technical features or equivalent features thereof without departing from the spirit of the present application. It is to be understood that it includes other technical solutions formed arbitrarily combined by. For example, the above features are technical solutions disclosed in the present application (but not limited to) and formed to replace the technical features having similar functions.

Claims (12)

In the response time confirmation method,
Acquiring a video of a pre-photographed image displayed on a screen when the target device executes a target operation command;
Parsing the video into a frame sequence;
Determining a start frame and an end frame in the frame sequence; And
Determining a response time when the detected device executes the target operation command based on the start frame and the end frame,
The start frame includes an image displayed on a screen when the detected device starts to execute the target operation command, and the end frame is displayed on a screen when the detected device completes execution of the target operation command. How to determine response time that includes an image. The method of claim 1,
The response time determination method,
And in response to determining that the response time is greater than a target threshold, outputting prompt information for indicating that the response time is greater than a target threshold. The method of claim 2,
The target threshold is,
Obtaining a past set of response times; And
And determining the target threshold based on the past response time set. The method according to any one of claims 1 to 3,
Before acquiring a video of a pre-photographed image displayed on a screen when the target device executes the target operation command, the response time determining method includes:
In response to receiving a signal to indicate that the target device has started executing the target operation command, sending a start command to a client to indicate the start of video recording;
In response to receiving a signal to indicate that the detected device has completed execution of the target operation command, sending a stop command to the client to indicate a video recording stop; And
Receive the target video transmitted from the client and determine the target video as a video of an image displayed on the screen when the detected device executes a target operation command, wherein the target video is determined by the client upon receipt of the start command. And a video obtained by starting recording in response and stopping recording in response to receiving the stop command. The method according to any one of claims 1 to 3,
Determining a start frame and an end frame in the frame sequence,
Responsive to determining that the similarity of two adjacent frames in the frame sequence is larger than a preset threshold, determining one of the two adjacent frames as a start frame or an end frame. . In the response time determination device,
An acquisition unit, configured to acquire a video of a pre-photographed image displayed on a screen when the target device executes a target operation command;
A parsing unit configured to parse the video into a frame sequence;
A key frame determination unit, configured to determine a start frame and an end frame in the frame sequence; And
A response time determination unit, configured to determine a response time when the detected device executes the target operation command based on the start frame and the end frame,
The start frame includes an image displayed on a screen when the detected device starts to execute the target operation command, and the end frame is displayed on a screen when the detected device completes execution of the target operation command. Response time determination device comprising an image. The method of claim 6,
The response time determination device,
And an output unit, configured to output prompt information indicating that the response time is greater than a target threshold, in response to determining that the response time is greater than a target threshold. The method of claim 7, wherein
The target threshold is,
Obtaining a past set of response times; And
And a response time determination device obtained by determining the target threshold value based on the past response time set. The method according to any one of claims 6 to 8,
The response time determination device,
A start command sending unit, configured to send a start command to a client to indicate a start of video recording in response to receiving a signal to indicate that the detected device has started executing the target operation command;
A stop instruction sending unit, configured to send a stop instruction for indicating a video recording stop to the client in response to receiving the signal indicating that the detected device has completed execution of the target operation instruction; And
Receive the target video transmitted from the client and determine the target video as a video of an image displayed on the screen when the detected device executes a target operation command, wherein the target video is determined by the client upon receipt of the start command. And a receiving unit which is a video obtained by starting recording in response and stopping recording in response to receiving the stop command. The method according to any one of claims 6 to 8,
The key frame determination unit
And in response to determining that the similarity of two adjacent frames in the frame sequence is greater than a preset threshold, determine one frame of the two adjacent frames as a start frame or an end frame. One or a plurality of processors; And
In the server including a storage device that stores one or a plurality of programs,
A server for causing the one or more processors to implement a response time determining method according to any one of claims 1 to 5 when the one or more programs are executed by the one or more processors. A computer readable medium having a computer program stored thereon,
A computer readable medium embodying the method for determining a response time according to any one of claims 1 to 5 when the program is executed by a processor.

Images