JP6898968B2 - Methods and devices for determining response time - Google Patents

Description

Embodiments of the present invention relate to the field of computer technology, specifically to methods and devices for determining response times.

Due to the continuous development of Internet technology and the rapid spread of mobile terminals, various types of applications (Applications) are appearing one after another. When users use these apps, the phenomenon of getting stuck or delayed frequently occurs. To solve these problems, it is necessary to test the response time of App. Currently, App response times are typically tested by manual testing or log analysis.

Embodiments of the present invention provide methods and devices for determining response times.

In a first aspect, embodiments of the invention provide a method for determining response time, which is pre-photographed and displayed on the screen when the target operation command is executed by the equipment to be detected. Acquiring the image image, analyzing the image into a frame sequence, and determining the start frame and end frame from the frame sequence. At the start frame, the detection target equipment starts executing the target operation command. It is a frame containing an image sometimes displayed on the screen, and the end frame is a frame containing an image displayed on the screen when the equipment to be detected completes the execution of the target operation command, and the start frame and the end frame. Based on the above, the response time when the target operation command is executed by the detection target equipment is determined.

In some embodiments, the method for determining the response time provides presentation information to indicate that the response time is greater than the target threshold in response to the determination that the response time is greater than the target threshold. Further prepare to output.

In some embodiments, the target threshold is obtained by acquiring a set of past response times and determining the target threshold based on the set of past response times.

In some embodiments, the method for determining the response time before acquiring an image of a pre-captured image, which is displayed on the screen when the target operation command is executed by the equipment to be detected, is a goal. In response to receiving a signal to indicate that the equipment to be detected starts executing the operation command, the equipment to be detected sends a start command to indicate the start of video recording to the client and executes the target operation command. In response to the reception of the signal indicating that is completed, a stop command for indicating the stop of recording of the video is transmitted to the client, and the target video transmitted from the client is received and the target video is set as the target. The operation command is determined as the image of the image displayed on the screen when the detection target equipment is executed, and the target image is the target image in which the client starts recording in response to the reception of the start command and receives the stop command. It is further provided that the video is acquired by stopping recording in response.

In some embodiments, determining the start and end frames from the frame sequence is adjacent in response to the determination that the similarity of two adjacent frames in the frame sequence is greater than a predetermined threshold. One of the two frames is defined as a start frame or an end frame.

In a second aspect, an embodiment of the present invention provides a device for determining response time, which is pre-photographed and displayed on a screen when a target operation command is executed by the equipment to be detected. An acquisition unit configured to acquire the image image, an analysis unit configured to analyze the image into a frame sequence, and a keyframe confirmation configured to determine the start and end frames from the frame sequence. In the unit, the start frame is a frame containing an image displayed on the screen when the detection target equipment starts executing the target operation command, and the end frame is a frame when the detection target equipment completes the execution of the target operation command. A response configured to determine the response time when the target equipment executes the target operation command based on the keyframe confirmation unit, which is the frame containing the image displayed on the screen, and the start and end frames. It is equipped with a time determination unit.

In some embodiments, the device for determining the response time provides presentation information to indicate that the response time is greater than the target threshold in response to the determination that the response time is greater than the target threshold. It further comprises an output unit configured to output.

In some embodiments, the target threshold is obtained by acquiring a set of past response times and determining the target threshold based on the set of past response times.

In some embodiments, the device for determining the response time is for indicating the start of video recording in response to the reception of a signal to indicate that the equipment to be detected has begun to execute the target operation command. A start command transmission unit configured to send a start command to the client and a target operation command to indicate that video recording has stopped in response to reception of a signal indicating that the equipment to be detected has completed execution. An image displayed on the screen when the stop command transmission unit configured to send a stop command to the client and the target image transmitted from the client are received and the target operation command is executed by the detection target equipment. The target video is acquired by the receiving unit configured to be determined as the video of, in which the client starts recording in response to the reception of the start command and stops recording in response to the reception of the stop command. It further includes a receiving unit, which is an image.

In some embodiments, the keyframe determination unit further comprises one of two adjacent frames in response to the determination that the similarity of two adjacent frames in the frame sequence is greater than a predetermined threshold. It is configured to determine one as the start or end frame.

In a third aspect, an embodiment of the present invention is a server comprising one or more processors and a storage device in which one or more programs are stored, wherein the one or more programs are included. When executed by the one or more processors, the one or more processors provide a server that implements the method according to any embodiment of the first aspect.

In a fourth aspect, the embodiment of the present invention is a computer-readable medium in which a computer program is stored, and when the program is executed by a processor, the embodiment of the first aspect is described. Provide a computer-readable medium in which the method is realized.

The method and apparatus for determining the response time provided by the embodiment of the present invention first determines the response time based on the start frame and the end frame by determining the start frame and the end frame in the frame sequence of the video. can do. Compared to manual testing, it is possible to analyze with a particle size that exceeds what can be perceived by the naked eye, and the accuracy of the obtained response time can be improved. Compared with the log analysis method, the accuracy of the acquired response time can be improved by avoiding the error due to the asynchronous operation.

Other features, objectives and advantages of the present invention will be further clarified by the detailed description given to non-limiting examples with reference to the drawings.
It is an exemplary system architecture diagram to which one embodiment of the present invention is applied. It is a flowchart of one Example of the method for determining the response time which concerns on this invention. It is a schematic diagram of one application scenario of the method for determining the response time according to the Example of this invention. It is a flowchart of another embodiment of the method for determining the response time which concerns on this invention. It is a schematic diagram of the structure of one Example of the apparatus for determining the response time which concerns on this invention. It is a schematic diagram of the structure of the computer system suitable for realizing the server of the Example of this invention.

Hereinafter, the present application will be described in detail with reference to the drawings and examples. It is understood that the specific examples described herein are used only to interpret the related invention and are not limited to the invention. For convenience of explanation, the drawings show only the parts related to the related invention.

As long as there is no contradiction, the examples in the present application and the features in the examples can be combined with each other. Hereinafter, the present application will be described in detail together with examples with reference to the drawings.

FIG. 1 shows an exemplary system architecture diagram of a method for determining a response time to which an embodiment of the present invention is applied or an apparatus for determining a response time.

As shown in FIG. 1, the system architecture 100 may include a server 101, a client 102, a detection target equipment 103, and networks 104 and 105. Here, the network 104 is used as a medium for providing a communication link between the server 101 and the client 102. The network 105 is used as a medium for providing a communication link between the server 101 and the detection target equipment 103. Networks 104, 105 may include various types of connections such as wired, wireless communication links or fiber optic cables.

The client 102 communicates with the server 101 via the network 104 to send and receive messages and the like. The detection target equipment 103 communicates with the server 101 via the network 105 to send and receive messages and the like.

The server 101 may be a server that provides various services, such as a video processing server that can perform processing such as analysis on the video captured by the client 102. The video processing server can perform processing such as analysis on the received video and acquire the processing result (for example, response time).

The detection target equipment 103 may be hardware or software. When the equipment 103 to be detected is hardware, it may be various electronic devices having a display screen and supporting the installation of applications, including smartphones, tablet computers, laptop portable computers, desktop computers, and the like. Not limited to these. When the detection target equipment 103 is software, it can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules, or as a single piece of software or software module. Here, it is not specifically limited.

The method for determining the response time provided by the embodiment of the present invention is generally executed by the server 101, and the corresponding device for determining the response time is generally installed in the server 101. ..

The server 101 and the client 102 may be hardware or software. When the server 101 and the client 102 are hardware, it can be realized by a distributed equipment cluster composed of a plurality of equipments, or can be realized by a single equipment. When the server 101 and the client 102 are software, they can be realized by a plurality of software or software modules, or can be realized by a single software or software module, and are not specifically limited here.

It should be understood that the number of servers, clients, equipment to be detected and networks in FIG. 1 is merely an example. It may have any number of servers, clients, equipment to be detected and networks, depending on the demands of realization.

Subsequently, with reference to FIG. 2, it is a flow 200 of an embodiment of the method for determining the response time according to the present invention.

In step 201, an image of a pre-captured image displayed on the screen when the target operation command is executed by the detection target equipment is acquired.

In this embodiment, the execution subject of the method for determining the response time (for example, the server 101 shown in FIG. 1) is the detection target equipment (for example, the client 102 shown in FIG. 1) from the communication-connected client (for example, the client 102 shown in FIG. 1). , It is possible to acquire an image of a pre-captured image displayed on the screen when the detection target equipment 103) shown in FIG. 1 executes the target operation command. Here, the operation command may be a command for instructing the computer to execute an operation. In practice, operational commands can be expressed in a variety of existing computer languages (eg, machine language, assembly language, high-level languages). The target operation command may be an operation command input by a technician, or may be a command triggered by a user performing an operation.

When the equipment to be detected executes the target operation command, the corresponding image is displayed on the display of the equipment to be detected. As an example, before the detection target equipment executes the target operation command, the technician can turn on the shooting function of the client and start shooting in line with the display of the detection target equipment. Shooting can be stopped after the equipment to be detected completes the execution of the target operation command. As a result, it is possible to acquire an image of the image displayed on the screen when the detection target equipment executes the target operation command. As another example, shooting can be completed with an application with screen recording function installed in the equipment to be detected. As a result, it is possible to acquire an image of the image displayed on the screen when the detection target equipment executes the target operation command.

The image of the image displayed on the screen when the detection target equipment executes the target operation command can also be stored locally in the execution subject. At this time, the execution subject can directly and locally acquire the image of the image displayed on the screen when the detection target equipment executes the line target operation command.

In step 202, the video is analyzed into a frame sequence.

In this embodiment, the executing subject can analyze the video acquired in step 201 into a frame sequence by various methods. In fact, the image consists of multiple still images, and the naked eye has a visual pause phenomenon. Therefore, when the number of frames displayed per second exceeds a certain value, a continuous image is observed with the naked eye. Will be done. Therefore, various existing video processing software can restore the video to a frame sequence. In fact, the frame rate of the video can display the number of frames displayed per second. Optionally, the number of images in the frame sequence can be increased by increasing the frame rate of the video (which may be, for example, 240 fps). This facilitates subsequent processing.

In step 203, the start frame and the end frame are determined from the frame sequence.

In this embodiment, the executing subject can determine the start frame and the end frame by various methods. Here, the start frame includes an image displayed on the screen when the detection target equipment starts executing the target operation command, and the end frame is displayed on the screen when the detection target equipment completes the execution of the target operation command. Includes image.

As an example, the executing subject can determine the start frame and the end frame by the following method.

In the first step, binarization processing is performed on each image in the frame sequence so as to reduce noise information in the image and facilitate subsequent processing.

In the second step, for each image in the binarized frame sequence, a connected in each image is determined. This makes it possible to distinguish between a plurality of objects displayed in each image and facilitate subsequent processing.

In the third step, the similarity between adjacent frames of each set can be calculated for the image in the frame sequence processed in the second step. Based on this, two sets of adjacent frames are selected in order from the one with the smallest similarity to the one with the highest similarity. Depending on the position of the two selected adjacent frames on the time axis, one set of adjacent frames that are early in time is determined as the first adjacent frame, and one set of adjacent frames that are late in time is determined as the second adjacent frame. It can be determined as an adjacent frame. Further, as an example, with respect to the two frames in the first adjacent frame, one frame in the two frames that is earlier in time can be determined as the start frame. With respect to the two frames in the second adjacent frame, one frame in the two frames that is earlier in time can be determined as the end frame.

In some selective embodiments of this embodiment, determining the start and end frames from the frame sequence determines that the similarity between two adjacent frames in the frame sequence is greater than a predetermined threshold. In response to, one frame in two adjacent frames is settled as a start frame or an end frame.

In step 204, the response time when the detection target equipment executes the target operation command is determined based on the start frame and the end frame.

In this embodiment, the execution subject can determine the response time when the detection target equipment executes the target operation command based on the start frame and the end frame. In reality, since the video includes a time axis, each frame in the video corresponds to one time point on the time axis. Therefore, it is possible to determine the two time points corresponding to the time axis of the start frame and the end frame. After that, the difference between these two time points can be determined as the response time when the target operation command is executed by the equipment to be detected.

In some selective embodiments of this embodiment, the method for determining the response time is that the response time is greater than the target threshold in response to the determination that the response time is greater than the target threshold. It may be further provided to output presentation information for indicating.

In some selective embodiments of this embodiment, the target threshold is obtained by obtaining a set of past response times and determining the target threshold based on the set of past response times. Is.

Subsequently, with reference to FIG. 3, FIG. 3 is a schematic diagram of one application scenario of the method for determining the response time according to the present embodiment. In the application scenario of FIG. 3, the execution subject of the method for determining the response time may be the server 301. The equipment to be detected may be a tablet computer 302. An instant messaging application is installed in it. In the drawing, the login screen of the instant messaging application is displayed. The server 301 is connected to the smartphone 300 by Bluetooth®. The server 301 is connected to the tablet computer 302 via a data line. By preliminarily capturing an image displayed on the screen when the tablet computer 302 executes the login command, the smartphone 300 can acquire an image of the image displayed on the screen when the tablet computer 302 executes the login command. it can. After that, the server 301 can acquire the video 3011 from the smartphone 300. The video can then be analyzed into the frame sequence 3012. Based on this, the start frame 3013 and the end frame 3014 are determined from the frame sequence 3012 by calculating the similarity of adjacent images in the frame sequence 3012. Based on the difference between the two time points corresponding to the time axes of the start frame 3013 and the end frame 3014, the response time 3015 when the tablet computer 302 executes the login operation command of the instant messaging application is acquired.

The method for determining the response time provided by the embodiment of the present invention can first analyze the video into a frame sequence to determine the start and end frames. Based on this, the response time when the detection target equipment executes the target operation command is determined based on the start frame and the end frame. Compared to manual testing, it is possible to analyze with a particle size that exceeds what is perceptible to the naked eye, and the accuracy of the obtained response time can be improved. Further, as compared with the log analysis method, the accuracy of the acquired response time can be improved by avoiding the error due to the asynchronous operation.

Further, FIG. 4 shows a flow 400 of another embodiment of the method for determining the response time. Flow 400 of the method for determining the response time includes the following steps.

In step 401, in response to the reception of the signal indicating that the detection target equipment starts executing the target operation command, the start command for indicating the start of video recording is transmitted to the client.

In this embodiment, the execution subject of the method for determining the response time in response to the reception of the signal indicating that the detection target equipment starts executing the target operation command (for example, the server shown in FIG. 1). The 101) can transmit a start command for indicating the start of recording of the video to the client (for example, the client 102 shown in FIG. 1). Here, the signal for indicating that the detection target equipment starts executing the target operation command may be transmitted by the detection target equipment to the execution subject.

In fact, the technician can pre-create a test case for testing the equipment to be detected. One test case can correspond to one or more operations of the user. For example, a login test case can accommodate a user's login operation. The update test case can correspond to the user's update operation. The test case created in advance can be stored locally in the execution subject.

For example, when it is necessary to test the response time when the test target equipment (detection target equipment) executes a login command (command triggered by a user login operation), the executing entity uses the login test case as the test target equipment. Can be sent to. As a result, the equipment to be tested can achieve the same effect as the user performing a login operation on the equipment to be tested by executing the login test case. In response to the start of the login test case, the test target equipment can send a signal to the executing subject to indicate that the detection target equipment starts executing the target operation command. For example, it may be one interruption signal. As a result, the executing subject can receive a signal indicating that the detection target equipment starts executing the target operation command. Based on this, the executing subject can transmit a start command for indicating the start of video recording to the client.

In step 402, in response to the reception of the signal indicating that the target operation command has been executed and completed, the stop command for indicating the stop of video recording is transmitted to the client.

In the present embodiment, in response to receiving a signal indicating that the target equipment for detecting the target operation command has been executed, the executing subject transmits a stop command for indicating the stop of video recording to the client. can do.

Next, taking the login test case in step 401 as an example, in response to the completion of execution of the login test case, the test target equipment issues a target operation command to indicate that the detection target equipment has completed execution. It can be transmitted to the executing subject. For example, it may be one interruption signal. As a result, the executing subject can receive a signal indicating that the detection target equipment has completed the execution of the target operation command. Based on this, the executing subject can send a stop command to the client to indicate that the recording of the video is stopped.

In step 403, the target image transmitted from the client is received, and the target image is determined as the image of the image displayed on the screen when the detection target equipment executes the target operation command.

In the present embodiment, the execution subject can receive the target image transmitted from the client and determine the target image as an image image displayed on the screen when the detection target equipment executes the target operation command. .. Here, the target video is a video acquired by the client starting recording in response to the reception of the start command and stopping recording in response to the reception of the stop command.

In step 404, an image of a pre-captured image displayed on the screen when the target operation command is executed by the detection target equipment is acquired.

In step 405, the video is analyzed into a frame sequence.

In step 406, the start frame and the end frame are determined from the frame sequence.

Here, the start frame includes an image displayed on the screen when the detection target equipment starts executing the target operation command, and the end frame is displayed on the screen when the detection target equipment completes the execution of the target operation command. Includes image.

In step 407, the response time when the detection target equipment executes the target operation command is determined based on the start frame and the end frame.

In this example, the specific realization of steps 404-407 and the technical effects resulting from them can be referred to in steps 201-204 of the corresponding embodiment of FIG. 2, which will not be repeated here.

As can be seen from FIG. 4, as compared to the corresponding embodiment of FIG. 2, the method for determining the response time in this embodiment is to record a video to the client by transmitting a start command and a stop command to the client. Control to complete. Compared with manual recording, automatic recording can be realized.

Further referring to FIG. 5, as a realization of the methods shown in each of the above figures, the present invention provides an apparatus for determining a response time, and examples of the apparatus correspond to the method examples shown in FIG. , The device is specifically applied to various electronic devices.

As shown in FIG. 5, the device for determining the response time of this embodiment includes an acquisition unit 501, an analysis unit 502, a keyframe determination unit 503, and a response time determination unit 504. Here, the acquisition unit 501 is configured to acquire an image of a pre-captured image displayed on the screen when the detection target equipment executes the target operation command. The analysis unit 502 is configured to analyze the video into a frame sequence. The keyframe determination unit 503 is configured to determine the start frame and end frame from the frame sequence. Here, the start frame includes an image displayed on the screen when the equipment to be detected starts executing the target operation command, and the end frame is displayed on the screen when the equipment to be detected completes the execution of the target operation command. Includes image. The response time determination unit 504 is configured to determine the response time when the detection target equipment executes the target operation command based on the start frame and the end frame.

In this embodiment, the specific processing of the acquisition unit 501, the analysis unit 502, the keyframe confirmation unit 503, and the response time determination unit 504 in the apparatus 500 for determining the response time and the technical effects brought about by the specific processing are shown in FIG. Since it is similar to steps 201 to 204 in the corresponding embodiment of 2, it will not be repeated here.

In some selective embodiments of this embodiment, the device 500 for determining the response time may further include an output unit (not shown). Here, the output unit is configured to output presentation information to indicate that the response time is greater than the target threshold in response to the determination that the response time is greater than the target threshold.

In some selective embodiments of this embodiment, the target threshold is obtained by obtaining a set of past response times and determining the target threshold based on the set of past response times. It is a thing.

In some selective embodiments of this embodiment, the apparatus 500 for determining the response time includes a start command transmission unit (not shown), a stop command transmission unit (not shown), and a reception unit (not shown). ) Is further provided. Here, the start command transmission unit transmits a start command for indicating the start of video recording to the client in response to receiving a signal indicating that the equipment to be detected starts executing the target operation command. It is configured as follows. The stop command transmission unit is configured to send a stop command to the client to indicate that video recording has stopped in response to receiving a signal indicating that the equipment to be detected has completed executing the target operation command. Will be done. The receiving unit is configured to receive the target video transmitted from the client and determine the target video as the video of the image displayed on the screen when the detection target equipment executes the target operation command. Here, the target video is a video acquired by the client starting recording in response to the reception of the start command and stopping recording in response to the reception of the stop command.

In some selective embodiments of this embodiment, the keyframe determination unit 503 further responds by determining that the similarity between two adjacent frames in the frame sequence is greater than a predetermined threshold. It is configured to determine one of two adjacent frames as the start frame or end frame.

In this embodiment, the analysis unit 502 in the device 500 for determining the response time can first analyze the video acquired by the acquisition unit 501 into a frame sequence, and then the keyframe determination unit 503 , The start frame and the end frame can be determined. Based on this, the response time determination unit 504 can determine the response time when the detection target equipment executes the target operation command based on the start frame and the end frame. Compared to manual testing, it is possible to analyze with a particle size that exceeds what is perceptible to the naked eye, and the accuracy of the obtained response time can be improved. Compared with the log analysis method, the accuracy of the acquired response time can be improved by avoiding the error due to the asynchronous operation.

Hereinafter, FIG. 6 shows a schematic diagram of the structure of the computer system 600 suitable for realizing the server according to the embodiment of the present invention. The server shown in FIG. 6 is merely an example and does not impose any limitation on the functions and scope of use of the embodiments of the present invention.

As shown in FIG. 6, the computer system 600 has various appropriate operations and various appropriate operations depending on the program stored in the read-only memory (ROM) 602 or the program loaded from the storage portion 608 into the random access memory (RAM) 603. A central processing unit (CPU) 601 capable of executing processing is provided. The RAM 603 further stores various programs and data necessary for operating the system 600. The CPU 601 and the ROM 602 and the RAM 603 are interconnected via the bus 604. The input / output (I / O) interface 605 is also connected to the bus 604.

The input portion 606 including a keyboard, mouse, etc., the output portion 607 including a liquid crystal display (LCD), etc., a speaker, etc., the storage portion 608 including a hard disk, etc., and the communication portion 609 of the network interface card including a LAN card, a modem, etc. It is connected to the I / O interface 605. The communication portion 609 executes communication processing via a network such as the Internet. Drive 610 is also connected to I / O interface 605 as needed. A removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is attached to a drive 610 as needed, and a computer program read from the removable medium 611 is installed in a storage portion 608 as needed.

In particular, in the embodiment according to the present disclosure, the process described above with reference to the flowchart can be realized as a computer software program. For example, an embodiment of the present disclosure comprises a computer program product comprising a computer program carried on a computer readable medium, the computer program comprising program code that executes the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication portion 609 and / or installed from the removable medium 611. When the computer program is executed by the central processing unit (CPU) 601 it performs the functions limited to the methods of the present invention.

It should be explained that the computer-readable medium described in the present invention can be a computer-readable signal medium, a computer-readable storage medium, or any combination of both. The computer-readable storage medium can be, but is not limited to, for example, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any combination thereof. More specific examples of computer-readable storage media are electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only. It includes, but is not limited to, a memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage element, a magnetic storage element, or any combination thereof. In the present invention, a computer-readable storage medium can be any tangible medium that comprises or stores a program, which is used by, or coupled with, a command execution system, device, or element. used. In the present invention, a computer-readable signal medium can carry a computer-readable program code and be provided for a baseband or a data signal propagated as part of a carrier wave. The data signal thus propagated can take various forms including, but not limited to, electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which is used by, or coupled with, a command execution system, device or element. The program can be transmitted, propagated, or transported. The program code contained on a computer-readable medium can be transmitted by any suitable medium including, but not limited to, wireless, wire, fiber optic cable, RF, or any suitable combination thereof.

Computer program code for performing the operations of the present invention can be created in one or more programming languages, or a combination thereof, the programming languages being Java®, Smalltalk, C ++, and conventional programming languages. It includes object-oriented programming languages such as those, as well as traditional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user computer, partially on the user computer, as a single independent software package, or partially on the user computer and partially on the remote computer. , Or can be run entirely on a remote computer or server. In the case of a remote computer, the remote computer can connect to the user's computer or connect to an external computer (eg,) via any type of network that includes a local area network (LAN) or wide area network (WAN). , Can be connected via the Internet using an Internet service provider).

Flow charts and block diagrams in the drawings show the structure, function, and operation of feasible embodiments of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram can represent a module, program segment or part of code, the module, program segment or part of code to achieve a defined logical function. It comprises one or more executable commands of. It should also be noted that in alternative embodiments, the functions shown in the blocks may occur in a different order than those shown in the drawings. For example, two blocks displayed in succession may actually be executed substantially in parallel, or they may be executed in reverse order depending on the functions included. Also, each block of the block diagram and / or flowchart, and the combination of blocks of the block diagram and / or flowchart, is implemented in a dedicated hardware-based system that performs a specified function or operation, or dedicated hardware. It should also be noted that this can be achieved by a combination of and computer directives.

The units referred to in the embodiments of the present invention can be implemented by software or can also be implemented by hardware. The described units can also be installed in the processor as, for example, a processor comprising an acquisition unit, an analysis unit, a keyframe determination unit and a response time determination unit. Here, the names of these units may not be limited to the unit itself. For example, the acquisition unit may also be "preliminarily photographed displayed on the screen when the target operation command is executed by the detection target equipment. It can also be described as "a unit that acquires the image of the image".

In another aspect, the invention further provides a computer-readable medium, which can be included in or separately exists in the server described in the embodiment and is not installed on the server. be able to. The computer-readable medium can carry one or more programs, and when the one or more programs are executed by the server, the server executes the target operation command by the detection target equipment. The start frame including the image displayed on the screen when the target equipment starts executing the target operation command from the frame sequence by acquiring the image of the pre-captured image that is sometimes displayed on the screen and analyzing the image into a frame sequence. When the detection target equipment executes the target operation command based on the start frame and the end frame after determining the end frame including the image displayed on the screen when the detection target equipment completes the execution of the target operation command. Determine the response time of.

The above description is merely a description of the preferred embodiments of the present invention and the principles of the applied technique. The scope of the present invention referred to in the present invention is not limited to a specific combination of the above technical features, and at the same time, optionally the above technical features or equivalent features without departing from the above concept of the invention. Formed in combination. For example, other technical solutions formed by exchanging the above-mentioned features and technical features having functions similar to those disclosed in the present invention but not limited to the above-mentioned features should be covered. Those skilled in the art should understand.

Claims (11)

A computer-implemented method for determining response time,
Acquiring a pre-captured image that is displayed on the screen when the target equipment executes the target operation command.
Analyzing the video into a frame sequence and
Determining the start frame and end frame from the frame sequence
Based on the start frame and the end frame, the response time when the detection target equipment executes the target operation command is determined.
The start frame is a frame including an image displayed on the screen when the detection target equipment starts executing the target operation command, and the end frame completes the execution of the target operation command by the detection target equipment. sometimes Ri Oh in the frame containing the image to be displayed on the screen,
Prior to acquiring an image of a pre-captured image that is displayed on the screen when the target operation command is executed by the detection target equipment, the method is:
In response to the reception of the signal indicating that the detection target equipment starts executing the target operation command, the start command for indicating the start of video recording is transmitted to the client.
In response to the execution of the target operation command in response to the reception of a signal indicating that the equipment to be detected has been completed, a stop command for indicating the stop of video recording is transmitted to the client.
Further, the target image transmitted from the client is received, and the target image is determined as an image of an image displayed on the screen when the target operation command is executed by the detection target equipment.
The target video is a video acquired by the client starting recording in response to the reception of the start command and stopping recording in response to the reception of the stop command.
A computer-implemented method for determining response time. It is further characterized by further comprising outputting presentation information for indicating that the response time is larger than the target threshold value in response to the determination that the response time is larger than the target threshold value.
A method performed by a computer for determining the response time according to claim 1. The target threshold is
To get a set of past response times,
The target threshold is determined based on the set of past response times, and is obtained by.
A method performed by a computer for determining the response time according to claim 2. Determining the start frame and the end frame from the frame sequence
In response to the determination that the similarity between two adjacent frames in the frame sequence is greater than a predetermined threshold, one of the two adjacent frames is determined as the start frame or the end frame. A method implemented by a computer for determining the response time according to any one of claims 1 to 3, wherein the response time is determined. A device for determining the response time
An acquisition unit configured to acquire an image of a pre-captured image displayed on the screen when the target equipment executes a target operation command, and an acquisition unit.
An analysis unit configured to analyze the video into a frame sequence,
A keyframe confirmation unit configured to determine the start frame and end frame from the frame sequence,
A response time determination unit configured to determine a response time when the detection target equipment executes the target operation command based on the start frame and the end frame is provided.
The start frame is a frame including an image displayed on the screen when the detection target equipment starts executing the target operation command, and the end frame completes the execution of the target operation command by the detection target equipment. sometimes Ri Oh in the frame containing the image to be displayed on the screen,
The device is
A start command transmission unit configured to transmit a start command to indicate the start of video recording in response to the reception of a signal indicating that the detection target equipment starts executing the target operation command. When,
A stop command configured to send a stop command to the client to indicate that video recording has stopped in response to receiving a signal to indicate that the target operation command has been executed to indicate that the equipment to be detected has been completed. Sending unit and
A receiving unit configured to receive the target image transmitted from the client and determine the target image as an image image displayed on the screen when the target operation command is executed by the detection target equipment. With more
The target video is a video acquired by the client starting recording in response to the reception of the start command and stopping recording in response to the reception of the stop command.
A device for determining response time. It further comprises an output unit configured to output presentation information to indicate that the response time is greater than the target threshold in response to the determination that the response time is greater than the target threshold. To
The device for determining the response time according to claim 5. The target threshold is
To get a set of past response times,
The target threshold is determined based on the set of past response times, and is obtained by.
The device for determining the response time according to claim 6. The keyframe confirmation unit further
In response to the determination that the similarity of two adjacent frames in the frame sequence is greater than a predetermined threshold, one of the two adjacent frames is determined as the start frame or the end frame. The device for determining the response time according to any one of claims 5 to 7, wherein the response time is determined. With one or more processors
A server with a storage device that stores one or more programs.
A server that, when the one or more programs are executed by the one or more processors, causes the one or more processors to implement the method according to any one of claims 1 to 4. A computer-readable storage medium that stores computer programs
A computer-readable storage medium in which the method according to any one of claims 1 to 4 is realized when the program is executed by a processor. It ’s a computer program,
A computer program that realizes the method according to any one of claims 1 to 4 , when the computer program is executed by a processor.

Images