JP2020030811A - Method and device for determining response time - Google Patents

Abstract

To provide a method and a device for determining a response time.SOLUTION: The method for determining a response time includes: acquiring a picture of a previously taken image displayed in a screen when a detection target facility executes a target operation command; analyzing a frame sequence in the picture; confirming, from a frame sequence, a start frame including an image displayed in a screen when the detection target facility starts execution of the target operation command and an end frame including an image displayed in the screen when the detection target facility completes the execution of the target operation command; and confirming the response time when the detection target facility executes the target operation command, on the basis of the start frame and the end frame.SELECTED DRAWING: Figure 2

Description

  Embodiments of the present invention relate to the field of computer technology, and in particular, to a method and apparatus for determining response time.

  With the continuous development of the Internet technology and the rapid spread of mobile terminals, various types of applications (Apps, Applications) are appearing one after another. When a user uses these apps, the phenomenon of getting stuck or delayed frequently occurs. In order to solve these problems, it is necessary to test the response time of the App. Currently, App response times are usually tested by manual testing or log analysis.

  Embodiments of the present invention provide a method and apparatus for determining response time.

  In a first aspect, embodiments of the present invention provide a method for determining a response time, the method comprising displaying a pre-shot image displayed on a screen when the target facility executes a target operation command. Acquiring an image of the image, analyzing the image into a frame sequence, and determining a start frame and an end frame from the frame sequence, wherein the start frame starts executing the target operation command by the detection target equipment. A frame including an image displayed on the screen at the time, and the end frame is a frame including an image displayed on the screen when the detection target equipment has completed the execution of the target operation command, and a start frame and an end frame. And determining a response time when the target facility executes the target operation command based on the target operation command.

  In some embodiments, the method for determining the response time comprises providing presentation information for indicating that the response time is greater than the target threshold in response to the response time being determined to be greater than the target threshold. Outputting further.

  In some embodiments, the target threshold is obtained by obtaining a set of past response times and determining the target threshold based on the set of past response times.

  In some embodiments, the method for determining a response time prior to obtaining a video of a pre-captured image that is displayed on a screen when the target facility executes the target operation command comprises a target In response to receiving the signal indicating that the operation target equipment starts to execute the detection target equipment, transmitting a start instruction to indicate the start of video recording to the client, and executing the target operation instruction on the detection target equipment. In response to the reception of the signal indicating that the recording is completed, transmitting a stop command to the client to indicate the stop of video recording, and receiving the target video transmitted from the client, the target video, the target video The operation command is determined as the image of the image displayed on the screen when the detection target equipment executes, and the target image is determined by the client in response to receiving the start command. Te start recording, further comprising a video obtained by stop recording in response to receiving the stop command, it and, a.

  In some embodiments, determining the start frame and the end frame from the frame sequence is performed in response to determining that a similarity between two adjacent frames in the frame sequence is determined to be greater than a predetermined threshold. Comprising determining one of the two frames as a start frame or an end frame.

  In a second aspect, an embodiment of the present invention provides an apparatus for determining a response time, the apparatus including a pre-shot image displayed on a screen when a target operation command executes a target operation command. An acquisition unit configured to capture a video of the image; an analysis unit configured to analyze the video into a frame sequence; and a key frame determination configured to determine a start frame and an end frame from the frame sequence. The unit, wherein the start frame is a frame including an image displayed on the screen when the target device starts executing the target operation command, and the end frame is a frame when the target device completes execution of the target operation command. The key frame determination unit, which is the frame containing the image to be displayed on the screen, and the start frame Based on the fine end frame, and a response time determination unit configured to determine a response time when the target operation command is detected facility executes.

  In some embodiments, the apparatus for determining the response time includes providing presentation information for indicating that the response time is greater than the target threshold in response to the response time being determined to be greater than the target threshold. The apparatus further includes an output unit configured to output.

  In some embodiments, the target threshold is obtained by obtaining a set of past response times and determining the target threshold based on the set of past response times.

  In some embodiments, the apparatus for determining the response time includes a signal for indicating the start of video recording in response to receiving a signal indicating that the target equipment starts to execute the target operation command. A start command transmission unit configured to transmit a start command to the client, and a signal for indicating a stop of video recording in response to receiving a signal indicating that the target equipment has completed execution of the target operation command. A stop command transmission unit configured to transmit a stop command to a client, an image displayed on a screen when a target image transmitted from the client is received, and the target image is displayed by the target device to execute the target operation command. A receiving unit configured to determine the target image as the target image, wherein the target image starts recording in response to the reception of the start command, and Of a video which is acquired by stop recording in response to receiving further comprises a receiving unit.

  In some embodiments, the key frame determination unit further includes, in response to determining that a similarity between two adjacent frames in the frame sequence is greater than a predetermined threshold, one of the two adjacent frames. One is determined as a start frame or an end frame.

  In a third aspect, an embodiment of the present invention is a server including one or more processors and a storage device storing one or more programs, wherein the one or more programs are A server is provided that, when executed by the one or more processors, causes the one or more processors to implement the method according to any embodiment of the first aspect.

  In a fourth aspect, an embodiment of the present invention is a computer readable medium having stored thereon a computer program, wherein the program is executed by a processor. Provide a computer readable medium on which the method may be implemented.

  A method and apparatus for determining a response time provided by an embodiment of the present invention determines a response time based on a start frame and an end frame by first determining a start frame and an end frame in a frame sequence of a video. can do. Compared to a manual test, analysis can be performed with a granularity that exceeds what can be perceived by the naked eye, and the accuracy of the obtained response time can be improved. As compared with the log analysis method, the accuracy of the obtained response time can be improved by avoiding the error due to the asynchronous calculation.

Other features, objects and advantages of the present invention will become more apparent from the detailed description given to non-limiting embodiments with reference to the drawings.
FIG. 1 is an exemplary system architecture diagram to which an embodiment of the present invention is applied. 4 is a flowchart of one embodiment of a method for determining a response time according to the present invention. FIG. 4 is a schematic diagram of one application scenario of a method for determining a response time according to an embodiment of the present invention; 5 is a flowchart of another embodiment of a method for determining a response time according to the present invention. FIG. 3 is a schematic view of a structure of an embodiment of a device for determining a response time according to the present invention. 1 is a schematic diagram of a structure of a computer system suitable for realizing a server according to an embodiment of the present invention.

  Hereinafter, the present application will be described in detail with reference to the drawings and embodiments. It is understood that the specific embodiments described herein are used only to interpret the relevant invention and are not limiting of the invention. For convenience of explanation, the drawings show only parts related to the related invention.

  Unless inconsistencies arise, the embodiments in the present application and the features in the embodiments can be combined with each other. Hereinafter, the present invention will be described in detail with reference to the drawings and embodiments.

  FIG. 1 shows an exemplary system architecture diagram of a method for determining a response time or an apparatus for determining a response time to which an embodiment of the present invention is applied.

  As shown in FIG. 1, the system architecture 100 may include a server 101, a client 102, a detection target facility 103, and networks 104 and 105. Here, the network 104 is used as a medium for providing a communication link between the server 101 and the client 102. The network 105 is used as a medium for providing a communication link between the server 101 and the equipment 103 to be detected. Networks 104, 105 may comprise various types of connections, such as wired, wireless communication links or fiber optic cables.

  The client 102 communicates with the server 101 via the network 104 to send and receive messages and the like. The detection target equipment 103 communicates with the server 101 via the network 105 to transmit and receive messages and the like.

  The server 101 may be a server that provides various services, such as a video processing server that can perform processing such as analysis on video captured by the client 102. The video processing server can perform processing such as analysis on the received video and acquire a processing result (for example, a response time).

  The detection target facility 103 may be hardware or software. When the detection target equipment 103 is hardware, it may be a variety of electronic devices having a display screen and supporting installation of an application, including a smartphone, a tablet computer, a laptop portable computer, and a desktop computer. It is not limited to these. When the detection target equipment 103 is software, it can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules or as a single software or software module. Here, it is not specifically limited.

  It should be noted that the method for determining the response time provided by the embodiment of the present invention is generally performed by the server 101, and the apparatus for determining the response time is generally installed in the server 101. .

  The server 101 and the client 102 may be hardware or software. When the server 101 and the client 102 are hardware, the server 101 and the client 102 can be implemented by a distributed facility cluster including a plurality of facilities, or can be implemented by a single facility. When the server 101 and the client 102 are software, they may be realized by a plurality of software or software modules, or may be realized by a single software or software module, and are not specifically limited here.

  It should be understood that the numbers of servers, clients, equipment to be detected, and networks in FIG. 1 are merely examples. It may have any number of servers, clients, equipment to be detected and networks, depending on the demands of realization.

  2, a flow 200 of one embodiment of a method for determining a response time according to the present invention.

  In step 201, a video of a previously captured image displayed on a screen when a target operation instruction executes a target operation command is acquired.

  In the present embodiment, the entity that executes the method for determining the response time (for example, the server 101 shown in FIG. 1) sends a communication-connected client (for example, the client 102 shown in FIG. 1) to the equipment to be detected (for example, When the detection target equipment 103 shown in FIG. 1 executes the target operation command, it is possible to acquire an image of a previously captured image displayed on the screen. Here, the operation command may be a command for instructing the computer to execute a certain operation. In practice, the operation commands can be expressed in various existing computer languages (eg, machine language, assembly language, high-level language). The target operation command may be an operation command input by a technician or a command triggered by performing a certain operation by a user.

  When the detection target equipment executes the target operation command, a corresponding image is displayed on the display of the detection target equipment. As an example, before the detection target equipment executes the target operation command, the technician can turn on the shooting function of the client and start shooting in alignment with the display of the detection target equipment. After the detection target equipment has completed the execution of the target operation command, the photographing can be stopped. Thereby, it is possible to acquire the video of the image displayed on the screen when the target operation command executes the target operation command. As another example, shooting can be completed by an application with a screen recording function installed in the detection target facility. Accordingly, it is also possible to acquire a video of an image displayed on the screen when the detection target equipment executes the target operation command.

  The image of the image displayed on the screen when the detection target equipment executes the target operation command may be stored locally in the execution subject. At this time, the execution subject can directly and locally acquire the image of the image displayed on the screen when the detection target equipment executes the line target operation command.

  At step 202, the video is analyzed into a frame sequence.

  In the present embodiment, the execution subject can analyze the video acquired in step 201 into a frame sequence by various methods. Actually, an image consists of a plurality of still images, and there is a visual pause phenomenon to the naked eye, so if the number of frames displayed per second exceeds a certain value, continuous images will be observed by the naked eye. Is done. Therefore, the video can be restored to the frame sequence by various existing video processing software. In fact, the frame rate of the video can indicate the number of frames displayed per second. Optionally, the number of images in the frame sequence can be increased by increasing the frame rate of the video (which may be, for example, 240 fps). This facilitates subsequent processing.

  In step 203, a start frame and an end frame are determined from the frame sequence.

  In this embodiment, the execution subject can determine the start frame and the end frame by various methods. Here, the start frame includes an image displayed on the screen when the detection target equipment starts executing the target operation command, and the end frame is displayed on the screen when the detection target equipment completes execution of the target operation command. Contains images.

  For example, the execution subject may determine the start frame and the end frame by the following method.

  In a first step, a binarization process is performed on each image in the frame sequence to reduce noise information in the images and facilitate subsequent processing.

  In the second step, for each image in the binarized frame sequence, a connected body (Connected) in each image is determined. This realizes distinction for a plurality of objects displayed in each image, and facilitates subsequent processing.

  In a third step, the similarity between each set of adjacent frames can be calculated for the images in the frame sequence that have undergone the processing of the second step. Based on this, two sets of adjacent frames are selected in order from the one with the smallest similarity to the one with the largest similarity. According to the position on the time axis of the selected two sets of adjacent frames, one set of adjacent frames that is earlier in time is determined as the first adjacent frame, and one set of adjacent frames that is later in time is determined as the second adjacent frame. It can be determined as an adjacent frame. Further, as an example, for two frames in the first adjacent frame, one temporally earlier frame of the two frames can be determined as a start frame. For two frames in the second adjacent frame, one temporally earlier frame of the two frames can be determined as the end frame.

  In some optional embodiments of the present embodiment, determining the start frame and the end frame from the frame sequence includes determining that a similarity between two adjacent frames in the frame sequence is determined to be greater than a predetermined threshold. And determining one of the two adjacent frames as a start frame or an end frame.

  In step 204, based on the start frame and the end frame, a response time when the target device executes the target operation command is determined.

  In this embodiment, the execution subject can determine the response time when the target device executes the target operation command based on the start frame and the end frame. Actually, since the video includes a time axis, each frame in the video corresponds to one time point on the time axis. Accordingly, two time points corresponding to the time axis of the start frame and the end frame can be determined. Thereafter, the difference between the two times can be determined as the response time when the target facility executes the target operation command.

  In some optional embodiments of the present embodiment, the method for determining the response time includes determining that the response time is greater than the target threshold in response to the response time being determined to be greater than the target threshold. May be further provided to output presentation information for indicating

  In some optional embodiments of this embodiment, the target threshold is obtained by obtaining a set of past response times and determining the target threshold based on the set of past response times. It is.

  Next, referring to FIG. 3, FIG. 3 is a schematic diagram of one application scenario of the method for determining the response time according to the present embodiment. In the application scenario of FIG. 3, the server 301 may perform the method for determining the response time. The equipment to be detected may be the tablet computer 302. It has an instant messaging application installed. In the drawing, a login screen of the instant messaging application is displayed. The server 301 is connected to the smartphone 300 by Bluetooth (registered trademark). The server 301 is connected to the tablet computer 302 via a data line. The smartphone 300 can capture an image of the image displayed on the screen when the tablet computer 302 executes the login command by previously capturing an image displayed on the screen when the tablet computer 302 executes the login command. it can. After that, the server 301 can acquire the video 3011 from the smartphone 300. Thereafter, the video can be analyzed into a frame sequence 3012. Based on this, the start frame 3013 and the end frame 3014 are determined from the frame sequence 3012 by calculating the similarity between adjacent images in the frame sequence 3012. A response time 3015 when the tablet computer 302 executes the login operation command of the instant messaging application is acquired based on a difference between two time points corresponding to the time axis of the start frame 3013 and the end frame 3014.

  The method for determining a response time provided by the embodiment of the present invention may first analyze a video into a frame sequence to determine a start frame and an end frame. Based on this, based on the start frame and the end frame, the response time when the target operation command executes the target operation command is determined. Compared to the manual test, the analysis can be performed at a granularity exceeding that which can be perceived by the naked eye, and the accuracy of the obtained response time can be improved. Further, as compared with the log analysis method, the accuracy of the obtained response time can be improved by avoiding the error due to the asynchronous operation.

  FIG. 4 further illustrates a flow 400 of another embodiment of a method for determining response time. The flow 400 of the method for determining the response time includes the following steps.

  In step 401, in response to receiving a signal indicating that the detection target equipment starts to execute the target operation instruction, a start instruction for indicating the start of video recording is transmitted to the client.

  In the present embodiment, in response to receiving a signal indicating that the target operation command starts to be executed by the detection target equipment, the subject of execution of the method for determining the response time (for example, the server shown in FIG. 1) 101) can transmit a start command for indicating the start of video recording to a client (for example, the client 102 shown in FIG. 1). Here, the signal for indicating that the detection target equipment starts to execute the target operation command may be transmitted by the detection target equipment to the execution subject.

  In fact, the technician can create a test case for testing the detection target equipment in advance. One test case may correspond to one or more operations of a user. For example, a login test case can correspond to a user's login operation. The update test case can respond to a user update operation. The test case created in advance can be stored locally in the execution subject.

  For example, when it is necessary to test a response time when a test target facility (detected facility) executes a login command (a command triggered by a user log-in operation), the execution subject converts the login test case into a test target facility. Can be sent to By executing the login test case, the test target facility can achieve the same effect as a user performing a login operation at the test target facility. In response to the start of the login test case, the test target equipment can send a signal to the execution subject to indicate that the detection target equipment starts executing the target operation command. For example, one interruption signal may be used. Accordingly, the execution subject can receive a signal indicating that the target facility starts to execute the target operation command. Based on this, the execution subject can transmit a start command for indicating the start of video recording to the client.

  In step 402, in response to receiving a signal indicating that the target equipment has completed execution of the target operation command, a stop command indicating stop of video recording is transmitted to the client.

  In the present embodiment, in response to receiving a signal indicating that the target equipment has completed execution of the target operation command, the execution subject transmits a stop command to the client to indicate stop of video recording. can do.

  Subsequently, in response to the completion of the execution of the login test case using the login test case in step 401 as an example, the test target equipment outputs a signal for indicating that the detection target equipment has completed execution of the target operation command, It can be transmitted to the execution subject. For example, one interruption signal may be used. Thus, the execution subject can receive a signal indicating that the target facility has completed execution of the target operation command. Based on this, the execution subject can transmit a stop command for indicating stop of video recording to the client.

  In step 403, the target image transmitted from the client is received, and the target image is determined as the image of the image displayed on the screen when the detection target equipment executes the target operation command.

  In this embodiment, the execution subject can receive the target image transmitted from the client and determine the target image as the image of the image displayed on the screen when the detection target equipment executes the target operation command. . Here, the target video is a video obtained by the client starting recording in response to receiving the start command and stopping recording in response to receiving the stop command.

  In step 404, a video of a previously captured image displayed on the screen when the target operation instruction executes the target operation command is acquired.

  In step 405, the video is analyzed into a frame sequence.

  In step 406, a start frame and an end frame are determined from the frame sequence.

  Here, the start frame includes an image displayed on the screen when the detection target equipment starts executing the target operation command, and the end frame is displayed on the screen when the detection target equipment completes execution of the target operation command. Contains images.

  In step 407, a response time when the target device executes the target operation command is determined based on the start frame and the end frame.

  In the present embodiment, the specific realization of steps 404 to 407 and the technical effects resulting therefrom can be referred to steps 201 to 204 in the corresponding embodiment of FIG. 2 and will not be described again here.

  As can be seen from FIG. 4, when compared with the corresponding embodiment of FIG. 2, the method for determining the response time in this embodiment is to send a start command and a stop command to the client, thereby recording the video to the client. Is controlled to be completed. Automatic recording can be realized as compared with manual recording.

  Still referring to FIG. 5, as an implementation for the method shown in each figure, the present invention provides an apparatus for determining response time, an embodiment of which corresponds to the method embodiment shown in FIG. The device is specifically applied to various electronic devices.

  As shown in FIG. 5, the apparatus for determining the response time according to the present embodiment includes an acquisition unit 501, an analysis unit 502, a key frame determination unit 503, and a response time determination unit 504. Here, the acquisition unit 501 is configured to acquire a video of a previously captured image displayed on the screen when the target device executes the target operation command. The analysis unit 502 is configured to analyze the video into a sequence of frames. The key frame determination unit 503 is configured to determine a start frame and an end frame from a frame sequence. Here, the start frame includes an image displayed on the screen when the target operation command starts executing the target operation command, and the end frame is displayed on the screen when the target object command completes execution of the target operation command. Contains images. The response time determination unit 504 is configured to determine a response time when the target device executes the target operation command based on the start frame and the end frame.

  In the present embodiment, the specific processing of the acquisition unit 501, the analysis unit 502, the key frame determination unit 503, and the response time determination unit 504 in the apparatus 500 for determining the response time and the technical effects brought about by the figure are shown in FIG. The steps are similar to steps 201 to 204 in the corresponding embodiment 2 and will not be described again here.

  In some optional embodiments of the present example, the apparatus 500 for determining a response time may further include an output unit (not shown). Here, the output unit is configured to output presentation information for indicating that the response time is greater than the target threshold value in response to the determination that the response time is greater than the target threshold value.

  In some optional embodiments of this embodiment, the target threshold is obtained by obtaining a set of past response times and determining the target threshold based on the set of past response times. It is a thing.

  In some optional embodiments of this embodiment, the apparatus 500 for determining response time comprises a start command sending unit (not shown), a stop command sending unit (not shown), and a receiving unit (not shown). Z) is further provided. Here, the start command transmitting unit transmits a start command for indicating the start of video recording to the client in response to receiving the signal indicating that the target device starts to execute the target operation command. It is configured as follows. The stop command transmission unit is configured to transmit a stop command for indicating stop of video recording to the client in response to receiving a signal indicating that the target operation command has completed execution of the target operation command. Is done. The receiving unit is configured to receive the target image transmitted from the client and determine the target image as an image of an image to be displayed on a screen when the detection target equipment executes the target operation command. Here, the target video is a video obtained by the client starting recording in response to receiving the start command and stopping recording in response to receiving the stop command.

  In some optional embodiments of the present example, the key frame determination unit 503 is further responsive to determining that a similarity between two adjacent frames in the frame sequence is greater than a predetermined threshold. It is configured to determine one of two adjacent frames as a start frame or an end frame.

  In this embodiment, the analysis unit 502 in the device 500 for determining the response time can first analyze the video acquired by the acquisition unit 501 into a frame sequence, and then the key frame determination unit 503 , A start frame and an end frame can be determined. Based on this, the response time determination unit 504 can determine the response time when the target device executes the target operation command based on the start frame and the end frame. Compared to the manual test, the analysis can be performed at a granularity exceeding that which can be perceived by the naked eye, and the accuracy of the obtained response time can be improved. As compared with the log analysis method, the accuracy of the obtained response time can be improved by avoiding the error due to the asynchronous calculation.

  FIG. 6 is a schematic diagram showing the structure of a computer system 600 suitable for realizing the server according to the embodiment of the present invention. The server shown in FIG. 6 is merely one example, and does not provide any limitation on the function and scope of use of embodiments of the present invention.

  As shown in FIG. 6, the computer system 600 may perform various suitable operations and programs by means of a program stored in a read-only memory (ROM) 602 or a program loaded from a storage part 608 into a random access memory (RAM) 603. A central processing unit (CPU) 601 capable of executing processing is provided. The RAM 603 further stores various programs and data necessary for operating the system 600. The CPU 601, the ROM 602, and the RAM 603 are interconnected via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

  An input portion 606 including a keyboard, a mouse, and the like, an output portion 607 including a liquid crystal display (LCD) and a speaker, a storage portion 608 including a hard disk, and a communication portion 609 of a network interface card including a LAN card, a modem, and the like. Connected to the I / O interface 605. The communication unit 609 performs communication processing via a network such as the Internet. The drive 610 is also connected to the I / O interface 605 as needed. A removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is mounted on the drive 610 as needed, and a computer program read therefrom is installed in the storage unit 608 as needed.

  In particular, in the embodiment according to the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, an embodiment of the present disclosure comprises a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising a program code for performing the method illustrated in the flowchart. In such embodiments, the computer program can be downloaded and installed from a network via communication portion 609 and / or can be installed from removable media 611. When the computer program is executed by a central processing unit (CPU) 601, it performs the functions limited to the method of the present invention.

  It should be noted that the computer-readable medium according to the present invention can be a computer-readable signal medium or a computer-readable storage medium or any combination of both. The computer-readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer readable storage media are electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only It includes, but is not limited to, a memory (EPROM or flash memory), an optical fiber, a portable compact disk read only memory (CD-ROM), an optical storage element, a magnetic storage element, or any combination thereof. In the present invention, a computer-readable storage medium can be any tangible medium that comprises or stores a program, which program is used by, or in combination with, a command execution system, apparatus, or element. used. In the present invention, a computer readable signal medium carries computer readable program code and may be provided in baseband or in a data signal propagated as part of a carrier wave. Data signals propagated in this manner can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, wherein the computer readable medium is used by, or in conjunction with, a command execution system, apparatus, or element. Programs can be sent, propagated, or transported. The program code contained on the computer readable medium may be transmitted by any suitable medium including, but not limited to, wireless, wire, fiber optic cable, RF, etc., or any suitable combination thereof.

  The computer program code for performing the operations of the present invention can be written in one or more programming languages, or a combination thereof, including Java, Smalltalk, C ++, and conventional programming languages. It comprises an object-oriented programming language such as one, and also comprises a conventional procedural programming language such as the "C" language or a similar programming language. The program code may be executed entirely on the user computer, partially on the user computer, as a single independent software package, partially on the user computer and partially on a remote computer , Or entirely on a remote computer or server. In the case of a remote computer, the remote computer can connect to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or connect to an external computer (eg, Can connect via the Internet, using an Internet service provider).

  The flowcharts and block diagrams in the drawings illustrate the structures, functions, and operations of possible embodiments of the systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowcharts or block diagrams may represent a module, a program segment, or a portion of code, where the module, program segment, or portion of the code implements a defined logical function. One or more executable instructions. Also note that in alternate embodiments, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks displayed in succession may, in fact, be executed substantially in parallel, or they may be executed in the reverse order, depending on the functionality involved. Also, each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented in dedicated hardware-based systems that perform specified functions or operations, or may be implemented using dedicated hardware. It can also be realized by a combination of and computer instructions.

  The units mentioned in the embodiments of the present invention may be implemented by software or may be implemented by hardware. The described units can also be installed in a processor, for example as a processor comprising an acquisition unit, an analysis unit, a key frame determination unit and a response time determination unit. Here, the names of these units may not be limited to the units themselves.For example, the acquisition unit may also be configured to perform a “pre-shooting displayed on the screen when the target operation command executes the target operation command”. A unit for acquiring a video of the created image. "

  In another aspect, the present invention further provides a computer-readable medium, which may be included in the server described in the above embodiment, or may be separately provided and not installed on the server. be able to. The computer readable medium can carry one or more programs, and when the one or more programs are executed by the server, the server executes the target operation command by the detection target equipment. A start frame including an image displayed on the screen when the target object starts to execute the target operation command from the frame sequence by acquiring a video of a pre-captured image displayed on the screen and analyzing the video into a frame sequence. And an end frame including an image displayed on the screen when the detection target equipment completes execution of the target operation instruction. When the detection target equipment executes the target operation instruction based on the start frame and the end frame. Determine the response time of

The above description is only the description of the preferred embodiment of the present invention and the principle of the applied technology. The scope of the present invention referred to in the present invention is not limited to the specific combination of the technical features described above, and at the same time, arbitrarily adds the technical features or equivalent features without departing from the inventive concept. Formed in combination. For example, the technical features having functions similar to the technical features disclosed in the present invention and the technical features disclosed in, but not limited to, the present invention should be exchanged with each other to cover other technical solutions. Should be understood by those skilled in the art.

Claims (12)

A method for determining a response time,
Acquiring a video of a previously captured image, which is displayed on the screen when the target device executes the target operation command,
Analyzing the video into a frame sequence;
Determining a start frame and an end frame from the frame sequence;
Based on the start frame and the end frame, to determine the response time when the detection target equipment executes the target operation command,
The start frame is a frame including an image displayed on a screen when the detection target equipment starts executing the target operation command, and the end frame is a frame in which the detection target equipment has completed execution of the target operation command. A frame containing an image that is sometimes displayed on the screen,
A method for determining response time. Further comprising: outputting presentation information for indicating that the response time is greater than the target threshold, in response to the response time being determined to be greater than the target threshold.
The method for determining a response time according to claim 1. The target threshold is
Obtaining a set of past response times;
Determining the target threshold based on the set of the past response times,
A method for determining a response time according to claim 2. The method for determining the response time before acquiring an image of a pre-shot image, which is displayed on a screen when the detection target equipment executes the target operation command,
In response to receiving a signal to indicate that the target operation command is to be executed by the detection target equipment, transmitting a start command to the client to indicate the start of video recording,
In response to receiving a signal to indicate that the target operation command has been completed, the target operation command is executed, and transmitting a stop command to the client to indicate a stop of video recording,
Receiving the target video transmitted from the client, determining the target video as a video of an image displayed on a screen when the target operation command executes the target operation command,
The target image is characterized in that the client starts recording in response to receiving the start command, and is an image acquired by stopping recording in response to receiving the stop command.
A method for determining a response time according to any one of claims 1 to 3. Determining the start frame and the end frame from the frame sequence,
Determining one of the two adjacent frames as the start frame or the end frame in response to the determination that the similarity between two adjacent frames in the frame sequence is greater than a predetermined threshold. The method for determining a response time according to any one of claims 1 to 3, comprising: A device for determining a response time,
An acquisition unit configured to acquire a video of a previously captured image, which is displayed on a screen when the target operation instruction executes the target operation command,
An analysis unit configured to analyze the video into a frame sequence;
A key frame determination unit configured to determine a start frame and an end frame from the frame sequence;
A response time determination unit configured to determine a response time when the target facility executes the target operation command based on the start frame and the end frame,
The start frame is a frame including an image displayed on a screen when the detection target equipment starts executing the target operation command, and the end frame is a frame in which the detection target equipment has completed execution of the target operation command. A frame containing an image that is sometimes displayed on the screen,
A device for determining the response time. An output unit configured to output presentation information for indicating that the response time is greater than the target threshold in response to the response time being determined to be greater than the target threshold. And
An apparatus for determining a response time according to claim 6. The target threshold is
Obtaining a set of past response times;
Determining the target threshold based on the set of the past response times,
An apparatus for determining a response time according to claim 7. A start command transmitting unit configured to transmit a start command to indicate a start of video recording to a client in response to receiving a signal indicating that the target operation command is to be executed by the detection target equipment. When,
A stop command configured to transmit to the client a stop command to indicate stop of video recording in response to receiving a signal to indicate that the detection target facility has completed execution of the target operation command. A transmission unit,
A receiving unit configured to receive a target image transmitted from the client, and determine the target image as an image of an image displayed on a screen when the target operation instruction executes the target operation command; Further comprising
The target image is characterized in that the client starts recording in response to receiving the start command, and is an image acquired by stopping recording in response to receiving the stop command.
An apparatus for determining a response time according to any one of claims 6 to 8. The key frame determination unit further includes:
Responding to a determination that the similarity between two adjacent frames in the frame sequence is greater than a predetermined threshold, one of the two adjacent frames is determined as the start frame or the end frame. The apparatus for determining a response time according to any one of claims 6 to 8, characterized in that: One or more processors,
A storage device storing one or more programs,
A server that, when the one or more programs are executed by the one or more processors, causes the one or more processors to implement the method according to any one of claims 1 to 5. A computer-readable medium storing a computer program,
A computer-readable medium on which the method according to any one of claims 1 to 5 is realized when the program is executed by a processor.