CN106982368B - Video response speed detection method and system - Google Patents

Video response speed detection method and system Download PDF

Info

Publication number
CN106982368B
CN106982368B CN201610035908.5A CN201610035908A CN106982368B CN 106982368 B CN106982368 B CN 106982368B CN 201610035908 A CN201610035908 A CN 201610035908A CN 106982368 B CN106982368 B CN 106982368B
Authority
CN
China
Prior art keywords
video
acquiring
operation instruction
current
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610035908.5A
Other languages
Chinese (zh)
Other versions
CN106982368A (en
Inventor
陈六四
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201610035908.5A priority Critical patent/CN106982368B/en
Publication of CN106982368A publication Critical patent/CN106982368A/en
Application granted granted Critical
Publication of CN106982368B publication Critical patent/CN106982368B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream

Abstract

A video response speed detection method, comprising: acquiring a video operation instruction of a current video; recording the current system time corresponding to the video operation instruction; starting a screen capture function; acquiring screenshots at a preset frequency and storing the screenshots to a picture library in a preset format; acquiring a key frame of the current video corresponding to the video operation instruction; searching whether a target screenshot corresponding to the key frame exists in the picture library or not; and when the target screenshot exists in the picture library, acquiring the time difference between the system time corresponding to the target screenshot and the current system time, and determining the response time of the video according to the time difference. The invention also provides a video response speed detection system. The detection method and the detection system can automatically and accurately acquire the response time of the video.

Description

Video response speed detection method and system
Technical Field
The invention relates to the technical field of videos, in particular to a method and a system for detecting video response speed.
Background
Mobile terminal devices, such as smart phones and tablet computers, have been widely used in the production and life of people, and in order to meet various requirements of people in the aspects of work, life, entertainment, and the like, more and more operating systems and application software applied to the mobile terminal devices are developed. The functions of the mobile terminal devices are more and more abundant, the interfaces are more and more humanized, but the video playing speed of the browser using the mobile terminal device is slower due to the influence of factors such as the processing performance of a mobile terminal chip and the like.
Due to the consideration of user experience and the requirement of browser providers for browser test performance, the response speed of browser video needs to be tested. There are three existing testing methods, the first method records the starting time of the browser video click and the time of the first frame image by manual testing, for example, by means of a stopwatch, and then calculates the difference between the starting time and the time of the first frame image as the response time, and evaluates the response speed of the video by the response time. The second method is to record a video in the process of playing a video by a browser, then obtain the starting time and the time of the first frame of picture by manually analyzing each frame of picture obtained by the video, and calculate the time difference between the starting time and the first frame of picture as the response time.
Disclosure of Invention
Based on this, it is necessary to provide a method and a system for detecting video response speed with high accuracy and capable of being automatically realized.
A video response speed detection method, comprising:
acquiring a video operation instruction of a current video;
recording the current system time corresponding to the video operation instruction;
starting a screen capture function;
acquiring screenshots at a preset frequency and storing the screenshots to a picture library in a preset format;
acquiring a key frame of the current video corresponding to the video operation instruction;
searching whether a target screenshot corresponding to the key frame exists in the picture library or not;
when the target screenshot exists in the picture library, acquiring a time difference between the system time corresponding to the target screenshot and the current system time; and
and determining the response time of the video according to the time difference.
A video response speed detection system comprising:
the operation instruction acquisition module is used for acquiring a video operation instruction of the current video;
the recording module is used for recording the current system time corresponding to the video operation instruction;
the screen capture starting module is used for starting a screen capture function;
the screen capture module is used for acquiring screenshots at a preset frequency and storing the screenshots to a picture library in a preset format;
the key frame acquisition module is used for acquiring a key frame of the current video corresponding to the video operation instruction;
the searching module is used for searching whether a target screenshot corresponding to the key frame exists in the picture library or not;
and the response calculation module is used for acquiring the time difference between the system time corresponding to the target screenshot and the current system time when the target screenshot exists in the picture library, and determining the response time of the video according to the time difference.
According to the video response speed detection method and system, the response time of the video can be obtained by calculating the time difference between the system time of the screen capture and the current system time corresponding to the video operation instruction, and the response time is used for judging whether the video response speed meets the requirement or not, wherein the screen capture corresponding to the operation instruction and the current system time corresponding to the operation instruction are obtained automatically, the detection process does not need to depend on human participation, the labor cost is saved, and the accuracy is better.
Drawings
Fig. 1 is an internal schematic view of a terminal according to an embodiment of the present invention;
fig. 2 is a flowchart of a video response time detection method according to an embodiment of the present invention;
FIG. 3 is a flowchart of a video response time detection method according to a second embodiment of the present invention;
FIG. 4 is a flowchart of a video response time detection method according to a third embodiment of the present invention;
FIG. 5 is a flowchart illustrating a video response time detection method according to a fourth embodiment of the present invention;
fig. 6 is a schematic structural diagram of a video response time detection system according to another embodiment of the present invention;
fig. 7 is a schematic structural diagram of a video response time detection system according to a second embodiment of the present invention;
fig. 8 is a schematic structural diagram of a video response time detection system according to a third embodiment of the present invention;
fig. 9 is a schematic structural diagram of a video response time detection system according to a fourth embodiment of the present invention;
FIG. 10 is a timing diagram illustrating the video response detection performed by the video response time detection system in accordance with one embodiment;
FIG. 11 is a diagram illustrating an embodiment of obtaining video operation commands;
FIG. 12 is a diagram illustrating launching a browser in one embodiment;
FIG. 13 is a diagram illustrating obtaining coordinates of a position of a start play button in an embodiment;
FIG. 14 is a diagram illustrating a screenshot obtained by screenshot software in one embodiment;
fig. 15 is a diagram illustrating acquisition of a first frame picture according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
The video response detection method provided by the embodiment of the present invention can be applied to the terminal shown in fig. 1, and the terminal 100 is preferably a mobile terminal. As shown in fig. 1, the terminal 100 includes a processor, a nonvolatile storage medium, an internal memory, a network interface, and a display screen, which are connected through a system bus. The processor has a calculation function and a function of controlling the operation of the terminal, and is configured to execute a video response speed detection method. The non-volatile storage medium includes at least one of a magnetic storage medium, an optical storage medium, and a flash memory type storage medium, and the non-volatile storage medium stores an operating system and a video response speed detection system. The video response speed detection system is used for realizing a video response speed detection method for a terminal player. The network interface is for connecting to a server, for communicating with the server, and for receiving resources from a network.
As shown in fig. 2, in an embodiment, a video response speed detection method is provided, which can be applied to the terminal 100 shown in fig. 1, and specifically includes the following steps.
Step 201, obtaining a video operation instruction of a current video.
Generally, the video operation instruction includes an instruction to start playing a video or an instruction to move a progress bar. The current video refers to a video played by a browser player of the terminal or other video players.
And step 203, recording the current system time corresponding to the video operation instruction.
The current system time corresponding to the video operation instruction refers to the time for sending the video operation instruction. The current system time when the video operation instruction is obtained is automatically recorded and used as the sending time of the video operation instruction. Specifically, when the video operation instruction is an instruction for starting playing a video, recording the time for clicking a play start button of the player as the current system time corresponding to the video operation instruction; and when the video operation instruction is an instruction of moving the progress bar, recording the operation time of the moving progress bar as the current system time corresponding to the video operation instruction.
Step 205, start the screenshot function. The initiation of the screenshot function may be accomplished by calling screenshot software. Invoking the screenshot software refers to implementing functionality that adds the screenshot software by calling an existing screenshot software Application Programming Interface (API) or function (function).
Preferably, the starting of the screenshot function is carried out at the same time of acquiring the video operation instruction of the current video. In specific implementation, the starting screenshot function may be before or after the operation instruction of the current video is obtained, and if the starting screenshot function is after the operation instruction of the video is obtained, it is ensured that the starting screenshot function is before a key frame corresponding to the operation instruction of the video appears, so as to ensure that the screenshot when the key frame corresponding to the operation instruction of the video appears can be captured.
Step 206, acquiring the screenshot at a preset screenshot frequency and storing the screenshot in a preset format to a picture library.
By starting the screenshots, a certain number of screenshots are continuously captured at a preset screenshot frequency, and the obtained screenshots are stored according to a preset format respectively. The speed of the screen capture can be adjusted by changing a preset screen capture frequency, which may be the screen capture frequency required to be set after the screen capture function is started, for example, when the screen capture frequency is set to 50 milliseconds, the number of screen captures obtained in one second is 20; when the screen capture frequency is set to 40 milliseconds, the number of screen captures obtained in one second is 25. The preset format refers to a name format or a picture format when the screen capture is stored, and the system time corresponding to the respective screen capture can be conveniently acquired after the screen capture is stored through the specific name format or picture format.
And step 207, acquiring a key frame of the current video corresponding to the video operation instruction.
The key frame corresponding to the video operation instruction refers to a picture frame pointed to by the video operation instruction. For example, when the video operation instruction is an instruction to start playing a video, the picture frame indicated by the instruction to start playing the video is the first frame of the current video, which appears after the start playing button is clicked, that is, the key frame corresponding to the instruction to start playing the video is the first frame; when the video operation instruction is an instruction to move the progress bar, the picture frame indicated by the instruction to move the progress bar is a picture frame played by the time node of the current video where the progress bar is moved, specifically, if the progress bar moves to 00 of the current video: at 20:10, the picture frame played by the time node of the current video where the progress bar is moved is the picture frame of the current video at the position of 00: the picture frame played at 20:10, that is, the key frame corresponding to the instruction to move the progress bar is the picture frame played by the time node where the progress bar is moved.
Acquiring the key frame of the current video can be realized by calling a multimedia video processing tool. The multimedia video processing tool is a set of open source computer programs that can be used to record, convert digital audio, video, and convert them into streams. Invoking a multimedia video processing tool may also be accomplished by invoking an existing multimedia video processing tool Application Programming Interface (API) or function (function) to add functionality to the multimedia video processing tool. Any desired keyframes of the current video can be obtained by the multimedia video processing tool.
Step 209, find whether there is a target screenshot corresponding to the key frame in the picture library.
And taking the key frame corresponding to the video operation instruction as a reference object, respectively comparing the similarity of the screenshot obtained in the step 205 with the key frame, and searching whether the same screenshot as the key frame exists or a first screenshot with the highest similarity to the key frame from a picture library, wherein the same screenshot or the first screenshot with the highest similarity is a target screenshot corresponding to the key frame. Generally, the screen shot with the similarity of more than 90% with the key frame can be used as the target screen shot meeting the search requirement. The similarity comparison of the searched picture library can be realized by calling a cross-platform computer vision library, namely, the function of increasing the image processing of the cross-platform computer vision library is realized by calling a program programming interface of the cross-platform computer vision library. Since the screen shot is obtained by capturing the terminal screen at the preset screen capture frequency, there may be a case that the screen shot same as the key frame appears between two adjacent captured screen shots, and therefore, the first screen shot with the highest similarity to the key frame may be used as the target screen shot corresponding to the key frame. When a plurality of target screenshots with similarity meeting the requirement exist, the first screenshot refers to the target screenshot with relatively earlier system time corresponding to the screenshot.
Step 210, when the target screenshot exists in the picture library, acquiring a time difference between the system time corresponding to the target screenshot and the current system time.
Step 212, determining the response time of the video according to the time difference.
And after the target screen capture corresponding to the key frame is found, acquiring the system time when the target screen capture is correspondingly captured, and calculating the time difference between the system time corresponding to the target screen capture and the current system time corresponding to the video operation instruction to be used as the response time of the current video.
In this embodiment, a current video is operated, a current system time when a corresponding operation is sent is recorded, a plurality of screenshots are captured at a preset frequency by starting a screenshot function, and a target screenshot corresponding to a picture frame which is pointed to by the corresponding operation is determined from the screenshots, so that a time difference between the target screenshot and the current system time can be calculated, that is, a response time from sending to finishing of the video from the corresponding operation is detected, and whether a video response speed meets a requirement is judged. The screen capture corresponding to the operation instruction and the current system time corresponding to the operation instruction are obtained automatically, people do not need to participate in the detection process, labor cost is saved, and the accuracy is better.
As shown in fig. 3, in an embodiment, in step 201, the step of obtaining the video operation instruction of the current video includes: step 2015, obtaining a video operation instruction for starting playing by clicking.
Step 207, the step of acquiring the key frame of the current video corresponding to the video operation instruction includes: step 2075, obtain the first frame of picture corresponding to the video operation instruction that starts playing after clicking the current video.
By respectively acquiring the video operation instruction for starting playing by clicking and the first frame picture corresponding to the video operation instruction for starting playing by clicking, the response time for starting playing of the video is detected as the detection of the video response speed. In the detection process of the video response speed, the response speed of the operation instruction for starting playing is detected, so that the quantity required by the screenshot can be reduced, the efficiency of searching the target screenshot can be improved, and the efficiency of the video response speed detection method is correspondingly improved.
In another embodiment, in step 201, before the step of obtaining the video operation instruction of the current video, the method further includes: step 2011, a browser start instruction is acquired;
step 2012, opening the browser according to the browser starting instruction, and searching the position coordinate of the start playing button of the current video in the browser;
and 2013, sending a click event to the play start button according to the position coordinate.
In this embodiment, it is preferable to detect the video response speed of the browser player. As more and more operating systems and application software applied to mobile terminal devices are developed, the functions of the mobile terminal devices are more and more abundant, and the performance test results of various browser players are important reference indexes for selecting a browser by a user. The browser starting instruction is obtained and comprises an instruction for opening the browser by clicking through an application interface by a user, or an instruction for selecting the detected browser when the detection method is operated. And opening the browser according to the browser starting instruction, wherein the method comprises a mode of opening the video page while opening the browser, or opening the video page in the browser after opening the browser.
The instruction for selecting the detected browser is initiated by a user through a software application interface, specifically, a browser starting instruction for selecting a button of the detected browser or other buttons is provided through the software application interface, the browser is opened and a click event is sent according to the position of a video player button on the browser by acquiring the starting instruction of the detected browser, so that the video response speed can be completely and automatically detected, the detection result is completely free from the interference of human factors, the detection result is more accurate, and the detection efficiency is higher. Secondly, a plurality of detected browsers can be selected for detection at one time, so that detection results of the plurality of detected browsers can be obtained for comparison.
As shown in fig. 4, in an embodiment, the step 206 of acquiring screenshots at a preset screenshot frequency and storing the screenshots in a preset format to the picture library includes:
step 2062, acquiring a screenshot at a preset frequency;
step 2063, storing the screenshots into the picture library by respectively using the corresponding system time as the file name.
The system time corresponding to the screen capture refers to the capture time corresponding to each screen capture, the screen capture is stored by taking the system time corresponding to each screen capture as a file name, the system time corresponding to each screen capture can be directly obtained through the file name, and compared with the method that the system time corresponding to each screen capture is taken as the information contained in the screen capture or is taken as the additional storage information of the screen capture, the method is more convenient to realize and is convenient to find an error point under the condition that the captured image is lost.
In another embodiment, as shown in fig. 5, in step 207, the step of acquiring a key frame of the current video corresponding to the video operation instruction includes:
step 2071, obtaining a film source address of a current video;
step 2072, downloading the film source of the current video according to the film source address;
step 2073, obtain the key frame corresponding to the video operation command in the film source.
The source address of the current video comprises a source address determined according to the related information of the current video or a uniform resource locator of the current video. The film source address determined according to the related information of the current video refers to a film source address determined by the name, type, content keyword, etc. of the current video. The real film source address of the current video can be obtained through the uniform resource locator of the current video, so that the film source which is the same as the current video can be downloaded through a downloading tool, the key frame corresponding to the video operation instruction is obtained from the film source, the same film source is downloaded according to the real film source address, and the detection accuracy can be further ensured.
The downloading of the film source according to the film source address can be downloading of the whole video film source, or downloading of only a part of video film sources including key frames corresponding to the video operation instruction. For example, when the video operation instruction is an instruction to start playing a video, only the first several megabytes of video sources of the current video including the first frame may be downloaded in the step of downloading the video source of the current video according to the video source address; when the video operation instruction is an instruction to move the progress bar, in the step of downloading the film source of the current video according to the film source address, only the clip film source containing the picture frame played by the time node of the current video where the progress bar is moved may be downloaded.
As shown in fig. 6, in one embodiment, a video response speed detection system is provided, and includes an operation instruction acquisition module 20, a recording module 21, a screen capture starting module 22, a screen capture module 23, a key frame acquisition module 24, a search module 25, and a response calculation module 26.
The operation instruction obtaining module 20 is configured to obtain a video operation instruction of a current video.
The recording module 21 is configured to record a current system time corresponding to the video operation instruction.
The screenshot launching module 22 is used to launch a screenshot function.
The screen capture module 23 is configured to obtain screenshots at a preset frequency and store the screenshots in a preset format in the picture library.
The key frame obtaining module 24 is configured to obtain a key frame of the current video corresponding to the video operation instruction.
The searching module 25 is configured to search whether a target screenshot corresponding to the key frame exists in the picture library.
The response calculation module 26 is configured to, when a target screenshot exists in the picture library, obtain a time difference between a system time corresponding to the target screenshot and a current system time.
In an embodiment, as shown in fig. 7, the operation instruction obtaining module 20 is specifically configured to obtain a video operation instruction for starting playing by clicking. The key frame obtaining module 24 is specifically configured to obtain a first frame of picture of the current video corresponding to the video operation instruction that is clicked to start playing.
Preferably, as shown in fig. 7, the video response speed detection system further includes a start instruction acquisition module 31, a coordinate acquisition module 32, and a click module 33.
The starting instruction obtaining module 31 is configured to obtain a browser starting instruction;
the coordinate obtaining module 32 is configured to open a browser according to a browser starting instruction, and search for a position coordinate of a play start button of the current video in the browser;
the click module 33 is configured to send a click event to the start playing button according to the position coordinates.
In another embodiment, as shown in fig. 8, the screen capture module 23 includes a screen capture unit 232 and a storage unit 233. The screen capture unit 232 is configured to obtain screen captures at a preset frequency. The storage unit 233 is configured to store the screenshots into the picture library with the corresponding system times as file names, respectively.
In one embodiment, as shown in fig. 9, the key frame acquiring module 24 includes an address acquiring unit 241, a downloading unit 242, and a key frame acquiring unit 243.
The address obtaining unit 241 is configured to obtain a slice source address of the current video.
The downloading unit 242 is configured to download the source of the current video according to the source address.
The key frame acquiring unit 243 is configured to acquire a key frame corresponding to the video operation instruction in the film source.
According to the method and the system for detecting the video response speed, provided by the embodiment of the invention, the current system time when the corresponding video operation instruction is sent is recorded through the video operation instruction generated by operating the current video, a plurality of screenshots are captured at a preset frequency by starting the screenshot function, and the target screenshot corresponding to the key frame pointed to by the corresponding operation is determined from the screenshots, so that the time difference between the target screenshot and the current system time can be calculated, namely the response time from the sending to the completion of the corresponding operation of the video is detected, and whether the video response speed meets the requirement or not is judged.
The video response speed detection method and system can be used for detecting the response speed of various terminals or players for playing videos. Preferably, the method and system for detecting the video response speed are used for detecting the performance of a browser player of the mobile terminal so as to design or select a browser video function with performance more meeting the requirements of a user of the mobile terminal.
As shown in fig. 10, the timing diagram of the video response speed detection system in an embodiment is a timing diagram of video response speed detection performed by the video response speed detection system, in this exemplary embodiment, the video response speed detection system is configured to detect a video response speed of a browser player of a mobile phone terminal with an Android operating system, where a current video is a video played by the browser player, a video operation instruction is an instruction to start playing the video, a key frame corresponding to the video operation instruction is a first frame, a film source address is a uniform resource locator obtained from a webview of a video playing web page, a multimedia video processing tool is ffmpeg, and a cross-platform computer vision library called by searching a picture library for comparison of picture similarity is OpenCV;
the specific process of the method for detecting the video response speed detection system comprises the following main steps:
1) starting a browser; specifically, as shown in fig. 11 and 12, the browser to be started may receive a selection instruction of a user through a button provided by the software application interface for selecting the browser to be detected, so that the browser to be detected is automatically started and acquired when the method for detecting the video response speed is run.
2) Searching the position coordinate of the play starting button; as shown in fig. 13, a screenshot of the browser player may be captured by the screenshot software, and the position coordinates of the start playing button may be obtained from the screenshot by calling the cross-platform computer vision library.
3) Clicking a button for starting playing the video; specifically, a control instruction for starting playing the video button by clicking can be sent by an input driving program of an Android system, and the sending time of the control instruction is obtained as the current system time of the click operation instruction.
4) Starting a screenshot function, and intercepting a current screen once every 50ms by a screenshot module by calling screenshot software, as shown in fig. 14, which is a schematic diagram of a partial screenshot of the current screen intercepted by the screenshot software, preferably, the intercepted current screen is firstly stored in a memory, and after 150 pictures are intercepted, the current screen is written into an SD card once.
5) And acquiring a slice source address of the current video, specifically, acquiring the slice source address of the current video in webview in a javascript injection mode.
6) And downloading the current film source, and downloading the current film source according to the film source address by starting a downloading tool.
7) The first picture in the slice source of the current video is obtained, and as shown in fig. 15, the first picture can be obtained through ffmpeg tool.
8) Specifically, the similarity of the pictures can be compared by calling opencv (open Source Computer Vision library), and the first screen shot which is the same as or has the highest similarity with the first frame picture in the screen shots of the picture library is determined as the target screen shot. OpenCV is a cross-platform computer vision library based on (open source) distribution, can run on various operating systems such as Linux, Windows, Mac OS and the like, and simultaneously provides interfaces of various languages, so that a plurality of general algorithms in the aspects of image processing and computer vision can be realized.
9) And acquiring response time, specifically calculating a time difference between the system time of the target screenshot and the current system time corresponding to the click operation instruction to obtain the response time.
Comparing the first frame obtained by the video response speed detection system in the above embodiment with the screenshot obtained by the screenshot function, and after determining the target screenshot by comparison, detecting the response speed of the first frame of the browser video to be detected by using the time difference between the system time corresponding to the target screenshot and the current system time when the user clicks to start playing.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention.

Claims (10)

1. A video response speed detection method, comprising:
acquiring a video operation instruction of a current video;
recording the current system time corresponding to the video operation instruction; the current system time refers to the time for sending the video operation instruction;
starting a screen capture function;
acquiring screenshots at a preset frequency and storing the screenshots to a picture library in a preset format;
acquiring a key frame of the current video corresponding to the video operation instruction;
searching whether a target screenshot corresponding to the key frame exists in the picture library or not;
when the target screenshot exists in the picture library, acquiring a time difference between the system time corresponding to the target screenshot and the current system time; and
determining the response time of the video according to the time difference;
when the video operation instruction is an instruction of moving a progress bar, the recording current system time corresponding to the video operation instruction includes: recording the operation time of the moving progress bar; the acquiring a key frame of the current video corresponding to the video operation instruction includes: acquiring a picture frame played by a time node in which a progress bar in the current video is moved by calling an application programming interface or function of a multimedia video processing tool; the time difference is the time difference between the system time corresponding to the target screenshot and the operation time of the mobile progress bar;
when the video operation instruction is a video operation instruction which is clicked to start playing, the recording of the current system time corresponding to the video operation instruction comprises: recording the time for clicking a play start button of the player; the acquiring a key frame of the current video corresponding to the video operation instruction includes:
and acquiring the first frame of picture of the current video appearing after the start playing button is clicked.
2. The video response speed detection method of claim 1, wherein: before the step of obtaining the video operation instruction of the current video, the method further comprises:
acquiring a browser starting instruction;
opening a browser according to the browser starting instruction, and searching the position coordinate of the play starting button of the current video in the browser;
and sending a click event to the play starting button according to the position coordinate.
3. The video response speed detection method of claim 1, wherein: the step of acquiring screenshots at a preset frequency and storing the screenshots in a preset format to a picture library comprises:
acquiring a screenshot at a preset frequency;
and respectively storing the screenshots into a picture library by taking the corresponding system time as a file name.
4. The video response speed detection method according to any one of claims 1 to 3, wherein: the step of acquiring the key frame of the current video corresponding to the video operation instruction comprises:
acquiring a film source address of the current video;
downloading the film source of the current video according to the film source address;
and acquiring a key frame corresponding to the video operation instruction in the film source.
5. A video response speed detection system comprising:
the operation instruction acquisition module is used for acquiring a video operation instruction of the current video;
the recording module is used for recording the current system time corresponding to the video operation instruction; the current system time refers to the time for sending the video operation instruction;
the screen capture starting module is used for starting a screen capture function;
the screen capture module is used for acquiring screenshots at a preset frequency and storing the screenshots to a picture library in a preset format;
the key frame acquisition module is used for acquiring a key frame of the current video corresponding to the video operation instruction;
the searching module is used for searching whether a target screenshot corresponding to the key frame exists in the picture library or not;
the response calculation module is used for acquiring the time difference between the system time corresponding to the target screenshot and the current system time when the target screenshot exists in the picture library, and determining the response time of the video according to the time difference;
when the video operation instruction is an instruction of moving a progress bar, the recording module is further used for recording the operation time of the moving progress bar; the key frame acquisition module is further used for acquiring a picture frame played by a time node in which the progress bar in the current video moves by calling an application programming interface or function of a multimedia video processing tool; the time difference is the time difference between the system time corresponding to the target screenshot and the operation time of the mobile progress bar;
when the video operation instruction is a video operation instruction for starting playing by clicking, the recording module is further used for recording the time for starting playing by clicking a playing button of the player; the key frame acquisition module is further used for acquiring the first frame of picture of the current video appearing after the start playing button is clicked.
6. The video response speed detection system of claim 5, wherein: further comprising:
the starting instruction acquisition module is used for acquiring a browser starting instruction;
the coordinate acquisition module is used for opening a browser according to the browser starting instruction and searching the position coordinate of the play starting button of the current video in the browser;
and the clicking module is used for sending a clicking event to the play starting button according to the position coordinate.
7. The video response speed detection system of claim 5, wherein: the screen capture module comprises:
the screen capture unit is used for acquiring screen captures at a preset frequency;
and the storage unit is used for storing the screenshots into a picture library by taking the corresponding system time as a file name respectively.
8. The video response speed detection system according to any one of claims 5 to 7, wherein: the key frame acquisition module comprises:
the address acquisition unit is used for acquiring a film source address of the current video;
the downloading unit is used for downloading the film source of the current video according to the film source address;
and the key frame acquisition unit is used for acquiring the key frame corresponding to the video operation instruction in the film source.
9. A terminal, characterized in that it comprises a memory and a processor, the memory having stored therein a computer program which, when executed by the processor, causes the processor to carry out the steps of the method according to any one of claims 1 to 4.
10. A computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, causes the processor to carry out the steps of the method according to any one of claims 1 to 4.
CN201610035908.5A 2016-01-19 2016-01-19 Video response speed detection method and system Active CN106982368B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610035908.5A CN106982368B (en) 2016-01-19 2016-01-19 Video response speed detection method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610035908.5A CN106982368B (en) 2016-01-19 2016-01-19 Video response speed detection method and system

Publications (2)

Publication Number Publication Date
CN106982368A CN106982368A (en) 2017-07-25
CN106982368B true CN106982368B (en) 2020-06-23

Family

ID=59340642

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610035908.5A Active CN106982368B (en) 2016-01-19 2016-01-19 Video response speed detection method and system

Country Status (1)

Country Link
CN (1) CN106982368B (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109766250A (en) * 2017-11-09 2019-05-17 广东欧珀移动通信有限公司 Mobile terminal and its response performance test method, device and storage medium
CN110099299A (en) * 2018-01-30 2019-08-06 腾讯科技(深圳)有限公司 Video frame parameter acquiring method, acquisition device and computer readable storage medium
CN108664281A (en) * 2018-03-13 2018-10-16 广东美晨通讯有限公司 It obtains application and starts time method, electronic equipment and the device with store function
CN110704294B (en) * 2018-07-09 2023-06-09 百度在线网络技术(北京)有限公司 Method and apparatus for determining response time
CN110908887B (en) * 2018-09-14 2023-09-12 飞狐信息技术(天津)有限公司 Method and system for automatically testing response speed of application program
CN109697156A (en) * 2018-11-19 2019-04-30 北京奇艺世纪科技有限公司 A kind of starting time obtaining method, device, terminal device and storage medium
CN110795340A (en) * 2019-10-04 2020-02-14 广州易方信息科技股份有限公司 Non-invasive Flash player automatic testing method
CN112055237B (en) * 2020-08-31 2022-07-19 北京爱奇艺科技有限公司 Method, system, apparatus, device and storage medium for determining screen-to-screen delay
CN115174924A (en) * 2022-07-20 2022-10-11 天翼数字生活科技有限公司 Set top box, video play-out delay calculation method, system, equipment and medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102624576A (en) * 2011-01-27 2012-08-01 腾讯科技(深圳)有限公司 Method for automatically testing webpage downloading time of browser and system thereof
CN102761456A (en) * 2011-04-29 2012-10-31 腾讯科技(深圳)有限公司 Method, device and system for acquiring performance parameters of browser of mobile terminal
CN102761467A (en) * 2011-04-25 2012-10-31 腾讯科技(深圳)有限公司 Method, device and system for calculating webpage download time of browser
CN102902625A (en) * 2012-11-14 2013-01-30 北京奇虎科技有限公司 Software performance test system and method
CN102929782A (en) * 2012-11-14 2013-02-13 北京奇虎科技有限公司 Device and method for testing software performances
CN103581987A (en) * 2012-07-31 2014-02-12 腾讯科技(深圳)有限公司 Method and device for testing webpage downloading speed of mobile terminal device
CN105117267A (en) * 2015-09-23 2015-12-02 北京金山安全软件有限公司 Browser starting method and device and terminal equipment
CN105183632A (en) * 2015-07-21 2015-12-23 四川长虹电器股份有限公司 Automatic testing method for video playback starting

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102624576A (en) * 2011-01-27 2012-08-01 腾讯科技(深圳)有限公司 Method for automatically testing webpage downloading time of browser and system thereof
CN102761467A (en) * 2011-04-25 2012-10-31 腾讯科技(深圳)有限公司 Method, device and system for calculating webpage download time of browser
CN102761456A (en) * 2011-04-29 2012-10-31 腾讯科技(深圳)有限公司 Method, device and system for acquiring performance parameters of browser of mobile terminal
CN103581987A (en) * 2012-07-31 2014-02-12 腾讯科技(深圳)有限公司 Method and device for testing webpage downloading speed of mobile terminal device
CN102902625A (en) * 2012-11-14 2013-01-30 北京奇虎科技有限公司 Software performance test system and method
CN102929782A (en) * 2012-11-14 2013-02-13 北京奇虎科技有限公司 Device and method for testing software performances
CN105183632A (en) * 2015-07-21 2015-12-23 四川长虹电器股份有限公司 Automatic testing method for video playback starting
CN105117267A (en) * 2015-09-23 2015-12-02 北京金山安全软件有限公司 Browser starting method and device and terminal equipment

Also Published As

Publication number Publication date
CN106982368A (en) 2017-07-25

Similar Documents

Publication Publication Date Title
CN106982368B (en) Video response speed detection method and system
CN106658199B (en) Video content display method and device
CN108616696B (en) Video shooting method and device, terminal equipment and storage medium
US20170192500A1 (en) Method and electronic device for controlling terminal according to eye action
US10951823B2 (en) Method and apparatus for capturing a video, terminal device and storage medium
CN108900771B (en) Video processing method and device, terminal equipment and storage medium
CN112118395B (en) Video processing method, terminal and computer readable storage medium
CN107748615B (en) Screen control method and device, storage medium and electronic equipment
CN108712667B (en) Smart television, screen capture application method and device thereof, and readable storage medium
CN105828101A (en) Method and device for generation of subtitles files
CN109639952B (en) Photographing question searching method and electronic equipment
EP3461136B1 (en) Video playing method and device
CN107870999B (en) Multimedia playing method, device, storage medium and electronic equipment
CN110968391A (en) Screenshot method, screenshot device, terminal equipment and storage medium
CN112241361A (en) Test case generation method and device and problem scene automatic reproduction method and device
US20230072899A1 (en) Tagging an Image with Audio-Related Metadata
CN108256071B (en) Method and device for generating screen recording file, terminal and storage medium
CN111077992B (en) Click-to-read method, electronic equipment and storage medium
US10924637B2 (en) Playback method, playback device and computer-readable storage medium
CN113824987A (en) Method, medium, device and computing equipment for determining time consumption of first frame of live broadcast room
CN105898169A (en) Video processing method and device
CN112328834A (en) Video association method and device, electronic equipment and storage medium
US20170139933A1 (en) Electronic Device, And Computer-Readable Storage Medium For Quickly Searching Video Segments
CN107748642B (en) Method and device for adjusting picture, storage medium and electronic equipment
CN109040848A (en) Barrage is put upside down method, apparatus, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant