CN112837640A - Screen dynamic picture testing method, system, electronic equipment and storage medium - Google Patents
Screen dynamic picture testing method, system, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112837640A CN112837640A CN202110106925.4A CN202110106925A CN112837640A CN 112837640 A CN112837640 A CN 112837640A CN 202110106925 A CN202110106925 A CN 202110106925A CN 112837640 A CN112837640 A CN 112837640A
- Authority
- CN
- China
- Prior art keywords
- video stream
- test
- video frame
- video
- frame images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/006—Electronic inspection or testing of displays and display drivers, e.g. of LED or LCD displays
Abstract
The embodiment of the application discloses a screen dynamic picture testing method, a screen dynamic picture testing system, electronic equipment and a storage medium. According to the technical scheme, the method comprises the steps of monitoring the trigger operation of a screen dynamic picture of the current test terminal through a test script, correspondingly acquiring a test video stream in a set time period of the current test terminal in response to the trigger operation, extracting a pre-cached standard video stream, calculating a Hamming distance between each video frame image in the standard video stream and the test video stream, determining an alignment position of the standard video stream and the test video stream based on the Hamming distance and a timestamp of each video frame image, sequentially extracting the video frame images of the standard video stream frame by frame from the alignment position, comparing the video frame images with the corresponding video frame images in the test video stream, matching and updating the alignment position, and outputting a corresponding test result. By adopting the technical means, the automatic testing efficiency and precision of the dynamic screen picture can be improved, and the automatic testing result is optimized.
Description
Technical Field
The embodiment of the application relates to the technical field of automatic testing, in particular to a method and a system for testing a dynamic screen, electronic equipment and a storage medium.
Background
At present, with the continuous development of mobile intelligent terminals, mobile application programs are increasingly abundant. In order to ensure the operation display effect of the mobile application program, the screen dynamic pictures of the mobile application program running on various mobile intelligent terminals need to be automatically tested to judge whether the screen dynamic pictures of the mobile application program are normal. In the process of verifying and testing the screen dynamic picture, the corresponding video stream is collected to verify frame by frame so as to test whether the screen dynamic picture is normal.
However, when the screen dynamic image is automatically tested, the video stream is affected by the frame rate and the delay rate of the video stream, which easily causes the inaccuracy of the acquisition and verification process of the video stream, further affects the automatic test result of the screen dynamic image, and interferes the success rate of the automatic test result.
Disclosure of Invention
The embodiment of the application provides a screen dynamic picture testing method, a system, electronic equipment and a storage medium, which can accurately acquire video streams, optimize automatic testing results and improve the automatic testing efficiency of screen dynamic pictures.
In a first aspect, an embodiment of the present application provides a screen dynamic picture testing method, including:
monitoring the trigger operation of a screen dynamic picture of the current test terminal, and correspondingly acquiring a test video stream in a set time period of the current test terminal in response to the trigger operation;
extracting a standard video stream cached in advance, calculating a Hamming distance between each video frame image in the standard video stream and the test video stream, and determining an alignment position of the standard video stream and the test video stream based on the Hamming distance and a timestamp of each video frame image;
and sequentially extracting the video frame images of the standard video stream frame by frame from the alignment position, comparing and matching the video frame images with the corresponding video frame images in the test video stream, updating the alignment position, and outputting a corresponding test result.
In a second aspect, an embodiment of the present application provides a screen dynamic picture testing system, including:
the acquisition module is used for monitoring the trigger operation of a screen dynamic picture of the current test terminal and correspondingly acquiring the test video stream in the set time period of the current test terminal in response to the trigger operation;
the alignment module is used for extracting a standard video stream cached in advance, calculating a Hamming distance between each video frame image in the standard video stream and the test video stream, and determining the alignment position of the standard video stream and the test video stream based on the Hamming distance and the time stamp of each video frame image;
and the test module is used for sequentially extracting the video frame images of the standard video stream frame by frame from the alignment position, comparing and matching the video frame images with the corresponding video frame images in the test video stream, updating the alignment position and outputting a corresponding test result.
In a third aspect, an embodiment of the present application provides an electronic device, including:
a memory and one or more processors;
the memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the screen dynamic picture testing method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a storage medium containing computer-executable instructions for performing the screen dynamic picture testing method according to the first aspect when executed by a computer processor.
The method comprises the steps of monitoring the trigger operation of a screen dynamic picture of a current test terminal through a test script, correspondingly acquiring a test video stream in a set time period of the current test terminal in response to the trigger operation, extracting a pre-cached standard video stream, calculating a Hamming distance between each video frame image in the standard video stream and the test video stream, determining an alignment position of the standard video stream and the test video stream based on the Hamming distance and a timestamp of each video frame image, sequentially extracting the video frame images of the standard video stream frame by frame from the alignment position, comparing and matching the video frame images with corresponding video frame images in the test video stream, updating the alignment position, and outputting a corresponding test result. By adopting the technical means, the video stream can be accurately collected for image matching by monitoring the trigger operation of the screen dynamic picture through the test script, and the problems of video delay and frame rate can be solved by aligning the position of the video stream, so that the automatic test efficiency and precision of the screen dynamic picture are improved, and the automatic test result is optimized.
Drawings
FIG. 1 is a flowchart illustrating a method for testing dynamic screen images according to an embodiment of the present disclosure;
FIG. 2 is a diagram illustrating a dynamic screen test architecture according to an embodiment of the present application;
fig. 3 is a flowchart of alignment position determination in the first embodiment of the present application;
FIG. 4 is a flowchart of test result determination in the first embodiment of the present application;
FIG. 5 is a flowchart illustrating comparison and matching of test video streams according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of a screen dynamic picture testing system according to a second embodiment of the present application;
fig. 7 is a schematic structural diagram of an electronic device according to a third embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, specific embodiments of the present application will be described in detail with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some but not all of the relevant portions of the present application are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
The screen dynamic picture testing method aims to accurately collect the testing video stream through the testing script and enable the comparison and matching of the video frame images to be more accurate through aligning the testing video stream and the standard video stream, so that the success rate of screen dynamic picture testing is improved, and the automatic testing result is optimized. For a traditional automatic test system, when screen animation picture test is performed, frame rate and delay difference between a test video stream and a standard video stream easily cause inaccurate video stream acquisition, and further interfere with an automatic test result. Therefore, the screen dynamic picture testing method provided by the embodiment of the application is provided to solve the technical problem that the existing screen dynamic picture testing is inaccurate.
The first embodiment is as follows:
fig. 1 is a flowchart of a screen dynamic picture testing method according to an embodiment of the present application, where the screen dynamic picture testing method provided in this embodiment may be executed by a screen dynamic picture testing device, the screen dynamic picture testing device may be implemented in a software and/or hardware manner, and the screen dynamic picture testing device may be formed by two or more physical entities or may be formed by one physical entity. Generally, the screen motion picture test device may be a computer, a server host, or other computing devices.
The following description will be given taking a screen dynamic picture test apparatus as an example of a main body for executing the screen dynamic picture test method. Referring to fig. 1, the method for testing a dynamic screen specifically includes:
s110, monitoring the trigger operation of the screen dynamic picture of the current test terminal, and correspondingly collecting the test video stream in the set time period of the current test terminal in response to the trigger operation.
Specifically, referring to fig. 2, a schematic diagram of a framework for testing a dynamic screen of the present application is provided. When the screen dynamic picture test is performed, a tester uploads the test script for testing the screen dynamic picture to the test node by compiling the test script, and the test script is uploaded to the automatic test platform server (namely, the screen dynamic picture test equipment) by the test node to be executed. And when the automatic test platform server executes the test script, the acquisition of the test video stream is carried out by accessing the corresponding test terminal. The test script further triggers the running of the dynamic picture of the screen of the test terminal through automatically simulating the click operation of the test terminal. It can be understood that the click operation is a trigger operation of the screen dynamic picture, and the test script triggers the running of the screen dynamic picture through the click operation of the automatic simulation test terminal on one hand and monitors the trigger operation on the other hand, so as to conveniently collect the test video stream corresponding to the screen dynamic picture running in real time. It should be noted that, in the embodiment of the present application, the automatic test platform server may be simultaneously connected to a plurality of test terminals to perform a screen dynamic picture test, and the test video streams of the test terminals are respectively compared and matched with the pre-stored standard video streams, so that the automatic test platform server is implemented to simultaneously test the screen dynamic pictures of a plurality of devices, the problem that one device monopolizes test resources is solved, and the test efficiency of the automatic test platform server is improved.
Further, when monitoring the trigger operation of the screen dynamic picture based on the test script, the automatic test platform server correspondingly performs the response of the trigger operation and starts to acquire the corresponding test video stream. And the automatic test platform server responds to the trigger operation to start the screen capture service, and acquires the test video stream of the corresponding screen dynamic picture in the set time period of the current test terminal based on the screen capture service. The screen capturing service is realized based on an Airplay protocol, and the automatic test platform server can acquire video stream data of the iOS mobile phone through the screen capturing service. The screen capture service uses an open source code library, is modified on the basis of the open source code library, and increases Socket communication and multi-concurrency functions. When the test terminal is connected with the automatic test platform server, the automatic test platform server can inform the screen capturing service to start collecting the video stream file of the corresponding test terminal once the triggering operation of the corresponding screen dynamic picture is monitored by opening the local monitoring port. Moreover, the screen capture service has a multi-concurrent function, so that the screen capture service can concurrently acquire the test video streams of the plurality of test terminals corresponding to the scene of concurrently testing the plurality of test terminals by the automatic test platform server.
Before that, the automatic test platform server needs to collect a standard video stream in advance, where the standard video stream is a video stream collected correspondingly at a terminal device where a screen dynamic picture test is normal. The terminal equipment is defined as a standard terminal, the standard terminal provides test indexes of dynamic pictures of screens of all test terminals, corresponding standard video streams are collected based on the dynamic pictures of the screens of the standard terminals, the standard video streams can be used for carrying out screen dynamic picture tests of the test terminals subsequently, and whether the test video streams are normal or not is determined by comparing the standard video streams with the test video streams. Specifically, when a standard video stream is collected, referring to the collection mode of the test video stream, an automatic test platform server is connected with a standard terminal, and when a screen dynamic picture is triggered by the standard terminal, the corresponding standard video stream is collected from the standard terminal based on the test script and cached.
It should be noted that, when a test video stream or a standard video stream is collected, the video stream data within N seconds (i.e., within a set time period) is collected from the start of the trigger operation through a time period preset by the test script, so as to obtain the corresponding test video stream or standard video stream. The test script presets corresponding script parameters, and the script parameters record the set time interval and show that video stream data is acquired within N seconds after the trigger operation. In addition, according to actual needs, the script parameters also need to ensure that the frame rates of the standard video stream and the test video stream are as consistent as possible to ensure the accuracy and success rate of the screen dynamic picture test.
S120, extracting a pre-cached standard video stream, calculating a Hamming distance between each video frame image in the standard video stream and the test video stream, and determining an alignment position of the standard video stream and the test video stream based on the Hamming distance and a timestamp of each video frame image;
further, based on the test video stream collected in the step S110 and the standard video stream cached in advance, the comparison and matching between the two video stream data are correspondingly performed. It can be understood that if it is determined that the standard video stream matches the test video stream, the screen dynamic picture corresponding to the test terminal is normal, and otherwise, the screen dynamic picture corresponding to the test terminal is abnormal.
Before matching the two video stream data, the two video stream data need to be aligned. It can be understood that, due to the influence of network delay, screen capture service delay, APP response speed and other factors, the situation that the first frame of the standard video stream is inconsistent with that of the test video stream is easily caused. In addition, the acquisition of the standard video stream and the acquisition of the test video stream are respectively from different terminal devices, two groups of video stream data do not correspond to each other, and the problems need to be pre-processed during matching so as to avoid influencing the comparison and matching results of the video streams. Therefore, according to the embodiment of the application, the standard video stream and the test video stream are aligned, so that the accuracy of the comparison and matching result of the subsequent video stream can be ensured, and the success rate of the screen dynamic picture test caused by the inconsistency of the first frames of the videos is avoided.
Based on the standard video stream and the test video stream, the automatic test platform server obtains corresponding video frame images by decoding the standard video stream and the test video stream, and reduces the video frame images to a preset size. And obtaining a corresponding video frame image by decoding the video stream so as to compare and match the subsequent standard video stream and the test video stream frame by frame video frame images and further determine whether the test video stream is normal. Moreover, after each video frame image is obtained through decoding, the embodiment of the application further performs normalization processing corresponding to each video frame image, and reduces the video frame images from the two video streams to a set size, so that the sizes of the two video frame images can be ensured to be consistent, and the precision and accuracy of comparison and matching of the video frame images are improved. In addition, by reducing the size of the video frame image, the data calculation amount during the matching of the video frame image can be reduced, and the efficiency of the screen dynamic picture test is further improved.
After the processing of the video frame images is completed, the embodiment of the application calculates the hamming distance between each video frame image in the standard video stream and the test video stream based on the hash value by determining the hash value of each video frame image. It is understood that the hamming distance between any video frame image in the standard video stream and any video frame image in the test video stream is determined by the hash value, and the similarity between the video frame images in the two video streams can be determined based on the hamming distance. The shorter the hamming distance is, the higher the similarity of the two corresponding video frame images is, and otherwise, the lower the similarity of the two video frame images is. There are many ways to determine the image similarity based on the hamming distance, and the embodiment of the present application is not repeated herein. It should be noted that, according to the hamming distance between any video frame image in the standard video stream and any video frame image in the test video stream, the similarity between the groups of image groups can be quantized, and then the alignment position between the standard video stream and the test video stream is determined based on the similarity between the video frame images.
Specifically, referring to fig. 3, the alignment position determination process includes:
s1201, determining a set number of image groups with the highest similarity based on the Hamming distance;
s1202, determining the image group with the top sorting according to the time stamp of the video frame image in each image group, and taking the image group with the top sorting as the alignment position of the standard video stream and the test video stream.
The image group is constructed based on the combination of the standard video stream and any video frame image of the test video stream, and the Hamming distance of each image group is determined. Further, according to the hamming distances of the image groups, a set number of image groups with the shortest hamming distance (i.e., the highest similarity) are selected. It should be noted that, since the two video frame images at the alignment positions of the standard video stream and the test video stream are highly similar, one image group needs to be selected from a set number of image groups with the shortest hamming distance (i.e., the highest similarity) to determine the alignment position of the standard video stream and the test video stream. The image groups are sorted according to the time stamp of the video frame image of each standard video stream in the image groups, the image group with the most front sorted time stamp is determined from the image groups, and the image group is used as the alignment position of the standard video stream and the test video stream, so that the determination of the alignment position can be completed. Through the determination of the alignment position, the influence of inconsistent video delay on the screen dynamic picture test can be avoided, and the accuracy of the comparison and matching of the video frame images between the standard video stream and the test video stream is ensured.
And S130, sequentially extracting the video frame images of the standard video stream frame by frame from the alignment position, comparing and matching the video frame images with the corresponding video frame images in the test video stream, updating the alignment position, and outputting a corresponding test result.
After the alignment positions of the standard video stream and the test video stream are determined, the embodiment of the application performs comparison and matching of the test video stream frame by frame from the alignment position to determine whether a screen dynamic picture of the current test terminal is normal. Referring to fig. 4, the test result determination process includes:
s1301, extracting video frame images of the standard video stream frame by frame from the alignment position, comparing and matching the video frame images with corresponding video frame images in the test video stream, and updating the alignment position until the video frame images in the test video stream are compared;
s1302, if the matched video frame image reaches a set proportion, judging that the test video stream is normal.
Specifically, when the frame-by-frame comparison matching of the test video stream is performed based on the alignment position, video frame images are respectively extracted from the two video streams frame by frame from the alignment position according to the time stamp sequence of the standard video stream and the test video stream, and whether the two video frame images are matched is determined based on the comparison between the two extracted video frame images. And when judging whether the two video frame images are matched, respectively extracting the corresponding two video frame images for comparison, and if the similarity of the two video frame images reaches a set similarity threshold, judging that the corresponding two video frame images are matched. Otherwise, if the similarity of the two video frame images is lower than the set similarity threshold, the two corresponding video frame images are judged to be not matched.
Illustratively, when two video frame images are compared and matched, the hamming distance between the two video frame images is calculated through the hash values of the two video frame images, the hamming distance is normalized to a corresponding similarity value, and then the similarity value is compared with a preset similarity threshold value to determine whether the two video frame images are matched. In some embodiments, image feature information (e.g., image feature information such as pixel grayscale, brightness, etc.) of the two video frame images may be compared to determine similarity of the two video frame images, and a preset similarity threshold may be set based on the similarity comparison to determine whether the two video frame images are matched.
Further, with reference to the above comparison and matching manner of the video frame images, the video frame images are extracted from the standard video stream and the test video stream respectively from the determined alignment positions according to the time stamp sequence of the video frame images of the standard video stream, and compared to determine whether the two corresponding video frame images are matched. And if the two images are matched, extracting the next video frame image from the standard video stream according to the time stamp sequence for comparison and matching. At this time, the test video stream needs to extract video frame images one by one from the alignment position according to the time stamp sequence and compare the video frame images with the video frame images of the standard video stream until the matched video frame images are determined, and further update the alignment positions of the video frame images and the standard video stream. For example, if the second frame video frame image of the standard video stream matches the fifth frame video frame image of the test video stream, the alignment position is updated to the second frame of the standard video stream and the fifth frame of the test video stream. And when the comparison is matched next time, the test video stream starts to extract the video frame image from the fifth frame and then compares the video frame image with the third frame video frame image of the standard video stream until the video frame image matched with the third frame video frame image of the standard video stream is determined. By analogy, comparison of video frame images of each frame of the test video stream can be completed. Furthermore, the number of the video frame images matched with the standard video stream is determined according to the comparison and matching result of each video frame image of the test video stream, and the ratio of the video frame images of the test video stream to the video frame images of the standard video stream can be determined by dividing the number by the total number of the video frame images of the standard video stream. It can be understood that, when the ratio reaches the set ratio, the test video stream of the current test terminal is considered to be close to the standard video stream, and the running display effect of the corresponding screen dynamic picture is close to that of the standard terminal, that is, the screen dynamic picture of the test terminal runs and displays normally. Otherwise, if the ratio is lower than the set ratio, the test video stream is considered to be abnormal, and the display of the screen dynamic picture corresponding to the current test terminal is abnormal. Thus, the test of the test video stream is completed, and the corresponding screen dynamic picture test result is output.
For example, referring to fig. 5, in the video stream matching algorithm according to the embodiment of the present application, when performing comparison matching on test video streams, two groups of video streams are respectively recorded as a video a (standard video stream) and a video B (test video stream), a video frame image successfully matched with each frame in the test video stream is marked with matchedFrameCount (i.e., the number of matched frames), and if the comparison matching is successful once, the matchedFrameCount is incremented by 1. The video a and the video B are ffmpeg decoded, respectively, to generate a video frame image cacheVideo [ len1] and a video frame image currentVideo [ len2 ]. The sizes of the video frame image cacheVideo [ len1] and the video frame image currentVideo [ len2] are reduced to 8 × 8, and then the hash value of each video frame image is calculated and recorded as cacheVideoHash and currentVideo hash. And calculating corresponding Hamming distance according to any combination of the video frame image cacheVideo [ len1] and the video frame image currentVideo [ len2], and screening the first ten image groups with the highest similarity (namely the shortest Hamming distance) and recording the image groups as diffArr [ ]. And sorting the screened diffArr according to the sequence of the time stamps appearing in the video frame images, so that the video frame images which are in the front and closest to each other are preferentially subjected to template matching, namely the video frame images are determined to be the alignment positions of the standard video stream and the test video stream. Further, when the alignment is started from the alignment position, if the similarity of the alignment matching between the video frame image cacheVideo [ len1] and the video frame image currentVideo [ len2] reaches the set similarity threshold, the matching is successful, and meanwhile, index is i +1, the matchedFrameCount is added by 1, and the alignment position is updated. And repeating the comparison and matching steps, and if the matching number of the matchedFrameCount reaches 70% of the video frame image of the standard video stream, judging that the video A and the video B are successfully matched. And the manual test cost can be reduced by automatically testing and verifying the dynamic screen picture. In addition, the test script can provide video streams with high frame rate and low delay through a real-time screen capture service, and the screen capture service supports starting of a plurality of test terminals on the same server, so that the problem that one device monopolizes resources is effectively solved. In addition, through video stream comparison and matching, reliable test results can be provided to match with the flow of the automatic test, and the efficiency of the automatic test is improved.
The method comprises the steps of monitoring the trigger operation of a screen dynamic picture of a current test terminal through a test script, correspondingly acquiring a test video stream in a set time period of the current test terminal in response to the trigger operation, extracting a pre-cached standard video stream, calculating a Hamming distance between each video frame image in the standard video stream and the test video stream, determining the alignment position of the standard video stream and the test video stream based on the Hamming distance and a timestamp of each video frame image, sequentially extracting the video frame images of the standard video stream frame by frame from the alignment position, comparing and matching the video frame images with the corresponding video frame images in the test video stream, updating the alignment position, and outputting a corresponding test result. By adopting the technical means, the video stream can be accurately collected for image matching by monitoring the trigger operation of the screen dynamic picture through the test script, and the problems of video delay and frame rate can be solved by aligning the position of the video stream, so that the automatic test efficiency and precision of the screen dynamic picture are improved, and the automatic test result is optimized.
Example two:
on the basis of the above embodiments, fig. 6 is a schematic structural diagram of a screen dynamic picture testing system provided in the second embodiment of the present application. Referring to fig. 6, the screen dynamic picture testing system provided in this embodiment specifically includes: acquisition module 21, alignment module 22 and testing module 23.
The acquisition module is used for monitoring the trigger operation of a screen dynamic picture of the current test terminal and correspondingly acquiring the test video stream in the set time period of the current test terminal in response to the trigger operation;
the alignment module is used for extracting a standard video stream cached in advance, calculating a Hamming distance between each video frame image in the standard video stream and the test video stream, and determining the alignment position of the standard video stream and the test video stream based on the Hamming distance and the time stamp of each video frame image;
and the testing module is used for comparing the standard video stream with each video frame image in the testing video stream frame by frame from the alignment position and outputting a corresponding testing result.
The method comprises the steps of monitoring the trigger operation of a screen dynamic picture of a current test terminal through a test script, correspondingly acquiring a test video stream in a set time period of the current test terminal in response to the trigger operation, extracting a pre-cached standard video stream, calculating a Hamming distance between each video frame image in the standard video stream and the test video stream, determining the alignment position of the standard video stream and the test video stream based on the Hamming distance and a timestamp of each video frame image, sequentially extracting the video frame images of the standard video stream frame by frame from the alignment position, comparing and matching the video frame images with the corresponding video frame images in the test video stream, updating the alignment position, and outputting a corresponding test result. By adopting the technical means, the video stream can be accurately collected for image matching by monitoring the trigger operation of the screen dynamic picture through the test script, and the problems of video delay and frame rate can be solved by aligning the position of the video stream, so that the automatic test efficiency and precision of the screen dynamic picture are improved, and the automatic test result is optimized.
The screen dynamic picture testing system provided by the second embodiment of the present application can be used for executing the screen dynamic picture testing method provided by the first embodiment, and has corresponding functions and beneficial effects.
Example three:
an embodiment of the present application provides an electronic device, and with reference to fig. 7, the electronic device includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The memory 32 is a computer readable storage medium, and can be used for storing software programs, computer executable programs, and modules, such as program instructions/modules corresponding to the screen dynamic image testing method described in any embodiment of the present application (for example, the acquisition module, the alignment module, and the testing module of the screen dynamic image testing system). The communication module 33 is used for data transmission. The processor 31 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory, that is, implements the screen dynamic picture testing method described above. The input device 34 may be used to receive entered numeric or character information and to generate key signal inputs relating to user settings and function controls of the apparatus. The output device 35 may include a display device such as a display screen. The electronic device provided by the above can be used to execute the screen dynamic picture testing method provided by the first embodiment, and has corresponding functions and beneficial effects.
Example four:
embodiments of the present application also provide a storage medium containing computer-executable instructions for performing a screen dynamic picture testing method as described above when executed by a computer processor, and the storage medium may be any of various types of memory devices or storage devices. Of course, the storage medium provided in the embodiments of the present application contains computer-executable instructions, and the computer-executable instructions are not limited to the screen dynamic picture testing method described above, and may also perform related operations in the screen dynamic picture testing method provided in any embodiment of the present application.
The foregoing is considered as illustrative of the preferred embodiments of the invention and the technical principles employed. The present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the claims.
Claims (11)
1. A screen dynamic picture testing method is characterized by comprising the following steps:
monitoring the trigger operation of a screen dynamic picture of the current test terminal, and correspondingly acquiring a test video stream in a set time period of the current test terminal in response to the trigger operation;
extracting a standard video stream cached in advance, calculating a Hamming distance between each video frame image in the standard video stream and the test video stream, and determining an alignment position of the standard video stream and the test video stream based on the Hamming distance and a timestamp of each video frame image;
and sequentially extracting the video frame images of the standard video stream frame by frame from the alignment position, comparing and matching the video frame images with the corresponding video frame images in the test video stream, updating the alignment position, and outputting a corresponding test result.
2. The method for testing the dynamic screen picture of the mobile terminal, according to claim 1, wherein the step of collecting the test video stream within the set time period of the current test terminal in response to the trigger operation comprises the steps of:
and responding to the trigger operation to start a screen capture service, and acquiring a test video stream of a corresponding screen dynamic picture in a set time period of the current test terminal based on the screen capture service.
3. The screen motion picture testing method according to claim 1, further comprising, before extracting the pre-buffered standard video stream:
and when a standard terminal triggers a screen dynamic picture, acquiring the corresponding standard video stream from the standard terminal based on the test script and caching the standard video stream.
4. The screen motion picture testing method of claim 1, wherein calculating the hamming distance between the standard video stream and each video frame image in the test video stream comprises:
and determining a hash value of each video frame image, and calculating the Hamming distance between each video frame image in the standard video stream and the test video stream based on the hash value.
5. The screen motion picture testing method of claim 4, further comprising, before determining the hash value of each video frame image:
and decoding the standard video stream and the test video stream to obtain corresponding video frame images, and reducing the video frame images to a preset size.
6. The screen motion picture testing method of claim 1, wherein determining the alignment position of the standard video stream and the test video stream based on the hamming distance and the time stamp of each of the video frame images comprises:
determining a set number of image groups with the highest similarity based on the Hamming distance;
and determining the image group with the top ordering according to the time stamp of the video frame image in each image group, and taking the image group with the top ordering as the alignment position of the standard video stream and the test video stream.
7. The method for testing dynamic screen images according to claim 1, wherein extracting video frame images of the standard video stream frame by frame sequentially from the alignment position, comparing and matching the video frame images with corresponding video frame images in the test video stream, updating the alignment position, and outputting corresponding test results comprises:
extracting video frame images of the standard video stream frame by frame from the alignment position, comparing and matching the video frame images with corresponding video frame images in the test video stream, and updating the alignment position until the video frame images in the test video stream are compared;
and if the matched video frame images reach the set proportion, judging that the test video stream is normal.
8. The method for testing dynamic pictures on a screen according to claim 7, wherein extracting the video frame images of the standard video stream frame by frame from the aligned position, and comparing and matching the video frame images with the corresponding video frame images in the test video stream comprises:
and respectively extracting two corresponding video frame images for comparison, and judging that the two corresponding video frame images are matched if the similarity of the two video frame images reaches a set similarity threshold value.
9. A system for testing dynamic pictures on a screen, comprising:
the acquisition module is used for monitoring the trigger operation of a screen dynamic picture of the current test terminal and correspondingly acquiring the test video stream in the set time period of the current test terminal in response to the trigger operation;
the alignment module is used for extracting a standard video stream cached in advance, calculating a Hamming distance between each video frame image in the standard video stream and the test video stream, and determining the alignment position of the standard video stream and the test video stream based on the Hamming distance and the time stamp of each video frame image;
and the test module is used for sequentially extracting the video frame images of the standard video stream frame by frame from the alignment position, comparing and matching the video frame images with the corresponding video frame images in the test video stream, updating the alignment position and outputting a corresponding test result.
10. An electronic device, comprising:
a memory and one or more processors;
the memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the screen dynamic picture testing method of any of claims 1-8.
11. A storage medium containing computer-executable instructions for performing the screen dynamic picture testing method of any one of claims 1-8 when executed by a computer processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110106925.4A CN112837640A (en) | 2021-01-27 | 2021-01-27 | Screen dynamic picture testing method, system, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110106925.4A CN112837640A (en) | 2021-01-27 | 2021-01-27 | Screen dynamic picture testing method, system, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112837640A true CN112837640A (en) | 2021-05-25 |
Family
ID=75931727
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110106925.4A Pending CN112837640A (en) | 2021-01-27 | 2021-01-27 | Screen dynamic picture testing method, system, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112837640A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113923450A (en) * | 2021-10-09 | 2022-01-11 | 深圳创维－Rgb电子有限公司 | Automatic image detection method, device, equipment and storage medium |
| WO2024001000A1 (en) * | 2022-07-01 | 2024-01-04 | 天翼数字生活科技有限公司 | Video playing detection method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103731664A (en) * | 2013-12-25 | 2014-04-16 | 华为技术有限公司 | Method for full reference type video quality assessment, apparatus for full reference type video quality assessment and video quality testing device for full reference type video quality assessment |
| CN105631487A (en) * | 2015-12-31 | 2016-06-01 | 北京奇艺世纪科技有限公司 | Image comparison method, device, video comparison method and device |
| CN110619362A (en) * | 2019-09-17 | 2019-12-27 | 北京市博汇科技股份有限公司 | Video content comparison method and device based on perception and aberration |
| CN111105392A (en) * | 2019-11-25 | 2020-05-05 | 紫光展讯通信(惠州)有限公司 | Display performance testing method and device and storage medium |
| CN112153374A (en) * | 2020-09-25 | 2020-12-29 | 腾讯科技（深圳）有限公司 | Method, device and equipment for testing video frame image and computer storage medium |
-
2021
- 2021-01-27 CN CN202110106925.4A patent/CN112837640A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103731664A (en) * | 2013-12-25 | 2014-04-16 | 华为技术有限公司 | Method for full reference type video quality assessment, apparatus for full reference type video quality assessment and video quality testing device for full reference type video quality assessment |
| CN105631487A (en) * | 2015-12-31 | 2016-06-01 | 北京奇艺世纪科技有限公司 | Image comparison method, device, video comparison method and device |
| CN110619362A (en) * | 2019-09-17 | 2019-12-27 | 北京市博汇科技股份有限公司 | Video content comparison method and device based on perception and aberration |
| CN111105392A (en) * | 2019-11-25 | 2020-05-05 | 紫光展讯通信(惠州)有限公司 | Display performance testing method and device and storage medium |
| CN112153374A (en) * | 2020-09-25 | 2020-12-29 | 腾讯科技（深圳）有限公司 | Method, device and equipment for testing video frame image and computer storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113923450A (en) * | 2021-10-09 | 2022-01-11 | 深圳创维－Rgb电子有限公司 | Automatic image detection method, device, equipment and storage medium |
| WO2024001000A1 (en) * | 2022-07-01 | 2024-01-04 | 天翼数字生活科技有限公司 | Video playing detection method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112036755B (en) | Supervision method and system for quality detection of building engineering | |
| CN111355950A (en) | Video transmission quality detection method and system in real-time video communication | |
| CN107040535B (en) | Method, device and system for monitoring login of mobile application channel and storage medium | |
| CN112837640A (en) | Screen dynamic picture testing method, system, electronic equipment and storage medium | |
| WO2020029608A1 (en) | Method and apparatus for detecting burr of electrode sheet | |
| CN107223257B (en) | Test method, test server and test system | |
| CN112511818B (en) | Video playing quality detection method and device | |
| CN109922334A (en) | A kind of recognition methods and system of video quality | |
| CN113763348A (en) | Image quality determination method and device, electronic equipment and storage medium | |
| CN110458126A (en) | A kind of pantograph state monitoring method and device | |
| CN109656800B (en) | Method and device for testing image recognition application, terminal and storage medium | |
| WO2022062968A1 (en) | Self-training method, system, apparatus, electronic device, and storage medium | |
| CN115396705A (en) | Screen projection operation verification method, platform and system | |
| CN112055237B (en) | Method, system, apparatus, device and storage medium for determining screen-to-screen delay | |
| CN116467110B (en) | Method and system for detecting damage of tablet personal computer | |
| CN110113630B (en) | Video detection method and device, electronic equipment and storage medium | |
| CN113923443A (en) | Network video recorder testing method and device and computer readable storage medium | |
| CN111797339A (en) | Page rendering monitoring method and device | |
| CN115426534A (en) | Video stream quality detection method, device, equipment and storage medium | |
| CN111553408B (en) | Automatic test method for video recognition software | |
| CN112995650A (en) | Method and device for detecting video continuity of camera | |
| CN112437348A (en) | State information acquisition method, storage medium and smart television | |
| KR20150024972A (en) | System, verification apparatus, terminal device, method and computer-readable medium for verifying application | |
| CN111078541A (en) | Automatic katon detection method and system based on Unity engine | |
| CN111866583B (en) | Video monitoring resource adjusting method, device, medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |