WO2023240927A1

WO2023240927A1 - Terminal capability test system, method, device, and storage medium

Info

Publication number: WO2023240927A1
Application number: PCT/CN2022/133387
Authority: WO
Inventors: 黄莺; 施唯佳; 钱怡; 吕冠中
Original assignee: 天翼数字生活科技有限公司
Priority date: 2022-06-14
Filing date: 2022-11-22
Publication date: 2023-12-21
Also published as: CN115243030B; CN115243030A

Abstract

The present application discloses a terminal capability test system, a method, a device, and a storage medium. The following measurement criteria for multi-view service testing are quantified and defined: starting time differences of video signals, synchronization time differences spent achieving picture synchronization for the video signals, and a corresponding calculation method, so that the technical problems of manually testing terminal capabilities in the prior art, such as high time consumption, low testing efficiency, and being error-prone, are ameliorated.

Description

A terminal capability testing system, method, equipment and storage medium

Technical field

The present application relates to the field of testing technology, and in particular, to a terminal capability testing system, method, equipment and storage medium.

Background technique

Multi-screen and multi-viewing technology refers to the simultaneous playback of multiple video signals from different viewing angles of the same scene on the display screen. Affected by the network and the terminal, the pictures in each window appear in sequence; and after the pictures arrive, the pictures are not synchronized at first. The terminal needs to perform dynamic adjustments to achieve synchronous playback. You can test the terminal performance based on this. .

However, there is a lack of fair automated testing methods at this stage. The existing technology relies on testers to recognize the screen with the naked eye and manually evaluate the terminal performance. This manual testing method consumes a lot of time and manpower, is inefficient, and is error-prone.

Contents of the invention

This application provides a terminal capability testing system, method, equipment and storage medium, which are used to improve the existing technology of manually testing terminal capabilities, which has the technical problems of long time consumption, low testing efficiency and error-prone.

In view of this, the first aspect of this application provides a terminal capability testing system, including:

Screen recording module, used to record the playback process of various video signals;

The image recognition module is used to record the time point at which the video was recorded when a picture appears in the window where each video signal is located, and obtain the start time of each video signal; identify the timestamp of the corresponding picture of each video signal, and When the timestamps of each screen are consistent through the dynamic adjustment of the terminal under test, record the time point at which the video was recorded to obtain the synchronization time;

A calculation module, configured to calculate the start time difference and the synchronization time difference according to the start time and the synchronization time of each video signal;

An evaluation module, configured to evaluate the capabilities of the terminal under test based on the broadcast start time difference and the synchronization time difference.

Optionally, the calculation process of the start time difference is:

Filter out the maximum value and minimum value from the starting time of each video signal;

Calculate the difference between the maximum value and the minimum value to obtain the start time difference.

Optionally, the calculation process of the synchronization time difference is:

The difference between the synchronization time and the maximum value is calculated to obtain the synchronization time difference.

The second aspect of this application provides a terminal capability testing method, which is applied to any of the terminal capability testing systems described in the first aspect. The method includes:

Record the playback process of various video signals;

When it is detected that a picture appears in the window where each video signal is located, the time point at which the video was recorded is recorded to obtain the start time of each video signal;

Identify the timestamps of the corresponding pictures of each video signal, and when the timestamps of each picture are consistent through the dynamic adjustment of the terminal under test, record the time point at which the video was recorded to obtain the synchronization time;

Calculate the start time difference and synchronization time difference according to the start time and the synchronization time of each video signal;

The capability of the terminal under test is evaluated based on the broadcast start time difference and the synchronization time difference.

Optionally, the calculation process of the start time difference is:

Optionally, the calculation process of the synchronization time difference is:

A third aspect of this application provides a terminal capability testing device, which includes a processor and a memory;

The memory is used to store program code and transmit the program code to the processor;

The processor is configured to execute any one of the terminal capability testing methods described in the second aspect according to instructions in the program code.

A fourth aspect of the present application provides a computer-readable storage medium. The computer-readable storage medium is used to store program code. When the program code is executed by a processor, the terminal capability test described in any one of the second aspects is implemented. method.

It can be seen from the above technical solutions that this application has the following advantages:

This application provides a terminal capability testing system, including: a screen recording module, used to record the playback process of each video signal; an image recognition module, used to record when a picture appears in the window where each video signal is located. At the time when the video is recorded, the start time of each video signal is obtained; the timestamp of the corresponding picture of each video signal is identified, and when the timestamp of each picture is consistent through the dynamic adjustment of the terminal under test, the recording at this time is recorded The synchronization time is obtained at the time point of the video; the calculation module is used to calculate the start time difference and synchronization time difference based on the start time and synchronization time of each video signal; the evaluation module is used to evaluate the terminal under test based on the start time difference and synchronization time difference ability.

In this application, the screen recording module is used to automatically record the playback process of each video signal, the image recognition module is used to identify and obtain the start time and synchronization time of each video signal, and the calculation module is used to calculate the start time difference and synchronization time difference, and then evaluate The terminal under test realizes the automated test terminal capability and avoids manual intervention in the test. The test speed is fast, the test efficiency is high, and the test accuracy is high. This improves the existing technology's ability to manually test the terminal, which is time-consuming and low in test efficiency. Error-prone technical issues.

Description of the drawings

In order to explain the embodiments of the present application or the technical solutions in the prior art more clearly, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting any creative effort.

Figure 1 is a schematic structural diagram of a terminal capability testing system provided by an embodiment of the present application;

Figure 2 is a schematic diagram of a 4-way multi-view picture window provided by an embodiment of the present application;

Figure 3 is a schematic diagram of a timeline for recording video provided by an embodiment of the present application;

Figure 4 is a schematic flow chart of a terminal capability testing method provided by an embodiment of the present application.

Detailed ways

In order to enable those in the technical field to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only These are part of the embodiments of this application, but not all of them. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

For ease of understanding, please refer to Figure 1. This embodiment of the present application provides a terminal capability testing system, including:

The calculation module is used to calculate the start time difference and synchronization time difference based on the start time and synchronization time of each video signal;

The evaluation module is used to evaluate the capabilities of the terminal under test based on the start time difference and synchronization time difference.

This application takes into account that due to the influence of the network and the terminal, the images of each window of the multi-view screen appear in sequence; and, after the arrival of each video signal, the images are not synchronized at first, and the terminal needs to perform dynamic adjustments to achieve the desired result. Play simultaneously. Although these two time differences are short, they must exist. Under the same video source and the same network conditions, they can be used as test indicators to measure the terminal processing capabilities and provide a basis for terminal evaluation. For example, if multiple terminals are tested under the same conditions, the shorter the time difference, the stronger the terminal's decoding capability and performance. Therefore, embodiments of the present application provide a terminal capability testing system for automatically testing terminal capabilities.

The test system in the embodiment of this application includes a screen recording module, an image recognition module, a computing module and an evaluation module. The screen recording module can record the playback process of various video signals through external cameras or built-in software. In order to achieve test standardization and automation, a timestamp is added to each frame of the recorded video, that is, a timestamp is added to the original video in the format of " Hours: Minutes: Seconds: Milliseconds/Frame", you can refer to the 4-channel multi-view picture window provided in Figure 2. Timestamps are added to each picture window in the recorded video; because the general time difference will be relatively short, for accurate calculation, In the embodiment of the present application, milliseconds or frames are preferably used as the time measurement unit.

The image recognition module identifies the window area of each video signal in the recorded video, and then captures the start event and synchronization event. When capturing the playback event, the image recognition module monitors the picture of each window. When a window changes from an empty screen to a picture (with an image), a mark is marked on the timeline of the recorded video. The marked time point is For the start time of the video signal corresponding to the window, please refer to Figure 3, where T ₁ is the start time of the first video signal to be broadcast, T ₂ is the start time of the second video signal to be broadcast, and T _n is the start time of the last video signal to be broadcast; when capturing synchronization events, when the pictures are out of sync, the terminal under test will dynamically adjust the pictures of each channel so that the pictures of each channel are synchronized, so the image recognition module can identify each channel The timestamps of the pictures corresponding to the video signals. When the timestamps of each picture are consistent, they are marked on the timeline of the recorded video. The marked time point is the synchronization time, that is, the time T _s in Figure 3. At this time, the image recognition module can return an end instruction to the screen recording module to end the recording.

The calculation module can calculate the start time difference and synchronization time difference based on the start time and synchronization time of each video signal. The calculation process of the start time difference is:

Filter out the maximum value T _n and the minimum value T ₁ from the start time of each video signal;

Calculate the difference between the maximum value and the minimum value to obtain the start time difference, that is, TD1=T _n -T ₁ .

The calculation process of synchronization time difference is:

Calculate the difference between the synchronization time T _s and the maximum value T _n to obtain the synchronization time difference, that is, TD1=T _s -T _n .

After the calculation module calculates the two time differences, the start time difference and the synchronization time difference, the evaluation module can evaluate the terminal capabilities under test based on the start time difference and synchronization time difference. When testing multiple terminals under the same conditions, the shorter the time difference, the better the decoding ability of the terminal. The stronger the performance. The strength of terminal capabilities can be graded, such as strong, medium, and weak; each level is configured with a corresponding time difference interval. According to which interval the calculated time difference falls, the level corresponding to the interval is used as an evaluation of the terminal capability under test. result. When testing multiple terminals, you can sort them according to the time difference between the terminals to evaluate the capabilities of the terminals. Of course, those skilled in the art can use other evaluation methods to evaluate terminal capabilities according to actual needs, which are not specifically limited here.

It should be noted that according to test needs, the same terminal under test can be tested multiple times, and the average value is finally taken to evaluate the capability of the terminal under test. The test results are more accurate and accidental errors can be avoided.

The above is an embodiment of a terminal capability testing system provided by this application, and the following is an embodiment of a terminal capability testing method provided by this application.

Please refer to Figure 4. A terminal capability testing method provided by an embodiment of the present application is applied to the terminal capability testing system in the above embodiment. The method includes:

Step 101. Record the playback process of each video signal.

The playback process of each video signal can be recorded through an external camera or built-in software. In order to achieve test standardization and automation, a timestamp is added to each frame of the recorded video in the format of "hour: minute: second: millisecond/frame". Referring to the 4-channel multi-view picture window provided in Figure 2, timestamps are added to each picture window in the recorded video. Because the time difference is generally relatively short, for accurate calculation, the embodiment of the present application preferably uses milliseconds or frames as the time measurement unit.

Step 102: When it is detected that a picture appears in the window where each video signal is located, record the time point at which the video was recorded to obtain the start time of each video signal.

Identify the window area of each video signal in the recorded video, and then capture the start event. Specifically, the screen of each window is monitored. When a window changes from an empty screen to a screen (with an image), a mark is marked on the timeline of the recorded video. The marked time point is the video signal corresponding to the window. For the start time, please refer to Figure 3, where T ₁ is the start time of the first video signal to start, T ₂ is the start time of the second video signal, and T _n is the last start time. The start time of the broadcast video signal.

Step 103: Identify the timestamps of the corresponding pictures of each video signal, and when the timestamps of each picture are consistent through dynamic adjustment of the terminal under test, record the time point at which the video was recorded to obtain the synchronization time.

After all video signals are started, when capturing synchronization events, when the pictures are out of sync, the terminal under test will dynamically adjust the pictures of each channel so that the pictures of each channel are synchronized, so the timestamps of the pictures corresponding to each video signal can be identified. , when the timestamps of each picture are consistent, they are marked on the timeline of the recorded video. The marked time point is the synchronization time, that is, the time Ts in Figure 3.

Step 104: Calculate the start time difference and synchronization time difference according to the start time and synchronization time of each video signal.

The start time difference and synchronization time difference can be calculated based on the start time and synchronization time of each video signal. The calculation process of the start time difference is:

Screen out the maximum value T _n and the minimum value T ₁ from the start time of each video signal; calculate the difference between the maximum value and the minimum value to obtain the start time difference, that is, TD1=T _n -T ₁ .

The calculation process of synchronization time difference is:

Step 105: Evaluate the capabilities of the terminal under test based on the start time difference and synchronization time difference.

After calculating the two time differences, the start time difference and the synchronization time difference, the capability of the terminal under test can be evaluated based on the start time difference and synchronization time difference. When testing multiple terminals under the same conditions, the shorter the time difference, the stronger the terminal's decoding capability and performance. The strength of terminal capabilities can be graded, such as strong, medium, and weak; each level is configured with a corresponding time difference interval. According to which interval the calculated time difference falls, the level corresponding to the interval is used as an evaluation of the terminal capability under test. result. When testing multiple terminals, you can sort them according to the time difference between the terminals to evaluate the capabilities of the terminals. Of course, those skilled in the art can use other evaluation methods to evaluate terminal capabilities according to actual needs, which are not specifically limited here.

In the embodiment of this application, the playback process of each video signal is recorded, the start time and synchronization time of each video signal are obtained through identification, and the start time difference and synchronization time difference are calculated based on the start time and synchronization time of each video signal. Then it evaluates the terminal under test and realizes the ability to test the terminal automatically, avoiding manual intervention in the test. The test speed is fast, the test efficiency is high, and the test accuracy is high. This improves the ability of the existing technology to manually test the terminal, which is time-consuming and inefficient. Low and error-prone technical issues.

The embodiment of the present application also provides a terminal capability testing device, which includes a processor and a memory;

Memory is used to store program code and transmit the program code to the processor;

The processor is configured to execute the terminal capability testing method in the foregoing method embodiment according to instructions in the program code.

Embodiments of the present application also provide a computer-readable storage medium. The computer-readable storage medium is used to store program codes. When the program codes are executed by a processor, the terminal capability testing method in the foregoing method embodiments is implemented.

The terms "first", "second", "third", "fourth", etc. (if present) in the description of this application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe specific objects. Sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances so that the embodiments of the application described herein can, for example, be practiced in sequences other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, e.g., a process, method, system, product, or apparatus that encompasses a series of steps or units and need not be limited to those explicitly listed. Those steps or elements may instead include other steps or elements not expressly listed or inherent to the process, method, product or apparatus.

It should be understood that in this application, "at least one (item)" refers to one or more, and "plurality" refers to two or more. "And/or" is used to describe the relationship between associated objects, indicating that there can be three relationships. For example, "A and/or B" can mean: only A exists, only B exists, and A and B exist simultaneously. , where A and B can be singular or plural. The character "/" generally indicates that the related objects are in an "or" relationship. “At least one of the following” or similar expressions thereof refers to any combination of these items, including any combination of a single item (items) or a plurality of items (items). For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c" ”, where a, b, c can be single or multiple.

In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or contributes to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions for executing all or part of the steps of the methods described in various embodiments of the application through a computer device (which can be a personal computer, a server, or a network device, etc.). The aforementioned storage media include: U disk, mobile hard disk, read-only memory (English full name: Read-Only Memory, English abbreviation: ROM), random access memory (English full name: Random Access Memory, English abbreviation: RAM), magnetic Various media that can store program code, such as discs or optical disks.

As mentioned above, the above embodiments are only used to illustrate the technical solution of the present application, but not to limit it. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still make the foregoing technical solutions. The technical solutions described in each embodiment may be modified, or some of the technical features may be equivalently replaced; however, these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions in each embodiment of the present application.

Claims

A terminal capability testing system, which is characterized by including:

Screen recording module, used to record the playback process of various video signals;

The image recognition module is used to record the time point at which the video was recorded when a picture appears in the window where each video signal is located, and obtain the start time of each video signal; identify the timestamp of the corresponding picture of each video signal, and When the timestamps of each screen are consistent through the dynamic adjustment of the terminal under test, record the time point at which the video was recorded to obtain the synchronization time;

A calculation module, configured to calculate the start time difference and the synchronization time difference according to the start time and the synchronization time of each video signal;

An evaluation module, configured to evaluate the capabilities of the terminal under test based on the broadcast start time difference and the synchronization time difference.
The terminal capability testing system according to claim 1, characterized in that the calculation process of the start time difference is:

Filter out the maximum value and minimum value from the starting time of each video signal;

Calculate the difference between the maximum value and the minimum value to obtain the start time difference.
The terminal capability testing system according to claim 2, characterized in that the calculation process of the synchronization time difference is:

The difference between the synchronization time and the maximum value is calculated to obtain the synchronization time difference.
A terminal capability testing method, characterized in that it is applied to the terminal capability testing system according to any one of claims 1-3, and the method includes:

Record the playback process of various video signals;

When it is detected that a picture appears in the window where each video signal is located, the time point at which the video was recorded is recorded to obtain the start time of each video signal;

Identify the timestamps of the corresponding pictures of each video signal, and when the timestamps of each picture are consistent through the dynamic adjustment of the terminal under test, record the time point at which the video was recorded to obtain the synchronization time;

Calculate the start time difference and synchronization time difference according to the start time and the synchronization time of each video signal;

The capability of the terminal under test is evaluated based on the broadcast start time difference and the synchronization time difference.
The terminal capability testing method according to claim 4, characterized in that the calculation process of the start time difference is:

Filter out the maximum value and minimum value from the starting time of each video signal;

Calculate the difference between the maximum value and the minimum value to obtain the start time difference.
The terminal capability testing method according to claim 5, characterized in that the calculation process of the synchronization time difference is:

The difference between the synchronization time and the maximum value is calculated to obtain the synchronization time difference.
A terminal capability testing device, characterized in that the device includes a processor and a memory;

The memory is used to store program code and transmit the program code to the processor;

The processor is configured to execute the terminal capability testing method according to any one of claims 4-6 according to instructions in the program code.
A computer-readable storage medium, characterized in that the computer-readable storage medium is used to store program code, and when the program code is executed by a processor, the terminal capability testing method according to any one of claims 4-6 is implemented. .