WO2022156202A1 - Video transmission test method, apparatus and system, and terminal - Google Patents

Abstract

The present application provides a video transmission test method, apparatus and system, and a terminal. The method may comprise: a first terminal obtains N-channel video streams, N being a positive integer greater than 1; the first terminal controls the N-channel video streams to be concurrently transmitted to a second terminal by means of a first network, wherein the first terminal controls an I-frame in M-channel video streams in the N-channel video streams to collide when the N-channel video streams are transmitted, and 2≤M≤N; and the second terminal receives video frames of the N-channel video streams, and determines a first index for each channel of video stream in the N-channel video streams, the first index being used for representing video transmission capability of the first network. Hence, when the network via which the multi-channel video transmission is performed is tested, the I-frame in some or all of the video streams may be controlled to collide, so as to simulate a scenario of randomly generating I-frame collision during concurrent transmission of multi-channel video streams after monitoring service is online, so that a plurality of actual application scenarios may be covered in the testing process, thereby effectively testing the video transmission capability of a pre-configured network.

Description

Video transmission test method, device, system and terminal

This application claims the priority of the Chinese patent application with the application number 2021100871642 and the application name "video transmission testing method, device, system and terminal", which was submitted to the State Intellectual Property Office of China on January 22, 2021, the entire contents of which are by reference Incorporated in this application.

technical field

The present application relates to the technical field of network testing, and in particular, to a video transmission testing method, device, system and terminal.

Background technique

With the rapid development of mobile communication technology, the 5th generation mobile networks (5G network) is gradually applied to people's daily life and work, which promotes the development of digital economy and society and the digital transformation and upgrading of traditional industries, especially It has had a huge impact on the transformation of traditional industries. Among them, the video surveillance service of the internet protocol camera (IPC) is one of the representatives of 5G industry applications.

At present, in the multi-channel video transmission scenario of the video surveillance service, when the video streams generated by the multi-channel surveillance cameras are transmitted concurrently in the same network, the phenomenon of superposition of traffic peaks of the multi-channel video streams often occurs, that is, the occurrence of intra-frame encoded images. Frame (intra-coded picture, I frame) collisions cause network congestion, packet loss, etc., and make the planned network bandwidth insufficient, resulting in video freezes and other problems, affecting the operation of video surveillance services. It can be seen that in order to ensure the long-term and non-stuck operation of the video surveillance service after it goes online, it is very necessary to test and verify the video transmission capability of the network where the video surveillance service is located (such as a 5G network) before it goes online. Therefore, how to effectively test and verify the video transmission capability of the network where the video surveillance service is located (such as the 5G network) is an urgent problem to be solved.

SUMMARY OF THE INVENTION

The present application provides a video transmission testing method, device, system and terminal. When testing the network where the multi-channel video transmission is located, it is possible to control the collision of I-frames in some or all of the video streams, and simulate the random change of the collision of I-frames. In this way, a variety of I-frame collision scenarios are covered in the test process, and the video transmission capability of the current network can be effectively tested.

In a first aspect, the present application provides a video transmission test method, which is applied to a system including a first terminal and a second terminal. The method may include: the first terminal acquires N video streams, where N is a positive integer greater than 1 ; The first terminal controls N-way video streams to be concurrently transmitted to the second terminal through the first network, wherein, the first terminal controls the I frames in the M-way video streams in the N-way video streams to collide when the N-way video streams are transmitted, and 2 ≤M≤N; the second terminal receives video frames of N video streams, and determines a first indicator of each video stream in the N videos, where the first indicator is used to characterize the video transmission capability of the first network. Therefore, in this solution, when testing the network where the multi-channel video transmission is located, it is possible to control the collision of the I-frames in some or all of the video streams, thereby simulating the random occurrence of I-frames when the multi-channel video streams are concurrently transmitted after the monitoring service goes online. Collision scenarios make it possible to cover a variety of practical application scenarios in the test process, and then effectively test the video transmission capability of the pre-configured network.

In a possible implementation manner, the method may further include that the first terminal determines whether to perform an I-frame collision according to a second indicator, I-frame statistical data and preset test parameters; wherein the second indicator is the latest index of the first terminal. The received indicator sent by the second terminal, the second indicator includes the real-time probability of I-frame collision in M-channel video streams, and the I-frame statistical data is used to count the data related to the I-frame in each video stream in the N-channel video streams. The parameters include the number of M video streams and the expected probability of collision of I frames in the M video streams. From this, it is determined whether I-frame collision is required. Exemplarily, the second index, I-frame statistical data and test parameters, may be input into the collision determination model to determine whether to perform an I-frame collision; wherein, the collision determination model may use a Gaussian process model, a neural network model, a support vector It is obtained by training the test data in the historical test data; in addition, the collision determination model can also be a deviation function model, a proportional function model, a hybrid function model, or other mathematical function models.

In a possible implementation manner, the I-frame statistical data includes one or more of the following: the number of I-frames that have been sent by each video stream in the N video streams, or, when an I-frame collision occurred last time, N The number of I-frames that have been sent for each video stream in the video streams.

In a possible implementation manner, the first terminal controls the collision of I frames in M video streams among the N video streams, which may include: the first terminal selects M video streams from the N video streams, and simultaneously sends I frame in M video streams. In this way, the collision control of the I frames in the M video streams is realized. Exemplarily, when the I frame in the M video streams is controlled to collide, if the first terminal determines that the video frames currently to be sent in each of the M video streams are all I frames, it can send M video frames simultaneously. I frame; if the first terminal determines that the current video frame to be sent of at least one video stream in the M video streams is not an I frame, it can suspend sending i I frames, and after collecting M I frames, send it simultaneously M I-frames, 1≤i<M, where M-i non-I-frames may be sent when the transmission of i I-frames is suspended.

In a possible implementation manner, the first terminal selects M video streams from the N video streams, which may include: the first terminal determines, according to the video frame statistics and the third indicator, for each video stream in the N video streams The video frame statistical data is used to count the data of video frames in each video stream in the N video streams, and the third indicator is the indicator recently received by the first terminal and sent by the second terminal, where the third indicator includes N The transmission index of each video stream in the video streams; the first terminal randomly selects M video streams from the N video streams according to the weight value of each video stream in the N video streams. Thereby, M video streams are randomly selected. Exemplarily, the video frame statistical data can be input into the weight determination model, so as to obtain the weight value of each video stream in the N video streams. Among them, the weight determination model can be obtained by training the test data in the historical test data by using Gaussian process model, neural network model, support vector machine, etc.; in addition, the weight determination model can also be a deviation type function model, a proportional function model, Hybrid functional models, or other mathematical functional models,

In a possible implementation manner, the third indicator includes one or more of the following: frame rate, or delay jitter; video frame statistics include one or more of the following: each video stream in the N video streams The total number of video frames sent, or the I-frame interval in each of N video streams.

In a possible implementation manner, the first indicator may include one or more of the following: frame rate, delay, delay jitter, bit rate, packet loss rate, frame peak-to-average ratio, number of rendering frames, or frame rate.

In a second aspect, the present application provides a video transmission testing method, which is applied to a first terminal. The method may include: acquiring N video streams, where N is a positive integer greater than 1; It is transmitted to the second terminal, wherein when the N video streams are transmitted, the I frames in the M video streams in the N video streams are controlled to collide, 2≤M≤N, so as to test the video transmission capability of the first network.

In a possible implementation manner, the method may further include: determining whether to perform I-frame collision according to a second indicator, I-frame statistical data and preset test parameters; wherein the second indicator is the latest received by the first terminal. The indicator sent by the second terminal. The second indicator includes the real-time probability of collision of I frames in the M video streams. The I frame statistical data is used to count the data related to the I frame in each video stream in the N video streams. Test parameters It includes the number of M video streams and the expected probability of collision of I frames in the M video streams.

In a possible implementation manner, the I-frame statistical data includes one or more of the following: the number of I-frames that have been sent by each video stream in the N video streams, or, when an I-frame collision occurred last time, N The number of I-frames that have been sent for each video stream in the video streams.

In a possible implementation manner, controlling the collision of the I frames in the M video streams in the N video streams may include: screening the M video streams from the N video streams, and simultaneously sending the M video streams in the M video streams. I frame.

In a possible implementation manner, screening the M video streams from the N video streams may include: determining the weight value of each video stream in the N video streams according to the video frame statistical data and the third index, the video frame The statistical data is used to count the data of video frames in each video stream in the N video streams, and the third indicator is the indicator sent by the second terminal that is newly received by the first terminal, wherein the third indicator includes each channel in the N video streams. The transmission index of the video stream; according to the weight value of each video stream in the N video streams, randomly select M video streams from the N video streams.

In a possible implementation manner, the third indicator includes one or more of the following: frame rate, or delay jitter; video frame statistics include one or more of the following: each video stream in the N video streams The total number of video frames sent, or the I-frame interval in each of N video streams.

In a possible implementation manner, the first indicator includes one or more of the following: frame rate, delay, delay jitter, bit rate, packet loss rate, frame peak-to-average ratio, number of rendered frames, or frame loss Rate.

In a possible implementation manner, the second terminal is configured to determine, based on the received video frames of the N-channel video streams, a first indicator of each video stream in the N-channel videos, where the first indicator is used to characterize the first network's video transmission capability.

In a third aspect, the present application provides a video transmission testing device, the device may include: a communication module and a processing module; wherein, the communication module can be used to obtain N video streams, where N is a positive integer greater than 1; the processing module can It is used to control the N-channel video streams to be transmitted to the second terminal through the first network, wherein, when the N-channel video streams are transmitted, the I frames in the M-channel video streams in the N-channel video streams are controlled to collide, 2≤M≤N, to test the video transmission capability of the first network.

In a possible implementation manner, the processing module may be further configured to: determine whether to perform I-frame collision according to the second indicator, I-frame statistical data and preset test parameters; wherein the second indicator is the latest update of the first terminal The received indicator sent by the second terminal, the second indicator includes the real-time probability of collision of I frames in the M video streams, and the I frame statistical data is used to count the data related to the I frame in each video stream in the N video streams, The test parameters include the number of M video streams and the expected probability of collision of I frames in the M video streams.

In a possible implementation manner, the I-frame statistical data includes one or more of the following: the number of I-frames that have been sent by each video stream in the N video streams, or, when an I-frame collision occurred last time, N The number of I-frames that have been sent for each video stream in the video streams.

In a possible implementation manner, the processing module may also be used for: screening M video streams from N video streams, and simultaneously sending I frames in the M video streams.

In a possible implementation manner, the processing module can also be used to: determine the weight value of each video stream in the N video streams according to the video frame statistical data and the third indicator, and the video frame statistical data is used to count the N video streams. the data of the video frames in each video stream in the video stream, the third indicator is the indicator sent by the second terminal that is newly received by the first terminal, wherein the third indicator includes the transmission indicator of each video stream in the N video streams; according to The weight value of each video stream in the N video streams, and randomly select M video streams from the N video streams.

In a possible implementation manner, the third indicator includes one or more of the following: frame rate, or delay jitter; video frame statistics include one or more of the following: each video stream in the N video streams The total number of video frames sent, or the I-frame interval in each of N video streams.

In a possible implementation manner, the first indicator includes one or more of the following: frame rate, delay, delay jitter, bit rate, packet loss rate, frame peak-to-average ratio, number of rendered frames, or frame loss Rate.

In a possible implementation manner, the second terminal may be configured to determine, based on the received video frames of the N video streams, a first indicator of each video stream in the N videos, where the first indicator may be used to represent the first indicator The video transmission capability of a network.

In a fourth aspect, the present application provides a video transmission test system, including a first terminal and a second terminal, the first terminal is used for executing the method performed by the first terminal mentioned in the first aspect, and the second terminal is used for The method performed by the second terminal mentioned in the first aspect is performed.

In a fifth aspect, the present application provides a terminal, including:

at least one memory for storing programs;

At least one processor is used to invoke a program stored in the memory to perform the method provided in the first aspect or the method provided in the second aspect.

In a sixth aspect, the present application provides a computer storage medium, where instructions are stored in the computer storage medium, and when the instructions are run on a computer, the computer is made to execute the method provided in the first aspect, or execute the method provided in the second aspect .

In a seventh aspect, the present application provides a computer program product comprising instructions that, when executed on a computer, cause the computer to perform the method provided in the first aspect, or perform the method provided in the second aspect.

In an eighth aspect, the present application provides a chip, including at least one processor and an interface;

At least one processor obtains program instructions or data through an interface;

At least one processor is configured to execute program line instructions to implement the method provided in the first aspect, or to perform the method provided in the second aspect.

Description of drawings

FIG. 1a is a schematic diagram of an application scenario provided by an embodiment of the present application;

FIG. 1b is a schematic diagram of a test scenario provided by an embodiment of the present application;

2 is a schematic diagram of a hardware structure of a terminal provided by an embodiment of the present application;

3 is a schematic diagram of a setting interface of a terminal provided by an embodiment of the present application;

4 is a schematic diagram of a transmission rate of a multi-channel video stream provided by an embodiment of the present application;

5 is a schematic diagram of a transmission process of video stream data in a test process provided by an embodiment of the present application;

6 is a schematic flowchart of a video transmission testing method provided by an embodiment of the present application;

7 is a schematic diagram of a step of screening M video streams from N video streams according to an embodiment of the present application;

8 is a schematic flowchart of another video transmission testing method provided by an embodiment of the present application;

9 is a schematic structural diagram of a video transmission test device provided by an embodiment of the present application;

FIG. 10 is a schematic structural diagram of a chip provided by an embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

In the description of the embodiments of the present application, words such as "exemplary", "such as" or "for example" are used to mean serving as an example, illustration or illustration. Any embodiments or designs described in the embodiments of the present application as "exemplary," "such as," or "by way of example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, use of words such as "exemplary," "such as," or "by way of example" is intended to present the related concepts in a specific manner.

In the description of the embodiments of the present application, the term "and/or" is only an association relationship for describing associated objects, indicating that there may be three relationships, for example, A and/or B, which may indicate: A alone exists, A alone exists There is B, and there are three cases of A and B at the same time. Also, unless stated otherwise, the term "plurality" means two or more. For example, multiple systems refer to two or more systems, multiple terminals refer to two or more terminals, and multiple video streams refer to two or more video streams.

In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implying the indicated technical features. Thus, a feature defined as "first" or "second" may expressly or implicitly include one or more of that feature. The terms "including", "including", "having" and their variants mean "including but not limited to" unless specifically emphasized otherwise.

First, an application scenario provided in this solution is introduced.

FIG. 1a is a schematic diagram of an application scenario provided by an embodiment of the present application. As shown in Fig. 1a, in the monitoring service, the video data collected by the monitoring cameras (111, 112, 113) can be sequentially passed through the routing device 121, the customer premise equipment (CPE) 13, the base station 14, the core network 15 and the routing device 122 , and transmit it to the playback terminal 16 concurrently, so that the user can view the video data collected by the surveillance cameras ( 111 , 112 , 113 ) on the playback terminal 16 . Before the monitoring service goes online, it is often necessary to pre-configure the network between the monitoring cameras (111, 112, 113) and the playback terminal 16; in this solution, the pre-configured network can be configured by routing equipment (121, 122), customer premise equipment (CPE) ) 13, the base station 14 and the core network 15 are composed. In order to ensure stable operation of the monitoring service after it goes online, it is necessary to test the network preconfigured in the monitoring service to adjust the network based on the test results, for example, increase the network bandwidth and so on.

It can be understood that, in this solution, the preconfigured network is not specifically limited, and the preconfigured network can implement the communication between the surveillance cameras ( 111 , 112 , 113 ) and the playback terminal 16 in FIG. 1 a . In one example, the preconfigured network may include more or fewer network elements than in the network shown in Figure 1a. In addition, the number of surveillance cameras shown in FIG. 1a is not limited to 3, and may also be other numbers, such as 2, 4, etc., which are not limited here.

Next, a test scenario provided in this scenario is introduced.

FIG. 1b is a schematic diagram of a test scenario provided by an embodiment of the present application. As shown in Fig. 1b, when testing the video transmission capability of the network preconfigured in Fig. 1a, the terminal 171 can be used to simulate the scene where the surveillance cameras (111, 112, 113) in Fig. 1a send video, for example, the terminal 171 can simulate and send three video streams concurrently . Afterwards, the video stream sent by the terminal 171 may be transmitted to the terminal 172 via a pre-configured network. Then, the terminal 172 can decode the received video stream, and determine the transmission test index of each video stream sent by the terminal 171, wherein the transmission test index can be used to characterize the video transmission capability of the pre-configured network, which can be For frame rate, delay, delay jitter, bit rate, packet loss rate, frame peak-to-average ratio, rendering frame number, or, frame loss rate, etc. Exemplarily, if the packet loss rate of each video stream is high, it may indicate that the video transmission capability of the preconfigured network is poor, and therefore the preconfigured network needs to be adjusted.

It can be understood that, in addition to simulating the scene in which the surveillance cameras (111, 112, 113) send video in FIG. 1a, the terminal 171 can also acquire the video data collected by the surveillance cameras (111, 112, 113) and the video data collected by the surveillance cameras (111, 112, 113). Sent to terminal 172 via a preconfigured network. For example, when testing the video transmission capability of the pre-configured network in FIG. 1a, the terminal 171 can be set between the routing device 121 and the surveillance cameras (111, 112, 113), so that the terminal 171 can obtain the video captured by the surveillance cameras (111, 112, 113). data.

It should be noted that, in this solution, when simulating the multi-channel video transmission scenario in FIG. 1a, the terminal 171 can control the I frames of the M video streams in the N video streams to collide when the N video streams are transmitted, thereby simulating the I frame of the M video streams. After the monitoring service goes online, the I-frame collision occurs randomly when multiple video streams are concurrently transmitted, so that a variety of practical application scenarios can be covered during the test process, and the video transmission capability of the pre-configured network can be effectively tested. In this scheme, 2≤M≤N, where M and N are both positive integers.

It can be understood that the preconfigured network described in this solution may be a wired network (wired network) or a wireless network (wireless network). For example, the network may be a local area network (LAN) or a wide area network (WAN) (eg, the Internet). The network may be implemented using any known network communication protocol, which may be various wired or wireless communication protocols, such as Ethernet, universal serial bus (USB), firewire, global Mobile communication system (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access) access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), new radio (new radio, NR), Bluetooth (bluetooth), wireless security True (wireless fidelity, Wi-Fi) and other communication protocols. It should be understood that the network of this solution may also be a future communication network, such as a 6G network, and so on.

In this solution, the terminals (171, 172) can be mobile phones, tablet computers, digital cameras, personal digital assistants (PDAs), wearable devices, smart TVs, Huawei smart screens, Raspberry Pi, industrial pie ( IndustriPi) etc. Exemplary embodiments of the terminals (171, 172) include, but are not limited to, electronic devices equipped with iOS, android, Windows, Harmony OS or other operating systems. The electronic device described above may also be other electronic devices, such as a laptop or the like having a touch-sensitive surface (eg, a touch panel). The embodiment of the present application does not specifically limit the type of the electronic device.

The following introduces a schematic diagram of the hardware structure of a terminal provided in this solution. The terminal may be the terminal (171, 172) shown in Figure 1b.

FIG. 2 is a schematic diagram of a hardware structure of a terminal provided by an embodiment of the present application. As shown in FIG. 2, the terminal may include at least one processor 201, and the at least one processor 201 may support the terminal to implement the method provided in this solution.

The processor 201 may be a general purpose processor or a special purpose processor. For example, the processor 201 may include a central processing unit (CPU) and/or a baseband processor. The baseband processor may be used to process communication data, and the CPU may be used to implement corresponding control and processing functions, execute software programs, and process data of software programs. Exemplarily, when the processor 201 belongs to the terminal 171 shown in FIG. 1b, the processor 201 can control N video streams to be transmitted to the terminal 172 in FIG. 1b through the preconfigured network, wherein the processor 201 When the N-channel video streams are transmitted, the I frames in the M-channel video streams in the N-channel video streams can be controlled to collide; when the processor 201 belongs to the terminal 172 shown in FIG. 1b, the processor 201 can receive the The video frame of the video stream sent by the terminal 171 is decoded, and the transmission test indicators of each video stream, such as bit rate, frame rate, packet loss rate, etc., are determined, wherein the transmission test indicators can represent the pre-configured network. video transmission capability.

Further, the terminal may further include a transceiver unit 203 to implement signal input (reception) and output (send). For example, the transceiver unit 203 may include a transceiver or a radio frequency chip. The transceiver unit 203 may also include a communication interface. Exemplarily, when the transceiver unit 203 belongs to the terminal 171 shown in FIG. 1 b , the transceiver unit 203 can receive or acquire N video streams, and can also send N video streams to the terminal 172 , and can also receive the video streams sent by the terminal 172 . When the transceiver unit 203 belongs to the terminal 172 shown in FIG. 1b, the transceiver unit 203 can receive the video frame of the video stream sent by the terminal 171 in FIG. 1b, and can also transmit part or all of the video determined by the terminal 172. The test indicators are sent to the terminal 171 and the like.

Optionally, the terminal may include one or more memories 202 on which programs (or instructions or codes) are stored, and the programs may be executed by the processor 201, so that the processor 201 executes the method described in this solution. Optionally, data may also be stored in the memory 202 . Optionally, the processor 201 can also read data stored in the memory 202 (for example, data of pre-stored video streams, pre-stored video encoding data, etc.), and the data can be stored in the same storage address as the program, The data can also be stored in a different memory address than the program.

The processor 201 and the memory 202 can be provided separately, or can be integrated together, for example, integrated on a single board or a system on chip (system on chip, SOC).

For a detailed description of the operations performed by the terminal in the above-mentioned various possible designs, reference may be made to the descriptions in the embodiments of the methods provided in the following text solutions, which will not be repeated here.

Next, based on the test scenario shown in FIG. 1 b and the hardware structure of the terminal shown in FIG. 2 , the test process of this solution is described in detail. For the convenience of description, the "pre-configured network" is referred to as the "network to be tested" hereinafter.

(1) Set test parameters

In the test scenario shown in Figure 1b, the tester can set the test parameters. In this solution, the test parameters may include the number and probability of video streams expected to collide with I-frames. For example, a tester can set I-frame collisions in 5 out of 10 video streams, and the probability of I-frame collisions is 10%, and so on.

In one example, the tester can set test parameters on the terminal 171, and can also set test parameters on other terminals. When the tester sets test parameters on other terminals, the other terminals can transmit the test parameters set by the tester to the terminal 171 through a wired network or a wireless network. Exemplarily, the tester can set the test parameters through the human-computer interaction interface on the terminal 171, wherein the tester can set the test parameters through touch control or voice control, but not limited to. For example, as shown in FIG. 3 , on the display interface of the display screen of the terminal 171, a setting interface 31 of test parameters can be displayed, and each test parameter, such as the total number of video streams to be tested, can be displayed on the setting interface 31, and an I frame is expected to occur. The number of colliding video streams, the probability of I-frame collision, the test duration, etc.; at this time, the tester can set the total number of test video streams to 10, and set the number of video streams expected to have an I-frame collision. For 5-way, set the probability of I-frame collision to 50%, and the test duration is 3 minutes.

It can be understood that the test parameters can also be automatically generated by the system based on empirical values. For example, when the bandwidth of the network to be tested is 500Mbps, the empirical value can be that the total number of test video streams is 8, the number of video streams expected to collide with I-frames is 3, and the probability of I-frame collision is 10%. Then when the bandwidth of the network to be tested is 500Mbps, the system can actively generate test parameters. At this time, the test parameters are: the total number of test video streams is 8, and the number of video streams expected to collide with an I frame is 3. The probability of an I-frame collision is 10%. In addition, it can also be automatically generated according to the historical data of other networks used by the tester, which is not limited here.

(2) Issue test instructions

In the test scenario shown in Figure 1b, after the test parameters are set, the test command can be issued. In this solution, the test instruction can be issued manually or automatically. When the test instruction is issued manually, the tester can issue the test instruction through the human-computer interaction interface on the terminal 171; for example, continue to refer to FIG. "Confirm" button to send the test command. When the test command is automatically issued, the test command can be issued periodically by the software program. For example, if the test needs to be performed every day, the test command can be sent once a day, etc. The software program for issuing the test command can be Installed on the terminal 171 .

It can be understood that the test instruction is an instruction used to test the video transmission capability of the network under test. After the test instruction is issued, the terminal 171 can receive the test instruction and start the test.

(3) Start the test

In the test scenario shown in FIG. 1b, after the terminal 171 receives the test instruction, it can start the test work.

During the test, the terminal 171 can acquire N video streams; wherein, the value of N can be determined based on the test parameter, which represents the total number of video streams to be tested. In this solution, the N video streams may be pre-stored on the terminal 171, or may be generated by the terminal 171 according to preset video encoding parameters, wherein the video encoding parameters may include encoding format, bit rate, frame rate, I frame interval, etc. In addition, the N video streams may also be pre-stored on other terminals, or may be generated by other terminals according to preset video coding parameters, which is not limited herein. It can be understood that when the N video streams are stored or generated by other terminals, the terminal 171 may send a request to the other terminals to request the other terminals to send the N video streams to the terminal 171 .

After the terminal 171 acquires the N video streams, the N video streams can be concurrently transmitted to the terminal 172 through the network under test. After receiving the video frames of the N video streams, the terminal 172 can decode the video frames of each video stream, and then determine the transmission test index of each video stream, wherein the transmission test index can characterize the video transmission of the network under test. ability. In this solution, the transmission test indicators may include frame rate, delay, delay jitter, bit rate, packet loss rate, frame peak-to-average ratio, number of rendering frames, or frame loss rate, and so on. In one example, concurrent transmission can be understood as simultaneous transmission of multiple video streams at the same time.

In this solution, when the terminal 171 sends N video streams to the terminal 172, it can control the I frames in the M video streams to collide, wherein M in the M video streams is the expected I frame collision in the test parameters. The number of video streams, M video streams are multiple video streams in N video streams, M≤N.

Wherein, in the process of transmitting N video streams, the terminal 171 may first determine whether it is necessary to perform I-frame collision at present. If I-frame collision needs to be performed, the terminal 171 can filter out M-channel video streams from the N-channel video streams, and then simultaneously transmit I-frames in the M-channel video streams, thereby realizing the collision of I-frames in the M-channel video streams. . The judging process, the screening process and the sending process are respectively described below.

a. Determine whether to perform an I-frame collision

In this solution, when the terminal 172 receives the video frames of the N video streams, it can determine the I-frame collision indicator, and then send the I-frame collision indicator to the terminal 171 . Afterwards, after receiving the I-frame collision indicator sent by the terminal 172, the terminal 171 may determine whether to perform an I-frame collision according to the latest received I-frame collision indicator, I-frame statistical data and test parameters.

In one example, the I-frame collision indicator may include the real-time probability of an I-frame collision in M video streams. Exemplarily, the terminal 172 can capture the video frames of the N video streams it receives, and then generate a transmission rate map, and determine whether an I-frame collision has occurred from the transmission rate map, and finally the received I-frame and the number of colliding I frames in M video streams, the real-time probability of I frame collision can be determined. For example, the time to start the test is 9:00 am, and the current time is 9:30 am. If it is in the time period from 9:00 to 9:30, the number of I-frames that collide in the M-channel video stream is 10 , the number of received I-frames is 100, and the real-time probability of I-frame collision in M-channel video streams at the current time (ie, 9:30 am) is 10%. For the transmission rate diagram, please refer to Figure 4. As shown in Figure 4, if there is no I frame collision, the I frame in each video stream can transmit 1000 bytes every 100ms; At the moment of I-frame collision, for example, in 30s, the data volume of I-frames transmitted every 100ms will double. For example, if I-frames in two video streams collide, the data volume of I-frames transmitted every 100ms is 2000 bytes; therefore, it can be determined whether an I-frame collision occurs and the number of video streams that send the I-frame collision based on the peak change of the I frame in the transmission rate graph in FIG. 4 .

The I frame statistical data can be used to count the data related to the I frame in each of the N video streams. Exemplarily, the I-frame statistical data may include: the number of I-frames that have been sent by each of the N-channel video streams, or, when the previous I-frame collision occurred, the number of sent I-frames in each of the N-channel video streams. The number of I-frames. It can be understood that the terminal 171 can count the number of I frames sent by the terminal 171 when sending the video frames of each video stream in the N video streams. For example, taking the first video stream as an example, when sending the first video stream When sending video frames of a stream, the terminal 171 increases the counted number of I frames of the first video stream by one each time an I frame is sent.

The test parameters may include the number of M video streams and the expected probability of collision of I frames in the M video streams.

In one example, when determining whether to perform an I-frame collision, the terminal 171 may input its latest received I-frame collision indicator, I-frame statistics and test parameters into a preconfigured collision determination model, and then, based on the collision Determine the output of the model to determine. For example, when the output result output by the collision determination model is to perform an I-frame collision, it can be determined that an I-frame collision needs to be performed at this time. Exemplarily, the collision determination model may be obtained by training test data in historical test data using a Gaussian process model, a neural network model, a support vector machine, or the like. In addition, the collision determination model may also be a deviation-type function model, a proportional-type function model, a hybrid-type function model, or other mathematical function models, which are not limited herein.

It can be understood that when it is judged that I frame collision is required, M video streams can be screened out from N video streams, that is, the “screening of M video streams from N video streams” described below is performed. the process of. If it is determined that I frame collision is not required, it may not be necessary to filter out M video streams from N video streams.

b. Screen out M video streams from N video streams

In this solution, the terminal 171 can receive the transmission indicator of each video stream in the N video streams sent by the terminal 172, wherein the transmission indicator is the transmission indicator when the terminal 172 receives the video frame of each video stream in the N video streams. determined. Further, after receiving the transmission indicator of each video stream in the N video streams sent by the terminal 172, the terminal 171 may, according to the transmission indicator and video frame statistical data of each video stream in the N video streams newly received by the terminal 171, , determine the weight value of each video stream in the N video streams; wherein, the transmission indicators of each video stream in the N video streams may include frame rate, delay jitter, etc., and the video frame statistics may include the N video streams. The total number of video frames that have been sent in each video stream in the N video streams, the I frame interval in each video stream in the N video streams, and so on. Finally, the terminal 171 can randomly select M video streams from the N video streams according to the weight value of each video stream in the N video streams; for example, use a random weighting algorithm for screening and so on. It should be noted that, in this solution, when screening the M video streams, the transmission index of each video stream in the N video streams used by the terminal 171 may be each video stream in the N video streams determined by the terminal 172. Some or all of the indicators in the streaming transmission test indicators are not limited here.

It can be understood that, when determining the weight value of each video stream in the N video streams, the terminal 171 can input the transmission index and video frame statistical data of each video stream in the N video streams that it recently received into the The weight determines the model, and then obtains the weight value of each video stream in the N video streams. Exemplarily, the weight determination model can be obtained by training the test data in the historical test data by using a Gaussian process model, a neural network model, a support vector machine, or the like. In addition, the weight determination model may also be a deviation-type function model, a proportional-type function model, a hybrid-type function model, or other mathematical function models, which are not limited herein. In one example, the weight determination model may be the mathematical function model shown below, where the mathematical function model is:

ω _i =1-jitter _i ×(IFI _i -mod(TolFN _i ,IFI _i ))×(1/FPS _i )

Among them, ω _i is the weight value of the ith video stream, 1≤i≤N; jitter _i is the delay jitter of the ith video stream; IFI _i is the I frame interval of the ith video stream; TolFN _i is the ith video stream The total number of video frames sent by the i-channel video stream; FPS _i is the frame rate of the i-th video stream.

It can be understood that, after the M video streams are selected from the N video streams, the process of "simultaneously sending I frames in the M video streams" described below can be performed.

c. Send I frames in M video streams at the same time

After filtering out the M video streams from the N video streams, the terminal 171 can perform collision control on the I frames in the M video streams. In one example, the terminal 171 can respectively determine whether the video frame to be sent in each video stream in the M video streams belongs to the I frame according to the definition of the video data packet result in the video stream according to video compression coding formats such as H264 and H265. Wherein, if the video frames currently to be sent in the M video streams are all I-frames, these I-frames are sent to the terminal 172 at the same time, so that these I-frames collide. If at least one of the video frames currently to be sent in the M video streams does not belong to an I frame, the video frame that does not belong to the I frame is sent to the terminal 172, and the transmission of the video frame belonging to the I frame is suspended; When the video frames currently to be sent in the video stream all belong to I frames, these I frames are sent to the terminal 172 at the same time. In one example, suspending the sending of a video frame belonging to an I frame may be to set the process of the video stream corresponding to the I frame to a blocking state.

(4) End the test

After the test duration is over, the test work can be ended. At this point, the terminal 172 may display the test results. In addition, the tester can also export the test data from the terminal 172, and then analyze the test data to determine the video transmission capability of the network under test.

For ease of understanding, the following takes the concurrent transmission of 3 video streams and the control of 2 video streams to generate an I-frame collision as an example, and explains part of the test process in the above-described test process step by step with reference to FIG. 5 .

In step A, the video encoding module 1711 or the video file reading module 1712 in the terminal 171 can acquire three video streams. The video encoding module 1711 can generate a video stream according to the video encoding parameters set before the test; the video file reading module 1712 can read the video stream according to the local file path set before the test.

In step B, each video stream in the terminal 171 has its own corresponding data acquisition module, that is, the data acquisition modules 17131, 17132, and 17133. Among them, the data acquisition module (17131, 17132, 17133) can acquire the video stream from the video encoding module 1711 or the video file reading module 1712, and save the acquired video stream in its own data buffer.

Step C, the I frame collision control module 1714 in the terminal 171 can obtain the video frame from the data acquisition module of each video stream, and obtain the indicator sent by the terminal 172 from the indicator receiving module 1715, and the indicator can be the above. The I frame collision index (such as the real-time probability of I frame collision in the 2-channel video stream, etc.), and the transmission index of each video stream in the 3-channel video stream (such as frame rate, delay jitter, etc.). Afterwards, the I-frame collision control module 1714 can determine whether to perform an I-frame collision. If I-frame collision is not required, the video frames of each video stream are sent directly. If I-frame collision is required, 2-channel video streams are screened from the 3-channel video streams; then, I-frames in the 2-channel video streams are sent simultaneously. For details, please refer to the relevant descriptions above, which will not be repeated here.

In step D, each video stream in the terminal 171 has its own corresponding data transmission module, that is, the data transmission modules 17161, 17162, and 17163. The data sending module corresponding to each video stream can obtain the video frame to be sent from the I-frame collision control module 1714 . Afterwards, the data sending module (17161, 17162, 17163) can use standard surveillance video streaming protocols (eg RTSP, RTMP, etc.), and send video frames to the terminal 172 via the network under test.

In step E, each video stream in the terminal 172 has its own corresponding data receiving module, that is, the data receiving modules 17211, 17212, and 17213. The data receiving module of each video stream can run the standard monitoring video stream transmission protocol to receive the video frame from the corresponding data sending module, and save the video frame into its own data buffer.

In step F, each video stream in the terminal 172 has its own corresponding decoding and rendering module, namely the decoding and rendering modules 17221, 17222, and 17223. The decoding and rendering module of each video stream can read the video frame from the data buffer of the corresponding data receiving module, and then decode and render the video picture.

In step G, each video stream in the terminal 172 has its own corresponding indicator generation module, that is, indicator generation modules 17231, 17232, and 17233. During the transmission test process, the indicator generation module can generate transmission test indicators in real time, such as frame rate, delay, delay jitter, bit rate, packet loss rate, frame peak-to-average ratio, number of rendering frames, or frame loss rate, etc. .

In step H, the indicator storage module 1724 in the terminal 172 may store the transmission test indicator generated by the indicator generation module. For example, save to a database or save as a local indicator file, etc.

In step 1, the indicator sending module 1725 in the terminal 172 may periodically acquire the latest generated indicator from the indicator storage module 1724, and then send the acquired latest indicator to the indicator receiving module 1714 in the terminal 171.

Repeat steps A to I until the test duration ends.

Next, based on the test process of the video transmission capability of the network under test described above, a video transmission test method provided by the embodiment of the present application is introduced. It can be understood that this method is another expression of the testing process of the video transmission capability of the network under test described above, and the two are combined. The method is proposed based on the testing process of the video transmission capability of the network under test described above, and some or all of the content of the method may refer to the description of the testing process of the video transmission capability of the network under test above.

Please refer to FIG. 6. FIG. 6 is a schematic flowchart of a video transmission testing method provided by an embodiment of the present application. It can be understood that the method can be performed by any apparatus, device, platform, or device cluster with computing and processing capabilities. Wherein, the method can be applied to a system including a first terminal and a second terminal. As shown in FIG. 6 , the video transmission test method includes:

Step S101, the first terminal acquires N video streams, where N is a positive integer greater than 1.

In this solution, the first terminal can generate N video streams by itself, or can read N video streams from a local file. In an example, the value of N may be set by a tester, or may be automatically generated by the first terminal according to an experience value, which is not limited herein. The first terminal may be understood as the terminal 171 described above.

Step S102, the first terminal controls the N video streams to pass through the first network and transmit them to the second terminal, wherein the first terminal controls the I frames in the M video streams in the N video streams to collide when the N video streams are transmitted. , 2≤M≤N.

In this solution, the first terminal can control N video streams to pass through the first network and transmit them to the second terminal, wherein the first terminal controls I frames in M video streams in the N video streams when the N video streams are transmitted. Collision. The first network may be understood as the pre-configured network described above. The second terminal may be understood as the terminal 172 described above.

In one example, the first terminal may determine whether to perform I-frame collision according to the second indicator, I-frame statistical data and preset test parameters. The second indicator is the indicator recently received by the first terminal and sent by the second terminal. The second indicator may include the real-time probability of I-frame collision of M-channel video streams, and the I-frame statistical data is used to count each video stream in the N-channel video streams. The data related to the I-frame in the test parameters may include the number of M-channel video streams and the expected probability of collision of the I-frames in the M-channel video streams. The second index can be understood as the I frame collision index described above, the I frame statistical data can be understood as the I frame statistical data described above, and the test parameters can be understood as the test parameters described above.

In an example, the I-frame statistics may include one or more of the following: the number of I-frames sent by each of the N-channel video streams, or, when an I-frame collision occurred last time, the N-channel video streams The number of I-frames that have been sent in each video stream.

If the first terminal determines to perform I-frame collision, further, the first terminal controls the collision of I-frames in M video streams in N video streams. In an example, the first terminal may filter M video streams from the N video streams, and simultaneously send I frames in the M video streams, so that the I frames in the M video streams collide.

As a possible implementation, as shown in FIG. 7 , the first terminal selects M video streams from N video streams, which may include the following steps:

Step S201, the first terminal determines the weight value of each video stream in the N video streams according to the video frame statistical data and the third indicator.

In this solution, the third indicator is an indicator recently received by the first terminal and sent by the second terminal, and the third indicator may include a transmission indicator of each video stream in the N video streams. The third indicator can be understood as the transmission indicator of each video stream in the N video streams described above, and the video frame statistical data can be understood as the video frame statistical data described above. After receiving the third indicator, the first terminal can determine the weight value of each video stream in the N video streams according to the third indicator and the video frame statistical data; wherein, the video frame statistical data can be used to count the N video streams. The data of the video frame in each video stream. Exemplarily, the third indicator and video frame statistical data may be input into the weight determination model to obtain the weight value of each video stream in the N video streams.

Step S202: The first terminal randomly selects M video streams from the N video streams according to the weight value of each video stream in the N video streams.

In this solution, after determining the weight value of each video stream in the N video streams, the first terminal may, but is not limited to, use a weighted random algorithm to randomly select M video streams from the N video streams.

Next, after the first terminal sends N video streams, step S103 may be executed.

Step S103, the second terminal receives the video frames of the N video streams, and determines a first indicator of each video stream in the N videos, where the first indicator is used to represent the video transmission capability of the first network.

In this solution, after receiving the video frames of the N video streams sent by the first terminal, the second terminal can decode the video frames of each video stream, and then determine the first indicator of each video stream in the N videos. , where the first indicator is used to characterize the video transmission capability of the first network. The first index may be understood as the transmission test index described above.

It can be understood that, for some or all of the descriptions in the method provided in this solution, reference may be made to the above related descriptions, which will not be repeated here.

Therefore, in this solution, when testing the network where the multi-channel video transmission is located, it is possible to control the collision of the I-frames in some or all of the video streams, thereby simulating the random occurrence of I-frames when the multi-channel video streams are concurrently transmitted after the monitoring service goes online. Collision scenarios make it possible to cover a variety of practical application scenarios in the test process, and then effectively test the video transmission capability of the pre-configured network.

Next, based on the testing process of the video transmission capability of the network to be tested described above, with the terminal 171 as the execution subject, another video transmission testing method provided by the embodiment of the present application is introduced. It can be understood that this method is another expression of the execution process of the terminal 171 in the process of testing the video transmission capability of the network under test described above, and the two are combined. The method is proposed based on the testing process of the video transmission capability of the network under test described above, and some or all of the content of the method may refer to the description of the testing process of the video transmission capability of the network under test above.

Please refer to FIG. 8. FIG. 8 is a schematic flowchart of another video transmission testing method provided by an embodiment of the present application. It can be understood that the method can be performed by any apparatus, device, platform, or device cluster with computing and processing capabilities. Wherein, the method can be applied to the first terminal, that is, the terminal 171 described above. As shown in FIG. 8 , the video transmission test method includes:

Step S301 , acquiring N video streams, where N is a positive integer greater than 1.

Step S302, controlling the N video streams to pass through the first network and transmit them to the second terminal, wherein when the N video streams are transmitted, the I frames in the M video streams in the N video streams are controlled to collide, 2≤M≤N , to test the video transmission capability of the first network.

In this solution, the second terminal may be configured to determine the first indicator of each video stream in the N videos based on the received video frames of the N video streams, where the first indicator is used to characterize the video transmission capability of the first network.

It can be understood that, for some or all of the descriptions in the method provided in this solution, reference may be made to the above related descriptions, which will not be repeated here.

Therefore, in this solution, when testing the network where the multi-channel video transmission is located, it is possible to control the collision of the I-frames in some or all of the video streams, thereby simulating the random occurrence of I-frames when the multi-channel video streams are concurrently transmitted after the monitoring service goes online. Collision scenarios make it possible to cover a variety of practical application scenarios in the test process, and then effectively test the video transmission capability of the pre-configured network.

Based on the methods in the foregoing embodiments, the embodiments of the present application provide a video transmission testing apparatus. Please refer to FIG. 9. FIG. 9 is a schematic structural diagram of a video transmission testing apparatus provided by an embodiment of the present application. As shown in FIG. 9 , the video transmission testing device 900 includes: a communication module 91 and a processing module 92; wherein, the communication module 91 can be used to obtain N video streams, where N is a positive integer greater than 1; the processing module 92 can be used to Control the N-channel video streams to be transmitted to the second terminal through the first network, wherein, when the N-channel video streams are transmitted, the processing module 92 can control the I-frames in the M-channel video streams in the N-channel video streams to collide, 2≤M≤ N, to test the video transmission capability of the first network.

In one example, the communication module 91 may be the transceiver unit 203 in the terminal shown in FIG. 2 , and the processing module 92 may be the processor 201 in the terminal shown in FIG. 2 .

In one example, the communication module 91 can be received by the video encoding module 1711, the video file reading module 1712, the data acquisition module (17131, 17132, 17133), the data transmission module (17161, 17162, 17163) and the indicator in FIG. 5 Module 1715 is composed. The processing module 92 may be the I-frame collision control module 1714 in FIG. 5 .

In one example, the processing module 92 may be further configured to: determine whether to perform an I-frame collision according to the second indicator, the I-frame statistical data and the preset test parameters; wherein the second indicator is the latest received first terminal by the first terminal. Two indicators sent by the terminal. The second indicator includes the real-time probability of collision of I frames in the M video streams. The I frame statistics are used to count the data related to the I frame in each video stream in the N video streams. The test parameters include The number of M video streams and the expected probability of collision of I frames in the M video streams.

In one example, the I-frame statistics include one or more of the following: the number of I-frames that have been sent by each of the N-channel video streams, or, when the previous I-frame collision occurred, the number of I-frames in the N-channel video streams The number of I-frames that have been sent for each video stream.

In an example, the processing module 92 may be further configured to: filter M video streams from N video streams, and simultaneously send I frames in the M video streams.

In one example, the processing module 92 can also be used to: determine the weight value of each video stream in the N video streams according to the video frame statistical data and the third indicator, and the video frame statistical data is used to count the N video streams in the N video streams. For the data of video frames in each video stream, the third indicator is the indicator recently received by the first terminal and sent by the second terminal, wherein the third indicator may include the transmission indicator of each video stream in the N video streams; The weight value of each video stream in the video stream, and randomly select M video streams from N video streams.

In one example, the third indicator includes one or more of the following: frame rate, or delay jitter; video frame statistics include one or more of the following: video sent by each video stream in the N video streams The total number of frames, or the I-frame interval in each of the N video streams.

In one example, the first indicator includes one or more of the following: frame rate, delay, delay jitter, bit rate, packet loss rate, frame peak-to-average ratio, number of rendering frames, or frame loss rate.

In an example, the second terminal is configured to determine, based on the received video frames of the N video streams, a first indicator of each video stream in the N videos, where the first indicator can be used to characterize video transmission on the first network ability.

In one example, the second terminal may be the terminal 172 described above. The terminal 172 may also include a communication module and a processing module. Wherein, the communication module in the terminal 172 may be composed of the data receiving module ( 17211 , 17212 , 17213 ) and the indicator sending module 1725 in FIG. 5 . The processing module in the terminal 172 may be composed of the decoding rendering module (17221, 17222, 17223), the indicator generating module (17231, 17232, 17233) and the indicator storage module 1724 in FIG. 5 .

In one example, the video transmission testing apparatus may be deployed in the first terminal described above.

It should be understood that the above-mentioned apparatus is used to execute the method in the above-mentioned embodiment, and the implementation principle and technical effect of the corresponding program modules in the apparatus are similar to those described in the above-mentioned method, and the working process of the apparatus may refer to the corresponding program module in the above-mentioned method The process will not be repeated here.

Based on the methods in the foregoing embodiments, an embodiment of the present application further provides a chip. Please refer to FIG. 10 , which is a schematic structural diagram of a chip according to an embodiment of the present application. As shown in FIG. 10 , the chip 1000 includes one or more processors 1001 and an interface circuit 1002 . Optionally, the chip 1000 may further include a bus 1003 . in:

The processor 1001 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above-mentioned method can be completed by an integrated logic circuit of hardware in the processor 1001 or an instruction in the form of software. The above-mentioned processor 1001 may be a general purpose processor, a digital communicator (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components . Various methods and steps disclosed in the embodiments of this application can be implemented or executed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The interface circuit 1002 can be used for sending or receiving data, instructions or information. The processor 1001 can use the data, instructions or other information received by the interface circuit 1002 to process, and can send the processing completion information through the interface circuit 1002.

Optionally, the chip 1000 further includes a memory, which may include a read-only memory and a random access memory, and provides operation instructions and data to the processor. A portion of the memory may also include non-volatile random access memory (NVRAM).

Optionally, the memory stores executable software modules or data structures, and the processor may execute corresponding operations by calling operation instructions stored in the memory (the operation instructions may be stored in the operating system).

Optionally, the interface circuit 1002 may be used to output the execution result of the processor 1001 .

It should be noted that the corresponding functions of the processor 1001 and the interface circuit 1002 can be implemented by hardware design, software design, or a combination of software and hardware, which is not limited here.

It should be understood that the steps in the above method embodiments may be implemented by logic circuits in the form of hardware or instructions in the form of software in the processor. Wherein, the chip can be applied to the terminal shown in FIG. 2 .

It can be understood that the processor in the embodiments of the present application may be a central processing unit (central processing unit, CPU), and may also be other general-purpose processors, digital signal processors (digital signal processors, DSP), application-specific integrated circuits (application specific integrated circuit, ASIC), field programmable gate array (field programmable gate array, FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. A general-purpose processor may be a microprocessor or any conventional processor.

The method steps in the embodiments of the present application may be implemented in a hardware manner, or may be implemented in a manner in which a processor executes software instructions. Software instructions can be composed of corresponding software modules, and software modules can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (programmable rom) , PROM), erasable programmable read-only memory (erasable PROM, EPROM), electrically erasable programmable read-only memory (electrically EPROM, EEPROM), registers, hard disks, removable hard disks, CD-ROMs or known in the art in any other form of storage medium. An exemplary storage medium is coupled to the processor, such that the processor can read information from, and write information to, the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and storage medium may reside in an ASIC.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted over a computer-readable storage medium. The computer instructions can be sent from one website site, computer, server, or data center to another website site by wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.) , computer, server or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media. The usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), or semiconductor media (eg, solid state disks (SSDs)), and the like.

It can be understood that, the various numbers and numbers involved in the embodiments of the present application are only for the convenience of description, and are not used to limit the scope of the embodiments of the present application.

Claims (28)

1. A video transmission testing method, characterized in that, applied to a system including a first terminal and a second terminal, the method comprising:

   The first terminal acquires N video streams, where N is a positive integer greater than 1;

   The first terminal controls the N video streams to pass through the first network and transmit them to the second terminal, wherein the first terminal controls the M video streams in the N video streams when the N video streams are transmitted. The I frame in the video stream collides, 2≤M≤N;

   receiving, by the second terminal, video frames of the N video streams;

   The second terminal determines a first indicator of each of the N video streams, where the first indicator is used to characterize the video transmission capability of the first network.
2. The method according to claim 1, wherein the method further comprises:

   The first terminal determines whether to perform an I-frame collision according to the second indicator, the I-frame statistical data and the preset test parameters;

   Wherein, the second indicator is an indicator recently received by the first terminal and sent by the second terminal, the second indicator includes the real-time probability of I-frame collision of the M-channel video streams, and the I-frame statistics The data is used to count the data related to the I frame in each video stream in the N video streams, and the test parameters include the number of the M video streams and the expected occurrence of the I frame in the M video streams. probability of collision.
3. The method according to claim 2, wherein the I-frame statistical data includes one or more of the following: the number of I-frames that have been sent by each video stream in the N video streams, or the previous The number of I-frames that have been sent by each of the N video streams when an I-frame collision occurs for the first time.
4. The method according to any one of claims 1-3, wherein the first terminal controls the collision of I frames in the M video streams in the N video streams, comprising:

   The first terminal screens the M video streams from the N video streams, and simultaneously sends I frames in the M video streams.
5. The method according to claim 4, wherein the first terminal selects the M video streams from the N video streams, comprising:

   The first terminal determines the weight value of each video stream in the N video streams according to the video frame statistical data and the third indicator, and the video frame statistical data is used to count each video in the N video streams. The data of the video frames in the stream, the third indicator is the indicator sent by the second terminal that is most recently received by the first terminal, wherein the third indicator includes the data of each video stream in the N video streams. transfer metrics;

   The first terminal randomly selects the M video streams from the N video streams according to the weight value of each video stream in the N video streams.
6. The method according to claim 5, wherein the third indicator comprises one or more of the following: frame rate, or delay jitter;

   The video frame statistical data includes one or more of the following: the total number of video frames sent by each video stream in the N video streams, or, the I frame in each video stream in the N video streams interval.
7. The method according to any one of claims 1-6, wherein the first indicator comprises one or more of the following: frame rate, delay, delay jitter, bit rate, packet loss rate, frame peak average ratio, the number of rendered frames, or, the drop frame rate.
8. A video transmission testing method, characterized in that, applied to a first terminal, the method comprising:

   Obtain N video streams, where N is a positive integer greater than 1;

   Controlling the N-channel video streams to pass through the first network and transmit them to the second terminal, wherein when the N-channel video streams are transmitted, the I-frames in the M-channel video streams in the N-channel video streams are controlled to collide, 2≤ M≤N, to test the video transmission capability of the first network.
9. The method according to claim 8, wherein the method further comprises:

   According to the second indicator, I-frame statistical data and preset test parameters, determine whether to perform I-frame collision;

   Wherein, the second indicator is an indicator recently received by the first terminal and sent by the second terminal, and the second indicator includes the real-time probability of collision of I frames in the M video streams, and the I frame The statistical data is used to count the data related to the I frame in each video stream in the N video streams, and the test parameters include the number of the M video streams and the expected I frame in the M video streams. probability of collision.
10. The method according to claim 9, wherein the I-frame statistical data includes one or more of the following: the number of I-frames that have been sent by each video stream in the N video streams, or the preceding The number of I-frames that have been sent by each of the N video streams when an I-frame collision occurs for the first time.
11. The method according to any one of claims 8-10, wherein the controlling the collision of I frames in the M video streams in the N video streams comprises:

    The M video streams are screened from the N video streams, and I frames in the M video streams are simultaneously sent.
12. The method according to claim 11, wherein the screening of the M video streams from the N video streams comprises:

    Determine the weight value of each video stream in the N video streams according to the video frame statistical data and the third indicator, and the video frame statistical data is used to count the video frames in each of the N video streams. data, the third indicator is an indicator that is newly received by the first terminal and sent by the second terminal, wherein the third indicator includes the transmission indicator of each video stream in the N video streams;

    According to the weight value of each video stream in the N video streams, the M video streams are randomly selected from the N video streams.
13. The method according to claim 12, wherein the third indicator comprises one or more of the following: frame rate, or delay jitter;

    The video frame statistical data includes one or more of the following: the total number of video frames sent by each video stream in the N video streams, or, the I frame in each video stream in the N video streams interval.
14. The method according to any one of claims 8-13, wherein the first indicator comprises one or more of the following: frame rate, delay, delay jitter, bit rate, packet loss rate, frame peak average ratio, the number of rendered frames, or, the drop frame rate.
15. The method according to any one of claims 8-14, wherein the second terminal is configured to determine, based on the received video frames of the N video streams, the video frame of each video stream in the N video streams. A first indicator, where the first indicator is used to characterize the video transmission capability of the first network.
16. A video transmission test device, comprising:

    The communication module is used to obtain N video streams, where N is a positive integer greater than 1;

    A processing module, configured to control the N-channel video streams to pass through the first network and transmit them to the second terminal, wherein, when the N-channel video streams are transmitted, the I frames in the M-channel video streams in the N-channel video streams are controlled Collision occurs, 2≤M≤N, to test the video transmission capability of the first network.
17. The device according to claim 16, wherein the processing module is further configured to:

    According to the second indicator, I-frame statistical data and preset test parameters, determine whether to perform I-frame collision;

    Wherein, the second indicator is an indicator recently received by the first terminal and sent by the second terminal, and the second indicator includes the real-time probability of collision of I frames in the M video streams, and the I frame The statistical data is used to count the data related to the I frame in each video stream in the N video streams, and the test parameters include the number of the M video streams and the expected I frame in the M video streams. probability of collision.
18. The apparatus according to claim 17, wherein the I-frame statistical data includes one or more of the following: the number of I-frames that have been sent by each video stream in the N video streams, or the previous The number of I-frames that have been sent by each of the N video streams when an I-frame collision occurs for the first time.
19. The device according to any one of claims 16-18, wherein the processing module is further configured to:

    The M video streams are screened from the N video streams, and I frames in the M video streams are simultaneously sent.
20. The apparatus according to claim 19, wherein the processing module is further configured to:

    Determine the weight value of each video stream in the N video streams according to the video frame statistical data and the third indicator, and the video frame statistical data is used to count the video frames in each of the N video streams. data, the third indicator is an indicator that is newly received by the first terminal and sent by the second terminal, wherein the third indicator includes the transmission indicator of each video stream in the N video streams;

    According to the weight value of each video stream in the N video streams, the M video streams are randomly selected from the N video streams.
21. The apparatus according to claim 20, wherein the third indicator comprises one or more of the following: frame rate, or delay jitter;

    The video frame statistical data includes one or more of the following: the total number of video frames sent by each video stream in the N video streams, or, the I frame in each video stream in the N video streams interval.
22. The apparatus according to any one of claims 16-21, wherein the first indicator comprises one or more of the following: frame rate, delay, delay jitter, bit rate, packet loss rate, frame peak average ratio, the number of rendered frames, or, the drop frame rate.
23. The apparatus according to any one of claims 16-22, wherein the second terminal is configured to determine, based on the received video frames of the N video streams, the video frame of each video stream in the N video streams. A first indicator, where the first indicator is used to characterize the video transmission capability of the first network.
24. A video transmission test system, characterized in that it includes a first terminal and a second terminal, and the first terminal is configured to perform the method performed by the first terminal in any one of the methods of claims 1-7, and the The second terminal is configured to execute the method executed by the second terminal in any of the methods of claims 1-7.
25. A terminal, characterized in that it includes:

    at least one memory for storing programs;

    At least one processor, configured to invoke the program stored in the memory to execute the method according to any one of claims 1-7, or the method according to any one of claims 8-15.
26. A computer storage medium, in which instructions are stored, and when the instructions are executed on a computer, the computer is made to execute the method according to any one of claims 1-7, or the method according to any one of claims 8-15. a described method.
27. A computer program product comprising instructions that, when executed on a computer, cause the computer to perform the method of any of claims 1-7, or the method of any of claims 8-15 .
28. A chip, characterized in that it includes at least one processor and an interface;

    The at least one processor obtains program instructions or data through the interface;

    The at least one processor is configured to execute the program line instructions to implement the method of any one of claims 1-7, or the method of any one of claims 8-15.

Images