CN109309831B - Method and device for testing video delay in video conference - Google Patents
Method and device for testing video delay in video conference Download PDFInfo
- Publication number
- CN109309831B CN109309831B CN201811528749.8A CN201811528749A CN109309831B CN 109309831 B CN109309831 B CN 109309831B CN 201811528749 A CN201811528749 A CN 201811528749A CN 109309831 B CN109309831 B CN 109309831B
- Authority
- CN
- China
- Prior art keywords
- video
- data
- video data
- control unit
- tested
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention relates to the technical field of video conferences, in particular to a method and a device for testing video delay in a video conference, wherein the method comprises the steps of obtaining first video data obtained by decoding a first data message to be tested by a multipoint control unit and a second data message to be tested with a time mark; decoding a second data message to be tested to obtain second video data and a time mark; and calculating the time delay of the multipoint control unit based on the time stamp of the first video data and the time stamp corresponding to the second video data. The method comprises the steps that a timestamp is added when a received first data message to be tested is decoded, wherein the timestamp is a timestamp corresponding to a multipoint control unit when the multipoint control unit decodes; the time mark is added when media processing is carried out on the decoded video data, the time mark is the corresponding time when the media processing is carried out, the time delay caused by the transmission of the data message in the network can be avoided based on the time mark and the time mark, and the reliability is higher.
Description
Technical Field
The invention relates to the technical field of video conferences, in particular to a method and a device for testing video delay in a video conference.
Background
With the development of the times and the progress of the society, the communication modes of people are changing day by day. The video conference gradually becomes a mainstream communication mode, and is convenient, quick, intuitive, vivid and deeply popular with people. Among them, the video conference in the center point mode is very widely applied. In the so-called central point mode, audio and video data are sent to the multipoint control unit from the source terminal in the video conference, and are sent to the destination terminal after being processed by the multipoint control unit. Certain time is inevitably consumed in the processing process of the audio and video data in the multipoint control unit, so that the phenomenon that the video picture of the source terminal and the video picture of the destination terminal are asynchronous is caused, wherein the consumed time is the time delay of the video pictures, and the time delay has important influence on the video conference.
In order to solve the above technical problems, in the prior art, video frames of a source terminal and a destination terminal are generally collected, and the video frames are compared and analyzed to obtain a time delay of the video frames. However, the delay of the video pictures of the source terminal and the destination terminal includes the delay in the network transmission process in addition to the processing due to the multipoint control unit. Because the delay in the network transmission process is different under different network environments, the reliability of the delay tested by the method is low.
In addition, chinese patent publication No. CN102158683A discloses a method for testing video latency, which includes: acquiring data messages, wherein the data messages comprise a first message sent to a Multipoint Control Unit (MCU) by a source terminal and a second message sent to a remote terminal by the MCU; respectively acquiring the same frame of image from the video code stream message of the first message and the video code stream message of the second message; analyzing and acquiring two different time information of the same frame of image in the two messages; and calculating to obtain the video delay according to the time difference of the two different time information. However, the inventor finds that, in this scheme, the time information of the image in the first message sent by the source terminal to the MCU is usually the time when the source terminal forms the message, and since there is network delay between the source terminal and the MCU, the detected delay of the MCU includes network delay time, which results in inaccurate delay test result of the MCU.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method and an apparatus for testing video delay in a video conference, so as to solve the problem that the existing multipoint control unit MCU delay test result is not accurate.
According to a first aspect, an embodiment of the present invention provides a method for testing video delay in a video conference, including:
acquiring first video data obtained by decoding a first data message to be tested by a multipoint control unit and a second data message to be tested with a time mark; the first data message to be tested is a data message sent by a source terminal to a multipoint control unit, and the first video data carries a timestamp added when the multipoint control unit decodes; the second data message to be tested is a data message obtained by performing media processing on video data obtained by decoding the first data message to be tested by the multipoint control unit;
decoding the second data message to be tested to obtain second video data and the time mark;
and calculating the time delay of the multipoint control unit based on the time stamp of the first video data and the time stamp corresponding to the second video data.
The method for testing video delay in a video conference, provided by the embodiment of the invention, comprises the steps that a first data packet to be tested is a data message sent to a multipoint control unit by a source terminal, a timestamp is added when the multipoint control unit decodes the received first data packet to be tested, and the timestamp is a timestamp corresponding to the multipoint control unit when the multipoint control unit decodes the received first data packet to be tested; in addition, the multipoint control unit adds a time mark when performing media processing on the decoded video data, wherein the time mark is the time corresponding to the multipoint control unit during the media processing, and the time mark can avoid the time delay caused by the transmission of the data message in the network; the delay obtained by carrying out the delay test on the data message is the delay caused by the media processing of the multipoint control unit, and the reliability is higher.
With reference to the first aspect, in a first implementation manner of the first aspect, the calculating a delay of the multipoint control unit based on the timestamp of the first video data and the timestamp corresponding to the second video data includes:
simultaneously starting to play the first video data and the second video data;
randomly and simultaneously pausing the playing of the first video data and the second video data to obtain a first video display picture corresponding to the first video data and a second video display picture corresponding to the second video data;
calculating a time difference based on a timestamp of the first video display and the timestamp on a second video display; the time difference is a delay of the multipoint control unit.
According to the method for testing the video delay in the video conference, provided by the embodiment of the invention, the first video data and the second video data are simultaneously played and paused, so that the unification of playing and stopping of the two video data is ensured, and the reliability of the video delay test is improved.
With reference to the first implementation manner of the first aspect, in a second implementation manner of the first aspect, the starting to play the first video data and the second video data simultaneously includes:
receiving a playing instruction;
simultaneously, two data message sending threads are used for respectively sending the first video data and the second video data;
and respectively receiving the first video data and the second video data by utilizing two data message receiving threads to obtain a first video image and a second video image.
According to the method for testing the video delay in the video conference, the two messages to be tested are respectively sent by the same terminal by using the data message sending thread, so that the interference of network reasons on the test result is reduced, the time change of the same frame data before and after being processed by the multipoint control unit is more accurately judged, and the reliability of the delay test is improved.
With reference to the second implementation manner of the first aspect, in a third implementation manner of the first aspect, the randomly pausing the playing of the first video data and the playing of the second video data simultaneously includes:
receiving a pause instruction;
pausing the two data message sending threads simultaneously to obtain the first video display picture and the second video display picture; the first video display picture and the second video display picture are respectively the last frame pictures received by the two data message receiving threads.
According to the method for testing video delay in the video conference, provided by the embodiment of the invention, under the condition of simultaneously displaying, playing and pausing, the time difference between the first video display picture and the second video display picture is the delay of the video pictures; therefore, by simultaneously transmitting and pausing, the reliability of the delay test is improved.
With reference to the first aspect, the first embodiment of the first aspect, the second embodiment of the first aspect, or the third embodiment of the first aspect, in a fourth embodiment of the first aspect, the obtaining a first data packet to be tested and a second data packet to be tested includes:
acquiring preset information; the preset information comprises a decoding channel number, a media processing channel number, an IP and a port number corresponding to the source terminal;
extracting a media file by using the decoding channel number and the media processing channel number of the source terminal; the media file is used for storing video data;
and analyzing the media file based on the IP and the port number of the source terminal to obtain the first video data and the second data message to be tested.
According to a second aspect, an embodiment of the present invention further provides a method for testing video delay in a video conference, including:
receiving a video delay test instruction; the delay test instruction comprises a decoding channel number and a media processing channel number corresponding to a source terminal;
decoding the video code stream of the decoding channel number and adding a timestamp to obtain first video data;
performing media processing on the decoded video code stream of the media processing channel number to obtain a second data message to be tested, sending the first video data and the second data message to be tested to a testing device, so that the testing device decodes the second data message to be tested to obtain second video data and the time stamp, and calculating to obtain the time delay of the multipoint control unit based on the time stamp of the first video data and the time stamp corresponding to the second video data; wherein the second datagram to be tested is time-stamped.
According to the method for testing the video delay in the video conference, provided by the embodiment of the invention, a timestamp is added when a received first data message to be tested is decoded, and the timestamp is a timestamp corresponding to a multipoint control unit when the multipoint control unit decodes; in addition, the multipoint control unit adds a time mark when performing media processing on the decoded video data, wherein the time mark is the time corresponding to the multipoint control unit during the media processing, and the time mark can avoid the time delay caused by the transmission of the data message in the network; the delay obtained by the subsequent delay test of the data message is the delay caused by the media processing of the multipoint control unit, and the reliability is higher.
With reference to the second aspect, in a first embodiment of the second aspect, the method further includes:
creating a media file; the media file is used for storing a video code stream;
respectively writing the first video data and the second data message to be tested into the media file;
judging whether the delay test is finished or not;
when the delay test is finished, judging whether the count value is a preset value; wherein the count value is used for representing the writing state of the media file;
and when the count value is the preset value, closing the media file.
According to the method for testing the video delay in the video conference, the closing of the media file is synchronously processed by utilizing the count value, and because the coding and the media processing belong to different threads, the collapse of the subsequent thread caused by closing the media file by the thread which finishes first after the synchronous processing can be avoided, and the reliability of the delay test is improved.
According to a third aspect, an embodiment of the present invention further provides a device for testing video delay in a video conference, which is applied to a testing device, and includes:
the acquisition module is used for acquiring first video data obtained by decoding a first data message to be tested by the multipoint control unit and a second data message to be tested with a time mark; the first data message to be tested is a data message sent by a source terminal to a multipoint control unit, and the first video data carries a timestamp added when the multipoint control unit decodes; the second data message to be tested is a data message obtained by performing media processing on video data obtained by decoding the first data message to be tested by the multipoint control unit;
the data message decoding module is used for decoding the second data message to be tested to obtain second video data and the time mark;
and the delay calculation module is used for calculating the delay of the multipoint control unit based on the time stamp of the first video data and the time stamp corresponding to the second video data.
According to the device for testing video delay in a video conference, provided by the embodiment of the invention, first data to be tested is surrounded as a data message sent to a multipoint control unit by a source terminal, a timestamp is added when the multipoint control unit decodes the received first data message to be tested, and the timestamp is a timestamp corresponding to the multipoint control unit when the multipoint control unit decodes the received first data message to be tested; in addition, the multipoint control unit adds a time mark when performing media processing on the decoded video data, wherein the time mark is the time corresponding to the multipoint control unit during the media processing, and the time mark can avoid the time delay caused by the transmission of the data message in the network; the delay obtained by carrying out the delay test on the data message is the delay caused by the media processing of the multipoint control unit, and the reliability is higher.
According to a fourth aspect, an embodiment of the present invention further provides a device for testing video latency in a video conference, which is applied to a multipoint control unit, and includes:
the receiving module is used for receiving a video delay test instruction; the delay test instruction comprises a decoding channel number and a media processing channel number corresponding to a source terminal;
the video code stream decoding module is used for decoding the video code stream of the decoding channel number and adding a timestamp to obtain first video data;
the media processing module is used for performing media processing on the decoded video code stream of the media processing channel number to obtain a second data message to be tested, sending the first video data and the second data message to be tested to the testing equipment so that the testing equipment decodes the second data message to be tested to obtain second video data and the time stamp, and calculating to obtain the time delay of the multipoint control unit based on the time stamp of the first video data and the time stamp corresponding to the second video data; wherein the second datagram to be tested is time-stamped.
According to the device for testing video delay in the video conference, provided by the embodiment of the invention, the timestamp is added when the received first data message to be tested is decoded, and the timestamp is the corresponding timestamp when the multipoint control unit decodes; in addition, the multipoint control unit adds a time mark when performing media processing on the decoded video data, wherein the time mark is the time corresponding to the multipoint control unit during the media processing, and the time mark can avoid the time delay caused by the transmission of the data message in the network; the delay obtained by the subsequent delay test of the data message is the delay caused by the media processing of the multipoint control unit, and the reliability is higher.
According to a fifth aspect, an embodiment of the present invention further provides an electronic device, including:
a memory and a processor, the memory and the processor being communicatively connected to each other, the memory storing therein computer instructions, and the processor executing the computer instructions to perform the method for testing video delay in a video conference according to the first aspect of the present invention or any of the embodiments of the first aspect, or the method for testing video delay in a video conference according to the second aspect of the present invention or any of the embodiments of the second aspect.
According to a sixth aspect, the present invention further provides a computer-readable storage medium, where the computer-readable storage medium stores computer instructions for causing the computer to execute the method for testing video delay in a video conference according to the first aspect of the present invention or any embodiment of the first aspect, or the method for testing video delay in a video conference according to the second aspect of the present invention or any embodiment of the second aspect.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 shows a block diagram of a video conference system in an embodiment of the invention;
FIG. 2 is a flow chart of a method for testing video latency in a video conference according to an embodiment of the present invention;
FIG. 3 is a flow chart of a method for testing video latency in a video conference according to an embodiment of the present invention;
FIG. 4 is a flowchart of a method for testing video latency in a video conference, according to an embodiment of the present invention;
FIG. 5 is a flowchart of a method for testing video latency in a video conference, according to an embodiment of the present invention;
FIG. 6 is a flow chart of a method for testing video latency in a video conference according to an embodiment of the present invention;
fig. 7 is a block diagram of a video delay testing apparatus in a video conference according to an embodiment of the present invention;
fig. 8 is a block diagram of a video delay testing apparatus in a video conference according to an embodiment of the present invention;
fig. 9 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic diagram of an application scenario of an embodiment of the present invention. The video conference system comprises a plurality of terminals and a multipoint control unit; the conference terminal encodes the collected video data and sends the encoded video data to the multipoint control unit, and the multipoint control unit receives the data sent by each terminal, decodes the data, performs media processing and then sends the decoded data to each terminal.
Specifically, the conference terminal encodes the collected video data and then sends the encoded video data to the multipoint control unit, and the received data sent by the multipoint control unit needs to be decoded and played; in addition, after receiving the data sent by the terminal, the multipoint control unit first needs to decode to obtain specific data, then performs media processing on the specific data, and sends the data to each terminal. Therefore, on the side of the multipoint control unit, a decoding channel and a media processing channel (each decoding channel has a unique decoding channel number, and each media processing channel has a unique media processing channel number) are provided corresponding to each terminal, wherein the decoding channel can be used for transmitting data encoded by the terminal, and the media processing channel is used for transmitting data processed by the multipoint control unit through media; that is, the multipoint control unit may have a decoder as well as a media processor corresponding to each terminal.
For example, referring to fig. 1, corresponding to the terminal 1, one side of the multipoint control unit has a decoding channel and a media processing channel, and correspondingly, the decoding channel number 1 and the media processing channel number a; corresponding to terminal 2, the multipoint control unit side has a decoding channel and a media processing channel, corresponding to decoding channel number 2, media processing channel number b, … ….
In addition, the method for testing video delay in the video conference provided by the embodiment of the invention can be used for testing in the process of the video conference and can also be used for testing off-line. Namely, the video delay test method does not affect the video conference, and when the test is carried out in the video conference, the multipoint control unit processes the data sent by each terminal and sends the processed data to each terminal; on the other hand, based on the actual test requirement, the data messages corresponding to a certain terminal before and after being processed by the multipoint control unit are stored for the test of video delay. The subsequent test of the video delay can be performed in the multipoint control unit, or can be performed in other test equipment.
In accordance with an embodiment of the present invention, there is provided an embodiment of a method for testing video latency in a video conference, it should be noted that the steps illustrated in the flowchart of the accompanying drawings may be executed in a computer system such as a set of computer executable instructions, and that although a logical order is illustrated in the flowchart, in some cases, the steps illustrated or described may be executed in an order different from that described herein.
In this embodiment, a method for testing video delay in a video conference is provided, which can be used in a test device, and fig. 2 is a flowchart of a method for testing video delay in a video conference according to an embodiment of the present invention, as shown in fig. 2, the flowchart includes the following steps:
s11, obtaining the first video data obtained by decoding the first data message to be tested by the multipoint control unit and the second data message to be tested with time mark.
The first data message to be tested is a data message sent by a source terminal to a multipoint control unit, and the first video data carries a timestamp added when the multipoint control unit decodes. The second data message to be tested is a data message obtained by the multipoint control unit performing media processing on video data obtained by decoding the first data message to be tested.
Specifically, when a video delay test is required, the conference terminal sends a data message to the multipoint control unit, the multipoint control unit decodes the data message, and a timestamp is added to each frame of video image in the data message during decoding; that is, the first video data is decoded and time-stamped. The multipoint control unit performs media processing on the video data obtained after decoding and then sends the video data to the conference terminal, wherein the multipoint control unit adds a time mark to each frame of video image during media processing; namely, the media processes and adds the time mark to obtain a second data message to be processed.
The time stamp and the time mark exist in the image content, so that the corresponding time stamp and the corresponding time mark can be displayed on the video display picture when the subsequent video display picture is played and displayed conveniently, and what you see is what you get is formed. The timestamp or time stamp may be an image of a stopwatch program acquired by a camera, such as Onlystop watch; time information can also be superimposed on the image during decoding or media processing, for example, current local time is acquired and then YUV data is generated by cario. Wherein the time schedule of acquisition and superposition is typically accurate to milliseconds.
The first video data and the second data message to be tested acquired by the testing equipment can be data messages acquired in real time, or the first video data and the second data message to be tested can be stored in a media file form, and when the time delay testing is needed, the testing equipment acquires the first video data and the second data message to be tested from the media file; or other modes and the like, and only the first video data and the second data message to be tested can be obtained by the testing equipment.
S12, decoding the second data packet to be tested to obtain the second video data and the time stamp.
The multipoint control unit sends the processed media to the conference terminal, and the data message sent from the media processing channel to the conference terminal is obtained after coding. Therefore, the second data message to be tested needs to be decoded to obtain the second video data and the time stamp.
S13, calculating the delay of the multi-point control unit based on the timestamp of the first video data and the timestamp corresponding to the second video data.
The time stamps exist on each frame of video image in the first video data, the time stamps exist on each frame of video image in the second video data, the same video image can be matched in the first video data and the second video data, and then the time stamps and the time stamps on the same video image are compared, so that the time delay of the multipoint control unit can be obtained; or simultaneously playing and simultaneously pausing the first video data and the second video data, and obtaining the time delay of the multipoint control unit through the time stamp of the first video display picture and the time stamp of the second video display picture obtained after pausing. The calculation of the time delay may be to extract the time stamp and compare with the time stamp, or to compare directly with the human eye, and so on.
Under the condition of simultaneous display and playing, the time information difference (the time difference between the timestamp and the time mark) of the first video display picture and the second video display picture is the video picture delay. For example, the timestamp in the first video frame a is 100, the timestamp in the second video frame B is 110, and the difference between the timestamp and the timestamp is the delay of the video frame.
The method for testing video delay in a video conference provided by this embodiment includes that a first data to be tested is surrounded as a data message sent by a source terminal to a multipoint control unit, the multipoint control unit adds a timestamp when decoding the received first data message to be tested, and the timestamp is a timestamp corresponding to the multipoint control unit when decoding; in addition, the multipoint control unit adds a time mark when performing media processing on the decoded video data, wherein the time mark is the time corresponding to the multipoint control unit during the media processing, and the time mark can avoid the time delay caused by the transmission of the data message in the network; the delay obtained by carrying out the delay test on the data message is the delay caused by the media processing of the multipoint control unit, and the reliability is higher.
The embodiment also provides a method for testing video delay in a video conference, which can be used in a test device, and fig. 3 is a flowchart of a method for testing video delay in a video conference according to an embodiment of the present invention, as shown in fig. 3, the flowchart includes the following steps:
s21, obtaining the first video data obtained by decoding the first data message to be tested by the multipoint control unit and the second data message to be tested with time mark.
The first data message to be tested is a data message sent by a source terminal to a multipoint control unit, and the first video data carries a timestamp added when the multipoint control unit decodes. The second data message to be tested is a data message obtained by the multipoint control unit performing media processing on video data obtained by decoding the first data message to be tested.
Please refer to S11 in fig. 2 for details, which are not described herein.
S22, decoding the second data packet to be tested to obtain the second video data and the time stamp. Please refer to S12 in fig. 2 for details, which are not described herein.
S23, calculating the delay of the multi-point control unit based on the timestamp of the first video data and the timestamp corresponding to the second video data.
And calculating to obtain the time delay of the multipoint control unit by adopting a method of simultaneously playing, randomly and simultaneously pausing.
Specifically, the method comprises the following steps:
s231, the first video data and the second video data are played simultaneously.
The first video data and the second video data are simultaneously started to be played, i.e. a first video image corresponding to the first video data and a second video image corresponding to the second video data can be presented in the testing device. For example, the test device may obtain the corresponding first video image and second video image by means of video playing software, or by encoding a display program.
The test equipment respectively utilizes the two data message sending threads and the two data receiving threads to display the picture by the video in the first video data and the second video data. Namely, on the test equipment, the first video data and the second video data are operated at the same time: the transmission, reception and display allow for the comparison of visual video displays.
Optionally, the following steps may be included:
(1) and receiving a playing instruction.
The test equipment receives a playing instruction sent by the script program so as to send the first video data and the second video data at the same time.
(2) And simultaneously, respectively sending the first video data and the second video data by utilizing two data message sending threads.
The test equipment simultaneously utilizes two data message sending threads to respectively send the first video data and the second video data; the playing instruction is sent through the script program, so that the data messages to be tested can be ensured to be sent at the same time. Because the data are sent simultaneously, the time change of the same frame data before and after the same frame data are processed by the media through the multipoint control unit can be more accurately judged subsequently.
For example, the data messaging thread may correspond to a written video data sending program, that is, the test equipment controls the video data sending program using a script program and sends video data at the same time.
(3) And respectively receiving the first video data and the second video data by utilizing two data message receiving threads to obtain a first video image and a second video image.
The data packet receiving thread of the test device may be a data packet receiving program corresponding to the data packet sending program. The test equipment controls two data message sending programs by using a script program, and simultaneously sends a data message to be tested to the two data message receiving programs so as to obtain a first video image and a second video image; i.e. the first video image and the second video image are displayed simultaneously on the test device.
S232, randomly and simultaneously pausing the playing of the first video data and the second video data to obtain a first video display picture corresponding to the first video data and a second video display picture corresponding to the second video data.
The test equipment randomly and simultaneously pauses the first video image and the second video image, so that the video images on the test equipment are stopped on the first video display picture and the second video display picture. The first video display picture corresponds to a first video image, and the second video display picture corresponds to a second video image.
Optionally, the following steps may be included:
(1) a pause instruction is received.
(2) And simultaneously suspending two data message sending threads.
And the two data message receiving threads display the received last frame of picture as a first video display picture and a second video display picture respectively.
The test equipment controls two data message sending threads to send video data to a data receiving thread by using a script program, the two data message sending threads pause sending the video data at the same time, and the data message receiving thread displays the received last frame of pictures as a first video display picture and a second video display picture respectively; with a time stamp on the first video display and a time stamp on the second video display.
S233, a time difference is calculated based on the time stamp of the first video display screen and the time stamp on the second video display screen.
And the time difference is the time delay of the MCU. And simultaneously, randomly pausing the first video data and the second video data to respectively obtain a corresponding first video display picture and a corresponding second video display picture, wherein the first video display picture is provided with a timestamp, the second video display picture is provided with a timestamp, and the timestamp are compared to obtain a time difference.
Compared with the embodiment shown in fig. 2, the method for testing video delay in a video conference provided by the embodiment guarantees the unification of playing and stopping of the two video data by simultaneously playing and pausing the first video data and the second video data, and improves the reliability of the video delay test.
As an optional implementation manner of this embodiment, multiple simultaneous playing and random simultaneous pausing may be performed to obtain multiple video delays, and then the multiple video delays are averaged, so as to obtain an average value of the video delays, thereby improving the reliability of the video delays.
The embodiment also provides a method for testing video delay in a video conference, which can be used in a test device, and fig. 4 is a flowchart of the method for testing video delay in a video conference according to the embodiment of the present invention, as shown in fig. 4, the flowchart includes the following steps:
s31, obtaining the first video data obtained by decoding the first data message to be tested by the multipoint control unit and the second data message to be tested with time mark.
The first data message to be tested is a data message sent by a source terminal to a multipoint control unit, and the first video data carries a timestamp added when the multipoint control unit decodes. The second data message to be tested is a data message obtained by the multipoint control unit performing media processing on video data obtained by decoding the first data message to be tested.
Specifically, during the delay test, the test device analyzes the first video data and the second data packet to be tested from the media file by using the decoding channel number, the media processing channel number, the IP, and the port number of the source terminal. Specifically, the method comprises the following steps:
and S311, acquiring preset information.
The preset information comprises a decoding channel number, a media processing channel number, an IP and a port number corresponding to the source terminal.
Specifically, the testing device may obtain the decoding channel number, the media processing channel number, the IP, and the port number of the source terminal respectively through information in the video conference. The subsequent testing equipment can acquire the first video data and the second data message to be tested from the media file by using the IP and the port number.
S312, extracting the media file by using the decoding channel number and the media processing channel number of the source terminal.
And the media file is used for storing the video code stream. Specifically, during the delay test, the multipoint control unit stores the video code streams before and after the media processing in the media file respectively. The media file can be named by a decoding channel number, a coding channel number and the current time so as to distinguish different time and terminal information during delay test. Therefore, the corresponding media file can be extracted by using the decoding channel number of the source terminal and the media processing channel number.
S313, the media file is analyzed based on the IP and the port number of the source terminal to obtain the first video data and the second data message to be tested.
The testing equipment analyzes and filters the media file by using the acquired information (IP and port number), and then the first video data and the second data message to be tested can be acquired. Wherein the first video data is the video data decoded and time-stamped by the multipoint control unit, and the second data message to be tested is the data processed (for example, re-decoded, synthesized and encoded) by the multipoint control unit.
S32, decoding the second data packet to be tested to obtain the second video data and the time stamp. Please refer to S22 in fig. 3 for details, which are not described herein.
S33, calculating the delay of the multi-point control unit based on the timestamp of the first video data and the timestamp corresponding to the second video data. Please refer to S23 in fig. 3 for details, which are not described herein.
Compared with the embodiment shown in fig. 3, in the method for testing video delay in a video conference provided by this embodiment, by analyzing the media file by using the information of the conference terminal, the first video data which is not subjected to the media processing by the multipoint control unit and the second data message to be tested which is subjected to the media processing by the multipoint control unit can be obtained, so that the efficiency of the delay test is improved.
As a specific application example of this embodiment, this embodiment provides a method for testing video delay in a video conference, including the following steps:
(1) and respectively acquiring the IP and the port of a first conference terminal (source terminal) and a second conference terminal (destination terminal) by utilizing the information in the conference.
(2) And analyzing and filtering the media file according to the IP and the port information to respectively obtain first video data S obtained after the source terminal multipoint control unit decodes the received data message sent by the source terminal and adds a timestamp and a second data message D to be tested obtained after the multipoint control unit carries out media processing on the decoded video data. In the case of co-display playing, the difference between the time information of the S and D display pictures is the video picture delay.
(3) On the test equipment, two data messaging tools open and set different ports 1 and 2, respectively (since on the same test equipment, the IP sent and received are the same) for sending message data S and message data D.
(4) On the test equipment, two data message receiving tools are opened, and the different ports 1 and 2 are respectively arranged for receiving the message data S and the message data D, decoding and displaying the message data S and the message data D, and displaying the video image. The aim of operating on the same test equipment is to minimize the interference of network causes on the test results. The data message sending tool has the main function of sending data to a specified IP and a specified port by setting the IP and the port.
(5) And controlling the two data message sending tools by using a script program, and sending S video message data and D video message data to the two data message receiving tools at the same time to display video pictures. The key of this step is that the script controls the simultaneous transmission, because only the simultaneous transmission can more accurately judge the time change of the same frame data before and after the processing by the multipoint control unit. The main function of the data message receiving tool is to receive a specific data message by setting an IP and a port, and decode, display and play the data message. The data message sending means and the data message receiving means form a system for visual analysis of the data message. On the same test equipment, simultaneously operating two data messages: transmitted, received, and displayed, and then the visualized video frames can be compared.
(6) And randomly pausing, comparing video display pictures, acquiring time information, and calculating a time difference. The two tools for sending the data message pause sending data at the same time, the tool for receiving the data message displays the received last frame of picture, and the time difference of the two video pictures is compared, namely the video picture delay.
In this embodiment, a method for testing video delay in a video conference is provided, which can be used in a multipoint control unit, and fig. 5 is a flowchart of a method for testing video delay in a video conference according to an embodiment of the present invention, as shown in fig. 5, the flowchart includes the following steps:
and S41, receiving a video delay test instruction.
Wherein the delay test instruction includes a decoding channel number and a media processing channel number corresponding to the conference terminal.
When the video conference starts, the multipoint control unit can simultaneously start a single thread for receiving the video delay test instruction. The multipoint control unit waits for receiving the video delay test instruction on one hand and decodes on the other hand. The delay test instruction may include a decoding channel number a corresponding to the conference terminal, and a media processing channel number B, so as to distinguish different conference terminals. Optionally, the delay test instruction may further include a storage duration T, and the like.
And S42, decoding the video code stream of the decoding channel number and adding a time stamp to obtain first video data.
After receiving the data message sent by the terminal, the media processing unit decodes the data message and adds a timestamp to the data message, so that first video data can be obtained.
S43, media processing is carried out on the decoded video code stream of the media processing channel number to obtain a second data message to be tested, the first video data and the second data message to be tested are sent to the testing equipment, so that the testing equipment decodes the second data message to be tested to obtain second video data and a time stamp, and the time delay of the multipoint control unit is obtained through calculation based on the time stamp of the first video data and the time stamp corresponding to the second video data.
Wherein the second datagram to be tested is time-stamped. And the media processing unit performs media processing on the video data obtained after decoding and adds a time mark to obtain a second data message to be tested.
The obtained first video data and the second data message to be tested can be used for subsequent testing of video delay.
In the method for testing video delay in a video conference provided by this embodiment, a timestamp is added when a received first data packet to be tested is decoded, where the timestamp is a timestamp corresponding to a multipoint control unit when decoding; in addition, the multipoint control unit adds a time mark when performing media processing on the decoded video data, wherein the time mark is the time corresponding to the multipoint control unit during the media processing, and the time mark can avoid the time delay caused by the transmission of the data message in the network; the delay obtained by the subsequent delay test of the data message is the delay caused by the media processing of the multipoint control unit, and the reliability is higher.
In this embodiment, a method for testing video delay in a video conference is provided, which can be used in a multipoint control unit, and fig. 6 is a flowchart of a method for testing video delay in a video conference according to an embodiment of the present invention, as shown in fig. 6, the flowchart includes the following steps:
and S51, receiving a video delay test instruction.
Wherein the delay test instruction includes a decoding channel number and a media processing channel number corresponding to the conference terminal. Please refer to S41 in fig. 5, which is not repeated herein.
And S52, decoding the video code stream of the decoding channel number and adding a time stamp to obtain first video data. Please refer to S42 in fig. 5, which is not repeated herein.
S53, media processing is carried out on the decoded video code stream of the media processing channel number to obtain a second data message to be tested, the first video data and the second data message to be tested are sent to the testing equipment, so that the testing equipment decodes the second data message to be tested to obtain second video data and a time stamp, and the time delay of the multipoint control unit is obtained through calculation based on the time stamp of the first video data and the time stamp corresponding to the second video data.
Wherein the second datagram to be tested is time-stamped. Please refer to S43 in fig. 5, which is not repeated herein.
S54, a media file is created.
And the media file is used for storing the video code stream. When the multi-point control unit needs to perform the delay test, a media file for storing the video code stream, such as an asf file, is created. The media file may be named using a decode channel number, a media processing channel number, and a current time.
And S55, writing the first video data and the second data message to be tested into the media file respectively.
After creating the media file, the multipoint control unit writes the video code streams (i.e., the first video data and the second data packet to be tested) corresponding to the decoding channel number and the media processing channel number into the media file, respectively. Wherein, optionally, the multipoint control unit can save the key frame to facilitate playing quickly when playing; meanwhile, in order to ensure that the key frame arrives quickly, the key frame needs to be applied during writing.
And S56, judging whether the delay test is finished.
The multi-point control unit judges whether the delay test is finished in real time, for example, when the delay test instruction includes a storage time length, the multi-point control unit can judge through comparing the storage time length, and if the storage time length exceeds, the multi-point control unit indicates that the writing is finished; or judging whether the delay test is ended by judging whether a test ending instruction is received. Wherein, when the delay test is finished, S57 is executed; otherwise, S55 is executed.
And S57, judging whether the count value is a preset value.
Wherein the count value is used to represent a writing status of the media file. Specifically, because the coding and the media processing belong to different threads, the file is operated and closed at the same time, the asf can automatically synchronize during operation and writing, but the closing needs to perform synchronization processing by itself, otherwise, the thread which ends first closes the file and then causes the subsequent thread to crash. Therefore, the count value is counted up by one according to the number of streams while the media file is opened, for example, one stream is written as count 1, and two streams are written as count 2; when the file is closed, the count is decreased by one, when the file is closed, the count is first decreased, for example, when the count is 2, the count is decreased by one, the count is 1, when the count is determined not to be 0, that is, the initial value is obtained, the file is not closed, the subsequent media processing is finished to close, when the count is first decreased by one, the count is 0, then the file is really closed after the count is determined to be 0, that is, the operating system interface is called to close. Therefore, only when the count value is a preset value, it indicates that the media file can be closed. When the count value is a preset value, executing S58; otherwise, after waiting for the preset time, S57 is executed again.
S58, the media file is closed.
The multi-point control unit closes the media file, and the first video data and the second data message to be tested are stored in the media file and can be used for subsequent video delay tests.
Compared with the embodiment shown in fig. 5, in the method for testing video delay in a video conference provided by the embodiment, the closing of the media file is synchronously processed by using the count value, and since the coding and the media processing belong to different threads, the crash of the subsequent thread caused by closing the media file by the thread which ends first after the synchronous processing can be avoided, and the reliability of the delay test is improved.
As a specific application example of this embodiment, the method for testing video delay in a video conference includes the following steps:
(1) video conference is started, terminal MTX joins in the conference, multipoint control unit carries out conventional functions of media processing such as picture composition, and terminal MTX is in picture composition.
(2) The terminal MTX sends video data to the multipoint control unit.
(3) The multipoint control unit decrypts the received video data and prepares for further processing (8).
(4) And simultaneously, the multipoint control unit starts a single thread to wait for a video delay test command.
(5) The multipoint control unit judges whether the test command is received, if not, the multipoint control unit continues to wait for the delay test command, if so, the multipoint control unit executes the decoding, and if so, the multipoint control unit executes the decoding (6), wherein the received test command can contain a decoding channel number A, a media processing channel number B, a storage duration T and the like corresponding to the terminal MTX. The information of the conference terminal on the platform can be acquired through the management information of the conference.
(6) The multipoint control unit creates a media file such as an asf file for storing media, and the naming adopts a decoding channel number, a coding channel number and the current time for naming, so that different time and terminal information can be conveniently distinguished in statistics. The multimedia unit adds a time stamp when decoding, and the time stamp exists in the image content, so that the playing and displaying are convenient after the time stamp is stored into a media playing file, and the what you see is what you get is formed. The time stamp can acquire images of a stopwatch program through a camera, such as a commonly-used Onlystop watch, and can also superpose time information on the images during encoding, such as acquiring the current local time and then generating YUV data through cario, and the time precision of acquisition and superposition is generally accurate to millisecond.
(7) The multipoint control unit is notified that the data is stored in the encoding path and the media processing path corresponding to the terminal MTX, and (8) and (13) are executed.
(8) Judging whether a delay test is needed to be carried out at present and a file is written in, wherein the judgment is from the delay command monitoring thread in the step (4); the determination can be generally made by setting a flag bit, such as bsiwrite ═ TRUE.
(9) The multipoint control unit generates a local timestamp that is typically obtained by calling a system function, such as gettimeoffset, to obtain the local time from linux, and writes the timestamp and decoded data to the media file to form the first video data (i.e., stream a). In order to enable fast playback at the time of playback, the key frames are generally saved at the time of arrival. Meanwhile, in order to ensure that the key frame arrives quickly, the key frame is required to be applied during writing. This enables fast acquisition of key frames.
(10) And judging whether the delay test is finished or not, usually comparing the storage time length T transmitted before to judge, and if the storage time length exceeds, indicating that the writing is finished.
(11) And after the delay test is finished, closing the file, and clearing related state information, such as writing flag bits, time length and the like.
(12) Whether the delay test is started or finished, the step is carried out, media operations such as decoding, synthesizing, encoding and the like are executed, and the normal conference function is ensured.
(13) And (8) judging whether the coding is in the delay test or not after the coding is finished under the same judgment condition.
(14) And if the file needs to be written, the multipoint control unit generates a time mark, writes the time mark and the data after the media processing into the media file to form a second data message to be tested (namely, a stream B), and directly encodes a frame of key frame for storage in order to play smoothly.
(15) And (5) judging whether the delay test is finished or not, wherein the judgment reason is the same as (10).
(16) The file is closed after the delay test is finished, and related state information is cleared (11). Because the coding and the media processing belong to different threads, the file is operated and closed at the same time, the asf can automatically synchronize during the operation writing, but the closing needs to perform the synchronization processing by itself, otherwise, the thread which ends first can crash the following thread after closing the file. When the file is opened, the count value is counted up by one according to the number of the streams, for example, one stream is written as count 1, two streams are written as count 2, the count is decremented by one when the file is closed, the count is first decremented when the file is closed, for example, the count is set as count 2, the count is decremented by one when the file is closed, that is, the count is 1, and it is determined that the count is not 0, that is, the initial value. If the file is not closed, the subsequent encoding is finished to close, counting is first reduced, and then count is 0, and then the file is really closed after the count is judged to be 0, namely the operating system interface is called to close.
(17) And sending the data after media processing to the corresponding terminal no matter whether the delay test is started or finished, so as to ensure that the conference is normally carried out.
To this end, a media file is stored in the multipoint control unit, the media file comprising the first video data (i.e. stream a) and the second data packets to be tested (i.e. stream B).
The embodiment also provides a device for testing video delay in a video conference, where the device is used to implement the foregoing embodiments and preferred embodiments, and the description already made is omitted here for brevity. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
The embodiment provides a device for testing video delay in a video conference, which is applied to a testing device, and as shown in fig. 7, the device comprises:
an obtaining module 61, configured to obtain first video data obtained by decoding, by a multipoint control unit, a first data packet to be tested, and a second data packet to be tested having a time stamp; the first data message to be tested is a data message sent by a source terminal to a multipoint control unit, and the first video data carries a timestamp added when the multipoint control unit decodes; the second data message to be tested is a data message obtained by performing media processing on video data obtained by decoding the first data message to be tested by the multipoint control unit.
And a data packet decoding module 62, configured to decode the second data packet to be tested, so as to obtain second video data and the time stamp.
And a delay calculating module 63, configured to calculate, based on the timestamp of the first video data and the timestamp corresponding to the second video data, a delay of the multipoint control unit.
In the device for testing video delay in a video conference provided by this embodiment, first data to be tested is surrounded as a data packet sent by a source terminal to a multipoint control unit, the multipoint control unit adds a timestamp when decoding the received first data packet to be tested, and the timestamp is a timestamp corresponding to the multipoint control unit when decoding; in addition, the multipoint control unit adds a time mark when performing media processing on the decoded video data, wherein the time mark is the time corresponding to the multipoint control unit during the media processing, and the time mark can avoid the time delay caused by the transmission of the data message in the network; the delay obtained by carrying out the delay test on the data message is the delay caused by the media processing of the multipoint control unit, and the reliability is higher.
The embodiment further provides a device for testing video delay in a video conference, which is applied to a multipoint control unit, as shown in fig. 8, and includes:
a receiving module 71, configured to receive a video delay test instruction; the delay test instruction comprises a decoding channel number and a media processing channel number corresponding to a source terminal;
a video code stream decoding module 72, configured to decode the video code stream of the decoding channel number and add a timestamp to obtain first video data;
the media processing module 73 is configured to perform media processing on the decoded video code stream of the media processing channel number to obtain a second data message to be tested, send the first video data and the second data message to be tested to the test equipment, so that the test equipment decodes the second data message to be tested to obtain second video data and a time stamp, and calculate a delay of the multipoint control unit based on the time stamp of the first video data and the time stamp corresponding to the second video data; wherein the second datagram to be tested is time-stamped.
According to the device for testing video delay in the video conference, provided by the embodiment of the invention, the timestamp is added when the received first data message to be tested is decoded, and the timestamp is the corresponding timestamp when the multipoint control unit decodes; in addition, the multipoint control unit adds a time mark when performing media processing on the decoded video data, wherein the time mark is the time corresponding to the multipoint control unit during the media processing, and the time mark can avoid the time delay caused by the transmission of the data message in the network; the delay obtained by the subsequent delay test of the data message is the delay caused by the media processing of the multipoint control unit, and the reliability is higher.
The video delay testing apparatus in the video conference in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC circuit, a processor and a memory executing one or more software or fixed programs, and/or other devices capable of providing the above functions.
Further functional descriptions of the modules are the same as those of the corresponding embodiments, and are not repeated herein.
An embodiment of the present invention further provides an electronic device, which has the video delay testing apparatus in a video conference shown in fig. 7 or fig. 8.
Referring to fig. 9, fig. 9 is a schematic structural diagram of an electronic device according to an alternative embodiment of the present invention, and as shown in fig. 9, the electronic device may include: at least one processor 81, such as a CPU (Central Processing Unit), at least one communication interface 83, memory 84, and at least one communication bus 82. Wherein a communication bus 82 is used to enable the connection communication between these components. The communication interface 83 may include a Display (Display) and a Keyboard (Keyboard), and the optional communication interface 83 may also include a standard wired interface and a standard wireless interface. The Memory 84 may be a high-speed RAM Memory (volatile Random Access Memory) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. The memory 84 may optionally be at least one memory device located remotely from the processor 81. Wherein the processor 81 may be in connection with the apparatus described in fig. 7 or fig. 8, an application program is stored in the memory 84, and the processor 81 calls the program code stored in the memory 84 for performing any of the above-mentioned method steps.
The communication bus 82 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The communication bus 82 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in FIG. 9, but this does not indicate only one bus or one type of bus.
The memory 84 may include a volatile memory (RAM), such as a random-access memory (RAM); the memory may also include a non-volatile memory (english: non-volatile memory), such as a flash memory (english: flash memory), a hard disk (english: hard-drive, abbreviated: HDD) or a solid-state drive (english: SSD); the memory 84 may also comprise a combination of the above types of memory.
The processor 81 may be a Central Processing Unit (CPU), a Network Processor (NP), or a combination of CPU and NP.
The processor 81 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a Programmable Logic Device (PLD), or a combination thereof. The aforementioned PLD may be a Complex Programmable Logic Device (CPLD), a field-programmable gate array (FPGA), a General Array Logic (GAL), or any combination thereof.
Optionally, the memory 84 is also used to store program instructions. The processor 81 may call program instructions to implement the method for testing video delay in a video conference as shown in the embodiments of fig. 1 to 3 of the present application, or the method for testing video delay in a video conference as shown in the embodiments of fig. 4 or 5 of the present application.
The embodiment of the invention also provides a non-transitory computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions can execute the method for testing the video delay in the video conference in any method embodiment. The storage medium may be a magnetic Disk, an optical Disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a flash Memory (FlashMemory), a Hard Disk (Hard Disk Drive, abbreviated as HDD) or a Solid State Drive (SSD), etc.; the storage medium may also comprise a combination of memories of the kind described above.
Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope defined by the appended claims.
Claims (10)
1. A method for testing video delay in a video conference is characterized by comprising the following steps:
acquiring first video data obtained by decoding a first data message to be tested by a multipoint control unit and a second data message to be tested with a time mark; the first data message to be tested is a data message sent by a source terminal to a multipoint control unit, and the first video data carries a timestamp added when the multipoint control unit decodes; the second data message to be tested is a data message obtained by performing media processing on video data obtained by decoding the first data message to be tested by the multipoint control unit;
decoding the second data message to be tested to obtain second video data and the time mark;
and calculating the time delay of the multipoint control unit based on the time stamp of the first video data and the time stamp corresponding to the second video data.
2. The method of claim 1, wherein calculating the delay of the multipoint control unit based on the timestamp of the first video data and the timestamp of the second video data comprises:
simultaneously starting to play the first video data and the second video data;
randomly and simultaneously pausing the playing of the first video data and the second video data to obtain a first video display picture corresponding to the first video data and a second video display picture corresponding to the second video data;
calculating a time difference based on a timestamp of the first video display and the timestamp on a second video display; the time difference is a delay of the multipoint control unit.
3. The method of claim 2, wherein the simultaneously starting to play the first video data and the second video data comprises:
receiving a playing instruction;
simultaneously, two data message sending threads are used for respectively sending the first video data and the second video data;
and respectively receiving the first video data and the second video data by utilizing two data message receiving threads to obtain a first video image and a second video image.
4. The method of claim 3, wherein randomly pausing the playback of the first video data and the second video data simultaneously comprises:
receiving a pause instruction;
pausing the two data message sending threads simultaneously to obtain the first video display picture and the second video display picture; the first video display picture and the second video display picture are respectively the last frame pictures received by the two data message receiving threads.
5. The method according to any of claims 1-4, wherein the obtaining the first video data and the second data packet with the time stamp from the decoding of the first data packet to be tested by the multipoint control unit comprises:
acquiring preset information; the preset information comprises a decoding channel number, a media processing channel number, an IP and a port number corresponding to the source terminal;
extracting a media file by using the decoding channel number and the media processing channel number of the source terminal; the media file is used for storing video data;
and analyzing the media file based on the IP and the port number of the source terminal to obtain the first video data and the second data message to be tested.
6. A method for testing video delay in a video conference is characterized by comprising the following steps:
receiving a video delay test instruction; the delay test instruction comprises a decoding channel number and a media processing channel number corresponding to a source terminal;
decoding the video code stream of the decoding channel number and adding a timestamp to obtain first video data;
and performing media processing on the decoded video code stream of the media processing channel number to obtain a second data message to be tested with a time mark, sending the first video data and the second data message to be tested to test equipment, so that the test equipment decodes the second data message to be tested to obtain second video data and the time mark, and calculating to obtain the time delay of the multipoint control unit based on the time stamp of the first video data and the time mark corresponding to the second video data.
7. The method of claim 6, further comprising:
creating a media file; the media file is used for storing a video code stream;
respectively writing the first video data and the second data message to be tested into the media file;
judging whether the delay test is finished or not;
when the delay test is finished, judging whether the count value is a preset value; wherein the count value is used for representing the writing state of the media file;
and when the count value is the preset value, closing the media file.
8. A video time-delay testing device in a video conference is applied to testing equipment and is characterized by comprising:
the acquisition module is used for acquiring first video data obtained by decoding a first data message to be tested by the multipoint control unit and a second data message to be tested with a time mark; the first data message to be tested is a data message sent by a source terminal to a multipoint control unit, and the first video data carries a timestamp added when the multipoint control unit decodes; the second data message to be tested is a data message obtained by performing media processing on video data obtained by decoding the first data message to be tested by the multipoint control unit;
the data message decoding module is used for decoding the second data message to be tested to obtain second video data and the time mark;
and the delay calculation module is used for calculating the delay of the multipoint control unit based on the time stamp of the first video data and the time stamp corresponding to the second video data.
9. An electronic device, comprising:
a memory and a processor, the memory and the processor being communicatively connected to each other, the memory having stored therein computer instructions, the processor executing the computer instructions to perform the method for testing video latency in a video conference according to any one of claims 1 to 5, or the method for testing video latency in a video conference according to claim 6 or 7.
10. A computer-readable storage medium storing computer instructions for causing a computer to perform the method for testing video latency in a video conference according to any one of claims 1 to 5 or the method for testing video latency in a video conference according to claim 6 or 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811528749.8A CN109309831B (en) | 2018-12-13 | 2018-12-13 | Method and device for testing video delay in video conference |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811528749.8A CN109309831B (en) | 2018-12-13 | 2018-12-13 | Method and device for testing video delay in video conference |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109309831A CN109309831A (en) | 2019-02-05 |
| CN109309831B true CN109309831B (en) | 2020-05-08 |
Family
ID=65223554
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811528749.8A Active CN109309831B (en) | 2018-12-13 | 2018-12-13 | Method and device for testing video delay in video conference |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109309831B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109842795B (en) * | 2019-02-28 | 2020-08-11 | 苏州科达科技股份有限公司 | Audio and video synchronization performance testing method and device, electronic equipment and storage medium |
| CN109819303B (en) * | 2019-03-06 | 2021-04-23 | Oppo广东移动通信有限公司 | Data output method and related equipment |
| CN110324566B (en) * | 2019-07-05 | 2020-12-25 | 苏州科达科技股份有限公司 | Method, device and equipment for testing sound delay in video conference |
| CN111787312A (en) * | 2020-07-29 | 2020-10-16 | 杭州叙简科技股份有限公司 | Video delay test method, system, electronic equipment and storage medium |
| CN113068021B (en) * | 2021-03-31 | 2023-03-07 | 北京飞讯数码科技有限公司 | Delay testing method, device, equipment and storage medium |
| CN112988475B (en) * | 2021-04-28 | 2022-10-28 | 厦门亿联网络技术股份有限公司 | Disaster tolerance test method, device, test server and medium |
| CN113573160B (en) * | 2021-05-17 | 2022-03-22 | 南斗六星系统集成有限公司 | Method for determining video delay in real-time video |
| CN113766217B (en) * | 2021-09-08 | 2024-04-09 | 苏州科达科技股份有限公司 | Video delay testing method and device, electronic equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104349163A (en) * | 2014-11-26 | 2015-02-11 | 电子科技大学 | Measurement display device and measurement system for end-to-end video transmission delay |
| CN105791986A (en) * | 2014-12-23 | 2016-07-20 | 中国移动通信集团公司 | Video time delay detection method and device |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100604480B1 (en) * | 2004-03-22 | 2006-07-24 | 엘지전자 주식회사 | System and Method for testing delay time of bidirectional in mobile image phone |
| CN1859584A (en) * | 2005-11-14 | 2006-11-08 | 华为技术有限公司 | Video frequency broadcast quality detecting method for medium broadcast terminal device |
| CN101516017B (en) * | 2008-02-22 | 2010-12-01 | 中国移动通信集团公司 | Method, device and system for measuring video transmission delay of session service |
| CN101656640B (en) * | 2009-09-16 | 2011-12-07 | 中兴通讯股份有限公司 | Method and equipment for determining testing data |
| CN102158683B (en) * | 2011-04-25 | 2015-08-12 | 中兴通讯股份有限公司 | The method of testing of video delay in video conference and computer |
| CN102655585B (en) * | 2012-04-16 | 2015-07-15 | 中国联合网络通信集团有限公司 | Video conference system and time delay testing method, device and system thereof |
| CN106546238B (en) * | 2016-10-26 | 2020-09-01 | 北京小鸟看看科技有限公司 | Wearable device and method for determining user displacement in wearable device |
| CN106851259B (en) * | 2017-01-17 | 2021-03-12 | 中国科学院上海高等研究院 | Video delay testing device in monitoring system |
-
2018
- 2018-12-13 CN CN201811528749.8A patent/CN109309831B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104349163A (en) * | 2014-11-26 | 2015-02-11 | 电子科技大学 | Measurement display device and measurement system for end-to-end video transmission delay |
| CN105791986A (en) * | 2014-12-23 | 2016-07-20 | 中国移动通信集团公司 | Video time delay detection method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109309831A (en) | 2019-02-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109309831B (en) | Method and device for testing video delay in video conference | |
| US20220070531A1 (en) | Methods and apparatus for an embedded appliance | |
| CN109842795B (en) | Audio and video synchronization performance testing method and device, electronic equipment and storage medium | |
| WO2021114708A1 (en) | Method and apparatus for implementing multi-person video live-streaming service, and computer device | |
| US10305613B2 (en) | Method and system for detecting image delay | |
| CN110505522A (en) | Processing method, device and the electronic equipment of video data | |
| CN102655585B (en) | Video conference system and time delay testing method, device and system thereof | |
| CN109144858B (en) | Fluency detection method and device, computing equipment and storage medium | |
| KR102260946B1 (en) | Techniques for detecting media playback errors | |
| US9344678B2 (en) | Information processing apparatus, information processing method and computer-readable storage medium | |
| US10593365B2 (en) | Methods and systems for determining that a video-capturing device is unsteady | |
| US20140281994A1 (en) | Interactive method, terminal device and system for communicating multimedia information | |
| CN113766217B (en) | Video delay testing method and device, electronic equipment and storage medium | |
| CN112702557A (en) | Screen sharing method, device, equipment and storage medium based on call | |
| CN110691238A (en) | Video reconstruction quality testing method, device, equipment and readable storage medium | |
| CN104053002A (en) | Video decoding method and device | |
| US9264665B2 (en) | Teleconferencing system and non-transitory computer readable medium storing program | |
| CN113572898B (en) | Method and corresponding device for detecting silent abnormality in voice call | |
| CN109600571B (en) | Multimedia resource transmission test system and multimedia resource transmission test method | |
| CN113099214A (en) | Live video playing control method, electronic equipment and storage medium | |
| CN111669539A (en) | Video playing method and device and electronic equipment | |
| CN114390336B (en) | Video decoding method and device, electronic equipment and readable storage medium | |
| CN115474073B (en) | Method and device for intelligently switching picture layout | |
| CN116708389B (en) | Multi-terminal monitoring method, terminal equipment and readable storage medium for online examination | |
| CN109508280B (en) | Method, device and terminal for monitoring UI blockage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201109 Address after: 3 / F, building 2, No. 200, zhangheng Road, Pudong New Area, Shanghai Patentee after: Sundial Technology (Shanghai) Co., Ltd Address before: 215011 No. 131 Jin Shan Road, hi tech Zone, Jiangsu, Suzhou Patentee before: SUZHOU KEDA TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |