CN110753261B - Audio and video time delay testing method and device, computer equipment and storage medium - Google Patents

Audio and video time delay testing method and device, computer equipment and storage medium Download PDF

Info

Publication number
CN110753261B
CN110753261B CN201810818429.XA CN201810818429A CN110753261B CN 110753261 B CN110753261 B CN 110753261B CN 201810818429 A CN201810818429 A CN 201810818429A CN 110753261 B CN110753261 B CN 110753261B
Authority
CN
China
Prior art keywords
audio
video
test sequence
terminal
audio signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810818429.XA
Other languages
Chinese (zh)
Other versions
CN110753261A (en
Inventor
吴友宝
赵珺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201810818429.XA priority Critical patent/CN110753261B/en
Publication of CN110753261A publication Critical patent/CN110753261A/en
Application granted granted Critical
Publication of CN110753261B publication Critical patent/CN110753261B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application relates to an audio and video time delay testing method, an audio and video time delay testing device, a computer readable storage medium and computer equipment, wherein the method comprises the following steps: receiving a dual-channel audio signal, wherein the dual-channel audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a real-time acquisition playing interface of a first terminal by a photoelectric conversion device, the first terminal is used for playing when receiving video data corresponding to a first audio and video test sequence, the second audio signal is an audio signal corresponding to the first audio and video test sequence sent by the first terminal, and the video data and the audio signal corresponding to the first audio and video test sequence are synchronous; and determining the audio and video playing time delay corresponding to the first audio and video test sequence according to the first audio signal and the second audio signal. The scheme provided by the application can improve the accuracy of audio and video time delay test data in the audio and video playing process.

Description

Audio and video time delay testing method and device, computer equipment and storage medium
Technical Field
The present application relates to the field of computer technologies, and in particular, to an audio/video delay testing method and apparatus, a computer device, and a storage medium.
Background
With the development of computer technology, audio and video time delay is generated in the process from the beginning of audio and video acquisition to the last audio and video playing, and the audio and video time delay is one of important reference indexes for optimizing the process from the audio and video acquisition to the playing. However, at present, for a mode of evaluating audio/video delay, the most common mode is to manually count the receiving time of the audio/video received by the receiving end and the sending time of the audio/video sent by the sending end, and then use the time difference between the receiving time and the sending time as the audio/video delay between the receiving end and the sending end, but the accuracy of audio/video delay test data is easily low through manual statistics.
Disclosure of Invention
Therefore, it is necessary to provide an audio/video delay test method, an audio/video delay test device, a computer device, and a storage medium for solving the above technical problems, so that the accuracy of audio/video delay test data can be improved when audio/video delay between a receiving end and a transmitting end is tested.
An audio and video time delay test method comprises the following steps:
receiving a dual-channel audio signal, wherein the dual-channel audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a real-time acquisition playing interface of a first terminal by a photoelectric conversion device, the first terminal is used for playing when receiving video data corresponding to a first audio and video test sequence, the second audio signal is an audio signal corresponding to the first audio and video test sequence sent by the first terminal, and the video data and the audio signal corresponding to the first audio and video test sequence are synchronous;
and determining the audio and video playing time delay corresponding to the first audio and video test sequence according to the first audio signal and the second audio signal.
An audio and video time delay test system, the system comprising:
the computer equipment is respectively connected with the first terminal and the second terminal;
the photoelectric conversion device covers a playing interface of the first terminal and comprises a photosensitive resistor and a first audio line connected with the photosensitive resistor;
the computer equipment is connected with the photoelectric conversion device and the first terminal through a dual-channel audio line, the first terminal comprises a second audio line for outputting audio, and the first audio line and the second audio line are connected with the dual-channel audio line.
An audio and video time delay testing device, the device includes:
the device comprises a double-channel audio signal receiving module, a first terminal and a second terminal, wherein the double-channel audio signal receiving module is used for receiving a double-channel audio signal, the double-channel audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a real-time acquisition playing interface of the first terminal by a photoelectric conversion device, the first terminal is used for playing when receiving video data corresponding to a first audio and video test sequence, the second audio signal is an audio signal corresponding to the first audio and video test sequence sent by the first terminal, and the video data corresponding to the first audio and video test sequence and the audio signal are synchronous;
and the audio and video playing time delay determining module is used for determining the audio and video playing time delay corresponding to the first audio and video test sequence according to the first audio signal and the second audio signal.
A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps when executing the program of:
receiving a dual-channel audio signal, wherein the dual-channel audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a real-time acquisition playing interface of a first terminal by a photoelectric conversion device, the first terminal is used for playing when receiving video data corresponding to a first audio and video test sequence, the second audio signal is an audio signal corresponding to the first audio and video test sequence sent by the first terminal, and the video data and the audio signal corresponding to the first audio and video test sequence are synchronous;
and determining the audio and video playing time delay corresponding to the first audio and video test sequence according to the first audio signal and the second audio signal.
A computer-readable storage medium having stored thereon a computer program which, when executed by a processor, causes the processor to perform the steps of:
receiving a dual-channel audio signal, wherein the dual-channel audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a real-time acquisition playing interface of a first terminal by a photoelectric conversion device, the first terminal is used for playing when receiving video data corresponding to a first audio and video test sequence, the second audio signal is an audio signal corresponding to the first audio and video test sequence sent by the first terminal, and the video data and the audio signal corresponding to the first audio and video test sequence are synchronous;
and determining the audio and video playing time delay corresponding to the first audio and video test sequence according to the first audio signal and the second audio signal.
According to the audio and video time delay testing method, the device, the computer device and the storage medium, the computer device receives a two-channel audio signal, the two-channel audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a real-time acquisition playing interface of a first terminal through a photoelectric conversion device, the first terminal is used for playing when receiving video data corresponding to a first audio and video testing sequence, the second audio signal is an audio signal corresponding to the first audio and video testing sequence sent by the first terminal, the video data and the audio signal corresponding to the first audio and video testing sequence are synchronous, and finally the computer device determines the audio and video playing time delay corresponding to the first audio and video testing sequence according to the first audio signal and the second audio signal.
The photoelectric conversion device converts the optical signal corresponding to the first terminal playing interface into the first audio signal, wherein the photoelectric conversion device detects that the time point of the state change of the test image corresponding to the first audio/video test sequence is accurate when the first audio/video test sequence is played on the first terminal playing interface, so that the time point of converting the optical signal corresponding to the first terminal playing interface into the first audio signal is also accurate. And secondly, synthesizing a first audio signal obtained by conversion and a second audio signal corresponding to the acquired first audio and video test sequence through a two-channel audio line to obtain a two-channel audio signal, wherein the time of state change of the first audio signal and the second audio signal in the synthesized two-channel audio signal is accurate, so that the error of audio and video playing time delay obtained by calculation according to the first audio signal and the second audio signal is small, and the accuracy of audio and video playing time delay test is ensured. Furthermore, the audio and video playing time delay between the first terminal and the second terminal is detected through the photoelectric conversion device, the detection is irrelevant to the equipment of the first terminal and the second terminal and the illumination environment, cross-platform testing can be achieved, manual intervention is not needed, and the working efficiency of video playing time delay testing is improved. The hardware equipment of the photoelectric conversion device is simple and easy to use, and the cost is low.
Drawings
Fig. 1 is an application environment diagram of an audio and video delay testing method in an embodiment;
fig. 2 is a schematic flow chart of an audio/video time delay testing method in an embodiment;
fig. 3 is a schematic flow chart of a step of calculating audio/video playing time delay in one embodiment;
fig. 4 is a schematic diagram of an audio and video time delay testing method in an embodiment;
fig. 5 is a block diagram of a structure of an audio/video delay test system in an embodiment;
fig. 6 is a block diagram of a structure of an audio/video delay test system in another embodiment;
fig. 7 is a block diagram of an embodiment of an audio/video delay testing apparatus;
fig. 8 is a block diagram of a structure of an audio/video play delay determining module in another embodiment;
FIG. 9 is a block diagram of a computer device in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
Fig. 1 is an application environment diagram of an audio and video time delay testing method in an embodiment. Referring to fig. 1, the audio/video delay testing method is applied to an audio/video delay testing system. The audio and video time delay test system comprises a first terminal 110, a second terminal 120, a third terminal 130, computer equipment 140 and a photoelectric conversion device 150. The first terminal 110 and the second terminal 120 may be connected to the computer device 140 through a network connection or a Universal Serial Bus (USB) line, the photoelectric conversion device 150 includes a light-sensitive resistor and a first audio line connected to the light-sensitive resistor, the computer device is connected to the photoelectric conversion device 150 and the first terminal 110 through a two-channel audio line, the first terminal 110 includes a second audio line for outputting audio, and the first audio line and the second audio line are connected to the two-channel audio line, respectively. The first terminal 110, the second terminal 120, the third terminal 130 and the computer device 140 may specifically be desktop terminals or mobile terminals, and the mobile terminals may specifically be at least one of a mobile phone, a tablet computer, a notebook computer, and the like, wherein the third terminal 130 must include an image capturing device and an audio capturing device. Wherein the computer device 140 may also be implemented as a stand-alone server or as a server cluster comprising a plurality of servers.
Specifically, the first terminal 110 and the second terminal 120 may be connected to the computer device 140 through a network connection or a USB cable, respectively, the computer device 140 issues a control command to the second terminal 120, the second terminal 120 receives the control command and plays the first audio/video test sequence according to the control command, the image capturing device of the third terminal 130 covers the playing interface of the second terminal 120, the audio signal corresponding to the first audio/video test sequence played by the second terminal 120 is acquired by the audio acquisition device, the video data corresponding to the first audio/video test sequence played by the second terminal 120 is acquired by the image acquisition device, and sending the collected audio signal and video data to the first terminal 110, and the first terminal 110 receiving the video data and audio signal corresponding to the first audio/video test sequence and playing on a related playing interface. And the video data and the audio signals corresponding to the first audio and video test sequence are synchronous.
Further, the photoelectric conversion device 150 covering the playing interface of the first terminal 110 collects an optical signal corresponding to the playing interface of the first terminal 110 in real time, converts the collected optical signal into a first audio signal through a photosensitive resistor in the photoelectric conversion device 150, synthesizes the converted first audio signal and the received second audio signal to obtain a two-channel audio signal, and transmits the two-channel audio signal to the computer device 140 through a two-channel audio line. The computer device 140 receives the two-channel audio signal, and determines an audio/video playing time delay corresponding to the first audio/video test sequence according to a first audio signal and a second audio signal in the two-channel audio signal.
As shown in fig. 2, in one embodiment, an audio-video delay testing method is provided. The embodiment is mainly illustrated by applying the method to the computer device 140 in fig. 1. Referring to fig. 2, the audio/video time delay testing method specifically includes the following steps:
step 202, receiving a two-channel audio signal, where the two-channel audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a real-time acquisition playing interface of a first terminal by a photoelectric conversion device, the first terminal is used for playing when receiving video data corresponding to a first audio/video test sequence, the second audio signal is an audio signal corresponding to the first audio/video test sequence sent by the first terminal, and the video data and the audio signal corresponding to the first audio/video test sequence are synchronous.
The first audio and video test sequence is composed of a pre-constructed synchronous video test sequence with state change and an audio test sequence, the video test sequence is composed of a pre-constructed video picture with state change, the audio test sequence is composed of a pre-constructed audio frequency spectrum with state change, and the first audio and video test sequence can be stored in the second terminal in advance. The state change refers to a difference that can be detected by the photoelectric conversion device in the test image, for example, a video test sequence in the first audio/video test sequence may jump from a first state to a second state, or the video test sequence may jump from the second state to the first state, or an audio test sequence of the first audio/video test sequence may jump from a third state to a fourth state, or the audio test sequence may jump from the fourth state to the third state, and so on. The first state and the second state may be, but are not limited to, two states of a black-and-white state of a video test sequence in the first audio-video test sequence, and the third state and the fourth state may be, but are not limited to, two states of a high-frequency state and a low-frequency state of an audio test sequence in the first audio test sequence. If the video test sequence and the audio test sequence are not synchronously delayed, the video test sequence and the audio test sequence in the first audio and video test sequence are always kept synchronous. Similarly, since the video test sequence and the audio test sequence in the first audio/video test sequence have a synchronous relationship, the video data and the audio signal corresponding to the first audio/video test sequence are also synchronous. If the first audio/video test sequence does not have any audio/video playing time delay, the video data and the audio signal corresponding to the first audio/video test sequence are always kept synchronous.
The dual-channel audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by acquiring an optical signal corresponding to a playing interface of a first terminal in real time through a photoelectric conversion device and is obtained by converting the optical signal, the second audio signal is obtained by directly receiving audio data corresponding to a first audio and video test sequence sent by the first terminal, and the dual-channel audio signal is obtained by synthesizing the first audio signal and the second audio signal with different attributes. The synthesizing of the two-channel audio signal may specifically be copying the first audio signal into the second audio signal to mix into the two-channel audio signal, and the start time stamps of the first audio signal and the second audio signal are kept consistent. Alternatively, the second audio signal is copied into the first audio signal to be mixed into the two-channel audio signal, and the start time stamps of the first audio signal and the second audio signal are kept consistent. The binaural audio signal may be embodied by a synthesized pulse spectrogram formed by combining a first pulse spectrogram corresponding to the first audio signal and a second pulse spectrogram corresponding to the second audio signal. That is, the first impulse spectrogram corresponding to the first audio signal and the second impulse spectrogram corresponding to the second audio signal can be obtained from the synthesized impulse spectrogram corresponding to the two-channel audio signal.
The photoelectric conversion device is a device for converting an optical signal of a video test sequence in a first audio/video test sequence with a state change into a corresponding audio signal, and the photoelectric conversion device includes, but is not limited to, a light dependent resistor, a power supply for supplying power to the light dependent resistor, a first audio line connected with the light dependent resistor, and the like. The number of the photoresistors, the power supply and the audio lines in the photoelectric conversion device can be customized, and the photoelectric conversion device covers a playing interface of a first terminal which is playing video data corresponding to a video test sequence in a first audio and video test sequence.
Specifically, when the audio and video generated in the audio and video acquisition process does not need to be tested, the second terminal can directly send the video data and the second audio signal corresponding to the first audio and video test sequence to the first terminal, or when the audio and video generated in the audio and video acquisition process needs to be tested is delayed, the video data corresponding to the video test sequence in the first audio and video test sequence can be acquired through the image acquisition device of the third terminal, the second audio signal corresponding to the audio test sequence in the first audio and video test sequence can be acquired through the audio acquisition device of the third terminal, and then the third terminal sends the acquired video data and the second audio signal to the first terminal. The video data corresponding to the video test sequence in the first audio/video test sequence may be video data that has been subjected to video coding, or may be video data that has not been subjected to video coding. Likewise, the second audio signal corresponding to the audio test sequence in the first audio-video test sequence may be audio data that has been audio-encoded, or may be audio data that has not been audio-encoded. If the video data corresponding to the first audio/video test sequence or the second audio signal is the data subjected to audio/video coding, the audio/video playing delay is tested to include the audio/video playing delay generated in the audio/video coding process, and if the video data corresponding to the first audio/video test sequence or the second audio signal is the data not subjected to audio/video coding, the audio/video playing delay is tested not to include the audio/video playing delay generated in the audio/video coding process. When the first terminal receives the video data and the second audio signal corresponding to the first audio and video test sequence, the received video data and the second audio signal can be played through the playing interface.
Further, because the playing interface of the first terminal is playing the video data and the second audio signal corresponding to the first audio/video test sequence, and the video image frame on the playing interface of the first terminal also has a corresponding state change, then the photoelectric conversion device covering the playing interface of the first terminal playing the video data corresponding to the video test sequence in the first audio/video test sequence collects the optical signal corresponding to the playing interface in real time, specifically, the optical signal corresponding to the playing interface of the first terminal is collected in real time through a photoresistor in the photoelectric conversion device, and the photoresistor in the photoelectric conversion device converts the collected optical signal into the corresponding first audio signal. The video data corresponding to the video test sequence in the first audio/video test sequence played on the first terminal playing interface is a video image with a state change, so that the photoresistor in the photoelectric conversion device acquires a corresponding optical signal through the video image with the state change, and converts the optical signal into a first audio signal, namely, a corresponding pulse signal exists at a time point when the state change is performed each time. If the state change of the video test sequence in the first audio-video test sequence is changed from the first state to the second state at the time point T1, a corresponding pulse signal exists in the first audio signal converted by the photoresistor in the photoelectric conversion device at the time point T1.
Finally, the converted first audio signal and the received second audio signal are synthesized into a two-channel audio signal and then sent to the computer device, and the specific synthesis may be synthesis of the two-channel audio signal by means of a specific audio line, such as a lotus head audio line, or synthesis of the two-channel audio signal by means of software.
And 204, determining the audio and video playing time delay corresponding to the first audio and video test sequence according to the first audio signal and the second audio signal.
The audio/video playing time delay refers to the time delay brought in the process from the acquisition to the playing of the whole audio/video, and the time delay brought in the process from the acquisition to the playing of the whole audio/video includes but is not limited to the processes of camera acquisition, preprocessing, encoding, network transmission, decoding, postprocessing, screen rendering playing, speaker playing and the like. Specifically, after receiving a binaural audio signal, the computer device determines an audio/video play time delay corresponding to a first audio/video test sequence according to a first audio signal and a second audio signal in the binaural audio signal, where specifically, a first pulse signal and a second pulse signal respectively corresponding to the first audio signal and the second audio signal may be obtained first, and then a first target time point set in the first pulse signal and a second target time point set in the second pulse signal are obtained according to a preset rule, where the first target time point set includes at least one first target time point, and the second target time point set includes at least one second target time point. The preset rule may be customized, and may specifically be, but not limited to, taking all time points of state change in the first pulse signal as a first target time point, and taking all time points of state change in the second pulse signal as a second target time point.
And finally, calculating to obtain the audio and video playing time delay corresponding to the first audio and video test sequence according to the first target time point and the matched second target time point. The matching relationship between the first target time point and the second target time point can be customized, and the customization can be, but is not limited to, establishing the matching relationship between the first target time point where the state change occurs for the first time in the first audio signal and the second target time point where the state change occurs for the first time in the second audio signal, for example, a first target time point a is a time point at which the first audio signal makes a first transition from the first state to the second state, a first target time point b is a time point at which the first audio signal makes a first transition from the second state to the first state, and then a second target time point a matching the first target time point a is a time point at which the second audio signal makes a first transition from the third state to the fourth state, the second target point in time b, which matches the first target point in time b, is a point in time at which the second audio signal first transitions from the fourth state to the third state.
In one embodiment, if the first target time point set includes only one first target time point, a second target time point matched with the first target time point is obtained from the second target time point set, and then the difference value between the first target time point and the second target time point is directly used as the audio/video playing time delay corresponding to the first audio/video test sequence.
In another embodiment, if the first target time point set includes a plurality of first target time points, first obtaining second target time points matched with each first target time point in the first target time point set from the second target time point set, then calculating a time difference between each first target time point and the matched second target time point, obtaining an audio/video playing time difference corresponding to each first target time point, then calculating an audio/video playing time delay corresponding to the first audio/video test sequence according to the audio/video playing time difference corresponding to each first target time point, and finally obtaining the audio/video playing time delay corresponding to the first audio/video test sequence. The calculation mode for calculating the audio/video playing time delay corresponding to the first audio/video test sequence can be customized, and the customization can be, but is not limited to, calculating an average value or calculating a variance, and the like. For example, the playing time of the first audio/video test sequence is 10s, and the time point at which the first audio signal jumps from the first state to the second state is TS1And the point in time at which the first audio signal transitions from the second state to the first state is TS2And T isS1And TS25 seconds apart. Then, the first target time point T is obtained from the second target time point setS1、TS2The matched second target time points are respectively TR1And TR2Calculating the time difference value between the first target time point and the matched second target time point as delta T1＝TS1-TR1And Δ T2＝TS2-TR2If the audio/video playing time delay corresponding to the first audio/video test sequence is (delta T)1+△T2)/2。
According to the audio and video time delay testing method, computer equipment receives a two-channel audio signal, the two-channel audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a real-time acquisition playing interface of a first terminal through a photoelectric conversion device, the first terminal is used for playing when receiving video data corresponding to a first audio and video testing sequence, the second audio signal is an audio signal corresponding to the first audio and video testing sequence sent by the first terminal, the video data and the audio signal corresponding to the first audio and video testing sequence are synchronous, and finally the computer equipment determines the audio and video playing time delay corresponding to the first audio and video testing sequence according to the first audio signal and the second audio signal.
The photoelectric conversion device converts the optical signal corresponding to the first terminal playing interface into the first audio signal, wherein the photoelectric conversion device detects that the time point of the state change of the test image corresponding to the first audio/video test sequence is accurate when the first audio/video test sequence is played on the first terminal playing interface, so that the time point of converting the optical signal corresponding to the first terminal playing interface into the first audio signal is also accurate. And secondly, synthesizing a first audio signal obtained by conversion and a second audio signal corresponding to the acquired first audio and video test sequence through a two-channel audio line to obtain a two-channel audio signal, wherein the time of state change of the first audio signal and the second audio signal in the synthesized two-channel audio signal is accurate, so that the error of audio and video playing time delay obtained by calculation according to the first audio signal and the second audio signal is small, and the accuracy of audio and video playing time delay test is ensured. Furthermore, the audio and video playing time delay of the first terminal and the second terminal is detected through the photoelectric conversion device, the detection is irrelevant to the equipment of the first terminal and the second terminal and the illumination environment, cross-platform testing can be achieved, manual intervention is not needed, and the working efficiency of video playing time delay testing is improved. The hardware equipment of the photoelectric conversion device is simple and easy to use, and the cost is low.
In one embodiment, the first audio/video test sequence includes a video test sequence and a corresponding audio test sequence, the video test sequence and the audio test sequence have a synchronization relationship, the state of a test image corresponding to the video test sequence includes a first state and a second state, a luminance difference between image luminance of the first state and image luminance of the second state exceeds a first preset threshold, the state of the test image changes periodically, the state of a test audio spectrum corresponding to the audio test sequence includes a third state and a fourth state, a height difference between a spectral height of the third state and a spectral height of the fourth state exceeds a second preset threshold, and the state of the test audio spectrum changes periodically.
The first audio and video test sequence is composed of a pre-constructed synchronous video test sequence with state change and an audio test sequence, the video test sequence is composed of a pre-constructed video picture with state change, and the audio test sequence is composed of a pre-constructed audio frequency spectrum with state change and can be stored in the second terminal in advance. The video test sequence and the corresponding audio test sequence in the first audio and video test sequence have a synchronous relationship, that is, the start timestamps of the video test sequence and the corresponding audio test sequence are the same. The states of the test images corresponding to the video test sequence are changed, the states of the test images corresponding to the video test sequence include, but are not limited to, a first state and a second state, and a brightness difference between the image brightness of the first state and the image brightness of the second state exceeds a first preset threshold. That is, the image brightness of the first state may be greater than the image brightness of the second state, or the image brightness of the first state may be less than the image brightness of the second state. For example, the first state and the second state are a black state and a white state, respectively. The first preset threshold value can be set according to actual requirements.
Further, the state of the test image corresponding to the video test sequence changes periodically, where the periodic change refers to that the first state and the second state of the test image corresponding to the video test sequence alternate regularly, and the presentation duration of the first state and the second state of the test image corresponding to the video test sequence may be specifically set by a user, where the user may be, but is not limited to, that the first state and the second state present the same duration interval, or that the duration interval of presentation of the first state is greater than the duration interval of presentation of the second state, or that the duration interval of presentation of the second state is greater than the duration interval of presentation of the first state, and so on.
In an embodiment, the presentation durations of the first state and the second state of the test image corresponding to the video test sequence are the same time interval, and if the presentation durations of the first state and the second state are both 5 seconds, the continuous playing time of the test image corresponding to the video test sequence is 5 minutes, and the continuous playing time of the test image is 5 minutes, the test image is converted into units of seconds, that is, the continuous playing time of the test image is 300 seconds, then the state change of the test image corresponding to the video test sequence is a periodic state change performed every 5 seconds, 60 times of the first state and 60 times of the second state occur within 300 seconds of the continuous playing time of the test image, and the first state and the second state of the test image are periodically and alternately converted every 5 seconds.
The test audio frequency spectrum corresponding to the audio test sequence is a spectrogram for showing state change of the audio test sequence, and the state of the test audio frequency spectrum corresponding to the audio test sequence is also changed. The test audio frequency spectrum corresponding to the audio test sequence includes, but is not limited to, a third state and a fourth state, and a height difference corresponding to a spectral height of the third state and a spectral height of the fourth state exceeds a second preset threshold. The spectral height represents the high-low state of the audio frequency, the third state may be a high-frequency state with a frequency higher than a certain preset threshold as the third state, and similarly, the fourth state may be a low-frequency state with a frequency lower than a certain preset threshold as the fourth state. The second preset threshold and the threshold for judging the frequency can be set according to actual requirements. Wherein, the audio test sequence can be a single tone audio signal which is not more than 8KHZ and is alternately high and low superimposed on the basis of human voice. The monophonic audio signal refers to a pure sinusoidal signal with a single frequency, and the frequency of the monophonic audio signal is usually continuously fixed, for example, a spectrum signal of the monophonic 5000HZ lasting for 300ms is the monophonic audio signal.
Further, the state of the test audio spectrum corresponding to the audio test sequence is periodically changed, where the periodic change refers to that the third state and the fourth state of the test audio spectrum corresponding to the audio test sequence are regularly and alternately changed, and the presentation duration of the third state and the fourth state of the test audio spectrum corresponding to the audio spectrum may be specifically set by a user, where the user-defined setting may be, but is not limited to, that the third state and the fourth state present the same duration interval, or the duration interval of presentation of the third state is greater than the duration interval of presentation of the fourth state, or the duration interval of presentation of the fourth state is greater than the duration interval of presentation of the third state, and so on.
In one embodiment, the test audio to which the audio test sequence corresponds is a monophonic frequency audio.
The audio test sequence is composed of a pre-constructed audio spectrum with state change, specifically but not limited to constructed single tone frequency audio, for example, the audio test sequence may be a single tone audio signal which is superposed on human voice and has a frequency not exceeding 8KHZ and with alternate high and low frequencies. The monophonic frequency audio is a pure sinusoidal signal of a single frequency, and the frequency of the monophonic audio signal is usually continuously fixed, for example, a spectrum signal of the monophonic 5000HZ lasting for 300ms is the monophonic audio signal. In order to finally identify the audio signal corresponding to the audio test sequence in the first audio and video test sequence and ensure the accuracy of audio and video playing delay data, the test audio corresponding to the audio test sequence is constructed into single-tone frequency audio with alternate frequencies when the audio test sequence is constructed.
In one embodiment, the audio and video data corresponding to the first audio and video test sequence is audio and video data sent by the third terminal, and the third terminal is used for acquiring an interface of the second terminal for playing the first audio and video test sequence in real time, obtaining a second audio and video test sequence corresponding to the first audio and video test sequence, and sending the audio and video data corresponding to the second audio and video test sequence to the first terminal in real time.
Specifically, the second terminal stores the first audio/video test sequence in a memory of the second terminal in advance, and if the computer device issues the control instruction to the second terminal, the second terminal receives the control instruction issued by the computer device, and can play the first audio/video test sequence stored in advance on the playing interface according to the control instruction. Or the playing time of the first audio and video test sequence playing is preset in the related configuration file of the first audio and video test sequence in the second terminal, and when the playing time is up, the first audio and video test sequence can automatically play the first audio and video test sequence within the set playing time.
The image acquisition device of the third terminal covers the playing interface of the second terminal, and when the first audio and video test sequence is played by the second terminal, the third terminal acquires images in real time through the image acquisition device and the audio acquisition device so as to obtain a second audio and video test sequence corresponding to the first audio and video test sequence. The image capturing device may be, but is not limited to, a camera, such as a USB digital camera. The audio capture device may be, but is not limited to, a microphone or the like.
And further, the third terminal sends the acquired audio and video data corresponding to the second audio and video test sequence to the first terminal in real time. The audio/video data corresponding to the second audio/video test sequence may be encoded audio/video data, or may be uncoded audio/video data. And finally, when the first terminal receives the audio and video data corresponding to the second audio and video test sequence, playing the audio and video data corresponding to the received second audio and video test sequence on a related playing interface of the first terminal, acquiring the first audio and video test sequence played by the second terminal through the third terminal to obtain the corresponding second audio and video test sequence, and showing that the finally calculated audio and video playing delay comprises the delay brought by the acquisition of the camera.
In an embodiment, as shown in fig. 3, determining an audio/video playing time delay corresponding to a first audio/video test sequence according to a first audio signal and a second audio signal includes:
step 302, a first pulse signal corresponding to the first audio signal is obtained, and a first target time point set is determined according to the first pulse signal, where the first target time point set includes at least one first target time point.
The pulse signal is a pulse spectrogram corresponding to the first audio signal, and the time point of each state change in the first audio signal can be known from the pulse spectrogram corresponding to the first audio signal. The pulse spectrogram can be obtained by converting a time domain waveform diagram of the first audio signal, and the first target time point set can be further identified from the first pulse signal through a sliding window. Specifically, a time domain waveform diagram of a first audio signal is first converted to obtain a first pulse signal corresponding to the first audio signal, that is, a pulse spectrogram diagram corresponding to the first audio signal, and then a first target time point set is identified from the first pulse signal through a sliding window, where the first target time point set includes at least one first target time point, the first target time point is a time point corresponding to a state change occurring in the pulse spectrogram diagram corresponding to the first audio signal, and if the state of the pulse spectrogram diagram corresponding to the first audio signal includes a first state and a second state, the first target time point may be a time point at which a transition from the first state to the second state occurs in the pulse spectrogram diagram corresponding to the first audio signal, or the first target time point may be a time point at which a transition from the second state to the first state occurs in the pulse spectrogram diagram corresponding to the first audio signal, and taking the time point of the pulse spectrogram corresponding to the first audio signal jumping from the first state to the second state and the time point of the pulse spectrogram corresponding to the first audio signal jumping from the second state to the first state as first target time points, thereby forming a first target time point set.
If the first target time point set includes at least one first target time point, the first target time point refers to all time points at which a state change occurs in the pulse spectrogram corresponding to the first audio signal, that is, all time points corresponding to the time at which the state change occurs in the pulse spectrogram corresponding to the first audio signal constitute the first target time point set. If the first target time point a is a time point at which the first pulse signal corresponding to the first audio signal jumps from the first state to the second state, the first target time point b is a time point at which the first pulse signal corresponding to the first audio signal jumps from the second state to the first state, the first target time point c is a time point at which the first pulse signal corresponding to the first audio signal jumps from the first state to the second state, and the first target time point d is a time point at which the first pulse signal corresponding to the first audio signal jumps from the second state to the first state. The first target time a, the first target time point b, the first target time point c and the first target time point d form a first target time point set.
Step 304, a second pulse signal corresponding to the second audio signal is obtained, and a second target time point set is determined according to the second pulse signal, where the second target time point set includes at least one second target time point.
The second audio signal is an audio signal corresponding to the first audio/video test sequence sent by the first terminal, the second pulse signal corresponding to the second audio signal is a pulse spectrogram corresponding to a time domain waveform diagram of the second audio signal, a time point at which each state in the second audio signal changes can be known from the pulse spectrogram, and a second target time point set can be identified from the second pulse signal corresponding to the second audio signal through fourier transform. Specifically, a second pulse signal corresponding to the second audio signal, that is, a pulse spectrogram corresponding to the second audio signal, is obtained by first converting according to a time domain waveform diagram of the second audio signal. And identifying a second target time point set from a second pulse signal corresponding to the second audio signal through fourier transform, where the second target time point set includes at least one second target time point, and the second target time point is a time point corresponding to a state change in a pulse spectrogram corresponding to the second audio signal, and if the state of the pulse spectrogram corresponding to the second audio signal includes a third state and a fourth state, the second target time point may be a time point at which a transition from the third state to the fourth state occurs in the corresponding pulse spectrum in the second audio signal, or the second target time point may be a time point at which a transition from the fourth state to the third state occurs in the corresponding pulse spectrum in the second audio signal, or the time point at which a transition from the third state to the fourth state occurs in the corresponding pulse spectrum in the second audio signal and the time point at which a transition from the fourth state to the third state occurs in the corresponding pulse spectrum in the second audio signal The intermediate points are all used as second target time points, so that a second target time point set is formed.
If the second target time point set includes at least one second target time point, the second target time point refers to all time points at which a state change occurs in the pulse spectrogram corresponding to the second audio signal, that is, all time points corresponding to the time at which the state change occurs in the pulse spectrogram corresponding to the second audio signal form the second target time point set. If the second target time point a is a time point at which the second pulse signal corresponding to the second audio signal jumps from the third state to the fourth state, the second target time point b is a time point at which the second pulse signal corresponding to the second audio signal jumps from the fourth state to the third state, the second target time point c is a time point at which the second pulse signal corresponding to the second audio signal jumps from the third state to the fourth state, and the second target time point d is a time point at which the second pulse signal corresponding to the second audio signal jumps from the fourth state to the third state. The second target time a, the second target time point b, the second target time point c and the second target time point d form a second target time point set.
And step 306, calculating to obtain the audio and video playing time delay according to the matched first target time point and the second target time point.
Specifically, after a first target time point set and a second target time point set are obtained, second target time points matched with all first target time points in the first target time point set are obtained from the second target time point set according to a preset matching rule, and finally audio and video playing time delay is calculated according to the matched first target time points and the matched second target time points. Wherein, the matching rule for obtaining the matched first target time point and second target time point is self-defined, the self-definition can be, but not limited to, establishing a matching relationship between a first target time point at which a state change occurs for the first time in the first audio signal and a second target time point at which a state change occurs for the first time in the first audio signal, and so on, establishing a matching relationship, such as a first time jump from the first state to the second state at the first target time point T1 in the first audio signal, a first time jump from the second state to the first state at the first target time point T2 in the first audio signal, a first time jump from the third state to the fourth state at the second target time point T3 in the second audio signal, a first time jump from the fourth state to the third state at the second target time point T4 in the second audio signal, and the second target time point T3 can be used as a matching time point of the first target time point T1 according to the preset matching rule, the second target time point T4 is taken as a matching time point of the first target time point T2.
As shown in fig. 4, fig. 4 is a schematic diagram illustrating an audio-video time delay testing method in an embodiment, where a pulse spectrogram in fig. 4 includes a first pulse signal corresponding to a first audio signal and a second pulse signal corresponding to a second audio signal, and a first target time point T in fig. 4RV1Is the time point when the first pulse signal corresponding to the first audio signal jumps from the first state to the second state for the first time, and the first target time point TRV2Is the time point when the first pulse signal corresponding to the first audio signal jumps from the second state to the first state for the first time, and the second target time point TRA1Is a first target time point TRV1Is the time point at which the second pulse signal corresponding to the second audio signal first jumps from the third state to the fourth state, and the second target time point TRA2Is a first target time point TRV2Is the point in time at which the first pulse corresponding to the second audio signal transitions from the fourth state to the third state.
And further, calculating to obtain the audio and video playing time delay generated in the whole audio and video playing process according to the first target time point and the matched second target time point. Wherein, the specific calculation mode for calculating the audio/video playing time delay can be customizedThe customization may be, but is not limited to, directly taking a time difference value between the matching target time points as an audio/video playing delay, or taking an average value of the time difference values between the matching target time points as the audio/video playing delay, or taking a variance value of the time difference values between the matching target time points as the audio/video playing delay, or the like, for example, the calculation manner of the audio/video playing delay shown in fig. 4 may be, but is not limited to, Δ TAV1＝TRV1-TRA1Or is Δ TAV2＝TRV2-TRA2Is either Δ TAV＝(ΔTAV1+ΔTAV2)/2。
In one embodiment, the audio and video time delay testing method further includes: and sending an audio and video test sequence playing instruction to the second terminal, acquiring initial playing time corresponding to the first audio and video test sequence played by the second terminal according to the audio and video test sequence playing instruction, and modifying the current time of the terminal according to the initial playing time.
Specifically, in order to ensure the accuracy of the finally calculated audio/video playing delay, the time of the second terminal and the time of the computer device need to be kept consistent at the beginning, so that when an audio/video test sequence playing instruction is sent to the second terminal, the initial playing time corresponding to the first audio/video test sequence played by the second terminal according to the audio/video test sequence playing instruction is obtained, and then the current time of the local terminal of the computer device is modified according to the obtained initial playing time. The time mode of modifying the local end of the computer device may be, but is not limited to, modifying the current time directly on a relevant time modification interface of the local end or modifying the current time through a relevant physical control of the local end, and the like.
If the second terminal plays the pre-installed first audio and video test sequence according to the audio and video test sequence playing instruction issued by the computer device, because the video test sequence in the first audio and video test sequence is actually a video picture with state change, when the first audio and video test sequence is played, the initial playing time for playing the first audio and video test sequence is 18:00, and the current time of the local end of the computer device is 17:58, the current time 17:58 of the local end of the computer device is modified to 18:00 through a relevant time modification interface of the local end of the computer device, or the current time 17:58 of the local end of the computer device is modified to 18:00 through a relevant physical control of the local end of the computer device. Because the computer equipment and the second terminal keep time consistency, the accuracy of the finally calculated audio and video playing time delay can be ensured.
In a specific embodiment, as shown in fig. 4, fig. 4 shows a schematic diagram of an audio and video delay testing method in an embodiment, an entire audio and video playing process includes an acquisition process, a preprocessing process, an encoding process, a network transmission process, a decoding process, a post-processing process, a playing process, and the like, where the acquisition process includes microphone acquisition and camera acquisition, the playing process includes speaker playing and screen playing, and if a second terminal receives a control instruction sent by a computer device and plays a first audio and video test sequence according to the control instruction, the first audio and video test sequence is composed of a pre-constructed synchronous video test sequence and audio test sequence with state change, and thus the first audio and video test sequence includes a video test sequence and an audio test sequence. And when the second terminal plays the test image corresponding to the video test sequence, the state change of the playing interface is cross-hopped between the first state and the second state. The third terminal collects the video signal and the second audio signal on the playing interface of the second terminal through the image collecting device and the audio device, sends the video signal and the second audio signal to the first terminal, and then the first terminal sends the second audio signal to the dual-channel audio line through the connected second audio line. The photoelectric conversion device covered on the first terminal collects the optical signal of the playing interface of the first terminal in real time, converts the optical signal to obtain a first audio signal, and the photoresistor sends the first audio signal to the two-channel audio line through the connected first audio line. And finally, the two-channel audio line synthesizes the first audio signal and the received second audio signal to obtain a two-channel audio signal, and sends the two-channel audio signal to the computer equipment.
Double sound received by computer equipmentThe channel audio signal may be embodied by a pulse spectrogram, and the pulse spectrogram illustrated in fig. 4 is an image that embodies a binaural audio signal, where the binaural audio signal includes a pulse signal corresponding to the first audio signal and a pulse signal corresponding to the second audio signal. First target time point T in FIG. 4RV1Is the time point when the first pulse signal corresponding to the first audio signal jumps from the first state to the second state for the first time, and the first target time point TRV2Is the time point when the first pulse signal corresponding to the first audio signal jumps from the second state to the first state for the first time, and the second target time point TRA1Is a first target time point TRV1Is the time point at which the second pulse signal corresponding to the second audio signal first jumps from the third state to the fourth state, and the second target time point TRA2Is a first target time point TRV2Is the point in time at which the first pulse corresponding to the second audio signal transitions from the fourth state to the third state.
And finally, calculating to obtain the audio and video playing time delay generated in the whole audio and video playing process according to the first target time point and the matched second target time point. The specific calculation method for calculating the audio/video playing delay may be self-defined, the self-definition may be, but is not limited to, directly taking the time difference between the matching target time points as the audio/video playing delay, or taking the average value of the time differences between the matching target time points as the audio/video playing delay, or taking the variance value of the time differences between the matching target time points as the audio/video playing delay, and the like, for example, the calculation method for calculating the audio/video playing delay shown in fig. 4 may be, but is not limited to, Δ TAV1＝TRV1-TRA1Or is Δ TAV2＝TRV2-TRA2Is either Δ TAV＝(ΔTAV1+ΔTAV2)/2。
In a specific embodiment, an audio and video time delay testing method is provided, which specifically includes the following steps:
step 502, the computer device sends an audio/video test sequence playing instruction to the second terminal, and obtains an initial playing time corresponding to the first audio/video test sequence played by the second terminal according to the audio/video test sequence playing instruction.
And step 504, the computer device modifies the current time of the local terminal through a time modification interface related to the local terminal according to the obtained starting playing time, or modifies the current time of the local terminal through a physical control related to the local terminal of the computer device, so that the time of the second terminal is consistent with that of the computer device.
Step 506, the second terminal plays the received first audio/video test sequence on the relevant playing interface according to the audio/video test sequence playing instruction issued by the computer device, the first audio and video test sequence comprises a video test sequence and a corresponding audio test sequence, the video test sequence and the audio test sequence have a synchronous relation, the state of a test image corresponding to the video test sequence comprises a first state and a second state, the brightness difference between the image brightness of the first state and the image brightness of the second state exceeds a first preset threshold value, the state of the test image is changed periodically, the state of a test audio frequency spectrum corresponding to the audio test sequence comprises a third state and a fourth state, the height difference between the frequency spectrum height of the third state and the frequency spectrum height of the fourth state exceeds a second preset threshold value, and the state of the test audio frequency spectrum is changed periodically.
And step 508, covering the playing interface of the second terminal by an image acquisition device of the third terminal, acquiring the interface of the second terminal for playing the first audio and video test sequence in real time, further obtaining a second audio and video test sequence corresponding to the first audio and video test sequence, and then sending video data corresponding to the second audio and video test sequence to the first terminal in real time.
Step 510, the first terminal receives video data corresponding to the second audio/video test sequence and plays the video data on a related playing interface and receives a second audio signal corresponding to an audio test sequence in the second audio/video test sequence sent by the third terminal, a photoresistor in a photoelectric conversion device covering the playing interface of the first terminal collects an optical signal corresponding to the playing interface of the first terminal in real time and converts the optical signal into a first audio signal, and finally the converted first audio signal and the received second audio signal are synthesized into a two-channel audio signal through a two-channel audio line, and then the two-channel audio signal is transmitted to a sound card of the computer device.
Step 512, the computer device receives a two-channel audio signal, the two-channel audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a real-time acquisition playing interface of the first terminal by the photoelectric conversion device, the first terminal is used for playing when receiving video data corresponding to a first audio/video test sequence, the second audio signal is an audio signal corresponding to the first audio/video test sequence sent by the first terminal, and the video data and the audio signal corresponding to the first audio/video test sequence are synchronous.
And 514, the computer device determines an audio/video playing time delay corresponding to the first audio/video test sequence according to the first audio signal and the second audio signal.
Step 514a, obtaining a first pulse signal corresponding to the first audio signal, and determining a first target time point set according to the first pulse signal, where the first target time point set includes at least one first target time point.
Step 514b, obtaining a second pulse signal corresponding to the second audio signal, and determining a second target time point set according to the second pulse signal, where the second target time point set includes at least one second target time point.
And 514c, calculating the audio and video playing time delay according to the matched first target time point and the second target time point.
It should be understood that, although the steps in the above-described flowcharts are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of the steps in the above-described flowcharts may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or the stages is not necessarily sequential, but may be performed alternately or alternatingly with other steps or at least a portion of the sub-steps or stages of other steps.
As shown in fig. 5, in one embodiment, there is provided an audio-video latency testing system 600, comprising: the computer device 606 is connected to the first terminal 602 and the second terminal 604, the photoelectric conversion device 608 covers a playing interface of the first terminal 602, the photoelectric conversion device 608 includes a photosensitive resistor 608a and a first audio line 608b connected to the photosensitive resistor, the computer device 606 is connected to the photoelectric conversion device 608 and the first terminal 602 through a two-channel audio line 610, the first terminal 602 includes a second audio line 608c for outputting audio, and the first audio line 608b and the second audio line 608c are connected to the two-channel audio line 610.
In one embodiment, the computer device is connected to the first terminal and the second terminal respectively through a universal serial bus or a wireless network.
Specifically, the audio/video delay testing system 600 includes a first terminal 602, a second terminal 604, a computer device 606, and an optical-to-electrical conversion apparatus 608, where the optical-to-electrical conversion apparatus 608 includes a light-sensitive resistor 608a and a first audio line 608b connected to the light-sensitive resistor 608a, the computer device 606 is connected to the optical-to-electrical conversion apparatus 608 and the first terminal 602 through a two-channel audio line 610, the first terminal 602 includes a second audio line 608c for outputting audio, and the first audio line 608b and the second audio line 608c are connected to the two-channel audio line 610. The second terminal 604 comprises a processor and a memory, the computer device 606 comprises a processor and a sound card, the first terminal 602 and the second terminal 604 are respectively connected with the computer device 606 through a universal serial bus or a wireless network, and the processor in the computer device 606 can issue an audio/video test sequence playing instruction to the second terminal 604 through a Universal Serial Bus (USB) or a wireless network. The second terminal 604 receives the audio/video test sequence playing instruction, and plays a first audio/video test sequence stored in advance on a playing interface of the second terminal 604 according to the audio/video test sequence playing instruction, or can directly play the first audio/video test sequence at a preset playing time by using a first audio/video test sequence configuration file stored in a memory of the second terminal 604.
Further, the second terminal 604 may also directly send the video data corresponding to the first audio/video test sequence to the first terminal 602. After receiving the video data corresponding to the first audio/video test sequence, the first terminal 602 plays the video data corresponding to the first audio/video test sequence on the play interface. The photoresistor 608a of the optoelectronic conversion device 608 covering the playing interface of the first terminal 602 collects the optical signal corresponding to the playing interface of the first terminal 602 in real time, and the photoresistor 608a converts the collected optical signal into a first audio signal, and transmits the first audio signal to the two-channel audio line 610 through the first audio line 608b connected to the photoresistor. Simultaneously, the second terminal 604 sends a second audio signal corresponding to the first audio/video test sequence to the first terminal 602, and the first terminal 602 transmits the received second audio signal to the two-channel audio line 610 through a second audio line 608c connected to the two-channel audio line 610. Secondly, the two-channel audio line 610 synthesizes the first audio signal and the second audio signal to obtain a two-channel audio signal, and finally the two-channel audio line 610 sends the synthesized two-channel audio signal to the sound card of the computer device 606. The photoelectric conversion device 608 is connected to the computer 606 via a two-channel audio line 610.
Finally, after receiving the two-channel audio signal, the computer device 606 determines an audio/video playing time delay corresponding to the first audio/video test sequence according to the first audio signal and the second audio signal in the two-channel audio signal.
In one embodiment, as shown in fig. 6, the audio/video delay testing system 600 further includes a third terminal 612, where the third terminal 612 includes an image capture device and an audio capture device, and the image capture device is overlaid on the playing interface of the second terminal.
Specifically, if the second terminal 604 does not directly send the video data corresponding to the first audio/video test sequence to the first terminal 602, the audio/video delay test system 600 further includes a third terminal 612, where the third terminal 612 includes an image acquisition device and an audio acquisition device, and the image acquisition device covers a playing interface of the second terminal 604. The playing interface of the second terminal 604 is playing a test image corresponding to the video test sequence in the first audio/video test sequence, and the third terminal 612 acquires the interface of the second terminal 604 playing the first audio/video test sequence through the image acquisition device, so as to obtain a second audio/video test sequence corresponding to the first audio/video test sequence. The third terminal 612 then sends the video data and the audio signal corresponding to the second audio/video test sequence to the first terminal 602 in real time. The first terminal 602 receives the video data and the audio signal corresponding to the second audio/video test sequence and then plays the video data and the audio signal on the relevant playing interface, and the photoresistor 608a in the photoelectric conversion device 608 covering the playing interface of the first terminal 602 collects the optical signal corresponding to the playing interface of the first terminal 602 in real time, and the photoresistor 608a converts the collected optical signal into the first audio signal. The third terminal 612 acquires, by the audio acquisition device, a second audio signal corresponding to the first audio/video test sequence played by the second terminal while acquiring, by the image acquisition device, an interface of the second terminal 604 playing the first audio/video test sequence.
Next, the first terminal 602 transmits the second audio signal to the two-channel audio line 610 through the connected second audio line 608c, and the photo-resistor in the photoelectric conversion device 608 transmits the converted first audio signal to the two-channel audio line 610 through the connected first audio line 608 b. Further, the two-channel audio line 610 synthesizes the first audio signal and the second audio signal to obtain a two-channel audio signal, and finally the two-channel audio line 610 sends the synthesized two-channel audio signal to the sound card of the computer device 606.
Finally, after receiving the two-channel audio signal, the computer device 606 determines an audio/video playing time delay corresponding to the first audio/video test sequence according to the first audio signal and the second audio signal in the two-channel audio signal.
In one embodiment, as shown in fig. 7, there is provided an audio-video latency testing apparatus 700, comprising:
a binaural audio signal receiving module 702, configured to receive a binaural audio signal, where the binaural audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting, by a photoelectric conversion device, an optical signal corresponding to a real-time acquisition first terminal playing interface, the first terminal is configured to play when receiving video data corresponding to a first audio/video test sequence, the second audio signal is an audio signal corresponding to the first audio/video test sequence sent by the first terminal, and the video data and the audio signal corresponding to the first audio/video test sequence are synchronous;
and the audio/video playing delay determining module 704 is configured to determine an audio/video playing delay corresponding to the first audio/video test sequence according to the first audio signal and the second audio signal.
In one embodiment, as shown in fig. 8, the audio/video playback delay determining module 704 includes:
the first target time point set obtaining unit 704a is configured to obtain a first pulse signal corresponding to the first audio signal, and determine a first target time point set according to the first pulse signal, where the first target time point set includes at least one first target time point.
The second target time point set obtaining unit 704b is configured to obtain a second pulse signal corresponding to the second audio signal, and determine a second target time point set according to the second pulse signal, where the second target time point set includes at least one second target time point.
And the audio and video playing time delay calculating unit 704c is used for calculating the audio and video playing time delay according to the matched first target time point and the second target time point.
In one embodiment, the first audio/video test sequence comprises a video test sequence and a corresponding audio test sequence, the video test sequence and the audio test sequence have a synchronous relationship, the state of a test image corresponding to the video test sequence comprises a first state and a second state, the brightness difference between the image brightness of the first state and the image brightness of the second state exceeds a first preset threshold, and the state of the test image changes periodically; the states of the test audio frequency spectrum corresponding to the audio test sequence comprise a third state and a fourth state, the height difference corresponding to the spectral height of the third state and the spectral height of the fourth state exceeds a second preset threshold, and the states of the test audio frequency spectrum are periodically changed.
In one embodiment, the test audio to which the audio test sequence corresponds is a monophonic frequency audio.
In one embodiment, the audio and video data corresponding to the first audio and video test sequence is audio and video data sent by the third terminal, and the third terminal is used for acquiring an interface of the second terminal for playing the first audio and video test sequence in real time, obtaining a second audio and video test sequence corresponding to the first audio and video test sequence, and sending the audio and video data corresponding to the second audio and video test sequence to the first terminal in real time.
In an embodiment, the audio/video delay testing apparatus 700 is further configured to send an audio/video test sequence playing instruction to the second terminal, obtain an initial playing time corresponding to the second terminal playing the first audio/video test sequence according to the audio/video test sequence playing instruction, and modify the current time of the second terminal according to the initial playing time.
FIG. 9 is a diagram illustrating an internal structure of a computer device in one embodiment. The computer device may specifically be the computer device 140 in fig. 1. As shown in fig. 9, the computer apparatus includes a processor, a memory, a network interface, an input device, and a display screen connected through a system bus. Wherein the memory includes a non-volatile storage medium and an internal memory. The nonvolatile storage medium of the computer device stores an operating system and also stores a computer program, and when the computer program is executed by a processor, the processor can realize the audio and video time delay testing method. The internal memory may also store a computer program, and when the computer program is executed by the processor, the processor may execute the audio/video delay testing method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 9 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In an embodiment, the audio/video delay testing apparatus provided in the present application may be implemented in a form of a computer program, and the computer program may be run on a computer device as shown in fig. 9. The memory of the computer device may store various program modules constituting the audio/video delay testing apparatus, such as a binaural audio signal receiving module and an audio/video playing delay determining module shown in fig. 7. The computer program formed by the program modules enables the processor to execute the steps in the audio and video time delay testing method of the embodiments of the present application described in the present specification.
For example, the computer device shown in fig. 9 may execute receiving of a binaural audio signal by a binaural audio signal receiving module in the audio/video time delay test apparatus shown in fig. 7, where the binaural audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal, which is acquired by a photoelectric conversion apparatus and corresponds to a playing interface of a first terminal in real time, the first terminal is configured to play when receiving video data corresponding to a first audio/video test sequence, the second audio signal is an audio signal corresponding to the first audio/video test sequence sent by the first terminal, and the video data and the audio signal corresponding to the first audio/video test sequence are synchronous. The computer equipment can determine the audio and video playing time delay corresponding to the first audio and video test sequence according to the first audio signal and the second audio signal through the audio and video playing time delay determining module.
In one embodiment, a computer device is presented, comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the steps of: receiving a dual-channel audio signal, wherein the dual-channel audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a real-time acquisition playing interface of a first terminal by a photoelectric conversion device, the first terminal is used for playing when receiving video data corresponding to a first audio and video test sequence, the second audio signal is an audio signal corresponding to the first audio and video test sequence sent by the first terminal, and the video data and the audio signal corresponding to the first audio and video test sequence are synchronous; and determining the audio and video playing time delay corresponding to the first audio and video test sequence according to the first audio signal and the second audio signal.
In one embodiment, the first audio/video test sequence comprises a video test sequence and a corresponding audio test sequence, the video test sequence and the audio test sequence have a synchronous relationship, the state of a test image corresponding to the video test sequence comprises a first state and a second state, the brightness difference between the image brightness of the first state and the image brightness of the second state exceeds a first preset threshold, and the state of the test image changes periodically; the states of the test audio frequency spectrum corresponding to the audio test sequence comprise a third state and a fourth state, the height difference corresponding to the spectral height of the third state and the spectral height of the fourth state exceeds a second preset threshold, and the states of the test audio frequency spectrum are periodically changed.
In one embodiment, the test audio to which the audio test sequence corresponds is a monophonic frequency audio.
In one embodiment, the audio and video data corresponding to the first audio and video test sequence is audio and video data sent by the third terminal, and the third terminal is used for acquiring an interface of the second terminal for playing the first audio and video test sequence in real time, obtaining a second audio and video test sequence corresponding to the first audio and video test sequence, and sending the audio and video data corresponding to the second audio and video test sequence to the first terminal in real time.
In one embodiment, determining an audio/video playing delay corresponding to a first audio/video test sequence according to a first audio signal and a second audio signal includes: acquiring a first pulse signal corresponding to a first audio signal, and determining a first target time point set according to the first pulse signal, wherein the first target time point set comprises at least one first target time point; acquiring a second pulse signal corresponding to a second audio signal, and determining a second target time point set according to the second pulse signal, wherein the second target time point set comprises at least one second target time point; and calculating to obtain the audio and video playing time delay according to the matched first target time point and the second target time point.
In one embodiment, the computer program further causes the processor to perform the steps of: sending an audio and video test sequence playing instruction to a second terminal, and acquiring initial playing time corresponding to the first audio and video test sequence played by the second terminal according to the audio and video test sequence playing instruction; and modifying the current time of the local terminal according to the initial playing time.
In one embodiment, a computer-readable storage medium is provided, storing a computer program that, when executed by a processor, causes the processor to perform the steps of: receiving a dual-channel audio signal, wherein the dual-channel audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a real-time acquisition playing interface of a first terminal by a photoelectric conversion device, the first terminal is used for playing when receiving video data corresponding to a first audio and video test sequence, the second audio signal is an audio signal corresponding to the first audio and video test sequence sent by the first terminal, and the video data and the audio signal corresponding to the first audio and video test sequence are synchronous; and determining the audio and video playing time delay corresponding to the first audio and video test sequence according to the first audio signal and the second audio signal.
In one embodiment, the first audio/video test sequence comprises a video test sequence and a corresponding audio test sequence, the video test sequence and the audio test sequence have a synchronous relationship, the state of a test image corresponding to the video test sequence comprises a first state and a second state, the brightness difference between the image brightness of the first state and the image brightness of the second state exceeds a first preset threshold, and the state of the test image changes periodically; the states of the test audio frequency spectrum corresponding to the audio test sequence comprise a third state and a fourth state, the height difference corresponding to the spectral height of the third state and the spectral height of the fourth state exceeds a second preset threshold, and the states of the test audio frequency spectrum are periodically changed.
In one embodiment, the test audio to which the audio test sequence corresponds is a monophonic frequency audio.
In one embodiment, the audio and video data corresponding to the first audio and video test sequence is audio and video data sent by the third terminal, and the third terminal is used for acquiring an interface of the second terminal for playing the first audio and video test sequence in real time, obtaining a second audio and video test sequence corresponding to the first audio and video test sequence, and sending the audio and video data corresponding to the second audio and video test sequence to the first terminal in real time.
In one embodiment, determining an audio/video playing delay corresponding to a first audio/video test sequence according to a first audio signal and a second audio signal includes: acquiring a first pulse signal corresponding to a first audio signal, and determining a first target time point set according to the first pulse signal, wherein the first target time point set comprises at least one first target time point; acquiring a second pulse signal corresponding to a second audio signal, and determining a second target time point set according to the second pulse signal, wherein the second target time point set comprises at least one second target time point; and calculating to obtain the audio and video playing time delay according to the matched first target time point and the second target time point.
In one embodiment, the computer program further causes the processor to perform the steps of: sending an audio and video test sequence playing instruction to a second terminal, and acquiring initial playing time corresponding to the first audio and video test sequence played by the second terminal according to the audio and video test sequence playing instruction; and modifying the current time of the local terminal according to the initial playing time.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (13)

1. An audio and video time delay testing method comprises the following steps:
receiving a two-channel audio signal, the two-channel audio signal being synthesized from a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a playing interface of the first terminal acquired by the photoelectric conversion device in real time, the first terminal is used for playing when receiving the video data corresponding to the second audio and video test sequence, the second audio and video test sequence is obtained by the third terminal image acquisition device acquiring the interface of the first audio and video test sequence played by the second terminal in real time, the third terminal is also used for sending the video data corresponding to the second audio and video test sequence to the first terminal in real time, the second audio signal is an audio signal corresponding to the first audio and video test sequence sent by the first terminal, and video data and the audio signal corresponding to the first audio and video test sequence are synchronous;
and determining the audio and video playing time delay corresponding to the first audio and video test sequence according to the first audio signal and the second audio signal.
2. The method according to claim 1, wherein the first audio/video test sequence comprises a video test sequence and a corresponding audio test sequence, the video test sequence and the audio test sequence have a synchronous relationship, the state of a test image corresponding to the video test sequence comprises a first state and a second state, the brightness difference corresponding to the image brightness of the first state and the image brightness of the second state exceeds a first preset threshold, and the state of the test image changes periodically;
the states of the test audio frequency spectrum corresponding to the audio test sequence comprise a third state and a fourth state, the height difference between the spectral height of the third state and the spectral height of the fourth state exceeds a second preset threshold, and the states of the test audio frequency spectrum are changed periodically.
3. The method of claim 2, wherein the test audio corresponding to the audio test sequence is monophonic frequency audio.
4. The method according to claim 1, wherein the audio/video data corresponding to the first audio/video test sequence is audio/video data sent by a third terminal, and the third terminal is configured to acquire an interface of a second terminal playing the first audio/video test sequence in real time, obtain a second audio/video test sequence corresponding to the first audio/video test sequence, and send the audio/video data corresponding to the second audio/video test sequence to the first terminal in real time.
5. The method according to claim 1, wherein the determining an audio/video playing time delay corresponding to the first audio/video test sequence according to the first audio signal and the second audio signal comprises:
acquiring a first pulse signal corresponding to the first audio signal, and determining a first target time point set according to the first pulse signal, wherein the first target time point set comprises at least one first target time point;
acquiring a second pulse signal corresponding to the second audio signal, and determining a second target time point set according to the second pulse signal, wherein the second target time point set comprises at least one second target time point;
and calculating to obtain the audio and video playing time delay according to the matched first target time point and the second target time point.
6. The method of claim 4, further comprising:
sending an audio and video test sequence playing instruction to a second terminal, and acquiring initial playing time corresponding to the first audio and video test sequence played by the second terminal according to the audio and video test sequence playing instruction;
and modifying the current time of the local terminal according to the starting playing time.
7. An audio and video time delay test system, characterized in that the system comprises:
the computer equipment is respectively connected with the first terminal and the second terminal;
the photoelectric conversion device covers a playing interface of the first terminal, and comprises a photosensitive resistor and a first audio line connected with the photosensitive resistor;
the computer equipment is connected with the photoelectric conversion device and the first terminal through a double-channel audio line, the first terminal comprises a second audio line for outputting audio, the first audio line and the second audio line are connected with the double-channel audio line, the computer equipment is used for receiving a double-channel audio signal, the double-channel audio signal is obtained by synthesizing a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a real-time acquisition first terminal playing interface through the photoelectric conversion device, the first terminal is used for playing when receiving video data corresponding to a second audio and video test sequence, the second audio and video test sequence is obtained by acquiring the interface of a first audio and video test sequence played by a second terminal image acquisition device in real time through a third terminal image acquisition device, and the third terminal is also used for transmitting the video data corresponding to the second audio and video test sequence to the first terminal in real time The second audio signal is an audio signal corresponding to the first audio and video test sequence sent by the first terminal, and video data and the audio signal corresponding to the first audio and video test sequence are synchronous; and determining the audio and video playing time delay corresponding to the first audio and video test sequence according to the first audio signal and the second audio signal.
8. The system of claim 7, wherein the computer device is connected to the first terminal and the second terminal via a universal serial bus or a wireless network.
9. The system of claim 7, further comprising:
and the third terminal comprises an image acquisition device and an audio acquisition device, and the image acquisition device covers the playing interface of the second terminal.
10. An audio and video time delay testing device is characterized in that the device comprises:
a binaural audio signal receiving module for receiving a binaural audio signal, the binaural audio signal being synthesized from a first audio signal and a second audio signal, the first audio signal is obtained by converting an optical signal corresponding to a playing interface of the first terminal acquired by the photoelectric conversion device in real time, the first terminal is used for playing when receiving the video data corresponding to the second audio and video test sequence, the second audio and video test sequence is obtained by the third terminal image acquisition device acquiring the interface of the first audio and video test sequence played by the second terminal in real time, the third terminal is also used for sending the video data corresponding to the second audio and video test sequence to the first terminal in real time, the second audio signal is an audio signal corresponding to the first audio and video test sequence sent by the first terminal, and video data and the audio signal corresponding to the first audio and video test sequence are synchronous;
and the audio and video playing time delay determining module is used for determining the audio and video playing time delay corresponding to the first audio and video test sequence according to the first audio signal and the second audio signal.
11. The apparatus of claim 10, wherein the audio-video playback delay determining module comprises:
a first target time point set obtaining unit, configured to obtain a first pulse signal corresponding to the first audio signal, and determine a first target time point set according to the first pulse signal, where the first target time point set includes at least one first target time point;
a second target time point set obtaining unit, configured to obtain a second pulse signal corresponding to the second audio signal, and determine a second target time point set according to the second pulse signal, where the second target time point set includes at least one second target time point;
and the audio and video playing time delay calculating unit is used for calculating the audio and video playing time delay according to the matched first target time point and the second target time point.
12. A computer-readable storage medium, storing a computer program which, when executed by a processor, causes the processor to carry out the steps of the method according to any one of claims 1 to 6.
13. A computer device comprising a memory and a processor, the memory storing a computer program that, when executed by the processor, causes the processor to perform the steps of the method according to any one of claims 1 to 6.
CN201810818429.XA 2018-07-24 2018-07-24 Audio and video time delay testing method and device, computer equipment and storage medium Active CN110753261B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810818429.XA CN110753261B (en) 2018-07-24 2018-07-24 Audio and video time delay testing method and device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810818429.XA CN110753261B (en) 2018-07-24 2018-07-24 Audio and video time delay testing method and device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110753261A CN110753261A (en) 2020-02-04
CN110753261B true CN110753261B (en) 2022-03-01

Family

ID=69275344

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810818429.XA Active CN110753261B (en) 2018-07-24 2018-07-24 Audio and video time delay testing method and device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110753261B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114286272B (en) * 2021-12-17 2023-05-16 华勤技术股份有限公司 Time delay test system, method and related device of true wireless earphone

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007221421A (en) * 2006-02-16 2007-08-30 Onkyo Corp Video audio reproducing system, av center constituting same, and monitor
CN101616331A (en) * 2009-07-27 2009-12-30 北京汉邦高科数字技术有限公司 A kind of method that video frame rate and audio-visual synchronization performance are tested

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007221421A (en) * 2006-02-16 2007-08-30 Onkyo Corp Video audio reproducing system, av center constituting same, and monitor
CN101616331A (en) * 2009-07-27 2009-12-30 北京汉邦高科数字技术有限公司 A kind of method that video frame rate and audio-visual synchronization performance are tested

Also Published As

Publication number Publication date
CN110753261A (en) 2020-02-04

Similar Documents

Publication Publication Date Title
CN107027050B (en) Audio and video processing method and device for assisting live broadcast
CN103327377B (en) System, method, and infrastructure for synchronized streaming of content
WO2016095369A1 (en) Screen recording method and device
CN110430104B (en) Audio transmission delay testing method and device, storage medium and electronic equipment
CN112040225B (en) Playing delay difference measuring method, device, equipment, system and storage medium
KR20070034462A (en) Video-Audio Synchronization
EP3171593B1 (en) Testing system and method
CN112637670B (en) Video generation method and device
WO2014149593A1 (en) External roundtrip latency measurement for a communication system
CN110585702A (en) Sound and picture synchronous data processing method, device, equipment and medium
CN110493592B (en) Video time delay testing method and device, computer equipment and storage medium
CN111028818A (en) Chorus method, apparatus, electronic device and storage medium
CN110753261B (en) Audio and video time delay testing method and device, computer equipment and storage medium
CN111383656A (en) Voiceprint live broadcast method, voiceprint live broadcast device, server, client equipment and storage medium
US20210390937A1 (en) System And Method Generating Synchronized Reactive Video Stream From Auditory Input
CN112188259B (en) Method and device for audio and video synchronization test and correction and electronic equipment
CN111726686B (en) Virtual karaoke system and method based on television
CN114466145B (en) Video processing method, device, equipment and storage medium
JP6956354B2 (en) Video signal output device, control method, and program
CN116233411A (en) Method, device, equipment and computer storage medium for audio and video synchronous test
CN111105816A (en) Man-machine interactive software screen recording method
CN115767158A (en) Synchronous playing method, terminal equipment and storage medium
WO2022227689A1 (en) Video processing method and apparatus
CN115243087A (en) Audio and video co-shooting processing method and device, terminal equipment and storage medium
CN112039612B (en) Time delay measuring method, device, equipment, system and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40020258

Country of ref document: HK

SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant