WO2014067364A1

WO2014067364A1 - Lip synchronization test system and method

Info

Publication number: WO2014067364A1
Application number: PCT/CN2013/083838
Authority: WO
Inventors: 李立世; 张成华; 梅卫星; 张学英
Original assignee: 中兴通讯股份有限公司
Priority date: 2012-10-30
Filing date: 2013-09-18
Publication date: 2014-05-08
Also published as: CN103796006A

Abstract

A lip synchronization test system and method. The system comprises: a playing device (101) configured to play a multimedia file with an image and sound both having an energy jump and being synchronous; a device to be tested (102) configured to receive a first image signal and a first sound signal output by the playing device (101) when playing the multimedia file, and output a second image signal corresponding to the first image signal and a second sound signal corresponding to the first sound signal; and a test device (103) configured to receive the second image signal and the second sound signal, and output a second image energy variation graph and a second sound energy variation graph; wherein the test device (103) is also configured to detect whether the second image energy variation graph has an image energy jump, and detect whether the second sound energy variation graph has a sound energy jump.

Description

System and method for lip sound synchronization test

The present invention relates to the field of testing technologies, and in particular, to a system and method for lip-synchronous testing. Background technique

With the continuous development of network technology and communication technology, more and more applications involve the transmission of multimedia data, such as: When performing video chat, it is necessary to transmit multimedia data including video signals and sound signals from a client terminal. To another one or more client terminals; when performing a video conference, it is necessary to transmit multimedia data including a participant's video signal and sound signal from one conference terminal to another conference terminal of another participant.

For various reasons, in the prior art, the image and the sound are not synchronized, such as: due to the network transmission, the sound signal is received first, and the image signal is received, which leads to sound. Not synchronized with the image.

Among the various reasons mentioned above, one of the important reasons is that due to equipment reasons, such as: The receiving party's conference television system itself has a delay in processing, which in turn causes images and sounds to be out of sync. Therefore, it is very important to test the conference TV system during use to determine if it is normal.

To this end, the methods commonly used in the prior art are as follows:

The method of manual subjective judgment is adopted, that is, the image and the sound are collected through the combination of the microphone and the camera, and the person observes the image change through the eyes while hearing the sound, and then subjectively judges whether the sound and the image are synchronized. .

In the process of implementing the technical solution in the embodiment of the present invention, the inventors found that at least the following problems exist in the prior art:

1. In the prior art, the manual method is used to control the microphone and the camera to go to the opposite sound. The sound and the image are collected, but in practice, the microphone and the camera cannot be activated at the same time, so there is a technical problem that the image and sound cannot be synchronously collected;

2. In the prior art, the sound and the image are collected by two independent devices, a microphone and a camera. Therefore, when inputting to the device under test, there is no guarantee that the image signal and sound will be at the same time. The technical problem of signal input to the device under test;

3. In the prior art, when judging, the judgment is performed manually, and subjectivity and arbitrariness are large, so there is a technical problem that the accuracy of the judgment result is low. Summary of the invention

Embodiments of the present invention provide a system and method for lip-synchronous testing to solve the technical problem that the accuracy of the judgment result existing in the prior art is low.

In order to solve the above technical problem, an embodiment of the present invention provides a lip synchronization test system, including:

a playback device, configured to play a multimedia file with an energy jump and synchronization of the image and the sound; the device under test, connected to the playback device, configured to receive the first image output by the playback device when playing the multimedia file a signal and a first sound signal, and outputting a second image signal corresponding to the first image signal, and a second sound signal corresponding to the first sound signal;

a test device, coupled to the device under test, configured to receive the second image signal and the second sound signal, and output a second image energy change map corresponding to the second image signal, and a second sound energy change map corresponding to the second sound signal;

The test device is further configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, record the first moment when the image energy jump occurs. Detecting whether the second sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a second moment when the sound energy jump occurs, and then, based on the first At the moment and the second moment, obtaining lip sync of the device under test The amount of delay.

Preferably, the playing device comprises:

a playing chip configured to play the multimedia file, output the first image signal and the first sound signal;

a first image output interface, connected to the playing chip, configured to output the first image signal;

The first sound output interface is coupled to the play chip and configured to output the first sound signal.

Preferably, the device under test comprises:

a first image input interface, coupled to the first image output interface, configured to receive the first image signal;

a first sound input interface, coupled to the first sound output interface, configured to receive the first sound signal;

a processing module, connected to the first image input interface and the first sound input interface, and after processing the received first image signal, outputting the second image signal, in receiving the received image After the first sound signal is processed, the second sound signal is output;

a second image output interface, coupled to the processing module, configured to output the second image signal;

The second sound output interface is coupled to the processing module and configured to output the second sound signal.

Preferably, the testing device comprises:

a second image input interface, coupled to the second image output interface, configured to receive the second image signal;

a second sound input interface, connected to the second sound output interface, configured to receive the second sound signal; a display unit, configured to output a second image energy change map corresponding to the second image signal, and the second image input interface and the second sound input interface, and corresponding to the second sound signal Second sound energy change map;

a test module, configured to be connected to the display unit, configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, record the occurrence of the image energy jump a first moment; detecting whether the second sound energy change map has a sound energy jump, and when the sound energy jumps, recording a second moment when the sound energy jump occurs, and then, based on At the first moment and the second moment, the lip synchronization delay amount of the device under test is obtained.

Preferably, when the second image input interface is connected to the first image output interface, and the second sound input interface is connected to the first sound output interface, the display unit is further configured to output and a first image energy change map corresponding to the first image signal, and a first sound energy change map corresponding to the first sound signal;

The test module is further configured to detect whether the first image energy change map has an image energy jump, and when there is the image energy jump, record a third moment when the image energy jump occurs; Detecting whether the first sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a fourth moment when the sound energy jump occurs, and then, based on the third moment And obtaining, by the fourth moment, a time error between the image and the sound in the multimedia file; and obtaining the lip synchronization delay based on the first moment, the second moment, and the time error the amount.

Preferably, the device under test is specifically: a conference television system, a video chat system or a video monitoring system.

On the other hand, the embodiment of the present invention further provides a lip-synchronization test method, which is applied in a lip-synchronization test system, and the system includes: a playback device, a device under test, a connection with the playback device, a test device, and a Connected to the device under test, the method includes: Playing, by the playing device, a multimedia file with an image jump and synchronization of images and sounds;

Receiving, by the device under test, a first image signal and a first sound signal output by the playback device when playing the multimedia file, and outputting a second image signal corresponding to the first image signal, and a second sound signal corresponding to the first sound signal;

Receiving, by the testing device, the second image signal and the second sound signal, and outputting a second image energy change map corresponding to the second image signal, and a second corresponding to the second sound signal Sound energy change diagram;

Detecting, by the test device, whether the second image energy change map has an image energy jump, and when there is the image energy jump, recording a first moment when the image energy jump occurs; detecting the Whether the second sound energy change map has a sound energy jump, and when the sound energy jumps, is recorded at a second moment when the sound energy jump occurs;

The lip synchronization delay amount of the device under test is obtained by the test device based on the first time and the second time.

Preferably, before the obtaining, by the test device, the lip synchronization delay amount of the device under test based on the first time and the second time, the method further includes:

Outputting, by the test device, a first image energy change map corresponding to the first image signal and a first sound corresponding to the first sound signal when the test device is directly connected to the playback device Energy change map;

Detecting, by the test device, whether the first image energy change map corresponding to the first image signal has an image energy jump, and when there is the image energy jump, recording when the image energy jump occurs a third time; detecting whether the first sound energy change map has a sound energy jump, and when the sound energy jumps, recording a fourth moment when the sound energy jump occurs, and then, based on The third time and the fourth time are obtained for characterizing a time error between the image and the sound in the multimedia file. Preferably, the determining, by the test device, the lip synchronization delay amount of the device under test based on the first time and the second time, specifically:

The lip synchronization delay amount is obtained by the test device based on the first moment, the second moment, and the time error.

The embodiment of the present invention has at least the following beneficial effects or advantages through one or more of the technical solutions provided above:

1. Since the image signal and the sound signal are from a multimedia file in which both the image and the sound have energy hopping and synchronization, the technical problem that the image and the sound cannot be synchronously collected in the prior art is effectively solved, and the realization is realized. Synchronous generation and acquisition of image signals and sound signals;

2. Since the playback device plays a multimedia file with both image and sound energy jumping and synchronization, the synchronous image signal and the sound signal can be simultaneously output and input to the device under test, thereby effectively solving the input to be tested. When the device is used, there is a technical problem that the image signal and the sound signal cannot be input to the device under test at the same time. Therefore, the technical effect of synchronous input of the image signal and the sound signal into the device under test is realized;

3. The test device automatically detects whether the image signal and the sound signal output by the device under test have energy jumps, and calculates the energy hopping relative time difference between the image signal and the sound signal when there is an energy jump, thereby determining the lip delay. The time quantity effectively solves the technical problem that the accuracy of the judgment result in the prior art is low, and realizes the technical effect of the accurate quantized lip sync delay data. DRAWINGS

1 is a structural diagram of a lip-synchronization test system according to Embodiment 1 of the present invention; FIG. 2 is a structural diagram of a playback device in a system according to Embodiment 1 of the present invention; 3 is a structural diagram of a device under test in a system according to Embodiment 1 of the present invention;

4 is a structural diagram of a test device in a system according to Embodiment 1 of the present invention;

FIG. 5 is a diagram showing image and sound energy transitions outputted by a test device in a system according to Embodiment 1 of the present invention; FIG.

FIG. 6 is a flowchart of a lip sound synchronization test method according to Embodiment 2 of the present invention. detailed description

The technical solution in the embodiment of the present invention is to solve the above technical problem. The general idea is as follows: a multimedia file that has an energy hopping and synchronization by playing a playback device and a sound; and a device connected to the playback device through the device under test, configured as Receiving a first image signal and a first sound signal output by the playback device when playing the multimedia file, and outputting a second image signal corresponding to the first image signal, and corresponding to the first sound signal Second sound signal;

Connected to the device under test, configured to receive the second image signal and the second sound signal, and output a second image energy change map corresponding to the second image signal, and a second sound energy change map corresponding to the second sound signal;

The test device is further configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, record the first moment when the image energy jump occurs. Detecting whether the second sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a second moment when the sound energy jump occurs, and then, based on the first At the moment and the second moment, the lip synchronization delay amount of the device under test is obtained.

It can be seen that the test device automatically detects whether the image signal and the sound signal output by the device under test have energy jumps, and calculates the energy jump of the image and the sound when there is an energy jump. The difference between the two is used to determine the lip delay amount, which effectively solves the technical problem that the accuracy of the judgment result in the prior art is low, and realizes the technical effect of accurately quantizing the lip sync delay data.

In order to better understand the above technical solutions, the above technical solutions will be described in detail below in conjunction with the drawings and specific embodiments.

Embodiment 1:

In the first embodiment, a lip synchronization test system is provided. Referring to FIG. 1, the test system in the embodiment of the present invention includes:

The playback device 101 is configured to play a multimedia file in which both the image and the sound have energy hopping and synchronization. Specifically, the multimedia file may be: a movie video, a music MV, or a specially produced video, but What video, both images and sounds need to have energy jumps, and the image and sound are synchronized. The form of the multimedia file can be: CD, or stored in a USB storage device.

The device under test 102 is connected to the playback device 101, and configured to receive a first image signal and a first sound signal that are output by the playback device 101 when the multimedia file is played, and output a corresponding image signal. The second image signal, and the second sound signal corresponding to the first sound signal, specifically, the device under test may be: a conference television system, a video chat system or a video surveillance system, all tested Devices all involve the encoding and decoding of image signals and sound signals.

The test device 103 is connected to the device under test 102, configured to receive the second image signal and the second sound signal, and output a second image energy change map corresponding to the second image signal, and The second sound energy change map corresponding to the second sound signal, specifically, the test device may be: an energy harvesting device having at least two channels, such as an oscilloscope, and capable of displaying image signal and sound signal energy jump Moment.

The test device 103 is further configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, the image energy is recorded. a first moment of the transition; detecting whether the second sound energy change map has a sound energy jump, and when the sound energy jumps, recording the second moment when the sound energy jump occurs, Then, based on the first moment and the second moment, a lip synchronization delay amount of the device under test is obtained.

In the following, the specific structure and working principle of each part in the test system in the embodiment of the present invention will be described with reference to FIG. 2, FIG. 3, FIG. 4 and FIG.

Referring to FIG. 2, in the embodiment of the present invention, the playback device 101 may be a conventional DVD player, a Blu-ray player, or a computer having a playback function. Not - for example. Specifically, the structure of the playback device 101 may specifically include:

The playing chip 1011 is configured to play the multimedia file, and output the first image signal and the first sound signal;

The first image output interface 1012 is connected to the playing chip 1011 and configured to output the first image signal;

The first sound output interface 1013 is connected to the play chip 1011 and configured to output the first sound signal.

When the playback device 101 is specifically a DVD player, and the multimedia file exists in the form of an optical disc, the specific working process of the playback device 101 is as follows: First, the optical disc is placed in an optical disc drive of the DVD player; Then, the DVD player detects that the optical disc is in the optical disc drive; next, the play chip 1011 in the DVD player reads the optical disc to obtain the multimedia file, and the multimedia file The file is played back; finally, the first image signal outputted by the playback is output to the first image output interface 1012, and the first sound signal output by the playback is output to the first sound output interface 1013. In practical applications, the first image output interface 1012 and the first sound output interface 1013 may be two physically separate interfaces; or may be an integrated interface. What kind of interface is specifically, the present invention The examples here are not limited.

The device under test 102, in the embodiment of the present invention, may specifically be a conference television system, a video chat system, or a video surveillance system. Referring to FIG. 3, the device under test 102 may specifically include: a first image input interface 1021 connected to the first image output interface 1012 and configured to receive the first image signal.

The first sound input interface 1022 is connected to the first sound output interface 1013 and configured to receive the first sound signal.

The processing module 1023 is connected to the first image input interface 1021 and the first sound input interface 1022, and after processing the received first image signal, outputting the second image signal, After processing the received first sound signal, the second sound signal is output. When the device under test 102 is specifically a conference television system, the processing module 1023 is specifically a conference television function module; when the device under test 102 is specifically a video chat system, such as a QQ chat system, the processing module 1023 is specifically a QQ chat function module.

a second image output interface 1024, coupled to the processing module 1023, configured to output the second image signal;

The second sound output interface 1025 is connected to the processing module 1023 and configured to output the second sound signal.

In the embodiment of the present invention, as shown in FIG. 1 , the device under test 102 is connected to the playback device 101 and configured to receive a first image signal and a first output when the playback device 101 plays the multimedia file. a sound signal, and outputting a second image signal corresponding to the first image signal and a second sound signal corresponding to the first sound signal.

Specifically, in the embodiment, when the device under test 102 is specifically a conference television system, the working process of the device under test 102 is as follows: the first image input interface 1021 of the conference television system, the first sound The input interface 1022 is respectively connected to the first image output interface 1012 and the first sound output interface 1013 in the playback device 101, and is configured to receive the playback device. The image signal and the sound signal outputted by the device 101 are processed by the processing module 1023, and finally the processed second image signal corresponding to the first image signal is output to the second image output interface 1024, and the processed image is processed. A second sound signal corresponding to a sound signal is output to the second sound output interface 1025.

In the embodiment of the present invention, the testing device 103 may specifically be: an oscilloscope having at least two channels, the oscilloscope can automatically detect the energy hopping of the image signal and the sound signal and record the time of the hopping, specifically, please Referring to FIG. 4, the testing device 103 in the embodiment of the present invention includes:

The detecting module 1033 is configured to detect whether the second image signal and the second sound signal energy change map have energy jumps;

a second image input interface 1031, connected to the detecting module 1033, configured to input a second image signal;

a second sound input interface 1032, connected to the detecting module 1033, configured to input a second sound signal;

The display unit 1034 is connected to the detecting module 1033, and configured to display the detected second image signal energy change map and the detected second sound signal energy change map.

In the embodiment of the present invention, referring to FIG. 1, the test device 103 is connected to the device under test 102, configured to receive the second image signal and the second sound signal, and output the second a second image energy change map corresponding to the image signal, and a second sound energy change map corresponding to the second sound signal;

The test device 103 is further configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, record the first when the image energy jump occurs. Detecting whether the second sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a second moment when the sound energy jump occurs, and then, based on the At a moment and the second moment, obtaining the lip of the device under test 102 The amount of tone synchronization delay.

In the embodiment of the present invention, in order to detect the device to be detected 102 more accurately, the test device 103 needs to be directly connected to the playback device 101. At this time, the test device 103 can output the same a first image energy change map corresponding to an image signal, and a first sound energy change map corresponding to the first sound signal;

Then, the first image energy change map corresponding to the first image signal is detected by the test device 103 to have an image energy jump, and when the image energy jumps, the image energy is recorded. a third moment of the transition; detecting whether the first sound energy change map has a sound energy jump, and when the sound energy jumps, recording the fourth moment when the sound energy jump occurs, Then, based on the third moment and the fourth moment, a time error for characterizing the image and the sound in the multimedia file is obtained.

Then, the lip sync delay amount is obtained by the test device 103 based on the first moment, the second moment, and the time error.

In this embodiment, when the test device 103 is specifically an oscilloscope, the working process of the test device 103 is specifically as follows: the oscilloscope is connected to the device under test 102, the second image input interface 1031 and the second sound input The interface 1032 is configured to receive the second image signal and the second sound signal, and after detecting by the detecting module 1033, the display unit 1034 displays an energy change map of the second image signal and the second sound signal;

When the detecting module 1033 detects that the second image signal has an energy jump, the display unit 1034 displays an energy jump diagram of the second image signal, and records the first transition time T1, and detects the second sound. When the signal has an energy jump, the display unit 1034 displays the energy jump diagram of the second sound signal, and records the second time Τ2, and then obtains the lip sync delay amount (T2-T1) of the device under test 102. Please refer to Figure 5.

When the oscilloscope 103 is directly connected to the playback device 101, the oscilloscope 103 display unit 1034 first displays a first image energy change map corresponding to the first image signal, and The first sound signal corresponds to a first sound energy change map, and then, when the detecting module 1033 detects that the first image signal has an energy jump, the display unit 1034 displays the first image signal energy jump map, and records Jumping to the first time T3, when detecting that the second sound signal has an energy jump, the display unit 1034 displays an energy jump diagram of the second sound signal, and records the second time Τ4, and then obtains for characterization The time error between the image and the sound in the multimedia file (Τ4-Τ3). The lip oscilloscope synchronization delay amount (T2-T1)-( Τ4-Τ3 ) of the device under test 102 is obtained by the oscilloscope 103 based on the first time T1, the second time Τ2, and the time error (Τ4-Τ3).

The technical solutions in the foregoing embodiments of the present invention have at least the following technical effects or advantages:

3. The test device automatically detects whether the image signal and the sound signal output by the device under test have energy jumps, and calculates the energy hopping relative time difference between the image and the sound when there is an energy jump, thereby determining the lip delay amount. The utility model effectively solves the technical problem that the accuracy of the judgment result in the prior art is low, and realizes the technical effect of accurately quantizing the lip sync delay data.

Embodiment 2

The embodiment of the present invention further provides a lip-synchronization test method. The method flow chart is as shown in FIG. 6 and is applied to a lip-synchronization test system. The system includes: a playback device 101, a device under test 102, and the playback device 101. Connecting, testing device 103, connected to the device under test 102 The method includes:

S501 plays, by the playing device 101, a multimedia file in which both images and sounds are energy-jumped and synchronized;

Specifically, in this embodiment, S501 is specifically: after the playback device 101 plays the multimedia file by the playing chip 1011 of the playing device, the first image output interface 1012 of the playing device outputs the first An image signal, and the first sound output interface 1013 outputs a first sound signal.

S502 receives, by the device under test 102, the first image signal and the first sound signal that are output by the playback device 101 when the multimedia file is played, and outputs a second image signal corresponding to the first image signal, and a second sound signal corresponding to the first sound signal; specifically, in the embodiment, S502 is specifically: the device under test 102 receives the first image output of the playback device through the first image input interface 1021. The first image signal output by the interface 1012 is received by the device under test 1022, and the first sound signal output by the first sound output interface 1013 of the playback device 101 is received by the device under test via the device under test 1023. After processing, the second image signal corresponding to the first image signal is output by the second image output interface 1024, and the second sound signal corresponding to the first sound signal is output by the second sound output interface 1025.

S503, the second image signal and the second sound signal are received by the testing device, and output a second image energy change map corresponding to the second image signal, and a corresponding to the second sound signal Second sound energy change diagram;

Specifically, in the embodiment, S503 is specifically: the test device 103 receives the second image signal output by the second image output interface 1024 of the device under test through the second image input interface 1031, and the test device Receiving, by the second sound input interface 1032, the second sound signal output by the second sound output interface 1025 of the device under test, after being detected by the test device detecting module 1033, the display unit 1034 of the test device outputs the second image Signal pair a second image energy change map, and a second sound energy change map corresponding to the second sound signal.

S504: detecting, by the testing device 103, whether the second image energy change map has an image energy jump, and recording, when the image energy jumps, the first moment when the image energy jump occurs; detecting Whether the second sound energy change map has a sound energy jump, and when the sound energy jumps, is recorded at a second moment when the sound energy jump occurs;

Specifically, in the embodiment, S504 is specifically: the detecting module 1033 of the testing device detects whether the second image signal has energy jump, and displays the second image signal energy change graph on the display unit 1034 of the testing device. And when there is an energy jump, simultaneously recording the first time T1 when the energy of the second image signal is hopping; the detecting module 1033 of the testing device detects whether the second sound signal has an energy jump, in the test The display unit 1034 of the device displays a second sound signal energy change map, and simultaneously records the second time T2 when the second sound signal energy jumps when there is an energy jump, based on the first time and the first At the second moment, the lip synchronization delay amount (T2-T1) of the device under test is obtained.

S505, when the test device 103 is directly connected to the playback device 101, outputting, by the test device 103, a first image energy change map corresponding to the first image signal, and corresponding to the first sound signal. First sound energy change map;

Detecting, by the testing device 103, whether the first image energy change map corresponding to the first image signal has image energy hopping, and when there is the image energy hopping, recording when the image energy hopping occurs a third time; detecting whether the first sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a fourth moment when the sound energy jump occurs, and then, based on The third time and the fourth time are obtained for characterizing a time error between the image and the sound in the multimedia file. Specifically, in this embodiment, S505 is specifically: the second image input interface 1031 of the test device is connected to the first image output interface 1012 of the playback device, and the second sound input interface 1032 of the test device is Connected to the first sound output interface 1013 of the playback device, after being detected by the detection module 1033 of the test device, the display unit 1034 of the test device outputs a first image energy change map corresponding to the first image signal. And a first sound energy change map corresponding to the first sound signal;

The test device detecting module 1033 detects whether the first image energy change map has an energy jump, and when the image energy jumps, records that the test device display unit 1034 displays the third time T3 of the jump. The test device detection module 1033 detects whether the first sound energy change map has an energy jump, and when the sound energy jumps, records that the test device display unit 1034 displays the fourth time T4 of the jump. Then, based on the third time Τ3 and the fourth time Τ4, a time error (Τ4-Τ3) between the image and the sound in the multimedia file is obtained.

S506 obtains the lip synchronization delay amount by the test device based on the first time T1, the second time, and the time error Τ2.

Specifically, in this embodiment, based on the first time T1, the second time Τ2, and the time error (Τ4-Τ3), the lip synchronization delay amount is obtained as: (T2-T1) -( Τ4-Τ3 ).

1. Since the image and the sound are generated by the same multimedia file, the problem that the manual control microphone and the camera cannot be started synchronously in the prior art is solved, so that the synchronous input of the image and the sound is realized;

2. Since the playback device plays a multimedia file with both image and sound energy jumping and synchronization, the synchronous image signal and the sound signal can be simultaneously output and input to the device under test, thereby effectively solving the input to be tested. When there is a device, there is a technical problem that the image signal and the sound signal cannot be input to the device under test at the same time, so the image letter is realized. The signal and the sound signal are synchronously input into the technical effect of the device under test;

While the preferred embodiment of the invention has been described, the subject matter Therefore, it is intended that the appended claims be interpreted as including The spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and modifications of the invention Industrial applicability

The present invention provides a lip synchronization test system and method, wherein the system includes: a playback device configured to play a multimedia file in which both images and sounds have energy jumps and synchronization; and the device under test is connected to the playback device And configured to receive a first image signal and a first sound signal output by the playback device when playing the multimedia file, and output a second image signal corresponding to the first image signal, and the first sound a second sound signal corresponding to the signal; a test device connected to the device under test, configured to receive the second image signal and the second sound signal, and output a second image corresponding to the second image signal An energy change map, and a second sound energy change map corresponding to the second sound signal; wherein the test device is further configured to detect whether the second image energy change map has an image energy jump, and detect the Whether the second sound energy change map has a sound energy jump. The present invention can solve the technical problem that the accuracy of the judgment result existing in the prior art is low.

Claims

claims

1. A lip synchronization test system, the system includes:

The playback device is configured to play multimedia files in which images and sounds have energy jumps and are synchronized; the device under test is connected to the playback device and is configured to receive the first image output by the playback device when playing the multimedia file. signal and a first sound signal, and output a second image signal corresponding to the first image signal, and a second sound signal corresponding to the first sound signal;

Test equipment, connected to the device under test, configured to receive the second image signal and the second sound signal, and output a second image energy change map corresponding to the second image signal, and with the The second sound energy change diagram corresponding to the second sound signal;

Wherein, the test equipment is further configured to detect whether there is an image energy jump in the second image energy change map, and when there is an image energy jump, record the first moment when the image energy jump occurs. ; Detect whether there is a sound energy jump in the second sound energy change graph, and when there is a sound energy jump, record the second moment when the sound energy jump occurs, and then, based on the first time and the second time, obtain the lip synchronization delay amount of the device under test.

2. The system of claim 1, wherein the playback device includes:

A playback chip configured to play the multimedia file and output the first image signal and the first sound signal;

A first image output interface, connected to the playback chip, configured to output the first image signal;

A first sound output interface is connected to the playback chip and configured to output the first sound signal.

3. The system of claim 2, wherein the device under test includes: A first image input interface, connected to the first image output interface, configured to receive the first image signal;

A first sound input interface, connected to the first sound output interface, configured to receive the first sound signal;

A processing module is connected to the first image input interface and the first sound input interface, and after processing the received first image signal, outputs the second image signal, and after processing the received first image signal, After processing the first sound signal, output the second sound signal;

A second image output interface, connected to the processing module, configured to output the second image signal;

A second sound output interface is connected to the processing module and configured to output the second sound signal.

4. The system of claim 3, wherein the test equipment includes:

a second image input interface, connected to the second image output interface, configured to receive the second image signal;

a second sound input interface, connected to the second sound output interface, configured to receive the second sound signal;

The display unit is connected to the second image input interface and the second sound input interface, and is configured to output a second image energy change map corresponding to the second image signal, and a second image energy change map corresponding to the second sound signal. The second sound energy change diagram;

A test module, connected to the display unit, configured to detect whether there is an image energy jump in the second image energy change map, and when there is an image energy jump, record the image energy jump when the image energy jump occurs. The first moment; detect whether there is a sound energy jump in the second sound energy change graph, and when there is a sound energy jump, record the second moment when the sound energy jump occurs, and then, based on the sound energy jump, According to the first moment and the second moment, the lip synchronization delay amount of the device under test is obtained.

5. The system of claim 4, wherein when the second image input interface is connected to the first image output interface, and the second sound input interface is connected to the first sound output interface, The display unit is further configured to output a first image energy change map corresponding to the first image signal, and a first sound energy change map corresponding to the first sound signal;

The test module is also configured to detect whether there is an image energy jump in the first image energy change map, and when there is an image energy jump, record the third moment when the image energy jump occurs; Detect whether there is a sound energy jump in the first sound energy change graph, and when there is a sound energy jump, record the fourth moment when the sound energy jump occurs, and then, based on the third moment and the fourth moment, obtaining the time error between the image and the sound in the multimedia file; and based on the first moment, the second moment and the time error, obtaining the lip synchronization delay quantity.

6. The system according to any one of claims 1 to 5, wherein the device under test is: a conference television system, a video chat system or a video surveillance system.

7. A lip synchronization testing method, applied in a lip synchronization testing system, the system includes: a playback device, a device under test connected to the playback device, a test device connected to the device under test, the method include:

Play a multimedia file whose images and sounds have energy jumps and are synchronized through the playback device;

receiving the first image signal and the first sound signal output by the playback device when playing the multimedia file through the device under test, and outputting a second image signal corresponding to the first image signal, and a second sound signal corresponding to the first sound signal;

The second image signal and the second sound signal are received through the test equipment, and a second image energy change map corresponding to the second image signal and a second second sound signal corresponding to the second sound signal are output. Sound energy change diagram;

Use the testing equipment to detect whether there is an image energy jump in the second image energy change map. change, and when there is a jump in image energy, record the first moment when the jump in image energy occurs; detect whether there is a jump in sound energy in the second sound energy change diagram, and when there is a jump in sound energy When the energy jumps, record the second moment when the sound energy jump occurs;

The lip synchronization delay amount of the device under test is obtained by the testing device based on the first time and the second time.

8. The method of claim 7, wherein before obtaining the labial synchronization delay amount of the device under test based on the first time and the second time through the testing device, the Methods also include:

When the testing device is directly connected to the playback device, the testing device outputs a first image energy change diagram corresponding to the first image signal, and a first sound corresponding to the first sound signal. energy change diagram;

Use the testing equipment to detect whether there is an image energy jump in the first image energy change map corresponding to the first image signal, and when there is the image energy jump, record the image energy jump when the image energy jump occurs. The third moment; detect whether there is a sound energy jump in the first sound energy change graph, and when there is a sound energy jump, record the fourth moment when the sound energy jump occurs, and then, based on the sound energy jump, The third moment and the fourth moment are obtained to characterize the time error between the image and the sound in the multimedia file.

9. The method of claim 8, wherein the lip synchronization delay amount of the device under test is obtained based on the first moment and the second moment through the test device, which is: The test equipment obtains the lip synchronization delay amount based on the first time, the second time and the time error.

10. The method according to any one of claims 7-9, wherein the device under test is: a conference television system, a video chat system or a video surveillance system.