WO2014067364A1 - Lip synchronization test system and method - Google Patents
Lip synchronization test system and method Download PDFInfo
- Publication number
- WO2014067364A1 WO2014067364A1 PCT/CN2013/083838 CN2013083838W WO2014067364A1 WO 2014067364 A1 WO2014067364 A1 WO 2014067364A1 CN 2013083838 W CN2013083838 W CN 2013083838W WO 2014067364 A1 WO2014067364 A1 WO 2014067364A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sound
- image
- energy
- signal
- jump
- Prior art date
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 171
- 238000000034 method Methods 0.000 title claims abstract description 24
- 230000005236 sound signal Effects 0.000 claims abstract description 124
- 230000001360 synchronised effect Effects 0.000 claims abstract description 16
- 230000008859 change Effects 0.000 claims description 85
- 238000012545 processing Methods 0.000 claims description 20
- 238000010586 diagram Methods 0.000 claims description 16
- 230000000694 effects Effects 0.000 description 9
- 230000003287 optical effect Effects 0.000 description 6
- 230000009191 jumping Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000007704 transition Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000010998 test method Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000003306 harvesting Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
Definitions
- the present invention relates to the field of testing technologies, and in particular, to a system and method for lip-synchronous testing. Background technique
- multimedia data such as: When performing video chat, it is necessary to transmit multimedia data including video signals and sound signals from a client terminal. To another one or more client terminals; when performing a video conference, it is necessary to transmit multimedia data including a participant's video signal and sound signal from one conference terminal to another conference terminal of another participant.
- the image and the sound are not synchronized, such as: due to the network transmission, the sound signal is received first, and the image signal is received, which leads to sound. Not synchronized with the image.
- the receiving party's conference television system itself has a delay in processing, which in turn causes images and sounds to be out of sync. Therefore, it is very important to test the conference TV system during use to determine if it is normal.
- the method of manual subjective judgment is adopted, that is, the image and the sound are collected through the combination of the microphone and the camera, and the person observes the image change through the eyes while hearing the sound, and then subjectively judges whether the sound and the image are synchronized. .
- the manual method is used to control the microphone and the camera to go to the opposite sound.
- the sound and the image are collected, but in practice, the microphone and the camera cannot be activated at the same time, so there is a technical problem that the image and sound cannot be synchronously collected;
- Embodiments of the present invention provide a system and method for lip-synchronous testing to solve the technical problem that the accuracy of the judgment result existing in the prior art is low.
- an embodiment of the present invention provides a lip synchronization test system, including:
- a playback device configured to play a multimedia file with an energy jump and synchronization of the image and the sound
- the device under test connected to the playback device, configured to receive the first image output by the playback device when playing the multimedia file a signal and a first sound signal, and outputting a second image signal corresponding to the first image signal, and a second sound signal corresponding to the first sound signal;
- test device coupled to the device under test, configured to receive the second image signal and the second sound signal, and output a second image energy change map corresponding to the second image signal, and a second sound energy change map corresponding to the second sound signal;
- the test device is further configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, record the first moment when the image energy jump occurs. Detecting whether the second sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a second moment when the sound energy jump occurs, and then, based on the first At the moment and the second moment, obtaining lip sync of the device under test The amount of delay.
- the playing device comprises:
- a playing chip configured to play the multimedia file, output the first image signal and the first sound signal
- a first image output interface connected to the playing chip, configured to output the first image signal
- the first sound output interface is coupled to the play chip and configured to output the first sound signal.
- the device under test comprises:
- a first image input interface coupled to the first image output interface, configured to receive the first image signal
- a first sound input interface coupled to the first sound output interface, configured to receive the first sound signal
- a processing module connected to the first image input interface and the first sound input interface, and after processing the received first image signal, outputting the second image signal, in receiving the received image After the first sound signal is processed, the second sound signal is output;
- a second image output interface coupled to the processing module, configured to output the second image signal
- the second sound output interface is coupled to the processing module and configured to output the second sound signal.
- the testing device comprises:
- a second image input interface coupled to the second image output interface, configured to receive the second image signal
- a second sound input interface connected to the second sound output interface, configured to receive the second sound signal
- a display unit configured to output a second image energy change map corresponding to the second image signal, and the second image input interface and the second sound input interface, and corresponding to the second sound signal Second sound energy change map
- a test module configured to be connected to the display unit, configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, record the occurrence of the image energy jump a first moment; detecting whether the second sound energy change map has a sound energy jump, and when the sound energy jumps, recording a second moment when the sound energy jump occurs, and then, based on At the first moment and the second moment, the lip synchronization delay amount of the device under test is obtained.
- the display unit is further configured to output and a first image energy change map corresponding to the first image signal, and a first sound energy change map corresponding to the first sound signal;
- the test module is further configured to detect whether the first image energy change map has an image energy jump, and when there is the image energy jump, record a third moment when the image energy jump occurs; Detecting whether the first sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a fourth moment when the sound energy jump occurs, and then, based on the third moment And obtaining, by the fourth moment, a time error between the image and the sound in the multimedia file; and obtaining the lip synchronization delay based on the first moment, the second moment, and the time error the amount.
- the device under test is specifically: a conference television system, a video chat system or a video monitoring system.
- the embodiment of the present invention further provides a lip-synchronization test method, which is applied in a lip-synchronization test system, and the system includes: a playback device, a device under test, a connection with the playback device, a test device, and a Connected to the device under test, the method includes: Playing, by the playing device, a multimedia file with an image jump and synchronization of images and sounds;
- the lip synchronization delay amount of the device under test is obtained by the test device based on the first time and the second time.
- the method further includes:
- the test device Detecting, by the test device, whether the first image energy change map corresponding to the first image signal has an image energy jump, and when there is the image energy jump, recording when the image energy jump occurs a third time; detecting whether the first sound energy change map has a sound energy jump, and when the sound energy jumps, recording a fourth moment when the sound energy jump occurs, and then, based on The third time and the fourth time are obtained for characterizing a time error between the image and the sound in the multimedia file.
- the determining, by the test device, the lip synchronization delay amount of the device under test based on the first time and the second time specifically:
- the lip synchronization delay amount is obtained by the test device based on the first moment, the second moment, and the time error.
- the device under test is specifically: a conference television system, a video chat system or a video monitoring system.
- the image signal and the sound signal are from a multimedia file in which both the image and the sound have energy hopping and synchronization, the technical problem that the image and the sound cannot be synchronously collected in the prior art is effectively solved, and the realization is realized. Synchronous generation and acquisition of image signals and sound signals;
- the playback device plays a multimedia file with both image and sound energy jumping and synchronization, the synchronous image signal and the sound signal can be simultaneously output and input to the device under test, thereby effectively solving the input to be tested.
- the device is used, there is a technical problem that the image signal and the sound signal cannot be input to the device under test at the same time. Therefore, the technical effect of synchronous input of the image signal and the sound signal into the device under test is realized;
- the test device automatically detects whether the image signal and the sound signal output by the device under test have energy jumps, and calculates the energy hopping relative time difference between the image signal and the sound signal when there is an energy jump, thereby determining the lip delay.
- the time quantity effectively solves the technical problem that the accuracy of the judgment result in the prior art is low, and realizes the technical effect of the accurate quantized lip sync delay data.
- FIG. 1 is a structural diagram of a lip-synchronization test system according to Embodiment 1 of the present invention
- FIG. 2 is a structural diagram of a playback device in a system according to Embodiment 1 of the present invention
- 3 is a structural diagram of a device under test in a system according to Embodiment 1 of the present invention
- FIG. 4 is a structural diagram of a test device in a system according to Embodiment 1 of the present invention.
- FIG. 5 is a diagram showing image and sound energy transitions outputted by a test device in a system according to Embodiment 1 of the present invention.
- FIG. 6 is a flowchart of a lip sound synchronization test method according to Embodiment 2 of the present invention. detailed description
- Embodiments of the present invention provide a system and method for lip-synchronous testing to solve the technical problem that the accuracy of the judgment result existing in the prior art is low.
- the technical solution in the embodiment of the present invention is to solve the above technical problem.
- the general idea is as follows: a multimedia file that has an energy hopping and synchronization by playing a playback device and a sound; and a device connected to the playback device through the device under test, configured as Receiving a first image signal and a first sound signal output by the playback device when playing the multimedia file, and outputting a second image signal corresponding to the first image signal, and corresponding to the first sound signal Second sound signal;
- Connected to the device under test configured to receive the second image signal and the second sound signal, and output a second image energy change map corresponding to the second image signal, and a second sound energy change map corresponding to the second sound signal;
- the test device is further configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, record the first moment when the image energy jump occurs. Detecting whether the second sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a second moment when the sound energy jump occurs, and then, based on the first At the moment and the second moment, the lip synchronization delay amount of the device under test is obtained.
- the test device automatically detects whether the image signal and the sound signal output by the device under test have energy jumps, and calculates the energy jump of the image and the sound when there is an energy jump.
- the difference between the two is used to determine the lip delay amount, which effectively solves the technical problem that the accuracy of the judgment result in the prior art is low, and realizes the technical effect of accurately quantizing the lip sync delay data.
- Embodiment 1 is a diagrammatic representation of Embodiment 1:
- the test system in the embodiment of the present invention includes:
- the playback device 101 is configured to play a multimedia file in which both the image and the sound have energy hopping and synchronization.
- the multimedia file may be: a movie video, a music MV, or a specially produced video, but What video, both images and sounds need to have energy jumps, and the image and sound are synchronized.
- the form of the multimedia file can be: CD, or stored in a USB storage device.
- the device under test 102 is connected to the playback device 101, and configured to receive a first image signal and a first sound signal that are output by the playback device 101 when the multimedia file is played, and output a corresponding image signal.
- the second image signal, and the second sound signal corresponding to the first sound signal specifically, the device under test may be: a conference television system, a video chat system or a video surveillance system, all tested Devices all involve the encoding and decoding of image signals and sound signals.
- the test device 103 is connected to the device under test 102, configured to receive the second image signal and the second sound signal, and output a second image energy change map corresponding to the second image signal, and
- the second sound energy change map corresponding to the second sound signal specifically, the test device may be: an energy harvesting device having at least two channels, such as an oscilloscope, and capable of displaying image signal and sound signal energy jump Moment.
- the test device 103 is further configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, the image energy is recorded. a first moment of the transition; detecting whether the second sound energy change map has a sound energy jump, and when the sound energy jumps, recording the second moment when the sound energy jump occurs, Then, based on the first moment and the second moment, a lip synchronization delay amount of the device under test is obtained.
- the playback device 101 may be a conventional DVD player, a Blu-ray player, or a computer having a playback function. Not - for example.
- the structure of the playback device 101 may specifically include:
- the playing chip 1011 is configured to play the multimedia file, and output the first image signal and the first sound signal;
- the first image output interface 1012 is connected to the playing chip 1011 and configured to output the first image signal
- the first sound output interface 1013 is connected to the play chip 1011 and configured to output the first sound signal.
- the specific working process of the playback device 101 is as follows: First, the optical disc is placed in an optical disc drive of the DVD player; Then, the DVD player detects that the optical disc is in the optical disc drive; next, the play chip 1011 in the DVD player reads the optical disc to obtain the multimedia file, and the multimedia file The file is played back; finally, the first image signal outputted by the playback is output to the first image output interface 1012, and the first sound signal output by the playback is output to the first sound output interface 1013.
- the first image output interface 1012 and the first sound output interface 1013 may be two physically separate interfaces; or may be an integrated interface. What kind of interface is specifically, the present invention The examples here are not limited.
- the device under test 102 may specifically be a conference television system, a video chat system, or a video surveillance system.
- the device under test 102 may specifically include: a first image input interface 1021 connected to the first image output interface 1012 and configured to receive the first image signal.
- the first sound input interface 1022 is connected to the first sound output interface 1013 and configured to receive the first sound signal.
- the processing module 1023 is connected to the first image input interface 1021 and the first sound input interface 1022, and after processing the received first image signal, outputting the second image signal, After processing the received first sound signal, the second sound signal is output.
- the processing module 1023 is specifically a conference television function module; when the device under test 102 is specifically a video chat system, such as a QQ chat system, the processing module 1023 is specifically a QQ chat function module.
- a second image output interface 1024 coupled to the processing module 1023, configured to output the second image signal
- the second sound output interface 1025 is connected to the processing module 1023 and configured to output the second sound signal.
- the device under test 102 is connected to the playback device 101 and configured to receive a first image signal and a first output when the playback device 101 plays the multimedia file. a sound signal, and outputting a second image signal corresponding to the first image signal and a second sound signal corresponding to the first sound signal.
- the working process of the device under test 102 is as follows: the first image input interface 1021 of the conference television system, the first sound The input interface 1022 is respectively connected to the first image output interface 1012 and the first sound output interface 1013 in the playback device 101, and is configured to receive the playback device.
- the image signal and the sound signal outputted by the device 101 are processed by the processing module 1023, and finally the processed second image signal corresponding to the first image signal is output to the second image output interface 1024, and the processed image is processed.
- a second sound signal corresponding to a sound signal is output to the second sound output interface 1025.
- the testing device 103 may specifically be: an oscilloscope having at least two channels, the oscilloscope can automatically detect the energy hopping of the image signal and the sound signal and record the time of the hopping, specifically, please Referring to FIG. 4, the testing device 103 in the embodiment of the present invention includes:
- the detecting module 1033 is configured to detect whether the second image signal and the second sound signal energy change map have energy jumps;
- a second image input interface 1031 connected to the detecting module 1033, configured to input a second image signal
- a second sound input interface 1032 connected to the detecting module 1033, configured to input a second sound signal
- the display unit 1034 is connected to the detecting module 1033, and configured to display the detected second image signal energy change map and the detected second sound signal energy change map.
- the test device 103 is connected to the device under test 102, configured to receive the second image signal and the second sound signal, and output the second a second image energy change map corresponding to the image signal, and a second sound energy change map corresponding to the second sound signal;
- the test device 103 is further configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, record the first when the image energy jump occurs. Detecting whether the second sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a second moment when the sound energy jump occurs, and then, based on the At a moment and the second moment, obtaining the lip of the device under test 102 The amount of tone synchronization delay.
- the test device 103 in order to detect the device to be detected 102 more accurately, the test device 103 needs to be directly connected to the playback device 101. At this time, the test device 103 can output the same a first image energy change map corresponding to an image signal, and a first sound energy change map corresponding to the first sound signal;
- the first image energy change map corresponding to the first image signal is detected by the test device 103 to have an image energy jump, and when the image energy jumps, the image energy is recorded. a third moment of the transition; detecting whether the first sound energy change map has a sound energy jump, and when the sound energy jumps, recording the fourth moment when the sound energy jump occurs, Then, based on the third moment and the fourth moment, a time error for characterizing the image and the sound in the multimedia file is obtained.
- the lip sync delay amount is obtained by the test device 103 based on the first moment, the second moment, and the time error.
- the working process of the test device 103 is specifically as follows: the oscilloscope is connected to the device under test 102, the second image input interface 1031 and the second sound input
- the interface 1032 is configured to receive the second image signal and the second sound signal, and after detecting by the detecting module 1033, the display unit 1034 displays an energy change map of the second image signal and the second sound signal;
- the display unit 1034 displays an energy jump diagram of the second image signal, and records the first transition time T1, and detects the second sound.
- the display unit 1034 displays the energy jump diagram of the second sound signal, and records the second time ⁇ 2, and then obtains the lip sync delay amount (T2-T1) of the device under test 102. Please refer to Figure 5.
- the oscilloscope 103 display unit 1034 When the oscilloscope 103 is directly connected to the playback device 101, the oscilloscope 103 display unit 1034 first displays a first image energy change map corresponding to the first image signal, and The first sound signal corresponds to a first sound energy change map, and then, when the detecting module 1033 detects that the first image signal has an energy jump, the display unit 1034 displays the first image signal energy jump map, and records Jumping to the first time T3, when detecting that the second sound signal has an energy jump, the display unit 1034 displays an energy jump diagram of the second sound signal, and records the second time ⁇ 4, and then obtains for characterization The time error between the image and the sound in the multimedia file ( ⁇ 4- ⁇ 3).
- the lip oscilloscope synchronization delay amount (T2-T1)-( ⁇ 4- ⁇ 3 ) of the device under test 102 is obtained by the oscilloscope 103 based on the first time T1, the second time ⁇ 2, and the time error ( ⁇ 4- ⁇ 3).
- the image signal and the sound signal are from a multimedia file in which both the image and the sound have energy hopping and synchronization, the technical problem that the image and the sound cannot be synchronously collected in the prior art is effectively solved, and the realization is realized. Synchronous generation and acquisition of image signals and sound signals;
- the playback device plays a multimedia file with both image and sound energy jumping and synchronization, the synchronous image signal and the sound signal can be simultaneously output and input to the device under test, thereby effectively solving the input to be tested.
- the device is used, there is a technical problem that the image signal and the sound signal cannot be input to the device under test at the same time. Therefore, the technical effect of synchronous input of the image signal and the sound signal into the device under test is realized;
- the test device automatically detects whether the image signal and the sound signal output by the device under test have energy jumps, and calculates the energy hopping relative time difference between the image and the sound when there is an energy jump, thereby determining the lip delay amount.
- the utility model effectively solves the technical problem that the accuracy of the judgment result in the prior art is low, and realizes the technical effect of accurately quantizing the lip sync delay data.
- the embodiment of the present invention further provides a lip-synchronization test method.
- the method flow chart is as shown in FIG. 6 and is applied to a lip-synchronization test system.
- the system includes: a playback device 101, a device under test 102, and the playback device 101. Connecting, testing device 103, connected to the device under test 102
- the method includes:
- S501 plays, by the playing device 101, a multimedia file in which both images and sounds are energy-jumped and synchronized;
- S501 is specifically: after the playback device 101 plays the multimedia file by the playing chip 1011 of the playing device, the first image output interface 1012 of the playing device outputs the first An image signal, and the first sound output interface 1013 outputs a first sound signal.
- S502 receives, by the device under test 102, the first image signal and the first sound signal that are output by the playback device 101 when the multimedia file is played, and outputs a second image signal corresponding to the first image signal, and a second sound signal corresponding to the first sound signal; specifically, in the embodiment, S502 is specifically: the device under test 102 receives the first image output of the playback device through the first image input interface 1021. The first image signal output by the interface 1012 is received by the device under test 1022, and the first sound signal output by the first sound output interface 1013 of the playback device 101 is received by the device under test via the device under test 1023. After processing, the second image signal corresponding to the first image signal is output by the second image output interface 1024, and the second sound signal corresponding to the first sound signal is output by the second sound output interface 1025.
- the second image signal and the second sound signal are received by the testing device, and output a second image energy change map corresponding to the second image signal, and a corresponding to the second sound signal Second sound energy change diagram;
- S503 is specifically: the test device 103 receives the second image signal output by the second image output interface 1024 of the device under test through the second image input interface 1031, and the test device Receiving, by the second sound input interface 1032, the second sound signal output by the second sound output interface 1025 of the device under test, after being detected by the test device detecting module 1033, the display unit 1034 of the test device outputs the second image Signal pair a second image energy change map, and a second sound energy change map corresponding to the second sound signal.
- S504 detecting, by the testing device 103, whether the second image energy change map has an image energy jump, and recording, when the image energy jumps, the first moment when the image energy jump occurs; detecting Whether the second sound energy change map has a sound energy jump, and when the sound energy jumps, is recorded at a second moment when the sound energy jump occurs;
- the lip synchronization delay amount of the device under test is obtained by the test device based on the first time and the second time.
- S504 is specifically: the detecting module 1033 of the testing device detects whether the second image signal has energy jump, and displays the second image signal energy change graph on the display unit 1034 of the testing device. And when there is an energy jump, simultaneously recording the first time T1 when the energy of the second image signal is hopping; the detecting module 1033 of the testing device detects whether the second sound signal has an energy jump, in the test
- the display unit 1034 of the device displays a second sound signal energy change map, and simultaneously records the second time T2 when the second sound signal energy jumps when there is an energy jump, based on the first time and the first At the second moment, the lip synchronization delay amount (T2-T1) of the device under test is obtained.
- S505 is specifically: the second image input interface 1031 of the test device is connected to the first image output interface 1012 of the playback device, and the second sound input interface 1032 of the test device is Connected to the first sound output interface 1013 of the playback device, after being detected by the detection module 1033 of the test device, the display unit 1034 of the test device outputs a first image energy change map corresponding to the first image signal. And a first sound energy change map corresponding to the first sound signal;
- the test device detecting module 1033 detects whether the first image energy change map has an energy jump, and when the image energy jumps, records that the test device display unit 1034 displays the third time T3 of the jump.
- the test device detection module 1033 detects whether the first sound energy change map has an energy jump, and when the sound energy jumps, records that the test device display unit 1034 displays the fourth time T4 of the jump. Then, based on the third time ⁇ 3 and the fourth time ⁇ 4, a time error ( ⁇ 4- ⁇ 3) between the image and the sound in the multimedia file is obtained.
- S506 obtains the lip synchronization delay amount by the test device based on the first time T1, the second time, and the time error ⁇ 2.
- the lip synchronization delay amount is obtained as: (T2-T1) -( ⁇ 4- ⁇ 3 ).
- the playback device plays a multimedia file with both image and sound energy jumping and synchronization
- the synchronous image signal and the sound signal can be simultaneously output and input to the device under test, thereby effectively solving the input to be tested.
- the image signal and the sound signal cannot be input to the device under test at the same time, so the image letter is realized.
- the signal and the sound signal are synchronously input into the technical effect of the device under test;
- the test device automatically detects whether the image signal and the sound signal output by the device under test have energy jumps, and calculates the energy hopping relative time difference between the image and the sound when there is an energy jump, thereby determining the lip delay amount.
- the utility model effectively solves the technical problem that the accuracy of the judgment result in the prior art is low, and realizes the technical effect of accurately quantizing the lip sync delay data.
- the present invention provides a lip synchronization test system and method, wherein the system includes: a playback device configured to play a multimedia file in which both images and sounds have energy jumps and synchronization; and the device under test is connected to the playback device And configured to receive a first image signal and a first sound signal output by the playback device when playing the multimedia file, and output a second image signal corresponding to the first image signal, and the first sound a second sound signal corresponding to the signal; a test device connected to the device under test, configured to receive the second image signal and the second sound signal, and output a second image corresponding to the second image signal An energy change map, and a second sound energy change map corresponding to the second sound signal; wherein the test device is further configured to detect whether the second image energy change map has an image energy jump, and detect the Whether the second sound energy change map has a sound energy jump.
- the present invention can solve the technical problem that the accuracy of the judgment result existing in the prior art is low.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Signal Processing For Recording (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
A lip synchronization test system and method. The system comprises: a playing device (101) configured to play a multimedia file with an image and sound both having an energy jump and being synchronous; a device to be tested (102) configured to receive a first image signal and a first sound signal output by the playing device (101) when playing the multimedia file, and output a second image signal corresponding to the first image signal and a second sound signal corresponding to the first sound signal; and a test device (103) configured to receive the second image signal and the second sound signal, and output a second image energy variation graph and a second sound energy variation graph; wherein the test device (103) is also configured to detect whether the second image energy variation graph has an image energy jump, and detect whether the second sound energy variation graph has a sound energy jump.
Description
一种唇音同步测试的系统与方法 技术领域 System and method for lip sound synchronization test
本发明涉及测试技术领域, 尤其涉及一种唇音同步测试的系统与方法。 背景技术 The present invention relates to the field of testing technologies, and in particular, to a system and method for lip-synchronous testing. Background technique
随着网络技术和通信技术的不断发展, 越来越多的应用都涉及到多媒 体数据的传输, 如: 在进行视频聊天时, 就需要将包含视频信号和声音信 号的多媒体数据从一个客户终端传输到另一个或多个客户终端; 在进行视 频会议时, 就需要将包含一参会者的视频信号和声音信号的多媒体数据从 一会议终端传输给另一个参会者的另一会议终端。 With the continuous development of network technology and communication technology, more and more applications involve the transmission of multimedia data, such as: When performing video chat, it is necessary to transmit multimedia data including video signals and sound signals from a client terminal. To another one or more client terminals; when performing a video conference, it is necessary to transmit multimedia data including a participant's video signal and sound signal from one conference terminal to another conference terminal of another participant.
由于各种各样的原因, 在现有技术中就会导致图像和声音不同步的情 况, 如: 由于网络传输的原因, 导致声音信号先被接收到, 图像信号后被 接收到, 进而导致声音和图像的不同步。 For various reasons, in the prior art, the image and the sound are not synchronized, such as: due to the network transmission, the sound signal is received first, and the image signal is received, which leads to sound. Not synchronized with the image.
在上述各种各样的原因中, 其中一种重要的原因是, 由于设备原因导 致的, 如: 接收方会议电视系统本身在处理时就存在延迟, 进而导致图像 和声音不同步。 所以, 在使用过程中, 对会议电视系统进行测试, 确定其 是否正常是非常重要的。 Among the various reasons mentioned above, one of the important reasons is that due to equipment reasons, such as: The receiving party's conference television system itself has a delay in processing, which in turn causes images and sounds to be out of sync. Therefore, it is very important to test the conference TV system during use to determine if it is normal.
为此, 现有技术通常采用的方法如下: To this end, the methods commonly used in the prior art are as follows:
采用人工主观判断的方式进行, 即: 即通过麦克风和摄像头相结合, 对图像及声音进行采集, 人在听到声音的同时, 通过眼睛去观察图像变化, 进而主观地判断该声音和图像是否同步。 The method of manual subjective judgment is adopted, that is, the image and the sound are collected through the combination of the microphone and the camera, and the person observes the image change through the eyes while hearing the sound, and then subjectively judges whether the sound and the image are synchronized. .
在实现本发明实施例中技术方案的过程中, 发明人发现现有技术中至 少存在如下问题: In the process of implementing the technical solution in the embodiment of the present invention, the inventors found that at least the following problems exist in the prior art:
1、 由于在现有技术中, 是采用人工方式去控制麦克风和摄像头去对声
音和图像进行采集, 而在实际中, 不能同时去启动麦克风和摄像头, 所以, 存在不能保证对图像和声音进行同步采集的技术问题; 1. In the prior art, the manual method is used to control the microphone and the camera to go to the opposite sound. The sound and the image are collected, but in practice, the microphone and the camera cannot be activated at the same time, so there is a technical problem that the image and sound cannot be synchronously collected;
2、 由于在现有技术中, 是通过麦克风和摄像头两个独立的设备来对声 音和图像进行采集的, 所以, 在输入到被测试设备时, 就存在不能保证在 同一时刻将图像信号和声音信号输入到被测试设备的技术问题; 2. In the prior art, the sound and the image are collected by two independent devices, a microphone and a camera. Therefore, when inputting to the device under test, there is no guarantee that the image signal and sound will be at the same time. The technical problem of signal input to the device under test;
3、 由于在现有技术中, 在判断时, 是采用人工的方式进行判断, 主观 性和随意性较大, 所以, 存在判断结果准确性很低的技术问题。 发明内容 3. In the prior art, when judging, the judgment is performed manually, and subjectivity and arbitrariness are large, so there is a technical problem that the accuracy of the judgment result is low. Summary of the invention
本发明实施例通过提供一种唇音同步测试的系统及方法, 用以解决现 有技术中存在的判断结果准确性很低的技术问题。 Embodiments of the present invention provide a system and method for lip-synchronous testing to solve the technical problem that the accuracy of the judgment result existing in the prior art is low.
为解决上述技术问题, 本发明实施例一方面提供了一种唇音同步测试 系统, 包括: In order to solve the above technical problem, an embodiment of the present invention provides a lip synchronization test system, including:
播放设备, 配置为播放图像和声音均有能量跳变且同步的多媒体文件; 被测试设备, 与所述播放设备连接, 配置为接收所述播放设备在播放 所述多媒体文件时输出的第一图像信号和第一声音信号, 并输出与所述第 一图像信号对应的第二图像信号, 及与所述第一声音信号对应的第二声音 信号; a playback device, configured to play a multimedia file with an energy jump and synchronization of the image and the sound; the device under test, connected to the playback device, configured to receive the first image output by the playback device when playing the multimedia file a signal and a first sound signal, and outputting a second image signal corresponding to the first image signal, and a second sound signal corresponding to the first sound signal;
测试设备, 与所述被测试设备连接, 配置为接收所述第二图像信号及 所述第二声音信号, 并输出与所述第二图像信号对应的第二图像能量变化 图, 及与所述第二声音信号对应的第二声音能量变化图; a test device, coupled to the device under test, configured to receive the second image signal and the second sound signal, and output a second image energy change map corresponding to the second image signal, and a second sound energy change map corresponding to the second sound signal;
其中, 所述测试设备还配置为检测所述第二图像能量变化图是否有图 像能量跳变, 并在有所述图像能量跳变时, 记录在发生所述图像能量跳变 时的第一时刻; 检测所述第二声音能量变化图是否有声音能量跳变, 并在 有所述声音能量跳变时, 记录在发生所述声音能量跳变时的第二时刻, 然 后, 基于所述第一时刻及所述第二时刻, 获得所述被测试设备的唇音同步
延时量。 The test device is further configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, record the first moment when the image energy jump occurs. Detecting whether the second sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a second moment when the sound energy jump occurs, and then, based on the first At the moment and the second moment, obtaining lip sync of the device under test The amount of delay.
较佳地, 所述播放设备包括: Preferably, the playing device comprises:
播放芯片, 配置为播放所述多媒体文件, 输出所述第一图像信号及所 述第一声音信号; a playing chip configured to play the multimedia file, output the first image signal and the first sound signal;
第一图像输出接口, 与所述播放芯片连接, 配置为输出所述第一图像 信号; a first image output interface, connected to the playing chip, configured to output the first image signal;
第一声音输出接口, 与所述播放芯片连接, 配置为输出所述第一声音 信号。 The first sound output interface is coupled to the play chip and configured to output the first sound signal.
较佳地, 所述被测试设备包括: Preferably, the device under test comprises:
第一图像输入接口, 与所述第一图像输出接口连接, 配置为接收所述 第一图像信号; a first image input interface, coupled to the first image output interface, configured to receive the first image signal;
第一声音输入接口, 与所述第一声音输出接口连接, 配置为接收所述 第一声音信号; a first sound input interface, coupled to the first sound output interface, configured to receive the first sound signal;
处理模块, 与所述第一图像输入接口及所述第一声音输入接口连接, 并在对接收到的所述第一图像信号进行处理后, 输出所述第二图像信号, 在对接收到所述第一声音信号进行处理后, 输出所述第二声音信号; a processing module, connected to the first image input interface and the first sound input interface, and after processing the received first image signal, outputting the second image signal, in receiving the received image After the first sound signal is processed, the second sound signal is output;
第二图像输出接口, 与所述处理模块连接, 配置为输出所述第二图像 信号; a second image output interface, coupled to the processing module, configured to output the second image signal;
第二声音输出接口, 与所述处理模块连接, 配置为输出所述第二声音 信号。 The second sound output interface is coupled to the processing module and configured to output the second sound signal.
较佳地, 所述测试设备包括: Preferably, the testing device comprises:
第二图像输入接口, 与所述第二图像输出接口连接, 配置为接收所述 第二图像信号; a second image input interface, coupled to the second image output interface, configured to receive the second image signal;
第二声音输入接口, 与所述第二声音输出接口连接, 配置为接收所述 第二声音信号;
显示单元, 与所述第二图像输入接口及所述第二声音输入接口连接, 配置为输出与所述第二图像信号对应的第二图像能量变化图, 及与所述第 二声音信号对应的第二声音能量变化图; a second sound input interface, connected to the second sound output interface, configured to receive the second sound signal; a display unit, configured to output a second image energy change map corresponding to the second image signal, and the second image input interface and the second sound input interface, and corresponding to the second sound signal Second sound energy change map;
测试模块, 与所述显示单元连接, 配置为检测所述第二图像能量变化 图是否有图像能量跳变, 并在有所述图像能量跳变时, 记录在发生所述图 像能量跳变时的第一时刻; 检测所述第二声音能量变化图是否有声音能量 跳变, 并在有所述声音能量跳变时, 记录在发生所述声音能量跳变时的第 二时刻, 然后, 基于所述第一时刻及所述第二时刻, 获得所述被测试设备 的唇音同步延时量。 a test module, configured to be connected to the display unit, configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, record the occurrence of the image energy jump a first moment; detecting whether the second sound energy change map has a sound energy jump, and when the sound energy jumps, recording a second moment when the sound energy jump occurs, and then, based on At the first moment and the second moment, the lip synchronization delay amount of the device under test is obtained.
较佳地, 在所述第二图像输入接口与所述第一图像输出接口连接, 所 述第二声音输入接口与所述第一声音输出接口连接时, 所述显示单元, 还 配置为输出与所述第一图像信号对应的第一图像能量变化图, 及与所述第 一声音信号对应的第一声音能量变化图; Preferably, when the second image input interface is connected to the first image output interface, and the second sound input interface is connected to the first sound output interface, the display unit is further configured to output and a first image energy change map corresponding to the first image signal, and a first sound energy change map corresponding to the first sound signal;
所述测试模块, 还配置为检测所述第一图像能量变化图是否有图像能 量跳变, 并在有所述图像能量跳变时, 记录在发生所述图像能量跳变时的 第三时刻; 检测所述第一声音能量变化图是否有声音能量跳变, 并在有所 述声音能量跳变时, 记录在发生所述声音能量跳变时的第四时刻, 然后, 基于所述第三时刻及所述第四时刻, 获得用于表征所述多媒体文件中图像 和声音间的时间误差; 并基于所述第一时刻, 所述第二时刻及所述时间误 差, 获得所述唇音同步延时量。 The test module is further configured to detect whether the first image energy change map has an image energy jump, and when there is the image energy jump, record a third moment when the image energy jump occurs; Detecting whether the first sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a fourth moment when the sound energy jump occurs, and then, based on the third moment And obtaining, by the fourth moment, a time error between the image and the sound in the multimedia file; and obtaining the lip synchronization delay based on the first moment, the second moment, and the time error the amount.
较佳地, 所述被测试设备具体为: 会议电视系统, 视频聊天系统或视 频监控系统。 Preferably, the device under test is specifically: a conference television system, a video chat system or a video monitoring system.
另一方面, 本发明实施例中还提供一种唇音同步测试方法, 应用在唇 音同步测试系统中, 所述系统包括: 播放设备, 被测试设备, 与所述播放 设备连接, 测试设备, 与所述被测试设备连接, 所述方法包括:
通过所述播放设备播放一图像和声音均有能量跳变且同步的多媒体文 件; On the other hand, the embodiment of the present invention further provides a lip-synchronization test method, which is applied in a lip-synchronization test system, and the system includes: a playback device, a device under test, a connection with the playback device, a test device, and a Connected to the device under test, the method includes: Playing, by the playing device, a multimedia file with an image jump and synchronization of images and sounds;
通过所述被测试设备接收所述播放设备在播放所述多媒体文件时输出 的第一图像信号和第一声音信号, 并输出与所述第一图像信号对应的第二 图像信号, 及与所述第一声音信号对应的第二声音信号; Receiving, by the device under test, a first image signal and a first sound signal output by the playback device when playing the multimedia file, and outputting a second image signal corresponding to the first image signal, and a second sound signal corresponding to the first sound signal;
通过所述测试设备接收所述第二图像信号及所述第二声音信号, 并输 出与所述第二图像信号对应的第二图像能量变化图, 及与所述第二声音信 号对应的第二声音能量变化图; Receiving, by the testing device, the second image signal and the second sound signal, and outputting a second image energy change map corresponding to the second image signal, and a second corresponding to the second sound signal Sound energy change diagram;
通过所述测试设备检测所述第二图像能量变化图是否有图像能量跳 变, 并在有所述图像能量跳变时, 记录在发生所述图像能量跳变时的第一 时刻; 检测所述第二声音能量变化图是否有声音能量跳变, 并在有所述声 音能量跳变时, 记录在发生所述声音能量跳变时的第二时刻; Detecting, by the test device, whether the second image energy change map has an image energy jump, and when there is the image energy jump, recording a first moment when the image energy jump occurs; detecting the Whether the second sound energy change map has a sound energy jump, and when the sound energy jumps, is recorded at a second moment when the sound energy jump occurs;
通过所述测试设备基于所述第一时刻及所述第二时刻, 获得所述被测 试设备的唇音同步延时量。 The lip synchronization delay amount of the device under test is obtained by the test device based on the first time and the second time.
较佳地, 在所述通过所述测试设备基于所述第一时刻及所述第二时刻, 获得所述被测试设备的唇音同步延时量之前, 所述方法还包括: Preferably, before the obtaining, by the test device, the lip synchronization delay amount of the device under test based on the first time and the second time, the method further includes:
在将所述测试设备与所述播放设备直接连接时, 通过所述测试设备输 出与所述第一图像信号对应的第一图像能量变化图, 及与所述第一声音信 号对应的第一声音能量变化图; Outputting, by the test device, a first image energy change map corresponding to the first image signal and a first sound corresponding to the first sound signal when the test device is directly connected to the playback device Energy change map;
通过所述测试设备检测与所述第一图像信号对应的第一图像能量变化 图是否有图像能量跳变, 并在有所述图像能量跳变时, 记录在发生所述图 像能量跳变时的第三时刻; 检测所述第一声音能量变化图是否有声音能量 跳变, 并在有所述声音能量跳变时, 记录在发生所述声音能量跳变时的第 四时刻, 然后, 基于所述第三时刻及所述第四时刻, 获得用于表征所述多 媒体文件中图像和声音间的时间误差。
较佳地, 所述通过所述测试设备基于所述第一时刻及所述第二时刻, 获得所述被测试设备的唇音同步延时量, 具体为: Detecting, by the test device, whether the first image energy change map corresponding to the first image signal has an image energy jump, and when there is the image energy jump, recording when the image energy jump occurs a third time; detecting whether the first sound energy change map has a sound energy jump, and when the sound energy jumps, recording a fourth moment when the sound energy jump occurs, and then, based on The third time and the fourth time are obtained for characterizing a time error between the image and the sound in the multimedia file. Preferably, the determining, by the test device, the lip synchronization delay amount of the device under test based on the first time and the second time, specifically:
通过所述测试设备基于所述第一时刻, 所述第二时刻及所述时间误差, 获得所述唇音同步延时量。 The lip synchronization delay amount is obtained by the test device based on the first moment, the second moment, and the time error.
较佳地, 所述被测试设备具体为: 会议电视系统, 视频聊天系统或视 频监控系统。 Preferably, the device under test is specifically: a conference television system, a video chat system or a video monitoring system.
本发明实施例通过以上提供的一个或多个技术方案, 至少具有以下有 益效果或者优点: The embodiment of the present invention has at least the following beneficial effects or advantages through one or more of the technical solutions provided above:
1、 由于图像信号和声音信号来自于一图像和声音均有能量跳变且同步 的多媒体文件, 所以, 有效解决了现有技术中存在不能保证对图像和声音 进行同步采集的技术问题, 实现了图像信号和声音信号的同步生成和获得 的技术效果; 1. Since the image signal and the sound signal are from a multimedia file in which both the image and the sound have energy hopping and synchronization, the technical problem that the image and the sound cannot be synchronously collected in the prior art is effectively solved, and the realization is realized. Synchronous generation and acquisition of image signals and sound signals;
2、 由于采用播放设备播放一图像和声音均有能量跳变且同步的多媒体 文件, 所以, 能够同时输出同步的图像信号和声音信号, 并输入到被测试 设备, 进而有效解决在输入到被测试设备时, 存在不能保证在同一时刻将 图像信号和声音信号输入到被测试设备的技术问题, 所以, 实现了图像信 号和声音信号同步输入被测试设备的技术效果; 2. Since the playback device plays a multimedia file with both image and sound energy jumping and synchronization, the synchronous image signal and the sound signal can be simultaneously output and input to the device under test, thereby effectively solving the input to be tested. When the device is used, there is a technical problem that the image signal and the sound signal cannot be input to the device under test at the same time. Therefore, the technical effect of synchronous input of the image signal and the sound signal into the device under test is realized;
3、 由于采用测试设备自动检测被测试设备输出的图像信号和声音信号 是否有能量跳变, 并在有能量跳变时计算图像信号和声音信号的能量跳变 相对时间差, 以此来确定唇音延时量, 有效解决了现有技术中存在判断结 果准确性很低的技术问题, 实现了精确的量化的唇音同步延时数据的技术 效果。 附图说明 3. The test device automatically detects whether the image signal and the sound signal output by the device under test have energy jumps, and calculates the energy hopping relative time difference between the image signal and the sound signal when there is an energy jump, thereby determining the lip delay. The time quantity effectively solves the technical problem that the accuracy of the judgment result in the prior art is low, and realizes the technical effect of the accurate quantized lip sync delay data. DRAWINGS
图 1为本发明实施例一中的实现唇音同步测试系统的结构图; 图 2为本发明实施例一中系统中播放设备的结构图;
图 3为本发明实施例一中系统中被测设备的结构图; 1 is a structural diagram of a lip-synchronization test system according to Embodiment 1 of the present invention; FIG. 2 is a structural diagram of a playback device in a system according to Embodiment 1 of the present invention; 3 is a structural diagram of a device under test in a system according to Embodiment 1 of the present invention;
图 4为本发明实施例一中系统中测试设备的结构图; 4 is a structural diagram of a test device in a system according to Embodiment 1 of the present invention;
图 5 为本发明实施例一中系统中测试设备输出的图像和声音能量跳变 图; FIG. 5 is a diagram showing image and sound energy transitions outputted by a test device in a system according to Embodiment 1 of the present invention; FIG.
图 6为本发明实施例二中的实现唇音同步测试方法的流程图。 具体实施方式 FIG. 6 is a flowchart of a lip sound synchronization test method according to Embodiment 2 of the present invention. detailed description
本发明实施例通过提供一种唇音同步测试的系统及方法, 用以解决现有 技术中存在的判断结果准确性很低的技术问题。 Embodiments of the present invention provide a system and method for lip-synchronous testing to solve the technical problem that the accuracy of the judgment result existing in the prior art is low.
本发明实施例中的技术方案为解决上述技术问题, 总体思路如下: 通过播放设备播放图像和声音均有能量跳变且同步的多媒体文件; 通过被测试设备, 与所述播放设备连接, 配置为接收所述播放设备在播 放所述多媒体文件时输出的第一图像信号和第一声音信号, 并输出与所述 第一图像信号对应的第二图像信号, 及与所述第一声音信号对应的第二声 音信号; The technical solution in the embodiment of the present invention is to solve the above technical problem. The general idea is as follows: a multimedia file that has an energy hopping and synchronization by playing a playback device and a sound; and a device connected to the playback device through the device under test, configured as Receiving a first image signal and a first sound signal output by the playback device when playing the multimedia file, and outputting a second image signal corresponding to the first image signal, and corresponding to the first sound signal Second sound signal;
通过测试设备, 与所述被测试设备连接, 配置为接收所述第二图像信 号及所述第二声音信号, 并输出与所述第二图像信号对应的第二图像能量 变化图, 及与所述第二声音信号对应的第二声音能量变化图; Connected to the device under test, configured to receive the second image signal and the second sound signal, and output a second image energy change map corresponding to the second image signal, and a second sound energy change map corresponding to the second sound signal;
其中, 所述测试设备还配置为检测所述第二图像能量变化图是否有图像 能量跳变, 并在有所述图像能量跳变时, 记录在发生所述图像能量跳变时 的第一时刻; 检测所述第二声音能量变化图是否有声音能量跳变, 并在有 所述声音能量跳变时, 记录在发生所述声音能量跳变时的第二时刻, 然后, 基于所述第一时刻及所述第二时刻, 获得所述被测试设备的唇音同步延时 量。 The test device is further configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, record the first moment when the image energy jump occurs. Detecting whether the second sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a second moment when the sound energy jump occurs, and then, based on the first At the moment and the second moment, the lip synchronization delay amount of the device under test is obtained.
可见, 由于采用测试设备自动检测被测试设备输出的图像信号和声音信 号是否有能量跳变, 并在有能量跳变时计算图像和声音的能量跳变相对时
间差, 以此来确定唇音延时量, 有效解决了现有技术中存在判断结果准确 性很低的技术问题, 实现了精确的量化的唇音同步延时数据的技术效果。 It can be seen that the test device automatically detects whether the image signal and the sound signal output by the device under test have energy jumps, and calculates the energy jump of the image and the sound when there is an energy jump. The difference between the two is used to determine the lip delay amount, which effectively solves the technical problem that the accuracy of the judgment result in the prior art is low, and realizes the technical effect of accurately quantizing the lip sync delay data.
为了更好的理解上述技术方案, 下面将结合说明书附图以及具体的实 施方式对上述技术方案进行详细的说明。 In order to better understand the above technical solutions, the above technical solutions will be described in detail below in conjunction with the drawings and specific embodiments.
实施例一: Embodiment 1:
在实施例一中, 提供了一种唇音同步测试系统, 请参考图 1, 本发明实 施例中的测试系统包括: In the first embodiment, a lip synchronization test system is provided. Referring to FIG. 1, the test system in the embodiment of the present invention includes:
播放设备 101,配置为播放图像和声音均有能量跳变且同步的多媒体文 件,具体来讲,所述多媒体文件具体可以为:一段电影视频,一段音乐 MV, 或者专门制作的视频, 但无论是什么视频, 都需要其中的图像和声音均有 能量跳变, 而且需要图像和声音同步。 对于多媒体文件的存在形式可以为: 光盘, 或存储在 USB存储设备中。 The playback device 101 is configured to play a multimedia file in which both the image and the sound have energy hopping and synchronization. Specifically, the multimedia file may be: a movie video, a music MV, or a specially produced video, but What video, both images and sounds need to have energy jumps, and the image and sound are synchronized. The form of the multimedia file can be: CD, or stored in a USB storage device.
被测试设备 102, 与所述播放设备 101连接, 配置为接收所述播放设备 101在播放所述多媒体文件时输出的第一图像信号和第一声音信号,并输出 与所述第一图像信号对应的第二图像信号, 及与所述第一声音信号对应的 第二声音信号, 具体来讲, 所述被测试设备具体可以为: 会议电视系统, 视频聊天系统或者视频监控系统, 所有的被测试设备都涉及对图像信号和 声音信号的编解码。 The device under test 102 is connected to the playback device 101, and configured to receive a first image signal and a first sound signal that are output by the playback device 101 when the multimedia file is played, and output a corresponding image signal. The second image signal, and the second sound signal corresponding to the first sound signal, specifically, the device under test may be: a conference television system, a video chat system or a video surveillance system, all tested Devices all involve the encoding and decoding of image signals and sound signals.
测试设备 103, 与所述被测试设备 102连接, 配置为接收所述第二图像 信号及所述第二声音信号, 并输出与所述第二图像信号对应的第二图像能 量变化图, 及与所述第二声音信号对应的第二声音能量变化图, 具体来讲, 所述测试设备具体可以为: 示波器等具有至少两个通道的能量采集设备, 并且能够显示图像信号和声音信号能量跳变的时刻。 The test device 103 is connected to the device under test 102, configured to receive the second image signal and the second sound signal, and output a second image energy change map corresponding to the second image signal, and The second sound energy change map corresponding to the second sound signal, specifically, the test device may be: an energy harvesting device having at least two channels, such as an oscilloscope, and capable of displaying image signal and sound signal energy jump Moment.
其中, 所述测试设备 103还配置为检测所述第二图像能量变化图是否 有图像能量跳变, 并在有所述图像能量跳变时, 记录在发生所述图像能量
跳变时的第一时刻; 检测所述第二声音能量变化图是否有声音能量跳变, 并在有所述声音能量跳变时, 记录在发生所述声音能量跳变时的第二时刻, 然后, 基于所述第一时刻及所述第二时刻, 获得所述被测试设备的唇音同 步延时量。 The test device 103 is further configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, the image energy is recorded. a first moment of the transition; detecting whether the second sound energy change map has a sound energy jump, and when the sound energy jumps, recording the second moment when the sound energy jump occurs, Then, based on the first moment and the second moment, a lip synchronization delay amount of the device under test is obtained.
下面, 将结合图 2, 图 3图 4及图 5, 对于本发明实施例中的测试系统 中每部分的具体结构及工作原理进行描述: In the following, the specific structure and working principle of each part in the test system in the embodiment of the present invention will be described with reference to FIG. 2, FIG. 3, FIG. 4 and FIG.
请参考图 2, 在本发明实施例中, 所述播放设备 101 具体可以为普通 DVD播放器, 也可以为蓝光播放器, 也可以为一具有播放功能的电脑等, 在此本发明实施例中就不——举例了。 具体来讲, 播放设备 101 的结构, 具体可以包括: Referring to FIG. 2, in the embodiment of the present invention, the playback device 101 may be a conventional DVD player, a Blu-ray player, or a computer having a playback function. Not - for example. Specifically, the structure of the playback device 101 may specifically include:
播放芯片 1011, 配置为播放所述多媒体文件, 输出所述第一图像信号 及所述第一声音信号; The playing chip 1011 is configured to play the multimedia file, and output the first image signal and the first sound signal;
第一图像输出接口 1012, 与所述播放芯片 1011连接, 配置为输出所述 第一图像信号; The first image output interface 1012 is connected to the playing chip 1011 and configured to output the first image signal;
第一声音输出接口 1013, 与所述播放芯片 1011连接, 配置为输出所述 第一声音信号。 The first sound output interface 1013 is connected to the play chip 1011 and configured to output the first sound signal.
当所述播放设备 101具体为 DVD播放器,所述多媒体文件的存在形式 为光盘时, 所述播放设备 101 的具体工作过程如下: 首先将所述光盘放入 所述 DVD播放器的光驱中; 然后, 所述 DVD播放器就会检测到光驱中有 所述光盘;接下来, DVD播放器中的播放芯片 1011就会对所述光盘进行读 操作, 获得所述多媒体文件, 并对所述多媒体文件进行播放操作; 最后, 将通过播放输出的第一图像信号输出到所述第一图像输出接口 1012, 将通 过播放输出的第一声音信号输出到所述第一声音输出接口 1013。 在实际应 用中, 第一图像输出接口 1012和第一声音输出接口 1013可以为两个物理 上分离的接口; 也可以为集成在一起的接口。 具体为何种接口, 本发明实
施例在此, 不作限制。 When the playback device 101 is specifically a DVD player, and the multimedia file exists in the form of an optical disc, the specific working process of the playback device 101 is as follows: First, the optical disc is placed in an optical disc drive of the DVD player; Then, the DVD player detects that the optical disc is in the optical disc drive; next, the play chip 1011 in the DVD player reads the optical disc to obtain the multimedia file, and the multimedia file The file is played back; finally, the first image signal outputted by the playback is output to the first image output interface 1012, and the first sound signal output by the playback is output to the first sound output interface 1013. In practical applications, the first image output interface 1012 and the first sound output interface 1013 may be two physically separate interfaces; or may be an integrated interface. What kind of interface is specifically, the present invention The examples here are not limited.
被测试设备 102, 在本发明实施例中, 具体可以为会议电视系统、 视频 聊天系统或视频监控系统。 请参考图 3, 被测试设备 102具体可以包括: 第一图像输入接口 1021, 与所述第一图像输出接口 1012连接, 配置为 接收所述第一图像信号。 The device under test 102, in the embodiment of the present invention, may specifically be a conference television system, a video chat system, or a video surveillance system. Referring to FIG. 3, the device under test 102 may specifically include: a first image input interface 1021 connected to the first image output interface 1012 and configured to receive the first image signal.
第一声音输入接口 1022, 与所述第一声音输出接口连接 1013, 配置为 接收所述第一声音信号。 The first sound input interface 1022 is connected to the first sound output interface 1013 and configured to receive the first sound signal.
处理模块 1023, 与所述第一图像输入接口 1021, 及所述第一声音输入 接口 1022连接, 并在对接收到的所述第一图像信号进行处理后, 输出所述 第二图像信号, 在对接收到所述第一声音信号进行处理后, 输出所述第二 声音信号。 当被测试设备 102具体为会议电视系统时, 处理模块 1023具体 为会议电视功能模块; 当被测试设备 102具体为视频聊天系统, 如 QQ聊 天系统时, 处理模块 1023具体为 QQ聊天功能模块。 The processing module 1023 is connected to the first image input interface 1021 and the first sound input interface 1022, and after processing the received first image signal, outputting the second image signal, After processing the received first sound signal, the second sound signal is output. When the device under test 102 is specifically a conference television system, the processing module 1023 is specifically a conference television function module; when the device under test 102 is specifically a video chat system, such as a QQ chat system, the processing module 1023 is specifically a QQ chat function module.
第二图像输出接口 1024, 与所述处理模块 1023连接, 配置为输出所述 第二图像信号; a second image output interface 1024, coupled to the processing module 1023, configured to output the second image signal;
第二声音输出接口 1025, 与所述处理模块 1023连接, 配置为输出所述 第二声音信号。 The second sound output interface 1025 is connected to the processing module 1023 and configured to output the second sound signal.
在本发明实施例中, 结合图 1可知, 被测试设备 102, 是与所述播放设 备 101连接, 配置为接收所述播放设备 101在播放所述多媒体文件时输出 的第一图像信号和第一声音信号, 并输出与所述第一图像信号对应的第二 图像信号, 及与所述第一声音信号对应的第二声音信号。 In the embodiment of the present invention, as shown in FIG. 1 , the device under test 102 is connected to the playback device 101 and configured to receive a first image signal and a first output when the playback device 101 plays the multimedia file. a sound signal, and outputting a second image signal corresponding to the first image signal and a second sound signal corresponding to the first sound signal.
具体来讲, 在本实施例中, 当所述被测试设备 102具体为会议电视系统 时, 所述被测试设备 102工作过程如下: 所述会议电视系统的第一图像输 入接口 1021, 第一声音输入接口 1022, 分别与所述播放设备 101中的第一 图像输出接口 1012, 第一声音输出接口 1013连接, 配置为接收所述播放设
备 101输出的图像信号和声音信号, 经过所述处理模块 1023处理操作, 最 后将处理后的与第一图像信号对应的第二图像信号输出到第二图像输出接 口 1024, 将处理后的与第一声音信号对应的第二声音信号输出到第二声音 输出接口 1025。 Specifically, in the embodiment, when the device under test 102 is specifically a conference television system, the working process of the device under test 102 is as follows: the first image input interface 1021 of the conference television system, the first sound The input interface 1022 is respectively connected to the first image output interface 1012 and the first sound output interface 1013 in the playback device 101, and is configured to receive the playback device. The image signal and the sound signal outputted by the device 101 are processed by the processing module 1023, and finally the processed second image signal corresponding to the first image signal is output to the second image output interface 1024, and the processed image is processed. A second sound signal corresponding to a sound signal is output to the second sound output interface 1025.
在本发明实施例中, 测试设备 103, 具体可以为: 具有至少两个通道的 示波器, 该示波器能够自动检测图像信号和声音信号的能量跳变并且记录 下跳变的时刻, 具体来讲, 请参考图 4, 本发明实施例中的测试设备 103包 括: In the embodiment of the present invention, the testing device 103 may specifically be: an oscilloscope having at least two channels, the oscilloscope can automatically detect the energy hopping of the image signal and the sound signal and record the time of the hopping, specifically, please Referring to FIG. 4, the testing device 103 in the embodiment of the present invention includes:
检测模块 1033, 配置为检测所述第二图像信号, 及所述第二声音信号 能量变化图是否有能量跳变; The detecting module 1033 is configured to detect whether the second image signal and the second sound signal energy change map have energy jumps;
第二图像输入接口 1031, 与所述检测模块 1033连接, 配置为输入第二 图像信号; a second image input interface 1031, connected to the detecting module 1033, configured to input a second image signal;
第二声音输入接口 1032, 与所述检测模块 1033连接, 配置为输入第二 声音信号; a second sound input interface 1032, connected to the detecting module 1033, configured to input a second sound signal;
显示单元 1034, 与所述检测模块 1033连接, 配置为显示所述被检测的 第二图像信号能量变化图, 及所述被检测的第二声音信号能量变化图。 The display unit 1034 is connected to the detecting module 1033, and configured to display the detected second image signal energy change map and the detected second sound signal energy change map.
在本发明实施例中, 参考图 1可知, 所述测试设备 103与所述被测试 设备 102连接, 配置为接收所述第二图像信号及所述第二声音信号, 并输 出与所述第二图像信号对应的第二图像能量变化图, 及与所述第二声音信 号对应的第二声音能量变化图; In the embodiment of the present invention, referring to FIG. 1, the test device 103 is connected to the device under test 102, configured to receive the second image signal and the second sound signal, and output the second a second image energy change map corresponding to the image signal, and a second sound energy change map corresponding to the second sound signal;
其中, 所述测试设备 103还配置为检测所述第二图像能量变化图是否 有图像能量跳变, 并在有所述图像能量跳变时, 记录在发生所述图像能量 跳变时的第一时刻; 检测所述第二声音能量变化图是否有声音能量跳变, 并在有所述声音能量跳变时, 记录在发生所述声音能量跳变时的第二时刻, 然后, 基于所述第一时刻及所述第二时刻, 获得所述被测试设备 102 的唇
音同步延时量。 The test device 103 is further configured to detect whether the second image energy change map has an image energy jump, and when the image energy jumps, record the first when the image energy jump occurs. Detecting whether the second sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a second moment when the sound energy jump occurs, and then, based on the At a moment and the second moment, obtaining the lip of the device under test 102 The amount of tone synchronization delay.
在本发明实施例中, 为了更精确地检测待检测设备 102, 还需要将所述 测试设备 103与所述播放设备 101直接连接, 此时, 通过所述测试设备 103 就能够输出与所述第一图像信号对应的第一图像能量变化图, 及与所述第 一声音信号对应的第一声音能量变化图; In the embodiment of the present invention, in order to detect the device to be detected 102 more accurately, the test device 103 needs to be directly connected to the playback device 101. At this time, the test device 103 can output the same a first image energy change map corresponding to an image signal, and a first sound energy change map corresponding to the first sound signal;
然后, 再通过所述测试设备 103检测与所述第一图像信号对应的第一图 像能量变化图是否有图像能量跳变, 并在有所述图像能量跳变时, 记录在 发生所述图像能量跳变时的第三时刻; 检测所述第一声音能量变化图是否 有声音能量跳变, 并在有所述声音能量跳变时, 记录在发生所述声音能量 跳变时的第四时刻, 然后, 基于所述第三时刻及所述第四时刻, 获得用于 表征所述多媒体文件中图像和声音间的时间误差。 Then, the first image energy change map corresponding to the first image signal is detected by the test device 103 to have an image energy jump, and when the image energy jumps, the image energy is recorded. a third moment of the transition; detecting whether the first sound energy change map has a sound energy jump, and when the sound energy jumps, recording the fourth moment when the sound energy jump occurs, Then, based on the third moment and the fourth moment, a time error for characterizing the image and the sound in the multimedia file is obtained.
然后, 再通过所述测试设备 103基于所述第一时刻, 所述第二时刻及 所述时间误差, 获得所述唇音同步延时量。 Then, the lip sync delay amount is obtained by the test device 103 based on the first moment, the second moment, and the time error.
在本实施例中, 当所述测试设备 103 具体为示波器时, 所述测试设备 103工作过程具体如下: 所述示波器与所述被测试设备 102连接, 第二图像 输入接口 1031及第二声音输入接口 1032分别配置为接收所述第二图像信 号及所述第二声音信号, 经过检测模块 1033检测后, 显示单元 1034显示 所述第二图像信号及所述第二声音信号的能量变化图; In this embodiment, when the test device 103 is specifically an oscilloscope, the working process of the test device 103 is specifically as follows: the oscilloscope is connected to the device under test 102, the second image input interface 1031 and the second sound input The interface 1032 is configured to receive the second image signal and the second sound signal, and after detecting by the detecting module 1033, the display unit 1034 displays an energy change map of the second image signal and the second sound signal;
当检测模块 1033 检测到所述第二图像信号有能量跳变时, 显示单元 1034显示所述第二图像信号的能量跳变图, 并记录跳变第一时刻 Tl, 检测 到所述第二声音信号有能量跳变时, 显示单元 1034显示所述第二声音信号 的能量跳变图, 并记录下第二时刻 Τ2, 然后获得所述被测设备 102的唇音 同步延时量(T2-T1 ), 请参考图 5。 When the detecting module 1033 detects that the second image signal has an energy jump, the display unit 1034 displays an energy jump diagram of the second image signal, and records the first transition time T1, and detects the second sound. When the signal has an energy jump, the display unit 1034 displays the energy jump diagram of the second sound signal, and records the second time Τ2, and then obtains the lip sync delay amount (T2-T1) of the device under test 102. Please refer to Figure 5.
在将所述示波器 103直接与所述播放设备 101连接时,所述示波器 103 显示单元 1034首先显示与第一图像信号对应的第一图像能量变化图, 及与
所述第一声音信号对应得第一声音能量变化图, 然后, 当检测模块 1033检 测到第一图像信号有能量跳变时, 显示单元 1034显示所述第一图像信号能 量跳变图, 并记录跳变第一时刻 T3, 检测到所述第二声音信号有能量跳变 时, 显示单元 1034显示所述第二声音信号的能量跳变图, 并记录下第二时 刻 Τ4, 然后获得用于表征所述多媒体文件中图像和声音间的时间误差 ( Τ4-Τ3 )。 通过所述示波器 103基于第一时刻 Tl, 所述第二时刻 Τ2及所 述时间误差( Τ4-Τ3 )获得被测设备 102的唇音同步延时量( T2-T1 )-( Τ4-Τ3 )。 When the oscilloscope 103 is directly connected to the playback device 101, the oscilloscope 103 display unit 1034 first displays a first image energy change map corresponding to the first image signal, and The first sound signal corresponds to a first sound energy change map, and then, when the detecting module 1033 detects that the first image signal has an energy jump, the display unit 1034 displays the first image signal energy jump map, and records Jumping to the first time T3, when detecting that the second sound signal has an energy jump, the display unit 1034 displays an energy jump diagram of the second sound signal, and records the second time Τ4, and then obtains for characterization The time error between the image and the sound in the multimedia file (Τ4-Τ3). The lip oscilloscope synchronization delay amount (T2-T1)-( Τ4-Τ3 ) of the device under test 102 is obtained by the oscilloscope 103 based on the first time T1, the second time Τ2, and the time error (Τ4-Τ3).
上述本发明实施例中的技术方案, 至少具有如下的技术效果或优点: The technical solutions in the foregoing embodiments of the present invention have at least the following technical effects or advantages:
1、 由于图像信号和声音信号来自于一图像和声音均有能量跳变且同步 的多媒体文件, 所以, 有效解决了现有技术中存在不能保证对图像和声音 进行同步采集的技术问题, 实现了图像信号和声音信号的同步生成和获得 的技术效果; 1. Since the image signal and the sound signal are from a multimedia file in which both the image and the sound have energy hopping and synchronization, the technical problem that the image and the sound cannot be synchronously collected in the prior art is effectively solved, and the realization is realized. Synchronous generation and acquisition of image signals and sound signals;
2、 由于采用播放设备播放一图像和声音均有能量跳变且同步的多媒体 文件, 所以, 能够同时输出同步的图像信号和声音信号, 并输入到被测试 设备, 进而有效解决在输入到被测试设备时, 存在不能保证在同一时刻将 图像信号和声音信号输入到被测试设备的技术问题, 所以, 实现了图像信 号和声音信号同步输入被测试设备的技术效果; 2. Since the playback device plays a multimedia file with both image and sound energy jumping and synchronization, the synchronous image signal and the sound signal can be simultaneously output and input to the device under test, thereby effectively solving the input to be tested. When the device is used, there is a technical problem that the image signal and the sound signal cannot be input to the device under test at the same time. Therefore, the technical effect of synchronous input of the image signal and the sound signal into the device under test is realized;
3、 由于采用测试设备自动检测被测试设备输出的图像信号和声音信号 是否有能量跳变, 并在有能量跳变时计算图像和声音的能量跳变相对时间 差, 以此来确定唇音延时量, 有效解决了现有技术中存在判断结果准确性 很低的技术问题, 实现了精确的量化的唇音同步延时数据的技术效果。 3. The test device automatically detects whether the image signal and the sound signal output by the device under test have energy jumps, and calculates the energy hopping relative time difference between the image and the sound when there is an energy jump, thereby determining the lip delay amount. The utility model effectively solves the technical problem that the accuracy of the judgment result in the prior art is low, and realizes the technical effect of accurately quantizing the lip sync delay data.
实施例二 Embodiment 2
本发明实施例还提供一种唇音同步测试方法,其方法流程图请参考图 6, 应用在唇音同步测试系统中, 所述系统包括: 播放设备 101, 被测试设备 102, 与所述播放设备 101连接, 测试设备 103, 与所述被测试设备 102连
接, 所述方法包括: The embodiment of the present invention further provides a lip-synchronization test method. The method flow chart is as shown in FIG. 6 and is applied to a lip-synchronization test system. The system includes: a playback device 101, a device under test 102, and the playback device 101. Connecting, testing device 103, connected to the device under test 102 The method includes:
S501通过所述播放设备 101播放一图像和声音均有能量跳变且同步的 多媒体文件; S501 plays, by the playing device 101, a multimedia file in which both images and sounds are energy-jumped and synchronized;
具体来讲, 在本实施例中, S501具体为: 所述播放设备 101将所述多 媒体文件由所述播放设备的播放芯片 1011播放后, 通过所述播放设备的第 一图像输出接口 1012输出第一图像信号, 及第一声音输出接口 1013输出 第一声音信号。 Specifically, in this embodiment, S501 is specifically: after the playback device 101 plays the multimedia file by the playing chip 1011 of the playing device, the first image output interface 1012 of the playing device outputs the first An image signal, and the first sound output interface 1013 outputs a first sound signal.
S502通过所述被测试设备 102接收所述播放设备 101在播放所述多媒 体文件时输出的第一图像信号和第一声音信号, 并输出与所述第一图像信 号对应的第二图像信号, 及与所述第一声音信号对应的第二声音信号; 具体来讲, 在本实施例中, S502具体为: 所述被测试设备 102通过第 一图像输入接口 1021接收所述播放设备第一图像输出接口 1012输出的第 一图像信号, 所述被测试设备 102通过第一声音输入接口 1022接收所述播 放设备 101第一声音输出接口 1013输出的第一声音信号, 经由所述被测试 设备处理模块 1023处理后由第二图像输出接口 1024输出与第一图像信号 对应的第二图像信号, 及由第二声音输出接口 1025输出与第一声音信号对 应的第二声音信号。 S502 receives, by the device under test 102, the first image signal and the first sound signal that are output by the playback device 101 when the multimedia file is played, and outputs a second image signal corresponding to the first image signal, and a second sound signal corresponding to the first sound signal; specifically, in the embodiment, S502 is specifically: the device under test 102 receives the first image output of the playback device through the first image input interface 1021. The first image signal output by the interface 1012 is received by the device under test 1022, and the first sound signal output by the first sound output interface 1013 of the playback device 101 is received by the device under test via the device under test 1023. After processing, the second image signal corresponding to the first image signal is output by the second image output interface 1024, and the second sound signal corresponding to the first sound signal is output by the second sound output interface 1025.
S503通过所述测试设备接收所述第二图像信号及所述第二声音信号, 并输出与所述第二图像信号对应的第二图像能量变化图, 及与所述第二声 音信号对应的第二声音能量变化图; S503, the second image signal and the second sound signal are received by the testing device, and output a second image energy change map corresponding to the second image signal, and a corresponding to the second sound signal Second sound energy change diagram;
具体来讲, 在本实施例中, S503具体为: 所述测试设备 103通过第二 图像输入接口 1031接收所述被测试设备第二图像输出接口 1024输出的第 二图像信号, 及所述测试设备通过第二声音输入接口 1032接收所述被测试 设备第二声音输出接口 1025输出的第二声音信号, 经由所述测试设备检测 模块 1033检测后, 所述测试设备的显示单元 1034输出与第二图像信号对
应的第二图像能量变化图, 及与所述第二声音信号对应的第二声音能量变 化图。 Specifically, in the embodiment, S503 is specifically: the test device 103 receives the second image signal output by the second image output interface 1024 of the device under test through the second image input interface 1031, and the test device Receiving, by the second sound input interface 1032, the second sound signal output by the second sound output interface 1025 of the device under test, after being detected by the test device detecting module 1033, the display unit 1034 of the test device outputs the second image Signal pair a second image energy change map, and a second sound energy change map corresponding to the second sound signal.
S504通过所述测试设备 103检测所述第二图像能量变化图是否有图像 能量跳变, 并在有所述图像能量跳变时, 记录在发生所述图像能量跳变时 的第一时刻; 检测所述第二声音能量变化图是否有声音能量跳变, 并在有 所述声音能量跳变时, 记录在发生所述声音能量跳变时的第二时刻; S504: detecting, by the testing device 103, whether the second image energy change map has an image energy jump, and recording, when the image energy jumps, the first moment when the image energy jump occurs; detecting Whether the second sound energy change map has a sound energy jump, and when the sound energy jumps, is recorded at a second moment when the sound energy jump occurs;
通过所述测试设备基于所述第一时刻及所述第二时刻, 获得所述被测 试设备的唇音同步延时量。 The lip synchronization delay amount of the device under test is obtained by the test device based on the first time and the second time.
具体来讲,在本实施例中, S504具体为:所述测试设备的检测模块 1033 检测第二图像信号是否有能量跳变, 在所述测试设备的显示单元 1034显示 第二图像信号能量变化图, 并在有能量跳变时, 同时记录所述第二图像信 号能量跳变时的第一时刻 T1 ;所述测试设备的检测模块 1033检测第二声音 信号是否有能量跳变, 在所述测试设备的显示单元 1034显示第二声音信号 能量变化图, 并在有能量跳变时, 同时记录所述第二声音信号能量跳变时 的第二时刻 T2, 基于所述第一时刻及所述第二时刻, 获得所述被测试设备 的唇音同步延时量( T2-T1 )。 Specifically, in the embodiment, S504 is specifically: the detecting module 1033 of the testing device detects whether the second image signal has energy jump, and displays the second image signal energy change graph on the display unit 1034 of the testing device. And when there is an energy jump, simultaneously recording the first time T1 when the energy of the second image signal is hopping; the detecting module 1033 of the testing device detects whether the second sound signal has an energy jump, in the test The display unit 1034 of the device displays a second sound signal energy change map, and simultaneously records the second time T2 when the second sound signal energy jumps when there is an energy jump, based on the first time and the first At the second moment, the lip synchronization delay amount (T2-T1) of the device under test is obtained.
S505在将所述测试设备 103与所述播放设备 101直接连接时, 通过所 述测试设备 103 输出与所述第一图像信号对应的第一图像能量变化图, 及 与所述第一声音信号对应的第一声音能量变化图; S505, when the test device 103 is directly connected to the playback device 101, outputting, by the test device 103, a first image energy change map corresponding to the first image signal, and corresponding to the first sound signal. First sound energy change map;
通过所述测试设备 103检测与所述第一图像信号对应的第一图像能量 变化图是否有图像能量跳变, 并在有所述图像能量跳变时, 记录在发生所 述图像能量跳变时的第三时刻; 检测所述第一声音能量变化图是否有声音 能量跳变, 并在有所述声音能量跳变时, 记录在发生所述声音能量跳变时 的第四时刻, 然后, 基于所述第三时刻及所述第四时刻, 获得用于表征所 述多媒体文件中图像和声音间的时间误差。
具体来讲, 在本实施例中, S505具体为: 所述测试设备的第二图像输 入接口 1031与所述播放设备的第一图像输出接口 1012连接, 所述测试设 备的第二声音输入接口 1032与所述播放设备的第一声音输出接口 1013连 接,经所述测试设备的检测模块 1033检测后,所述测试设备的显示单元 1034 输出与所述第一图像信号对应的第一图像能量变化图, 及与所述第一声音 信号对应的第一声音能量变化图; Detecting, by the testing device 103, whether the first image energy change map corresponding to the first image signal has image energy hopping, and when there is the image energy hopping, recording when the image energy hopping occurs a third time; detecting whether the first sound energy change map has a sound energy jump, and when there is the sound energy jump, recording a fourth moment when the sound energy jump occurs, and then, based on The third time and the fourth time are obtained for characterizing a time error between the image and the sound in the multimedia file. Specifically, in this embodiment, S505 is specifically: the second image input interface 1031 of the test device is connected to the first image output interface 1012 of the playback device, and the second sound input interface 1032 of the test device is Connected to the first sound output interface 1013 of the playback device, after being detected by the detection module 1033 of the test device, the display unit 1034 of the test device outputs a first image energy change map corresponding to the first image signal. And a first sound energy change map corresponding to the first sound signal;
通过所述测试设备检测模块 1033检测所述第一图像能量变化图是否有 能量跳变, 并在所述图像能量跳变时, 记录下所述测试设备显示单元 1034 显示跳变的第三时刻 T3 ;所述测试设备检测模块 1033检测所述第一声音能 量变化图是否有能量跳变, 并在所述声音能量跳变时, 记录下所述测试设 备显示单元 1034显示跳变的第四时刻 T4, 然后, 基于所述第三时刻 Τ3及 所述第四时刻 Τ4, 获得用于表征所述多媒体文件中图像和声音间的时间误 差 ( Τ4-Τ3 )。 The test device detecting module 1033 detects whether the first image energy change map has an energy jump, and when the image energy jumps, records that the test device display unit 1034 displays the third time T3 of the jump. The test device detection module 1033 detects whether the first sound energy change map has an energy jump, and when the sound energy jumps, records that the test device display unit 1034 displays the fourth time T4 of the jump. Then, based on the third time Τ3 and the fourth time Τ4, a time error (Τ4-Τ3) between the image and the sound in the multimedia file is obtained.
S506通过所述测试设备基于所述第一时刻 Tl,所述第二时刻及所述时 间误差 Τ2, 获得所述唇音同步延时量。 S506 obtains the lip synchronization delay amount by the test device based on the first time T1, the second time, and the time error Τ2.
具体来讲, 在本实施例中, 基于所述第一时刻 Tl, 所述第二时刻 Τ2 及所述时间误差( Τ4-Τ3 ),获得所述唇音同步延时量为: ( T2-T1 )-( Τ4-Τ3 )。 Specifically, in this embodiment, based on the first time T1, the second time Τ2, and the time error (Τ4-Τ3), the lip synchronization delay amount is obtained as: (T2-T1) -( Τ4-Τ3 ).
上述本发明实施例中的技术方案, 至少具有如下的技术效果或优点: The technical solutions in the foregoing embodiments of the present invention have at least the following technical effects or advantages:
1、 由于采用图像和声音由同一多媒体文件产生, 解决了现有技术中采 用人工控制麦克风和摄像头不能同步启动的问题, 所以, 实现了图像和声 音的同步输入; 1. Since the image and the sound are generated by the same multimedia file, the problem that the manual control microphone and the camera cannot be started synchronously in the prior art is solved, so that the synchronous input of the image and the sound is realized;
2、 由于采用播放设备播放一图像和声音均有能量跳变且同步的多媒体 文件, 所以, 能够同时输出同步的图像信号和声音信号, 并输入到被测试 设备, 进而有效解决在输入到被测试设备时, 存在不能保证在同一时刻将 图像信号和声音信号输入到被测试设备的技术问题, 所以, 实现了图像信
号和声音信号同步输入被测试设备的技术效果; 2. Since the playback device plays a multimedia file with both image and sound energy jumping and synchronization, the synchronous image signal and the sound signal can be simultaneously output and input to the device under test, thereby effectively solving the input to be tested. When there is a device, there is a technical problem that the image signal and the sound signal cannot be input to the device under test at the same time, so the image letter is realized. The signal and the sound signal are synchronously input into the technical effect of the device under test;
3、 由于采用测试设备自动检测被测试设备输出的图像信号和声音信号 是否有能量跳变, 并在有能量跳变时计算图像和声音的能量跳变相对时间 差, 以此来确定唇音延时量, 有效解决了现有技术中存在判断结果准确性 很低的技术问题, 实现了精确的量化的唇音同步延时数据的技术效果。 3. The test device automatically detects whether the image signal and the sound signal output by the device under test have energy jumps, and calculates the energy hopping relative time difference between the image and the sound when there is an energy jump, thereby determining the lip delay amount. The utility model effectively solves the technical problem that the accuracy of the judgment result in the prior art is low, and realizes the technical effect of accurately quantizing the lip sync delay data.
尽管已描述了本发明的优选实施例, 但本领域内的技术人员一旦得知 了基本创造性概念, 则可对这些实施例作出另外的变更和修改。 所以, 所 附权利要求意欲解释为包括优选实施例以及落入本发明范围的所有变更和 修改。 本发明的精神和范围。 这样, 倘若本发明的这些修改和变型属于本发明权 利要求及其等同技术的范围之内, 则本发明也意图包含这些改动和变型在 内。 工业实用性 While the preferred embodiment of the invention has been described, the subject matter Therefore, it is intended that the appended claims be interpreted as including The spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and modifications of the invention Industrial applicability
本发明提供了一种唇音同步测试系统和方法, 其中, 所述系统包括: 播放设备, 配置为播放图像和声音均有能量跳变且同步的多媒体文件; 被 测试设备, 与所述播放设备连接, 配置为接收所述播放设备在播放所述多 媒体文件时输出的第一图像信号和第一声音信号, 并输出与所述第一图像 信号对应的第二图像信号, 及与所述第一声音信号对应的第二声音信号; 测试设备, 与所述被测试设备连接, 配置为接收所述第二图像信号及所述 第二声音信号, 并输出与所述第二图像信号对应的第二图像能量变化图, 及与所述第二声音信号对应的第二声音能量变化图; 其中, 所述测试设备 还配置为检测所述第二图像能量变化图是否有图像能量跳变, 及检测所述 第二声音能量变化图是否有声音能量跳变。 本发明能够解决现有技术中存 在的判断结果准确性很低的技术问题。
The present invention provides a lip synchronization test system and method, wherein the system includes: a playback device configured to play a multimedia file in which both images and sounds have energy jumps and synchronization; and the device under test is connected to the playback device And configured to receive a first image signal and a first sound signal output by the playback device when playing the multimedia file, and output a second image signal corresponding to the first image signal, and the first sound a second sound signal corresponding to the signal; a test device connected to the device under test, configured to receive the second image signal and the second sound signal, and output a second image corresponding to the second image signal An energy change map, and a second sound energy change map corresponding to the second sound signal; wherein the test device is further configured to detect whether the second image energy change map has an image energy jump, and detect the Whether the second sound energy change map has a sound energy jump. The present invention can solve the technical problem that the accuracy of the judgment result existing in the prior art is low.
Claims
1、 一种唇音同步测试系统, 所述系统包括: 1. A lip synchronization test system, the system includes:
播放设备, 配置为播放图像和声音均有能量跳变且同步的多媒体文件; 被测试设备, 与所述播放设备连接, 配置为接收所述播放设备在播放 所述多媒体文件时输出的第一图像信号和第一声音信号, 并输出与所述第 一图像信号对应的第二图像信号, 及与所述第一声音信号对应的第二声音 信号; The playback device is configured to play multimedia files in which images and sounds have energy jumps and are synchronized; the device under test is connected to the playback device and is configured to receive the first image output by the playback device when playing the multimedia file. signal and a first sound signal, and output a second image signal corresponding to the first image signal, and a second sound signal corresponding to the first sound signal;
测试设备, 与所述被测试设备连接, 配置为接收所述第二图像信号及 所述第二声音信号, 并输出与所述第二图像信号对应的第二图像能量变化 图, 及与所述第二声音信号对应的第二声音能量变化图; Test equipment, connected to the device under test, configured to receive the second image signal and the second sound signal, and output a second image energy change map corresponding to the second image signal, and with the The second sound energy change diagram corresponding to the second sound signal;
其中, 所述测试设备还配置为检测所述第二图像能量变化图是否有图 像能量跳变, 并在有所述图像能量跳变时, 记录在发生所述图像能量跳变 时的第一时刻; 检测所述第二声音能量变化图是否有声音能量跳变, 并在 有所述声音能量跳变时, 记录在发生所述声音能量跳变时的第二时刻, 然 后, 基于所述第一时刻及所述第二时刻, 获得所述被测试设备的唇音同步 延时量。 Wherein, the test equipment is further configured to detect whether there is an image energy jump in the second image energy change map, and when there is an image energy jump, record the first moment when the image energy jump occurs. ; Detect whether there is a sound energy jump in the second sound energy change graph, and when there is a sound energy jump, record the second moment when the sound energy jump occurs, and then, based on the first time and the second time, obtain the lip synchronization delay amount of the device under test.
2、 如权利要求 1所述的系统, 其中, 所述播放设备包括: 2. The system of claim 1, wherein the playback device includes:
播放芯片, 配置为播放所述多媒体文件, 输出所述第一图像信号及所 述第一声音信号; A playback chip configured to play the multimedia file and output the first image signal and the first sound signal;
第一图像输出接口, 与所述播放芯片连接, 配置为输出所述第一图像 信号; A first image output interface, connected to the playback chip, configured to output the first image signal;
第一声音输出接口, 与所述播放芯片连接, 配置为输出所述第一声音 信号。 A first sound output interface is connected to the playback chip and configured to output the first sound signal.
3、 如权利要求 2所述的系统, 其中, 所述被测试设备包括:
第一图像输入接口, 与所述第一图像输出接口连接, 配置为接收所述 第一图像信号; 3. The system of claim 2, wherein the device under test includes: A first image input interface, connected to the first image output interface, configured to receive the first image signal;
第一声音输入接口, 与所述第一声音输出接口连接, 配置为接收所述 第一声音信号; A first sound input interface, connected to the first sound output interface, configured to receive the first sound signal;
处理模块, 与所述第一图像输入接口及所述第一声音输入接口连接, 并在对接收到的所述第一图像信号进行处理后, 输出所述第二图像信号, 在对接收到所述第一声音信号进行处理后, 输出所述第二声音信号; A processing module is connected to the first image input interface and the first sound input interface, and after processing the received first image signal, outputs the second image signal, and after processing the received first image signal, After processing the first sound signal, output the second sound signal;
第二图像输出接口, 与所述处理模块连接, 配置为输出所述第二图像 信号; A second image output interface, connected to the processing module, configured to output the second image signal;
第二声音输出接口, 与所述处理模块连接, 配置为输出所述第二声音 信号。 A second sound output interface is connected to the processing module and configured to output the second sound signal.
4、 如权利要求 3所述的系统, 其中, 所述测试设备包括: 4. The system of claim 3, wherein the test equipment includes:
第二图像输入接口, 与所述第二图像输出接口连接, 配置为接收所述 第二图像信号; a second image input interface, connected to the second image output interface, configured to receive the second image signal;
第二声音输入接口, 与所述第二声音输出接口连接, 配置为接收所述 第二声音信号; a second sound input interface, connected to the second sound output interface, configured to receive the second sound signal;
显示单元, 与所述第二图像输入接口及所述第二声音输入接口连接, 配置为输出与所述第二图像信号对应的第二图像能量变化图, 及与所述第 二声音信号对应的第二声音能量变化图; The display unit is connected to the second image input interface and the second sound input interface, and is configured to output a second image energy change map corresponding to the second image signal, and a second image energy change map corresponding to the second sound signal. The second sound energy change diagram;
测试模块, 与所述显示单元连接, 配置为检测所述第二图像能量变化 图是否有图像能量跳变, 并在有所述图像能量跳变时, 记录在发生所述图 像能量跳变时的第一时刻; 检测所述第二声音能量变化图是否有声音能量 跳变, 并在有所述声音能量跳变时, 记录在发生所述声音能量跳变时的第 二时刻, 然后, 基于所述第一时刻及所述第二时刻, 获得所述被测试设备 的唇音同步延时量。
A test module, connected to the display unit, configured to detect whether there is an image energy jump in the second image energy change map, and when there is an image energy jump, record the image energy jump when the image energy jump occurs. The first moment; detect whether there is a sound energy jump in the second sound energy change graph, and when there is a sound energy jump, record the second moment when the sound energy jump occurs, and then, based on the sound energy jump, According to the first moment and the second moment, the lip synchronization delay amount of the device under test is obtained.
5、 如权利要求 4所述的系统, 其中, 在所述第二图像输入接口与所述 第一图像输出接口连接, 所述第二声音输入接口与所述第一声音输出接口 连接时, 所述显示单元, 还配置为输出与所述第一图像信号对应的第一图 像能量变化图, 及与所述第一声音信号对应的第一声音能量变化图; 5. The system of claim 4, wherein when the second image input interface is connected to the first image output interface, and the second sound input interface is connected to the first sound output interface, The display unit is further configured to output a first image energy change map corresponding to the first image signal, and a first sound energy change map corresponding to the first sound signal;
所述测试模块, 还配置为检测所述第一图像能量变化图是否有图像能 量跳变, 并在有所述图像能量跳变时, 记录在发生所述图像能量跳变时的 第三时刻; 检测所述第一声音能量变化图是否有声音能量跳变, 并在有所 述声音能量跳变时, 记录在发生所述声音能量跳变时的第四时刻, 然后, 基于所述第三时刻及所述第四时刻, 获得用于表征所述多媒体文件中图像 和声音间的时间误差; 并基于所述第一时刻, 所述第二时刻及所述时间误 差, 获得所述唇音同步延时量。 The test module is also configured to detect whether there is an image energy jump in the first image energy change map, and when there is an image energy jump, record the third moment when the image energy jump occurs; Detect whether there is a sound energy jump in the first sound energy change graph, and when there is a sound energy jump, record the fourth moment when the sound energy jump occurs, and then, based on the third moment and the fourth moment, obtaining the time error between the image and the sound in the multimedia file; and based on the first moment, the second moment and the time error, obtaining the lip synchronization delay quantity.
6、 如权利要求 1-5中任一权利要求所述的系统, 其中, 所述被测试设 备为: 会议电视系统, 视频聊天系统或视频监控系统。 6. The system according to any one of claims 1 to 5, wherein the device under test is: a conference television system, a video chat system or a video surveillance system.
7、 一种唇音同步测试方法, 应用在唇音同步测试系统中, 所述系统包 括: 播放设备, 与所述播放设备连接的被测试设备, 与所述被测试设备连 接的测试设备, 所述方法包括: 7. A lip synchronization testing method, applied in a lip synchronization testing system, the system includes: a playback device, a device under test connected to the playback device, a test device connected to the device under test, the method include:
通过所述播放设备播放一图像和声音均有能量跳变且同步的多媒体文 件; Play a multimedia file whose images and sounds have energy jumps and are synchronized through the playback device;
通过所述被测试设备接收所述播放设备在播放所述多媒体文件时输出 的第一图像信号和第一声音信号, 并输出与所述第一图像信号对应的第二 图像信号, 及与所述第一声音信号对应的第二声音信号; receiving the first image signal and the first sound signal output by the playback device when playing the multimedia file through the device under test, and outputting a second image signal corresponding to the first image signal, and a second sound signal corresponding to the first sound signal;
通过所述测试设备接收所述第二图像信号及所述第二声音信号, 并输 出与所述第二图像信号对应的第二图像能量变化图, 及与所述第二声音信 号对应的第二声音能量变化图; The second image signal and the second sound signal are received through the test equipment, and a second image energy change map corresponding to the second image signal and a second second sound signal corresponding to the second sound signal are output. Sound energy change diagram;
通过所述测试设备检测所述第二图像能量变化图是否有图像能量跳
变, 并在有所述图像能量跳变时, 记录在发生所述图像能量跳变时的第一 时刻; 检测所述第二声音能量变化图是否有声音能量跳变, 并在有所述声 音能量跳变时, 记录在发生所述声音能量跳变时的第二时刻; Use the testing equipment to detect whether there is an image energy jump in the second image energy change map. change, and when there is a jump in image energy, record the first moment when the jump in image energy occurs; detect whether there is a jump in sound energy in the second sound energy change diagram, and when there is a jump in sound energy When the energy jumps, record the second moment when the sound energy jump occurs;
通过所述测试设备基于所述第一时刻及所述第二时刻, 获得所述被测 试设备的唇音同步延时量。 The lip synchronization delay amount of the device under test is obtained by the testing device based on the first time and the second time.
8、 如权利要求 7所述的方法, 其中, 在所述通过所述测试设备基于所 述第一时刻及所述第二时刻, 获得所述被测试设备的唇音同步延时量之前, 所述方法还包括: 8. The method of claim 7, wherein before obtaining the labial synchronization delay amount of the device under test based on the first time and the second time through the testing device, the Methods also include:
在将所述测试设备与所述播放设备直接连接时, 通过所述测试设备输 出与所述第一图像信号对应的第一图像能量变化图, 及与所述第一声音信 号对应的第一声音能量变化图; When the testing device is directly connected to the playback device, the testing device outputs a first image energy change diagram corresponding to the first image signal, and a first sound corresponding to the first sound signal. energy change diagram;
通过所述测试设备检测与所述第一图像信号对应的第一图像能量变化 图是否有图像能量跳变, 并在有所述图像能量跳变时, 记录在发生所述图 像能量跳变时的第三时刻; 检测所述第一声音能量变化图是否有声音能量 跳变, 并在有所述声音能量跳变时, 记录在发生所述声音能量跳变时的第 四时刻, 然后, 基于所述第三时刻及所述第四时刻, 获得用于表征所述多 媒体文件中图像和声音间的时间误差。 Use the testing equipment to detect whether there is an image energy jump in the first image energy change map corresponding to the first image signal, and when there is the image energy jump, record the image energy jump when the image energy jump occurs. The third moment; detect whether there is a sound energy jump in the first sound energy change graph, and when there is a sound energy jump, record the fourth moment when the sound energy jump occurs, and then, based on the sound energy jump, The third moment and the fourth moment are obtained to characterize the time error between the image and the sound in the multimedia file.
9、 如权利要求 8所述的方法, 其中, 所述通过所述测试设备基于所述 第一时刻及所述第二时刻, 获得所述被测试设备的唇音同步延时量, 为: 通过所述测试设备基于所述第一时刻, 所述第二时刻及所述时间误差, 获得所述唇音同步延时量。 9. The method of claim 8, wherein the lip synchronization delay amount of the device under test is obtained based on the first moment and the second moment through the test device, which is: The test equipment obtains the lip synchronization delay amount based on the first time, the second time and the time error.
10、 如权利要求 7-9中任一权利要求所述的方法, 其中, 所述被测试设 备为: 会议电视系统, 视频聊天系统或视频监控系统。
10. The method according to any one of claims 7-9, wherein the device under test is: a conference television system, a video chat system or a video surveillance system.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210424020.2A CN103796006A (en) | 2012-10-30 | 2012-10-30 | System and method for labial sound synchronization test |
CN201210424020.2 | 2012-10-30 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014067364A1 true WO2014067364A1 (en) | 2014-05-08 |
Family
ID=50626448
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2013/083838 WO2014067364A1 (en) | 2012-10-30 | 2013-09-18 | Lip synchronization test system and method |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN103796006A (en) |
WO (1) | WO2014067364A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106101694A (en) * | 2016-06-12 | 2016-11-09 | 深圳创维-Rgb电子有限公司 | A kind of methods, devices and systems of automatic calibration labial synchronization |
CN107172419A (en) * | 2017-06-08 | 2017-09-15 | 广州华多网络科技有限公司 | Audio-visual synchronization method of testing and system |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1436005A (en) * | 2002-01-30 | 2003-08-13 | 华邦电子股份有限公司 | Method and system for measuring accuracy of video/audio output synchronization, and analysis means |
CN101022560A (en) * | 2007-03-09 | 2007-08-22 | 北京牡丹视源电子有限责任公司 | Digital TV video and audio synchronous testing signal and measuring method thereof |
GB2437123A (en) * | 2006-04-10 | 2007-10-17 | Vqual Ltd | Method and apparatus for measuring audio/video sync delay |
GB2437122A (en) * | 2006-04-10 | 2007-10-17 | Vqual Ltd | Method and apparatus for measuring audio/video sync delay |
CN101742357A (en) * | 2009-12-29 | 2010-06-16 | 北京牡丹电子集团有限责任公司 | Method for measuring audio/video synchronous error of digital television device |
-
2012
- 2012-10-30 CN CN201210424020.2A patent/CN103796006A/en active Pending
-
2013
- 2013-09-18 WO PCT/CN2013/083838 patent/WO2014067364A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1436005A (en) * | 2002-01-30 | 2003-08-13 | 华邦电子股份有限公司 | Method and system for measuring accuracy of video/audio output synchronization, and analysis means |
GB2437123A (en) * | 2006-04-10 | 2007-10-17 | Vqual Ltd | Method and apparatus for measuring audio/video sync delay |
GB2437122A (en) * | 2006-04-10 | 2007-10-17 | Vqual Ltd | Method and apparatus for measuring audio/video sync delay |
CN101022560A (en) * | 2007-03-09 | 2007-08-22 | 北京牡丹视源电子有限责任公司 | Digital TV video and audio synchronous testing signal and measuring method thereof |
CN101742357A (en) * | 2009-12-29 | 2010-06-16 | 北京牡丹电子集团有限责任公司 | Method for measuring audio/video synchronous error of digital television device |
Also Published As
Publication number | Publication date |
---|---|
CN103796006A (en) | 2014-05-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR100694060B1 (en) | Apparatus and method for synchronizing video and audio | |
WO2017092343A1 (en) | Video data detection method and device | |
US9269399B2 (en) | Capture, syncing and playback of audio data and image data | |
US8786659B2 (en) | Device, method and computer program product for responding to media conference deficiencies | |
KR20160022307A (en) | System and method to assist synchronization of distributed play out of control | |
TWI575966B (en) | Audio playback system and method used in handheld electronic device | |
WO2014067364A1 (en) | Lip synchronization test system and method | |
KR101590913B1 (en) | Apparatus and method for controlling contents download | |
CN112188259B (en) | Method and device for audio and video synchronization test and correction and electronic equipment | |
RU2005126866A (en) | METHOD FOR PLAYING CONTENT INFORMATION BY A DEVICE FOR AN INTERACTIVE OPTICAL DISK | |
JP2009130820A (en) | Information processing apparatus | |
CN116437068A (en) | Lip synchronization test method and device, electronic equipment and storage medium | |
JP2004104284A5 (en) | ||
CN114025229A (en) | Method and device for processing audio and video files, computing equipment and storage medium | |
CN112687247A (en) | Audio alignment method and device, electronic equipment and storage medium | |
CN112769645A (en) | Terminal testing method and device, terminal equipment and storage medium | |
JP2007312007A (en) | Unit and method for processing moving image data, stream-generating device, and imaging apparatus | |
JP2014116941A (en) | Message recording and reproducing system and method for the same | |
TWI748892B (en) | Clock synchronization system and method for operating a clock synchronization system | |
CN113241086B (en) | Audio processing method, device, electronic equipment and storage medium | |
JP2006186990A (en) | Lip sync measuring method | |
JP2002354029A (en) | System for transmitting/receiving data, method for data transmission and data reproduction and programs for data transmission and data reproduction | |
TW201409464A (en) | Disc reproducing apparatus and communication control method of disc reproducing apparatus | |
WO2024057399A1 (en) | Media playback control device, media playback control method, and media playback control program | |
JP2008148084A (en) | Lip-sync measurement method and circuit |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13851275 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 13851275 Country of ref document: EP Kind code of ref document: A1 |