CN107172419A - Audio-visual synchronization method of testing and system - Google Patents
Audio-visual synchronization method of testing and system Download PDFInfo
- Publication number
- CN107172419A CN107172419A CN201710428408.2A CN201710428408A CN107172419A CN 107172419 A CN107172419 A CN 107172419A CN 201710428408 A CN201710428408 A CN 201710428408A CN 107172419 A CN107172419 A CN 107172419A
- Authority
- CN
- China
- Prior art keywords
- signal
- audio
- measured
- image
- audio signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/004—Diagnosis, testing or measuring for television systems or their details for digital television systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2407—Monitoring of transmitted content, e.g. distribution time, number of downloads
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
This application provides audio-visual synchronization method of testing and system, methods described includes：Play in default synchronism detection signal, the synchronism detection signal, vision signal is alternately made up of bright picture signal and dark picture signal, audio signal is alternately made up of the first audio signal and the second audio signal；In vision signal the cycle phase of one of signal and one of signal in audio signal with and signal is synchronous, the cycle phase of another signal in vision signal and another signal in audio signal is together and signal is synchronous；The brightness value of bright picture signal and dark picture signal belongs to different range of luminance values, and the first audio signal is different with the second audio signal；After end to be measured collection synchronism detection signal, while the image and audio of the collection end output to be measured, and it is converted into electric signal respectively；Determine whether the audio frequency and video for passing through end to be measured are synchronous by contrasting the waveform of electric signal, so as to improve the degree of accuracy of audio-visual synchronization test.
Description
Technical field
The application is related to multimedia information field, more particularly to audio-visual synchronization method of testing and system.
Background technology
Digital video technology is widely used for the fields such as DTV, computer, smart mobile phone, handheld video terminal.
By taking audio frequency and video real-time system end to end as an example, such system include collection, pretreatment, coding, transmission, decoding, play etc.
Reason process.In processing procedure, Voice ＆ Video is independent, to the difference of Voice ＆ Video processing, it is easy to cause viewing
The audio frequency and video at end are asynchronous.However, for the also no highly effective method of accurate measurement of audio-visual synchronization performance.
The content of the invention
The application provides audio-visual synchronization method of testing and system, to solve accurately measure audio frequency and video in the prior art
Whether synchronous defect.
According to the first aspect of the embodiment of the present application there is provided a kind of audio-visual synchronization method of testing, methods described includes：
Play in default synchronism detection signal, the synchronism detection signal, vision signal is by bright picture signal and dark figure
As signal alternating composition, audio signal is alternately made up of the first audio signal and the second audio signal；Wherein one in vision signal
The cycle phase of individual signal and one of signal in audio signal with and signal is synchronous, another signal and sound in vision signal
The cycle phase of another signal in frequency signal is same and signal is synchronous；The brightness value of bright picture signal and dark picture signal belongs to
Different range of luminance values, the first audio signal is different with the second audio signal；
After end to be measured collection synchronism detection signal, while the image and audio of the collection end output to be measured, and will
Acquired image signal and audio signal are converted into electric signal respectively；
Determine whether the audio frequency and video for passing through end to be measured are synchronous by contrasting the waveform of electric signal.
Optionally, the bright picture signal is the picture signal that brightness is 100%, and the dark picture signal is that brightness is
0% picture signal.
Optionally, the amplitude or signal frequency of first audio signal are 0, and the second audio signal is amplitude and signal frequency
Rate is not 0 simple signal.
Optionally, the image of the collection end output to be measured, including：
By the light sensor being arranged on end screen to be measured, the image shown on the end screen to be measured is gathered.
Optionally, photodiode is provided with the light sensor, it is described that acquired image signal is converted into electricity
Signal, including：
If showing bright picture signal on the screen, acquired image signal is converted into high level signal；
If showing dark picture signal on the screen, acquired image signal is converted into low level signal.
Optionally, the end to be measured includes end-to-end audio frequency and video real-time system, described in end to be measured collection synchronism detection letter
After number, while the image and audio of the collection end output to be measured, including：
After collecting device collection synchronism detection signal in the end-to-end audio frequency and video real-time system, while collection is described
The image and audio of playback equipment output in end-to-end audio frequency and video real-time system.
According to the second aspect of the embodiment of the present application there is provided a kind of audio-visual synchronization test system, the system includes：
Playing module, for playing in default synchronism detection signal, the synchronism detection signal, vision signal is by bright figure
As signal and dark picture signal alternating composition, audio signal is alternately made up of the first audio signal and the second audio signal；Video
In signal the cycle phase of one of signal and one of signal in audio signal with and signal is synchronous, it is another in vision signal
The cycle phase of one signal and another signal in audio signal with and signal is synchronous；Bright picture signal and dark picture signal
Brightness value belongs to different range of luminance values, and the first audio signal is different with the second audio signal；
Image capture module, the image for after end to be measured collection synchronism detection signal, gathering the end output to be measured,
And acquired image signal is converted into electric signal；
Audio collection module, the audio for after end to be measured collection synchronism detection signal, gathering the end output to be measured,
And the audio signal gathered is converted into electric signal；
Interpretation of result module, for determining whether the audio frequency and video for passing through end to be measured are synchronous by contrasting the waveform of electric signal.
Optionally, the bright picture signal is the picture signal that brightness is 100%, and the dark picture signal is that brightness is
0% picture signal.
Optionally, the amplitude or signal frequency of first audio signal are 0, and the second audio signal is amplitude and signal frequency
Rate is not 0 simple signal.
Optionally, described image acquisition module is arranged in light sensor, described image acquisition module specifically for：
The image shown on the end screen to be measured is gathered, if showing bright picture signal on the screen, by what is gathered
Picture signal is converted to high level signal；If showing dark picture signal on the screen, acquired image signal is converted to
Low level signal.
According to the third aspect of the embodiment of the present application there is provided a kind of audio-visual synchronization test system, including：Playback equipment,
Light sensor, message processing device；
The playback equipment be used for play in default synchronism detection signal, the synchronism detection signal, vision signal by
Bright picture signal and dark picture signal are alternately constituted, and audio signal is alternately made up of the first audio signal and the second audio signal；
In vision signal the cycle phase of one of signal and one of signal in audio signal with and signal is synchronous, in vision signal
Another signal and another signal in audio signal cycle phase with and signal is synchronous；Bright picture signal and dark image letter
Number brightness value belong to different range of luminance values, the first audio signal is different with the second audio signal；
After end to be measured collection synchronism detection signal, the light sensor is used for the figure for gathering the end output to be measured
Picture, and acquired image signal is converted into electric signal；Meanwhile, described information processing equipment is defeated for gathering the end to be measured
The audio gone out, and the audio signal gathered is converted into electric signal；
Described information processing equipment be additionally operable to by contrast electric signal waveform determine by end to be measured audio frequency and video whether
It is synchronous.
Using application scheme, due to waveform that in preset synchronism detection signal, bright picture signal is correspondingly formed with it is dark
The waveform that picture signal is correspondingly formed is different, can find the boundary point of two waveforms；The waveform that first audio signal is correspondingly formed
It is different from the waveform that the second audio signal is correspondingly formed, the boundary point of two waveforms can be found；Again due in vision signal wherein
The cycle phase of one signal and one of signal in audio signal with and signal is synchronous, another signal in vision signal and
The cycle phase of another signal in audio signal is same and signal is synchronous, therefore can gather synchronism detection signal at end to be measured
Afterwards, while gathering the image and audio of the end output to be measured, and acquired image signal and audio signal are turned respectively
Change electric signal into；Determine whether the audio frequency and video for passing through end to be measured are synchronous by contrasting the waveform of electric signal, so as to improve same pacing
Try accuracy.
It should be appreciated that the general description of the above and detailed description hereinafter are only exemplary and explanatory, not
The application can be limited.
Brief description of the drawings
Accompanying drawing herein is merged in specification and constitutes the part of this specification, shows the implementation for meeting the application
Example, and be used to together with specification to explain the principle of the application.
Fig. 1 is a kind of audio-visual synchronization test application scenarios schematic diagram of the application according to an exemplary embodiment.
Fig. 2 is a kind of flow chart of audio-visual synchronization method of testing of the application according to an exemplary embodiment.
Fig. 3 is a kind of schematic diagram of synchronism detection signal of the application according to an exemplary embodiment.
Fig. 4 is a kind of circuit diagram of optical sensor of the application according to an exemplary embodiment.
Fig. 5 is a kind of comparison of wave shape schematic diagram of the application according to an exemplary embodiment.
Fig. 6 is a kind of block diagram of audio-visual synchronization test system of the application according to an exemplary embodiment.
Embodiment
Here exemplary embodiment will be illustrated in detail, its example is illustrated in the accompanying drawings.Following description is related to
During accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represent same or analogous key element.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistent with the application.On the contrary, they be only with it is such as appended
The example of the consistent system and method for some aspects be described in detail in claims, the application.
It is the purpose only merely for description specific embodiment in term used in this application, and is not intended to be limiting the application.
" one kind ", " described " and "the" of singulative used in the application and appended claims are also intended to including majority
Form, unless context clearly shows that other implications.It is also understood that term "and/or" used herein refers to and wrapped
It may be combined containing one or more associated any or all of project listed.
It will be appreciated that though various information, but this may be described using term first, second, third, etc. in the application
A little information should not necessarily be limited by these terms.These terms are only used for same type of information being distinguished from each other out.For example, not departing from
In the case of the application scope, the first information can also be referred to as the second information, similarly, and the second information can also be referred to as
One information.Depending on linguistic context, word as used in this " if " can be construed to " ... when " or " when ...
When " or " in response to determining ".
Typically detect whether Devices to test audio frequency and video occurs in correlation technique by way of manual observation nonsynchronous scarce
Fall into, this mode accuracy rate is low.In order to improve the accuracy of audio-visual synchronization test, the application provides a kind of audio-visual synchronization and surveyed
Method for testing, methods described can apply to test in the test system at end to be measured.Wherein, end to be measured can be with collection and broadcast
The electronic equipment of playing function, for example, the equipment such as smart mobile phone, tablet personal computer and personal computer, multimedia player.End to be measured
Can also be end-to-end audio frequency and video real-time system, for example, end to be measured can be network direct broadcasting system, monitoring system etc..By broadcasting
Device plays synchronism detection signal is put, the collecting device collection synchronism detection signal in the end-to-end audio frequency and video real-time system
Afterwards, while gathering the image and audio of the playback equipment output in the end-to-end audio frequency and video real-time system, and collection is utilized
Information analyzed, it is whether synchronous by the audio frequency and video at end to be measured to determine.
Understand for convenience, the application enters so that end to be measured is network direct broadcasting system as an example to the application scenarios of application scheme
Row is illustrated.
As shown in figure 1, Fig. 1 is a kind of audio-visual synchronization test applied field of the application according to an exemplary embodiment
Scape schematic diagram, Fig. 1 includes test system and end to be measured.End to be measured is by taking network direct broadcasting system as an example, and network direct broadcasting system includes
Main broadcaster end and viewer end.It is understood that also including service end in network direct broadcasting framework, service end provides live to client
Service, in Fig. 1 not shown service end.Generally, two class users are related to during live, a class user is main broadcasting user, another
Class user is spectators user.Live client provides main broadcaster's direct broadcast function when being in main broadcaster's pattern, live client is in spectators
There is provided during pattern and live watch function.For convenience, the live client corresponding to main broadcaster user can be referred to as main broadcaster end, will
Live client corresponding to spectators user is referred to as viewer end.Main broadcaster user can use the direct broadcast function that live client is provided
Carry out net cast.For example, live client can open the video capture module of smart machine, it is real by video capture module
When gather video data, and video data is sent to service end, service end is by the video data broadcast received to direct broadcasting room
The live client of interior each spectators user, and spectators user can use what live client provided to watch that function viewing main broadcaster uses
The live content at family.
Application scheme is applied in test system, and test system can include playing module, image capture module, audio and adopt
Collect module and interpretation of result module.Playing module can be playback equipment, and synchronism detection can be prestored in playing module
Signal, so-called synchronism detection signal refers to the audio signal signal synchronous with vision signal.Playing module can play same pacing
Trial signal, so that main broadcaster end gathers view data and voice data.Image capture module and audio collection module respectively with spectators
End connection, image capture module is used for the image for gathering viewer end output, and audio collection module is used to gather viewer end output
Audio, the audio-frequency information for image information and the audio collection module collection that interpretation of result module gathers image capture module enters
Row analysis, may thereby determine that network direct broadcasting system whether there is the nonsynchronous defect of audio frequency and video.
Scheme provided herein is described in detail below.
As shown in Fig. 2 Fig. 2 is a kind of audio-visual synchronization method of testing of the application according to an exemplary embodiment
Flow chart, methods described can be using in a test system, and methods described includes：
In step 201, default synchronism detection signal is played.
Wherein, default synchronism detection signal is played, so that end to be measured is acquired.
In step 202., after end to be measured collection synchronism detection signal, at the same the image of the collection end to be measured output with
And audio, and acquired image signal and audio signal are converted into electric signal respectively.
Wherein, end output image and audio to be measured, this actuating station gather the image and audio of end output to be measured, obtain
Picture signal and audio signal.The image and audio of the end output to be measured are gathered simultaneously, that is, gather the end output to be measured
Image audio of the opportunity with gathering the end to be measured output opportunity it is synchronous, so as to the signal progress for gathering same time
Contrast.
In step 203, determine whether the audio frequency and video for passing through end to be measured are synchronous by contrasting the waveform of electric signal.
Wherein, synchronism detection signal includes vision signal and audio signal.Vision signal can be picture signal.Video is believed
Number alternately it is made up of bright picture signal and dark picture signal, audio signal replaces structure by the first audio signal and the second audio signal
Into；In vision signal the cycle phase of one of signal and one of signal in audio signal with and signal is synchronous, video is believed
The cycle phase of another signal in number and another signal in audio signal with and signal is synchronous；Bright picture signal and dark figure
As the brightness value of signal belongs to different range of luminance values, the first audio signal is different with the second audio signal.
On the vision signal in synchronism detection signal, vision signal replaces structure by bright picture signal and dark picture signal
Can be with identical into, cycle of the cycle of bright picture signal and dark picture signal, can also be different.Cycle can set according to demand
Fixed, such as cycle is more than the asynchronous time estimated.The brightness value of bright picture signal and dark picture signal belongs to different bright
Angle value scope, in order to which the waveform that bright picture signal is correspondingly formed is different from the waveform that dark picture signal is correspondingly formed, and
There is signal saltus step between bright picture signal and dark picture signal, so as to which the boundary point of two waveforms can be found.
In one example, the corresponding range of luminance values of bright picture signal is the larger range of luminance values of a brightness, secretly
The corresponding range of luminance values of picture signal is a less range of luminance values of brightness.Two range of luminance values differences and gap
Larger, the waveform difference being correspondingly formed respectively so as to two range of luminance values is away from larger.Specific range of luminance values can be according to need
Ask setting.For example, the corresponding range of luminance values of bright picture signal is 90%~100%, the corresponding brightness value model of dark picture signal
Enclose for 0%~10%.
On the brightness value of picture signal, it can be indicated by color of image.For example, bright picture signal uses light tone
It is picture signal, for example, white image signal, red image signal etc..Dark picture signal uses dead color system picture signal, for example
Black signal etc..
In order that bright picture signal and dark picture signal have obvious separating degree, in an optional implementation,
Bright picture signal can be the picture signal that brightness is 100%, and dark picture signal can be the picture signal that brightness is 0%.
It can be seen that, the waveform corresponding to picture signal for being 0% with brightness due to the picture signal that brightness is 100% has very
Big difference, therefore the separation of bright picture signal and dark picture signal can be clearly distinguished, subsequently sentence so as to improve
The whether synchronous accuracy of staccato video.
Further, the making of synchronism detection signal for convenience, bright picture signal can use full white image, dark image
Signal can use all black picture, so that the brightness for characterizing bright picture signal is 100%, the brightness of dark picture signal is 0%, drop
The low difficulty for obtaining vision signal in synchronism detection signal.
On the audio signal in synchronism detection signal, audio signal is replaced by the first audio signal and the second audio signal
Constitute, cycle of the first audio signal and the second audio signal can be with identical, can also be different.First audio signal and the second sound
Frequency signal is different, can be that the first audio signal is different with the amplitude and/or signal frequency of the second audio signal, in order to
The waveform that first audio signal is correspondingly formed is different from the waveform that the second audio signal is correspondingly formed, and the first audio signal and
There is signal saltus step between two audio signals, so as to which the boundary point of two waveforms can be found.
Wherein, the amplitude of the first audio signal differs larger with the amplitude of the second audio signal, and/or the first audio signal
Signal frequency differ larger with the signal frequency of the second audio signal, the waveform difference being correspondingly formed so as to two audio signals away from
It is larger.
In one example, in order to be able to quickly distinguishing the first audio signal and the second audio signal, the first audio signal
Can be amplitude and/or the different simple signal of signal frequency with the second audio signal.Wherein, simple signal is that frequency is constant
Signal, simple signal is defined to by the first audio signal, and the second audio signal is defined into simple signal, such as the first audio letter
Number it is the simple signal of high frequency, the second audio signal is the simple signal of low frequency, because simple signal is separating degree very strong letter
Number, therefore the first audio signal and the second audio signal are defined to amplitude and/or the different simple signal of signal frequency, can be with
The starting point and end point of the audio signal of the first audio signal/second are easily determined, and then quick distinguishes the first audio letter
Number and the second audio signal.
In one example, the amplitude or signal frequency of the first audio signal are 0, and the second audio signal is amplitude and signal
Frequency is not 0 audio signal, based on this, during the first audio signal and the second audio signal are alternate, and one section is sky,
One section has signal, then can be easily determined the starting point and end point of the audio signal of the first audio signal/second, and then quickly
Distinguish the first audio signal and the second audio signal.
Further, the amplitude or signal frequency that can also be defined to first audio signal are 0, the second audio signal
It is not 0 simple signal for amplitude and signal frequency, that is, only exists the second audio signal, in the absence of the first audio signal, first
Audio signal is sky.
It can be seen that, during the first audio signal and the second audio signal are alternate, one section for sky, one section have signal and
The signal is simple signal, then can determine the border of two signals with the audio signal of quick separating first and the second audio signal
Point.
When making synchronism detection signal, one of signal and one of signal in audio signal in vision signal
Cycle phase with and signal is synchronous, the cycle phase of another signal in vision signal and another signal in audio signal with and
Signal is synchronous.Respectively that two vision signals are corresponding with audio signal, then vision signal is correspondingly formed in synchronism detection signal
The waveform that waveform is correspondingly formed with audio signal is mutually echoed, and the time of the trip point of two waveforms is identical, i.e. its in audio signal
In an audio signal jump to time of another audio signal, jumped to separately with one of vision signal in vision signal
The time of one vision signal is identical.After synchronism detection signal is gathered at end to be measured and is played back, if the jump of two signals
The time of height is identical or gap is in setting range, then it represents that by the audio-visual synchronization at end to be measured, sound is not present in end to be measured
The nonsynchronous defect of video, if the time of the trip point of two signals is different, or gap is outside setting range, then it represents that by treating
The audio frequency and video for surveying end are asynchronous, and end to be measured has the nonsynchronous defect of audio frequency and video.
As shown in figure 3, Fig. 3 is a kind of signal of synchronism detection signal of the application according to an exemplary embodiment
Figure.In the schematic diagram, synchronism detection signal includes vision signal V and audio signal A.Bright picture signal in vision signal can
Think that the dark picture signal in all light picture, vision signal can be complete dark picture, and the duration of some frame all light pictures occur
It is identical with there is the duration of the complete dark picture of some frames.First audio signal is sky, and the second audio signal is simple signal, and second
The appearance duration of vision signal is identical with interval duration, the second audio signal and all light picture synchronization.
When making synchronism detection signal, the synchronism detection signal of different frame per second can be made, test is applicable to different
In the application scenarios of frame per second, so as to improve the test scope of audio-visual synchronization method of testing.
In an optional implementation, institute can be gathered by the light sensor that is arranged on end screen to be measured
The image shown on end screen to be measured is stated, and acquired image signal is converted into electric signal.
In the present embodiment, light sensor can be arranged on the screen at end to be measured, is gathered by light sensor
The image shown on end screen to be measured, and then corresponding electric signal can be obtained.Information, cost are gathered using light sensor
It is low.
Further, light sensor can be made to obtain by high-precision photodiode.By using photosensitive two pole
Pipe makes the light sensor collection information obtained, acquisition precision can be improved, so as to reduce synchronism detection error.Such as Fig. 4 institutes
Show, Fig. 4 is a kind of circuit diagram of optical sensor of the application according to an exemplary embodiment.The light sensor includes steady
Depressor, photodiode, triode, electric capacity, resistance etc..
In one example, the picture signal of different brightness can be converted into different electrical signals by light sensor, due to
The brightness value of bright picture signal and dark picture signal belongs to different range of luminance values, therefore is converted to and is formed after electric signal
Waveform it is different.
In another example, photodiode is provided with light sensor, is more than the first predetermined luminance in brightness value
During threshold value, photodiode conducting, when brightness value is less than the second predetermined luminance threshold value, photodiode is not turned on.Therefore, it is bright
The brightness value of picture signal is more than the first predetermined luminance threshold value, and the brightness value of dark picture signal is less than the second predetermined luminance threshold value,
If showing bright picture signal on end screen to be measured, acquired image signal is converted into high level signal；If end screen to be measured
The upper dark picture signal of displaying, low level signal is converted to by acquired image signal.
It can be seen that, corresponding picture signal is represented by high level signal and low level signal, square wave can be formed, more just
In the comparison of audio/video synchronous error, so as to improve the accuracy of audio-visual synchronization test.
In one example, the waveform of electric signal can be contrasted by double track digital oscilloscopes, to determine the sound at end to be measured
Whether video is synchronous.Specifically, oscillograph two-way can input the electric signal of the audio of light sensor output respectively, and treat
The electric signal of end output is surveyed, so as to compare the waveform of two electric signal formation.
In another example, the electric signal of light sensor output can be recorded using computer Line-in two-channels
And the electric signal of the audio of end output to be measured, by the waveform for comparing two kinds of electric signal formation, you can determine the sound at end to be measured
Whether video is synchronous.
After the corresponding electric signal of picture signal and the corresponding electric signal of audio signal is obtained, due in vision signal wherein
The cycle phase of one signal and one of signal in audio signal with and signal is synchronous, another signal in vision signal and
The cycle phase of another signal in audio signal is same and signal is synchronous；The brightness value of bright picture signal and dark picture signal is adhered to separately
In different range of luminance values, the first audio signal is different with the amplitude and/or signal frequency of the second audio signal.Therefore, scheme
As the formation of signal corresponding electric signal waveform in the regular waveform change of tool occurs, when bright picture signal and dark image are believed
When number switching over, saltus step occurs in waveform.Also occur with rule in the waveform of the corresponding electric signal formation of audio signal
The waveform change of rule, when the first audio signal and the second audio signal are switched over, occurs saltus step in waveform.If two ripples
When the time of shape saltus step is identical, it is possible to determine that the nonsynchronous phenomenon of audio frequency and video do not occur after end to be measured is handled, if two
When the time of waveform saltus step is different, it is possible to determine that the nonsynchronous phenomenon of audio frequency and video occur after end to be measured is handled.
Illustrated by taking square wave as an example.As shown in figure 5, Fig. 5 is one of the application according to an exemplary embodiment
Plant comparison of wave shape schematic diagram.In the schematic diagram, including the corresponding waveform V ' of picture signal and the corresponding waveform of audio signal
A’.If in synchronism detection signal, vision signal is alternately made up of all light picture signal and complete dark picture signal, audio signal by
Spacing wave and simple signal are alternately constituted, and simple signal and all light signal cycle phase together and signal is synchronous, then can contrast
The time difference t of rising edge in both waveforms, this time difference t is audio/video synchronous error.T is zero, or less than predetermined threshold value
When, it is believed that end audio-visual synchronization or near-synchronous to be measured, otherwise it is assumed that end audio frequency and video to be measured are asynchronous.
Embodiment with foregoing audio-visual synchronization method of testing is corresponding, is present invention also provides audio-visual synchronization test
The embodiment of system.
As shown in fig. 6, Fig. 6 is a kind of audio-visual synchronization test system of the application according to an exemplary embodiment
Block diagram, the system includes：Playing module 610, image capture module 620, audio collection module 630 and interpretation of result module
640。
Wherein, playing module 610, for playing in default synchronism detection signal, the synchronism detection signal, video letter
Number alternately it is made up of bright picture signal and dark picture signal, audio signal replaces structure by the first audio signal and the second audio signal
Into；In vision signal the cycle phase of one of signal and one of signal in audio signal with and signal is synchronous, video is believed
The cycle phase of another signal in number and another signal in audio signal with and signal is synchronous；Bright picture signal and dark figure
As the brightness value of signal belongs to different range of luminance values, the first audio signal is different with the second audio signal.
Image capture module 620, the figure for after end to be measured collection synchronism detection signal, gathering the end output to be measured
Picture, and acquired image signal is converted into electric signal.
Audio collection module 630, the sound for after end to be measured collection synchronism detection signal, gathering the end output to be measured
Frequently, and by the audio signal gathered it is converted into electric signal.
Interpretation of result module 640, for determining whether the audio frequency and video for passing through end to be measured are same by contrasting the waveform of electric signal
Step.
Wherein, audio collection module 630 and interpretation of result module 640 can be set in the same apparatus, can also be set
Put in distinct device.
In an optional implementation, the bright picture signal is the picture signal that brightness is 100%, the dark figure
As signal is the picture signal that brightness is 0%.
In an optional implementation, the amplitude or signal frequency of first audio signal are 0, the second audio letter
Number be amplitude and signal frequency be not 0 simple signal.
In an optional implementation, described image acquisition module is arranged in light sensor, and described image is adopted
Collect module specifically for：
The image shown on the end screen to be measured is gathered, if showing bright picture signal on the screen, by what is gathered
Picture signal is converted to high level signal；If showing dark picture signal on the screen, acquired image signal is converted to
Low level signal.
Accordingly, the disclosure also provides a kind of audio-visual synchronization test system, including：Playback equipment, light sensor, letter
Cease processing equipment；
The playback equipment be used for play in default synchronism detection signal, the synchronism detection signal, vision signal by
Bright picture signal and dark picture signal are alternately constituted, and audio signal is alternately made up of the first audio signal and the second audio signal；
In vision signal the cycle phase of one of signal and one of signal in audio signal with and signal is synchronous, in vision signal
Another signal and another signal in audio signal cycle phase with and signal is synchronous；Bright picture signal and dark image letter
Number brightness value belong to different range of luminance values, the first audio signal is different with the second audio signal.
After end to be measured collection synchronism detection signal, the light sensor is used for the figure for gathering the end output to be measured
Picture, and acquired image signal is converted into electric signal；Meanwhile, described information processing equipment is defeated for gathering the end to be measured
The audio gone out, and the audio signal gathered is converted into electric signal.
Described information processing equipment be additionally operable to by contrast electric signal waveform determine by end to be measured audio frequency and video whether
It is synchronous.The function of modules and the specific details of implementation process of effect are shown in the reality of correspondence step in the above method in said system
Existing process, will not be repeated here.
For system embodiment, because it corresponds essentially to embodiment of the method, so related part is real referring to method
Apply the part explanation of example.System embodiment described above is only schematical, wherein described be used as separating component
The module of explanation can be or may not be physically separate, and the part shown as module can be or can also
It is not physical module, you can with positioned at a place, or can also be distributed on multiple mixed-media network modules mixed-medias.Can be according to reality
Selection some or all of module therein is needed to realize the purpose of application scheme.Those of ordinary skill in the art are not paying
In the case of going out creative work, you can to understand and implement.
Accordingly, the disclosure also provides a kind of computer-readable recording medium, is stored thereon with computer program, the program
The step of audio-visual synchronization method of testing described in any of the above-described is realized when being executed by processor.
The disclosure can be used (includes but is not limited to disk in one or more storage mediums for wherein including program code
Memory, CD-ROM, optical memory etc.) on the form of computer program product implemented.Computer-usable storage medium bag
Permanent and non-permanent, removable and non-removable media is included, can realize that information is stored by any method or technique.Letter
Breath can be computer-readable instruction, data structure, the module of program or other data.The example bag of the storage medium of computer
Include but be not limited to：Phase transition internal memory (PRAM), static RAM (SRAM), dynamic random access memory (DRAM),
Other kinds of random access memory (RAM), read-only storage (ROM), Electrically Erasable Read Only Memory
(EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read-only storage (CD-ROM), digital versatile disc
(DVD) or other optical storages, magnetic cassette tape, the storage of tape magnetic rigid disk or other magnetic storage apparatus or any other non-pass
Defeated medium, the information that can be accessed by a computing device available for storage.
Those skilled in the art will readily occur to its of the application after considering specification and putting into practice invention disclosed herein
Its embodiment.The application is intended to any modification, purposes or the adaptations of the application, these modifications, purposes or
Person's adaptations follow the general principle of the application and including the undocumented common knowledge in the art of the application
Or conventional techniques.Description and embodiments are considered only as exemplary, and the true scope of the application and spirit are by following
Claim is pointed out.
It should be appreciated that the precision architecture that the application is not limited to be described above and is shown in the drawings, and
And various modifications and changes can be being carried out without departing from the scope.Scope of the present application is only limited by appended claim.
The preferred embodiment of the application is the foregoing is only, not to limit the application, all essences in the application
God is with principle, and any modification, equivalent substitution and improvements done etc. should be included within the scope of the application protection.
Claims (10)
1. a kind of audio-visual synchronization method of testing, it is characterised in that methods described includes：
Play in default synchronism detection signal, the synchronism detection signal, vision signal is believed by bright picture signal and dark image
Number alternately constitute, audio signal is alternately made up of the first audio signal and the second audio signal；One of letter in vision signal
Number with the cycle phase of one of signal in audio signal with and signal is synchronous, another signal in vision signal and audio letter
The cycle phase of another signal in number is same and signal is synchronous；The brightness value of bright picture signal and dark picture signal belongs to difference
Range of luminance values, the first audio signal is different with the second audio signal；
After end to be measured collection synchronism detection signal, while the image and audio of the collection end output to be measured, and will be adopted
The picture signal and audio signal of collection are converted into electric signal respectively；
Determine whether the audio frequency and video for passing through end to be measured are synchronous by contrasting the waveform of electric signal.
2. according to the method described in claim 1, it is characterised in that the bright picture signal is that the image that brightness is 100% is believed
Number, the dark picture signal is the picture signal that brightness is 0%.
3. according to the method described in claim 1, it is characterised in that the amplitude or signal frequency of first audio signal are 0,
Second audio signal be amplitude and signal frequency be not 0 simple signal.
4. the method according to any one of claims 1 to 3, it is characterised in that the figure of the collection end output to be measured
Picture, including：
By the light sensor being arranged on end screen to be measured, the image shown on the end screen to be measured is gathered.
5. method according to claim 4, it is characterised in that photodiode is provided with the light sensor, described
Acquired image signal is converted into electric signal, including：
If showing bright picture signal on the screen, acquired image signal is converted into high level signal；
If showing dark picture signal on the screen, acquired image signal is converted into low level signal.
6. according to the method described in claim 1, it is characterised in that the end to be measured includes end-to-end audio frequency and video real-time system,
It is described after end to be measured collection synchronism detection signal, while the image and audio of the collection end to be measured output, including：
After collecting device collection synchronism detection signal in the end-to-end audio frequency and video real-time system, arrived while gathering the end
Hold image and audio that the playback equipment in audio frequency and video real-time system is exported.
7. a kind of audio-visual synchronization test system, it is characterised in that the system includes：
Playing module, for playing in default synchronism detection signal, the synchronism detection signal, vision signal is believed by bright image
Number and dark picture signal alternately constitute, audio signal is alternately made up of the first audio signal and the second audio signal；Vision signal
In one of signal and one of signal in audio signal cycle phase with and signal is synchronous, another in vision signal
The cycle phase of signal and another signal in audio signal with and signal is synchronous；The brightness of bright picture signal and dark picture signal
Value belongs to different range of luminance values, and the first audio signal is different with the second audio signal；
Image capture module, the image for after end to be measured collection synchronism detection signal, gathering the end output to be measured, and will
Acquired image signal is converted into electric signal；
Audio collection module, the audio for after end to be measured collection synchronism detection signal, gathering the end output to be measured, and will
The audio signal gathered is converted into electric signal；
Interpretation of result module, for determining whether the audio frequency and video for passing through end to be measured are synchronous by contrasting the waveform of electric signal.
8. system according to claim 7, it is characterised in that the bright picture signal is that the image that brightness is 100% is believed
Number, the dark picture signal is the picture signal that brightness is 0%；
And/or, the amplitude or signal frequency of first audio signal are 0, the second audio signal be amplitude and signal frequency not
For 0 simple signal.
9. the system according to claim 7 or 8, it is characterised in that described image acquisition module is arranged on light sensor
In, described image acquisition module specifically for：
The image shown on the end screen to be measured is gathered, if showing bright picture signal on the screen, by acquired image
Signal is converted to high level signal；If showing dark picture signal on the screen, acquired image signal is converted into low electricity
Ordinary mail number.
10. a kind of audio-visual synchronization test system, it is characterised in that including：Playback equipment, light sensor, information processing are set
It is standby；
The playback equipment is used to play in default synchronism detection signal, the synchronism detection signal, and vision signal is by bright figure
As signal and dark picture signal alternating composition, audio signal is alternately made up of the first audio signal and the second audio signal；Video
In signal the cycle phase of one of signal and one of signal in audio signal with and signal is synchronous, it is another in vision signal
The cycle phase of one signal and another signal in audio signal with and signal is synchronous；Bright picture signal and dark picture signal
Brightness value belongs to different range of luminance values, and the first audio signal is different with the second audio signal；
After end to be measured collection synchronism detection signal, the light sensor is used for the image for gathering the end output to be measured, and
Acquired image signal is converted into electric signal；Meanwhile, described information processing equipment is used to gather the end output to be measured
Audio, and the audio signal gathered is converted into electric signal；
Described information processing equipment is additionally operable to determine whether the audio frequency and video for passing through end to be measured are synchronous by the waveform for contrasting electric signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710428408.2A CN107172419A (en) | 2017-06-08 | 2017-06-08 | Audio-visual synchronization method of testing and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710428408.2A CN107172419A (en) | 2017-06-08 | 2017-06-08 | Audio-visual synchronization method of testing and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107172419A true CN107172419A (en) | 2017-09-15 |
Family
ID=59826127
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710428408.2A Pending CN107172419A (en) | 2017-06-08 | 2017-06-08 | Audio-visual synchronization method of testing and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107172419A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112929149A (en) * | 2021-03-22 | 2021-06-08 | 峰米(北京)科技有限公司 | Audio synchronization method and system |
| CN113766215A (en) * | 2021-09-07 | 2021-12-07 | 中电科航空电子有限公司 | Airborne passenger cabin passenger broadcasting synchronous testing method and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101022560A (en) * | 2007-03-09 | 2007-08-22 | 北京牡丹视源电子有限责任公司 | Digital TV video and audio synchronous testing signal and measuring method thereof |
| CN101742357A (en) * | 2009-12-29 | 2010-06-16 | 北京牡丹电子集团有限责任公司 | Method for measuring audio/video synchronous error of digital television device |
| CN101796812A (en) * | 2006-03-31 | 2010-08-04 | 莱切技术国际公司 | Lip synchronization system and method |
| CN201585085U (en) * | 2009-12-29 | 2010-09-15 | 北京牡丹电子集团有限责任公司 | Metering equipment for AV synchronous error of digital television equipment |
| CN103313089A (en) * | 2012-03-16 | 2013-09-18 | 三洋科技中心(深圳)有限公司 | Lip synchronization detection device and method |
| CN103796006A (en) * | 2012-10-30 | 2014-05-14 | 中兴通讯股份有限公司 | System and method for labial sound synchronization test |
-
2017
- 2017-06-08 CN CN201710428408.2A patent/CN107172419A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101796812A (en) * | 2006-03-31 | 2010-08-04 | 莱切技术国际公司 | Lip synchronization system and method |
| CN101022560A (en) * | 2007-03-09 | 2007-08-22 | 北京牡丹视源电子有限责任公司 | Digital TV video and audio synchronous testing signal and measuring method thereof |
| CN101742357A (en) * | 2009-12-29 | 2010-06-16 | 北京牡丹电子集团有限责任公司 | Method for measuring audio/video synchronous error of digital television device |
| CN201585085U (en) * | 2009-12-29 | 2010-09-15 | 北京牡丹电子集团有限责任公司 | Metering equipment for AV synchronous error of digital television equipment |
| CN103313089A (en) * | 2012-03-16 | 2013-09-18 | 三洋科技中心(深圳)有限公司 | Lip synchronization detection device and method |
| CN103796006A (en) * | 2012-10-30 | 2014-05-14 | 中兴通讯股份有限公司 | System and method for labial sound synchronization test |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112929149A (en) * | 2021-03-22 | 2021-06-08 | 峰米(北京)科技有限公司 | Audio synchronization method and system |
| CN112929149B (en) * | 2021-03-22 | 2023-01-03 | 峰米(北京)科技有限公司 | Audio synchronization method and system |
| CN113766215A (en) * | 2021-09-07 | 2021-12-07 | 中电科航空电子有限公司 | Airborne passenger cabin passenger broadcasting synchronous testing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101616331B (en) | Method for testing video frequency frame rate and audio-video synchronous performance | |
| US8379735B2 (en) | Automatic video glitch detection and audio-video synchronization assessment | |
| CN104810025B (en) | Audio similarity detection method and device | |
| US20120075480A1 (en) | Video testing system and method | |
| CN108401217A (en) | Signal output and TWS earphone testing method, terminal, device and storage medium | |
| CN107509107A (en) | Method, device and equipment for detecting video playing fault and readable medium | |
| CN106358039B (en) | Sound draws synchronous detecting method and device | |
| CN108933935A (en) | Detection method, device, storage medium and the computer equipment of video communication system | |
| CN104091607B (en) | Video editing method and device based on IOS equipment | |
| CN102655585B (en) | Video conference system and time delay testing method, device and system thereof | |
| TW200536389A (en) | Intelligent key-frame extraction from a video | |
| CN109191444A (en) | Video area based on depth residual error network removes altering detecting method and device | |
| CN109842795A (en) | Audio-visual synchronization performance test methods, device, electronic equipment, storage medium | |
| CN110049373A (en) | Set-top box Caton detection method, system and storage medium | |
| CN201467383U (en) | Video frequency frame rate tester | |
| CN110475156A (en) | A kind of calculation method and device of slowed-down video value | |
| CN107172419A (en) | Audio-visual synchronization method of testing and system | |
| CN103475911B (en) | Television information providing method and system based on video characteristics | |
| CN110113598A (en) | A kind of Network Personal Video Recorder test method and system | |
| CN104254019A (en) | Information push result detecting method and information push result detecting system | |
| CN107483916A (en) | The control method of audio frequency and video archival quality detecting system | |
| WO1997050256A1 (en) | System and method for evaluating video fidelity by determining information frame rate | |
| CN114419502A (en) | Data analysis method and device and storage medium | |
| CN110248235A (en) | Software teaching method, apparatus, terminal device and medium | |
| US10097819B2 (en) | Testing system, testing method, computer program product, and non-transitory computer readable data carrier |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170915 |
|
| RJ01 | Rejection of invention patent application after publication |