CN105657512A - Method for monitoring sound-picture asynchronization of digital video - Google Patents

Method for monitoring sound-picture asynchronization of digital video Download PDF

Info

Publication number
CN105657512A
CN105657512A CN201610063984.7A CN201610063984A CN105657512A CN 105657512 A CN105657512 A CN 105657512A CN 201610063984 A CN201610063984 A CN 201610063984A CN 105657512 A CN105657512 A CN 105657512A
Authority
CN
China
Prior art keywords
sound
video
digital video
decoding
draws
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610063984.7A
Other languages
Chinese (zh)
Inventor
梁敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sichuan Changhong Electric Co Ltd
Original Assignee
Sichuan Changhong Electric Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sichuan Changhong Electric Co Ltd filed Critical Sichuan Changhong Electric Co Ltd
Priority to CN201610063984.7A priority Critical patent/CN105657512A/en
Publication of CN105657512A publication Critical patent/CN105657512A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4342—Demultiplexing isochronously with video sync, e.g. according to bit-parallel or bit-serial interface formats, as SDI
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The present invention relates to video display terminal testing technologies, and discloses a method for monitoring sound-picture asynchronization of a digital video, aiming to solve the problem in traditional technologies that sound-picture asynchronization of the digital video cannot be monitored precisely in real time. The method comprises a first step of monitoring decoding asynchronization of the sound and pictures of the digital video and a second step of monitoring display asynchronization of the sound and pictures of the digital video. The first step comprises substeps of acquiring a fixed difference of audio and video decoding time stamps (DTS) of the digital video; and determining whether sound-picture asynchronization occurs in audio-video decoding in a decoding terminal, if the sound-picture asynchronization occurs, alarming and prompting. The second step comprises the substeps of acquiring a fixed difference of audio and video presentation time stamps (PTS) of the digital video; and determining whether sound-picture asynchronization occurs in audio-video display in the decoding terminal, if the sound-picture asynchronization occurs, alarming and prompting. The method is applicable to monitoring of sound-picture asynchronization of the digital video.

Description

A kind of digital video sound draws step-out monitoring method
Technical field
The present invention relates to video display terminal measuring technology, be specifically related to a kind of digital video sound and draw step-out monitoring method.
Background technology
The audio frequency and video of DTV in television for play process it sometimes appear that sound draw nonsynchronous phenomenon, similar being easy in Android intelligent television is tested occurs, asynchronous once find, rely on manual testing, accurately can not draw the time difference of step-out by test tone, can not judging nonsynchronous time point occur, the log of crawl is invalid many times.
It is more complicated that actual sound draws nonsynchronous reason: when audio-video signal is displayed without synchronizing, and the TV programme of user's viewing arise that obvious sound is drawn asynchronous; Some is play frame losing and causes, and some is that video problems causes, and some is that audio, video data decoding causes.
In digital TV decoding process, every two field picture has a unique DTS (time point of audio/video decoding) and unique PTS (time point that audio frequency and video show) value. When utilizing buffer storage signal, actual signal and corresponding frame are variations, add the difference of data redundancy amount size, and compression ratio is also different, and therefore in picture frame group layer processes, the order of B frame and P frame also there occurs change. These make the difficulty testing the sound picture step-out of digital television signal higher.
Summary of the invention
The technical problem to be solved is: proposes a kind of digital video sound and draws step-out monitoring method, and solving in conventional art can not the problem of accurate measurements digital video sound picture step-out in real time.
The technical solution adopted for the present invention to solve the technical problems is: a kind of digital video sound draws step-out monitoring method, including:
A, the decoding step-out monitoring step that digital video sound is drawn:
A1, obtain the consistent difference of audio/video decoding time tag DTS of digital video;
A2, judge the audio/video decoding of decoding end whether occur sound draw step-out, if step-out occurs, then alarm;
B, the display step-out monitoring step that digital video sound is drawn:
B1, obtain the consistent difference of audio frequency and video Presentation Time Stamp PTS of digital video;
B2, judge that the audio frequency and video of decoding end display whether to occur that sound draws step-out, if step-out occurs, then alarm.
Further, in step A1, the consistent difference of the audio/video decoding time tag DTS of described acquisition digital video method particularly includes:
Under frame identical in signal code bag, obtain audio frequency DTS and video DTS respectively, the consistent difference of the two is recorded storage.
Further, in step A2, whether the described audio/video decoding judging decoding end occurs that sound draws step-out, if step-out occurs, then and alarm method particularly includes:
Comparing the DTS of same number of frames audio frequency and the difference of both DTS of video at Fixed Time Interval, if it occur that change, just illustrate in decoding process, it is asynchronous that sound draws generation; Calculating according to actual frame per second and obtain the sound nonsynchronous actual frame number of picture, when difference variation is more than a frame, prompting is reported to the police, simultaneously the decoding time point of prompting problem generation.
Further, in step B1, the concrete grammar of the consistent difference of the audio frequency and video Presentation Time Stamp PTS of described acquisition digital video is:
Under frame identical in signal code bag, obtain audio frequency PTS and video PTS respectively, the consistent difference of the two is recorded storage.
Further, in step B2, it is judged that the audio frequency and video of decoding end display whether occur that sound draws step-out, if there is step-out, then the concrete grammar of alarm is:
Comparing the PTS of same number of frames audio frequency and the difference of both PTS of video at Fixed Time Interval, if it occur that change, just illustrate in display process, it is asynchronous that sound draws generation; Calculating according to actual frame per second and obtain the sound nonsynchronous actual frame number of picture, when difference variation is more than a frame, prompting is reported to the police, simultaneously the display time point of prompting problem generation.
The invention has the beneficial effects as follows: can accurately test sound and image synchronization interval, real-time prompting sound draws step-out point, obtaining current sound and draw nonsynchronous frame number, labelling sound draws the video of step-out and the time point of audio frequency respectively, and the sound of monitor digital video draws asynchronous state; Relevant design orientation problem can be helped.
Accompanying drawing explanation
Fig. 1 is the decoding step-out monitoring flow process that digital video sound is drawn;
Fig. 2 is the display step-out monitoring flow process that digital video sound is drawn.
Detailed description of the invention
It is contemplated that propose a kind of digital video sound to draw step-out monitoring method, solving in conventional art can not the problem of accurate measurements digital video sound picture step-out in real time. Sound and the decoding of image, display time that the present invention uses in digital video in each PID bag accurately test sound and image synchronization interval. Carry out comparison according to this time difference, confirm the time relationship between sound and image after decoding, display, thus the sound monitoring digital video real-time and accurately draws asynchronous state.
Digital video sound in the present invention draws step-out monitoring method, including: the decoding step-out monitoring step that digital video sound is drawn and the display step-out monitoring step that digital video sound is drawn;
As it is shown in figure 1, in the decoding step-out monitoring that digital video sound is drawn, under frame identical in signal code bag, obtain audio frequency DTS and video DTS respectively, the consistent difference of the two recorded storage; Then, comparing the DTS of same number of frames audio frequency and the difference of both DTS of video at Fixed Time Interval, if it occur that change, just illustrate in decoding process, it is asynchronous that sound draws generation; Calculating according to actual frame per second and obtain the sound nonsynchronous actual frame number of picture, when difference variation is more than a frame, prompting is reported to the police, simultaneously the decoding time point of prompting problem generation.
As in figure 2 it is shown, in the display step-out monitoring that digital video sound is drawn, under frame identical in signal code bag, obtain audio frequency PTS and video PTS respectively, the consistent difference of the two recorded storage; Then, comparing the PTS of same number of frames audio frequency and the difference of both PTS of video at Fixed Time Interval, if it occur that change, just illustrate in display process, it is asynchronous that sound draws generation;Calculating according to actual frame per second and obtain the sound nonsynchronous actual frame number of picture, when difference variation is more than a frame, prompting is reported to the police, simultaneously the display time point of prompting problem generation.
Embodiment:
Use 3D50A4500i complete machine, play local digital video-" the fast and the furious 4 ". This video is carried out sound and draws nonsynchronous monitoring by this example:
First before testing, the consistent difference of Pts and the Dts of Voice & Video is obtained; Video playback constantly reads differential time; When the differential time of the two exceeds the time span of consistent difference+1 frame video, start to report to the police and record operation; Record current time location and the frame number of step-out;
On being embodied as, it is necessary to be done as follows:
1, computer connects the serial ports of complete machine: arrange port data;
2, the monitoring pattern to television for play digital video is started;
3, the related data such as corresponding selection TCH test channel, timer duration, start time point;
4, use function key, start operation;
5, test the decoding of the digital video play respectively, display sound draws the frame number of step-out, sound draws out of alignment time position.

Claims (5)

1. a digital video sound draws step-out monitoring method, it is characterised in that including:
A, the decoding step-out monitoring step that digital video sound is drawn:
A1, obtain the consistent difference of audio/video decoding time tag DTS of digital video;
A2, judge the audio/video decoding of decoding end whether occur sound draw step-out, if step-out occurs, then alarm;
B, the display step-out monitoring step that digital video sound is drawn:
B1, obtain the consistent difference of audio frequency and video Presentation Time Stamp PTS of digital video;
B2, judge that the audio frequency and video of decoding end display whether to occur that sound draws step-out, if step-out occurs, then alarm.
2. a kind of digital video sound as claimed in claim 1 draws step-out monitoring method, it is characterised in that in step A1, the consistent difference of the audio/video decoding time tag DTS of described acquisition digital video method particularly includes:
Under frame identical in signal code bag, obtain audio frequency DTS and video DTS respectively, the consistent difference of the two is recorded storage.
3. digital video sound as claimed in claim 2 a kind of draws step-out monitoring method, it is characterised in that in step A2, whether the described audio/video decoding judging decoding end occurs that sound draws step-out, if step-out occurs, then and alarm method particularly includes:
Comparing the DTS of same number of frames audio frequency and the difference of both DTS of video at Fixed Time Interval, if it occur that change, just illustrate in decoding process, it is asynchronous that sound draws generation; Calculating according to actual frame per second and obtain the sound nonsynchronous actual frame number of picture, when difference variation is more than a frame, prompting is reported to the police, simultaneously the decoding time point of prompting problem generation.
4. a kind of digital video sound as claimed in claim 1 draws step-out monitoring method, it is characterised in that in step B1, the concrete grammar of the consistent difference of the audio frequency and video Presentation Time Stamp PTS of described acquisition digital video is:
Under frame identical in signal code bag, obtain audio frequency PTS and video PTS respectively, the consistent difference of the two is recorded storage.
5. a kind of digital video sound as claimed in claim 4 draws step-out monitoring method, it is characterised in that in step B2, it is judged that the audio frequency and video of decoding end display whether occur that sound draws step-out, if there is step-out, then the concrete grammar of alarm is:
Comparing the PTS of same number of frames audio frequency and the difference of both PTS of video at Fixed Time Interval, if it occur that change, just illustrate in display process, it is asynchronous that sound draws generation;Calculating according to actual frame per second and obtain the sound nonsynchronous actual frame number of picture, when difference variation is more than a frame, prompting is reported to the police, simultaneously the display time point of prompting problem generation.
CN201610063984.7A 2016-01-29 2016-01-29 Method for monitoring sound-picture asynchronization of digital video Pending CN105657512A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610063984.7A CN105657512A (en) 2016-01-29 2016-01-29 Method for monitoring sound-picture asynchronization of digital video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610063984.7A CN105657512A (en) 2016-01-29 2016-01-29 Method for monitoring sound-picture asynchronization of digital video

Publications (1)

Publication Number Publication Date
CN105657512A true CN105657512A (en) 2016-06-08

Family

ID=56488985

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610063984.7A Pending CN105657512A (en) 2016-01-29 2016-01-29 Method for monitoring sound-picture asynchronization of digital video

Country Status (1)

Country Link
CN (1) CN105657512A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106385628A (en) * 2016-09-23 2017-02-08 努比亚技术有限公司 Apparatus and method for analyzing audio and video asynchronization
CN106875952A (en) * 2016-12-23 2017-06-20 伟乐视讯科技股份有限公司 The soft encoding mechanism of MCVF multichannel voice frequency based on FPGA embedded systems

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5594660A (en) * 1994-09-30 1997-01-14 Cirrus Logic, Inc. Programmable audio-video synchronization method and apparatus for multimedia systems
CN1645944A (en) * 2004-12-13 2005-07-27 武汉大学 Method for testing audio and video frequency step falling out of audio and video frequency coding-decoding system
CN1836443A (en) * 2003-07-01 2006-09-20 Lg电子株式会社 Method for testing lip-sync of a dtv and an apparatus thereof by using time indexed audio and video signals
CN102075806A (en) * 2011-01-26 2011-05-25 四川长虹电器股份有限公司 Audio and video synchronization method of digital television
CN102421035A (en) * 2011-12-31 2012-04-18 青岛海信宽带多媒体技术有限公司 Method and device for synchronizing audio and video of digital television
CN102724559A (en) * 2012-06-13 2012-10-10 天脉聚源(北京)传媒科技有限公司 Method and system for synchronizing encoding of videos and audios

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5594660A (en) * 1994-09-30 1997-01-14 Cirrus Logic, Inc. Programmable audio-video synchronization method and apparatus for multimedia systems
CN1836443A (en) * 2003-07-01 2006-09-20 Lg电子株式会社 Method for testing lip-sync of a dtv and an apparatus thereof by using time indexed audio and video signals
CN1645944A (en) * 2004-12-13 2005-07-27 武汉大学 Method for testing audio and video frequency step falling out of audio and video frequency coding-decoding system
CN102075806A (en) * 2011-01-26 2011-05-25 四川长虹电器股份有限公司 Audio and video synchronization method of digital television
CN102421035A (en) * 2011-12-31 2012-04-18 青岛海信宽带多媒体技术有限公司 Method and device for synchronizing audio and video of digital television
CN102724559A (en) * 2012-06-13 2012-10-10 天脉聚源(北京)传媒科技有限公司 Method and system for synchronizing encoding of videos and audios

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106385628A (en) * 2016-09-23 2017-02-08 努比亚技术有限公司 Apparatus and method for analyzing audio and video asynchronization
CN106875952A (en) * 2016-12-23 2017-06-20 伟乐视讯科技股份有限公司 The soft encoding mechanism of MCVF multichannel voice frequency based on FPGA embedded systems

Similar Documents

Publication Publication Date Title
CN109089064B (en) Apparatus and method for processing media signal
KR100499037B1 (en) Method and apparatus of dtv lip-sync test
CN110868600B (en) Target tracking video plug-flow method, display method, device and storage medium
KR101777908B1 (en) Method of processing a sequence of coded video frames
CN101478683B (en) Synchronizing audio and video frames
CN105979332A (en) Video data detection method and device
CN102421035A (en) Method and device for synchronizing audio and video of digital television
CN101616331A (en) A kind of method that video frame rate and audio-visual synchronization performance are tested
CN109508276B (en) Method for improving equipment factory detection efficiency on Android platform
CN111131874B (en) Method, equipment and computer storage medium for solving problem of playing jam of H.265 code stream random access point
CN101322410A (en) Method and device for detecting video data error
CN114079813A (en) Picture synchronization method, coding method, video playing device and video coding device
CN105657512A (en) Method for monitoring sound-picture asynchronization of digital video
CN100496133C (en) Method for testing audio and video frequency out of step of audio and video frequency coding-decoding system
CN113141525B (en) Online video cut-off continuous playing method and system
CN115665493A (en) Large screen splicing device supporting recording and playing, splicer, playing control method and system
CN116489342B (en) Method and device for determining coding delay, electronic equipment and storage medium
WO2023240927A1 (en) Terminal capability test system, method, device, and storage medium
JP2010219735A (en) Broadcast receiver
CN115633207A (en) Set top box self-adaptive audio and video synchronization method
CN112437242B (en) Method and apparatus for processing media signal
JP2007060222A (en) Apparatus, method and program for processing video
CN113014917A (en) Audio transmission quality evaluation method, device, equipment and storage medium
TWI625059B (en) Terminal device and method for audio video synchronization
TWI413412B (en) Set-top box and program recording method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160608

RJ01 Rejection of invention patent application after publication