JP2010279014A - Synchronism verification method of stream data processing and stream data processing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an AV synchronism verification method of stream data processing for AV synchronous reproduction of stream data. <P>SOLUTION: According to the AV synchronism verification method, in a state that AV synchronous control is invalidated (ST100), asynchronous data obtained by decoding stream data are compressed on a one-frame unit basis and sequentially captured as expected value data (ST200). Next, in a state that AV synchronous control is validated (ST300), synchronous data obtained by decoding stream data are compressed on a one-frame unit basis. The compressed synchronous data are collated with the expected value data (ST400). <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a digital broadcasting AV system that processes stream data distributed by digital broadcasting (digital BS, digital CS, terrestrial digital, etc.) and outputs the processed data. More specifically, the present invention relates to a digital broadcast AV system that enables quantitative verification of synchronization processing.

In a digital AV broadcasting system, stream data in which video and audio data are multiplexed is distributed by digital broadcasting. When the video and audio are played back, synchronization control is executed to match the playback timing of both. There is a need to.
The AV synchronization verification in the conventional digital broadcasting system relies on the subjective evaluation of the viewer, so that the quantitative verification cannot be performed, for example, the evaluation results differ depending on the individual evaluators.

For example, Patent Document 1 discloses a means for detecting synchronization between an audio signal and a video signal in a recording / reproducing apparatus that compresses and records video and audio signals.
FIG. 10 is a conventional example disclosed in Patent Document 1. In FIG.
In Patent Document 1, the video signal generating unit 1 generates a video signal in which the time corresponding to the frame number is superimposed, and the video signal compressing unit 2 compresses the video signal into, for example, the MPEG format.
The time code generating means 3 generates a time code signal corresponding to the video signal generated by the video signal generating means 1.

An example of the time code signal is an LTC (Longitudinal Time Code) signal that has been modulated into an analog signal having an audio signal band.
This time code signal is band-compressed by, for example, MPEG by the audio signal compression means 4.
The compressed time code signal data and the band-compressed video signal are interleaved by the synthesizing means 5 and recorded on the disk medium 8 by the recording means 6.

The reproducing means 7 reproduces the data recorded on the disk medium 8.
The reproduced audio data is restored by the audio signal restoration means 11, and the time code is read by the time code reading means 12 from the output.
In addition, the video with the superimposed time is displayed on the display means 10.
Therefore, the time difference of AV synchronization can be estimated by comparing the displayed time and the time code.

Japanese Patent Laid-Open No. 08-172597

In the configuration of the above-mentioned Patent Document 1, it is necessary to set the compressed data itself in order to detect the synchronization between the audio signal and the video signal in the recording / reproducing apparatus.
The above configuration can be applied to any apparatus that compresses and records data on the disk medium 8 and reproduces it as in Patent Document 1.
However, the above configuration cannot be applied to stream data that is provided in real time and has a standardized code as in digital broadcasting.

  As described above, there is no means for quantitatively verifying the synchronization processing in the processing of stream data such as digital broadcast content, and it has been necessary to rely on subjective evaluation.

  The synchronization verification method for a stream data processing apparatus according to the present invention is a synchronization verification method for a stream data processing apparatus for synchronously reproducing input stream data, wherein asynchronous data obtained by decoding the stream data with synchronization control disabled Are compressed in units of one frame and sequentially taken as expected value data. Next, the synchronization data obtained by decoding the stream data with the synchronization control enabled is compressed in units of one frame. It collates with the expected value data.

  In such a configuration, the data compression value is captured and compared when the synchronization is enabled and disabled. Thereby, since it is not necessary to process the data to be evaluated, synchronization verification of stream data processing such as digital broadcasting can be performed.

The figure which shows 1st Embodiment which concerns on the digital broadcast AV system of this invention. The flowchart which shows the operation | movement procedure of synchronous process verification. The flowchart which shows the detailed operation | movement procedure of the process of acquiring an expected value. The flowchart which shows the detailed operation | movement procedure of the process which collates compressed data. The figure which shows typically a mode that the compression data as expected value data acquired at the time of synchronization invalidity and the video compression data at the time of synchronization validity are compared. The figure which shows the system configuration | structure of 2nd Embodiment. The flowchart which shows the operation | movement procedure of the process of acquiring expected value data in 2nd Embodiment. The flowchart which shows the operation | movement procedure of the process which collates the audio | voice data and expected value data in AV synchronization effective mode in 2nd Embodiment. The figure which shows typically a mode that compressed data are collated in the synchronous verification of 2nd Embodiment. The figure which shows the structure of a prior art.

Embodiments of the present invention will be described below with reference to the drawings.
(First embodiment)
FIG. 1 is a diagram showing a first embodiment according to a digital broadcast AV system (stream data processing apparatus) of the present invention.
The stream data may be digital broadcast as an example, but may be stream data distributed using a communication channel such as the Internet.

First, in the normal mode, an operation in which the digital broadcast AV system 100 processes and outputs multiplexed stream data will be described.
The stream data is received by a receiver or the like (not shown) and input to the data input unit 110.
The data input unit 110 includes a demultiplexing unit 111, a video buffer 112, and an audio buffer 113.
The stream data input to the data input unit 110 is separated into an audio stream and a video stream by the demultiplexing unit 111.
The separated audio stream and video stream are sequentially stored in the audio buffer 113 and the video buffer 112, respectively.

The PTS reading unit 120 acquires PTS information (Presentation Time Stamp) from data on the video buffer 112 and the audio buffer 113.
In the normal operation, the read PTS information is sent to the AV synchronization control unit 140.
The STC counter 130 is set based on PCR (Program Clock Reference) information added to the stream data, and counts a system clock STC (System Time Clock).
The STC information from the STC counter 130 is sent to the AV synchronization control unit 140 in the normal mode.

The AV synchronization control unit 140 synchronizes the audio reproduction output and the video reproduction output based on the STC information and the PTS information, and sends a decoding start command and an output command to the audio signal processing unit 150 and the video signal processing unit 160. give.
At this time, the AV synchronization control unit 140 compares the PTS information with the STC information, and starts reproduction when the STC reaches the PTS time.
The audio signal decoding unit 151 and the video signal decoding unit 161 start decoding upon receiving a decoding start command, and externally output the decoded data upon receiving an output command.
In the normal operation, such AV synchronization control is executed.

Next, an AV synchronization verification method according to the present invention will be described.
FIG. 2 is a flowchart showing an operation procedure for verifying AV synchronization control.
In the verification of AV synchronization control, first, AV synchronization control is turned off (ST100), and an expected value is acquired (ST200). Subsequently, AV synchronization control is turned on (ST300), and data collation processing is performed (ST400).
Hereinafter, it demonstrates in order.

First, a process (ST200) of obtaining expected value data in a state where AV synchronization control is turned off (ST100) (AV synchronization invalid mode) will be described.
In obtaining expected value data for verification for verifying AV synchronization control, AV synchronization control by the AV synchronization control unit 140 is disabled (ST100).
Then, expected value data is acquired (ST200).
FIG. 3 is a flowchart showing a detailed operation procedure of the step (ST200) of obtaining the expected value.
The video data processing system will be mainly described here, but it will be described later that it can be similarly applied to the audio data processing system.

First, streaming data to be verified is input from the data input unit 110 (ST201). Then, compressed data is acquired for each frame of this data (ST202).
That is, the streaming data is demultiplexed and then sent to the video signal processing unit 160 via the video buffer 112. Since the AV synchronization process is invalid, the video signal decoding unit 161 decodes the data and outputs it without waiting time.
Here, the video signal processing unit 160 includes a data compression unit 162 that takes in external output data in units of one frame and compresses the data.

The data compression unit 162 takes in the data output from the video signal decoding unit 161 for each frame and compresses it (ST202).
The data compression unit 162 determines the data amount for one frame by referring to the vertical synchronization signal (VSYNC).
The compressed data is sequentially stored in the memory 180 (ST203).

At this time, the PTS value for each frame is acquired by the PTS reading unit 120 in accordance with the acquisition of each data compression value (ST204) and stored in the memory 180 (ST205).
This is repeated for each frame, and the data compression value and the PTS value are acquired and stored in the memory 180.
After the data acquisition of all the frames to be verified is completed (ST206: YES), the data storage value and the PTS value corresponding to each data compression value are stored in the external storage medium 200 (ST207).
Thereby, the acquisition of expected value data is completed.

Next, the process of collating video data with the expected value data in the AV synchronization valid mode will be described (ST400).
After obtaining the expected value data (ST200), the AV synchronization control is enabled (ST300). Then, the video data obtained in a state where the AV synchronization control is valid is collated with the expected value data (ST400).

FIG. 4 is a flowchart showing a detailed operation procedure of the step (ST400) of collating the video data in the AV synchronization effective mode with the acquired expected value data.
First, the expected value data acquired in advance is expanded from the storage medium 200 to the memory 180 (ST401). Then, the streaming data is input from the data input unit 110 (ST402).
This streaming data is the same as the data used when obtaining the expected value data.
A data compression value is acquired for each frame of data (ST403). That is, the streaming data is demultiplexed and then sent to the video signal processing unit 160 via the video buffer 112.

Here, since the AV synchronization processing by the AV synchronization control unit 140 is validated, the data is decoded from the video signal decoding unit 161 at the timing when the STC becomes the PTS and output to the outside.
Then, the data compression unit 162 takes in the data output from the video signal decoding unit 161 for each frame, compresses the data, and obtains compressed data (ST403).
The acquired compressed data is sent to the AV synchronization verification unit 170.

At the same time, AV synchronization verification section 170 reads the compressed video data as expected value data developed on memory 180 (ST404). Then, AV synchronization verification section 170 sequentially compares the acquired compressed data with expected value data (ST405).
If the comparison results of the data compression values match (ST405: YES), it is determined that the frame is OK.

Here, FIG. 5 is a diagram schematically showing a state in which compressed data as expected value data acquired when AV synchronization is disabled is compared with compressed video data when AV synchronization is enabled.
In FIG. 5, compressed data as expected value data acquired when AV synchronization is invalid represents a code with an uppercase alphabet.
In addition, the compressed video data when the AV synchronization is valid represents a code with a lower case alphabet.
When data collation is performed in order in the example of FIG. 5, the compressed data (a), (b), (c), and (d) are compressed data (A), (B), (C), Since each is equal to (D), it is determined to be OK (ST406).

On the other hand, if they do not match (ST405: NO), one of frame repeat / frame skip / NG is conceivable.
In this case, STC information corresponding to the current output video frame is acquired from the STC counter (ST408). Then, the acquired STC value is compared with the PTS value corresponding to the corresponding data compression value expanded on the memory as expected value data (ST410).

  As a result of this comparison (ST410), if the STC value is earlier by one frame, it is determined that a frame skip has occurred, the expected value data developed on the memory is used as the next frame data (ST411), and again Then, the compressed data and the expected value data are compared (ST405).

In the example shown in FIG. 5, the compressed data (e) and the expected value data (E) do not match.
This is because the video data when AV synchronization is valid skips one frame.
The STC value corresponding to the compressed data (e) is compared with the PTS corresponding to the expected value data (E).
If the STC value is one frame earlier, it can be determined that frame skipping has occurred.
In this case, the expected value data is set to the next frame. That is, the expected value data (F) is read and compared with the compressed data (e).

  If the STC value is delayed by one frame as a result of the comparison (ST410), it is determined that frame repeat has occurred, and the expected value data developed in the memory is used as the data compression value of the previous frame (ST412). ) Again, the compressed data is compared with the expected value data (ST405).

In the example shown in FIG. 5, if data collation is continued sequentially from the above state, the compressed data (j) and the expected value data (K) do not match.
This is because the video data when AV synchronization is valid repeats one frame.
The STC value corresponding to the compressed data (j) is compared with the PTS corresponding to the expected value data (K).
If the STC value is delayed by one frame, it can be determined that the frame repeats. In this case, the expected value data is set to the previous frame. That is, the expected value data (J) is read and compared with the compressed data (j).

  If the difference between the STC value and the PTS value is 1 frame or less as a result of the comparison (ST410), it is determined that the skip / repeat operation has not occurred and an expected value mismatch has occurred, and NG is determined (ST413). .

  The above process is performed until the expected value collation of all the streaming data to be verified is completed (ST407: YES).

In the above description, the case of processing video data has been described as an example, but the same applies to audio data.
However, for video, the data compression value for one frame can be acquired at the vertical synchronization timing, but for audio, the data compression value acquisition timing is not synchronized with the timing at the vertical synchronization.

Therefore, the data compression unit 152 of the audio signal processing unit 150 includes a mechanism that can determine the completion of data compression for one frame.
For example, the frame length is determined by analyzing the header added to the head of each frame of the audio stream.
Thereby, data collation can be performed for each frame as in the case of processing video data.

Since the other processing is the same as that for video data, details are omitted.
Note that the synchronization verification of audio data may be performed simultaneously with the synchronization verification of video data, or may be performed separately.

According to the present embodiment having such a configuration, the following effects can be obtained.
(1) In the present embodiment, the data compression value is taken in when AV synchronization is enabled and disabled, and the data is compared by comparing with each other. Thereby, since it is not necessary to process the data to be evaluated, AV synchronization verification of stream data processing such as digital broadcasting can be performed.

(2) By acquiring the data compression value and the PTS value as expected value data in a state in which AV synchronization is disabled in advance, it is possible to quantitatively determine whether the frame is skipped or frame repeat by enabling AV synchronization. it can.
Thus, it is possible to quantitatively determine whether or not the skip / repeat operation is an expected operation when AV synchronization is valid.

(3) When collating data, there is no need to embed time display or time code in the data as in the prior art. Therefore, the amount of information processing for AV synchronization verification can be reduced.

(Second Embodiment)
Next, a second embodiment of the present invention will be described.
In the first embodiment, quantitative AV synchronization verification is performed on stream data by sequentially comparing compressed data as expected value data acquired when AV synchronization is disabled with compressed data when AV synchronization is enabled. There was an advantage in being able to.
In the second embodiment, a configuration for specifying a location where an AV synchronization failure has occurred and further facilitating analysis of the cause of the failure is employed.
Hereinafter, a second embodiment will be described.

FIG. 6 is a diagram illustrating a system configuration of the second embodiment.
The same elements as those in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted.
In the second embodiment, the audio signal processing unit 350 includes an audio data capture 353 that takes in audio data (decoded data) output externally from the audio signal decoding unit 151 for each frame.
The video signal processing unit 360 includes a video data capture 363 that captures video data output from the video signal decoding unit 161 for each frame.

An AV synchronization verification method according to the second embodiment having such a configuration will be described.
The overall flow of AV synchronization verification is the same as the flow of the first embodiment shown in FIG. 2, and AV synchronization control is turned off (ST100) to obtain an expected value (ST200), and then AV synchronization control is performed. Is turned on (ST300), and data collation processing is performed (ST400).

FIG. 7 is a flowchart showing an operation procedure of a process of obtaining expected value data in the second embodiment.
In the second embodiment, the audio data processing system will be mainly described. However, the second embodiment can be similarly applied to a video data processing system.
First, streaming data to be verified is input from the data input unit 110 (ST501), and compressed data is acquired for each frame of this data (ST502), as in ST201 and ST202 of the first embodiment. .
That is, the data compression unit 152 takes in and compresses the audio data output from the audio signal decoding unit 151 for each frame (ST502).

  In addition, although the modulation system of audio | voice data includes PCM (Pulse Code Modulation), not only this but various modulation systems are employable.

In the second embodiment, in parallel with the acquisition of compressed data, audio data (asynchronous decoded data) is acquired by audio data capture (ST503).
That is, uncompressed audio data (asynchronous decode data) is acquired together with the compressed data.
The acquired audio compression data and audio data are stored in the memory 380 (ST504).

Along with the acquisition of compressed data and audio data, the PTS value for each frame is acquired by the PTS reading unit 120 (ST505) and stored in the memory 380 (ST506).
This is repeated for each frame, and the data compression value, audio data, and PTS value are acquired and stored in the memory 380.
After data acquisition for all the frames to be verified is completed (ST507: YES), the data compression value, audio data, and PTS value are stored in the external storage medium 200 (ST508).
Thereby, the acquisition of expected value data is completed.

Next, AV synchronization verification is executed in the AV synchronization valid mode.
FIG. 8 is a flowchart showing an operation procedure of a step of collating audio data with the acquired expected value data in the AV synchronization effective mode.
First, the expected value data acquired in advance is expanded from the storage medium 200 to the memory 380 (ST601).
That is, the compressed data, audio data, and PTS values stored in the storage medium 200 are expanded in the memory 380.

Next, the same streaming data as the data used when obtaining the expected value data is input from data input section 110 (ST602).
The streaming data is demultiplexed and then sent to the audio signal processing unit 350 via the audio buffer 113.
Since the AV synchronization processing by the AV synchronization control unit 140 is validated, the audio data decoded from the audio signal decoding unit 151 is externally output at the timing when the STC value and the PTS value match.

Data compression section 162 takes in and compresses audio data output from audio signal decoding section 161 for each frame, and acquires compressed data (ST603).
The acquired compressed data is sent to the AV synchronization verification unit 170.

  At the same time, in the audio data capture, audio data (synchronized decode data) is acquired for each frame (ST604).

At the same time, AV synchronization verification section 170 reads compressed data as expected value data developed on memory 380 (ST605).
Then, AV synchronization verification section 170 sequentially compares the acquired compressed data with expected value data (ST606).
If the comparison results of the data compression values match (ST606: YES), it is determined that the frame is OK.

Here, in the second embodiment, if it is determined to be OK, the audio data (AV synchronous decode data) acquired in ST604 for the frame is discarded (ST608).
Also, the audio data (asynchronous decode data) of the expected value data stored in the memory 380 is discarded.

FIG. 9 is a diagram schematically showing a state in which compressed data are collated in AV synchronization verification.
When AV synchronization is disabled, compressed data as expected value data and audio data are acquired at the same time.
When AV synchronization is valid, audio data is sequentially acquired together with the compressed data.
Compressed data as expected value data acquired when AV synchronization is disabled represents a code in uppercase alphabets, and compressed data when AV synchronization is enabled represents a code in lowercase alphabets.
When data collation is sequentially performed in the example of FIG. 9, since the compressed data (a) to (h) are equal to the compressed data (A) to (H) as expected value data, it is determined to be OK (ST606). ).
For frames determined to be OK due to the match between the compressed data and the expected value data, the audio data acquired in ST604 and the audio data (ST503) acquired as the expected value are discarded (ST608).

On the other hand, when there is a mismatch (ST606: NO), frame repeat / frame skip / NG can be considered, and ST610 to ST615 are the same as ST408 to ST413 of the first embodiment.
That is, the STC information corresponding to the current output frame is compared with the PTS value developed on the memory as expected value data (ST612), and the expected value data is read according to frame skip or frame repeat.

Here, as a result of the comparison (ST612), when the difference between the STC value and the PTS value is 1 frame or less, since the skip / repeat operation is not performed, it is determined that mismatch between the expected value data and the compressed data occurs, and NG (ST615).
When it is determined as NG in this way, in the second embodiment, audio data is stored for a frame for NG determination.
For example, as shown in FIG. 9, when the compressed data (I) as the expected value and the compressed data (i) acquired in the verification process are inconsistent and NG determination is made, the compressed data (I) and the compressed data ( Audio data corresponding to i) is stored in the memory 380, respectively.

  The above process is performed until the expected value matching of all the streaming data to be verified is completed (ST609: YES).

If there is audio data stored in the memory 380 after completion of the expected value collation, the audio data is written to the external storage medium 200.
The stored audio data can be used to elucidate the cause of the AV synchronization processing failure.

According to 2nd Embodiment provided with such a structure, there can exist the following effects.
In the second embodiment, audio data corresponding to a frame that has been determined to be NG is stored.
As described above, since the data of the portion having the AV synchronization failure is stored, the failure portion can be immediately identified.
This makes it possible to reduce the time for each stage as compared with the case where the viewing evaluation is performed again or the defective portion is identified by comparing and examining each frame by bit.
Furthermore, since the uncompressed data of the frame corresponding to the NG determination is stored as it is together with the identification of the defective portion, the cause of AV synchronization failure can be immediately analyzed by using this data as it is.

  Further, since the audio data is discarded for the OK determination frame, the memory capacity for storing the data can be reduced.

In the second embodiment, in the case of OK determination (ST607), the audio data (AV synchronous decode data) acquired in ST604 for the frame and the audio data of the expected value data stored in the memory 380 ( An example of discarding (asynchronous decode data) is also illustrated.
On the other hand, for example, in the case of OK determination (ST607), the audio data (synchronized decode data) acquired in ST604 for the frame is discarded without being saved, but expected value data stored in the memory 380 The audio data (asynchronous decoded data) may be left without being discarded.
The audio data (synchronized decode data) acquired in ST604 is in the state acquired by the audio data capture 353, and can be easily discarded by simply not writing to the memory. On the other hand, the audio data (asynchronous decode data) of the expected value data stored in the memory 380 must be positively deleted, and it takes time and effort to control the memory 380. Good.
Even in this case, in the case of NG determination (ST615), since the audio data (synchronized decode data) acquired in ST604 is stored, it is possible to specify the AV synchronization failure location.

  Note that the present invention is not limited to the above-described embodiment, and can be changed as appropriate without departing from the spirit of the present invention.

1 video signal generating means,
2 video signal compression means,
3 Time code generation means,
4 audio signal compression means,
5 synthesis means,
6 Recording means,
7 Reproduction means,
8 disk media,
10 display means,
11 audio signal restoration means,
12 Time code reading means,
100 digital broadcasting AV system,
110 Data input part,
111 demultiplexer,
112 video buffer,
113 audio buffer,
120 PTS reader,
130 STC counter,
140 AV synchronization control unit,
150, 350 audio signal processing unit,
151 voice signal decoding unit,
152 data compression unit,
160, 360 video signal processing unit,
161 video signal decoding unit,
162 data compression unit,
170 AV synchronization verification unit,
180, 380 memory,
200 storage media,
353 audio data capture,
363 Video data capture.

Claims (8)

An AV synchronization verification method for stream data processing for reproducing input stream data in AV synchronization,
Asynchronous data obtained by decoding the stream data with AV synchronization control disabled is compressed in units of one frame and sequentially taken as expected value data.
Next, synchronous data obtained by decoding the stream data with AV synchronization control enabled is compressed in units of one frame,
A method for verifying synchronization of stream data processing, comprising: comparing the compressed synchronization data with the expected value data. The AV data synchronization verification method for stream data processing according to claim 1,
Acquiring presentation time information for each frame in accordance with acquisition of the compressed value of the asynchronous data,
An AV synchronization verification method for stream data processing, wherein the compressed value of the asynchronous data and the presentation time information are combined into expected value data. The AV data synchronization verification method for stream data processing according to claim 2,
Collating the compressed synchronization data with the expected value data;
If both match, it is determined to be OK, the next frame is verified,
Stream data characterized in that, if they do not match, system time information corresponding to the synchronized data being collated is obtained, and the system time information of the synchronized data is collated with the presentation time information of the expected value data. AV synchronization verification method of processing. The AV data synchronization verification method for stream data processing according to claim 3,
As a result of collating system time information of the synchronization data and presentation time information of the expected value data when the synchronization data and the expected value data do not match,
If the system time information is one frame earlier than the presentation time information, it is determined that the synchronization data has been skipped, the next frame of expected value data is read, and the expected value data of the next frame and the compressed synchronization are read Match the data,
If the system time information is one frame later than the presentation time information, it is determined that the synchronization data has been repeated, and the previous frame of the expected value data is read, and the expected value data of the previous frame and the compressed synchronization are read Match the data,
An AV synchronization verification method for stream data processing, wherein, when the difference between the system time information and the presentation time information is within one frame, it is determined as NG. The AV data synchronization verification method for stream data processing according to claim 4,
In accordance with acquisition of the compressed value of the asynchronous data, the decoded asynchronous data is acquired as asynchronous decoded data for each frame without being compressed,
Combine the compressed value of the asynchronous data, the presentation time information and the asynchronous decoded data into the expected value data,
The synchronous data obtained by decoding the stream data with the synchronous control enabled is compressed in units of one frame, and the decoded synchronous data is acquired as the synchronous decoded data for each frame without being compressed.
In the case of the OK determination, the asynchronous decode data of the frame corresponding to the OK determination is discarded,
In the case of the NG determination, the asynchronous decoded data of the frame corresponding to the NG determination is stored. The AV data synchronization verification method for stream data processing according to claim 5,
In the case of the OK determination, the asynchronous decode data and the synchronous decode data of the frame corresponding to the OK determination are discarded,
In the case of the NG determination, the asynchronous decoding data and the synchronous decoding data of the frame corresponding to the NG determination are stored. A stream that includes a PTS reading unit that reads presentation time information of stream data, and an STC counter that counts system time information, and performs AV synchronized reproduction of the input stream data based on the presentation time information and the system time information A data processing device,
A data compression unit for compressing the external output signal in units of one frame;
The asynchronous data compression value obtained by the data compression unit in the AV synchronization invalid mode and the presentation time information corresponding to the data compression value are accumulated as expected value data, and the synchronization data obtained by the data compression unit in the AV synchronization valid mode is stored. A stream data processing apparatus comprising: an AV synchronization verification unit that compares a compressed value of data with the expected value data. The stream data processing apparatus according to claim 7,
A stream data processing apparatus, further comprising a data capture that acquires an external output signal in units of one frame without being compressed.

Images