WO2008050427A1 - Information data receiving device, information data receiving method, information data receiving program and recording medium with information data receiving program stored therein - Google Patents

Information data receiving device, information data receiving method, information data receiving program and recording medium with information data receiving program stored therein Download PDF

Info

Publication number
WO2008050427A1
WO2008050427A1 PCT/JP2006/321355 JP2006321355W WO2008050427A1 WO 2008050427 A1 WO2008050427 A1 WO 2008050427A1 JP 2006321355 W JP2006321355 W JP 2006321355W WO 2008050427 A1 WO2008050427 A1 WO 2008050427A1
Authority
WO
WIPO (PCT)
Prior art keywords
information data
decoding
data
time
information
Prior art date
Application number
PCT/JP2006/321355
Other languages
French (fr)
Japanese (ja)
Inventor
Seiji Harada
Original Assignee
Pioneer Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pioneer Corporation filed Critical Pioneer Corporation
Priority to PCT/JP2006/321355 priority Critical patent/WO2008050427A1/en
Priority to JP2008540849A priority patent/JP4820877B2/en
Publication of WO2008050427A1 publication Critical patent/WO2008050427A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams

Definitions

  • Information data receiving apparatus information data receiving method, information data receiving program, and recording medium storing information data receiving program
  • the present invention relates to an information data receiving apparatus, an information data receiving method, an information data receiving program, and a recording medium storing the information data receiving program.
  • MPE G Moving Picture Experts Group
  • encoding method for encoding audio and moving images when digitized and transmitted.
  • each bit stream as information data such as encoded video, audio, and additional data is multiplexed and transmitted while synchronizing with each other.
  • MPEG system is specified as a playback method!
  • each encoded bit stream is stored in a packet called a PES (Packetized Elementary Stream) packet.
  • Figure 1 shows the structure of the PES packet.
  • a PES packet is a variable-length packet consisting of a PES packet header containing time information called PTS (Presentation Time Stamp) and a PES packet payload that stores encoded data such as audio and video. .
  • PTS Presentation Time Stamp
  • the PES packet is divided into packets that are divided into fixed lengths called TS (Transport Stream) packets and output to a transmission line or the like.
  • TS Transport Stream
  • the PES packet is restored from the received TS packet, the PES packet payload power is also extracted based on the time information such as PTS extracted from the PES packet header by extracting the code data such as voice and video. Decrypt and play.
  • the receiver of the information data transmission system described in Patent Document 1 compares the PTS inserted in the PES packet with the PTS inserted in the previous PES packet, and Judgment is made on whether or not there is a missing part, and if a missing part is detected, the audio data for the missing PES packet is interpolated.
  • Patent Document 1 Japanese Patent Laid-Open No. 2001-111610
  • the receiving device of the information data transmission system described in Patent Document 1 described above determines the missing PES packet from the PTS and interpolates in units of PES. For example, in the case of voice data, the missing PES packet If there are too many frames, the audio may be interrupted during playback or the sound may become unnatural.
  • the present invention provides information that can minimize the influence of errors during reproduction even if errors due to missing or changed data occur when audio or video is transmitted in an MPEG system, for example. It is an object of the present invention to provide a data receiving apparatus, an information data receiving method, an information data receiving program, and a recording medium storing an information data receiving program.
  • the invention according to claim 1 is characterized in that a minimum code key unit to which time information for decoding and reproduction is added and the time information are added. Further, receiving means for receiving information data in which the minimum coding unit is mixed, decoding means for decoding the information data received by the receiving means for each minimum coding unit, and the decoding means In the information data receiving apparatus having the reproducing means for reproducing the decoded data, the minimum coding code is detected when the decoding means detects an error when decoding the minimum coding unit.
  • Interpolating means for generating interpolated data for a unit time, causing the reproducing means to output the interpolated data generated by the interpolating means instead of the information data of the minimum coding unit in which an error is detected, and Interpolated data After been output, the decoding continues ChikaraTsuta the minimum code I ⁇ position such errors are detected And control means for causing the reproducing means to decrypt and output to the reproducing means.
  • the invention according to claim 4 includes a minimum coding unit to which time information for decoding and reproduction is added, and the minimum code key unit to which the time information is added.
  • the minimum coding unit is set. If an error is detected during decoding, interpolated data for the time of the minimum coding unit is generated, and the interpolated data is reproduced instead of the information data of the minimum coding unit in which the error is detected, Then, after the interpolation data is output, control is performed such that the minimum code unit that has been detected without error is continuously decoded and reproduced.
  • the invention according to claim 7 includes a minimum coding unit to which time information for decoding and reproduction is added, and the minimum code key unit to which the time information is added.
  • Receiving means for receiving mixed information data, decoding means for decoding the information data received by the receiving means for each minimum code unit, and decoding by the decoding means In an information data reception program that causes a computer to function as a playback unit that plays back decoding data, if the decoding unit detects an error when decoding the minimum coding unit, the minimum code Interpolating means for generating interpolated data for the time of the encoding unit, causing the reproducing means to output the interpolated data generated by the interpolating means instead of the information data of the minimum coding unit in which an error is detected, and Supplement After the data is output, the computer functions as a control unit that continuously decodes the minimum code unit that has not been detected an error by the decoding unit and outputs it to the reproduction unit. It is characterized by making it.
  • FIG. 1 is an explanatory diagram of a PES packet in the prior art.
  • FIG. 2 is a block diagram of an information data receiving apparatus according to an embodiment of the present invention.
  • FIG. 3 is a block diagram of an audio decoder of the information data receiving apparatus shown in FIG.
  • FIG. 4 is a flowchart for explaining the operation of the audio decoder.
  • FIG. 5 is an explanatory diagram showing input and output of the audio decoder.
  • FIG. 6 is an explanatory diagram showing input and output of the audio decoder.
  • the information data receiving apparatus generates interpolation data for a time corresponding to the minimum coding unit by the interpolation unit when the decoding unit detects an error when decoding the minimum coding unit. Then, the interpolated data is output to the reproducing means by the control means in place of the decoded key data in the smallest code unit in which an error is detected. Then, after the interpolation data generated by the interpolation means is output, the strongest code key unit in which no error is detected is continuously decoded by the decoding means and output to the reproducing means.
  • control means may detect the missing of the minimum coding unit from the time information, cause the interpolation means to generate information data for the missing time, and output it to the reproduction means.
  • interpolation for the missing time can be performed at the time when time information is detected after interpolation of the smallest sign key unit, so that the time axis deviation at the time of reproducing information data can be reduced.
  • control means may determine the number of interpolations and the number of interpolations in units of the least sign of the previous time information power. It is also possible to detect the missing of the minimum coding unit by comparing the time calculated from the number of signals and the currently detected time information. In this way, the time is also calculated in advance for the number of interpolations and the number of decoding keys in the smallest code unit of the previous time information power, and the minimum code signal to which the time information of the current time is added. If a comparison is made at the time when the ⁇ unit is detected, it is possible to easily detect the missing of the smallest sign ⁇ unit.
  • the information data receiving method generates interpolation data for a time corresponding to the minimum coding unit when an error is detected when decoding the minimum coding unit. Then, the interpolated data is output in place of the decoded key data of the smallest code key unit in which the error is detected. Then, after the interpolation data is output, the minimum coding unit without error is continuously decoded and reproduced. In this way, information data can be interpolated when an error occurs regardless of the presence or absence of time information, and thereafter, decoding in units of minimum code units can be continued immediately. Therefore, since the interpolation is performed immediately when an error occurs in the minimum coding unit, the influence of the error can be minimized.
  • the number of interpolations and the decoding power of the smallest sign key unit of the previous time information power are calculated and the currently detected time information is compared to determine whether the minimum coding unit is missing. It may be detected. In this way, the time is calculated in advance from the number of interpolations and the number of decoding keys in units of the minimum sign of the previous time information power, and the minimum time value with the current time information added. If the comparison is made at the time when the sign key unit is detected, it is possible to easily detect the lack of the minimum sign key unit.
  • the information data receiving program provides a time corresponding to the minimum coding unit when the decoding unit detects an error when decoding the minimum code key unit.
  • Interpolated data is generated by the interpolating means, and the interpolating data is output to the reproducing means in place of the decoded data of the smallest code unit in which the error is detected, and the interpolating data is then interpolated.
  • the computer is caused to function so that the decoding unit continuously decodes and outputs to the reproducing unit the strongest code unit in which no error is detected.
  • the information data can be interpolated when an error occurs regardless of the presence or absence of time information, and then decoding in units of minimum codes can be continued immediately thereafter. Therefore, since the interpolation is performed immediately when an error occurs in units of the minimum sign key, the influence of the error can be minimized.
  • the minimum number of coding units is compared by comparing the calculated number of interpolations and decoding powers of the previous time information power with the currently detected time information. It may be detected. In this way, the time is calculated in advance from the number of interpolations and the number of decoding keys in units of the minimum sign of the previous time information power, and the minimum time value with the current time information added. If the comparison is made at the time when the sign key unit is detected, it is possible to easily detect the lack of the minimum sign key unit.
  • the information data receiving program according to any one of claims 7 to 9 may be stored in a recording medium. In this way, the information data receiving program can be distributed as a single unit in addition to being incorporated into the device.
  • the information data receiving device 100 is a device that receives a bit stream as information data input from an input terminal, extracts audio data, decodes it, and reproduces it. As shown in FIG. 2, the information data receiving apparatus 100 includes a TS demultiplexer 101, an audio input buffer 102, an audio decoder 103, an audio output buffer 104, a DZA converter 105, and a speaker 106. .
  • the TS demultiplexer 101 as a receiving means has a TS format input from an input terminal. Restores PES packet from bit stream, extracts voice data, detects PTS as time information from PES packet header and detects error of voice data, and outputs PTS and error detection information to voice input buffer 102 along with voice data To do. At this time, the PTS outputs the error detection information so as to be aligned with the error detection position of the audio data so that it is aligned with the beginning of the audio data of the PES packet.
  • the audio input buffer 102 accumulates the audio data, PTS, and error detection information input from the TS demultiplexer 101, and outputs the audio data, PTS, and error information in response to a request from the audio decoder 103.
  • the audio decoder 103 decodes the audio data read from the audio input buffer 102 and outputs it to the audio output buffer 104. If there is error detection information, the audio data is interpolated based on the decoding result and PTS.
  • an audio decoding control unit 201 an interpolation data generation unit 202, an audio decoding unit 203, and a selector 204 are also configured.
  • the audio decoding control unit 201 as the control means reads out from the audio input buffer 102 for each frame as a minimum code unit which is a decoding processing unit. If the read frame has a PTS, calculate the time from the PTS and the number of frames decoded or interpolated from the PTS output immediately before, and detect missing frames from that time. When error detection information is attached to the read frame, or when a missing frame is detected from the PTS or when an error has been notified from the audio decoding unit 203, the interpolation data generation unit 202 generates interpolation data. Instruct. If no frame error is detected from the error detection or PTS, the frame is output to the audio decoding unit 203. Further, the selector 204 is switched depending on which of the interpolation data generation unit 202 and the audio decoding unit 203 has been instructed to process.
  • the interpolation data generating unit 202 as an interpolating unit refers to the result of the audio decoding unit 203, and adds complementary data for error frames and missing frames. Generate for frame time and output to selector 204.
  • the audio decoding unit 203 as decoding means decodes the frame data input from the audio decoding control unit 201 and outputs the decoded data to the selector 204. Decode error during decoding When one occurs, the decoding process is stopped and the audio decoding control unit 201 is output that a decoding error has occurred.
  • the selector 204 is in response to an instruction from the audio decoding control unit 201. Output either one of the interpolation data generation unit 202 or the audio decoding unit 203 to the audio output buffer 104
  • the PTS is also output.
  • step S101 the number of interpolations and the number of frames as the number of decodes counted in the audio decoding control unit 201 are cleared to 0, and the process proceeds to step S102.
  • step S102 the audio decoding control unit 201 reads audio data, PTS, and error detection information for each frame from the audio input buffer 102, and proceeds to step S103.
  • step S103 it is determined whether or not the data read by the audio decoding control unit 201 has a PTS. If there is a PTS (in the case of Y), the process proceeds to step S110. If yes (N), go to Step S104.
  • step S104 it is determined whether or not the data read by the audio decoding control unit 201 has error detection information. If there is error detection information (in the case of Y), the process proceeds to step S107. If not (N), go to Step S105.
  • step S105 the data of the frame read by the audio decoding unit 203 is decoded, and the process proceeds to step S106.
  • step S106 the audio decoding unit 203 determines whether an error has occurred during decoding. If an error has occurred (in the case of Y), the process proceeds to step S107; If N), go to step S108.
  • step S107 if the error is included in the data read from the audio input buffer 102 or a decoding error is generated from the audio decoding unit 203, the audio decoding control unit 201 executes the interpolation data generating unit.
  • the interpolation data for one frame time is generated in 202, and the process proceeds to step S108.
  • One frame time is obtained from the input bit stream, and the interpolation method may be, for example, to output the previous frame again, or the interpolation data based on a plurality of past frame data. You can make it generate.
  • step S108 the audio decoding control unit 201 switches the selector 204 to output the decoded or interpolated audio data and PTS to the audio output buffer 104, and the process proceeds to step S109.
  • step S109 the number of frames in the audio decoding control unit 201 is incremented, and the process returns to step S102.
  • step S110 the audio decoding control unit 201 is greater than the value obtained by multiplying the PTS obtained immediately before the PTS force obtained in step S103 and the number of frames counted in the audio decoding control unit 201 by one frame time. If it is larger (in the case of Y), the process proceeds to step S111, and if not (in the case of N), the process proceeds to step S114. In other words, a frame loss is detected by comparing the time when the number of interpolations and decoding power of the frame from the previous PTS are calculated with the currently detected PTS.
  • step S111 the PTS detected in step S103 is larger than the PTS obtained immediately before and the number of frames counted in the audio decoding control unit 201 multiplied by one frame time.
  • the audio decoding control unit 201 causes the interpolation data generation unit 202 to generate interpolation data for one frame time and proceeds to step S112.
  • the input bit stream power is acquired, and the interpolation method may be to output the previous frame again, for example, based on a plurality of past frame data! / Interpolation data may be generated.
  • step S112 the audio decoding control unit 201 switches the selector 204 to output the interpolated audio data and PTS to the audio output buffer 104, and the process proceeds to step S113.
  • step S113 the number of frames in the audio decoding control unit 201 is incremented, and the process returns to step S110.
  • step S114 the number of frames in the audio decoding control unit 201 is cleared to 0, and the process proceeds to step S104.
  • FIG. 5 is a diagram in which a part of the bit stream input to the information data receiving apparatus 100 is extracted. Input frame sequence is input in order from frame 1, frame 1 is the previous This is an example in which the last PES packet is shown, the PES packet is composed of frames 2 through 6, and the next PES packet is shown from frame 7. As shown in Fig. 5, PTS is added to frames 2 and 7, which are the first frames of the PES packet. The following explanation focuses on PES packets including frames 2-6.
  • step S102 frame 3 is read, and the process proceeds to step S103, step S104, step S105, and step S106.An error is detected and the process proceeds to step S107, where interpolation data is generated for one frame time. Proceed to step S109, set the number of frames to 2, and return to step S102.
  • step S102 frame 4 is read, and the process proceeds to step S103, step S104, step S105, step S106, step S108, and step S109. The number of frames is set to 3, and the process returns to step S102.
  • step S102 frame 5 is read in step S102, and the process proceeds to step S103 and step S104. Since error detection information is included, the process proceeds to step S107, and one frame time of complement data is generated. Proceed to S108 and Step S109, set the number of frames to 4, and return to Step S102.
  • step S102 frame 6 is read, and the process proceeds to step S103, step S104, step S105, step S106, step S108, and step S109. The number of frames is set to 5, and the process returns to step S102.
  • step S102 frame 7, which is the head of the next PES packet, is read, and the process proceeds to steps S103 and S110.
  • step S110 the PTS included in frame 7 is changed to the PTS included in frame 2.
  • the time obtained by multiplying the PTS included in frame 2 by the number of frames multiplied by one frame time is PTS + 5 X 1 frame time of frame 2
  • the PTS included in frame 7 is As shown in Fig. 5, when frame 2 to 5 Since the time has advanced for a while, step SI 10 becomes N, and the process proceeds to step S114. In other words, no frame interpolation is performed because no missing frame is detected.
  • Fig. 6 is different from Fig. 5 in that an error occurs in frame 3 and the beginning of frame 4 cannot be recognized due to an error.
  • step S102 In the case of frame 2 which is the head of the PES packet, the process proceeds to steps S102 and S103. Since PTS is added, if there is no error in the previous PES packet, the process proceeds to steps S114, S104, The decoded audio data is output in steps S105, S106, and S108, and the process proceeds to step S109. The number of frames is set to 1, and the process returns to step S102. In step S102, frame 3 is read, and the process proceeds to step S103, step S104, step S105, and step S106.An error is detected and the process proceeds to step S107.Interpolation data is generated for one frame time, and step S108.
  • step S109 the number of frames is set to 2, and the process returns to step S102. Since frame 4 cannot be detected in step S102, frame 5 that can be detected at the beginning is read, and the process proceeds to step S103, step S104, step S105, step S106, step S108, and step S109. Return to step S10-2. That is, after interpolating for one frame time, the decoded frame data of a strong frame in which no error is detected is output continuously.
  • step S102 frame 6 is read, and the process proceeds to step S103, step S104, step S105, step S106, step S108, and step S109.
  • the number of frames is set to 4, and the process returns to step S102. .
  • step S102 frame 7, which is the head of the next PES packet, is read, and the process proceeds to step S103 and step S110.
  • step S110 the PTS included in frame 7 is changed to the PTS included in frame 2. Detects whether or not it is larger than the time obtained by multiplying the number of frames times one frame time. As described above, the time obtained by multiplying the PTS included in frame 2 by the number of frames multiplied by one frame time is the PTS +4 X 1 frame time of frame 2, and the PTS included in frame 7 is As shown in Fig.
  • step S110 since it is a time advanced by 5 frame hours from frame 2, step S110 becomes Y, and the step S111, S112 and advance interpolation data and PTS are output, and the frame is changed in step S113. Return to step S110 as 5.
  • step S110 PTS force included in frame 7 again PT included in frame 2 It is detected whether or not the time obtained by multiplying the value of S multiplied by the number of frames and 1 frame time is larger than the time obtained by multiplying the PTS included in frame 2 by the number of frames multiplied by 1 frame time.
  • the audio output buffer 104 accumulates decoded or interpolated audio data and PTS input from the audio decoder 103, and outputs them to the D / A converter 105 in accordance with the PTS.
  • the DZA converter 105 as reproduction means converts the audio data of the digital value to which the audio output buffer 104 is also input into an analog signal and outputs it to the speaker 106.
  • the speaker 106 amplifies the analog signal output from the DZA converter 105 to a predetermined level with an amplifier (not shown), and then emits it as a sound.
  • the PES packet is also restored by the TS demultiplexer 101 for the input bit stream power, and decoded by the audio decoder 103 for each frame. If an error is detected during PES packet restoration, or if an error is detected during decoding by the audio decoding unit 203 in the audio decoder 103, the interpolation data generation unit 202 in the audio decoder 103 generates interpolation data for one frame time. Then, the audio decoding control unit 201 switches the selector 204 so that the interpolation data is output to the audio output buffer 104 instead of the error frame, and performs decoding of the next frame.
  • the audio decoding control unit 201 If no error is detected, the audio decoding control unit 201 outputs it as it is. Therefore, when an error is detected, audio data for one frame time can be interpolated immediately. Then, the decoding of the next frame is performed, and if it is normal, it is output as it is, so that interpolation can be performed in units of one frame, so that it is possible to output the audio information of the subsequent frames while minimizing the influence of the error. it can.
  • the PTS is compared with the time when the previous PTS and the number of frames that have been interpolated or decoded are calculated. As a result, if the current PTS is large, the frame Since it is determined that there is a missing frame and the frame is interpolated for the missing time, PTS is detected. It is possible to easily determine the presence or absence of a missing frame at the time of extraction and perform interpolation. Therefore, it is possible to reduce the time axis shift of the decoded data.
  • the frame loss is determined by comparing the PTS with the number of interpolations and the number of frames calculated from the previous PTS.
  • a clock function may be provided inside the information data receiving device, and a missing frame may be detected from the clock and the PTS. In other words, it may be determined that the frame arrives at the time when the frame should have arrived, and in this case, it is determined that the frame is missing.
  • the fluctuation of the force PTS determined by comparing the PTS, the number of interpolations from the previous PTS, and the time for which the number of frames was calculated is determined.
  • the determination may be made in consideration.
  • the time between two PTSs is 5 frame times, but in actual MPEG system transmission, the PTS added to frame 7 may not necessarily be the time after 5 frames from frame 2 ( Judgment may be made in consideration of that amount, which may fluctuate within a range of less than about 1Z2 frame time).
  • the audio has been described.
  • the video for example, when the picture is the minimum code unit, the time information is added to the picture.
  • the present invention can be applied when there is something that is not added.
  • the information data receiving apparatus described above may be a program that operates on a computer.
  • the function of each block shown in the block diagram of FIG. 2 is functioned by a CPU and a memory, so that a computer-readable information data receiving program can be obtained.
  • the present invention is applied to a receiver that receives terrestrial digital broadcasting, CATV, broadcasting via the Internet, and the like, the influence of errors during transmission can be minimized. In particular, it is very effective when applied to mopile equipment and in-vehicle equipment that are mobile receivers that transmit information by radio waves.
  • the following information data receiving device, information data receiving method, and information data receiving program can be obtained.
  • TS demultiplexer 101 that receives a bitstream in which a frame to which PTS is added and a frame to which PTS is not added is mixed, and TS demultiplexer 1
  • TS demultiplexer 1 In an information data receiving apparatus 100 having an audio decoding unit 203 that decodes a bit stream received by 01 for each frame and a DZA converter 105 that reproduces audio data decoded by the audio decoding unit 203,
  • an interpolation data generation unit 202 that generates interpolation data for one frame time
  • the interpolation data generated by the interpolation data generation unit 202 is output to the DZA converter 105 instead of the audio data of the frame in which the error is detected, and after the interpolation data is output, the powerful frame in which no error is detected is continued.
  • An audio decoding control unit 201 that causes the audio decoding unit 203 to decode and output to the DZ A converter 105;
  • this information data receiving apparatus 100 it is possible to interpolate audio data for one frame when an error occurs regardless of the presence or absence of PTS, and then continue decoding in units of frames immediately thereafter. Can do. Therefore, since the interpolation is performed immediately when an error occurs in the frame, the influence of the error can be minimized.
  • interpolated data for one frame time is generated, the interpolated data is reproduced instead of the audio data of the frame in which the error is detected, and the interpolated data is A method of receiving information data, comprising: controlling to decode and reproduce a frame for which no error has been detected after output.
  • audio data can be interpolated for one frame when an error occurs regardless of the presence or absence of PTS, and then decoding can be continued in units of frames immediately thereafter. . Therefore, since the interpolation is performed immediately when an error occurs in the frame, the influence of the error can be minimized.
  • the TS demultiplexer 101 that receives a bitstream in which a frame to which a PTS is added and a frame to which a PTS is not added is mixed, and the bitstream that is received by the TS demultiplexer 101 Audio decoding unit 203 that decodes every frame, and audio In the information data receiving program that causes the computer to function as the DZA converter 105 that reproduces the audio data decoded by the decoding unit 203,
  • an interpolation data generation unit 202 that generates interpolation data for one frame time
  • the interpolation data generated by the interpolation data generation unit 202 is output to the DZA converter 105 instead of the audio data of the frame in which the error is detected, and after the interpolation data is output, the powerful frame in which no error is detected is continued.
  • An audio decoding control unit 201 that causes the audio decoding unit 203 to decode and output to the DZ A converter 105;
  • a computer-readable information data receiving program characterized by causing a computer to function.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Detection And Prevention Of Errors In Transmission (AREA)
  • Error Detection And Correction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

When a PES packet holds a plurality of frame data, the PES packet is divided into a plurality of TS packets, and its part is omitted, the omitted frames are complimented by other TS packets, so that it prevents a state in which data are not reproduced for every PES packet unit.

Description

明 細 書  Specification
情報データ受信装置、情報データ受信方法、情報データ受信プログラム および情報データ受信プログラムを格納した記録媒体  Information data receiving apparatus, information data receiving method, information data receiving program, and recording medium storing information data receiving program
技術分野  Technical field
[0001] 本発明は、映像や音声などが符号化された情報を受信する情報データ受信装置、 情報データ受信方法、情報データ受信プログラムおよび情報データ受信プログラム を格納した記録媒体に関する。  [0001] The present invention relates to an information data receiving apparatus, an information data receiving method, an information data receiving program, and a recording medium storing the information data receiving program.
背景技術  Background art
[0002] 音声や動画像をデジタル化して伝送する際に符号化する符号化方式として、 MPE G (Moving Picture Experts Group)が知られている。  [0002] MPE G (Moving Picture Experts Group) is known as an encoding method for encoding audio and moving images when digitized and transmitted.
[0003] MPEGでは音声や映像の符号ィ匕方式の他に、符号化された映像や音声、付加デ ータなどの情報データとしての各ビットストリームを多重化し、それぞれの同期を取り ながら伝送、再生するための方式として MPEGシステムが規定されて!、る。  [0003] In MPEG, in addition to audio and video encoding schemes, each bit stream as information data such as encoded video, audio, and additional data is multiplexed and transmitted while synchronizing with each other. MPEG system is specified as a playback method!
[0004] MPEGシステムでは、符号化された各ビットストリームを PES (Packetized Elementa ry Stream)パケットと呼ばれるパケットに格納する。図 1に PESパケットの構造を示す 。 PESパケットは、 PTS (Presentation Time Stamp)と呼ばれる時間情報などが含ま れる PESパケットヘッダと、音声や映像などの符号ィ匕されたデータが格納される PES パケットペイロードとからなる可変長のパケットである。  [0004] In an MPEG system, each encoded bit stream is stored in a packet called a PES (Packetized Elementary Stream) packet. Figure 1 shows the structure of the PES packet. A PES packet is a variable-length packet consisting of a PES packet header containing time information called PTS (Presentation Time Stamp) and a PES packet payload that stores encoded data such as audio and video. .
[0005] そして、 PESパケットを TS (Transport Stream)パケットと呼ばれる一定長に区切つ たパケットに分割し、伝送路等に出力する。受信側では、受信した TSパケットから PE Sパケットを復元し、 PESパケットペイロード力も音声や映像などの符号ィ匕データを取 り出して PESパケットヘッダから取り出した PTSなどの時間情報に基づ 、て復号化お よび再生を行う。  [0005] Then, the PES packet is divided into packets that are divided into fixed lengths called TS (Transport Stream) packets and output to a transmission line or the like. On the receiving side, the PES packet is restored from the received TS packet, the PES packet payload power is also extracted based on the time information such as PTS extracted from the PES packet header by extracting the code data such as voice and video. Decrypt and play.
[0006] このような、 MPEGシステムによる伝送において、無線や有線などの伝送路での伝 送中にデータの欠落または意図しな 、変更が発生してしまうことがある。その場合、 受信側では、エラーとして認識され、当該データの廃棄や補間などが行われている。 エラーが発生した際の受信側の対応方法としては、例えば、特許文献 1に記載の情 報データ伝送システムの受信装置が提案されて!ヽる。 [0006] In such transmission by the MPEG system, data may be lost or unintentionally changed during transmission on a wireless or wired transmission path. In that case, it is recognized as an error on the receiving side, and the data is discarded or interpolated. As a method for dealing with the receiving side when an error occurs, for example, the information described in Patent Document 1 is used. Receiving device for information transmission system has been proposed! Speak.
[0007] 特許文献 1に記載された情報データ伝送システムの受信装置は、 PESパケットに挿 入されている PTSを 1つ前の PESパケットに挿入されている PTSと比較して PESパケ ットの欠落の有無を判定し、欠落が検出された場合は、欠落した PESパケット分のォ 一ディォデータを補間して 、る。 [0007] The receiver of the information data transmission system described in Patent Document 1 compares the PTS inserted in the PES packet with the PTS inserted in the previous PES packet, and Judgment is made on whether or not there is a missing part, and if a missing part is detected, the audio data for the missing PES packet is interpolated.
特許文献 1:特開 2001— 111610号公報  Patent Document 1: Japanese Patent Laid-Open No. 2001-111610
発明の開示  Disclosure of the invention
発明が解決しょうとする課題  Problems to be solved by the invention
[0008] 上述した特許文献 1に記載の情報データ伝送システムの受信装置は、 PTSから PE Sパケットの欠落を判定して PES単位で補間するために、例えば音声データの場合 は、欠落した PESパケットに含まれるフレームが多いと再生時に音声が途切れたり、 不自然な音声になってしまうことがあった。  [0008] The receiving device of the information data transmission system described in Patent Document 1 described above determines the missing PES packet from the PTS and interpolates in units of PES. For example, in the case of voice data, the missing PES packet If there are too many frames, the audio may be interrupted during playback or the sound may become unnatural.
[0009] そこで、本発明は、例えば MPEGシステムなどで音声や映像を伝送する際にデー タの欠落や変更によるエラーが発生しても、再生時にエラーによる影響を最小限に 留めることができる情報データ受信装置、情報データ受信方法、情報データ受信プ ログラムおよび情報データ受信プログラムを格納した記録媒体を提供することを課題 とする。  [0009] Therefore, the present invention provides information that can minimize the influence of errors during reproduction even if errors due to missing or changed data occur when audio or video is transmitted in an MPEG system, for example. It is an object of the present invention to provide a data receiving apparatus, an information data receiving method, an information data receiving program, and a recording medium storing an information data receiving program.
課題を解決するための手段  Means for solving the problem
[0010] 上記課題を解決するために、請求項 1に記載の発明は、復号化や再生のための時 間情報が付加されて ヽる最小符号ィ匕単位と、前記時間情報が付加されて ヽな 、前 記最小符号化単位とが混在する情報データを受信する受信手段と、前記受信手段 が受信した情報データを前記最小符号化単位毎に復号化する復号化手段と、前記 復号化手段が復号化した復号化データを再生する再生手段と、を有する情報データ 受信装置において、前記復号化手段が前記最小符号化単位を復号化する際にエラ 一を検出した場合は、前記最小符号ィ匕単位の時間分の補間データを生成する補間 手段と、エラーが検出された前記最小符号化単位の情報データに代えて前記補間 手段が生成した補間データを前記再生手段に出力させ、そして、前記補間データを 出力させた後に、エラーが検出されな力つた前記最小符号ィ匕単位を続けて前記復号 化手段に復号化させ前記再生手段に出力させる制御手段と、を有したことを特徴とし ている。 [0010] In order to solve the above problem, the invention according to claim 1 is characterized in that a minimum code key unit to which time information for decoding and reproduction is added and the time information are added. Further, receiving means for receiving information data in which the minimum coding unit is mixed, decoding means for decoding the information data received by the receiving means for each minimum coding unit, and the decoding means In the information data receiving apparatus having the reproducing means for reproducing the decoded data, the minimum coding code is detected when the decoding means detects an error when decoding the minimum coding unit. Interpolating means for generating interpolated data for a unit time, causing the reproducing means to output the interpolated data generated by the interpolating means instead of the information data of the minimum coding unit in which an error is detected, and Interpolated data After been output, the decoding continues ChikaraTsuta the minimum code I 匕単 position such errors are detected And control means for causing the reproducing means to decrypt and output to the reproducing means.
[0011] 請求項 4に記載の発明は、復号ィ匕や再生のための時間情報が付加されている最小 符号化単位と、前記時間情報が付加されて ヽな 、前記最小符号ィ匕単位とが混在す る情報データを受信し、受信した情報データを前記最小符号化単位毎に復号化して 、復号ィ匕した復号ィ匕データを再生する情報データ受信方法において、前記最小符 号化単位を復号化する際にエラーを検出した場合は、前記最小符号化単位の時間 分の補間データを生成し、エラーが検出された前記最小符号化単位の情報データ に代えて前記補間データを再生し、そして、前記補間データを出力させた後に、エラ 一が検出されな力つた前記最小符号ィ匕単位を続けて復号ィ匕し再生するように制御す ることを特徴としている。  [0011] The invention according to claim 4 includes a minimum coding unit to which time information for decoding and reproduction is added, and the minimum code key unit to which the time information is added. In the information data receiving method of receiving information data in which the mixed information is received, decoding the received information data for each of the minimum coding units, and reproducing the decoded decoded data, the minimum coding unit is set. If an error is detected during decoding, interpolated data for the time of the minimum coding unit is generated, and the interpolated data is reproduced instead of the information data of the minimum coding unit in which the error is detected, Then, after the interpolation data is output, control is performed such that the minimum code unit that has been detected without error is continuously decoded and reproduced.
[0012] 請求項 7に記載の発明は、復号ィ匕や再生のための時間情報が付加されている最小 符号化単位と、前記時間情報が付加されて ヽな 、前記最小符号ィ匕単位とが混在す る情報データを受信する受信手段と、前記受信手段が受信した情報データを前記最 小符号ィ匕単位毎に復号ィ匕する復号ィ匕手段と、前記復号ィ匕手段が復号化した復号ィ匕 データを再生する再生手段と、してコンピュータに機能させる情報データ受信プログ ラムにおいて、前記復号化手段が前記最小符号化単位を復号化する際にエラーを 検出した場合は、前記最小符号化単位の時間分の補間データを生成する補間手段 と、エラーが検出された前記最小符号化単位の情報データに代えて前記補間手段 が生成した補間データを前記再生手段に出力させ、そして、前記補間データを出力 させた後に、エラーが検出されな力つた前記最小符号ィ匕単位を続けて前記復号ィ匕手 段に復号化させ前記再生手段に出力させる制御手段と、してコンピュータに機能さ せることを特徴としている。  [0012] The invention according to claim 7 includes a minimum coding unit to which time information for decoding and reproduction is added, and the minimum code key unit to which the time information is added. Receiving means for receiving mixed information data, decoding means for decoding the information data received by the receiving means for each minimum code unit, and decoding by the decoding means In an information data reception program that causes a computer to function as a playback unit that plays back decoding data, if the decoding unit detects an error when decoding the minimum coding unit, the minimum code Interpolating means for generating interpolated data for the time of the encoding unit, causing the reproducing means to output the interpolated data generated by the interpolating means instead of the information data of the minimum coding unit in which an error is detected, and Supplement After the data is output, the computer functions as a control unit that continuously decodes the minimum code unit that has not been detected an error by the decoding unit and outputs it to the reproduction unit. It is characterized by making it.
図面の簡単な説明  Brief Description of Drawings
[0013] [図 1]従来技術における PESパケットの説明図である。 FIG. 1 is an explanatory diagram of a PES packet in the prior art.
[図 2]本発明の一実施例に力かる情報データ受信装置のブロック図である。  FIG. 2 is a block diagram of an information data receiving apparatus according to an embodiment of the present invention.
[図 3]図 1に示された情報データ受信装置の音声デコーダのブロック図である。  FIG. 3 is a block diagram of an audio decoder of the information data receiving apparatus shown in FIG.
[図 4]音声デコーダの動作を説明したフローチャートである。 [図 5]音声デコーダの入力と出力を示した説明図である。 FIG. 4 is a flowchart for explaining the operation of the audio decoder. FIG. 5 is an explanatory diagram showing input and output of the audio decoder.
[図 6]音声デコーダの入力と出力を示した説明図である。  FIG. 6 is an explanatory diagram showing input and output of the audio decoder.
符号の説明  Explanation of symbols
[0014] 100 情報データ受信装置 [0014] 100 information data receiving apparatus
101 TSデマルチプレクサ(受信手段)  101 TS demultiplexer (receiving means)
103 音声デコーダ  103 audio decoder
105 DZAコンバータ(再生手段)  105 DZA converter (reproduction means)
201 音声デコード制御部(制御手段)  201 Audio decoding control unit (control means)
202 補間データ生成部 (補間手段)  202 Interpolation data generator (interpolation means)
203 音声デコード部 (復号化手段)  203 Audio decoding part (Decoding means)
発明を実施するための最良の形態  BEST MODE FOR CARRYING OUT THE INVENTION
[0015] 以下、本発明の一実施形態に力かる情報データ受信装置を説明する。本発明の一 実施形態にかかる情報データ受信装置は、復号化手段が最小符号化単位を復号化 する際にエラーを検出した場合に、最小符号化単位分の時間の補間データを補間 手段で生成し、その補間データを制御手段がエラーが検出された最小符号ィヒ単位 の復号ィ匕データに代えて再生手段に出力する。そして、補間手段が生成した補間デ ータを出力した後に、エラーが検出されな力つた最小符号ィ匕単位を続けて復号ィ匕手 段に復号ィ匕させ再生手段に出力する。このようにすることにより、時間情報の有無に 関わらずエラーが発生した時点で情報データの補間を行うことができ、その後は直ち に最小符号ィ匕単位の復号を継続することができる。したがって、最小符号化単位で エラーが発生した時点で補間を直ちに行うことから、エラーによる影響を最小限に留 めることができる。 Hereinafter, an information data receiving apparatus according to an embodiment of the present invention will be described. The information data receiving apparatus according to an embodiment of the present invention generates interpolation data for a time corresponding to the minimum coding unit by the interpolation unit when the decoding unit detects an error when decoding the minimum coding unit. Then, the interpolated data is output to the reproducing means by the control means in place of the decoded key data in the smallest code unit in which an error is detected. Then, after the interpolation data generated by the interpolation means is output, the strongest code key unit in which no error is detected is continuously decoded by the decoding means and output to the reproducing means. In this way, information data can be interpolated when an error occurs regardless of the presence or absence of time information, and then decoding in units of minimum codes can be continued immediately. Therefore, since the interpolation is performed immediately when an error occurs in the minimum coding unit, the influence of the error can be minimized.
[0016] また、制御手段が、時間情報から最小符号化単位の欠落を検出し、欠落時間分の 情報データを補間手段に生成させて、再生手段に出力するようにしても良い。このよ うにすることにより、最小符号ィ匕単位の補間後に時間情報が検出された時点で欠落 時間分の補間を行うことができるので、情報データ再生時の時間軸のずれを少なく することができる。  [0016] Further, the control means may detect the missing of the minimum coding unit from the time information, cause the interpolation means to generate information data for the missing time, and output it to the reproduction means. By doing so, interpolation for the missing time can be performed at the time when time information is detected after interpolation of the smallest sign key unit, so that the time axis deviation at the time of reproducing information data can be reduced. .
[0017] また、制御手段が、一つ前の時間情報力もの最小符号ィ匕単位の補間数および復 号ィ匕数カゝら算出した時間と、現在検出した時間情報とを比較して最小符号化単位の 欠落を検出するようにしても良い。このようにすることにより、予め一つ前の時間情報 力もの最小符号ィ匕単位の補間数および復号ィ匕数力も時間を算出しておき、時間現 在の時間情報が付加された最小符号ィ匕単位を検出した時点で比較すれば容易に最 小符号ィ匕単位の欠落を検出することができる。 [0017] Further, the control means may determine the number of interpolations and the number of interpolations in units of the least sign of the previous time information power. It is also possible to detect the missing of the minimum coding unit by comparing the time calculated from the number of signals and the currently detected time information. In this way, the time is also calculated in advance for the number of interpolations and the number of decoding keys in the smallest code unit of the previous time information power, and the minimum code signal to which the time information of the current time is added. If a comparison is made at the time when the 匕 unit is detected, it is possible to easily detect the missing of the smallest sign 匕 unit.
[0018] また、本発明の一実施形態にかかる情報データ受信方法は、最小符号化単位を復 号ィ匕する際にエラーを検出した場合に、最小符号化単位分の時間の補間データを 生成し、その補間データをエラーが検出された最小符号ィ匕単位の復号ィ匕データに代 えて出力する。そして、補間データを出力した後に、エラーが検出されな力つた最小 符号化単位を続けて復号化し再生する。このようにすることにより、時間情報の有無 に関わらずエラーが発生した時点で情報データの補間を行うことができ、その後は直 ちに最小符号ィ匕単位の復号を継続することができる。したがって、最小符号化単位 でエラーが発生した時点で補間を直ちに行うことから、エラーによる影響を最小限に 留めることができる。  [0018] Also, the information data receiving method according to an embodiment of the present invention generates interpolation data for a time corresponding to the minimum coding unit when an error is detected when decoding the minimum coding unit. Then, the interpolated data is output in place of the decoded key data of the smallest code key unit in which the error is detected. Then, after the interpolation data is output, the minimum coding unit without error is continuously decoded and reproduced. In this way, information data can be interpolated when an error occurs regardless of the presence or absence of time information, and thereafter, decoding in units of minimum code units can be continued immediately. Therefore, since the interpolation is performed immediately when an error occurs in the minimum coding unit, the influence of the error can be minimized.
[0019] また、時間情報から最小符号化単位の欠落を検出し、欠落時間分の情報データを 生成して再生するようにしても良い。このようにすることにより、最小符号化単位の補 間後に時間情報が検出された時点で欠落時間分の補間を行うことができるので、情 報データ再生時の時間軸のずれを少なくすることができる。  [0019] Further, it is possible to detect missing of the minimum coding unit from the time information, and generate and reproduce information data for the missing time. In this way, interpolation for the missing time can be performed when time information is detected after interpolation of the minimum coding unit, so that the time axis deviation during information data reproduction can be reduced. it can.
[0020] また、一つ前の時間情報力 の最小符号ィ匕単位の補間数および復号ィ匕数力 算 出した時間と、現在検出した時間情報とを比較して最小符号化単位の欠落を検出す るようにしても良い。このようにすることにより、予め一つ前の時間情報力もの最小符 号ィ匕単位の補間数および復号ィ匕数カゝら時間を算出しておき、時間現在の時間情報 が付加された最小符号ィ匕単位を検出した時点で比較すれば容易に最小符号ィ匕単 位の欠落を検出することができる。  [0020] In addition, the number of interpolations and the decoding power of the smallest sign key unit of the previous time information power are calculated and the currently detected time information is compared to determine whether the minimum coding unit is missing. It may be detected. In this way, the time is calculated in advance from the number of interpolations and the number of decoding keys in units of the minimum sign of the previous time information power, and the minimum time value with the current time information added. If the comparison is made at the time when the sign key unit is detected, it is possible to easily detect the lack of the minimum sign key unit.
[0021] また、本発明の一実施形態に力かる情報データ受信プログラムは、復号化手段が 最小符号ィ匕単位を復号ィ匕する際にエラーを検出した場合に、最小符号化単位分の 時間の補間データを補間手段で生成し、その補間データを制御手段がエラーが検 出された最小符号ィ匕単位の復号ィ匕データに代えて再生手段に出力し、そして、補間 データを出力させた後に、エラーが検出されな力つた最小符号ィ匕単位を続けて復号 化手段に復号ィ匕させ再生手段に出力するようにコンピュータに機能させる。このよう にすることにより、時間情報の有無に関わらずエラーが発生した時点で情報データの 補間を行うことができ、その後は直ちに最小符号ィ匕単位の復号を継続することができ る。したがって、最小符号ィ匕単位でエラーが発生した時点で補間を直ちに行うことか ら、エラーによる影響を最小限に留めることができる。 [0021] Also, the information data receiving program according to one embodiment of the present invention provides a time corresponding to the minimum coding unit when the decoding unit detects an error when decoding the minimum code key unit. Interpolated data is generated by the interpolating means, and the interpolating data is output to the reproducing means in place of the decoded data of the smallest code unit in which the error is detected, and the interpolating data is then interpolated. After the data is output, the computer is caused to function so that the decoding unit continuously decodes and outputs to the reproducing unit the strongest code unit in which no error is detected. In this way, the information data can be interpolated when an error occurs regardless of the presence or absence of time information, and then decoding in units of minimum codes can be continued immediately thereafter. Therefore, since the interpolation is performed immediately when an error occurs in units of the minimum sign key, the influence of the error can be minimized.
[0022] また、時間情報から最小符号化単位の欠落を検出し、欠落時間分の情報データを 補間手段に生成させて、再生手段に出力するようにしても良い。このようにすることに より、最小符号ィヒ単位の補間後に時間情報が検出された時点で欠落時間分の補間 を行うことができるので、情報データ再生時の時間軸のずれを少なくすることができる  [0022] It is also possible to detect the missing of the minimum coding unit from the time information, generate information data for the missing time in the interpolating means, and output it to the reproducing means. By doing so, it is possible to perform the interpolation for the missing time when the time information is detected after the interpolation of the minimum sign unit, so that the time axis deviation at the time of reproducing the information data can be reduced. it can
[0023] また、一つ前の時間情報力 の最小符号ィ匕単位の補間数および復号ィ匕数力 算 出した時間と、現在検出した時間情報とを比較して最小符号化単位の欠落を検出す るようにしても良い。このようにすることにより、予め一つ前の時間情報力もの最小符 号ィ匕単位の補間数および復号ィ匕数カゝら時間を算出しておき、時間現在の時間情報 が付加された最小符号ィ匕単位を検出した時点で比較すれば容易に最小符号ィ匕単 位の欠落を検出することができる。 [0023] In addition, the minimum number of coding units is compared by comparing the calculated number of interpolations and decoding powers of the previous time information power with the currently detected time information. It may be detected. In this way, the time is calculated in advance from the number of interpolations and the number of decoding keys in units of the minimum sign of the previous time information power, and the minimum time value with the current time information added. If the comparison is made at the time when the sign key unit is detected, it is possible to easily detect the lack of the minimum sign key unit.
[0024] また、請求項 7乃至 9のうちいずれか一項に記載の情報データ受信プログラムを記 録媒体に格納してもよい。このようにすることにより、情報データ受信プログラムを機 器に組み込む以外に単体でも流通させることができる。  [0024] Further, the information data receiving program according to any one of claims 7 to 9 may be stored in a recording medium. In this way, the information data receiving program can be distributed as a single unit in addition to being incorporated into the device.
実施例  Example
[0025] 本発明の一実施例に力かる情報データ受信装置 100を図 2ないし図 6を参照して 説明する。情報データ受信装置 100は、入力端子から入力される情報データとして のビットストリームを受信し、音声データを取り出して復号ィ匕し、再生する装置である。 情報データ受信装置 100は、図 2に示すように TSデマルチプレクサ 101と、音声入 力バッファ 102と、音声デコーダ 103と、音声出力バッファ 104と、 DZAコンバータ 1 05と、スピーカ 106とを備えている。  An information data receiving apparatus 100 according to one embodiment of the present invention will be described with reference to FIGS. The information data receiving device 100 is a device that receives a bit stream as information data input from an input terminal, extracts audio data, decodes it, and reproduces it. As shown in FIG. 2, the information data receiving apparatus 100 includes a TS demultiplexer 101, an audio input buffer 102, an audio decoder 103, an audio output buffer 104, a DZA converter 105, and a speaker 106. .
[0026] 受信手段としての TSデマルチプレクサ 101は、入力端子から入力される TS形式の ビットストリームから PESパケットを復元し、音声データの取り出しおよび PESパケット ヘッダから時間情報としての PTSの検出および音声データのエラー検出を行い、 PT Sやエラー検出情報は音声データとともに音声入力バッファ 102に出力する。この際 に PTSは該 PESパケットの音声データの先頭に合わせるように、エラー検出情報は 、音声データのエラー検出位置に合わせるように出力する。 [0026] The TS demultiplexer 101 as a receiving means has a TS format input from an input terminal. Restores PES packet from bit stream, extracts voice data, detects PTS as time information from PES packet header and detects error of voice data, and outputs PTS and error detection information to voice input buffer 102 along with voice data To do. At this time, the PTS outputs the error detection information so as to be aligned with the error detection position of the audio data so that it is aligned with the beginning of the audio data of the PES packet.
[0027] 音声入力バッファ 102は、 TSデマルチプレクサ 101から入力された音声データや P TSおよびエラー検出情報を蓄積し、音声デコーダ 103の要求に応じて、音声データ や PTSおよびエラー情報を出力する。  The audio input buffer 102 accumulates the audio data, PTS, and error detection information input from the TS demultiplexer 101, and outputs the audio data, PTS, and error information in response to a request from the audio decoder 103.
[0028] 音声デコーダ 103は、音声入力バッファ 102から読み出した音声データをデコード して音声出力バッファ 104に出力する。また、エラー検出情報があった場合はデコー ド結果および PTSに基づいて音声データを補間する。  The audio decoder 103 decodes the audio data read from the audio input buffer 102 and outputs it to the audio output buffer 104. If there is error detection information, the audio data is interpolated based on the decoding result and PTS.
[0029] 音声デコーダ 103では、図 3に示すように、音声デコード制御部 201と、補間データ 生成部 202と、音声デコード部 203と、セレクタ 204と、力も構成されている。  In the audio decoder 103, as shown in FIG. 3, an audio decoding control unit 201, an interpolation data generation unit 202, an audio decoding unit 203, and a selector 204 are also configured.
[0030] 制御手段としての音声デコード制御部 201は、音声入力バッファ 102からデコード の処理単位である最小符号ィ匕単位としてのフレームごとに読み出す。読み出したフ レームに PTSが付いていた場合は、その PTSと直前に出力した PTSからのデコード または補間したフレーム数から時間を算出しておき、その時間からフレームの欠落を 検出する。読み出したフレームにエラー検出情報が付いていた場合または PTSから フレームの欠落を検出した場合または音声デコード部 203からエラー発生の通知が あった場合は、補間データ生成部 202に対して補間データの生成を指示する。エラ 一検出および PTSからフレームの欠落が検出されない場合は、音声デコード部 203 にフレームを出力する。さらに、補間データ生成部 202または音声デコード部 203の どちらに処理の指示を行ったかに応じてセレクタ 204の切り替えを行う。  [0030] The audio decoding control unit 201 as the control means reads out from the audio input buffer 102 for each frame as a minimum code unit which is a decoding processing unit. If the read frame has a PTS, calculate the time from the PTS and the number of frames decoded or interpolated from the PTS output immediately before, and detect missing frames from that time. When error detection information is attached to the read frame, or when a missing frame is detected from the PTS or when an error has been notified from the audio decoding unit 203, the interpolation data generation unit 202 generates interpolation data. Instruct. If no frame error is detected from the error detection or PTS, the frame is output to the audio decoding unit 203. Further, the selector 204 is switched depending on which of the interpolation data generation unit 202 and the audio decoding unit 203 has been instructed to process.
[0031] 補間手段としての補間データ生成部 202は、音声デコード制御部 201からの指示 に応じて、音声デコード部 203の結果を参照しながらエラーフレームや欠落したフレ ーム分の補完データを 1フレーム時間分生成してセレクタ 204へ出力する。  [0031] In response to an instruction from the audio decoding control unit 201, the interpolation data generating unit 202 as an interpolating unit refers to the result of the audio decoding unit 203, and adds complementary data for error frames and missing frames. Generate for frame time and output to selector 204.
[0032] 復号ィ匕手段としての音声デコード部 203は、音声デコード制御部 201から入力され たフレームのデータをデコードしセレクタ 204に出力する。デコード中にデコードエラ 一が発生した場合は、デコード処理を中止し、音声デコード制御部 201にデコードェ ラーが発生したことを出力する。 [0032] The audio decoding unit 203 as decoding means decodes the frame data input from the audio decoding control unit 201 and outputs the decoded data to the selector 204. Decode error during decoding When one occurs, the decoding process is stopped and the audio decoding control unit 201 is output that a decoding error has occurred.
[0033] セレクタ 204は、音声デコード制御部 201の指示により。補間データ生成部 202ま たは音声デコード部 203のいずれか一方の出力を音声出力バッファ 104へ出力するThe selector 204 is in response to an instruction from the audio decoding control unit 201. Output either one of the interpolation data generation unit 202 or the audio decoding unit 203 to the audio output buffer 104
。また、出力するフレームに PTSが付いている場合は PTSも合わせて出力する。 . If the output frame has a PTS, the PTS is also output.
[0034] 音声デコーダ 103の動作を図 4のフローチャートを参照して説明する。 The operation of the audio decoder 103 will be described with reference to the flowchart of FIG.
[0035] まず、ステップ S 101において、音声デコード制御部 201内で計数している補間数 およびデコード数としてのフレーム数を 0にクリアしてステップ S102に進む。 [0035] First, in step S101, the number of interpolations and the number of frames as the number of decodes counted in the audio decoding control unit 201 are cleared to 0, and the process proceeds to step S102.
[0036] 次に、ステップ S102において、音声デコード制御部 201で音声入力バッファ 102よ りフレーム単位の音声データ、 PTS、エラー検出情報を読み込みステップ S103に進 む。 Next, in step S102, the audio decoding control unit 201 reads audio data, PTS, and error detection information for each frame from the audio input buffer 102, and proceeds to step S103.
[0037] 次に、ステップ S103において、音声デコード制御部 201で読み込んだデータに P TSがある力否かを判断し、 PTSがある場合 (Yの場合)はステップ S110に進み、そう でな 、場合 (Nの場合)はステップ S 104に進む。  [0037] Next, in step S103, it is determined whether or not the data read by the audio decoding control unit 201 has a PTS. If there is a PTS (in the case of Y), the process proceeds to step S110. If yes (N), go to Step S104.
[0038] 次に、ステップ S104において、音声デコード制御部 201で読み込んだデータにェ ラー検出情報がある力否かを判断し、エラー検出情報がある場合 (Yの場合)はステ ップ S107に進み、そうでない場合(Nの場合)はステップ S105に進む。  Next, in step S104, it is determined whether or not the data read by the audio decoding control unit 201 has error detection information. If there is error detection information (in the case of Y), the process proceeds to step S107. If not (N), go to Step S105.
[0039] 次に、ステップ S105において、音声デコード部 203が読み込んだフレームのデー タをデコードし、ステップ S106に進む。  [0039] Next, in step S105, the data of the frame read by the audio decoding unit 203 is decoded, and the process proceeds to step S106.
[0040] 次に、ステップ S106において、音声デコード部 203でデコード中にエラーが発生し た力否かを判断し、エラーが発生した場合 (Yの場合)はステップ S107に進み、そう でない場合 (Nの場合)はステップ S 108に進む。  [0040] Next, in step S106, the audio decoding unit 203 determines whether an error has occurred during decoding. If an error has occurred (in the case of Y), the process proceeds to step S107; If N), go to step S108.
[0041] 次に、ステップ S107において、音声入力バッファ 102から読み込んだデータにエラ 一が含まれていたまたは音声デコード部 203からのデコードエラー発生を受けて音 声デコード制御部 201が補間データ生成部 202に 1フレーム時間分の補間データを 生成させてステップ S 108に進む。 1フレーム時間は入力されるビットストリームから取 得し、また、補間の方法は、例えば、前のフレームを再度出力するようにしても良いし 、過去の複数のフレームデータに基づ 、て補間データを生成するようにしても良 、。 [0042] 次に、ステップ S108において、音声デコード制御部 201がセレクタ 204を切り替え てデコードまたは補間された音声データおよび PTSを音声出力バッファ 104に出力 しステップ S 109に進む。 [0041] Next, in step S107, if the error is included in the data read from the audio input buffer 102 or a decoding error is generated from the audio decoding unit 203, the audio decoding control unit 201 executes the interpolation data generating unit. The interpolation data for one frame time is generated in 202, and the process proceeds to step S108. One frame time is obtained from the input bit stream, and the interpolation method may be, for example, to output the previous frame again, or the interpolation data based on a plurality of past frame data. You can make it generate. Next, in step S108, the audio decoding control unit 201 switches the selector 204 to output the decoded or interpolated audio data and PTS to the audio output buffer 104, and the process proceeds to step S109.
[0043] 次に、ステップ S109において、音声デコード制御部 201内のフレーム数をインクリ メントしてステップ S 102に戻る。  Next, in step S109, the number of frames in the audio decoding control unit 201 is incremented, and the process returns to step S102.
[0044] ステップ S110においては、音声デコード制御部 201で、ステップ S103で得た PTS 力 直前に得た PTSと音声デコード制御部 201内で計数したフレーム数に 1フレーム 時間を掛けた値よりも大きいか否かを判断し、大きい場合 (Yの場合)はステップ S 11 1に進み、そうでない場合 (Nの場合)はステップ S114に進む。すなわち、一つ前の P TSからのフレームの補間数およびデコード数力も算出した時間と、現在検出した PT Sとを比較してフレームの欠落を検出して 、る。  [0044] In step S110, the audio decoding control unit 201 is greater than the value obtained by multiplying the PTS obtained immediately before the PTS force obtained in step S103 and the number of frames counted in the audio decoding control unit 201 by one frame time. If it is larger (in the case of Y), the process proceeds to step S111, and if not (in the case of N), the process proceeds to step S114. In other words, a frame loss is detected by comparing the time when the number of interpolations and decoding power of the frame from the previous PTS are calculated with the currently detected PTS.
[0045] 次に、ステップ S111において、ステップ S103で検出した PTSが直前に得た PTSと 音声デコード制御部 201内で計数したフレーム数に 1フレーム時間を掛けた値よりも 大きいことからフレームの欠落があつたと判断し、音声デコード制御部 201が補間デ ータ生成部 202に 1フレーム時間分の補間データを生成させてステップ S112に進む 。 1フレーム時間は入力されるビットストリーム力も取得し、また、補間の方法は、例え ば、前のフレームを再度出力するようにしても良いし、過去の複数のフレームデータ に基づ!/、て補間データを生成するようにしても良 、。  [0045] Next, in step S111, the PTS detected in step S103 is larger than the PTS obtained immediately before and the number of frames counted in the audio decoding control unit 201 multiplied by one frame time. The audio decoding control unit 201 causes the interpolation data generation unit 202 to generate interpolation data for one frame time and proceeds to step S112. In one frame time, the input bit stream power is acquired, and the interpolation method may be to output the previous frame again, for example, based on a plurality of past frame data! / Interpolation data may be generated.
[0046] 次に、ステップ S112において、音声デコード制御部 201がセレクタ 204を切り替え て補間された音声データおよび PTSを音声出力バッファ 104に出力しステップ S113 に進む。  Next, in step S112, the audio decoding control unit 201 switches the selector 204 to output the interpolated audio data and PTS to the audio output buffer 104, and the process proceeds to step S113.
[0047] 次に、ステップ S113において、音声デコード制御部 201内のフレーム数をインクリ メントしてステップ S 110に戻る。  Next, in step S113, the number of frames in the audio decoding control unit 201 is incremented, and the process returns to step S110.
[0048] ステップ S114においては、音声デコード制御部 201内のフレーム数を 0にクリアし てステップ S 104に進む。 In step S114, the number of frames in the audio decoding control unit 201 is cleared to 0, and the process proceeds to step S104.
[0049] ここで、上述したフローチャートによる動作の例を図 5、図 6を参照して説明する。 Here, an example of the operation according to the flowchart described above will be described with reference to FIGS.
[0050] まず、図 5は、情報データ受信装置 100に入力されているビットストリームの一部を 抜き出した図である。入力フレーム列がフレーム 1から順に入力され、フレーム 1が前 の PESパケットの最後のフレームを示し、フレーム 2から 6まで力 PESパケットを構成 し、フレーム 7から次の PESパケットを示している場合の例である。図 5に示したように PESパケットの先頭フレームであるフレーム 2と 7には PTSが付加されている。以降の 説明は、フレーム 2〜6を含む PESパケットを中心に説明する。 [0050] First, FIG. 5 is a diagram in which a part of the bit stream input to the information data receiving apparatus 100 is extracted. Input frame sequence is input in order from frame 1, frame 1 is the previous This is an example in which the last PES packet is shown, the PES packet is composed of frames 2 through 6, and the next PES packet is shown from frame 7. As shown in Fig. 5, PTS is added to frames 2 and 7, which are the first frames of the PES packet. The following explanation focuses on PES packets including frames 2-6.
[0051] 図 5においてフレーム 3でデコード中にエラーが検出され、フレーム 5でフレームデ ータを読み込んだときにエラー検出情報が含まれていたとすると、まず、 PESパケット の先頭であるフレーム 2の場合は、ステップ S102、 S103と進み PTSが付カ卩されてい るので S 110と進み前の PESパケットでエラーが無かったとすれば、ステップ S 114、 S104、 S105、 S106、 S108と進みデコードされた音声データが出力され、ステップ S109に進み、フレーム数を 1としてステップ S102に戻る。ステップ S102ではフレー ム 3を読み込み、ステップ S 103、ステップ S 104、ステップ S 105、ステップ S 106と進 み、エラーが検出されステップ S 107に進み 1フレーム時間分補間データが生成され 、ステップ S108、ステップ S109と進み、フレーム数を 2としてステップ S102に戻る。 ステップ S 102ではフレーム 4を読み込み、ステップ S 103、ステップ S 104、ステップ S 105、ステップ S 106、ステップ S 108、ステップ S 109と進み、フレーム数を 3としてス テツプ S102に戻る。 [0051] In FIG. 5, if an error was detected during decoding at frame 3, and error detection information was included when the frame data was read at frame 5, first the frame 2 at the beginning of the PES packet In this case, the process proceeds to steps S102 and S103, and the PTS is attached, so if there is no error in the previous PES packet, the process proceeds to steps S114, S104, S105, S106, and S108. The audio data is output, the process proceeds to step S109, the number of frames is set to 1, and the process returns to step S102. In step S102, frame 3 is read, and the process proceeds to step S103, step S104, step S105, and step S106.An error is detected and the process proceeds to step S107, where interpolation data is generated for one frame time. Proceed to step S109, set the number of frames to 2, and return to step S102. In step S102, frame 4 is read, and the process proceeds to step S103, step S104, step S105, step S106, step S108, and step S109. The number of frames is set to 3, and the process returns to step S102.
[0052] 続いて、ステップ S 102でフレーム 5を読み込み、ステップ S 103、ステップ S 104と 進みエラー検出情報が含まれていたのでステップ S 107に進み 1フレーム時間分補 間データが生成され、ステップ S 108、ステップ S 109と進み、フレーム数を 4としてス テツプ S102に戻る。ステップ S102ではフレーム 6を読み込み、ステップ S103、ステ ップ S104、ステップ S105、ステップ S106、ステップ S108、ステップ S109と進み、フ レーム数を 5としてステップ S 102に戻る。  [0052] Subsequently, frame 5 is read in step S102, and the process proceeds to step S103 and step S104. Since error detection information is included, the process proceeds to step S107, and one frame time of complement data is generated. Proceed to S108 and Step S109, set the number of frames to 4, and return to Step S102. In step S102, frame 6 is read, and the process proceeds to step S103, step S104, step S105, step S106, step S108, and step S109. The number of frames is set to 5, and the process returns to step S102.
[0053] そして、ステップ S 102で次の PESパケットの先頭であるフレーム 7を読み込み、ス テツプ S103、ステップ S110と進み、ステップ S110で、フレーム 7に含まれる PTSが 、フレーム 2に含まれる PTSにフレーム数と 1フレーム時間を掛けた値をカ卩えた時間よ りも大きいか否かを判断する。フレーム 2に含まれる PTSにフレーム数と 1フレーム時 間を掛けた値をカ卩えた時間は、上述したように、フレーム 2の PTS + 5 X 1フレーム時 間となり、フレーム 7に含まれる PTSは、図 5に示すようにフレーム 2から 5フレーム時 間分進んだ時間であることからステップ SI 10は Nとなり、ステップ S114に進む。すな わち、フレームの欠落が検出されなかったのでフレームの補間は行われない。 [0053] Then, in step S102, frame 7, which is the head of the next PES packet, is read, and the process proceeds to steps S103 and S110. In step S110, the PTS included in frame 7 is changed to the PTS included in frame 2. Judges whether or not it is larger than the time obtained by multiplying the number of frames by one frame time. As described above, the time obtained by multiplying the PTS included in frame 2 by the number of frames multiplied by one frame time is PTS + 5 X 1 frame time of frame 2, and the PTS included in frame 7 is As shown in Fig. 5, when frame 2 to 5 Since the time has advanced for a while, step SI 10 becomes N, and the process proceeds to step S114. In other words, no frame interpolation is performed because no missing frame is detected.
[0054] 次に、図 6の場合を説明する。図 6は、エラーの発生がフレーム 3で発生し、さらに エラーによってフレーム 4の先頭が認識できない状態であることが図 5とは異なる。  Next, the case of FIG. 6 will be described. Fig. 6 is different from Fig. 5 in that an error occurs in frame 3 and the beginning of frame 4 cannot be recognized due to an error.
[0055] まず、 PESパケットの先頭であるフレーム 2の場合は、ステップ S102、 S103と進み PTSが付加されているので S110と進み前の PESパケットでエラーが無かったとすれ ば、ステップ S114、 S104、 S105、 S106、 S108と進みデコードされた音声データ が出力され、ステップ S109に進み、フレーム数を 1としてステップ S102に戻る。ステ ップ S 102ではフレーム 3を読み込み、ステップ S 103、ステップ S 104、ステップ S 10 5、ステップ S106と進み、エラーが検出されステップ S107に進み 1フレーム時間分 補間データが生成され、ステップ S 108、ステップ S 109と進み、フレーム数を 2として ステップ S102に戻る。ステップ S102ではフレーム 4が検出できないので、先頭が検 出できるフレーム 5を読み込み、ステップ S 103、ステップ S 104、ステップ S 105、ステ ップ S106、ステップ S108、ステップ S109と進み、フレーム数を 3としてステップ S10 2に戻る。すなわち、 1フレーム時間分補間したのちにエラーが検出されな力つたフレ 一ムの復号ィ匕データを続けて出力して 、る。  [0055] First, in the case of frame 2 which is the head of the PES packet, the process proceeds to steps S102 and S103. Since PTS is added, if there is no error in the previous PES packet, the process proceeds to steps S114, S104, The decoded audio data is output in steps S105, S106, and S108, and the process proceeds to step S109. The number of frames is set to 1, and the process returns to step S102. In step S102, frame 3 is read, and the process proceeds to step S103, step S104, step S105, and step S106.An error is detected and the process proceeds to step S107.Interpolation data is generated for one frame time, and step S108. The process proceeds to step S109, the number of frames is set to 2, and the process returns to step S102. Since frame 4 cannot be detected in step S102, frame 5 that can be detected at the beginning is read, and the process proceeds to step S103, step S104, step S105, step S106, step S108, and step S109. Return to step S10-2. That is, after interpolating for one frame time, the decoded frame data of a strong frame in which no error is detected is output continuously.
[0056] 続いて、ステップ S 102ではフレーム 6を読み込み、ステップ S 103、ステップ S 104、 ステップ S 105、ステップ S 106、ステップ S 108、ステップ S 109と進み、フレーム数を 4としてステップ S102に戻る。  [0056] Subsequently, in step S102, frame 6 is read, and the process proceeds to step S103, step S104, step S105, step S106, step S108, and step S109. The number of frames is set to 4, and the process returns to step S102. .
[0057] そして、ステップ S 102で次の PESパケットの先頭であるフレーム 7を読み込み、ス テツプ S103、ステップ S110と進み、ステップ S110で、フレーム 7に含まれる PTSが 、フレーム 2に含まれる PTSにフレーム数と 1フレーム時間を掛けた値をカ卩えた時間よ りも大きいか否かを検出する。フレーム 2に含まれる PTSにフレーム数と 1フレーム時 間を掛けた値をカ卩えた時間は、上述したように、フレーム 2の PTS +4 X 1フレーム時 間となり、フレーム 7に含まれる PTSは、図 6に示すようにフレーム 2から 5フレーム時 間分進んだ時間であることからステップ S 110は Yとなり、ステップ S111、 S112と進 み補間データと PTSを出力して、ステップ S113でフレームを 5としてステップ S110に 戻る。ステップ S 110で、再度フレーム 7に含まれる PTS力 フレーム 2に含まれる PT Sにフレーム数と 1フレーム時間を掛けた値をカ卩えた時間よりも大きいか否かを検出し 、フレーム 2に含まれる PTSにフレーム数と 1フレーム時間を掛けた値をカ卩えた時間 は、フレーム 2の PTS + 5 X 1フレーム時間となりフレーム 7の PTSと一致するのでス テツプ S114に進む。すなわち、 PTSからフレームの欠落を検出し、フレームの補間 を行っている。 [0057] Then, in step S102, frame 7, which is the head of the next PES packet, is read, and the process proceeds to step S103 and step S110. In step S110, the PTS included in frame 7 is changed to the PTS included in frame 2. Detects whether or not it is larger than the time obtained by multiplying the number of frames times one frame time. As described above, the time obtained by multiplying the PTS included in frame 2 by the number of frames multiplied by one frame time is the PTS +4 X 1 frame time of frame 2, and the PTS included in frame 7 is As shown in Fig. 6, since it is a time advanced by 5 frame hours from frame 2, step S110 becomes Y, and the step S111, S112 and advance interpolation data and PTS are output, and the frame is changed in step S113. Return to step S110 as 5. In step S110, PTS force included in frame 7 again PT included in frame 2 It is detected whether or not the time obtained by multiplying the value of S multiplied by the number of frames and 1 frame time is larger than the time obtained by multiplying the PTS included in frame 2 by the number of frames multiplied by 1 frame time. Frame 2 PTS + 5 X 1 frame time, which coincides with the frame 7 PTS, so proceed to step S114. In other words, frame missing is detected from PTS and frame interpolation is performed.
[0058] なお、図 6の場合にデコード中のエラー検出でなくフレーム 3にエラー検出情報が 付加されており、かつフレーム 4の先頭が認識できない場合も同様の動作となる。  In the case of FIG. 6, the same operation is performed when error detection information is added to frame 3 instead of error detection during decoding and the head of frame 4 cannot be recognized.
[0059] 音声出力バッファ 104は、音声デコーダ 103から入力されたデコード済みまたは補 間された音声データおよび PTSを蓄積し、 PTSに合わせて D/ Aコンバータ 105に 出力する。  [0059] The audio output buffer 104 accumulates decoded or interpolated audio data and PTS input from the audio decoder 103, and outputs them to the D / A converter 105 in accordance with the PTS.
[0060] 再生手段としての DZAコンバータ 105は、音声出力バッファ 104力も入力された デジタル値の音声データをアナログ信号に変換し、スピーカ 106へ出力する。  [0060] The DZA converter 105 as reproduction means converts the audio data of the digital value to which the audio output buffer 104 is also input into an analog signal and outputs it to the speaker 106.
[0061] スピーカ 106は、 DZ Aコンバータ 105から出力されたアナログ信号を図示しないァ ンプで所定のレベルに増幅した後音声として放音する。  [0061] The speaker 106 amplifies the analog signal output from the DZA converter 105 to a predetermined level with an amplifier (not shown), and then emits it as a sound.
[0062] 本実施例によれば、情報データ受信装置 100において、入力されたビットストリーム 力も PESパケットを TSデマルチプレクサ 101で復元し、音声デコーダ 103でフレーム 毎に復号化する。 PESパケット復元時のエラー検出または、音声デコーダ 103内の 音声デコード部 203でデコード中にエラー検出した場合には、音声デコーダ 103内 の補間データ生成部 202で 1フレーム時間分の補間データを生成し、音声デコード 制御部 201が、エラーフレームに代えて補間データを音声出力バッファ 104に出力 するようにセレクタ 204を切替えて、次のフレームの復号ィ匕を行 、エラーが検出され なければそのまま出力されるので、エラー検出時には直ちに 1フレーム時間分の音 声データを補間することができる。そして、次のフレームの復号ィ匕を行い正常であれ ばそのまま出力するので、 1フレーム単位で補間を行えることからエラーの影響を最 小限に留めて以降のフレームの音声情報を出力することができる。  [0062] According to the present embodiment, in the information data receiving apparatus 100, the PES packet is also restored by the TS demultiplexer 101 for the input bit stream power, and decoded by the audio decoder 103 for each frame. If an error is detected during PES packet restoration, or if an error is detected during decoding by the audio decoding unit 203 in the audio decoder 103, the interpolation data generation unit 202 in the audio decoder 103 generates interpolation data for one frame time. Then, the audio decoding control unit 201 switches the selector 204 so that the interpolation data is output to the audio output buffer 104 instead of the error frame, and performs decoding of the next frame. If no error is detected, the audio decoding control unit 201 outputs it as it is. Therefore, when an error is detected, audio data for one frame time can be interpolated immediately. Then, the decoding of the next frame is performed, and if it is normal, it is output as it is, so that interpolation can be performed in units of one frame, so that it is possible to output the audio information of the subsequent frames while minimizing the influence of the error. it can.
[0063] さらに、 PTSを検出した時点で、その PTSと、前の PTSと補間またはデコードしたフ レーム数力も算出した時間と、を比較し、その結果現在の PTSが大きい場合はフレ ームの欠落が有ると判断して、欠落時間分のフレームの補間を行うので、 PTSを検 出した時点で容易に欠落フレームの有無が判断でき補間を行うことができる。したが つて、デコードデータの時間軸のずれを少なくすることができる。 [0063] Further, when the PTS is detected, the PTS is compared with the time when the previous PTS and the number of frames that have been interpolated or decoded are calculated. As a result, if the current PTS is large, the frame Since it is determined that there is a missing frame and the frame is interpolated for the missing time, PTS is detected. It is possible to easily determine the presence or absence of a missing frame at the time of extraction and perform interpolation. Therefore, it is possible to reduce the time axis shift of the decoded data.
[0064] なお、上述した実施例ではフレームの欠落を、 PTSと、前の PTSからの補間数およ びフレーム数力 算出した時間と、を比較して判定していた力 それに限らず、例え ば情報データ受信装置内部に時計機能を持ち、その時計と PTSとからフレームの欠 落を検出しても良い。すなわち、フレームが本来到着していなければならない時刻に なっても到着して 、な 、場合はフレーム欠落であると判定するようにしても良 、。  [0064] It should be noted that in the above-described embodiment, the frame loss is determined by comparing the PTS with the number of interpolations and the number of frames calculated from the previous PTS. For example, a clock function may be provided inside the information data receiving device, and a missing frame may be detected from the clock and the PTS. In other words, it may be determined that the frame arrives at the time when the frame should have arrived, and in this case, it is determined that the frame is missing.
[0065] また、上述した実施例では、フレームの欠落を、 PTSと、前の PTSからの補間数お よびフレーム数力 算出した時間と、を比較して判定していた力 PTSの揺らぎ分を 考慮して判定を行っても良い。例えば、図 5では、 2つの PTS間は 5フレーム時間で あるが、実際の MPEGシステムの伝送においては、フレーム 7に付加される PTSが 必ずしもフレーム 2から 5フレーム後の時間でないことがあるため(約 1Z2フレーム時 間未満の範囲で揺らぐことがある)、その分を考慮して判定を行っても良い。  [0065] In the above-described embodiment, the fluctuation of the force PTS determined by comparing the PTS, the number of interpolations from the previous PTS, and the time for which the number of frames was calculated is determined. The determination may be made in consideration. For example, in Fig. 5, the time between two PTSs is 5 frame times, but in actual MPEG system transmission, the PTS added to frame 7 may not necessarily be the time after 5 frames from frame 2 ( Judgment may be made in consideration of that amount, which may fluctuate within a range of less than about 1Z2 frame time).
[0066] また、上述した実施例は、音声について説明したが、音声に限らず映像についても 、例えばピクチャが最小符号ィ匕単位であった場合に、ピクチャに時間情報が付加さ れたものと付加されないものがあった場合には本発明を適用することができる。  [0066] In the above-described embodiment, the audio has been described. However, not only the audio but also the video, for example, when the picture is the minimum code unit, the time information is added to the picture. The present invention can be applied when there is something that is not added.
[0067] また、上述した情報データ受信装置をコンピュータで動作するプログラムとしてもよ い。その際には、図 2のブロック図に示された各ブロックの機能を CPUおよびメモリな どに機能されることで、コンピュータ読み取り可能な情報データ受信プログラムとする ことができる。  [0067] The information data receiving apparatus described above may be a program that operates on a computer. In this case, the function of each block shown in the block diagram of FIG. 2 is functioned by a CPU and a memory, so that a computer-readable information data receiving program can be obtained.
[0068] また、本発明を地上デジタル放送や CATVおよびインターネット経由の放送などを 受信する受信機に適用すれば、伝送時のエラーの影響を最小限に留めることができ る。特に電波で情報が伝送される移動体受信機であるモパイル機器や車載機器など に適用すると非常に効果的である。  [0068] Further, if the present invention is applied to a receiver that receives terrestrial digital broadcasting, CATV, broadcasting via the Internet, and the like, the influence of errors during transmission can be minimized. In particular, it is very effective when applied to mopile equipment and in-vehicle equipment that are mobile receivers that transmit information by radio waves.
[0069] 前述した実施例によれば、以下の情報データ受信装置、情報データ受信方法およ び情報データ受信プログラムが得られる。  [0069] According to the embodiment described above, the following information data receiving device, information data receiving method, and information data receiving program can be obtained.
[0070] (付記 1) PTSが付加されているフレームと、 PTSが付加されていないフレームとが混 在するビットストリームを受信する TSデマルチプレクサ 101と、 TSデマルチプレクサ 1 01が受信したビットストリームをフレーム毎に復号ィ匕する音声デコード部 203と、音声 デコード部 203が復号ィ匕した音声データを再生する DZAコンバータ 105と、を有す る情報データ受信装置 100において、 [0070] (Supplementary Note 1) TS demultiplexer 101 that receives a bitstream in which a frame to which PTS is added and a frame to which PTS is not added is mixed, and TS demultiplexer 1 In an information data receiving apparatus 100 having an audio decoding unit 203 that decodes a bit stream received by 01 for each frame and a DZA converter 105 that reproduces audio data decoded by the audio decoding unit 203,
音声デコード部 203がフレームを復号ィ匕する際にエラーを検出した場合は、 1フレ ーム時間分の補間データを生成する補間データ生成部 202と、  When the audio decoding unit 203 detects an error when decoding a frame, an interpolation data generation unit 202 that generates interpolation data for one frame time;
エラーが検出されたフレームの音声データに代えて補間データ生成部 202が生成 した補間データを DZAコンバータ 105に出力させ、そして、補間データを出力させ た後に、エラーが検出されな力つたフレームを続けて音声デコード部 203に復号ィ匕さ せて DZ Aコンバータ 105に出力させる音声デコード制御部 201と、  The interpolation data generated by the interpolation data generation unit 202 is output to the DZA converter 105 instead of the audio data of the frame in which the error is detected, and after the interpolation data is output, the powerful frame in which no error is detected is continued. An audio decoding control unit 201 that causes the audio decoding unit 203 to decode and output to the DZ A converter 105;
を有したことを特徴とする情報データ受信装置。  An information data receiving apparatus characterized by comprising:
[0071] この情報データ受信装置 100によれば、 PTSの有無に関わらずエラーが発生した 時点で音声データの補間を 1フレーム分行うことができ、その後は直ちにフレーム単 位の復号を継続することができる。したがって、フレームでエラーが発生した時点で 補間を直ちに行うことから、エラーによる影響を最小限に留めることができる。 [0071] According to this information data receiving apparatus 100, it is possible to interpolate audio data for one frame when an error occurs regardless of the presence or absence of PTS, and then continue decoding in units of frames immediately thereafter. Can do. Therefore, since the interpolation is performed immediately when an error occurs in the frame, the influence of the error can be minimized.
[0072] (付記 2) PTSが付加されているフレームと、 PTSが付加されていないフレームとが混 在するビットストリームを受信し、受信したビットストリームをフレーム毎に復号ィ匕して、 復号化した音声データを再生する情報データ受信方法において、 [0072] (Appendix 2) A bitstream in which a frame to which a PTS is added and a frame to which a PTS is not added is mixed is received, and the received bitstream is decoded for each frame and decoded. In an information data receiving method for playing back audio data,
フレームを復号ィ匕する際にエラーを検出した場合は、 1フレーム時間分の補間デー タを生成し、エラーが検出されたフレームの音声データに代えて補間データを再生し 、そして、補間データを出力させた後に、エラーが検出されなかったフレームを続け て復号化して再生するように制御することを特徴とする情報データ受信方法。  If an error is detected when decoding a frame, interpolated data for one frame time is generated, the interpolated data is reproduced instead of the audio data of the frame in which the error is detected, and the interpolated data is A method of receiving information data, comprising: controlling to decode and reproduce a frame for which no error has been detected after output.
[0073] この情報データ受信方法によれば、 PTSの有無に関わらずエラーが発生した時点 で音声データの補間を 1フレーム分行うことができ、その後は直ちにフレーム単位の 復号を継続することができる。したがって、フレームでエラーが発生した時点で補間を 直ちに行うことから、エラーによる影響を最小限に留めることができる。 [0073] According to this information data reception method, audio data can be interpolated for one frame when an error occurs regardless of the presence or absence of PTS, and then decoding can be continued in units of frames immediately thereafter. . Therefore, since the interpolation is performed immediately when an error occurs in the frame, the influence of the error can be minimized.
[0074] (付記 3) PTSが付加されているフレームと、 PTSが付加されていないフレームとが混 在するビットストリームを受信する TSデマルチプレクサ 101と、 TSデマルチプレクサ 1 01が受信したビットストリームをフレーム毎に復号ィ匕する音声デコード部 203と、音声 デコード部 203が復号ィ匕した音声データを再生する DZAコンバータ 105と、してコ ンピュータに機能させる情報データ受信プログラムにおいて、 (Supplementary Note 3) The TS demultiplexer 101 that receives a bitstream in which a frame to which a PTS is added and a frame to which a PTS is not added is mixed, and the bitstream that is received by the TS demultiplexer 101 Audio decoding unit 203 that decodes every frame, and audio In the information data receiving program that causes the computer to function as the DZA converter 105 that reproduces the audio data decoded by the decoding unit 203,
音声デコード部 203がフレームを復号ィ匕する際にエラーを検出した場合は、 1フレ ーム時間分の補間データを生成する補間データ生成部 202と、  When the audio decoding unit 203 detects an error when decoding a frame, an interpolation data generation unit 202 that generates interpolation data for one frame time;
エラーが検出されたフレームの音声データに代えて補間データ生成部 202が生成 した補間データを DZAコンバータ 105に出力させ、そして、補間データを出力させ た後に、エラーが検出されな力つたフレームを続けて音声デコード部 203に復号ィ匕さ せて DZ Aコンバータ 105に出力させる音声デコード制御部 201と、  The interpolation data generated by the interpolation data generation unit 202 is output to the DZA converter 105 instead of the audio data of the frame in which the error is detected, and after the interpolation data is output, the powerful frame in which no error is detected is continued. An audio decoding control unit 201 that causes the audio decoding unit 203 to decode and output to the DZ A converter 105;
してコンピュータに機能させることを特徴とするコンピュータ読み取り可能な情報デー タ受信プログラム。  A computer-readable information data receiving program characterized by causing a computer to function.
[0075] この情報データ受信プログラムによれば、 PTSの有無に関わらずエラーが発生した 時点で音声データの補間を 1フレーム分行うことができ、その後は直ちにフレーム単 位の復号を継続することができる。したがって、フレームでエラーが発生した時点で 補間を直ちに行うことから、エラーによる影響を最小限に留めることができる。  [0075] According to this information data receiving program, it is possible to interpolate audio data for one frame when an error occurs regardless of the presence or absence of PTS, and then continue decoding in units of frames immediately thereafter. it can. Therefore, since the interpolation is performed immediately when an error occurs in the frame, the influence of the error can be minimized.
[0076] なお、前述した実施例は本発明の代表的な形態を示したに過ぎず、本発明は、実 施例に限定されるものではない。すなわち、本発明の骨子を逸脱しない範囲で種々 変形して実施することができる。  It should be noted that the above-described embodiments are merely representative forms of the present invention, and the present invention is not limited to the embodiments. That is, various modifications can be made without departing from the scope of the present invention.

Claims

請求の範囲 The scope of the claims
[1] 復号化や再生のための時間情報が付加されている最小符号化単位と、前記時間 情報が付加されて 、な 、前記最小符号ィ匕単位とが混在する情報データを受信する 受信手段と、前記受信手段が受信した情報データを前記最小符号化単位毎に復号 化する復号化手段と、前記復号化手段が復号化した復号化データを再生する再生 手段と、を有する情報データ受信装置において、  [1] Receiving means for receiving information data in which the minimum coding unit to which time information for decoding and reproduction is added and the time information is added and the minimum code unit is mixed And a decoding means for decoding the information data received by the receiving means for each minimum coding unit, and a reproducing means for reproducing the decoded data decoded by the decoding means. In
前記復号化手段が前記最小符号化単位を復号化する際にエラーを検出した場合 は、前記最小符号化単位の時間分の補間データを生成する補間手段と、  When the decoding means detects an error when decoding the minimum coding unit, an interpolation means for generating interpolation data for the time of the minimum coding unit;
エラーが検出された前記最小符号化単位の情報データに代えて前記補間手段が 生成した補間データを前記再生手段に出力させ、そして、前記補間データを出力さ せた後に、エラーが検出されな力つた前記最小符号ィ匕単位を続けて前記復号ィ匕手 段に復号化させ前記再生手段に出力させる制御手段と、  The interpolating data generated by the interpolating means is output to the reproducing means in place of the information data of the minimum coding unit in which an error is detected, and after the interpolated data is output, the error is detected. Control means for successively decoding the minimum code key unit by the decoding key means and causing the reproduction means to output the unit;
を有したことを特徴とする情報データ受信装置。  An information data receiving apparatus characterized by comprising:
[2] 前記制御手段が、前記時間情報から前記最小符号化単位の欠落を検出し、欠落 時間分の情報データを前記補間手段に生成させて、前記再生手段に出力することを 特徴とする請求項 1に記載の情報データ受信装置。  [2] The control means detects missing of the minimum coding unit from the time information, causes the interpolation means to generate information data for a missing time, and outputs the information data to the reproducing means. Item 4. The information data receiving device according to Item 1.
[3] 前記制御手段が、一つ前の前記時間情報からの最小符号化単位の補間数および 復号化数から算出した時間と、現在検出した前記時間情報とを比較して前記最小符 号ィ匕単位の欠落を検出することを特徴とする請求項 2に記載の情報データ受信装置  [3] The control means compares the time calculated from the number of interpolations and the number of decodings of the minimum coding unit from the previous time information with the time information detected at present, and compares the time code with the minimum code i. 3. The information data receiving apparatus according to claim 2, wherein a missing unit of a heel is detected.
[4] 復号化や再生のための時間情報が付加されて!ヽる最小符号化単位と、前記時間 情報が付加されて 、な 、前記最小符号ィ匕単位とが混在する情報データを受信し、受 信した情報データを前記最小符号化単位毎に復号化して、復号化した復号化デー タを再生する情報データ受信方法にぉ 、て、 [4] Receive information data in which the minimum coding unit to which time information for decoding and reproduction is added and the time information is added and the minimum code unit to be mixed are received. The received information data is decoded for each of the minimum encoding units, and the information data receiving method for reproducing the decoded data is used.
前記最小符号化単位を復号化する際にエラーを検出した場合は、前記最小符号 化単位の時間分の補間データを生成し、エラーが検出された前記最小符号化単位 の情報データに代えて前記補間データを再生し、そして、前記補間データを出力さ せた後に、エラーが検出されな力つた前記最小符号ィ匕単位を続けて復号ィ匕し再生 するように制御することを特徴とする情報データ受信方法。 When an error is detected when decoding the minimum coding unit, interpolation data for the time of the minimum coding unit is generated, and the information is replaced with the information data of the minimum coding unit in which the error is detected. After interpolated data is reproduced and the interpolated data is output, the minimum code key unit without error is continuously decoded and reproduced. An information data receiving method characterized in that control is performed.
[5] 前記時間情報から前記最小符号化単位の欠落を検出し、欠落時間分の補間デー タを生成させて再生することを特徴とする請求項 4に記載の情報データ受信方法。  5. The information data receiving method according to claim 4, wherein missing of the minimum coding unit is detected from the time information, and interpolated data corresponding to the missing time is generated and reproduced.
[6] 一つ前の前記時間情報力 の前記最小符号ィ匕単位の補間数および復号ィ匕数から 算出した時間と、現在検出した前記時間情報とを比較して前記最小符号化単位の欠 落を検出することを特徴とする請求項 5に記載の情報データ受信方法。  [6] The time calculated from the number of interpolations and the number of decoding keys in the minimum code unit of the previous time information power is compared with the currently detected time information, and the minimum encoding unit is missing. 6. The information data receiving method according to claim 5, wherein a drop is detected.
[7] 復号化や再生のための時間情報が付加されている最小符号化単位と、前記時間 情報が付加されて 、な 、前記最小符号ィ匕単位とが混在する情報データを受信する 受信手段と、前記受信手段が受信した情報データを前記最小符号化単位毎に復号 化する復号化手段と、前記復号化手段が復号化した復号化データを再生する再生 手段と、してコンピュータに機能させる情報データ受信プログラムにおいて、 前記復号化手段が前記最小符号化単位を復号化する際にエラーを検出した場合 は、前記最小符号化単位の時間分の補間データを生成する補間手段と、  [7] Receiving means for receiving information data in which the minimum coding unit to which time information for decoding and reproduction is added and the time information is added and the minimum code unit is mixed And a decoding means for decoding the information data received by the receiving means for each minimum coding unit, and a reproducing means for reproducing the decoded data decoded by the decoding means. In the information data receiving program, when the decoding unit detects an error when decoding the minimum coding unit, an interpolation unit that generates interpolation data for a time of the minimum coding unit;
エラーが検出された前記最小符号化単位の情報データに代えて前記補間手段が 生成した補間データを前記再生手段に出力させ、そして、前記補間データを出力さ せた後に、エラーが検出されな力つた前記最小符号ィ匕単位を続けて前記復号ィ匕手 段に復号化させ前記再生手段に出力させる制御手段と、  The interpolating data generated by the interpolating means is output to the reproducing means in place of the information data of the minimum coding unit in which an error is detected, and after the interpolated data is output, the error is detected. Control means for successively decoding the minimum code key unit by the decoding key means and causing the reproduction means to output the unit;
してコンピュータに機能させることを特徴とするコンピュータ読み取り可能な情報デ ータ受信プログラム。  A computer-readable information data receiving program characterized by causing a computer to function.
[8] 前記制御手段が、前記時間情報から前記最小符号化単位の欠落を検出し、欠落 時間分の情報データを前記補間手段に生成させて、前記再生手段に出力することを 特徴とする請求項 7に記載の情報データ受信プログラム。  [8] The control means detects missing of the minimum coding unit from the time information, causes the interpolation means to generate information data for the missing time, and outputs the information data to the reproducing means. The information data receiving program according to Item 7.
[9] 前記制御手段が、一つ前の前記時間情報からの前記最小符号化単位の補間数お よび復号化数から算出した時間と、現在検出した前記時間情報とを比較して前記最 小符号ィ匕単位の欠落を検出することを特徴とする請求項 8に記載の情報データ受信 プログラム。  [9] The control means compares the time calculated from the number of interpolations and the number of decoding of the minimum coding unit from the previous time information with the currently detected time information and compares the minimum time 9. The information data receiving program according to claim 8, wherein a loss of a sign unit is detected.
[10] 請求項 7乃至 9のうち 、ずれか一項に記載の情報データ受信プログラムを格納した ことを特徴とするコンピュータ読み取り可能な記録媒体。  [10] A computer-readable recording medium, wherein the information data receiving program according to any one of claims 7 to 9 is stored.
PCT/JP2006/321355 2006-10-26 2006-10-26 Information data receiving device, information data receiving method, information data receiving program and recording medium with information data receiving program stored therein WO2008050427A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2006/321355 WO2008050427A1 (en) 2006-10-26 2006-10-26 Information data receiving device, information data receiving method, information data receiving program and recording medium with information data receiving program stored therein
JP2008540849A JP4820877B2 (en) 2006-10-26 2006-10-26 Information data receiving apparatus, information data receiving method, information data receiving program, and recording medium storing information data receiving program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2006/321355 WO2008050427A1 (en) 2006-10-26 2006-10-26 Information data receiving device, information data receiving method, information data receiving program and recording medium with information data receiving program stored therein

Publications (1)

Publication Number Publication Date
WO2008050427A1 true WO2008050427A1 (en) 2008-05-02

Family

ID=39324241

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2006/321355 WO2008050427A1 (en) 2006-10-26 2006-10-26 Information data receiving device, information data receiving method, information data receiving program and recording medium with information data receiving program stored therein

Country Status (2)

Country Link
JP (1) JP4820877B2 (en)
WO (1) WO2008050427A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002359603A (en) * 2001-05-31 2002-12-13 Mitsubishi Electric Corp Stream converter
JP2005223452A (en) * 2004-02-03 2005-08-18 Matsushita Electric Ind Co Ltd Digital broadcasting transmitter, digital broadcasting receiver, its method, and program

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002359603A (en) * 2001-05-31 2002-12-13 Mitsubishi Electric Corp Stream converter
JP2005223452A (en) * 2004-02-03 2005-08-18 Matsushita Electric Ind Co Ltd Digital broadcasting transmitter, digital broadcasting receiver, its method, and program

Also Published As

Publication number Publication date
JP4820877B2 (en) 2011-11-24
JPWO2008050427A1 (en) 2010-02-25

Similar Documents

Publication Publication Date Title
JP3602728B2 (en) Digital video disk player and image display device
JP4391409B2 (en) High-efficiency-encoded time-series information transmission method and apparatus for real-time streaming transmission and reception
JP5553764B2 (en) Method for FEC decoding
JP2006115104A (en) Method and device for packetizing time-series information encoded with high efficiency, and performing real-time streaming transmission, and for reception and reproduction
TW200830874A (en) Image information transmission system, image information transmitting apparatus, image information receiving apparatus, image information transmission method, image information transmitting method, and image information receiving method
JP2002335230A (en) Method and device for decoding audio encoded signal
US7742472B2 (en) Signal processing apparatus and stream processing method
CN101695134B (en) The terminal of a kind of improving play performance of terminal in weak signal environment, system and method
US7333711B2 (en) Data distribution apparatus and method, and data distribution system
JP2008061150A (en) Receiver and information processing method
JP4096915B2 (en) Digital information reproducing apparatus and method
US7269839B2 (en) Data distribution apparatus and method, and data distribution system
US7436457B2 (en) Analog/digital signal processor and analog/digital signal processing method
WO2008050427A1 (en) Information data receiving device, information data receiving method, information data receiving program and recording medium with information data receiving program stored therein
US6198499B1 (en) Radio-communication video terminal device
JP2001309375A (en) Media separating method and method/device for decoding image
JP2001125596A (en) Audio data transmission method and device
JP2007221211A (en) Audio processing apparatus
JP4538488B2 (en) Stream receiving apparatus, stream receiving method, and stream transmitting / receiving method
KR100847178B1 (en) Communication system and communication method
JPH11340935A (en) Data multiplexer and its method
JP2001135024A (en) Image/audio signal recording/reproducing device
JP4538489B2 (en) Stream receiving apparatus, stream receiving method, and stream transmitting / receiving method
JP2004289537A (en) Data packetizing apparatus
JP2007214735A (en) Program recording and reproducing apparatus

Legal Events

Date Code Title Description
DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 06822331

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2008540849

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06822331

Country of ref document: EP

Kind code of ref document: A1