JP2005245006A - Postrecording signal reproducing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To return a postrecording data to an original data, to record a plurality of the postrecording data by a user, and to reproduce them by replacing selectively with a main data at a reproduction time. <P>SOLUTION: A postrecording audio data is MPEG-encoded by an audio encoder 101b, the encoded postrecording audio data is packetized by adding an identification information to an element data of the postrecording audio at a PES packetizer 102b, and the PES packet of the postrecording audio records a time stamp data by a time stamp recorder 103b. The PES packet of the postrecording audio by which the identification information and the time stamp are recorded is recorded in a recording medium 108 by being streamed not through a multiplexer 104. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an after-recording signal reproduction apparatus suitable for an after-recording system that performs recording (after-recording, hereinafter referred to as after-recording) / replacement of an audio signal or the like with respect to main data composed of at least an audio signal and a video signal.

  As a conventional example, Japanese Patent Application Laid-Open No. 11-144378 proposes a method of writing a new audio bit stream for post-recording in an area corresponding to a time substantially equal to the recording area of the original data in the digital recording medium. . Japanese Patent Laid-Open No. 11-259992 proposes a method for recording post-recording data in an empty pack prepared in advance. Japanese Patent Laid-Open No. 2000-197005 discloses a method for overwriting recording after-recording sound on a sound pack determined to be silent.

  By the way, as a recent digital device, data multiplexed using a multiplexing system called TS (transport stream) in D-VHS and STB and PS (program stream) in DVD are handled. On the other hand, once multiplexed, it is a problem of multiplexing that it becomes difficult to replace a part of the data. That is, it is not easy to replace only the audio portion of the multiplexed stream in order to perform audio after-recording. Therefore, there is an increasing need for a format that can easily cope with post-recording as encoded data in a recording medium.

  However, since the above-described conventional method is based on the premise that the element data to be dubbed is written and the multiplexed main stream is rewritten, it cannot be restored again after rewriting. . In addition, after recording a plurality of post-recording sounds, a system in which the user can selectively enjoy post-recording data cannot be constructed.

  In view of the above-described problems of the conventional example, the present invention can return the post-record data to the original data, and the user can record a plurality of post-record data and selectively replace the main data with the main data during playback. An object of the present invention is to provide an after-recording signal reproducing apparatus that can be used.

In order to achieve the above object, the present invention
The compression-encoded data of two signals of the audio signal and the video signal constituting the main data are multiplexed by adding a time stamp for synchronous reproduction of the audio signal and the video signal to each predetermined unit. An input means for inputting a stream of main data;
Means for selecting and designating one of a plurality of post-recording compression-coded audio data for the audio signal constituting the main data;
The plurality of post-recording compressed and encoded audio data are added with a time stamp for synchronous reproduction with the main data and identification information for identifying the individual post-recording compressed and encoded audio data and multiplexed with the main data. An input means for selectively inputting a post-recording data stream including the selected post-recording compressed encoded audio data from the post-record data stream that has been streamed without being converted based on the identification information;
The main data is read from the main data stream, and the one selected after-recording compressed encoded audio data is read from the selected after-record data stream, and the selected after-recording compressed code is read out. Replacing the encoded audio data with the audio signal in the main data for the post-recording compressed encoded audio data, and a time stamp read from the main data stream and a time stamp read from the selected post-record data stream And means for synchronously reproducing the video signal of the main data and the selected and designated after-recording compressed encoded audio data;
An after-recording signal reproducing apparatus, comprising:
I will provide a.

  As described above, according to the present invention, a plurality of post-recording compressed data is added with a time stamp for synchronous reproduction with main data and identification information for identifying individual data, and multiplexing of main data is performed. Since the data is streamed without being multiplexed with the data, it is possible to return the post-record data to the original data. In addition, the user can record a plurality of post-record data and selectively replace the main data with the main data during reproduction.

Embodiments of the present invention will be described below with reference to the drawings.
<MPEG>
First, an MPEG video (video encoding system) and an MPEG system (audio video multiplexing system) used in this embodiment will be described. MPEG is the name of the organization that examines video coding standards established in 1988 by ISO / IEC JTC1 / SC2 (International Organization for Standardization / International Electrotechnical Standards Meeting Technical Committee 1 / Technical Committee 2, now SC29). Abbreviation for Moving Picture Experts Group. MPEG1 (MPEG Phase 1) is a standard for storage media of about 1.5 Mbps, and JPEG for the purpose of encoding still images, and video compression for low transfer rates of ISDN video conferences and videophones. The target H.C. It inherits the basic technology of H.261 (CCIT SGXV: standardized by the current ITU-T SG15) and introduces a new technology for storage media. These were established in August 1993 as ISU / IEC 11172. In addition, MPEG2 (MPEG Phase 2) is an ISU / IEC 13818 H.264 standard in November 1994 for the purpose of general-purpose standards so as to be compatible with various applications such as communication and broadcasting. It is established as 262.

  MPEG is created by combining several technologies. FIG. 12 shows an MPEG compression apparatus. First, the input image Vin is reduced by the adder 1 by taking the difference from the reference image decoded by the motion compensation predictor 11 to reduce the time redundant portion. There are three modes of prediction from the past and the future. These can be switched and used for each 16 pixels × 16 pixels MB (macroblock). The prediction direction is determined by the picture type given to the input image. The P picture has two modes for predicting from the past and encoding the MB independently without prediction. In addition, there are four modes in which prediction from the future, prediction from the past, prediction from both, and four modes for encoding independently exist. It is the I picture that all MBs are encoded independently.

  In motion compensation, a motion region is subjected to pattern matching for each MB, a motion vector is detected with half-pel accuracy, and prediction is performed after shifting by the amount of motion. The motion vector has a horizontal direction and a vertical direction, and is transmitted as additional information of the MB together with an MC (Motion Compensation) mode indicating which one is predicted. From the I picture to the picture before the next I picture is called a GOP (Group Of Pictures), and when it is used in a storage medium or the like, generally about 15 pictures are used.

  The difference image is subjected to orthogonal transformation in a DCT (Discrete Cosine Transform) unit 2. DCT is an orthogonal transformation that discretely transforms an integral transformation with a cosine function as an integral kernel into a finite space. In MPEG, two-dimensional DCT is performed on an 8 × 8 DCT block by dividing MB into four. In general, a video signal has many low frequency components and few high frequency components. Therefore, when DCT is performed, the coefficients are concentrated in the low frequency.

  The quantized image data (DCT coefficient) subjected to DCT is quantized by the quantizer 3. Quantization is a quantized value obtained by multiplying a value obtained by weighting the 8 × 8 two-dimensional frequency called the quantization matrix with a visual characteristic and a value called a quantization scale that is a scalar multiplication of the whole, and the DCT coefficient is quantized. Divide by value. When inverse quantization is performed by the decoder, a value that approximates the original DCT coefficient is obtained by multiplying by the quantized value.

  The quantized data is variable length encoded by the VLC unit 4. The direct current (DC) component of the quantized value is encoded using DPCM (Differential Pulse Code Modulation) which is one of predictive encoding. In addition, alternating current (AC) components are zigzag scanned from low to high, and a zero run length and effective coefficient value are considered as one event, and codes with a short code length are assigned to those with a high probability of appearance. Huffman encoding is performed. The variable-length encoded data is temporarily stored in the buffer 5 and output as encoded data at a predetermined transfer rate.

  The generated code amount for each macroblock of the output data is transmitted to the code amount controller 6, and the error code amount with respect to the generated code amount with respect to the target code amount is fed back to the quantizer 3 to quantize the scale. The amount of code is controlled by adjusting. The quantized image data is inversely quantized by the inverse quantizer 7 and then inversely DCTed by the inverse DCT 8 to restore the original DCT coefficients. This DCT coefficient is added to the reference image decoded by the motion compensation predictor 11 by the adder 9, and after the added image data is temporarily stored in the image memory 10, the motion compensated predictor 11 Used as a reference decoded image for calculating a difference image.

  FIG. 13 shows an MPEG decoding apparatus. The encoded stream is buffered, and the data from the buffer 12 is input to a VLD (variable length decoder) 13. The VLD unit 13 performs variable length decoding to obtain a direct current (DC) component and an alternating current (AC) component. Alternating current (AC) component data is zigzag scanned from low to high and arranged in an 8 × 8 matrix. This data is input to the inverse quantizer 14 and is inversely quantized by a quantization matrix. The inversely quantized data is input to the inverse DCT unit 15 and subjected to inverse DCT, and this DCT coefficient is added by the adder 16 with the reference image decoded by the motion compensation predictor 18, and the added image data. Is output as decoded data. The decoded data is temporarily stored in the image memory 17 and then used as a reference decoded image for calculating a difference image in the motion compensation predictor 18.

The MPEG system stipulates a method for multiplexing a bit stream encoded by MPEG video and audio into one bit stream and reproducing it while ensuring synchronization. The contents specified in the system are roughly divided into the following five points.
1) Synchronous playback of multiple encoded bitstreams 2) Multiplexing of multiple encoded bitstreams into a single bitstream 3) Buffer initialization at playback start 4) Continuous buffer management 5) Determination of time for decoding, reproduction, etc. Information must be packetized for multiplexing in the MPEG system. Packet multiplexing means, for example, when video and audio are multiplexed, each is divided into streams of appropriate length called packets, attached with additional information such as headers, and video and audio packets are switched appropriately. Time-division transmission. The header includes information for identifying video, audio, etc., and time information for synchronization. The packet length depends on the transmission medium and application, and ranges from 53 bytes as in ATM to 4 Kbytes as long as an optical disk. In MPEG, the packet length is variable and can be arbitrarily specified.

  Data is packed and packetized, and one pack is composed of several packets. Pack-start-code and SCR (System Clock Reference) are described in the head part of each pack, and Stream ID and time stamp are described in the head part of the packet. The time stamp describes time information for synchronizing audio, video, etc., and there are two types of DTS (Decoding Time Stamp) and PTS (Presentation Time Stamp). PCR (Program Clock Reference) is described with a time accuracy of 27 MHz and is information for locking the reference clock of the decoder. DTS indicates the decoding start time of the first access unit (1 picture for video, 1152 samples for audio) in the packet data, and PTS indicates the display (playback) start time.

  As shown in FIG. 14, the audio, video, and other decoders are configured to constantly monitor a common reference clock locked by PCR and to perform decoding and display when the time matches with the time of DTS or PTS. . Multiplexed data is buffered by each decoder, and a virtual decoder for performing synchronized display is called STD (System Target Decoder), and this STD is multiplexed so as not to cause overflow or underflow. There must be.

  The MPEG system is roughly divided into TS (Transport Stream) and PS (Program Stream). These are composed of packets including PES (Packetized Elementary Stream) and other necessary information. PES is defined as an intermediate stream for enabling conversion between both streams, and is a packet of a private stream or the like in addition to video and audio data encoded by MPEG.

  PS can multiplex video and audio of programs having a common reference time. The packet layer is called PES, and this structure is used in common with a TS described later as shown in FIG. In the PS STD model, the stream is switched by the Stream ID in the PES packet.

  TS can also multiplex video and audio of programs with a common reference time as well as PS, but TS can also multiplex multi-programs such as communications and broadcasts with different reference times It is said. The TS is composed of a fixed-length packet of 188 bytes in consideration of the case of ATM cell length and error correction coding, and is considered so that it can be used even in a system in which an error exists. Although the structure of the TS packet itself is not so complicated, since it is a multi-program stream, its operation is complicated. What is characteristic compared to PS is that, although the TS packet has a higher structure, it is shorter (usually) than the PES packet, and the PES packet is divided and transmitted on the TS packet.

  In the STD model of TS, the stream is switched by the PID (packet ID) in the TS packet. The structure of the TS packet is shown in FIG. The first header has an 8-bit SYNC byte, followed by an error instruction, a unit head instruction, and a priority instruction bit for discarding one bit at a time. Thereafter, an ID indicating the type of payload of this packet is described as PID. After that, scramble information (2 bits), information indicating whether the adaptation field is transmitted in the payload (2 bits), information indicating the continuity of the packet (4 bits) are respectively described, and finally, the element encoded data or the adaptation Describe the element data after the information. It is also possible to transmit invalid data.

  The TS of the MPEG system has a mechanism for indicating which PID is a packet related to information of the multiplexed program. This will be described with reference to FIG. First, the TS packet group is searched for PID = 0. It is an information packet called a PAT (Program Association Table), in which information PlD corresponding to the program number PR is described in a linked form. Next, when reading the packet of the PID corresponding to the target PR, there is an information packet called PMT (Program Map Table), in which the PID of the video packet of the program corresponding to the program number PR and The PID information of the audio packet is described. PAT and PMT are called PSI (Program Specific Infomation), and it is an information system that allows access (entry) to a channel of a target program.

<Post-recording equipment>
Next, a preferred embodiment of the present invention will be described. First, an example of an after-recording apparatus that generates after-recording data to be played back by the after-recording signal playback apparatus of the present invention will be described with reference to FIG. A user interface (User I / F) 109 can select whether to record main data or after-recording audio data, and the instruction signal is transmitted from the CPU 110 to the signal switch 105. First, a case where main data is generated and recorded on the recording medium 108 will be described. Video data and audio data are respectively input to the video encoder 101a and the audio encoder 101b, and the MPEG encoding already described is performed. The encoded data is transmitted to the PES packetizers 102a and 102b for each element in order to perform MPEG system multiplexing. The PES packetizers 102a and 102b packetize video and audio element data, respectively.

  In each PES packet, time stamp data such as the above-described PCR, PTS, DTS, etc. is recorded in the time stamp recorders 103a and 103b. The time stamp is created using 27 MHz clock information. Next, element data of each PES packet is multiplexed in a format such as PS multiplexing or TS multiplexing as shown in FIG. The multiplexed data is input to the signal switch 105.

  Here, in order to record the main data, the signal switch 105 selects the data from the multiplexer 104 and temporarily records it in the buffer 106a. The buffered data is recorded on the recording medium 108 by the recording controller 107. The main data is recorded with the file name PR0.dat shown in FIG. 2 according to the information format described later.

  Next, a case where after-recording audio data is generated and recorded on the recording medium 108 will be described. In this case, recording of the after-recording audio data is selected in the user interface 109, the instruction signal is transmitted from the CPU 110 to the signal switch 105, and the after-recording data identification information is transmitted to the PES packetizer 102b. After-recording audio data is input to the audio encoder 101b, and MPEG encoding is performed in the same manner. The encoded after-recording audio data is transmitted to the PES packetizer 102b in order to add the time stamp of the MPEG system.

  The PES packetizer 102b adds the identification information to the after-recording audio element data and packetizes it. In the post-recording audio PES packet, the time stamp recorder 103b records time stamp data such as PCR, PTS, and DTS. The time stamp is created using 27 MHz clock information. Next, the post-recording audio PES packet in which the identification information and the time stamp are recorded is transmitted to the signal switch 105 without passing through the multiplexer 104. Since the after-recording audio data is recorded in the signal switcher 105, the data from the time stamp recorder 103b is selected and recorded in the buffer 106b. The buffered data is recorded on the recording medium 108 by the recording controller 107.

<Format and recording medium>
The post-recording audio data is recorded as information called a playlist according to an information format described later. If the file name is the first post-record data, it is recorded as the file name AF-1.dat in the PLO folder shown in FIG. For the Mth after-recording audio data, the file name is AF-m.dat. As shown in FIG. 8, since AF_number that can be described as data for after-recording is 8 bits (0 is not used), up to 254 independent after-recording audio data can be recorded.

  Next, the format of information recorded on the recording medium 108 will be described with reference to FIGS. The information to be recorded is audio or video side information data. As shown in FIG. 2, a folder named LIB is created under ROOT as shown in FIG. 2, and side information is recorded under the file name SIDE.ifo relating to a plurality of programs. The format of SIDE.ifo has a hierarchical structure as shown in FIG. TOTAL_MANAGER_IFO is defined at the top, and GENERAL_IFO and CNTNT_IFO are among them. GENERAL_IFO describes parameters related to the entire information group. The details of GENERAL_IFO have a SYNTAX structure as shown in FIG.

  The contents of the next CNTNT_IFO describe PR_IFO_0 to PL_IFO_n as information for each of a plurality of programs. Details are as shown in FIG. When post-record editing is performed, playlist information called PLAYL_IFO is described. This is the post-record audio data AF-1.dat to AF-m. In the PLn shown in FIG. 2 when the audio video multiplexed stream PRn.dat in the folder PR shown in FIG. List information for linking dat stream files.

  The user can register m types of post-recording audio data from 1 to m in the audio video multiplexed stream PRn.dat in the folder PR shown in FIG. When m is 0, the original sound is used without using the after-recording audio. When a number from 1 to m is instructed, playback or transmission is performed using post-record audio audio. Details of the structure of PLAYL_IFO are as shown in FIG. In the lower hierarchy, there is a structure INDEX_IFO that allows a part of the program to be registered as an index. The format of this structure is as shown in FIG. The syntax of INDEX_ is as shown in FIG.

<Reproducing device>
Next, a reproducing apparatus to which one embodiment of the after-recording signal reproducing apparatus of the present invention is applied will be described with reference to FIG. Here, the CPU 121 receives from the user interface (User I / F) 120 an instruction for reproducing normal main data or dubbing audio data, and when identification information is inputted, the input is performed. The corresponding instruction signal is output to the signal switch 114 and the identification information is output to the identification information detector 123. First, a case where normal main data is reproduced will be described. The multiplexed stream data of the main data recorded on the recording medium 108 is read by the reading controller 111 and recorded in the buffer 112a. The data input to the buffer 112 a is separated by the separator 113 for each element, and the video signal is transmitted to the time stamp detector 115 a and the audio signal is transmitted to the signal switch 114.

  Since the signal switch 114 reproduces the main data, the audio signal from the separator 113 is selected and transmitted to the time stamp detector 115b. Each of the time stamp detectors 115a and 115b detects time stamp data such as the above-described PCR, PTS, and DTS, and the detected time stamp related information is transmitted to the time stamp comparator 124.

  Next, the video and audio PES packets are released by the PES packet releasers 116a and 116b, respectively, and the video data is transmitted to the video decoder 117a and the audio data is transmitted to the audio decoder 117b. The video decoder 117a temporarily stores the decoded video data in the memory 118a, and the audio decoder 117b temporarily stores the audio data in the memory 118b.

  At this time, the time stamp comparator 124 synchronizes the system clock from the detected PCR information to generate master clock information, and compares the DTS decoding timing information with the system clock. By transmitting a decoding start signal to the decoder 117a, the video corresponding to the packet in which the time stamp data is described is decoded at that timing. As for PTS, the display timing information for both audio and video is compared with the system clock, and when they match, the video data is output to the display monitor 119a and the audio data is output to the speaker 119b at that timing. In the time stamp comparator 124, the PLL is locked by a PCR signal as a reference clock, and the reference signal is generated using a 27 MHz clock.

  Next, a case where an after-recording audio signal is reproduced will be described. The after-recording audio signal is reproduced by replacing the audio signal portion of the main data with the after-recording audio signal while reproducing the video signal of the main data. First, the user interface 120 inputs what number of the post-recording audio is replaced with what number of the main data. PR_number in PLAYL_INFO () of the information format shown in FIG. 8 corresponds to the main data number, and AF_number corresponds to the post-recording audio data number. In response to an instruction signal from the CPU 121, the identification information detector 123 reads the PR_number and AF_number from the data structure shown in FIG. 8 of the information format, and sends an instruction signal for reading the corresponding file name data to the reading controller 111. put out. The CPU 121 also issues an after-recording selection signal to the signal switch 114.

  As a result, the main data file in which the video and audio recorded on the recording medium 108 are multiplexed and the after-recording audio data file are read in a burst manner by the reading controller 111, and each element is read. Data is temporarily stored in the buffer 112a and the buffer 112b. The after-recording audio data stored in the buffer 112b is transmitted to the signal switch 114. On the other hand, the data input to the buffer 112 a separates the data multiplexed by the separator 113 for each element, and the video signal is transmitted to the time stamp detector 115 a and the audio signal is transmitted to the signal switch 114. Since the signal switch 114 reproduces the post-record data, the signal from the buffer 112b is selected and transmitted to the time stamp detector 115b. Since the operations after the time stamp detectors 115a and 115b are the same as those in the main data reproduction, the description thereof is omitted.

<Transmission equipment>
Next, a transmission apparatus that transmits main data and post-recording audio data will be described with reference to FIG. First, a case where normal main data is transmitted will be described. The multiplexed stream data of the main data recorded on the recording medium 108 is recorded in the buffer 112a by the reading controller 111. The data input to the buffer 112a is transmitted to the element switch 125. At this time, when the main data is transmitted from the user interface 120 and the instruction signal indicating that the main data is transmitted from the element switch 125 is transmitted from the CPU 121, the element switch 125 receives from the buffer 112a. The signal is transmitted to the transmission line via the buffer 126 as it is.

  Next, a case where an after-recording audio signal is transmitted will be described. The post-recording audio signal is transmitted by replacing the audio signal portion of the main data with the after-recording audio signal based on the video signal of the main data. First, the user interface 120 inputs what number of post-recording audio is replaced with what number of main data. PR_number in PLAYL_INFO () of the information format shown in FIG. 8 corresponds to the number of main data, and AF_number corresponds to the number of post-recording audio data. In response to an instruction signal from the CPU 121, the identification information detector 123 reads the PR_number and AF_number from the data structure shown in FIG. 8 of the information format, and issues an instruction signal for reading the corresponding file name data to the reading controller 11. .

  As a result, the main data file in which the video and audio recorded on the recording medium 108 are multiplexed and the after-recording audio data file are read in a burst manner by the reading controller 111, and each element is read. Data is temporarily stored in the buffer 112a and the buffer 112b. The after-recording audio data stored in the buffer 112b is transmitted to the signal switch 114, while the data input to the buffer 112a is transmitted to the element switch 125.

  At this time, transmission of post-recording audio data is input from the user interface 120, and an instruction signal indicating transmission of post-recording audio data from the CPU to the signal switch 114 and the element switch 125 is transmitted. Since the switch 125 transmits the after-recording audio data, the audio part of the multiplexed data of the main data is replaced with the audio part of the after-recording audio data input from the signal switch 114, and is transmitted to the transmission path via the buffer 126. . Time stamps such as PCR, DTS, and PTS need not be changed at all. However, the CRC code adopted in the MPEG multiplexing standard is recalculated and changed to a new value in accordance with the packet part in which the after-recording audio data is replaced.

  In this embodiment, when creating the main data, the data of the after-record data type is created in advance in the element data, and the transfer rate of the after-record data is the same element as the type of the after-record data included in the main data. Although it is assumed that the data is the same as the data, element data having the same transfer rate as the expected after-recording data may be multiplexed in advance with dummy data when the main data is created.

  In addition, when the element data having the same transfer rate as the expected after-recording data is multiplexed in advance with dummy data, or when element data that is not dummy is recorded at the time of main data creation, the element switcher 125 in FIG. The time stamps of PCR, DTS, PTS, etc. need not be changed at all. However, if dummy data is not recorded or if the transfer rate of post-recording data is different, the element switch 125 substantially remultiplexes. It is necessary to re-add time stamps such as new PCR, DTS, and PTS. However, even in that case, the effects of the present invention are sufficiently exhibited.

  As described above, at least audio and video signals are compressed and encoded, and a time stamp for synchronous reproduction is recorded in a predetermined unit of each encoded data, and each is multiplexed with main data to be recorded by multiplexing. Since at least one kind of element data is recorded without multiplexing one or more after-recording compressed data, a format for easily recording after-recording data can be realized, and many kinds of after-recording data can be recorded. be able to.

  Also, at least audio and video signals are compressed and encoded, and data in which a time stamp for synchronous reproduction is recorded in a predetermined unit of each encoded data is multiplexed with the main data recorded and multiplexed. Since at least one or a plurality of types of elemental data is recorded and read after-recorded in a time-division manner, the post-record data recorded in a state where the compressed data for post-recording is not multiplexed is recorded. The post-record data can be reproduced easily without being re-multiplexed.

  Further, at least audio and video signals are compression-encoded, and data in which a time stamp for synchronous reproduction is recorded in a predetermined unit of each encoded data is multiplexed with the main data recorded and multiplexed. For at least one or a plurality of types of component data, the post-record data recorded without being multiplexed is read in a time-sharing manner, and the component data of the main data is recorded after being multiplexed And the data for after-recording are exchanged and transmitted, so that the data that is completely compliant with the MPEG multiplexing standard can be transmitted in the transmitted data, and an MPEG compatible player that exists at an external transmission destination, Transmission data reflecting the post-recording data of the present invention can be reproduced.

  In addition, in all cases, with this configuration, even after the recording is selected, recorded, reproduced and transmitted, the system can be restored again, and the user can enjoy the after-recording data selectively after recording a plurality of after-recording sounds. Can provide.

  Furthermore, the function of the above-described after-recording apparatus may be realized by a computer by a program, and the function of the above-described playback apparatus may be realized by a computer by a program. These programs may be read from a recording medium and loaded into a computer, or may be transmitted via a communication network and loaded into a computer.

It is a block diagram which shows an example of the after-recording apparatus which produces | generates the data for after-recording reproduced | regenerated with the after-recording signal reproduction | regeneration apparatus based on this invention. It is explanatory drawing which shows the example of a format of the file structure of library information. It is explanatory drawing which shows the example of a format of PROGRAM in library information. It is explanatory drawing which shows the example of a format of INDEX in library information. It is explanatory drawing which shows the format of TS stream on a hard disk. It is explanatory drawing which shows the GENERAL_IFO table of the side information used for one Example of this invention. It is explanatory drawing which shows the PROGRAM_IFO table of the side information used for one Example of this invention. It is explanatory drawing which shows the PLAYL_IFO table of the side information used for one Example of this invention. It is explanatory drawing which shows the INDEX_IFO table of the side information used for one Example of this invention. It is a block diagram which shows the reproducing | regenerating apparatus to which one Example of the after-recording signal reproducing | regenerating apparatus of this invention is applied. It is a block diagram which shows an example of the transmission apparatus which transmits main data and after-recording audio data. It is a block diagram which shows an MPEG encoder. It is a block diagram which shows an MPEG decoder. 1 is a block diagram showing an MPEG multiplexing system. FIG. It is explanatory drawing which shows the relationship of MPEG TS, PS, and PES. It is explanatory drawing which shows the usage example of PSI of MPEG TS.

Explanation of symbols

101a Video encoder 101b Audio encoder 102a, 102b PES packetizer 103a, 103b Time stamp recorder 104 Multiplexer 105, 114 Signal switcher 108 Recording medium 109, 120 User interface 123 Identification information detector 124 Time stamp Comparator

Claims (1)

The compression-encoded data of two signals of the audio signal and the video signal constituting the main data are multiplexed by adding a time stamp for synchronous reproduction of the audio signal and the video signal to each predetermined unit. An input means for receiving a stream of main data;
Means for selecting and designating one of a plurality of post-recording compression-coded audio data for the audio signal constituting the main data;
The plurality of after-recording compressed and encoded audio data are added with a time stamp for synchronous reproduction with the main data and identification information for identifying the individual after-recording compressed and encoded audio data, and multiplexed with the main data. An input means for selecting and inputting a post-record data stream including the selected post-record compressed audio data from the post-record data stream that has been streamed without being converted based on the identification information;
The main data is read out from the main data stream, and the one selected after-recording compressed encoded audio data is read out from the selected after-recording data stream, and the selected after-recording compressed code is read out. Replacing the encoded audio data with the audio signal in the main data for the post-recording compressed encoded audio data, and a time stamp read from the main data stream and a time stamp read from the selected post-record data stream And means for synchronously playing back the video signal of the main data and the selected and designated after-recording compression-encoded audio data;
An after-recording signal reproducing apparatus comprising:

Images