JPH11355719A - Recording and reproducing device, recording and reproducing method and served medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an output of an excellent audio signal synchronously with an image even when compressed video data are used and reproduced at a high speed. SOLUTION: A multiplex processing section 14 multiplexes a packet of audio data with a presentation time stamp PTS equivalent to a time between a PTS of an I picture and a PTS of a succeeding picture so that the packet is inserted between packets of the I picture. A demultiplexer processing section 19 demultiplexes the audio data with the PTS equivalent to a time between a PTS of an I picture and a PTS of a succeeding picture and read from a disk drive 16 and provides an output of the audio data to an audio signal expansion processing section 21.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a recording / reproducing apparatus, a recording / reproducing method, and a providing medium, and more particularly, to a high-quality audio corresponding to an image even when high-speed reproduction is performed using compressed image data and audio data. The present invention relates to a recording / reproducing apparatus, a recording / reproducing method, and a providing medium capable of outputting a signal.

[0002]

2. Description of the Related Art MPEG (Moving Picture Experts Group) video data is compressed using inter-picture prediction using motion vectors. Specifically, a P picture (Predi
ctive-Picture) is predicted using a motion vector for the previous image, and a B picture (Bidirectionally Predic
tive-Picture) is predicted using motion vectors for the previous and next images. In order to perform inter-picture prediction using a motion vector for the preceding and succeeding pictures, the position of the B picture in the MPEG video data stream is different from the position of the picture before being compressed as MPEG video data. Therefore, a certain delay time is required for recording and reproducing MPEG video data using a B picture.

On the other hand, MPEG audio data has a smaller data amount per time than MPEG video data, and decompression processing requires almost no delay time. For this reason, when an image signal and an audio signal in which an image and audio are synchronized are recorded on a recording medium using MPEG video and MPEG audio, image and audio data at different times are recorded adjacently.

[0004] When performing an image search associated with video editing or the like, a user causes a recording / reproducing apparatus to perform a high-speed reproduction operation at a speed several times higher than a normal video reproduction speed. At this time,
A recording / reproducing apparatus that uses MPEG video data performs high-speed reproduction using only I-pictures, or performs high-speed reproduction using I-pictures and P-pictures that follow the I-pictures.

[0005]

When high-speed reproduction is performed by a recording / reproducing apparatus using MPEG video data, even if audio is reproduced using audio data recorded in the vicinity of an I picture, it is possible to cope with an image. Not necessarily. Further, even if audio corresponds to an image, temporally continuous audio is not always obtained. For this reason, a recording / reproducing apparatus using MPEG video data generally mutes audio during high-speed reproduction.

SUMMARY OF THE INVENTION The present invention has been made in view of such circumstances, and has as its object to output good audio corresponding to an image even when high-speed reproduction is performed using compressed video data. .

[0007]

According to a first aspect of the present invention, there is provided a recording / reproducing apparatus which multiplexes audio data packets corresponding to image data between packets of image data encoded without referring to another image. And a multiplexing unit for separating the image data packet and the audio data packet multiplexed therebetween during high-speed reproduction.

A multiplexing step of multiplexing a packet of audio data corresponding to image data between packets of image data coded without referring to another image, according to a second aspect of the present invention. In high-speed reproduction, a separation step of separating and reproducing a packet of image data and a packet of audio data multiplexed therebetween is provided.

According to a third aspect of the present invention, there is provided the recording medium, wherein the recording / reproducing apparatus multiplexes the audio data packet corresponding to the image data between the image data packets encoded without referring to another image. A computer readable program including a multiplexing step and a separating step of separating and reproducing a packet of image data and a packet of audio data multiplexed therebetween during high-speed reproduction. And

According to a fourth aspect of the present invention, during a packet of data of a first image coded without referring to another image, the recording / reproducing apparatus does not refer to another image from the first image. Multiplexing means for multiplexing audio data packets during a period up to the next encoded second image, and a packet of an image encoded without referring to another image during high-speed playback; Separating means for separating and reproducing packets of multiplexed audio data.

According to a fifth aspect of the present invention, during a packet of data of a first image encoded without referring to another image, the first image does not refer to another image. A multiplexing step of multiplexing a packet of audio data up to the next encoded second image, and a packet of an image encoded without referring to another image during high-speed playback; Separating a multiplexed audio data packet and reproducing the multiplexed audio data packet.

According to a sixth aspect of the present invention, in the recording medium according to the first aspect of the present invention, the first image is transferred from the first image to another image during a packet of the first image data encoded without referring to the other image. A multiplexing step of multiplexing audio data packets in a period up to the next second image coded without referring to the first image, and a packet of an image coded without referring to another image during high-speed playback And a separating step of separating and playing back packets of audio data multiplexed therebetween, thereby providing a computer-readable program.

According to a seventh aspect of the present invention, there is provided a recording / reproducing apparatus comprising: first audio data generating means for generating first audio data used for normal reproduction from an audio signal; and a second audio data generating means for generating high-speed reproduction from the audio signal. A second audio data creating unit for creating the second audio data, and referring to another image from the first image during a packet of data of the first image encoded without referring to the other image. Multiplexing means for multiplexing the packets of the second audio data in the period up to the next second image which has been encoded, and at the time of high-speed reproduction, between the packets of the data of the first image. Separating means for separating the multiplexed second audio data packet, and reproducing the audio signal from the second audio data packet separated by the separating means during high-speed reproduction Characterized in that it comprises an audio signal reproduction means that.

According to a ninth aspect of the present invention, there is provided a recording / reproducing method, wherein a first audio data producing step for producing first audio data used for normal reproduction from an audio signal, and a second audio data producing step for producing high-speed reproduction from the audio signal. A second audio data creating step of creating the second audio data, and a first audio data encoded without referring to another image.
Multiplexing packets of the second audio data in a period from the first image to the next second image encoded without referring to another image between the packets of the image data of A step of separating a packet of multiplexed second audio data between packets of data of the first image at the time of high-speed playback; and a step of separating the packet at the time of fast playback. An audio signal reproducing step of reproducing an audio signal from the audio data packet.

[0015] The recording and reproducing apparatus according to claim 1, and claim 2.
In the recording / reproducing method according to the item (3) and the providing medium according to the item (3), packets of audio data corresponding to the image data are multiplexed between packets of the image data used at the time of high-speed reproduction, and Separate and play audio data.

A recording / reproducing apparatus according to claim 4, and claim 5
In the recording / reproducing method described in the item (1) and the providing medium described in the item (6), between the packet of the image data used at the time of high-speed reproduction, the period of the image data and the period of the image data used at the next high-speed reproduction The audio data packets are multiplexed, and the audio data is separated and reproduced at the time of high-speed reproduction.

In the recording / reproducing apparatus according to the seventh aspect and the providing medium according to the ninth aspect, audio data to be used at the time of high-speed reproduction is created, and the audio data is interposed between packets of image data to be used at the time of high-speed reproduction. A packet of audio data used at the time of high-speed reproduction corresponding to the period of the image data and the image data used at the next high-speed reproduction is multiplexed, and the audio data used at the high-speed reproduction is separated and reproduced at the time of high-speed reproduction.

[0018]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below. In order to clarify the correspondence between each means of the invention described in the claims and the following embodiments, each means is described. When the features of the present invention are described by adding the corresponding embodiment (however, an example) in parentheses after the parentheses, the result is as follows. However, of course, this description does not mean that each means is limited to those described.

That is, the recording / reproducing apparatus according to claim 1 multiplexes audio data packets corresponding to image data between image data packets encoded without referring to another image. Means (for example, the multiplexing processing unit 14 in FIG. 1) and a separating means (for example, in FIG. 1) for separating and reproducing the image data packet and the audio data packet multiplexed therebetween during high-speed reproduction.
And a separation processing unit 19).

According to a fourth aspect of the present invention, during a packet of data of a first image coded without referring to another image, the first image does not refer to another image. Multiplexing means (for example, multiplexing means) for multiplexing packets of audio data up to the next encoded second image;
A multiplexing processing unit 14) shown in FIG. 1 and a separation unit that separates and reproduces a packet of an image encoded without referring to another image and a packet of audio data multiplexed therebetween during high-speed reproduction. (For example, the separation processing unit 1 in FIG. 1
9).

According to a seventh aspect of the present invention, there is provided a recording / reproducing apparatus comprising: a first audio data generating means for generating first audio data used for normal reproduction from an audio signal (for example, the audio signal compression processing unit 13 shown in FIG. 9); -1), a second audio data generating unit (for example, the audio signal compression processing unit 13-2 in FIG. 9) for generating second audio data used for high-speed reproduction from the audio signal, and During a packet of data of a first image encoded without reference, a second audio during a period from the first image to the next second image encoded without reference to another image A multiplexing means for multiplexing data packets (for example, the multiplexing processing unit 14 in FIG. 9) and
A separating unit (for example, the separating unit 19 in FIG. 9) for separating the multiplexed second audio data packet between the first image data packets,
An audio signal reproducing unit (for example, an audio signal decompression processing unit 21-2 in FIG. 9) that reproduces an audio signal from the second audio data packet separated by the separating unit is provided.

FIG. 1 is a block diagram showing the configuration of an embodiment of a recording / reproducing apparatus according to the present invention. The recording / reproducing apparatus 1 is connected to an external antenna 2 so that a signal received by the antenna 2 is supplied. The recording / reproducing apparatus 1 is configured so that an infrared signal based on a user operation is supplied from the remote commander 3. The video signal of the recording / reproducing apparatus 1 is supplied to a monitor 4. The audio signal of the recording / reproducing device 1 is supplied to a speaker 5.

The signal supplied from the antenna 2 is supplied to a tuner 11. The tuner 11 selects a predetermined channel based on a signal from the system controller 27 and outputs a video signal and an audio signal. The video signal compression processing unit 12 includes a system controller 27
After performing analog processing such as sync separation and chroma decoding on the video signal input from the tuner 11 based on the signal from the tuner 11, the video signal is A / D (Analog / Digital) converted, and further MPEG
It performs video band compression processing and outputs compressed image digital data. The audio signal compression processing unit 13 filters the audio signal input from the tuner 11 based on a signal from the system controller 27,
Performs band compression processing such as EG audio and outputs compressed audio digital data.

The multiplexing processing unit 14 is based on a signal from the system controller 27, and
The compressed image digital data output from the audio signal compression unit 13 and the compressed audio digital data output from the audio signal compression processing unit 13 are put into packets each having a variable byte length, and a packet multiplexing process is performed.

The recording buffer 15 temporarily stores the packet input from the multiplex processing unit 14 and outputs the packet to the disk drive 16 so that the packet necessary for the write operation of the disk drive 16 is not interrupted.

The disk drive 16 performs error correction and modulation on the packet input from the recording buffer 15 based on a signal from the system controller 27, and records the packet on predetermined tracks and sectors of the mounted disk. The disk drive 16 records information and control data stored in the information memory 17 on predetermined tracks and sectors of a mounted disk (not shown).

When a disk is loaded, the disk drive 16 reads out various control data stored in predetermined tracks and sectors of the loaded disk based on a signal from the system controller 27, and performs error correction and the like. The signal is demodulated and output to the information memory 17. The information memory 17 supplies information and control data relating to the disk mounted on the disk drive 16 to the system controller 27. When recording on a disk mounted on the disk drive 16, the system controller 2
7 changes the information and control data stored in the information memory 17 as needed.

Further, the disk drive 16 reads a signal from a predetermined track and sector of the mounted disk based on a signal from the system controller 27, performs error correction and demodulation, and outputs predetermined data to the reproduction buffer 18. I do. The reproduction buffer 18 temporarily stores the packet input from the disk drive 16 and outputs the packet to the separation processing unit 19 so that the packet required for the operation of the separation processing unit 19 is not interrupted.

The separation processing section 19 separates a packet output from the reproduction buffer 18 into a packet containing video data and a packet containing audio data based on a signal from the system controller 27. Separation processing unit 19
Outputs video data extracted from the packet to the video signal decompression processor 20 and outputs audio data to the audio signal decompression processor 21.

The video signal expansion processor 20 performs MPEG video band expansion processing on the input video data,
It performs D / A (Digital / Analog) conversion, performs analog processing such as chroma encoding and synchronization addition, and outputs the video signal. The audio signal expansion processing unit 21 performs D / A conversion after performing band expansion processing such as MPEG audio, performs analog processing such as filtering, and outputs the audio signal.

The light receiving section 24 receives a signal from the remote commander 3
An infrared signal based on a user's operation is received, and an electric signal corresponding to the signal is supplied to the control signal input unit 22. When the user operates the remote commander 3 or the key panel 25, the control signal input unit 22 outputs a signal corresponding to the operation to the system controller 27. Data indicating the operation state of the recording / reproducing apparatus 1 output from the system controller 27 to the display output unit 23 or data relating to the disk mounted on the disk drive 16 is displayed on the LCD 26.

FIG. 2 is a diagram showing the structure of MPEG video data. The encoded MPEG video data has a hierarchical structure, in order from the upper layer, a sequence (Sequence) layer,
GOP layer, Picture layer, Slice layer, Macro Block layer, and Block
Consists of layers. Each layer from the sequence layer to the slice layer is provided with a unique 32-bit start code, which distinguishes each layer and serves as an error recovery point.

Generally, the bit stream 41 of the sequence layer is coded data of one entire video program, and the bit stream 41 is composed of one or more GOPs.
Consists of The GOP 42 indicates a set of one or more images. The GOP 42 includes an independently coded I picture 43
Are arranged as the first encoded image, and thereafter, a predetermined number of B pictures 44 and P pictures 45 are arranged. Therefore, the GOP 42 can be used as a point for performing random access of MPEG data. For example,
When the GOP 42 includes 10 pictures, a random access point (I picture) exists every 0.33 seconds in a video of 30 frames per second.

The picture 46 corresponds to each screen and is divided into one or more slices. The slice 47 corresponds to a horizontally long band-like area in the screen. The macro block 48 is
It is composed of a predetermined number of luminance blocks and a predetermined number of color difference blocks spatially corresponding to the luminance blocks. Block 49 stores DCT (Discrete Cosine Transform) encoded data. The block 49 is composed of 8 pixels × 8 lines of a luminance signal or a color difference signal, and includes DCT and IDC.
T (Inverse Discrete Cosine Transform) is performed in this unit.

FIG. 3 is a diagram for explaining the multiplexing of video data and audio data at the time of recording. Tuner 1
The video signal 51 composed of the images V1 to V9 (V1 to V9 each represent a video frame) output from the video signal compression unit 1 is output from the video signal compression processing unit 12 to a PTS (Presentation Time Stamp), which is information on the time at which the image is output. ) Is added, the order of the images is changed, and the image is converted to the MPEG video data stream 52. When the image V3 of the video signal 51 is converted into the I picture I3 in the MPEG video data stream 52, the image V1 located before the image V3 of the video signal 51
And V2 are within the MPEG video data stream 52:
B pictures B1 and B2 are arranged behind I picture I3. Images (for example, images V3, V6, and V9 in FIG. 3) that are converted into I-pictures and P-pictures do not change their positions even in the MPEG video data stream. B
Images to be converted to pictures (for example, images V1 and V
2, V4, V5, V7, and V8) are arranged in the MPEG video data stream 52 after the next image to be converted to an I-picture or a P-picture.

On the other hand, the audio signal output from the tuner 11 is added with PTS, which is information on the time at which audio is output, by the audio signal compression processing unit 13 and is added to the MPEG audio data stream 53 composed of audio frames A1 to A30. Is converted. In the compression of the audio signal, the exchange of the audio frames is not performed.

MPEG video data stream 52 and MP
The EG audio data stream 53 is transmitted to the multiplex processing unit 1
4, the packets are divided into packets of a predetermined size, and each packet is arranged in a predetermined number of ratios and converted into a multiplexed data stream 54. MPEG video data stream 52 and MPEG audio data stream 5
3 are multiplexed without causing overflow or underflow in the respective decoding buffers in the video signal decompression processing unit 20 and the audio signal decompression processing unit 21 during reproduction based on the rules of the MPEG system. The SCR (System C) recorded in the data stream 54
The Lock Reference) is placed in the multiplexed data stream 54 so that the PTS does not delay by more than one second.

Furthermore, a packet corresponding to an audio frame of the MPEG audio data stream 53 having a PTS corresponding to a time between the PTS of the I picture and the PTS of the next picture is a packet of a plurality of video packets constituting the I picture. Placed between. For example, the time stamp PTS-
Video packet 57 corresponding to I picture I3 having V3
-1 to 57-n, the time stamps PTS-A8 to PT
Packets 59-1 to 59-3 corresponding to audio frames A8 to A10 each having S-A10 are arranged.

FIG. 4 is a flowchart for explaining the multiplexing operation of the multiplexing processing section 14 at the time of recording. In step S11, the multiplex processing unit 14 determines whether or not a video packet has been generated from the MPEG video data stream 52. If it is determined that no video packet has been generated, the process returns to step S11, and the Wait for it to be generated. If it is determined in step S11 that a video packet has been generated, step S1
Then, the multiplex processing unit 14 does not overflow or underflow the respective decoding buffers in the video signal decompression processing unit 20 and the audio signal decompression processing unit 21 during reproduction, and It is determined whether or not there is an audio packet generated by the audio signal compression processing unit 13 from the MPEG audio data stream 53 which satisfies the MPEG system rule that the PTS does not delay the recorded SCR by more than one second. .

If it is determined in step S12 that there is an audio packet that satisfies the rules of the MPEG system, the process proceeds to step S13, where the multiplex processing unit 14 determines that the generated video packet is the first video packet of the I picture. It is determined whether or not. If it is determined in step S13 that the generated video packet is not the first video packet of the I picture, step S1
Proceeding to 4, the multiplexing processing unit 14 determines whether or not the generated video packet is an I-picture packet.
In step S14, the generated video packet is
If it is determined that the video packet is an I picture,
Proceeding to step S15, the multiplex processing unit 14 determines whether there is an audio packet having a PTS between the PTS of the I picture and the PTS of the next picture.

In step S15, the PTS of the I picture
If it is determined that there is no audio packet having a PTS between the PTS of the next picture and the PTS of the next picture, the process proceeds to step S17, where the multiplexing processing unit 14 performs the video signal decompression processing unit 20 and the audio signal decompression processing during reproduction. An MP that does not cause the respective decoding buffers in the section 21 to overflow or underflow and that the PTS does not delay the SCR recorded in the multiplexed data stream 54 by one second or more.
It is determined whether or not there is an audio packet whose index value for keeping the EG rule is equal to or less than a predetermined threshold. Step S1
In step 7, when it is determined that there is no audio packet whose index value for keeping the MPEG rule is equal to or less than the predetermined threshold, the process proceeds to step S18, and the multiplex processing unit 14 outputs the generated video packet to the recording buffer. Then, the process returns to step S12 to continue the process.

If it is determined in step S14 that the generated video packet is not a video packet of an I picture, the process proceeds to step S15.
If it is determined that there is an audio packet having a PTS between the TS and the PTS of the next picture, and if there is an audio packet whose index value for complying with the MPEG rule is equal to or less than a predetermined threshold in step S17. If determined, the process proceeds to step S16, where the multiplex processing unit 14
An audio packet having a PTS between the PTS of the I picture and the PTS of the next picture is output to the recording buffer 15. Thereafter, the process returns to step S12.

If it is determined in step S12 that there is no audio packet that satisfies the rules of the MPEG system, and if it is determined in step S13 that the generated video packet is the first video packet of the I picture, Proceeding to S18, a video packet recording process is executed.

When the system controller 27 determines that the recording has ended, the system controller 27 requests the multiplexing processing section 14 to end the recording, and the multiplexing process for this recording ends.

By the above processing, the video frames constituting the I picture correspond to the audio frames of the MPEG audio data stream 53 having the PTS corresponding to the time from the PTS of the I picture to the PTS of the next picture. Multiplexed so that audio packets to be input are included.

FIG. 5 is a diagram for explaining the synchronization of an image and audio during high-speed reproduction. At the time of high-speed reproduction, the disk drive 16 reads a multiplexed data stream 61 composed of video packets of an I picture and audio packets sandwiched between the video packets. The separation processing unit 19 outputs the MPEG video data stream 62 reproduced from the video packet of the I picture to the video signal decompression processing unit 20. The video signal decompression processor 20 outputs a video signal 63 based on the MPEG video data stream 62.

The separation processing unit 19 includes the video packet
An MPEG audio data stream 64 reproduced from an audio packet having a PTS between the PTS of the I picture and the PTS of the next picture is output to the audio signal decompression processing unit 21. The audio signal decompression processing unit 21 outputs an audio signal synchronized with the video signal 63 based on the MPEG audio data stream 64.

FIG. 6 shows the separation processing section 19 at the time of high-speed reproduction.
5 is a flowchart for explaining the operation of FIG. Step S2
In 1, the separation processing unit 19 determines whether or not the input packet is a video packet. If it is determined that the input packet is a video packet, the process proceeds to step S22. In step S22, the separation processing unit 19 determines whether or not the picture included in the input video packet is an I picture. If it is determined that the picture is an I picture, the process proceeds to step S23. In step S23, the separation processing unit 19 writes the payload of the video packet into the buffer of the video signal decompression processing unit 20. Thereafter, the process returns to step S21. When it is determined in step S22 that the video packet is not an I-picture packet,
Step S23 is skipped, and step S21 is skipped.
Return to

If it is determined in step S21 that the packet is not a video packet (it is an audio packet), the procedure proceeds to step S24, where the separation processing unit 19
Determines whether the audio packet has a PTS corresponding to the time between the PTS of the I picture and the PTS of the next picture. The audio packet is the PTS of the I picture
If it is determined that there is a PTS corresponding to the time from to the PTS of the next picture, the process proceeds to step S25, and the separation processing unit 19 writes the audio packet payload into the buffer of the audio signal decompression processing unit 21. Thereafter, the process returns to step S21.

If it is determined in step S24 that the audio packet does not have a PTS corresponding to the time between the PTS of the I picture and the PTS of the next picture,
The procedure returns to step S21 and continues the processing.

When the system controller 27 requests the separation processing section 19 to end high-speed reproduction, the separation processing of the separation processing section 19 ends.

As described above, even in high-speed reproduction, an image and its corresponding audio are reproduced in synchronization.
When one I picture is reproduced and then the next I picture is reproduced, an audio packet corresponding to the previous I picture at an unnecessary timing is not used.

On the other hand, in step S15 of FIG.
It is also possible to determine whether there is an audio packet having a PTS between the PTS of the picture and the PTS of the next I picture. When the multiplexing processing unit 14 performs such processing, audio packets up to the next I picture are arranged in the portion where the video packet of the I picture is arranged in the multiplexed data stream 54 shown in FIG. .

FIG. 7 shows a reproducing operation in such an example. A predetermined time is required until the seek operation of the disk drive 16 is slow and a multiplexed data stream 72 including video packets including the next I picture I18 is read from a multiplexed data stream 71 including video packets including the I picture I3 from the disk. Is required,
While the signal of the image V3 corresponding to the I picture I3 is output from the video signal decompression processing unit 20 three times in succession, the audio signal decompression processing unit 21 outputs the MPEG audio data stream 79 including the audio frames A8 to A17. Outputs a continuous audio signal.

The multiplexed data stream 72 composed of video packets including the I picture I18 is transmitted to the disk drive 1
6, the video signal decompression processing unit 20 outputs
Output a video signal of image V18 corresponding to picture I18,
The audio signal decompression processor 21 outputs an audio signal corresponding to the MPEG audio data stream 80 including the audio frames A58 to A60.

As described above, the audio signal decompression processor 21
By utilizing the fact that the seek operation of the disk drive 16 is slow, an audio signal can be output continuously for a longer time than in the example of FIG. This makes it easier to recognize the reproduced audio.

After reproducing one more picture,
In the case of a device that can predict the interval (time) until the next I picture can be reproduced, in step S15 in FIG.
When it is determined that there is an audio packet having a PTS between the PTS of the picture and the PTS of the next I picture, in step S16, the audio having the PTS at regular intervals within the playback interval of the I picture Packets can be selected and recorded.

FIG. 8 shows a reproducing operation in the case of this example. That is, in the example of FIG. 7, continuous audio frames A8 to A17 are recorded and reproduced corresponding to the I picture I3, whereas in the example of FIG. A8, A13, A18, A23, A
28, A33, A38, A43, A48, and A53 are recorded and reproduced corresponding to the I picture I3. As described above, since the audio frame thinning ratio does not change, relatively natural audio can be reproduced.

FIG. 9 is a block diagram showing the configuration of another embodiment of the recording / reproducing apparatus according to the present invention. In FIG. 9, portions corresponding to those in FIG.
The description is omitted as appropriate. The tuner 11 is configured to output an audio signal to the audio signal compression processing units 13-1 and 13-2. Audio signal compression processing unit 13
-1 compresses the audio signal at the same compression rate as the audio signal compression processing unit 13 in FIG. 1 and outputs an MPEG audio data stream to the multiplexing processing unit 14. The audio signal compression processing unit 13-2 includes the audio signal compression processing unit 13
The audio compression processing is performed at a compression ratio higher than −1, and a low bit rate MPEG audio data stream is output to the multiplex processing unit 14. The multiplex processing unit 14 is configured to output the MPEG video data stream output from the video signal compression processing unit 12 and the MPEG audio data output from the audio signal compression processing units 13-1 and 13-2 based on the signal from the system controller 27. The streams are put into packets each having a fixed byte length, and a packet multiplexing process is performed.

The separation processing unit 19 converts a packet output from the reproduction buffer 18 into a packet containing video data, a packet containing ordinary audio data, or a low bit rate audio data based on a signal from the system controller 27. The video data stream extracted from the packet is output to the video signal decompression processing unit 20, the audio data stream of the normal bit rate is output to the audio signal decompression processing unit 21-1, and the low bit rate audio data stream is output. The data stream is output to the audio signal decompression processor 21-2. Output switching unit 8
5 is based on a signal from the system controller 27,
The audio output signal to be output to the outside is switched to the audio signal output from the audio signal expansion processing unit 21-1 or the audio signal output from the audio signal expansion processing unit 21-2.

FIG. 10 is a diagram for explaining the operation of the recording and reproducing apparatus 1 of FIG. Image V1 output from tuner 11
The video signal 91 composed of V18 to V18 is added with a PTS, which is information on the time at which an image is output, by the video signal compression processing unit 12, the order of the images is changed, and the video signal 91 is converted into an MPEG video data stream 92. The audio signal output from the tuner 11 is output to the audio signal compression processing unit 13-1.
A PTS, which is information on the time at which audio is output, is added, and an MPEG comprising audio frames A1 to A60
In addition to the audio data stream 94, the audio signal compression processing unit 13-2 adds a PTS, which is information on the time at which audio is output, to another low-rate MPEG audio data stream composed of audio frames A1 to A60. 95.

From the PTS-V3 of the I picture I3, the next I picture I1
PTS-A8 and PTS- corresponding to 8 PTS-V18 times, respectively
Audio packets corresponding to low-rate audio frames having a PTS up to A58 are multiplexed so as to be arranged between the video packets constituting the I picture I3. From PTS-V3 of I picture I3 to PTS of next I picture I18
Audio packets corresponding to the normal-rate audio frame having a PTS up to the PTS corresponding to the time of -V18 are multiplexed so as not to be arranged between video packets constituting the I picture I3.

In the high-speed reproduction, the audio signal decompression processor 21-2 multiplexes the audio packets corresponding to the low-rate audio frames multiplexed so as to be arranged between the video packets constituting the I picture I3. An audio signal is reproduced from the data and output, and the output switching unit 85
Supplies the signal output from the audio signal expansion processing unit 21-2 to the speaker 5. In normal reproduction, the audio signal decompression processor 21-1 outputs the MPEG audio data stream 9
An audio signal is reproduced from the data of the audio packet corresponding to No. 4 and output, and the output switching unit 85 supplies the speaker 5 with the signal output by the audio signal decompression processing unit 21-1.

At least the number of packets that can be read out per fixed time by the disk drive 16 is at least the number of audio packets included between the packets constituting the I picture, so that the reproduction per unit time is possible even in the high-speed reproduction. The number of images is not reduced, and the images and audio are reproduced in synchronization.

Note that as a providing medium for providing a user with a computer program for performing the above-described processing,
In addition to recording media such as magnetic disks, CD-ROMs, and solid-state memories, communication media such as networks and satellites can be used.

[0066]

According to the recording / reproducing apparatus according to the first aspect, the recording / reproducing method according to the second aspect, and the providing medium according to the third aspect, between the packets of the image data used at the time of high-speed reproduction. Since the audio data packet corresponding to the image data is multiplexed and the audio data is separated and reproduced at the time of high-speed reproduction, audio corresponding to the image can be output even at high-speed reproduction.

The recording / reproducing apparatus according to claim 4, and claim 5
According to the recording / reproducing method described in (1) and the providing medium described in (6), a period between the packet of the image data used in high-speed reproduction and the period of the image data used in the next high-speed reproduction is supported. Since the audio data packets to be reproduced are multiplexed, and the audio data is separated and reproduced at the time of high-speed reproduction, continuous audio corresponding to an image can be output even at high-speed reproduction even if the seek operation is slow.

According to the recording / reproducing apparatus according to the seventh aspect and the recording / reproducing method according to the ninth aspect, audio data to be used at the time of high-speed reproduction is created, and between the packets of image data to be used at the high-speed reproduction. Multiplexes the packet of audio data used in high-speed reproduction corresponding to the period of the image data and the image data used in next high-speed reproduction, and separates and reproduces the audio data used in high-speed reproduction during high-speed reproduction Thus, even if the data reading speed is low, the number of images that can be reproduced per unit time does not decrease, and the images and audio can be reproduced in synchronization.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an embodiment of a recording / reproducing apparatus according to the present invention.

FIG. 2 is a diagram showing a structure of an MPEG video data stream.

FIG. 3 is a diagram illustrating multiplexing of video data and audio data at the time of recording.

FIG. 4 is a flowchart illustrating the multiplexing operation of the multiplexing processing unit 14 during recording.

FIG. 5 is a diagram illustrating synchronization between an image and audio during high-speed playback.

FIG. 6 is a flowchart illustrating the operation of the separation processing unit 19 during high-speed playback.

FIG. 7 is a diagram illustrating another embodiment of the present invention.

FIG. 8 is a diagram illustrating still another embodiment of the present invention.

FIG. 9 is a block diagram showing a configuration of another embodiment of the recording / reproducing apparatus according to the present invention.

FIG. 10 is a diagram illustrating the operation of the recording / reproducing apparatus 1 of FIG.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 Recording / reproducing apparatus, 13-1, 13-2 Audio signal compression processing part, 14 Multiplexing processing part, 19 Separation processing part, 21, 21-1, 21-2 Audio signal decompression processing part

 ──────────────────────────────────────────────────の Continued on the front page (72) Inventor Koichi Nagatoku 6-7-35 Kita Shinagawa, Shinagawa-ku, Tokyo Inside Sony Corporation

Claims (9)

[Claims] 1. A recording / reproducing apparatus for compressing and recording a video signal and an audio signal and reproducing the compressed and decompressed video signal, wherein said image data is interposed between packets of image data encoded without referring to another image. Multiplexing means for multiplexing audio data packets corresponding to the following; and, at high speed reproduction, demultiplexing means for separating the image data packets and the audio data packets multiplexed therebetween to reproduce the audio data packets. A recording / reproducing device, comprising: 2. A recording / reproducing method for compressing and recording a video signal and an audio signal, and expanding and reproducing the video signal and the audio signal, wherein the image data is encoded between packets of image data encoded without referring to another image. A multiplexing step of multiplexing audio data packets corresponding to the following, and a high-speed reproduction separation step of separating the image data packets and the audio data packets multiplexed therebetween to reproduce the audio data packets. A recording / reproducing method comprising: 3. A recording / reproducing apparatus for compressing and recording a video signal and an audio signal and reproducing it by decompressing the video signal and the audio signal between packets of the encoded image data without referring to another image. A multiplexing step of multiplexing audio data packets corresponding to the following, and a high-speed reproduction separation step of separating the image data packets and the audio data packets multiplexed therebetween to reproduce the audio data packets. A providing medium for providing a computer-readable program including the program. 4. A recording / reproducing apparatus for compressing and recording a video signal and an audio signal and reproducing the same by decompressing the video signal and the audio signal, wherein a data packet of the first image encoded without referring to another image is used. Multiplexing means for multiplexing audio data packets during a period from the first image to a next second image coded without referring to another image; A recording / reproducing apparatus comprising: an image packet encoded without referring to an image; and a separating unit for separating and reproducing an audio data packet multiplexed therebetween. 5. A recording / reproducing method for compressing and recording a video signal and an audio signal and performing reproduction by decompressing the video signal and the audio signal, wherein a packet of data of the first image encoded without referring to another image is used. A multiplexing step of multiplexing audio data packets during a period from the first image to the next second image coded without referring to another image; A recording / reproducing method, comprising: a separating step of separating and reproducing a packet of an image encoded without referring to an image and a packet of audio data multiplexed therebetween. 6. A recording / reproducing apparatus which compresses and records a video signal and an audio signal and reproduces it by decompressing the video signal and the audio signal between packets of the data of the first image encoded without referring to another image. A multiplexing step of multiplexing audio data packets during a period from the first image to the next second image coded without referring to another image; A computer-readable program including a separating step of separating and playing back a packet of an image encoded without referring to an image and a packet of audio data multiplexed therebetween, and reproducing the same. Providing medium. 7. A recording / reproducing apparatus for compressing and recording a video signal and an audio signal and reproducing the same by decompressing the video signal and the audio signal, wherein first audio data for producing first audio data to be used for normal reproduction from the audio signal is provided. Data generating means; second audio data generating means for generating second audio data to be used for high-speed reproduction from the audio signal; and data of the first image data encoded without referring to another image. Multiplexing means for multiplexing packets of the second audio data during a period from a first image to a next second image encoded without referring to another image between packets; A separating unit for separating the multiplexed packet of the second audio data between the packets of the first image data during high-speed reproduction; Recording reproducing apparatus characterized by including an audio signal reproducing means for reproducing audio signals from the playback time, the separating means of the second audio data separated packet. 8. The apparatus according to claim 7, further comprising switching means for switching between the audio signal reproduced by the first audio signal reproducing means and the audio signal reproduced by the second audio signal reproducing means. The recording / reproducing apparatus as described in the above. 9. A recording / reproducing method for compressing and recording a video signal and an audio signal and performing reproduction by expanding the video signal and the audio signal, wherein a first audio data for producing first audio data used for normal reproduction from the audio signal is provided. A data creation step, a second audio data creation step of creating second audio data to be used for high-speed reproduction from the audio signal, and a first image data encoded without referring to another image. A multiplexing step of multiplexing packets of the second audio data between packets from the first picture to a next second picture encoded without reference to another picture; At the time of high-speed reproduction, the packet for separating the multiplexed second audio data packet is separated between the first image data packets. Steps and, during high-speed reproduction, a recording and reproducing method wherein the separation step is characterized in that it comprises an audio signal reproducing step of reproducing the audio signal from the packet of the second audio data separated.