JP2000324428A - Device and method for delayed reproduction, and storing medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize catch-up reproduction corresponding to the kind of watched broadcasting in a system for simultaneously recording and reproducing digital television broadcasting. SOLUTION: This device is provided with an information supplying means 1 for supplying multiplexed data information of video, voice and other data sent by digital signals, a recording/reproducing means 9 for recording and reproducing a bit stream continuously outputted from the means 1, a data control means 5 for executing the input control and the output control of data to be recorded in and reproduced from the means 9, an operation monitoring means 10 for monitoring the motion of the video (voice) part of data to be recorded in the means 9 and a frame number deciding means 6 for deciding the number of frames to be reproduced in a unit time from the means 9 based on the monitoring result of the means 10. In the case of interrupting viewing of broadcasting for an optional period, it is possible to catch up with rear broadcasting by reproducing faster than the real broadcasting from the interrupted part.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a delay reproduction apparatus, a delay reproduction method, and a storage medium, and more particularly, to a method of temporarily recording a series of data on a time axis and, after an arbitrary time elapses, at a higher speed than actual data. It is related to technology for reproducing and catching up with actual data. In particular, digital broadcast data (MP
EG2 transport stream), and is suitable for use in catching up with the actual broadcast by suspending the viewing of the broadcast for an arbitrary time and playing back at a higher speed than the actual broadcast from the interrupted point.

[0002]

2. Description of the Related Art FIG. 8 shows a conventional example of a method for recording a digital television broadcast. FIG. 8A shows that the digital broadcast signal received by the reception demodulator 1 is converted into an MPEG2 transport stream (hereinafter, referred to as TS), separated into each PES of the program selected by the classifier 2, and
The G demodulator 3 demodulates video, audio, and data into a signal corresponding to the display 4.

In general, recording is performed by converting the signal into an analog video signal or an audio signal and recording it on a magnetic tape using an analog video tape recorder 101 such as a VHS. For reproduction, the recorded analog video and audio signals are input to the display.

[0004] In FIG. 8 (b), the digital broadcast signal received by the receiving demodulator 1 is converted into a TS, and the discriminator 2 converts the digital broadcasting signal into a TS of only the program selected. The converted TS data is a method using a video tape recorder 102 capable of recording a TS such as D-VHS on a magnetic tape.

[0005] For reproduction, the recorded TS data is separated by a classifier 2
And the video, audio, and data are demodulated by the MPEG demodulator 3 into a signal corresponding to the display 4. In these methods, a broadcast is recorded at an arbitrary time, and the broadcast is rewound and played back after the recording is completed.

[0006] Magnetic tapes are suitable for storing large amounts of data, but are not suitable for random access. Magnetic tapes were primarily intended for sequential operation in nature.

Therefore, in order to perform the random operation, use of a semiconductor memory, a magnetic disk (HD), a magneto-optical disk (MO), an optical disk (DVD, CD) or the like can be considered. Further, as a realistic medium for realizing a large capacity, a disk type recording / reproducing apparatus such as HD, MO, DVD and the like is generally used.

[0008]

However, even if it can be said that random access can be performed at high speed, if recording and reproduction occur simultaneously, the head which is a data recording / reproducing unit moves, and actual recording / reproduction occurs. The time to perform is slow.

[0009] In fact, the data rate (bit rate) of digital broadcasting requires about 6 Mbps for normal broadcasting.
There has been a problem that the bit rate which must be realized by the recording / reproducing apparatus requires a higher value.

SUMMARY OF THE INVENTION In view of the above problems, it is an object of the present invention to realize a catch-up playback according to the type of broadcast being watched in a system for playing back while recording a digital television broadcast.

[0011]

According to the present invention, there is provided a delay reproduction apparatus comprising: information supply means for supplying multiplexed data information of video, audio, and other data transmitted as a digital signal; and continuous output from the information supply means. Recording and reproducing means for recording and reproducing the bit stream, input control of data to be recorded in the recording and reproducing means, and data control means for controlling output of data to be reproduced from the recording and reproducing means,
Operation monitoring means for monitoring the movement of the video portion of the data to be recorded in the recording / reproducing means; and frame number determination for determining the number of frames to be reproduced per unit time from the recording / reproducing means based on the monitoring result of the operation monitoring means. Means. Another characteristic feature of the delay reproduction apparatus of the present invention is that the monitoring result of the operation monitoring means is as follows:
It is characterized in that the sum of the motion vectors of the macroblocks is obtained, and the sum is generated based on the magnitude. Another feature of the delay reproduction apparatus of the present invention is that the monitoring result of the operation monitoring means is obtained based on the sum of the absolute values of the motion vectors of the macroblocks and based on the magnitude thereof. And Another feature of the delay reproduction apparatus of the present invention is that the macroblock is extracted from only a few places on the display surface, and the combination of the sum of the motion vectors and the sum of the absolute values of the motion vectors is used for the video. It is characterized in that the movement is patterned and output from the operation monitoring means. Another feature of the delay reproduction apparatus of the present invention is that an information supply unit that supplies multiplexed data information of video, audio, and other data such as a digital signal broadcast, Recording and reproducing means for recording and reproducing the output bit stream, input control of data to be recorded in the recording and reproducing means,
Data control means for controlling the output of data to be reproduced from the recording / reproducing means, volume monitoring means for monitoring the volume of the audio portion of the data to be recorded in the recording / reproducing means, based on the monitoring result of the volume monitoring means, A frame number determining means for determining the number of frames to be reproduced per unit time from the recording / reproducing means. Another feature of the delay reproduction apparatus of the present invention is that an image storage means for synthesizing a display image and a frame of the number of frames to be reproduced per unit time from the recording / reproduction means are developed in the image storage means. And a developing / combining means for performing composition.

According to the delay reproduction method of the present invention, an information supply process for supplying multiplexed data information of video, audio, and other data transmitted as a digital signal, and a bit stream continuously output by the information supply process are recorded. Recording / reproducing processing for recording / reproducing on the reproducing means, input control of data to be recorded on the recording / reproducing means, data control processing for controlling output of data reproduced by the recording / reproducing means, and recording on the recording / reproducing means An operation monitoring process for monitoring a motion of a video portion of data, and a frame number determining process for determining the number of frames to be reproduced in a unit time by the recording / reproducing means based on an output result of the operation monitoring process. And Another feature of the delay reproduction method of the present invention is that the output result of the operation monitoring process is obtained by calculating the sum of the motion vectors of the macro blocks and generating the sum based on the magnitude. Another feature of the delay reproduction method of the present invention is that the output result of the operation monitoring process is obtained by calculating the sum of the absolute values of the motion vectors of the macroblocks and generating the sum based on the magnitude. And Another feature of the delay reproduction method of the present invention is that the macroblock is extracted from only a few places on the display surface, and the combination of the sum of the motion vectors and the sum of the absolute values of the motion vectors is combined. It is characterized in that the movement is patterned and output as the output of the operation monitoring processing. Another feature of the delay reproduction method of the present invention is that an information supply process for supplying multiplexed data information of video, audio, and other data such as a digital signal broadcast, and a continuous Recording and reproducing the bit stream to be output to the recording / reproducing means, recording / reproducing processing, input control of data to be recorded in the recording / reproducing means, and data control processing for controlling output of data reproduced by the recording / reproducing means, Volume monitoring processing for monitoring the volume of the audio portion of the data to be recorded in the recording / reproducing means, and frame number determination for determining the number of frames to be reproduced per unit time by the recording / reproducing means based on the output result of the volume monitoring processing. And processing is performed. Another feature of the delay reproduction method of the present invention is that an image storage process for synthesizing a display image and a frame of the number of frames reproduced in a unit time by the recording / reproduction means are expanded into the image storage process. And a development synthesis process for performing synthesis.

[0013] The storage medium of the present invention is characterized in that a program for causing a computer to function as each means constituting the delay reproduction apparatus is stored so as to be readable from the computer. Another feature of the storage medium of the present invention is that a program for causing a computer to execute the procedure of the delay reproduction method is stored so as to be readable from the computer.

[0014]

DESCRIPTION OF THE PREFERRED EMBODIMENTS [First Embodiment] One embodiment of a delay reproduction apparatus, a delay reproduction method and a storage medium according to the present invention will be described below with reference to the drawings. FIG. 1 is a system configuration diagram according to the present embodiment.
Digital broadcast signals such as V and terrestrial waves are received, and MPEG2
Is a receiving demodulator that outputs a transport stream (hereinafter, referred to as a TS).

2 is a T composed of a plurality of programs.
S is a classifier that classifies S into each packetized elementary stream (hereinafter, referred to as PES), 3 is an MPEG demodulator that demodulates each PES into video, audio, and data, and converts it into a signal that can be displayed on a display. Reference numeral 4 denotes a display for displaying a demodulated video signal and reproducing an audio signal.

Reference numeral 5 denotes a data controller, which switches between broadcasting, data recording, and data reproduction in accordance with an instruction from the microcomputer 10 and, at the time of data recording, sorts only the TS data of one selected program, and At the time of reproduction, based on the classification information added by the frame classifier 6, TS data is output in accordance with a reproduction speed threshold value specified by the microcomputer 10.

Reference numeral 6 denotes a frame classifier, which calculates each frame (field) to classify the motion into four patterns, divides the motion amount into eight stages, and stores the
This classification information is added when recording S data.

Reference numeral 7 denotes a buffer, and a data storage 9
The data storage 9 for temporarily storing the TS data to be recorded in the data storage 9 can be read and written at a higher speed. Reference numeral 8 denotes a buffer for temporarily storing TS data to be reproduced from the data storage 9, which can read and write data at a higher speed than the data storage 9.

Reference numeral 9 denotes a data storage for recording TS data, and reference numeral 10 denotes a microcomputer which controls the data controller 5 and the display controller 11 according to an external instruction. 11
Is a display controller for synthesizing the frame image demodulated by the MPEG demodulator 3 in the image synthesizing memory 12 in accordance with the reproduction speed output from the data controller 5 and controlling the output. This is an image synthesizing memory for synthesizing.

A digital broadcast signal multiplexed by the MPEG2 system and subjected to various modulations is demodulated by a receiving demodulator 1 suitable for various transmission paths, and converted into an MPEG2 TS. This TS is generally multiplexed with a plurality of programs.

When watching a broadcast, the data controller 5 sends the TS of the arbitrarily selected single program to the classifier 2 to separate it into each PES, and the MPEG demodulator 3 demodulates it into video, audio, and data. And sends it to the display 4 to display the video,
The audio is reproduced and the data is processed according to the application. When a broadcast is recorded in the data storage 9 for delay reproduction, a command for recording is input to the microcomputer 10.

When receiving the recording command, the microcomputer 10 instructs the data controller 5 to record the TS data. The data controller 5 sends the arbitrarily selected single program TS data to the frame classifier 6 and the classifier 2
Stop sending TS data to

FIG. 2 shows a flowchart of the TS data recording operation. In the first step S21, the microcomputer 10 calculates the classification information of the video, and then in the step S22
Sends the TS data to the buffer with the above classification information added.

Next, in step S23, the data is recorded in the data storage. Next, in step S24, it is determined whether or not the recording is stopped.
And the above operation is repeated. If the result of determination in step S24 is that the recording is to be stopped, the recording operation ends.

The calculation of the motion vector performed by the frame classifier 6 is performed on a specific macroblock in an image. In the present embodiment, vectors are compared for several macroblocks at five locations in the screen and classified into four patterns, the amount of motion is calculated according to each pattern, and classified into eight stages. .

FIG. 3 shows four patterns. (1)
It is an intra-coded image and a motion vector cannot be extracted. (2) All motion vectors have the same direction. (3) All the motion vectors point to one point. In (4), all motion vectors have no correlation.

The motion data is classified into the above four patterns, and is calculated according to the pattern, not simply as a vector sum or a scalar sum. The TS data is recorded in the data storage 9 with this information added.

This operation is repeated until the microcomputer 10 outputs a recording end command. When reproducing the recorded TS data from the data storage 9, the microcomputer 10
This is performed by inputting a command to perform reproduction.

The reproduction speed can be increased to catch up with the actual broadcast. As the speed, either a constant speed or a method of changing the speed based on the classification information added at the time of recording can be selected. In the case of a constant speed, double speed reproduction is performed at an arbitrarily set reproduction speed L (L = 1, 2, 3,...). The TS data is sent to the buffer 8, sent to the discriminator 2 via the data controller 5 at L times the bit rate, separated into each PES, and demodulated into video, audio, and data by the MPEG demodulator 3.

FIG. 4 shows a specific example of the TS data reproducing operation. In the first step S41, it is determined whether or not the reproduction is at a constant speed. If the result of this determination is that it is not constant-speed playback, the process proceeds to step S42, and processing is performed in which playback speed weight = m (m is an integer).

Next, in step S43, processing is performed to set the reproduction speed to M (M is an integer) based on the classification information and the reproduction speed weight m. Next, in step S44, a process of combining the M images into one image is performed.

Next, in step S45, the sound is
Play at double speed. Thereafter, it is determined in step S46 whether or not the reproduction is to be stopped. If the reproduction is to be stopped, the reproduction is terminated. If the reproduction is to be continued, the process returns to step S41 to repeat the above-described processing.

On the other hand, if the result of determination in step S41 is that reproduction is to be performed at a constant speed, the flow proceeds to step S47, where the reproduction speed = L
(L is an integer). Then, step S4
Proceeding to step S8, a process for synthesizing the L images into one is performed, and then, in step S49, the sound is reproduced at the L speed. Thereafter, it is determined in step S46 whether or not the reproduction is to be stopped.

As a method of reproducing a video, when the speed is constant, double-speed reproduction is performed at an arbitrarily set reproduction speed L (L = integer). The TS data is sent to the buffer 8 and sent to the discriminator 2 via the data controller 5 at an L-times bit rate.
And the MPEG demodulator 3 demodulates them into video, audio and data.

FIG. 5 shows the composition at 3 × speed. The image decoded in the frame buffer is divided into three equal parts in the vertical direction, and the display part is copied to the image combining memory 12. The image thus synthesized is returned to the MPEG demodulator 3 and sent to the display 4 to display the video, reproduce the audio, and process the data according to the application. At this time, a reproduced flag is added to the reproduced TS data.

In the case of reproduction using the classification information, catch-up reproduction for reproducing a portion having no motion such as a sports broadcast at high speed can be realized. In the method of reproducing at high speed, the reproducing speed M is determined based on an arbitrarily set integer m and eight-stage classification information.
Subsequent processing is equivalent to the case of constant speed.

As described above, when continuing to watch a broadcast that has been temporarily interrupted, the playback speed is adjusted according to the movement,
Can understand the contents even in scenes with many movements. In addition, since the catch-up speed of catch-up reproduction can be adjusted, it is easy to match the user's preference.

[Second Embodiment] A second embodiment of the present invention will be described below with reference to the drawings. The delay reproduction method according to the present embodiment is characterized in that the reproduction speed can be adjusted not only by the amount of motion of the video but also by the volume of the audio. The difference from the first embodiment is that the frame classifier 6 generates classification information of eight levels for both video and audio,
This is to add to S data. The system configuration diagram is the same as in the first embodiment.

The frame classifier 6 classifies the motion of each frame (field) into four patterns and calculates it to divide the motion amount into eight stages. When the audio volume is divided into eight levels and the TS data is recorded in the data storage 9,
The above classification information is added. A digital broadcast signal multiplexed by the MPEG2 system and subjected to various modulations is demodulated by a reception demodulator 1 suitable for various transmission paths,
Is converted to TS. This TS is generally multiplexed with a plurality of programs.

When watching the broadcast, the data controller 5 sends the arbitrarily selected single program TS to the classifier 2,
It is separated into each PES, demodulated into video, audio, and data by the MPEG demodulator 3 and sent to the display 4, where the video is displayed, the audio is reproduced, and the data is processed according to the application. When a broadcast is recorded in the data storage 9, it is performed by inputting a recording command to the microcomputer 10.

When receiving the recording command, the microcomputer 10 instructs the data controller 5 to record the TS data. The data controller 5 sends the arbitrarily selected single program TS data to the frame classifier 6 and sends the TS data to the classifier 2.
Stop sending S data.

Next, the frame classifier 6 calculates a motion vector. (Refer to the first embodiment.) Further, the frame classifier 6 divides the volume of the voice into eight levels and uses it as voice classification information. The TS data is recorded in the data storage 9 with these pieces of information added. This operation is repeated until the microcomputer 10 outputs a recording end command. The reproduction of the recorded TS data from the data storage 9 is performed by inputting a reproduction command to the microcomputer 10.

FIG. 6 shows a specific example of the TS data recording operation. In the first step S61, the microcomputer 10 calculates video and audio classification information, and then sends the TS data to the buffer with the classification information added in step S62.

Next, in step S63, the data is recorded in the data storage. Next, in step S64, it is determined whether or not the recording is stopped.
And the above operation is repeated. If the result of determination in step S64 is that the recording is to be stopped, the recording operation ends.

The reproduction speed can be increased to catch up with the actual broadcast. As the speed, either a constant speed or a method of changing the speed based on the classification information added at the time of recording can be selected. In the case of the reproduction using the classification information, the reproduction is further divided into a video emphasis and a voice emphasis. It can be selected according to the type of broadcast to watch.

In the algorithm of the present embodiment, catch-up reproduction for reproducing a portion having no motion at high speed in sports broadcasting or the like can be realized. However, if a broadcast with little motion such as an orchestra concert is reproduced with emphasis on video, it is reproduced at a very high speed.

Since the purpose of such a music program is to listen to music rather than to video, a place where sound is not output (a small place) is reproduced at a high speed and skipped, and when the performance starts, it is reproduced normally. Can be realized.
In the high-speed reproduction method, the reproduction speed N (or M) is determined based on an arbitrarily set integer m and eight-stage classification information.
Subsequent processing is equivalent to the case of constant speed.

FIG. 7 shows a specific example of the TS data reproducing operation. In the first step S71, it is determined whether or not the reproduction is at a constant speed. If the result of this determination is not constant-speed playback, the flow advances to step S72 to perform processing for setting playback speed weight = m (m is an integer).

Next, in step S73, it is determined whether or not reproduction is performed with emphasis on video. As a result of this determination, if the reproduction is not video-oriented, the process proceeds to step S74, and processing for setting the reproduction speed = N (N is an integer) is performed based on the classification information and the reproduction speed weight m. Next, in step S75, a process of combining the N images into one image is performed.

Next, in step S76, the sound is
Play at double speed. Thereafter, in step S83, it is determined whether or not the reproduction is to be stopped. If the reproduction is to be stopped, the reproduction is terminated. If the reproduction is to be continued, the process returns to step S71 to repeat the above-described processing.

On the other hand, if the result of determination in step S71 is that the reproduction is to be performed at the constant speed, the flow proceeds to step S77, where the reproduction speed = L
(L is an integer). Then, step S7
Proceeding to step S8, a process of synthesizing the L images into one is performed, and then, in step S79, the sound is reproduced at the L-times speed. Thereafter, in step S83, it is determined whether or not the reproduction is stopped.

Further, if it is determined in step S73 that the reproduction is image-oriented, step S80
And the reproduction speed is determined by the classification information and the reproduction speed weight m.
A process for setting M (M is an integer) is performed. Next, step S8
In step 1, a process of combining M images into one image is performed.

Next, in step S82, the sound is
Play at double speed. Thereafter, in step S83, it is determined whether or not the reproduction is to be stopped. If the reproduction is to be stopped, the reproduction is terminated. If the reproduction is to be continued, the process returns to step S71 to repeat the above-described processing.

As described above, in the case where the viewing of the broadcast which has been temporarily interrupted is continued, the reproduction speed is adjusted according to the type of the broadcast, so that the viewing purpose can be continued without deteriorating. In addition, since the catch-up speed of catch-up reproduction can be adjusted, it is easy to match the user's preference.

(Other Embodiments of the Present Invention) The present invention is applied to a system composed of a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), but is also applicable to an apparatus composed of one device. You may.

Further, in order to realize the functions of the above-described embodiments, a device connected to the above-mentioned various devices or a computer in a system is operated so as to operate various devices so as to realize the functions of the above-described embodiments. The present invention also includes programs implemented by supplying the program code of the software described above and operating the various devices according to programs stored in a computer (CPU or MPU) of the system or apparatus.

In this case, the program code of the software realizes the functions of the above-described embodiment, and the program code itself and means for supplying the program code to the computer are provided.
For example, a storage medium storing such a program code constitutes the present invention. As a storage medium for storing such a program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM,
A magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the supplied program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) or other operating system running on the computer. Needless to say, even when the functions of the above-described embodiments are realized in cooperation with application software or the like, such program codes are included in the embodiments of the present invention.

Further, after the supplied program code is stored in a memory provided in a function expansion board of the computer or a function expansion unit connected to the computer, the function expansion board or the function expansion unit is specified based on the instruction of the program code. It is needless to say that the present invention also includes a case where the CPU or the like provided in the first embodiment performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0060]

As described above, according to the present invention,
In a system that plays back while recording a digital television broadcast, catch-up playback according to the type of broadcast being watched can be realized.

[Brief description of the drawings]

FIG. 1 is a system configuration diagram according to an embodiment of the present invention.

FIG. 2 is a flowchart of TS data recording.

FIG. 3 is a diagram showing a motion vector extraction pattern.

FIG. 4 is a flowchart of TS data reproduction.

FIG. 5 is a diagram illustrating an example of image synthesis.

FIG. 6 is a flowchart of TS data recording.

FIG. 7 is a flowchart of TS data reproduction.

FIG. 8 is a system configuration diagram showing an example of a conventional technique.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Receiving demodulator 2 Classifier 3 MPEG demodulator 4 Display 5 Data controller 6 Frame classifier 7 Buffer 8 Buffer 9 Data storage 10 Microcomputer 11 Display controller 12 Image synthesis memory

Claims (14)

[Claims] 1. An information supply unit for supplying multiplexed data information of video, audio, and other data transmitted as a digital signal, and a recording for recording and reproducing a bit stream continuously output from the information supply unit. Reproducing means; input control of data to be recorded in the recording / reproducing means; data control means for controlling output of data to be reproduced from the recording / reproducing means; and monitoring movement of a video portion of data to be recorded in the recording / reproducing means. A delay reproduction apparatus comprising: an operation monitoring unit that performs the operation; and a frame number determination unit that determines the number of frames to be reproduced per unit time from the recording / reproduction unit based on a monitoring result of the operation monitoring unit. 2. The delay reproduction apparatus according to claim 1, wherein the monitoring result of the operation monitoring means calculates a sum of the motion vectors of the macroblocks and generates the sum based on the magnitude thereof. 3. The delay reproduction according to claim 1, wherein the monitoring result of the operation monitoring means is obtained based on a sum of absolute values of motion vectors of the macroblock and based on the magnitude. apparatus. 4. The macroblock is extracted from only a few places on the display surface, and the motion of the video is patterned by a combination of the sum of the motion vectors and the sum of the absolute values of the motion vectors. The delay reproduction apparatus according to any one of claims 1 to 3, wherein: 5. An information supply means for supplying multiplexed data information of video, audio, and other data such as a digital signal broadcast, and a recording / reproducing apparatus for recording and reproducing a bit stream continuously output from said information supply means. Recording / reproducing means, input control of data to be recorded in the recording / reproducing means, data control means for controlling output of data to be reproduced from the recording / reproducing means, and volume control of an audio part of data to be recorded in the recording / reproducing means. A delay reproduction apparatus comprising: a volume monitoring means for monitoring; and a frame number determination means for determining the number of frames to be reproduced in a unit time from the recording / reproduction means based on a monitoring result of the volume monitoring means. 6. An image storing means for synthesizing a display image, and a developing and synthesizing means for expanding and synthesizing frames of the number of frames to be reproduced per unit time from the recording and reproducing means in the image storing means. The delay reproduction device according to any one of claims 1 to 5, characterized in that: 7. An information supply process for supplying multiplexed data information of video, audio, and other data transmitted as a digital signal, and a bit stream continuously output by the information supply process is recorded and reproduced by a recording / reproducing means. Recording and reproduction processing, input control of data to be recorded in the recording and reproduction means, data control processing to control output of data to be reproduced by the recording and reproduction means, and movement of a video portion of data to be recorded in the recording and reproduction means And a frame number determining process for determining the number of frames to be reproduced in a unit time by the recording / reproducing means based on an output result of the operation monitoring process. 8. The delayed reproduction method according to claim 7, wherein the output result of the operation monitoring processing is obtained by calculating the sum of the motion vectors of the macroblocks and generating the sum based on the magnitude. 9. The delay reproduction according to claim 7, wherein an output result of the operation monitoring processing is obtained based on a sum of absolute values of a motion vector of a macroblock and based on the magnitude thereof. Method. 10. The macroblock is extracted from only a few places on a display surface, and a motion of a video is patterned by a combination of a sum of motion vectors and a sum of absolute values of motion vectors. 10. The delay reproduction method according to claim 7, wherein the delay reproduction is performed. 11. Video and audio such as digital signal broadcasting, etc.
Information supply processing for supplying multiplexed data information of other data; recording and reproduction processing for recording and reproducing a bit stream continuously output by the information supply processing on recording and reproduction means; and data for recording on the recording and reproduction means. Input control, data control processing for controlling output of data to be reproduced by the recording / reproducing means, volume monitoring processing for monitoring a volume of an audio portion of data to be recorded in the recording / reproducing means, and output of the volume monitoring processing A frame number determining process for determining the number of frames to be reproduced per unit time by the recording / reproducing means based on the result. 12. An image storage process for synthesizing a display image, and a development / synthesis process for expanding and synthesizing the number of frames to be reproduced per unit time by the recording / reproducing means in the image storage process. The delay reproduction method according to any one of claims 7 to 11, wherein: 13. A storage medium storing a program for causing a computer to function as each of the means constituting the delay reproduction apparatus according to claim 1 so as to be readable from the computer. 14. A storage medium storing a program for causing a computer to execute the procedure of the delay reproduction method according to any one of claims 7 to 12 so as to be readable from the computer.