JPH06121276A - Compression reproduction system for picture and audio information - Google Patents

Abstract

PURPOSE:To easily eliminate out of synchronism between a picture and an audio signal automatically resulting from the slower picture compression processing speed than that of the audio signal when the picture signal and the audio signal are subject to compression processing. CONSTITUTION:A picture frame and an audio frame processed at present are compared (step 81) and when an audio frame number is larger than a picture frame number (step 82), since it represents that the picture processing is slower than the audio processing, the picture compression processing is interrupted for the frame and the picture compression processing of a succeeding frame is restarted. Since the picture compression processing is more quickened, the picture compression processing is automatically synchronized with the audio compression processing and a proper audio signal is added to the picture signal and no deviation is caused.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a compression / reproduction system for image and audio information, and more particularly to a compression recording system for compressing and recording image and audio information on a recording medium such as a CD-ROM or a hard disk. Further, the present invention relates to a reproducing system for reproducing the image and audio information from the recording medium and the communication line which are compressed and recorded.

[0002]

2. Description of the Related Art In recent years, image information and audio information have been recorded in advance on a large-capacity recording medium such as a CD-ROM or a hard disk, and a database has been constructed so that a user can use a communication line or the like from a terminal as needed. An online information search service is now in widespread use, in which the user can access the database and search for the image and audio information requested by the user.

In this case, the image and audio information is basically analog information, and therefore it is necessary to digitally convert the information and record it on a recording medium. However, when these analog information is converted into digital data, the amount of the information is extremely large compared with the character information.
Various data compression techniques for audio signals are used, and therefore, an electronic information file system capable of recording a large amount of information on a recording medium and retrieving the information has been put into practical use.

An example of such a system is a multimedia computer system, which is ISO 10918.
-1 (JPEG: Joint Photographi
The image and audio signals are compressed according to the image encoding method based on the cExpert Group. In this compression processing method, the image is generally compressed by dividing an image for one frame into 8 × 8 blocks and
Discrete cosine transform (DCT), quantization, and entropy coding are performed, respectively. Also, the playback of compressed images is
This is performed by performing entropy decoding, inverse quantization, and inverse DCT for each block unit of 8 × 8 blocks.

In such a system, a device capable of editing a large amount of information such as images and sounds at high speed, compressing it, and recording it on a recording medium is required, and at the time of reproduction, the audio information is stored as corresponding image information. In order to reproduce in combination, it is necessary to take reproduction timing (synchronization). In particular, the image recording / reproducing speed may be slower than the audio recording / reproducing speed depending on the performance of the apparatus, the size of the compressed code of the image, and the like. As a result, it becomes unnatural because the images and sound cannot be synchronized when they are reproduced.

[0006] As a conventional example for achieving this synchronization, Japanese Patent Laid-Open No. 63-63
There are techniques disclosed in JP-A-168745, JP-A-63-266579 and JP-A-63-313384. A brief description of these conventional synchronization methods is as follows. In the process of compressing and converting a large amount of information such as images and sounds, data attributes such as data type, data length, data conversion processing method, and other information to be synchronized are created as a data file, and these data are created. Store it as a control file. After that,
Using the data file stored in this data control file, so-called simulated reproduction is performed, assuming that the data recorded on the recording medium in the final form is reproduced. At this time, the real-time reproduction of the audio signal, the combination of the image and the sound, the quality of the reproduction timing, etc. are confirmed by the actual eyes and ears.

At this time, the reproduction is performed based on the contents of the data file in the control file. However, if the image and the sound are not synchronized, the timing and the like can be freely set while correcting the simulated reproduction procedure. . In this way, the simulated reproduction creates a program file whose operation has been confirmed, adjusted, and edited.

[0008]

[Problems to be Solved by the Invention]
In the image / audio synchronization method in the audio compression / playback system, it is necessary to create a data file for timing adjustment. Also, the operation check is repeated while performing the simulated playback based on the contents of these data files. It has the drawback that it requires time and effort to create a file.

Therefore, the present invention has been made to solve the drawbacks of the prior art, and an object thereof is to create a data file or the like when compressing image and audio information. An object of the present invention is to provide a compression / reproduction system capable of automatically recording an image and sound in synchronization with each other.

Another object of the present invention is to reproduce the image and audio information from a recording medium or a communication line, which has been compressed and recorded, without the need to create a data file or the like, and to simulate reproduction or the like. An object of the present invention is to provide a reproduction system capable of automatically reproducing images and sounds in synchronization with each other without requiring time-consuming operations.

[0011]

A compression system according to the present invention is a compression system for compressing input image information and audio information for each frame, and includes first to nth (n is 2).
Image compression processing means for compressing the input image information for one frame divided into blocks of the above integers in units of blocks while sequentially scanning from the first block to the nth block, and the input audio for one frame. When the image compression processing is delayed with respect to the audio compression processing by referring to the audio compression processing means for compressing information and the frame numbers in the compression processing of the image compression processing means and the audio compression processing means,
Means for controlling interruption of the image compression processing of the frame at that time.

Another compression system according to the present invention is a compression system for compressing input image information and audio information frame by frame and recording them in a storage medium, and one frame divided into first to nth blocks. Minute blocks of the input image information are further divided into first to mth (m is an integer of 2 or more) frequency band components, and each block of the first frequency band component is divided from the first block to the nth block. An image compression processing unit that sequentially scans and similarly compresses each block of the second and subsequent frequency band components in the same scanning procedure while performing compression processing on a block-by-block basis, and compresses input audio information for one frame. When the image compression processing is delayed with respect to the audio compression processing by referring to the audio compression processing means for performing the compression and the frame numbers in the compression processings of the image compression processing means and the audio compression processing means Characterized in that it comprises a means for interrupting controlling image compression processing of the frame at that time.

Another compression system according to the present invention is a compression system for compressing input image information and audio information frame by frame and recording them in a storage medium, and one frame divided into first to nth blocks. Minute input image information blocks are further divided into first to kth (k is an integer of 2 or more) color components, and each block of the first color component is sequentially scanned from the first block to the nth block. Similarly, the image compression processing means for compressing each block of the second and subsequent color components in the same scanning procedure and performing compression processing for each block, and the audio compression for compressing the input audio information for one frame. When the image compression processing is delayed with respect to the audio compression processing by referring to the processing means and the frame numbers in the compression processing of the image compression processing means and the audio compression processing means, the image of the frame at that time is delayed. Characterized in that it comprises a means for interrupting control compression process.

The reproducing system according to the present invention is a reproducing system for reproducing the input image information and the audio information which are compressed for each frame, and the input image for one frame divided into the first to nth blocks. Image reproduction processing means for reproducing the information in units of blocks while sequentially scanning information from the first block to the nth block, a sound reproduction processing means for reproducing the input audio information for one frame, and the image reproduction processing means. And a means for interrupting the image reproduction processing of the frame at that time when the image reproduction processing is delayed with respect to the audio reproduction processing by referring to the frame numbers during the reproduction processing of the audio reproduction processing means. Is characterized by.

Another reproducing system according to the present invention is a reproducing system for reproducing the input image information and the audio information which are compressed for each frame, and which corresponds to one frame divided into the first to nth blocks. Each block of the input image information is further divided into first to m-th frequency band components, each block of the first frequency band component is sequentially scanned from the first block to the n-th block, and the second and subsequent blocks are similarly scanned. Image reproduction processing means for reproducing processing in units of blocks while sequentially scanning each block of the frequency band component in the same scanning procedure, audio reproduction processing means for reproducing input audio information for one frame, and the image reproduction. When the image reproduction processing is delayed with respect to the audio pressure reproduction processing by referring to the frame numbers during the reproduction processing of the processing means and the audio reproduction processing means, the image of the frame at that time is displayed. Characterized in that it comprises a means for interrupting control playback process.

Another playback system according to the present invention is a playback system for playing back input image information and audio information that have been compressed for each frame, and for one frame divided into first to nth blocks. Each block of input image information is further divided into first to kth color components, each block of the first color component is sequentially scanned from the first block to the nth block, and similarly, the second and subsequent color components are similarly scanned. For each block, the image reproduction processing means for performing the reproduction processing for each block while sequentially scanning by the same scanning procedure, the audio reproduction processing means for reproducing the input audio information for one frame, the image reproduction processing means, When the image reproduction processing is delayed with respect to the audio pressure reproduction processing by referring to the frame numbers during the reproduction processing of the audio reproduction processing means, the image reproduction processing of the frame at that time is interrupted and controlled. Characterized in that it comprises a stage.

[0017]

In the compression system according to the present invention, the fact that the image compression processing is delayed compared to the audio compression processing is detected by referring to the frame number being processed, and in response to this detection, the image compression of the frame at that time is detected. Suspend processing. Since the image compression process is performed again from the next new frame, the image compression process is speeded up, and it is automatically synchronized with the audio compression process and recorded on the recording medium, and again on the communication line. Will be sent.

In the reproducing system according to the present invention, when the compressed image and the sound from the recording medium or the communication line are reproduced, the fact that the image reproducing process is delayed as compared with the sound reproducing process means that the frame being processed is being processed. Detection is performed by referring to the number, and in response to this detection, the image reproduction processing of the frame at that time is interrupted. Then, the image reproduction processing is performed again from the next new frame, so that the image reproduction processing is speeded up and the synchronization with the audio reproduction processing is automatically established.

[0019]

Embodiments of the present invention will now be described in detail with reference to the drawings.

FIG. 1 is a system block diagram applied to the compression system according to the embodiment of the present invention.
It is a block diagram of the image and audio compression system in the image encoding system of the multimedia computer system based on 0918-1 (JPEG).

In the figure, a CPU 1 executes a program stored in a ROM 2 to control the entire apparatus. RA
M3 is a memory for temporarily storing the data being compressed. The keyboard 4 is for specifying image and audio compression processing, and the hard disk 5 records the compression coded image code and audio code stored in the RAM 3. The transmitter 6 transmits the compression coded image code and audio code to the communication line.

The input image signal is A / D converted by the A / D converter 8.
It is / D converted and separated into a luminance signal and a chrominance signal by the Y / C separator 7. Thereafter, the DCT unit 9 performs discrete cosine transform, the quantizer 10 quantizes, and the encoder 11
It is stored in the RAM 3 after being subjected to high efficiency compression coding in.
The input audio signal is compression-encoded by the audio encoder 12 and stored in the RAM 3.

FIG. 2 is a system block diagram applied to the reproducing system according to the embodiment of the present invention.
It is a block diagram of the image and the audio | voice reproducing apparatus of the image coding system of the multimedia computer system based on 0918-1 (JPEG).

In the figure, the CPU 20 executes a program stored in the ROM 21 to control the entire apparatus.
The RAM 22 temporarily stores the data being reproduced.
The keyboard 23 is for performing processing of an image / sound reproduction device. The hard disk 24 records the compression coded image code and audio code, and the code can be read into the RAM 22. The receiving unit 25 receives the compression coded image code and audio code from the communication line.

The compressed image code read into the RAM 22 is decoded by the decoder 30 and inversely quantized by the inverse quantizer 29. Thereafter, the inverse DCT unit 28 performs inverse discrete cosine transform, the Y / C combiner 26 combines the luminance signal and the color difference signal, and the D / A converter 27 performs D / A conversion, and then outputs as an image signal. To be done. The compressed voice code read in the RAM 22 is decoded by the voice decoder 31 and output as a voice signal.

FIG. 3 is a flow chart for controlling the image and audio compression processing. As shown in the flowchart of FIG. 3, when the compression process is started, the transmission flag ON / OFF, the number of frames (or fields) to be recorded, the file, and the like are input from the keyboard 4 (step 40).
Next, the input video signal is digitally converted by the A / D converter 8 (step 41), separated by the Y / C separator 7 into a luminance signal and a color difference signal (step 42), and image compression is performed. (Step 43) The compression code of the image is stored in the RAM 3 (Step 44).

Next, the speech signal input to the speech signal is input to the speech encoder 1.
2 is encoded (step 45), and the compression code of the voice is R
Store in AM3 (step 46). Next, it is judged whether or not the transmission flag is designated as ON (step 4
7), otherwise go to step 49. If the transmission flag is ON, the image and audio codes in the RAM 3 are sent to the communication line by the transmitter 6 (step 48). Next, the codes of the image and sound in the RAM 3 are recorded in the hard disk 5 (step 49). Then, it is judged whether it is the last frame (or field) (step 50),
If not, the process returns to step 41, and if it is the final frame, the process ends.

FIG. 4 is a flow chart for controlling the image and sound reproduction processing. As shown in the flowchart of FIG. 4, when the reproducing apparatus is started, ON / OFF of the reception flag, the number of frames (or fields) to be reproduced, and the file name are input from the keyboard 23 (step 6).
0). Next, it is judged whether or not the reception flag is ON (step 61), and if so, the receiving unit 25 receives the compression code of the image and the sound from the communication line and the RAM 22.
(Step 62) and the compression code of the image and sound stored in the RAM 22 is recorded in the hard disk 24 (step 63).

If the reception flag is not ON, the compression codes of image and sound are read from the hard disk 24 and the RAM 2 is read.
2 (step 64), and the process proceeds to step 65.
Next, the voice compression code stored in the RAM 22 is decoded by the voice decoder 31 and output as a voice signal (step 65). Then, the compressed code of the image is reproduced (step 66), the luminance signal and the color difference signal are combined by the Y / C combiner 26 (step 67), and the converted by the D / A converter 27 and output as a video signal. (Step 68). Next, it is judged whether or not it is the last frame (or field) (step 69), and if not so, the process returns to step 61, and if it is the last frame, the processing ends.

The above is the outline of the configuration and operation of the compression and reproduction system to which the embodiment of the present invention is applied. The detailed operation of the embodiment will be described below for different cases.

(1) Block compression interruption operation of image compression / reproduction processing: FIGS. 5 to 8 show that the image compression reproduction processing is interrupted in block units when the image compression processing is delayed from the audio compression reproduction processing. FIG. 6 is a diagram illustrating an example of processing for synchronizing audio and images.

FIG. 5 is a diagram for explaining a block which is a processing unit when compressing an image for one frame. In FIG. 5, the image for one frame is shown as 48 × 48 dots, but actually, for example, 600 × 4
It is 00 dots, and here it is 4 for simplification.
It is set to 8 × 48 dots. This 48 × 48 dot image is divided into a total of 36 blocks from the 0th to the 35th as shown in the figure (each block is 8 × 8 dots), and compression processing is performed in units of these blocks. Will be seen.

The compression process in this case is a so-called zigzag scan, which is performed in ascending order according to the block numbers in FIG. At this time, as shown in FIG. 6A, the sound and image of the same frame are processed in parallel, but when the 30th block of the second frame is processed, 3
If the processing of the audio of the frame is started, the 31st block of the 2nd frame is not processed, the processing of the 2nd frame is interrupted at that time, and the processing is started from the 0th block of the next 3rd frame. To start.

As shown in FIG. 6 (B), the codes of the voice and the image thus created are the codes of the 0th to 35th blocks ( M0 to M35) are stored, and only the codes (M0 to 30) of the 0th to 30th blocks are stored in the code of the interrupted second frame image.

In the figure, A is a voice compression code, S
OI is a code indicating the start of the frame, and EOI is a code indicating the end of the frame.

FIG. 7 shows a flowchart of processing for interrupting voice compression in block units. At the time of compression, as shown in the flowchart of FIG. 7, when the image compression is started, it is judged whether or not it is the first frame (step 80), and if so, the process proceeds to step 83. If not, the audio frame number currently being processed is compared with the image frame number (step 81) to determine whether the image processing is behind the audio processing (step 82). If there is a delay, the image processing of the current frame ends when the compression of the block currently being processed ends. If not, the frequency component is calculated from the block by the DCT unit 9 (step 83) and quantized by the quantizer 10 (step 8).
4) High-efficiency compression coding is performed by the encoder 11 (step 85), and the compression code of the image is stored in the RAM 3 (step 86). Next, it is judged whether or not it is the final block (step 87), and if not, the process returns to step 80. If it is the final block, the compression of the image ends.

At the time of reproduction, as shown in the flowchart of FIG. 8, when the image reproduction is started, it is judged whether or not it is the first frame (step 90), and if so, step 9
Go to 3. If not, the audio frame number currently being processed is compared with the image frame number (step 9).
1) It is determined whether the image processing is behind the audio processing (step 92). If there is a delay, the image reproduction processing of the current frame ends when the reproduction of the block currently being processed ends. Otherwise, RAM 22
The compression code of the image stored in is extracted (step 9
3) Decoding is performed by the decoder 30 (step 94), inverse quantization is performed by the inverse quantizer 29 (step 95), and inverse DCT is performed.
The pixel value is calculated by the device 28 (step 96). Next, it is judged whether or not it is the final block (step 97), and if not so, the process returns to step 90. If it is the final block, the reproduction of the image is terminated.

(2) Interruption operation of the image compression / reproduction processing in units of frequency components: FIGS. 9 to 12 show the image compression / reproduction processing for each frequency component when the image compression / reproduction processing lags behind the audio compression / reproduction processing. By interrupting in block units of
It is a figure explaining the example of the process which synchronizes a sound and an image. FIG. 9A shows a horizontal frequency of 8 × for each of the 0th to 35th blocks (one block) shown in FIG.
A set of frequency components (64 components) having a vertical frequency of 8 is further added to 4
It is shown divided into three components (0 to 3).

The compression / reproduction processing is performed in the order of the 0th to 35th blocks of the 0th frequency component, the 0th to 35th blocks of the 1st frequency component, and the 0th to 35th blocks of the 2nd frequency component. Block, the third frequency component is processed from 0th to 35th.

FIG. 9B shows a conversion formula at the time of image compression and reproduction. In the figure, sample values after Svu compression, sample values before syx compression or after reproduction, μ are horizontal spatial frequencies, and ν are vertical spatial frequencies.

As shown in FIG. 10A, the voice and image of the same frame are processed in parallel.
If the processing of the audio of the third frame is started at the time when the 30th block of the th frequency component is processed,
The processing is started from the 0th block of the 0th frequency component of the 3rd frame without processing the 31st block of the 3rd frequency component of the 2nd frame.

As shown in FIG. 10B, the codes of the sound and the image thus created are the 0th to 35th of the 0th frequency component in the code of the image of the first frame which is not interrupted. Codes up to the th block (H000 to H03
5), codes of the 0th to 35th blocks of the first frequency component (H100 to H135), and codes of the 0th to 35th blocks of the second frequency component (H200 to H235), Codes (H300 to H3) of the 0th to 35th blocks of the third frequency component
35) and are stored. The code of the interrupted second frame is the code of the 0th to 35th blocks (H000 to H2) of the 0th to 2nd frequency components.
35) and the codes (H300 to H330) of the 0th to 30th blocks of the third frequency component are stored.

FIG. 11 shows a flowchart of processing for interrupting the image compression processing for each frequency component. Figure 11 during compression
When the image compression is started, it is judged whether or not it is the first frame (step 100),
If so, go to step 103. If not, the audio frame number currently being processed is compared with the image frame number (step 101) to determine whether the image processing is behind the audio processing (step 10).
2) If there is a delay, the image processing of the current frame is finished at the time when the compression of the currently processed frequency component in block units is finished. Otherwise, the frequency component currently processed from the block is calculated by the DCT unit 9 (step 103) and quantized by the quantizer 10 (step 10).
4) High-efficiency compression coding is performed by the encoder 11 (step 105), and the compression code of the image is stored in the RAM 3 (step 106).

Next, it is judged whether the block is the final block (step 107), and if not, the process returns to step 100. If it is the final block, the block is returned to the beginning and the frequency component to be processed is changed (step 108),
Determine whether it is the final frequency component (step 10
9) If not, the process returns to step 100, and if it is the final frequency component, compression of the image ends.

FIG. 12 is a flowchart of the image reproducing process. During playback, as shown in the flowchart in FIG.
When the image reproduction is started, the process proceeds to step 123. If not, the audio frame number currently being processed is compared with the image frame number (step 121) to determine whether the image processing is behind the audio processing (step 1).
22) If there is a delay, the image reproduction processing of the current frame is ended when the reproduction of the currently processed frequency component in block units is completed. Otherwise, RAM 22
The compression code of the image stored in is extracted (step 12
3) Decoding is performed by the decoder 30 (step 124), inverse quantization is performed by the inverse quantizer 29 (step 125), and inverse D
The CT unit 28 calculates the pixel value from the current frequency component (step 126).

Next, it is judged whether the block is the final block (step 127), and if not, the process returns to step 120. If it is the final block, the block is returned to the beginning and the frequency component to be processed is changed (step 128),
Determine whether it is the final frequency component (step 12
9) If not, the process returns to step 120, and if it is the final frequency component, the reproduction of the image ends.

(3) Interruption operation of image compression / reproduction processing for each color component: FIGS. 13 to 15 show image compression / reproduction processing for each color component when the image frame compression / reproduction processing is delayed from the audio compression / reproduction processing. It is a figure explaining the example of the process which synchronizes an audio | voice and an image by interrupting in block units.
In the example shown in FIG. 13, one block of the image shown in FIG. 5 is further divided into three Y components, Cb components, and Cr components of the color components, and the 0th block in the order shown in FIG. 0 of color component
Blocks from 1st to 35th, 0 of 1st color component
Blocks from the 35th to the 35th, 0 of the second color component
The blocks from the th to the thirty-fifth are processed in this order.

As shown in FIG. 10 (A), the sound and image of the same frame are processed in parallel, but when the 30th block of the 3rd color component of the 2nd frame is processed, 3
Since the processing of the sound of the frame has started, the processing starts from the 0th block of the 0th color component of the 3rd frame without processing the 31st block of the 3rd color component of the 2nd frame.

As shown in FIG. 9C, the codes of the sound and the image created in this way are 0 to 35 of the 0th color component in the code of the image of the first frame which is not interrupted.
The codes of the blocks up to the th (C000 to C035),
Codes of the 0th to 35th blocks of the first color component (C100 to C135) and codes of the 0th to 35th blocks of the second color component (C200 to C2)
35) and the codes (C300 to C335) of the 0th to 35th blocks of the third color component are stored. In the interrupted image code of the second frame, the codes (C000 to C235) of the 0th to 2nd blocks of the 0th to 2nd color components and the 0th to 30th of the 3rd color component Block code (C300-
Only C330) is stored.

FIG. 15 shows a flowchart of processing for interrupting the image compression processing for each color component. At the time of compression, as shown in the flowchart of FIG.
It is determined whether or not it is the frame (step 140), and if so, the process proceeds to step 143. If not, the audio frame number currently being processed is compared with the image frame number (step 141) to determine whether the image processing is behind the audio processing (step 142). When the block unit compression of the color component being processed ends, the image processing of the current frame ends. If not, the frequency component of the color component currently processed from the block is calculated by the DCT unit 9 (step 14
3), quantizing by the quantizer 10 (step 144),
The encoder 11 performs high-efficiency compression coding (step 14).
5) The compression code of the image is stored in the RAM 3 (step 146).

Next, it is judged whether or not it is the final block (step 147), and if not so, the process returns to step 140. If it is the final block, the block is returned to the beginning and the color component to be processed is changed (step 148).
It is judged whether or not it is the final color component (step 149), and if not, the process returns to step 140, and if it is the final color component, the image compression is ended.

FIG. 16 is a flowchart of the image reproducing process. During playback, as shown in the flowchart in FIG.
When the image reproduction is started, it is judged whether or not it is the first frame (step 160), and if so, step 16
Go to 3. If not, the audio frame number currently being processed is compared with the image frame number (step 1
61) It is judged whether the image processing is behind the audio processing (step 162). If the processing is delayed, the image reproduction processing of the current frame is performed at the time when the reproduction of the currently processed color component in block units is completed. Suspended and ended. If not, the compression code of the image stored in the RAM 22 is extracted (step 163), decoded by the decoder 30 (step 164), and dequantized by the dequantizer 29 (step 1).
65), and the inverse DCT unit 28 calculates the pixel value of the current color component.

Next, it is judged whether or not it is the final block (step 167), and if not, the process returns to step 160. If it is the final step, the block is returned to the head to change the color component to be processed (step 168), it is judged whether or not it is the final color component (step 169), and if it is not, the process returns to step 160 to determine the final color. If it is a component, the image reproduction is ended.

It should be noted that the input image information and the input audio information (the information read from the recording medium and the information received from the communication line) in the image and audio reproduction processing of this embodiment include the image and audio compression processing of this embodiment. The information that has not been subjected to the synchronization processing is used, and the above-described synchronization processing is performed during reproduction.

[0055]

As described above, according to the present invention, the image compression processing is speeded up by interrupting the image compression processing at the audio compression processing speed during the image and audio compression processing. There is an effect that synchronization with the audio compression processing can be automatically obtained. Also, by suspending the image reproduction processing at the speed of the audio reproduction processing even during the reproduction processing of images and sounds,
This has the effect of speeding up the image reproduction processing and automatically synchronizing with the audio reproduction processing.

As a result, appropriate audio information is added to a certain image to be recorded or reproduced, so that the sound is not recorded or reproduced with the sound deviated from the image, so that both can be synchronized. The effect that there is no need to create a data file or to perform complicated simulated reproduction is produced.

[Brief description of drawings]

FIG. 1 is a block diagram of an image / audio compression system applied to an embodiment of the present invention.

FIG. 2 is a block diagram of an image / sound reproduction system applied to an embodiment of the present invention.

FIG. 3 is an operation flow of a block in FIG.

4 is an operation flow of the block in FIG.

FIG. 5 is a diagram showing an example in which an image for one frame is divided into a plurality of blocks.

FIG. 6 shows the operation of one embodiment of the present invention, (A)
Is a time chart in the case of compressing an image for one frame in block units, and (B) is a data format diagram after the compression.

FIG. 7 is a flowchart showing a compression process of the operation of FIG.

FIG. 8 is a flowchart showing a reproduction process of the operation of FIG.

FIG. 9A is a diagram showing an example in which one block of an image is further divided into a plurality of frequency components, and FIG. 9B is an example of a conversion formula in the case of compressing and reproducing an image for each frequency component. It is a figure.

FIG. 10 shows the operation of another embodiment of the present invention,
(A) is a time chart when compressing an image for one frame for each frequency component, and (B) is a data format diagram after the compression.

11 is a flowchart showing a compression process of the operation of FIG.

12 is a flowchart showing a reproduction process of the operation of FIG.

FIG. 13 is a diagram showing an example in which one block of an image is further divided into a plurality of color components.

FIG. 14 shows the operation of another embodiment of the present invention,
(A) is a time chart in the case of compressing an image for one frame for each color component, and (B) is a data format diagram after the compression.

15 is a flowchart showing a compression process of the operation of FIG.

16 is a flowchart showing a reproduction process of the operation of FIG.

[Explanation of symbols]

 1,20 CPU 2,21 ROM 3,22 RAM 4,23 Keyboard 5,24 Hard disk 6 Transmitter 7 Y / C separator 8 A / D converter 9 DCT device 10 Quantizer 11 Encoder 12 Speech encoding Device 25 Receiver 26 Y / C combiner 27 D / A converter 28 Inverse DCT device 29 Inverse quantizer 30 Decoder 31 Speech decoder

Claims (6)

[Claims] 1. A compression system for compressing input image information and audio information for each frame, the first to nth compression systems.
Image compression processing means for compressing the input image information for one frame divided into blocks (n is an integer of 2 or more) for each block while sequentially scanning from the first block to the nth block, and one frame. Audio compression processing means for compressing minute input audio information and the frame numbers in the compression processing of the image compression processing means and the audio compression processing means And a means for controlling interruption of the image compression processing of the frame at that time. 2. A reproduction system for reproducing input image information and audio information that have been compressed for each frame,
Image reproduction processing means for reproducing the input image information for one frame divided into the first to nth blocks in units of blocks while sequentially scanning from the first block to the nth block, and the input for one frame. When the image reproduction processing is delayed with respect to the audio reproduction processing by referring to the audio reproduction processing means for reproducing the audio information and the frame numbers in the reproduction processing of the image reproduction processing means and the audio reproduction processing means, And a means for controlling interruption of the image reproduction processing of the frame at that time. 3. A compression system for compressing input image information and audio information for each frame, comprising:
Each block of the input image information for one frame divided into the blocks of 1 to m (m is an integer of 2 or more) is further divided, and each block of the first frequency band component is divided into An image compression processing unit that sequentially scans from the 1st block to the nth block, and similarly performs a compression process for each block while sequentially scanning each block of the second and subsequent frequency band components in the same scanning procedure, and 1 frame. Audio compression processing means for compressing minute input audio information and the frame numbers in the compression processing of the image compression processing means and the audio compression processing means And a means for controlling interruption of the image compression processing of the frame at that time. 4. A reproduction system for reproducing input image information and audio information that have been compressed for each frame,
Each block of the input image information for one frame divided into the first to nth blocks is further divided into the first to mth frequency band components, and each block of the first frequency band component is divided into the first block.
An image reproduction processing means for sequentially scanning from the block to the nth block, and similarly for each block of the second and subsequent frequency band components while sequentially performing the same scanning procedure and reproducing processing for each block, and one frame worth. With reference to the audio reproduction processing means for reproducing the input audio information, and the frame numbers in the reproduction processing of the image reproduction processing means and the audio reproduction processing means, the image reproduction processing is delayed with respect to the audio pressure reproduction process. And a means for controlling interruption of the image reproduction processing of the frame at that time. 5. A compression system for compressing input image information and audio information frame by frame, comprising:
Each block of the input image information for one frame divided into blocks is further divided into first to kth (k is an integer of 2 or more) color components, and each block of the first color component is divided into first blocks. Image compression processing means for sequentially scanning from the block to the nth block, and similarly for each block of the second and subsequent color components in the same scanning procedure while performing compression processing on a block-by-block basis, and input for one frame. When the image compression processing is delayed with respect to the audio compression processing by referring to the audio compression processing means for compressing the audio information and the frame numbers in the compression processing of the image compression processing means and the audio compression processing means,
And a means for controlling interruption of the image compression processing of the frame at that time. 6. A reproduction system for reproducing input image information and audio information, which are compressed for each frame,
Each block of the input image information for one frame divided into the first to nth blocks is further divided into first to kth color components, and each block of the first color component is divided from the first block to the nth block.
Image reproduction processing means for sequentially performing reproduction processing for each block while sequentially scanning each block of the second and subsequent color components in the same scanning procedure.
By referring to the audio reproduction processing means for reproducing the input audio information for the frame and the frame numbers in the reproduction processing of the image reproduction processing means and the audio reproduction processing means, the image reproduction processing is performed for the audio pressure reproduction processing. And a means for controlling the interruption of the image reproduction processing of the frame at that time when the reproduction is delayed.