JP2000209587A - Encoding device, its method, decoding device, its method and computer readable storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To attain high efficiency encoding/decoding by mixing a low resolution moving picture with and a high resolution still picture with a small circuit scale. SOLUTION: A low resolution video encoding circuit 103 encodes a low resolution moving picture received at a terminal 101 and the encoded picture is stored in a moving picture storage area of a recording medium 104. Furthermore, when a high resolution still picture is received, a low resolution video encoding circuit encodes a low frequency component extracted by a low pass filter 105 to store the encoded picture to the moving picture storage area. Furthermore, a high frequency component extracted by a high pass filter 106 is encoded by a high frequency encoding circuit 107. An additional information encoding circuit 108 encodes a received additional information signal and the encoded high frequency signal and records the encoded signal to an additional information storage area of the recording medium.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an encoding apparatus, method, decoding apparatus and method suitable for high-efficiency encoding / decoding of video signals and the like, and a computer-readable storage used for them. It is about media.

[0002]

2. Description of the Related Art In recent years, with the advancement of digital signal processing technology, a large amount of digital information such as a moving image, a still image, and a sound has been encoded with high efficiency, and recorded on a small magnetic medium or transmitted to a communication medium. It is possible. Multimedia devices that can handle moving images, still images, and a plurality of images having different resolutions in a mixed manner by applying such technologies are being studied.

FIG. 6 shows a conventional configuration example of a high-efficiency coding apparatus capable of recording / reproducing a low-resolution moving image and a high-resolution still image in a mixed manner. 6, reference numeral 601 denotes a video signal input terminal; 602, a low-resolution video encoding circuit; 603, a high-resolution video encoding circuit; 604, a switching circuit;
5 is a recording medium, 606 is an audio signal input terminal, 607 is an audio encoding circuit, 608 is an additional information input terminal, and 609 is an additional information encoding circuit.

Next, the operation will be described. Either a low-resolution video signal or a high-resolution video signal is selectively input to the video signal input terminal 601 and supplied to the low-resolution video encoding circuit 602 and the high-resolution video encoding circuit 603. The low-resolution video coding circuit 602 and the high-resolution video coding circuit 603 perform orthogonal transform, quantization, and variable-length coding on the signals supplied thereto, thereby performing high-efficiency coding, and a switching circuit. 604.

The switching circuit 604 is connected to the input terminal 60
1 is a low-resolution video signal, a signal supplied from the low-resolution video encoding circuit 602 is selected,
If the input signal to the input terminal 601 is a high-resolution video signal, a signal supplied from the high-resolution video encoding circuit 603 is selected. The selected signal is recorded on the recording medium 605.

On the other hand, an audio signal input to an audio signal input terminal 606 is encoded by an audio encoding circuit 607 and recorded on a recording medium 605. Further, the additional information signal input to the additional information input terminal 608 is encoded by the additional information encoding circuit 609 and recorded in the video recording area of the recording medium 605.

That is, in this device, the switching circuit 6
04 enables only one of the low-resolution video encoding circuit 602 and the high-resolution video encoding circuit 603, and records only one output on the recording medium 605. Efficiency coding is realized.

FIG. 7 shows a configuration example of a conventional decoding device.
7, 701 is a recording medium, 702 is a low-resolution video decoding circuit, 703 is a high-resolution video signal decoding circuit,
704 is a switching circuit, 705 is a video signal output terminal, 7
06 is an audio decoding circuit, 707 is an audio output terminal, 708
Is an additional information decoding circuit, and 709 is an additional information output terminal.

Next, the operation will be described. Recording medium 70
The video code recorded in 1 is supplied to the low-resolution video decoding circuit 702 and the high-resolution video decoding circuit 703. The low-resolution video decoding circuit 702 and the high-resolution video decoding circuit 703 perform variable-length decoding, inverse quantization, and inverse orthogonal transform on the video codes supplied thereto, respectively.
The signal is decoded into the original video signal and supplied to the switching circuit 704.

If the video code supplied from the recording medium 701 is a low-resolution video, the switching circuit 704 selects a signal supplied from the low-resolution video decoding circuit 702 and outputs the video supplied from the recording medium 701. If the code is a high-resolution video, a signal supplied from the high-resolution video decoding circuit 703 is selected and output to the video signal output terminal 705.

The audio code recorded on the recording medium 701 is decoded into an audio signal by an audio decoding circuit 706 and output from an audio signal output terminal 707. Similarly, the additional information code recorded on the recording medium 701 is
An additional information signal is decoded by an additional information decoding circuit 708 and output from an additional information signal output terminal 709.

[0012]

In the above-described conventional example, when low-resolution moving images and high-resolution still images are mixedly processed, different coding is performed between the low-resolution moving images and the high-resolution still images. / The use of the decoding means required a large circuit scale. In general, the MPEG1 system is often used for encoding / decoding low-resolution moving images, and the JPEG system is often used for encoding / decoding high-resolution still images. Further, a recording medium on which a high-resolution still image is recorded by the above-described apparatus cannot be used at all by a conventional apparatus corresponding to only a low-resolution moving image.

As a simpler conventional configuration, there has been proposed an apparatus which divides a high-resolution still image into a plurality of low-resolution still images and shares a low-resolution encoding / decoding means. As a result, the image is distorted, folded, or shaken, so that the reproducibility when the image is reproduced by the conventional device is low. In particular, in the case of continuous reproduction in the same manner as in the case of a moving image, such distortion, folding, and shaking have occurred in the form of noise.

In view of the above background, an object of the present invention is to provide a low-resolution moving image and a high-resolution still image with a small circuit scale and without losing compatibility with a device supporting only low-resolution video. To enable high-efficiency encoding / decoding processing.

[0015]

In order to achieve the above object, in an encoding apparatus according to the present invention, an input means for selectively inputting a low-resolution image signal or a high-resolution image signal; A low-frequency extracting means for extracting a low-frequency component from the high-resolution image signal; a low-frequency encoding means for encoding the extracted low-frequency component or the input low-resolution image signal; High-frequency extraction means for extracting a high-frequency component from an image signal and high-frequency encoding means for encoding the extracted high-frequency component are provided.

Also, in the encoding method according to the present invention, a step of selectively inputting a low-resolution image signal or a high-resolution image signal, a step of extracting a low-frequency component from the input high-resolution image signal, Encoding the extracted low-frequency component or the input low-resolution image signal, extracting the high-frequency component from the input high-resolution image signal, and encoding the extracted high-frequency component Procedures are provided.

In the storage medium according to the present invention,
Processing for selectively inputting a low-resolution image signal or a high-resolution image signal, processing for extracting a low-frequency component from the input high-resolution image signal, and processing for extracting the low-frequency component or the input low resolution A program for executing a process of encoding an image signal, a process of extracting a high-frequency component from the input high-resolution image signal, and a process of encoding the extracted high-frequency component is stored.

Further, in the decoding apparatus according to the present invention, there is provided an input means for selectively inputting an encoded low-resolution image signal, or an encoded low-frequency image signal and an encoded high-frequency image signal. A low-frequency decoding means for decoding the encoded low-resolution image signal or the encoded low-frequency image signal; a high-frequency decoding means for decoding the encoded high-frequency image signal; A synthesizing means for synthesizing a decoded output when the low-frequency decoding means decodes the encoded low-frequency image signal and a decoded output from the high-frequency decoding means.

Also, in the decoding method according to the present invention, a step of selectively inputting an encoded low-resolution image signal, or an encoded low-frequency image signal and an encoded high-frequency image signal, A step of decoding the encoded low-resolution image signal or the encoded low-frequency image signal; a step of decoding the encoded high-frequency image signal; A step of combining the decoded output of the decoded low-frequency image signal with the decoded output of the high-frequency decoding means.

In another storage medium according to the present invention, there is provided a process for selectively inputting an encoded low-resolution image signal, or an encoded low-frequency image signal and an encoded high-frequency image signal. A process of decoding the encoded low-resolution image signal or the encoded low-frequency image signal; a process of decoding the encoded high-frequency image signal; A program for executing a process of synthesizing a decoded output obtained when the converted low-frequency image signal is decoded and a decoded output of the high-frequency decoding means is stored.

In another encoding apparatus according to the present invention, an encoding apparatus for storing an encoded moving image signal composed of n × m pixels in a moving image storage area of a recording medium has N × M pixels ( N> n, M> m), and a low-frequency extraction unit for extracting a still image signal of n × m pixels corresponding to a low frequency component thereof, and the extracted still image of n × m pixels Low-frequency encoding means for encoding a signal and storing the encoded signal in a moving image storage area of the recording medium;
High-frequency extraction means for extracting a high-frequency component of a still image signal composed of M pixels; high-frequency encoding means for encoding the extracted high-frequency component and storing the encoded high-frequency component in a storage area different from the moving image storage area of the recording medium; Is provided.

In another encoding method according to the present invention, a high-efficiency encoding method for storing an encoded moving image signal composed of n × m pixels in a moving image storage area of a recording medium comprises the steps of: Receiving a still image signal composed of pixels (N> n, M> m) and extracting a still image signal of n × m pixels corresponding to the low frequency component;
encoding a still image signal of m pixels and storing it in a moving image storage area of the recording medium, extracting a high frequency component of the still image signal composed of N × M pixels, and encoding the extracted high frequency component And storing the data in a storage area different from the moving image storage area of the recording medium.

In another storage medium according to the present invention, a program for executing encoding for storing an encoded moving image signal composed of n × m pixels in a moving image storage area of a recording medium is stored. Receiving a still image signal composed of N × M pixels (N> n, M> m) in a computer-readable storage medium and extracting an n × m pixel still image signal corresponding to a low-frequency component thereof; A process of encoding the extracted n × m pixel still image signal and storing the encoded still image signal in a moving image storage area of the recording medium; and a process of extracting a high frequency component of the still image signal composed of the N × M pixels.
A program for encoding the extracted high-frequency component and storing the encoded high-frequency component in a storage area different from the moving image storage area of the recording medium.

In another decoding apparatus according to the present invention, there is provided a decoding apparatus for decoding a video code stored in a moving image storage area of a recording medium and outputting a moving image signal composed of n × m pixels. A low-frequency decoding means for decoding a video code stored in a moving image storage area of the recording medium into a low-frequency component, and a high-frequency code extracted from a storage area different from the moving image storage area as a high-frequency component. High-frequency decoding means for decoding; and synthesizing means for synthesizing the decoded low-frequency component and high-frequency component and outputting a still image signal composed of N × M pixels (N> n, M> m). Is provided.

In another decoding method according to the present invention, there is provided a decoding method for decoding a video code stored in a moving image storage area of a recording medium and outputting a moving image signal composed of n × m pixels. A procedure for decoding a video code stored in a moving image storage area of the recording medium into a low frequency component, and a procedure for decoding a high frequency code extracted from a storage area different from the moving image storage area into a high frequency component. And the decoded low frequency component and high frequency component are synthesized, and N × M
Outputting a still image signal composed of pixels (N> n, M> m).

In another storage medium according to the present invention, a video code stored in a moving image storage area of the recording medium is decoded, and decoding is performed to output a moving image signal composed of n × m pixels. Processing for decoding a video code stored in a moving image storage area of the recording medium into a low frequency component in a computer readable storage medium storing a program for storing the program, from a storage area different from the moving image storage area. A process of decoding the extracted high-frequency code into a high-frequency component, combining the decoded low-frequency component and the high-frequency component, and forming a still image signal composed of N × M pixels (N> n, M> m) Output processing is stored.

In another encoding apparatus according to the present invention, the input means for selectively inputting a first image signal or a second image signal having a higher resolution than the first image signal; Separation means for separating the low frequency component and the high frequency component from the second image signal, and first encoding means for encoding the first image signal or the low frequency component image signal separated by the separation means. And a second encoding unit that encodes the image signal of the high frequency component separated by the separation unit.

In another encoding method according to the present invention, the first image signal or the second image signal having a higher resolution than the first image signal is selectively inputted, and the second image signal is inputted. The signal is separated into a low-frequency component and a high-frequency component, the first image signal or the separated low-frequency component image signal is encoded, and the separated high-frequency component image signal is encoded. I have.

In another decoding apparatus according to the present invention, a low-frequency component and a high-frequency component are separated from the first image signal, and the resolution of the low-frequency component image signal is converted and encoded. A decoding apparatus for encoding an image signal of a high-frequency component and decoding an image signal of a low-frequency component and an image signal of a high-frequency component independently encoded, wherein the image of the encoded low-frequency component is A first decoding unit for decoding a signal, a second decoding unit for decoding the encoded high-frequency component image signal, and an image signal decoded by the first decoding unit. Synthesizing means for synthesizing the image signal decoded by the second decoding means.

[0030]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing a high efficiency coding apparatus according to an embodiment of the present invention. In FIG.
101 is a video signal input terminal, 102 is a switching circuit, 1
03 is a low-resolution video encoding circuit, 104 is a recording medium, 1
05 is a low-pass filter, 106 is a high-pass filter,
107 is a high frequency encoding circuit, 108 is an additional information encoding circuit, 109 is an additional information input terminal, 110 is an audio signal input terminal, and 111 is an audio encoding circuit.

Next, the operation will be described. First, a case where a low-resolution moving image is input to the video input terminal 101 will be described. The low-resolution video signal supplied to the video input terminal 101 is supplied to the low-resolution video encoding circuit 103 via the switching circuit 102. The low-resolution video coding circuit 103 performs orthogonal transformation, quantization, and variable-length coding, compresses the amount of information, and records it on the recording medium 104.

The additional information signal supplied to the additional information input terminal 109 and the audio signal supplied to the audio signal input terminal 110 are supplied to an additional information encoding circuit 108 and an audio encoding circuit 111, respectively. After that, it is recorded on the recording medium 104.

As a result of the above processing, each code is stored in each storage area of each frame of the recording medium 104 in a form as shown in FIG.

Next, a case where a high-resolution still image is input to the video input terminal 101 will be described. The high-resolution video signal supplied to the video input terminal 101 is supplied to a low-pass filter 105 and a high-pass filter 106. The low-pass filter 105 extracts a low-frequency component of the supplied high-resolution video signal, converts the low-frequency component into a low-resolution video signal having the same number of pixels as the low-resolution moving image, and supplies the low-resolution video signal to the switching circuit 102.

The switching circuit 102 supplies the video signal supplied from the low-pass filter 105 to the low-resolution video encoding circuit 103. Low resolution video encoding circuit 103
Performs orthogonal transform, quantization, and variable length coding on the video signal, compresses the amount of information, and records it on the recording medium 104.

On the other hand, the high-pass filter 106 extracts a high-frequency component of the supplied high-resolution video signal and supplies it to the high-frequency encoding circuit 107. The high band encoding circuit 107
The information amount of the supplied signal is compressed and supplied to the additional information encoding circuit 108. The additional information encoding circuit 108 encodes the additional information signal supplied from the additional information input terminal 109 and the signal supplied from the high frequency encoding circuit 107, and records them on the recording medium 104.

The audio signal supplied to the audio signal input terminal 110 is encoded by the audio encoding circuit 111 and recorded on the recording medium 104.

As a result of the above processing, each code is stored in each storage area of each frame of the recording medium 104 in a form as shown in FIG.

The discriminating information for discriminating whether a low-resolution image or a high-resolution image is supplied to the image input terminal 101 is obtained from the additional information input terminal 109.
And recorded on the recording medium 104. By recording this discrimination information for each frame, a low-resolution moving image and a high-resolution still image can coexist in the same recording medium. When a still image is input, the encoded data output from the low-resolution video encoding circuit 103 is continuously stored over a plurality of frames in the moving image storage area of the recording medium, and output from the high-frequency encoding circuit 107. The encoded data thus divided may be divided and recorded in the additional information storage area of the plurality of frames.

FIG. 2 shows a second embodiment of the high efficiency coding apparatus. This embodiment is an apparatus that can input a high-resolution still image having a plurality of types of pixels. In FIG. 2, 2
01 is a video input terminal, 202 is a switching circuit, 203 is a low-resolution video encoding circuit, 204 is a recording medium, 205 is a low-pass filter, 206 is a high-pass filter, 207
Is a high frequency encoding circuit, 208 is an additional information encoding circuit, 20
9 is an additional information input terminal, 210 is an audio signal input terminal, 2
Reference numeral 11 denotes a speech encoding circuit, and reference numeral 212 denotes an enlargement circuit.

Next, the operation will be described. First, a case where a low-resolution moving image is input to the video input terminal 201 will be described. The low-resolution video signal supplied to the video input terminal 201 is supplied to the low-resolution video encoding circuit 203 via the switching circuit 202. The low-resolution video encoding circuit 203 subjects the video signal to orthogonal transformation, quantization, and variable-length encoding, compresses the amount of information, and
Record in 4.

The additional information signal supplied to the additional information input terminal 209 and the audio signal supplied to the audio signal input terminal 210 are supplied to an additional information encoding circuit 208 and an audio encoding circuit 211, respectively. After that, it is recorded on the recording medium 204. That is, processing for a low-resolution moving image is exactly the same as in the first embodiment.

Next, a case where a high-resolution still image is input to the video input terminal 201 will be described. The high-resolution video signal supplied to the video input terminal 201 is supplied to the enlargement circuit 212. The enlargement circuit 212 performs enlargement processing on the supplied still images having a plurality of types of pixels and converts the still images into a single number of pixels. That is, even if the supplied high-resolution still image is 1280 × 960 pixels, it is 1152 × 86.
Even if the number of pixels is four or 1024 × 768 pixels, the enlargement circuit 212 allows all pixels to have a predetermined number,
For example, it is enlarged to 1440 × 960 pixels so that the subsequent processing is performed in a unified manner.

The still image enlarged by the enlargement circuit 212 is
Low-pass filter 205 and high-pass filter 206
Supplied to The low-pass filter 205 extracts the low-frequency component of the supplied high-resolution video signal, converts the low-frequency component into a low-resolution video signal having the same number of pixels as the low-resolution video, and supplies the low-resolution video signal to the switching circuit 202.

The switching circuit 202 supplies the video signal supplied from the low-pass filter 205 to the low-resolution video encoding circuit 203. Low resolution video coding circuit 203
Performs orthogonal transform, quantization, and variable length coding on the video signal, compresses the information amount, and records the information amount on the recording medium 204.

On the other hand, the high-pass filter 206 extracts a high-frequency component of the supplied high-resolution video signal and supplies it to the high-frequency encoding circuit 207. The high band encoding circuit 207
The information amount of the supplied signal is compressed and supplied to the additional information encoding circuit 208. The additional information encoding circuit 208 encodes the additional information signal supplied from the additional information input terminal 209 and the signal supplied from the high frequency encoding circuit 207 and records them on the recording medium 204.

The audio signal supplied to the audio signal input terminal 210 is encoded by the audio encoding circuit 211 and recorded on the recording medium 204.

The discrimination information for discriminating whether a low-resolution video or a high-resolution video is supplied to the video input terminal 201 and the number of pixels of the high-resolution video are input to additional information input. The data is supplied from the terminal 209 and recorded on the recording medium 204. By recording this discrimination information for each frame, a low-resolution moving image and a high-resolution still image can coexist in the same recording medium.

FIG. 3 shows a third embodiment of the high efficiency coding apparatus. In FIG. 3, reference numeral 301 denotes a video input terminal;
02 is a switching circuit, 303 is a low-resolution video encoding circuit, 304 is a recording medium, 305 is a low-pass filter,
06 is a high-pass filter, 307 is a high-frequency encoding circuit, 3
08 is an additional information encoding circuit, 309 is an additional information input terminal, 310 is an audio signal input terminal, 311 is an audio encoding circuit, and 312 is an enlargement circuit.

Next, the operation will be described. First, a case where a low-resolution moving image is input to the video input terminal 301 will be described. The low-resolution video signal supplied to the video input terminal 301 is supplied to the low-resolution video encoding circuit 303 via the switching circuit 302. The low-resolution video encoding circuit 303 performs orthogonal transformation, quantization, and variable-length encoding, compresses the amount of information, and records it on the recording medium 304.

The additional information signal supplied to the additional information input terminal 309 and the audio signal supplied to the audio signal input terminal 310 are supplied to an additional information encoding circuit 308 and an audio encoding circuit 311, respectively. After that, it is recorded on the recording medium 304.

Next, a case where a high-resolution still image is input to the video input terminal 301 will be described. The high-resolution video signal supplied to the video input terminal 301 is supplied to the enlargement circuit 312. The enlargement circuit 312 enlarges the supplied still image having a plurality of types of pixels and converts it into a single number of pixels.

The still image enlarged by the enlargement circuit 312 is
It is supplied to a low-pass filter 305 and a high-pass filter 306. The low-pass filter 306 extracts a low-frequency component of the supplied high-resolution video signal, converts the low-frequency component into a low-resolution video signal having the same number of pixels as the low-resolution moving image, and supplies the same to the switching circuit 302.

The switching circuit 302 supplies the video signal supplied from the low-pass filter 306 to the low-resolution video encoding circuit 303. Low resolution video coding circuit 303
Performs orthogonal transformation, quantization, and variable-length coding on the video signal, compresses the amount of information, and records it on the recording medium 304.

On the other hand, the high-pass filter 306 extracts a high-frequency component of the supplied high-resolution video signal, and supplies it to the high-frequency encoding circuit 307. The high band encoding circuit 307
The information amount of the supplied signal is compressed, and the audio
Feed to 1. The audio encoding circuit 311 encodes the signal supplied from the high-frequency encoding circuit 307 and records the signal in a part or the entirety of an area for audio recording in the recording medium 304 according to the information amount.

That is, when the amount of information is large, four channels, which is the total number of audio recording areas, are used for recording high frequency components. When the amount of information is small, only two channels are used for recording high frequency components.

The additional information supplied to the additional information input terminal 309 is encoded by the additional information encoding circuit 308 and recorded on the recording medium 304.

As a result of the above processing, each code is stored in each storage area of each frame of the recording medium 304 in a form as shown in FIG.

The discrimination information for discriminating whether a low-resolution video or a high-resolution video is supplied to the video input terminal 301 and the number of pixels of the high-resolution video are input to additional information input. The data is supplied from the terminal 309 and recorded on the recording medium 304. By recording this discrimination information for each frame, it is possible to allow a low-resolution moving image and a high-resolution still image to coexist in the same recording medium.

The encoding device according to each of the embodiments described above is an encoding device that stores an encoded moving image signal composed of n × m pixels in a moving image storage area of a recording medium. In this encoding apparatus, the low-pass filter receives a still image signal composed of N × M pixels (N> n, M> m) and converts the still image signal of n × m pixels corresponding to the low-frequency component into the still image signal. Extract and supply to low-resolution video encoding circuit. Further, the low-resolution video encoding circuit encodes the extracted still image signal of n × m pixels and continuously stores the extracted still image signal in a moving image storage area of the recording medium over k (k> 0) frames.

Further, the high-pass filter is provided with the N ×
A high frequency component of a still image signal composed of M pixels is extracted.
The high-frequency encoding circuit encodes the extracted high-frequency component and stores the encoded high-frequency component in a storage area of the recording medium different from the moving image storage area.

In addition, the above-described enlargement circuit includes an i × j pixel (i>
n, j> m), and expands the still image signal into a still image of N × M pixels (N ≧ i, M ≧ j), and the low-pass filter and the high-pass filter To supply.

Further, the high-pass filter is provided with the N ×
A signal sequence LH composed of a horizontal low band and a vertical high region, a signal sequence HL composed of a horizontal high region and a vertical low region, and a horizontal high region of a still image signal composed of M pixels. And a signal train HH composed of high frequencies in the vertical direction.

Further, the high-pass filter converts the high-frequency component into n × (M−m) information strings and (N−
You may make it extract as n) * m information sequences and (N-n) * (Mm) information sequences. Also, N = 2
× n, M = 2 × m.

The discrimination information indicates whether or not a signal extracted from the still image signal composed of the N × M pixels is stored, and this discrimination information is stored in the recording medium.

The encoded output of the high-frequency encoding circuit is stored in a subcode storage area or a video auxiliary data storage area of the additional information storage area of the recording medium.

FIG. 5 is a block diagram showing a decoding apparatus according to the embodiment of the present invention. 5, reference numeral 501 denotes a recording medium, 502 denotes a low-resolution video decoding circuit, 503 denotes a switching circuit, 504 denotes a video output terminal, 505 denotes a high-frequency decoding circuit, 506 denotes a synthesis circuit, 507 denotes a reduction circuit, and 507 denotes a reduction circuit.
8 is an audio decoding circuit, 509 is an audio output terminal, 510 is an additional information decoding circuit, and 511 is an additional information output terminal.

Next, the operation will be described. First, a case where a normal low-resolution moving image is stored in the recording medium 501 according to the third embodiment will be described. That is, in each storage area of each frame of the recording medium 501, a code is stored in a form as shown in FIG. The low-resolution video code recorded in the video storage area of the recording medium 501 is supplied to the low-resolution video decoding circuit 502, where it is subjected to variable-length decoding, inverse quantization, inverse orthogonal transform, and a switching circuit 503. Supplied to

The switching circuit 503 outputs the video signal supplied from the low-resolution video decoding circuit 502 to the video signal output terminal 504. Also, the audio code recorded in the audio storage area of the storage medium 501 is
8 and is decoded into an audio signal.
09 is output. Further, the additional information recorded in the additional information storage area of the recording medium is supplied to the additional information decoding circuit 510, decoded into additional information, and output from the additional information output terminal 511.

Next, a case where a high-resolution still image is stored in the recording medium 501 according to the third embodiment will be described. That is, in each storage area of each frame of the recording medium 501, a code is stored in a form as shown in FIG. The low-frequency code recorded on the recording medium 501 is supplied to a low-resolution video decoding circuit 502, where the low-frequency code is subjected to variable-length decoding, inverse quantization, and inverse orthogonal transform.
6.

The high-frequency code recorded in the voice storage area of the recording medium 501 is supplied to the high-frequency decoding circuit 505, and the voice code is supplied to the voice decoding circuit 508.
The high band decoding circuit 505 decodes the supplied high band code and supplies the decoded high band code to the synthesis circuit 506. Voice decoding circuit 508
Decodes the supplied audio code and outputs an audio output terminal 509
Output to

The synthesizing circuit 506 includes the low-frequency component supplied from the low-resolution video decoding circuit 502 and the high-frequency decoding circuit 5.
A high-resolution still image is generated by synthesizing the high-frequency component supplied from the signal generator 05 and supplied to the reduction circuit 507. The reduction circuit 507 reduces the supplied high-resolution still image to the number of pixels before encoding, and outputs the reduced number of pixels to the video output terminal 504 via the switching circuit 503.

The additional information code recorded in the additional information storage area of the recording medium 501 is supplied to the additional information decoding circuit 510, decoded into additional information, and output to the additional information output terminal 511.

The decoding apparatus described above decodes the video code stored in the moving image storage area of the recording medium to obtain nx
This is a decoding device that outputs a moving image signal composed of m pixels. In this decoding device, the low-resolution video decoding circuit decodes a video code stored in a moving image storage area in k (k> 0) frames of the recording medium into a low-frequency component. The high-frequency decoding circuit decodes a high-frequency code extracted from a storage area different from the moving image storage area in the k frames into high-frequency components. The combining circuit combines the decoded low-frequency component and high-frequency component, and outputs a still image signal composed of N × M pixels (N> n, M> m).

Next, a storage medium according to another embodiment of the present invention will be described. The object of the present invention can be achieved by a hardware configuration, and can also be achieved by a computer system including a CPU and a memory. When the present invention is implemented by a computer system, the memory constitutes a storage medium according to the present invention.

That is, a storage medium storing a program code of software for executing the operation described in each of the above embodiments is used in a system or an apparatus, and the CPU of the system or apparatus is stored in the storage medium. By reading and executing the program code, the object of the present invention can be achieved.

The storage medium includes ROM, R
Semiconductor memory such as AM, optical disk, magneto-optical disk,
A magnetic medium or the like may be used, and these may be configured and used in a CD-ROM, a floppy disk, a magnetic medium, a magnetic card, a nonvolatile memory card, or the like.

Therefore, this storage medium is shown in FIGS.
The functions equivalent to those of the above-described embodiments can also be performed by using a system or a computer other than the system or the apparatus described in the above, and reading or executing the program code stored in the storage medium by the system or the computer. This can be realized and the same effect can be obtained, so that the object of the present invention can be achieved.

An OS running on a computer
When performing part or all of the processing, or after the program code read from the storage medium is written to a memory provided in an extended function board or an extended function unit connected to the computer, Even when the CPU or the like provided in the above-mentioned extended function board or extended function unit performs a part or all of the processing based on the instruction of the program code, the same functions as those of the embodiments can be realized and the same effects can be obtained. Can be obtained, and the object of the present invention can be achieved.

[0080]

As described above, according to the encoding of the present invention, a high-resolution image signal and a low-resolution image signal can be selectively encoded. Since the means and the means for encoding the low-frequency component of the high-resolution image signal are shared, the circuit scale can be reduced.

According to another encoding method of the present invention, a low-frequency component is extracted from a high-resolution still image, and this low-frequency component is encoded in the same manner as one low-resolution moving image, so that a low-resolution moving image is recorded. While storing in the low-resolution moving image area, a high-frequency component is extracted from the high-resolution still image, the high-frequency component is encoded, and the recording is separated into a recording area separate from the recording area for storing the low-resolution moving image, and recorded. With this configuration, existing low-resolution moving image processing can be used as it is as low-frequency component processing in encoding high-resolution still images. Can be.

Further, according to the decoding of the present invention, the encoded high-resolution image signal and the encoded low-resolution image signal can be selectively decoded. Since the decoding means and the decoding means for the low-frequency component of the high-resolution image signal are shared, the circuit scale can be reduced.

Further, according to another decoding method of the present invention, by decoding only the storage area of a low-resolution moving image, an existing device that can handle only a low-resolution moving image can reproduce a low-frequency component as a still image. .

As described in the second embodiment,
By converting an input high-resolution image signal or still image signal into a predetermined number of pixels, encoding / decoding processing independent of the number of pixels of the high-resolution image signal or still image signal can be performed.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a first embodiment of a high efficiency coding apparatus according to the present invention.

FIG. 2 is a block diagram showing a second embodiment of the high efficiency coding apparatus according to the present invention.

FIG. 3 is a block diagram showing a third embodiment of the high efficiency coding apparatus according to the present invention.

FIG. 4 is a configuration diagram showing a code storage state in a storage area of a recording medium according to the first to third embodiments.

FIG. 5 is a block diagram showing an embodiment of a high-efficiency decoding device according to the present invention.

FIG. 6 is a block diagram showing a conventional high efficiency coding apparatus.

FIG. 7 is a block diagram showing a conventional high-efficiency decoding device.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 101 Video signal input terminal 102 Switching circuit 103 Low-resolution video encoding circuit 104 Recording medium 105 Low-pass filter 106 High-pass filter 107 High-frequency encoding circuit 108 Additional information encoding circuit 109 Additional information input terminal 110 Audio signal input terminal 111 Audio Coding Circuit 201 Video Signal Input Terminal 202 Switching Circuit 203 Low Resolution Video Coding Circuit 204 Recording Medium 205 Low Pass Filter 206 High Pass Filter 207 High Band Coding Circuit 208 Additional Information Coding Circuit 209 Additional Information Input Terminal 210 Audio signal input terminal 211 Audio encoding circuit 212 Enlargement circuit 501 Recording medium 502 Low resolution video decoding circuit 503 Switching circuit 504 Video signal output terminal 505 High frequency decoding circuit 506 Synthesis circuit 507 Reduction circuit 508 Audio decoding Circuit 509 audio signal output terminal 510 additional information decoding circuit 511 additional information output terminal

Continued on front page F-term (reference) 5C053 FA07 FA14 FA21 FA23 FA27 GB23 GB26 GB27 GB33 KA04 KA08 KA12 KA13 KA28 LA11 5C059 KK07 KK37 LB05 MA21 MA32 MC11 ME01 PP01 PP04 SS20 SS30 UA02 UA05 UA12 UA14 UA38 UA39

Claims (43)

[Claims] An input means for selectively inputting a low-resolution image signal or a high-resolution image signal; a low-frequency extraction means for extracting a low-frequency component from the input high-resolution image signal; Low-frequency encoding means for encoding a frequency component or the input low-resolution image signal; high-frequency extraction means for extracting a high-frequency component from the input high-resolution image signal; encoding the extracted high-frequency component And a high frequency encoding means for encoding. 2. The image processing apparatus according to claim 1, further comprising a conversion unit that converts the input high-resolution image signal into a predetermined number of pixels and supplies the predetermined number of pixels to the low-band extraction unit and the high-band extraction unit.
An encoding device according to claim 1. 3. The encoding apparatus according to claim 1, further comprising recording means for recording each encoded output of said low-frequency encoding means and said high-frequency encoding means in separate areas of a recording medium. apparatus. 4. An audio encoding means for encoding an audio signal, wherein the recording means stores the encoded audio signal and an encoded output of the high-frequency encoding means in a common area of the recording medium. 4. The encoding device according to claim 3, wherein the information is recorded in the encoding device. 5. An additional information encoding means for encoding additional information added to the low-resolution image signal and the high-resolution image signal, wherein the recording means comprises: the encoded additional information and the high-frequency code. 4. The encoding apparatus according to claim 3, wherein the encoded output of the encoding means is recorded in a common area of the recording medium. 6. A step of selectively inputting a low-resolution image signal or a high-resolution image signal; a step of extracting a low-frequency component from the input high-resolution image signal; A step of encoding the input low-resolution image signal; a step of extracting a high-frequency component from the input high-resolution image signal; and a step of encoding the extracted high-frequency component. Encoding method to be used. 7. A procedure for converting the input high-resolution image signal into a predetermined number of pixels and providing a procedure for extracting the low-frequency component and a procedure for extracting the high-frequency component. The encoding method according to claim 6. 8. A process for selectively inputting a low-resolution image signal or a high-resolution image signal; a process for extracting a low-frequency component from the input high-resolution image signal; A program for executing a process of encoding an input low-resolution image signal, a process of extracting a high-frequency component from the input high-resolution image signal, and a process of encoding the extracted high-frequency component A stored computer-readable storage medium. 9. The program according to claim 1, wherein a process for converting the input high-resolution image signal into a predetermined number of pixels and giving the process of extracting the low-frequency component and the process of extracting the high-frequency component is provided in the program. 9. The computer-readable storage medium according to claim 8, wherein: 10. An input means for selectively inputting an encoded low-resolution image signal, or an encoded low-frequency image signal and an encoded high-frequency image signal, and said encoded low-resolution image A low-band decoding unit that decodes the signal or the encoded low-frequency image signal; a high-band decoding unit that decodes the encoded high-frequency image signal; A decoding device comprising: a synthesizing means for synthesizing a decoded output obtained by decoding the obtained low-frequency image signal and a decoded output of the high-frequency decoding means. 11. The low-frequency image signal and the encoded high-frequency image signal are obtained by converting an original image signal into a predetermined number of pixels, and outputting an output of the synthesizing means to the image signal having the original number of pixels. 11. The decoding device according to claim 10, further comprising a conversion unit that converts the data into a data. 12. A step of selectively inputting an encoded low-resolution image signal, or an encoded low-frequency image signal and an encoded high-frequency image signal, and said encoded low-resolution image signal. Or a procedure for decoding the encoded low-frequency image signal; a procedure for decoding the encoded high-frequency image signal; and a decoded output of the encoded low-frequency image signal and the high-frequency image signal. Combining the decoded output with the decoded output. 13. The low-frequency image signal and the encoded high-frequency image signal are obtained by converting an original image into a predetermined number of pixels. The output of the synthesizing procedure is converted to an image signal having the original number of pixels. 13. The decoding method according to claim 12, further comprising a step of converting. 14. A process for selectively inputting an encoded low-resolution image signal, or an encoded low-frequency image signal and an encoded high-frequency image signal, and the encoded low-resolution image signal Or a process of decoding the encoded low-frequency image signal; a process of decoding the encoded high-frequency image signal; and a decoding output of the encoded low-frequency image signal and the high-frequency image signal. A computer-readable storage medium storing a program for executing a process of combining a decoded output. 15. The low-frequency image signal and the encoded high-frequency image signal are obtained by converting an original image signal into a predetermined number of pixels. 15. The computer-readable storage medium according to claim 14, wherein a process of converting into a program is provided in the program. 16. An encoding apparatus for storing an encoded moving image signal composed of n × m pixels in a moving image storage area of a recording medium, comprising: a still image composed of N × M pixels (N> n, M> m). Low-frequency extraction means for receiving an image signal and extracting a still image signal of n × m pixels corresponding to the low frequency component; encoding the extracted still image signal of n × m pixels; Low-frequency encoding means for storing in a storage area; high-frequency extracting means for extracting high-frequency components of a still image signal composed of the N × M pixels; encoding the extracted high-frequency components to store a moving image in the recording medium An encoding device comprising: high-frequency encoding means for storing data in a storage area different from the area. 17. A still image signal composed of i × j pixels (i> n, j> m) is received, and the still image signal is converted into N × M
17. The encoding apparatus according to claim 16, further comprising a conversion unit that converts a still image of pixels (N≥i, M≥j) and supplies the still image to the low band extraction unit and the high band extraction unit. 18. A high-frequency extracting means, comprising: a signal sequence LH comprising a horizontal low frequency and a vertical high frequency of a still image signal composed of the N × M pixels; 17. The encoding apparatus according to claim 16, wherein a signal sequence HL composed of a low frequency band and a signal sequence HH composed of a high frequency region in a horizontal direction and a high frequency region in a vertical direction are extracted. 19. The high-frequency extraction means converts the high-frequency component into n × (Mm) information strings, (Nn) × m information strings, and (N−n) × ( 17. The encoding apparatus according to claim 16, wherein the information is extracted as Mm) information strings. 20. The encoding apparatus according to claim 16, wherein N = 2 × n and M = 2 × m. 21. A recording apparatus according to claim 16, further comprising means for storing discrimination information indicating whether or not a signal extracted from the still image signal composed of said N × M pixels is stored in said recording medium. Encoding device. 22. The encoding apparatus according to claim 16, wherein a storage area of said recording medium different from said moving image storage area is a subcode storage area. 23. The encoding apparatus according to claim 16, wherein a storage area of said recording medium different from said moving image storage area is a video auxiliary data storage area. 24. The encoding apparatus according to claim 16, wherein a storage area of said recording medium different from said moving image storage area is an audio storage area. 25. An encoding method for storing an encoded moving image signal composed of n × m pixels in a moving image storage area of a recording medium, comprising: a still image composed of N × M pixels (N> n, M> m). A procedure for receiving an image signal and extracting a still image signal of n × m pixels corresponding to the low-frequency component; and encoding the extracted still image signal of n × m pixels in a moving image storage area of the recording medium. A procedure for storing, a procedure for extracting a high-frequency component of the still image signal composed of the N × M pixels, a procedure for encoding the extracted high-frequency component, and storing the encoded high-frequency component in a storage area different from the moving image storage area of the recording medium An encoding method characterized by comprising: 26. A still image signal composed of i × j pixels (i> n, j> m) is received, and the still image signal is converted into N × M
26. The method according to claim 25, further comprising providing a procedure for converting the image into a still image of pixels (N≥n, M≥j) to extract the low frequency component and a procedure for extracting the high frequency component. Encoding method. 27. A computer-readable storage medium storing a program for executing encoding for storing an encoded moving image signal composed of n × m pixels in a moving image storage area of a recording medium, comprising: A process of receiving a still image signal consisting of M pixels (N> n, M> m) and extracting a still image signal of n × m pixels corresponding to a low frequency component thereof; A process of encoding a signal and storing it in a moving image storage area of the recording medium; a process of extracting a high-frequency component of a still image signal composed of the N × M pixels; A computer-readable storage medium storing a program for executing a process of storing a moving image in a storage area different from the moving image storage area. 28. Receiving a still image signal composed of i × j pixels (i> n, j> m), and converting the still image signal into N × M
3. The program according to claim 1, wherein a procedure for converting the image into a still image of pixels (N.gtoreq.n, M.gtoreq.j) and extracting the low-frequency component and the process of extracting the high-frequency component is provided in the program. 28. The computer-readable storage medium according to claim 27. 29. A decoding device for decoding a video code stored in a moving image storage area of a recording medium and outputting a moving image signal composed of n × m pixels, wherein the decoding is performed in the moving image storage area of the recording medium. A low-frequency decoding means for decoding the obtained video code into a low-frequency component; a high-frequency decoding means for decoding a high-frequency code extracted from a storage area different from the moving image storage area into a high-frequency component; Synthesizes the decoded low frequency component and high frequency component,
A decoding device for outputting a still image signal composed of N × M pixels (N> n, M> m). 30. A decoding method for decoding a video code stored in a moving image storage area of a recording medium and outputting a moving image signal composed of n × m pixels, wherein the decoding is performed in the moving image storage area of the recording medium. Decoding the decoded video code into a low-frequency component, decoding the high-frequency code extracted from a storage area different from the moving image storage area into a high-frequency component, and decoding the decoded low-frequency component. Synthesizes high frequency components,
Outputting a still image signal composed of N × M pixels (N> n, M> m). 31. A computer readable program storing a program for decoding a video code stored in a moving image storage area of a recording medium and outputting a moving image signal composed of n × m pixels. In the storage medium, a process of decoding a video code stored in a moving image storage area of the recording medium into a low-frequency component, and decoding a high-frequency code extracted from a storage area different from the moving image storage area into a high-frequency component. And combining the decoded low-frequency component and high-frequency component,
And outputting a still image signal composed of N × M pixels (N> n, M> m). 32. An input means for selectively inputting a first image signal or a second image signal having a higher resolution than the first image signal, and a low frequency component and a high frequency component from the second image signal. Separating means for separating the first image signal or the low-frequency component image signal separated by the separating means; and a high-frequency component separated by the separating means. A second encoding unit that encodes the image signal. 33. The encoding apparatus according to claim 32, wherein said separation means converts the resolution of the low frequency component image signal to be equal to the resolution of the first image signal. 34. The encoding apparatus according to claim 32, wherein said input means includes a conversion means for converting said second image signal into an image signal having a predetermined resolution. 35. Recording means for recording an image signal encoded by the first encoding means and an image signal encoded by the second encoding means on a recording medium. An encoding device according to any one of claims 32 to 34. 36. Audio input means for inputting an audio signal,
Third encoding means for encoding the audio signal,
36. The encoding apparatus according to claim 35, wherein the recording unit records the audio signal encoded by the third encoding unit on the recording medium. 37. The recording means, wherein the audio signal coded by the third coding means and the image signal coded by the first coding means are separately stored on the recording medium. 37. The encoding apparatus according to claim 36, wherein an image signal recorded in a recording area and encoded by the second encoding unit is recorded in a recording area of the audio signal. 38. The encoding method according to claim 32, wherein the first image signal is a moving image signal, and the second image signal is a still image signal. apparatus. 39. A first image signal or a second image signal having a higher resolution than the first image signal is selectively inputted, and a low-frequency component and a high-frequency component are separated from the second image signal. An encoding method comprising: encoding the first image signal or the image signal of the separated low-frequency component; and encoding the image signal of the separated high-frequency component. 40. A low-frequency component and a high-frequency component are separated from the first image signal, the resolution of the low-frequency component image signal is converted and encoded, and the high-frequency component image signal is encoded. A decoding device for decoding an image signal of a low-frequency component and an image signal of a high-frequency component which are encoded in the decoding device, wherein the first decoding means decodes the encoded image signal of the low-frequency component A second decoding unit for decoding the encoded high-frequency component image signal; an image signal decoded by the first decoding unit; and a second decoding unit decoding the image signal decoded by the second decoding unit. A synthesizing means for synthesizing the decoded image signal. 41. The decoding apparatus according to claim 40, wherein said first image signal is converted so as to be an image signal having a predetermined resolution. 42. The decoding apparatus according to claim 41, further comprising a conversion unit for converting the resolution of the image signal output from said combining unit. 43. An encoded second image signal having a resolution lower than that of the first image signal is input, and the first decoding means performs the encoding with the encoded second image signal and the code. 41. The decoding device according to claim 40, wherein the decoding device selectively decodes the converted low frequency component image signal.