JPH09107544A - Coding/decoding device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To attain decoding efficiently in a short time by comparing received coding information with information corresponding to a tool thereby selecting an optimum tool in the case of decoding the received coding information with the tool received at the same. SOLUTION: A coding processing capability received by a decoder 14 is stored in a coding processing capability storage section 17 in the unit of tools being components of the algorithm. An output of a decoding processing capability storage section 18 and total sum of processing capability of the tools being components of the algorithm are both given to a capability comparator section 19. The capability comparator section 19 compares them so as to discriminate whether or not the processing of the algorithm using the received tools is available in its own device. When the processing is discriminated available, an enable signal is fed to a tool storage control section 15, received tools are stored in a tool storage section 16 and the tools are used for decoding the received data.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a coding / decoding device for coding and transmitting information such as image signals and decoding the coded information.

[0002]

2. Description of the Related Art In recent years, ISDN (Integrated Services Di
The image communication service has been realized as a new communication service due to the spread of the gital network (service integrated digital network). Examples are a videophone and a video conference system. Further, with the development of wireless transmission networks represented by PHS and FPLMTS, demands for further sophistication, diversification and portability of services are rapidly increasing.

Generally, in the case of transmitting image information like a videophone or a video conference system, the amount of image information is enormous, but the transmission speed of the line used for transmission and the cost of the image to be transmitted It becomes necessary to compress and encode the amount of information and reduce the amount of information before transmission.

As a coding method for compressing image information, a still picture coding method such as JPEG (Joint Photographic) is used.
Coding Experts Group), H.264 as a moving image coding method. 261, MPEG as a moving image encoding method for storage
(Moving Picture Coding ExpertGroup) 1, MPEG
2 has already been internationally standardized. 64 kbps
MPEG as an encoding method at the following ultra-low bit rate
4 standardization activities are underway.

Since MPEG4 can flexibly support a wide variety of applications and can be coded by an optimum method for each application, existing JPEG,
H. It is not a system that performs coding according to an algorithm like the H.261, MPEG1, MPEG2 coding system, but prepares a large number of each tool (converter, quantizer, inverse transformer, inverse quantizer, etc.) of the encoder. , It is necessary that the method be such that encoding is performed by an appropriate combination thereof.

[0006] FIG. 261 is a data string of encoded output information encoded by H.261, and FIG. 19B is a data string of encoded output information encoded by an encoding method with a flexible algorithm. In the case of FIG. 11B,
Since the combination of each tool of the encoder can be freely selected, it is necessary to transmit information about which tool was used for encoding together with the encoding output information. In FIG. 11, the motion compensation tool A, the inverse transformation tool B, the motion compensation tool C, the inverse transformation tool D, and the quantization tool E are the tool information, and the following motion vector information 10
1, the transform coefficient 102, the motion vector information 103, the transform coefficient 104, and the quantization step 105 are processed data.

FIG. 12 shows the H.264 standard. FIG. 26 is a block diagram showing an example of a conventional encoding / decoding device according to H.261. This encoding / decoding device includes a control unit 106 for controlling the entire device and an H
An encoder 107 for encoding according to H.261,
Decoder 108 that decodes the information encoded in step S1 and tool storage unit 109 that includes a memory that stores the tool information
It is a configuration provided with:

Considering the configurations for implementing these encoding algorithms, there are a method implemented by implementing dedicated hardware and software and a method implemented by executing appropriate software on a general-purpose arithmetic unit. Conceivable. FIG. 13 is a block diagram of the encoder 107. The encoder 107 includes an encoding control unit 111 that performs encoding control, a conversion unit 112 that performs DCT conversion, a quantization unit 113 that quantizes the coefficient converted by the conversion unit, and an inverse of the quantized coefficient. Inverse quantization unit 114 for performing quantization, inverse transform unit 115 for performing inverse DCT conversion, memory 116 having a variable delay function for motion compensation used in motion compensation inter-frame prediction, in a loop that can be turned on / off for each macroblock It is composed of a filter 117. When this algorithm is implemented by dedicated hardware and software, the encoding control unit 111 and the conversion unit 11 that are tools are used.
2, quantizer 113, inverse quantizer 114, inverse transformer 11
5, the memory 116 having the delay function for motion compensation, and the loop filter 117 have dedicated hardware and software.

FIG. 14 shows a block diagram of the decoder 108. H. The decoder 108 of 261 is a part included in the encoder 107 of FIG. 13, and it has a decoding function. The decoder 108 includes an inverse quantizer 1
14, an inverse transformation unit 115, a memory 116 (having a variable delay function for motion compensation), and an in-loop filter 117. The encoded data is inversely quantized by the inverse quantization unit 114, inversely DCT-transformed by the inverse transformation unit 115, and decoded. The memory 116 and the in-loop filter 117 are used when decoding the motion compensation predictive coded data.

JPEG, H.264. 261, MPEG1, MP
If several types of algorithms are to be processed by a method of encoding with a certain algorithm such as EG2, hardware and software for realizing each algorithm are required. One terminal, for example, H.264. In the case of encoding a moving image in H.261 and a still image in JPEG, FIG.
It becomes the structure like 5. That is, this encoder
H. 261 encoder 120 and JPEG encoder 121
It is composed of

Similarly, if the flexible coding algorithm of FIG. There are several kinds of tools of the conversion unit, the quantization unit, the inverse quantization unit, and the inverse conversion unit in H.261. Therefore, the coding unit 118 including the transforming unit 112, the quantizing unit 113, the inverse quantizing unit 114, and the inverse transforming unit 115 illustrated in FIG. 13 is configured by each tool illustrated in FIG. 16. The structure of the decoder is the same as the inverse quantizer 114 shown in FIG.
The decoding unit 119 including the inverse conversion unit 115 has the tool configuration of the decoding unit 122 in FIG.

In operation, the tool information of the motion compensation tool A, the inverse transformation tool B, the motion compensation tool C, the inverse transformation tool D, the quantization tool E, etc. shown in FIG.
20 and motion vector information 1 which is the data that follows.
01, the conversion coefficient 102, the motion vector information 103, and the conversion coefficient 104 are transmitted to each tool. The control unit 123 controls selection of which tool to use from each tool information, and each data is processed and decoded by the tool selected by the control unit 123.

However, in this method, it is necessary to prepare dedicated hardware and software for each tool, which increases the scale of the decoder. Also, if the data processed by the tool not prepared by the decoder is received, the data cannot be decoded. In order to solve this, it is conceivable that the received parts are compiled to generate a processing program, and the processing program is decoded by the general-purpose arithmetic processing unit.

When the information shown in FIG. 11B is decoded by the general-purpose arithmetic processing unit and the compiler, the decoder shown in FIG. 17 is used. Tool information such as the motion compensation tool A, the inverse conversion tool B, the motion compensation tool C, the conversion tool D, and the quantization tool E shown in FIG. Information 10
1, the conversion coefficient 102, the motion vector information 103, the conversion coefficient 104, and the quantization step 105
Sent to 24. The compiler 125 generates a processing program for the general-purpose arithmetic processing unit 124, and the data transmitted next is processed and decoded by the general-purpose arithmetic processing unit 124. Further, the processing program once generated is saved and reused at the next decoding.

[0015]

DISCLOSURE OF THE INVENTION Problems to be Solved by the Invention
If the processing capacity for processing an algorithm is lower than the sum of the processing capacities of the tools that make up the algorithm required by the encoding side, even if the decoding side accumulates the tools sent from the encoding side, it will be decoded Since the processing capacity on the computerization side is low, there is a problem that the received data cannot be accurately decoded and the memory of the tool storage unit is wasted.

Further, in the conventional encoding / decoding apparatus, when comparing the tool used on the encoding side with the tool stored on the decoding side, the tools themselves must be compared. There is a problem that the processing takes a very long time.

When decoding the encoded information using the new algorithm, even if the tool forming the algorithm is the same as the tool already stored, the tool has to be received again, and the time required for the transmission and reception thereof is also increased. There was a problem that it was quite large.

An object of the present invention is to, when the received coded information is decoded by the tool that has been received at the same time, select the most suitable tool by comparing with the information corresponding to the tool, and improve the efficiency in a short time. An object of the present invention is to provide an encoding / decoding device that can perform well decoding.

[0019]

SUMMARY OF THE INVENTION According to the present invention, encoded information and information of a tool constituting an algorithm as a means for decoding the information are transmitted at the same time, and the received tool is reconfigured as an algorithm. , A coding / decoding device for decoding the coded information received using the tool, a tool storage means for storing a tool, a tool correspondence information storage means for storing information corresponding to the tool, and the tool correspondence information Comparing means for comparing the information accumulated in the accumulating section with the received tool correspondence information, and selection control means for selecting an optimum tool from the tool accumulating means on the basis of the result of the comparing means and performing processing. It has the feature that it simultaneously transmits encoding information, tool information, and tool correspondence information, and decodes by the tool selected from the received tool correspondence information. To.

Further, according to the present invention, the tool correspondence information is a processing capacity value by the tool, and the received processing capacity value of the tool is compared with the decoding processing capacity value accumulated in the tool correspondence information accumulating means to perform decoding. It is characterized in that the processing is performed by selecting a tool that falls within the range of the processing capacity value. Here, the processing capability value of the tool is preferably digitized and transmitted.

The tool-corresponding information storage means sets a decoding processing capacity of the decoding apparatus and stores the decoding processing capacity, and a code which stores the coding processing capacity of each tool transmitted from the coding apparatus. The comparing means comprises an ability value comparing section for comparing the decoding processing ability with the encoding processing ability to determine whether the transmitted tool can be processed. preferable.

Further, according to the present invention, the tool correspondence information is a key unique to each tool, and the received key is compared with the key stored in the tool correspondence information storage means to select the corresponding tool for processing. It is characterized by

Further, in the present invention, it is desirable to include a response control means for having the encoding device of the other party transmit the tool information only when the tool information is necessary.

[0024]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. (First Embodiment) FIG. 1 is a block diagram showing a first embodiment of an encoding / decoding apparatus according to the present invention. This encoding / decoding device includes a control unit 11, an encoder 12, a response control unit 13, a decoder 14, a tool accumulation control unit 15, a tool accumulation unit 16, an encoding processing capability value accumulation unit 17, and a decoding process. A capability value storage unit 18 and a capability value comparator 19 are provided.

The control section 11 is a section for controlling the entire apparatus, and the sum of the processing capability values of the decoder 14 in advance for each tool forming the algorithm is used as the decoding processing capability value as the decoding processing capability value. It is stored in the storage unit 18. The processing capacity value of the decoder 14 in units of tools is digitized. The encoder 12 digitizes a processing capacity value necessary for processing the tool for each tool, adds the value, and transmits the numerical value to the partner device.

Here, to quantify the capability of the tool, set the standard process and the process capability required to perform the process, and compare the process load and the process capability with other processes. By.

The encoder 12 does not digitize each time it is transmitted, but is set in advance by the creator or selector of the tool from the processing load and the like. The digitized capability is sent from the control unit 11 to the response control unit, multiplexed with the encoded data and the tool information, and transmitted.

The coding processing capability value received by the decoder 14 is stored in the coding processing capability value storage unit 17 for each tool forming the algorithm. Decoding processing capability value storage unit 1
The output of 8 and the total sum of the processing capability values of the tools forming the algorithm are both input to the capability value comparison unit 19.

The capability value comparison unit 19 compares the respective values to determine whether or not the processing of the algorithm using the received tool is possible in the own device. The determination can be performed by a simple size comparison circuit. If it is judged from the comparison of the processing capability values that the processing is possible, a permission signal is sent to the tool storage control unit 15, the received tool is stored in the tool storage unit 16 and used for decoding the received data thereafter. .

If it is judged from the comparison of the processing capability values that the processing capability is low and the decoding processing capability is low, and the processing is impossible, the received tool is not necessary and the storage disabled signal is sent to the tool storage control unit 15. It is not stored in the tool storage unit 16. At the same time, the response control unit 31 is instructed to download the received tool and transmit a confirmation as to whether processing is possible.

Normally, under an encoding system in which the types of tools that make up an algorithm are specified, the decoding capabilities of each other are exchanged at the early stage of communication to obtain the decoding capabilities of the other party. The encoding and transmission of data can be started above. However, in the case of a method in which the encoding side and the tool forming the algorithm that is the means for decoding the information are simultaneously transmitted from the encoding side, the load of the decoding process significantly changes depending on the type of the selected tool. It is considered that it is not easy to strictly obtain the decoding capability of the partner device in advance in such capability exchange.
Therefore, in this way, each time a new tool is received, the capability values are compared and the determination result as to whether processing is possible is transmitted to the partner device.

FIG. 2 is an explanatory diagram showing an operation example of the present invention. The operations of the encoding device 20 and the decoding device 21 will be described. The encoding device 20 and the decoding device 21
Are the encoding / decoding devices shown in FIG. 1, and function as an encoding device and a decoding device, respectively.

First, it is assumed that the encoding device 20 transmits the tool a and the encoding capability value Ca required for the processing of the tool a to the other party. The decoding device 21 stores the transmitted processing capability value Ca of the tool in the encoding processing capability value storage unit 17. Since the capability values of the tools that make up the algorithm are accumulated for each tool, the sum of the capability values other than Ca is Cz.
Then, Ca + Cz is a capability value necessary for processing an algorithm using a tool having a capability value of Ca.

By comparing this value with the decoding capability value Cr preset in the decoding device 14, Ca
If + Cz ≦ Cr, it can be determined that the newly received tool a can be used on the decoding side. If available, the received tool is downloaded and a download completion response is sent to the partner device. As a result, the encoding device 12 can determine that the data can be transmitted using the transmitted tool.

Next, from the encoding device 12 to the tool b and
It is assumed that the coding capability value Cb necessary for the processing of the tool b is transmitted to the other party. The decoding device 14 stores the transmitted processing capability value Cb of the tool in the encoding processing capability value storage unit 17. Similar to the operation example described above, Cb + Cz is the ability value necessary to process the algorithm using the tool having the ability value of Cb.

This value and the preset decoding ability value Cr
By comparing with, if Cb + Cz> Cr, the newly received tool can be determined to be unusable on the decoding side. In that case, the received tool is not downloaded, but a download error response is transmitted to the partner device. This allows the encoding device to determine that data transmission using the transmitted tool is impossible. Therefore, the encoding device can decode the data by retransmitting another new tool or by transmitting the data using the previously transmitted tool a.

In this way, by using the tool correspondence information as the processing capability of the tool and selecting the tool that falls within the decoding processing range, efficient decoding processing becomes possible. In this case, the capacity comparison can be performed quickly and efficiently by digitizing the processing capacity value and transmitting it. In addition, the processing capability determines whether or not the receiving tool can be used, and then downloads the tool only when using it.
The processing time required for transmission and reception can be shortened.

(Second Embodiment) FIG. 3 shows an example of tool management in the second embodiment of the encoding / decoding apparatus according to the present invention. As shown in FIG. 3, each tool has a unique key. For example, keys corresponding to all the tools are set so that the key is Aa01 and the corresponding tool is the integer pixel precision motion compensation, whereby each tool can be identified.

FIG. 4 shows an example of setting this key. For example, as shown in FIG. 4, a key is represented by a large classification (motion compensation prediction, DCT conversion, etc.) in uppercase alphabets, a small classification (integer pixel accuracy, half-pixel accuracy, etc.) in lowercase alphabets, and a version expressed by two numbers. To be done.

FIG. 5 is a block diagram of an encoding apparatus of a second embodiment of the encoding / decoding apparatus according to the present invention. This encoding device stores a control unit 31 that controls the entire device, a tool storage unit 33 that stores each tool, and where in the tool storage unit 33 the processing program of the tool corresponding to each key is stored. A key table 32, a processing operation unit 34 that reads out and executes a processing program of a tool from the tool storage unit, a work memory 35 used in the processing operation unit 34, and a network interface 36 that communicates with the outside. There is.

FIG. 6 is a block diagram of the decoding apparatus of the second embodiment of the coding / decoding apparatus according to the present invention. This decryption device includes a control unit 41 for controlling the entire device, a key buffer 47 for temporarily storing the received key, a tool storage unit 43 for storing a tool, and a processing program of a tool corresponding to each key. A key table 42 for storing where it is stored in the tool storage unit 44, a processing operation unit 44 for reading and executing a processing program of the tool from the tool storage unit, a work memory 45 used by the processing operation unit 44, A network interface 46 that communicates with the outside.

FIG. 7 shows the tool storage unit 3 of the encoding apparatus shown in FIG.
3 and the example of the storage state of each tool in the tool storage unit 43 of the decoding device of FIG. FIG.
Is the key table 32 of FIG. 5 and the key table 4 of FIG.
2 shows an example of the correspondence between each key in No. 2 and the storage location in the tool storage unit 33, 43 of the tool corresponding to that key.

The encoding apparatus of FIG. 5 and the decoding apparatus of FIG.
As shown in FIG. 9, each network interface 3
6, 46 connect to various networks such as ISDN and wireless network.

FIG. 10 is a flow chart showing an example of a communication procedure when the encoder of FIG. 5 and the decoder of FIG. 6 are connected as shown in FIG. First, the algorithm used in the encoding device and the tools constituting the algorithm are determined (step S1). Then, the key of each tool is transmitted to the decryption device (step S2). The decryption device receives the key and stores it in the key buffer 47.
(Step T1). And key buffer 4
The keys taken in 7 are checked against the key table 42 (step T2), and if not registered, these keys are transmitted to the encoding device together with the tool transfer request (step T3). The encoding device transmits the processing program of the tool corresponding to the key to the decoding device (step S4). The decryption device stores the processing program of the tool in the tool storage unit 43, and registers the storage address and the key in the key table 42 (step T5). And
The tool is transferred from the tool storage unit 43 to the calculation unit 44 while referring to the key table 42 (step T6). After that, the decoding device transmits an encoded data transfer request to the encoding device (step T7), and the encoding device which has received the request transmits the encoded data to the decoding device (step S5).
S6), the decoding device receives the encoded data (step T8) and decodes it (step T9). When all the coding devices have finished transmitting the coded data, they transmit a coded data transmission end signal to the decoding device (steps S7, S).
8) At the time when the decoding device receives the signal (step T10), the communication ends.

Thus, by using the key unique to the tool, the corresponding tools can be easily compared and selected by comparing the keys, and the processing time can be shortened. Further, it is possible to reduce the processing time required for transmission and reception by determining whether or not the same tool is present in the decryption device using the key and transferring the tool only when there is no such tool.

[0046]

According to the present invention, the tool correspondence information accumulated in the tool correspondence information accumulating means is compared with the received tool correspondence information, and the optimum tool is compared and selected. Processing can be done in a short time. Especially,
By using the tool correspondence information as the processing capability of the tool and selecting a tool that falls within the decoding processing range, efficient decoding processing becomes possible. In this case, the capacity comparison can be performed quickly and efficiently by digitizing the processing capacity value and transmitting it.

Further, by making the tool correspondence information easy to compare, it is not necessary to compare the tools themselves, and quick tool selection processing is possible. In particular, by using the tool correspondence information as a key unique to the tool, the process of comparing and selecting the tools of the tool storage means can be efficiently performed in a short time.

Further, by providing the response control means, the information can be transmitted to the encoding device on the partner side only when it is necessary to receive the tool, and the time required for transmission / reception can be shortened. Processing can be done efficiently.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a first embodiment of an encoding / decoding device according to the present invention.

FIG. 2 is an explanatory diagram showing an operation of the encoding / decoding device of the first embodiment.

FIG. 3 is an explanatory diagram showing an example of a tool corresponding to a key.

FIG. 4 is an explanatory diagram showing an example of a key.

FIG. 5 is a block diagram showing an encoding device of a second embodiment of an encoding / decoding device according to the present invention.

FIG. 6 is a block diagram showing a decoding device of a second embodiment of an encoding / decoding device according to the present invention.

FIG. 7 is an explanatory diagram showing an example of a storage state of each tool in a tool storage unit of the encoding device and the decoding device.

FIG. 8 is an explanatory diagram showing a storage state of a key table of an encoding device and a decoding device.

FIG. 9 is an explanatory diagram of network connection between the encoding device and the decoding device.

FIG. 10 is a flowchart showing a communication procedure when the encoding device and the decoding device are connected.

FIG. 11 is an explanatory diagram showing a data string of encoded output information of a conventional encoding / decoding device.

FIG. 12 is a block diagram showing a conventional encoding / decoding device.

FIG. 13 is a block diagram showing an encoder of the encoding / decoding device of FIG. 12.

14 is a block diagram showing a decoder of the encoding / decoding device of FIG. 12. FIG.

FIG. 15: FIG. 26 is a block diagram showing an encoder that encodes with H.261 and JPEG.

FIG. 16 is a block diagram showing each tool of a decoder.

FIG. 17 is a block diagram showing a decoder that performs processing by a compiler.

[Explanation of symbols]

 11 control unit 12 encoding 13 response control unit 14 decoder 15 tool storage control unit 16 tool storage unit 17 encoding processing capability value storage unit 18 decoding processing capability value storage unit 19 capability value comparison unit

Claims (6)

[Claims] 1. A code which is transmitted at the same time as encoded information and information of a tool which constitutes an algorithm as a means for decoding the information, and which is formed by reconstructing the received tool as an algorithm In an encoding / decoding device for decoding encoded information, a tool accumulating means for accumulating tools, a tool-corresponding information accumulating means for accumulating information corresponding to the tools, and information accumulated in the tool-corresponding information accumulating section. And a selection control means for selecting an optimum tool from the tool storage means based on the result of the comparison means and processing the encoded information and the tool. Information and tool correspondence information are transmitted at the same time, and decoding is performed by a tool selected from the received tool correspondence information. 2. The tool correspondence information is a processing capacity value by the tool, and compares the received processing capacity value of the tool with the decoding processing capacity value accumulated in the tool correspondence information accumulating means to obtain the decoding processing capacity value. The encoding / decoding device according to claim 1, wherein a tool within a range is selected and processing is performed. 3. The encoding / decoding device according to claim 2, wherein the processing capability value of the tool is digitized and transmitted. 4. The tool-corresponding information storage means stores a decoding processing capacity storage unit for setting and storing the decoding processing capacity of the decoding apparatus, and the coding processing capacity of each tool transmitted from the coding apparatus. Comparing means is a capability value comparison unit that compares the decoding processing capability with the encoding processing capability to determine whether the transmitted tool can be processed. The encoding / decoding device according to claim 2, wherein 5. The tool correspondence information is a key unique to each tool, and the received key is compared with the key stored in the tool correspondence information storage means, and the corresponding tool is selected and processed. The encoding / decoding device according to claim 1. 6. The coding / decoding apparatus according to claim 1, further comprising: a response control unit that causes the partner coding apparatus to transmit the tool information only when the tool information is required.