JP2008022488A - Image processing apparatus, image processing method, program, and information recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To efficiently execute decoding processing for progressive image display where a resolution or image quality is gradually improved. <P>SOLUTION: JPEG2000 decoding processing is divided into first decoding processing to entropy decoding processing or inverse quantization processing and subsequent second decoding processing, and a first decoding processing means 106 and a second decoding processing means 107 are provided therefor. In the case of resolution progressive image display, processing is divided into two and executed separately, for example. In the first processing, first decoding processing is performed only upon a low-resolution packet, and second decoding processing is carried out using the result thereof, so that low-resolution display image data are generated. In the second processing, first decoding processing is performed only upon a packet except for the packet processed the last time, and second decoding processing is carried out using the result thereof and the result of the last first decoding processing, so that high-resolution display image data are generated. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image processing apparatus that generates image data whose resolution or image quality is gradually improved from code data, and an image processing apparatus that generates code data of an image whose resolution or image quality is gradually improved.

  In general, image encoding (compression) is performed by a procedure of “color space conversion of image data → frequency conversion → quantization of subband coefficients → entropy encoding of quantization coefficients (or necessary bit planes thereof) → code formation”. Often done.

  JPEG2000, which has been internationally standardized in recent years, is one type of such an encoding method (subband encoding method), and uses wavelet transform for frequency conversion and arithmetic encoding called MQ encoding for entropy encoding. The JPEG 2000 code data is composed of a set of partial codes called packets that can be processed independently.

  The present invention is suitable when JPEG2000 is used, but the present invention can also be applied when using other subband encoding methods that generate code data consisting of sets of partial codes that can be processed independently.

  Since JPEG2000 is used in the embodiments of the present invention to be described later, an outline of JPEG2000 will be described here to the extent necessary for understanding the present invention.

  FIG. 1 is a schematic block diagram for explaining the outline of JPEG2000. FIG. 2 shows an outline of a basic encoding process flow of JPEG2000, and FIG. 3 shows an outline of a basic decoding process flow of JPEG2000.

  First, the encoding process will be described. The image is divided into rectangular tiles and processed (number of divisions ≧ 1). Each tile is converted into components of luminance Y and color differences Cb and Cr by the color space conversion unit of the color space conversion unit / inverse color space conversion unit 1 (step 11). In the case of RGB image data or the like, in step 11, a DC level shift that reduces half the dynamic range is performed prior to color space conversion.

  Each component (tile component) after color space conversion is divided into subbands by applying wavelet transform in the wavelet transform unit of the wavelet transform unit / inverse wavelet transform unit 2 (step 12).

  FIG. 4 shows subband division when the number of decomposition levels is three. In FIG. 4, the first two-dimensional wavelet transform is applied to the tile component of (a), and is divided into subbands (1LL, 1HL, 1LH, 1HH) shown in (b). By applying the second two-dimensional wavelet transform to the coefficients of the 1LL subband, which is the low frequency component of the decomposition level 1, the subbands (2LL, 2HL, 2LH, 2HH) shown in (c) are applied. Divided. By applying the third two-dimensional wavelet transform to the coefficients of the 2LL subbands at decomposition level 2, the subbands at decomposition level 3 (3LL, 3HL, 3LH, 3HH) shown in (d) are applied. Divided. The numbers in parentheses in each subband in (d) indicate the resolution level.

  Please refer to FIG. 1 and FIG. 2 again. In JPEG2000, reversible 5 × 3 conversion and irreversible 9 × 7 conversion are defined as wavelet conversion. When the 9 × 7 transform is used, the quantization unit of the quantization unit / inverse quantization unit 3 performs linear quantization on the wavelet coefficients for each subband (step 13).

  Next, the entropy encoding unit of the entropy encoding unit / entropy decoding unit 4 performs entropy encoding of each subband coefficient (step 14). More specifically, as illustrated in FIG. 5, each subband is divided into non-overlapping rectangular areas called precincts. Three rectangular regions spatially matching the LH, HL, and HH subbands at the same decomposition level are treated as one precinct. However, in the LL subband, one rectangular area is treated as one precinct. The precinct roughly represents the position of the image area. A code block obtained by further dividing the precinct into rectangles is a unit of entropy coding. In JPEG 2000, bit plane encoding is performed on wavelet coefficients using an arithmetic encoder called an MQ encoder for each code block.

  Next, the tag processing unit 5 discards unnecessary entropy codes and collects necessary entropy codes to generate a packet (step 15). A packet is a packet obtained by collecting a part of codes of all code blocks included in the precinct (for example, a code obtained by collecting the codes of the MSB to the third bit plane of all code blocks in the precinct). It has a header. Each packet is a unit of code that can be handled independently. JPEG2000 code data is a set of packets that are partial codes that can be handled independently.

  The packet has four types of indexes (component number (color component), resolution level, precinct number, and layer number). However, although information (described later) regarding codes included in the packet is included in the packet header, it is not known from the packet header what index the packet has.

  Now, if packets of all precincts (= all code blocks = all subbands) are collected, a part of the code of the entire tile component (for example, the wavelet coefficient of the entire tile component from the MSB 3 This is called a layer.

  The upper part of FIG. 6 shows an example of layer division when the number of decomposition levels = 2 and the precinct size = subband size. An example of a packet included in a layer is shown in the lower part of FIG.

  Finally, the tag processing unit 5 hierarchically arranges the generated packets according to the index and adds necessary tags or tag information to form JPEG2000 code data (code stream) (step 16). . This order of packet arrangement is called a progression order, and JPEG2000 defines five progression orders.

  Next, the decoding process will be described. The tag processing unit 5 analyzes the tag information of the code data, divides the code data into packets (step 21), and divides the code of the packet for each code block (step 22). The entropy decoding unit of the entropy encoding unit / entropy decoding unit 4 performs code entropy decoding for each code block (step 23). This entropy decoding is bit-plane decoding using an arithmetic decoder called an MQ decoder. In the case of code data that has undergone linear quantization at the time of encoding, the quantization coefficient of the wavelet coefficient obtained by entropy decoding is inverted for each subband by the inverse quantization unit of the quantization unit / inverse quantization unit 3. Linear quantization is performed (step 24). Next, the inverse wavelet transform unit of the wavelet transform unit / inverse wavelet transform unit 2 performs inverse wavelet transform for each tile (step 25), and the generated tile component is subjected to the color space transform unit / inverse color space transform unit 1 Reverse color conversion is performed by the reverse color space conversion unit (step 26). If a DC level shift is performed at the time of encoding, a DC reverse level shift is also performed (step 26).

  Interpretation of the packet arrangement at the time of encoding processing and the attribute of the packet at the time of decoding processing is performed by a for loop corresponding to the progression order as described below.

For example, in the case of RLCP progression order, the following for loop
for (resolution) {
for (layer) {
for (component) {
for (Precinct) {
Encoding process: Packet placement
During decryption: interpret packet attributes
}
}
}
Thus, the arrangement of packets of each tile (during encoding processing) or the interpretation of attributes (during decoding processing) is performed.

Similarly, for the LRCP progression order, the following for loop
for (resolution) {
for (layer) {
for (component) {
for (Precinct) {
Encoding process: Packet placement
During decryption: interpret packet attributes
}
}
}
Thus, the arrangement of packets of each tile (during encoding processing) or the interpretation of attributes (during decoding processing) is performed.

Now, in the packet header of each packet,
Whether the packet is empty,
Which code block is included in the packet,
The number of zero bit planes for each code block included in the packet,
-The number of coding passes (number of bit planes) of each code block code included in the packet,
The code length of each code block included in the packet,
Is described. However, as described above, the index such as the layer number and the resolution level is not described at all in the packet header. In order to determine which layer and which resolution level the packet is at the time of decoding processing, a for loop as described above is constructed from the progression order described in the COD marker segment etc. in the main header, and the packet is What is necessary is just to determine the packet break by obtaining the packet length from the sum of the code lengths of the included code blocks, and to see where in the for loop each packet was handled. This also means that if the code length in the packet header is read, the next packet can be detected without decoding the packet data (entropy code).

  FIG. 7 shows an image size = 100 × 100 pixels, no tile division (1 tile), 2 layers (0, 1), number of resolution levels = 3 (0 to 2), 3 components (0 to 2), pre- An arrangement of 36 packets in the case of a syncint size = 32 × 32 and an RLCP progression order is shown.

  In FIG. 8, image size = 100 × 100 pixels, no tile division (1 tile), 2 layers (0, 1), number of resolution levels = 3 (0 to 2), 3 components (0 to 2), pre- An arrangement of 36 packets in the case of a syncto size = 32 × 32 and an LRCP progression order is shown.

  Although not described so far, the code of each tile is divided into one or more parts, and each divided part is called a tile part. Therefore, JPEG2000 code data is preceded by tag information called a main header, and then one or more tile parts for each tile are arranged. Then, tag information called a tile part header is inserted at the head of each tile part. In JPEG2000 code data, the default progression order defined in the main header can be changed midway. This progression order change is specified by a POC marker segment inserted in the main header or the tile part header of the first tile part of each tile.

  There are many prior art documents related to JPEG 2000 described above. For example, Patent Document 1 can be cited as an example related to high-speed processing.

  Further, Patent Document 2 has a first encoding unit for fixed length compression and a second encoding unit for variable length compression. In the first encoding unit, each block of an image Performs color conversion to luminance Y, color differences Cb, Cr, subband conversion of each component, quantization of conversion coefficients to a fixed number of bits, and only low-frequency coefficients that are fixed-length compressed in the second encoding unit An image coding apparatus is described that performs variable length compression processing such as adaptive arithmetic coding on the subject and outputs the fixed-frequency compressed high frequency coefficient as it is.

JP 2004-40388 A JP 2001-94985 A

  A resolution or low-resolution or low-quality image is reproduced and displayed from the JPEG2000 code data by the first decoding process, and a higher-resolution or high-quality image is reproduced and displayed by the second decoding process. There is a case where it is desired to display a progressive image related to image quality. However, in a conventional image processing apparatus that performs such processing for displaying a resolution / image quality progressive image, the result of the previous decoding process is not used for each decoding process, and the decoding process is repeated for the same packet. There was a problem that processing efficiency was bad.

  In addition, low resolution or low image quality code data is generated by the first encoding process on image data, and higher resolution or high image quality code data is generated by the second encoding process. In some cases, it is desired to generate code data with gradually improved image quality. For example, low-resolution code data is generated on the server side and transmitted to the client, the code data is decoded on the client side, and the image is displayed at an early stage, and then automatically or In response to a request from the client, high resolution code data is transmitted from the server to the client, and the code data is decoded on the client side to display a high-definition image. However, in a conventional image processing apparatus that generates code data in which resolution or image quality is gradually improved by such multiple encoding processes, the result of the previous encoding process is used for each encoding process. However, since the encoding process is repeated for the same packet, there is a problem that the processing efficiency is poor.

  Therefore, the object of the present invention is to efficiently process resolution or image quality from JPEG2000 code data or code data by other subband coding methods composed of subcodes that can be processed independently. An object of the present invention is to provide an image processing apparatus or an image processing method for generating image data in which the image quality is gradually improved. Another object of the present invention is to provide an image processing apparatus or an image processing method for generating code data of JPEG 2000 or other subband encoding method in which resolution or image quality is gradually improved from image data by efficient processing. Is to provide.

The invention described in claim 1
Decoding processing means configured to perform decoding processing divided into a plurality of times for code data according to a specific subband encoding method, which is configured by a set of partial codes that can be processed independently, and control means for controlling the decoding processing means And
The decoding processing means is a first decoding process for executing a process (hereinafter referred to as a first decoding process) until a subband coefficient or a quantized coefficient thereof is generated in the decoding process according to the subband encoding method. Means, a second decoding processing means for executing a process after the first decoding process of the decoding process of the subband encoding method (hereinafter referred to as a second decoding process), and the first decoding processing means Storage means for storing the generated subband coefficients or their quantization coefficients (hereinafter referred to as result data),
The decoding processing means executes the first decoding processing by the first decoding processing means only for the partial code designated as the processing target by the control means during the first decoding processing for the code data, and the result data The image data is output by executing a second decoding process on the result data stored in the storage unit and stored in the storage unit by the second decoding processing unit,
The decoding processing means executes the first decoding processing by the first decoding processing means only for the partial code additionally designated as a processing target by the control means at the time of the second and subsequent decoding processes on the code data, The result data is stored in the storage unit, and the second decoding process is performed on the result data stored in the storage unit by the second decoding unit, so that the resolution or the image quality is higher than the previous decoding process. An image processing apparatus that outputs improved image data.

The invention according to claim 2
Decoding processing means for executing decoding processing on JPEG2000 code data in a plurality of times, and control means for controlling the decoding processing means,
The decoding processing means is a first decoding processing means for executing processing (hereinafter referred to as first decoding processing) up to generation of a wavelet coefficient or a quantized coefficient thereof in JPEG2000 decoding processing, JPEG2000 decoding processing Second decoding processing means for executing processing after the first decoding processing (hereinafter referred to as second decoding processing), and a wavelet coefficient generated by the first decoding processing means or a quantized coefficient thereof ( And storage means for storing the result data)
The decoding processing means executes the first decoding processing by the first decoding processing means only for the packet designated as the processing target by the control means at the time of the first decoding processing on the code data, and the result data The image data is output by executing a second decoding process on the result data stored in the storage means by the second decoding processing means,
The decoding processing means executes the first decoding processing by the first decoding processing means only for a packet that is additionally designated as a processing target by the control means at the time of the second and subsequent decoding processes on the code data, The result data is stored in the storage unit, and the second decoding process is performed on the result data stored in the storage unit by the second decoding unit, thereby improving the resolution or image quality compared to the previous decoding process. The image processing apparatus is characterized by outputting the processed image data.

The invention described in claim 3
Coding processing means for performing coding processing by a specific subband coding method for generating code data composed of a set of partial codes that can be processed independently for image data in a plurality of times; Output code generation processing means for generating output code data from code data output from the encoding processing means, and control means for controlling the encoding processing means and the output code generation processing means,
The encoding processing means performs a process (hereinafter referred to as a first encoding process) for generating a subband coefficient or a quantized coefficient thereof in the encoding process by the subband encoding method. 1 encoding processing means, second encoding processing means for executing processing after the first encoding processing of the encoding processing by the subband encoding scheme (hereinafter referred to as second encoding processing), and Storage means for storing a subband coefficient generated by the first encoding processing means or a quantized coefficient thereof (hereinafter referred to as result data),
The encoding processing means performs the first encoding by the first encoding processing means only for the image area related to the partial code designated as the processing target by the control means during the first encoding processing on the image data. A second unit for executing the process, storing the result data in the storage unit, and generating the designated partial code using the result data stored in the storage unit by the second encoding unit. By executing the encoding process, code data including the designated partial code is output,
The encoding processing means is an image area related to a partial code additionally designated as a processing target by the control means at the time of encoding processing of the second and subsequent times for image data, and at the time of encoding processing up to the previous time Only the unprocessed image area is subjected to the first encoding processing by the first encoding processing means, the result data is stored in the storage means, and the second encoding processing means is stored in the storage means. Output code data including the additional specified partial code by executing a second encoding process for generating the additional specified partial code using the result data of
The output code generation processing unit generates the code data output from the encoding processing unit as it is as the output code data during the first encoding process, and performs the encoding during the second and subsequent encoding processes. By combining the code data output from the processing means with the output code data generated during the previous encoding process, output code data with improved resolution or image quality compared to the previous encoding process is generated. The image processing apparatus.

The invention according to claim 4
Encoding processing means for executing JPEG2000 encoding processing on image data in a plurality of times, output code generation processing means for generating output code data from code data output from the encoding processing means, and the code And a control means for controlling the output code generation processing means,
The encoding processing means includes a first encoding processing means for executing a process (hereinafter referred to as a first encoding process) of generating a wavelet coefficient or a quantized coefficient thereof in the encoding process of JPEG2000, Generated by the second encoding processing means for executing processing after the first encoding processing of JPEG2000 encoding processing (hereinafter referred to as second encoding processing), and the first encoding processing means. Storage means for storing the wavelet coefficients or the quantized coefficients thereof (hereinafter referred to as result data),
The encoding processing means performs the first encoding processing by the first encoding processing means only for an image area related to a packet designated as a processing target by the control means during the first encoding processing for image data. The second encoding for generating the designated packet using the result data stored in the storage means by the second encoding processing means By executing the process, the code data including the designated packet is output,
The encoding processing means is an image area related to a packet additionally designated as a processing target by the control means at the second and subsequent encoding processes on image data, and has not been processed at the previous encoding process. The first encoding processing unit executes the first encoding process only for the image area to be processed, the result data is stored in the storage unit, and the second encoding processing unit is stored in the storage unit Outputting code data including the additionally specified packet by executing a second encoding process for generating the additional specified packet using the result data;
The output code generation processing unit generates the code data output from the encoding processing unit as it is as the output code data during the first encoding process, and performs the encoding during the second and subsequent encoding processes. By combining the code data output from the processing means with the output code data generated during the previous encoding process, output code data with improved resolution or image quality compared to the previous encoding process is generated. The image processing apparatus.

The invention according to claim 5
A decoding process step for executing the decoding process for JPEG2000 code data in a plurality of times, and a control step for controlling the decoding process step,
The decoding processing step is a first decoding processing step for executing processing up to generation of wavelet coefficients or quantization coefficients thereof (hereinafter referred to as first decoding processing) of decoding processing of JPEG2000, decoding processing of JPEG2000 A second decoding process step for executing a process after the first decoding process (hereinafter referred to as a second decoding process), and a wavelet coefficient generated by the first decoding process step or a quantized coefficient thereof ( (Hereinafter referred to as result data) including a storage step for storing in the storage means,
In the decoding process step, the first decoding process is executed in the first decoding process step only for the packet designated as the processing target by the control step in the first decoding process for the code data, and the result data is converted into the data The image data is output by executing a second decoding process on the result data stored in the storage unit by the storing step and the result data stored in the storage unit by the second decoding process step,
In the decoding process step, the first decoding process is executed in the first decoding process step only for the packet that is additionally designated as the processing target by the control step during the second and subsequent decoding processes for the code data, The result data is stored in the storage unit in the storing step, and the second decoding process is performed on the result data stored in the storage unit in the second decoding process step, so that the resolution is higher than that in the previous decoding process. Alternatively, the image processing method is characterized in that image data with improved image quality is output.

The invention described in claim 6
An encoding process for executing JPEG2000 encoding processing on image data in a plurality of times, an output code generating process for generating output code data from the code data output from the encoding process, and the code And a control step for controlling the output code generation processing step,
The encoding processing step is a first encoding processing step for executing processing (hereinafter referred to as first encoding processing) until generation of wavelet coefficients or quantization coefficients thereof in JPEG2000 encoding processing, Generated by a second encoding process for executing a process after the first encoding process of the JPEG2000 encoding process (hereinafter referred to as a second encoding process), and the first encoding process. Including a storing step of storing the wavelet coefficient or the quantized coefficient thereof (hereinafter referred to as result data) in the storage means,
In the encoding process step, the first encoding process is performed in the first encoding process step only for the image region related to the packet designated as the processing target by the control process in the first encoding process for the image data. And the result data is stored in the result storage unit in the storage step, and the designated packet is generated using the result data stored in the storage unit in the second encoding process step. The code data including the designated packet is output by executing the second encoding process of
In the encoding processing step, the image region related to the packet additionally designated as a processing target by the control step at the time of the second and subsequent encoding processing on the image data, which has not been processed at the previous encoding processing. The first encoding process is executed in the first encoding process step only for the image area of the process, and the result data is stored in the storage means in the storage step, and the storage means is stored in the storage means in the second encoding process step. Outputting code data including the additional designated packet by executing a second encoding process for generating the additional designated packet using the stored result data;
In the output code generation processing step, the code data output from the encoding processing manual step is generated as it is as the output code data in the first encoding processing, and the code is output in the second and subsequent encoding processing. By combining the code data output from the encoding process with the output code data generated during the previous encoding process, generating output code data with improved resolution or image quality compared to the previous encoding process. This is a featured image processing method.

The invention described in claim 7
Decoding processing means for executing decoding processing on JPEG2000 code data in a plurality of times, and control means for controlling the decoding processing means,
The decoding processing means is a first decoding processing means for executing processing (hereinafter referred to as first decoding processing) up to generation of a wavelet coefficient or a quantized coefficient thereof in JPEG2000 decoding processing, JPEG2000 decoding processing Second decoding processing means for executing processing after the first decoding processing (hereinafter referred to as second decoding processing), and a wavelet coefficient generated by the first decoding processing means or a quantized coefficient thereof ( And storage means for storing the result data)
The decoding processing means executes the first decoding processing by the first decoding processing means only for the packet designated as the processing target by the control means at the time of the first decoding processing on the code data, and the result data The image data is output by executing a second decoding process on the result data stored in the storage means by the second decoding processing means,
The decoding processing means executes the first decoding processing by the first decoding processing means only for a packet that is additionally designated as a processing target by the control means at the time of the second and subsequent decoding processes on the code data, The result data is stored in the storage unit, and the second decoding process is performed on the result data stored in the storage unit by the second decoding unit, thereby improving the resolution or image quality compared to the previous decoding process. In order to operate the computer as an image processing apparatus characterized by outputting the processed image data, the program causes the computer to function as each means.

The invention described in claim 8
Encoding processing means for executing JPEG2000 encoding processing on image data in a plurality of times, output code generation processing means for generating output code data from code data output from the encoding processing means, and the code And a control means for controlling the output code generation processing means,
The encoding processing means includes a first encoding processing means for executing a process (hereinafter referred to as a first encoding process) of generating a wavelet coefficient or a quantized coefficient thereof in the encoding process of JPEG2000, Generated by the second encoding processing means for executing processing after the first encoding processing of JPEG2000 encoding processing (hereinafter referred to as second encoding processing), and the first encoding processing means. Storage means for storing the wavelet coefficients or the quantized coefficients thereof (hereinafter referred to as result data),
The encoding processing means performs the first encoding processing by the first encoding processing means only for an image area related to a packet designated as a processing target by the control means during the first encoding processing for image data. The second encoding for generating the designated packet using the result data stored in the storage means by the second encoding processing means By executing the process, the code data including the designated packet is output,
The encoding processing means is an image area related to a packet additionally designated as a processing target by the control means at the second and subsequent encoding processes on image data, and has not been processed at the previous encoding process. The first encoding processing unit executes the first encoding process only for the image area to be processed, the result data is stored in the storage unit, and the second encoding processing unit is stored in the storage unit Outputting code data including the additionally specified packet by executing a second encoding process for generating the additional specified packet using the result data;
The output code generation processing unit generates the code data output from the encoding processing unit as it is as the output code data during the first encoding process, and performs the encoding during the second and subsequent encoding processes. By combining the code data output from the processing means with the output code data generated during the previous encoding process, output code data with improved resolution or image quality compared to the previous encoding process is generated. In order to operate the computer as the image processing apparatus, the program causes the computer to function as each of the means.

  A ninth aspect of the invention is a computer-readable information recording medium on which a program according to the seventh or eighth aspect of the invention is recorded.

  According to the image processing apparatus or the image processing method according to the first, second, and fifth aspects of the present invention, JPEG2000 code data, or other subband encoding composed of a set of subcodes that can be processed independently similar to the JPEG2000 code data. Generating low-resolution or low-quality image data from the code data of the system by the first decoding process, and generating higher-resolution or high-quality image data from the previous time by the second and subsequent decoding processes. Can do. In each decoding process after the second time, the first decoding process is not executed again for the packet or the partial code that has been processed until the previous time, so that the process overlap is reduced and an efficient process is possible.

  According to the image processing apparatus or the image processing method according to the third, fourth, and sixth aspects of the present invention, the first encoding process allows the low-resolution or low-quality JPEG2000 code data, or the same independently. It is possible to generate code data of another subband encoding method composed of a set of processable partial codes, and generate code data with higher resolution or higher image quality than the previous time by encoding processing each time after the second time. it can. In each encoding process after the second time, neither the first encoding process nor the second encoding process is executed again for packets or partial codes that have been processed up to the previous time, thereby reducing processing duplication. Efficient processing is possible.

  By loading the program according to the inventions according to claims 6, 7, and 9 or the program recorded on the information recording medium into the computer, the computer can be operated as the image processing apparatus according to the invention according to claim 2 or 4. it can.

  Hereinafter, two embodiments of the present invention will be described. In any embodiment, JPEG2000 is used as the encoding method.

<First Embodiment>
FIG. 9 is a block diagram of the image processing apparatus 100 according to the first embodiment of the present invention. The image processing apparatus 100 generates display image data for progressive image display that gradually improves resolution or image quality by sequentially executing decoding processing on JPEG2000 code data in two or more steps. Is.

  In FIG. 9, reference numeral 101 denotes storage means for storing JPEG 2000 code data to be processed. Reference numeral 102 denotes a decoding processing means for executing the decoding process on the code data in two or more times. Reference numeral 103 denotes display image generation processing means for generating display image data to be displayed on the display using the processing result of the decoding processing means 102. Reference numeral 104 denotes a storage means for storing display image data. A control unit 105 controls the decoding processing unit 102 and the display image generation processing unit 103.

  The decoding processing means 102 divides the JPEG2000 decoding processing into two parts, a first decoding process and a second decoding process, along the processing flow, and each of them is divided into a first decoding processing means 106 and a second decoding processing means 108. It is the structure which is executed with. The decoding processing means 102 also includes storage means 107 for storing the result data of the first decoding process, which is intermediate result data of the JPEG 2000 decoding process.

  In the first example of the present embodiment, the result data of the first decoding process is a wavelet coefficient. That is, in the first embodiment, the JPEG 2000 decoding process is divided so that the process up to the inverse quantization process is included in the first decoding process and the part after the inverse wavelet transform process is included in the second decoding process. Therefore, in contrast to the functional block configuration shown in FIG. 1, in the first embodiment, as shown in the middle part of FIG. 9, the tag processing unit 111, the entropy decoding unit 112, The inverse quantization unit 113 is included, while the second decoding processing unit 108 includes an inverse wavelet transform unit 114 and an inverse color space transform unit 115.

  In the second example of the present embodiment, the result data of the first decoding process is a quantized coefficient of a wavelet coefficient. That is, in the second embodiment, the JPEG2000 decoding process is divided so that the entropy decoding process is included in the first decoding process, and the inverse quantization process and the subsequent processes are included in the second decoding process. Therefore, in contrast to the functional block configuration shown in FIG. 1, in the second embodiment, as shown in the lower part of FIG. 9, the tag processing unit 111 and the entropy decoding unit 112 are included in the first decoding processing unit 106. On the other hand, the second decoding processing means 108 includes an inverse quantization unit 113, an inverse wavelet transform unit 114, and an inverse color space transform unit 115.

  The image processing apparatus 100 according to the present embodiment includes, for example, a CPU 301, a main memory 302, a hard disk device 303, a display 304, a display controller 305, an input device (a pointing device such as a keyboard and a mouse), a network interface 307, and the like illustrated in FIG. Is realized by a program using a computer connected to the bus 308. A program for that purpose, that is, a program for causing a computer to function as each means constituting the image processing apparatus 100 shown in FIG. 9 is loaded into the main memory 302 from the hard disk device 303, for example, and executed by the CPU 301, whereby the computer It operates as the processing apparatus 100.

  Such a program and various information recording (storing) media that can be read by a computer such as a magnetic disk, an optical disk, a magneto-optical disk, and a semiconductor storage element on which the program is recorded are also included in the present invention.

  Note that memory areas allocated on the main memory 302 are used as the storage units 101, 104, and 107 of the image processing apparatus 100.

  Code data to be processed is read from, for example, the hard disk device 303 and written in the storage unit 101 on the main memory 302. Alternatively, code data is taken in via the network via the network interface 307 and written into the storage unit 101 on the main memory 302. In the latter case, it is possible to start the decoding process when a part of the code data is captured, that is, the code data capture and the decoding process can be executed in parallel, and this aspect is also included in this embodiment. Is done.

  FIG. 10 is a schematic flowchart for explaining the operation of the image processing apparatus 100. Hereinafter, the operation of the image processing apparatus 100 will be described with reference to this flowchart.

  The first decoding processing unit 106 reads the main header of the code data from the storage unit 101 and analyzes it by the tag processing unit 111 (step S1).

  The control means 105 creates a code table on the storage means 107 based on the analysis result of the main header (step S2). This code table is used to store the designation of whether or not each packet constituting the code data is a processing target and a flag indicating whether or not the processing has been completed. This is a five-dimensional table in which information on packets having corresponding attributes can be searched using five types of indexes to be attached (tile number, precinct number, component number, resolution level, layer number). It is also possible to create a code table for each tile. In this case, the code table for each tile is a four-dimensional table that can be searched using four types of indexes (precinct number, component number, resolution level, layer number). That's fine.

  The control means 105 sets a decoding condition (step S3). For example, the size of the original image obtained by analyzing the main header, the number of resolution levels, the number of layers, the number of components, the progression order, and the size and resolution of the image display window on the screen of the display 304 Based on the above, the decoding conditions regarding the region (tile number, precinct number), resolution (resolution level), image quality (layer number), and color (component number) are determined. However, this is merely an example. For example, the user may directly specify such a decoding condition through a user interface using a display screen.

  By setting such decoding conditions, the range of packets to be finally decoded is determined. Then, the image processing apparatus 100 generates display image data for displaying a progressive image related to resolution, image quality, and the like by sequentially executing the decoding process for these packets in two or more steps.

  The control unit 105 determines a packet to be subjected to the first decoding process within the range of the packet to be finally decoded, writes the designation information in the code table (step S5), and the decoding processing unit 102 Is instructed to start the first process.

  Here, for simplification of description, all packets of 1-tile code data composed of the packet sequence shown in FIG. 7 are to be finally decoded, and packets (packets) up to resolution level 1 in the first decoding process. Assuming an example of generating display image data for resolution progressive image display by processing 0 to 11) and processing packets up to resolution level 2 (packets 0 to 35) in the second decoding process. explain. Therefore, in this example, information specifying packets 0 to 11 as the target of the first decoding process is written in the code table.

  The decoding processing means 102 reads the code data packets in order from the first one (step S7). The tag processing unit 111 recognizes the attribute of the read packet by the for loop corresponding to the progression order as described above, and searches the code table using the index corresponding to the attribute, thereby processing the packet. It is determined whether or not it is a target of (step S8). In the second and subsequent decoding processes, even if a packet is designated as a process target, if the processed flag is set to ON, it is determined that the packet is not a process target.

  If it is determined that it is not a processing target, the process immediately proceeds to the next packet reading process. As described above, since the packet length can be obtained by summing up the code lengths of the code blocks recorded in the packet header, the next packet can be easily obtained without decoding the packet data (code). Is accessible. Therefore, only the packet header may be read in step S7, and the packet data may be read in step S9.

  When the first decoding processing unit 106 determines that the read packet is a processing target, the first decoding processing unit 106 processes the packet (step S9), writes the result data in the storage unit 107, and processes the packet in the code table. The completed flag is set to ON (step S10). That is, the tag processing unit 111 divides the code (packet data) of the packet into code blocks, and the entropy decoding unit 112 performs code entropy decoding for each code block. In the case of the second embodiment, the quantized coefficient of the wavelet coefficient obtained by entropy decoding is written in the storage means 107 as result data. In the case of the first embodiment, the quantization coefficient obtained by entropy decoding is inversely quantized by the inverse quantization unit 113, and the obtained wavelet coefficient is written in the storage means 107 as result data. A pointer table for recording a pointer to the result data for each packet is created in advance on the storage means 107 by the control means 105, but the first decoding processing means 106 performs the first decoding processing of one packet. When the result data is written in the storage means 107, a pointer to the result data is recorded in the pointer table. In this way, the first first decoding process is sequentially executed for the processing target packet.

  Note that the first decoding processing means 106 also writes the “internal state” at the end of processing of the entropy decoding unit 112 in the storage means 107 in step S10. This internal state is the state of superiority (significant flag) of each coefficient processed by the arithmetic decoder of the entropy decoding unit 112 and the state of the register of the arithmetic decoder. In addition, when the first decoding processing unit 106 performs the entropy decoding process of the packet of the layer other than the highest layer in step S9, the “internal state” stored in the storage unit 107 is set prior to the process. It is read and control is performed to restore the entropy decoding unit 112 to the previous processing state of the upper layer packet. By performing such control, it is possible to perform entropy decoding of lower layer packets without performing entropy decoding again from the highest layer packets. In the present embodiment, the “internal state” is stored in the storage unit 107, but the first decoding processing unit 106 may include a storage unit for storing the “internal state”.

  When the first process by the first decoding processing unit 106 is completed (step S6, Yes), the control unit 105 instructs the second decoding processing unit 108 to start the first process.

  The second decoding processing means 108 uses the pointer table to sequentially read the result data of the first decoding processing of each packet from the storage means 107 according to the for loop as described above (step S12), and refer to the code table to refer to the code table. It is determined whether the result data is a processing target (step S13). When the second decoding processing unit 108 determines that the result data is a processing target, the second decoding processing unit 108 performs a second decoding process on the result data (step S14). That is, in the case of the first embodiment, the inverse wavelet transform unit 114 performs inverse wavelet transform on the wavelet coefficients read from the storage unit 107 to generate data of each component, and the inverse color space transform unit 115 The image data is generated by performing reverse color space conversion (and DC level reverse shift if necessary). In the case of the second embodiment, the inverse quantization unit 113 performs inverse quantization on the quantized coefficients of the wavelet coefficients read from the storage means 107, and the inverse wavelet transform unit 114 performs inverse quantization on the obtained wavelet coefficients. Wavelet transform is performed, and the inverse color space transform unit 115 performs inverse color space transform (and DC level reverse shift if necessary) on the result.

  In the second decoding processing means 108, the same processing is repeated for the packet to be processed. In the case of the example, as a result of processing packets 0 to 11 up to resolution level 1 in the first decoding process, image data of resolution level 1 is output. The display image generation processing unit 103 stores, as display image data, image data output from the second decoding processing unit 108 or image data obtained by scaling the image data according to the set decoding conditions. Write.

  When the second decoding process is completed for all the packets to be processed (step S11, Yes), the control unit 105 determines a packet to be added as a second process target and writes the designation information in the code table (step S5). Then, the processing of the first decoding processing means 106 is started. In the case of this example, resolution level 2 packets 12 to 35 are added as processing targets, the first decoding processing unit 106 performs processing on these packets, and the result data is written to the storage unit 107. (Steps S6 to S10). The packets 0 to 11 processed in the first decoding process are excluded from the current processing target because the processed flag of the code table is set to ON. Thus, since the same packet is not processed twice in the first decoding process, an efficient decoding process is possible.

  When the second first decoding process is completed, the second decoding processing unit 108 executes the second process in accordance with an instruction from the control unit 105 (steps S11 to S14). In the case of the example, the wavelet coefficients of the packets 0 to 11 obtained by the first decoding process for the first time or the quantization coefficients thereof, and the wavelet coefficients of the packets 12 to 35 obtained by the current first decoding process or the quantum thereof. As a result of the conversion factor processing, image data of resolution level 2 is output from the second decoding processing means 108. The display image generation processing unit 103 overwrites the previous display image data in the storage unit 104 as display image data with the resolution level 2 image data or the image data subjected to scaling processing according to the set decoding condition. . In this example, the process is completed by the end of the second decoding process (step S4, Yes).

  Here, the configuration of the decoding processing means 102 will be further described in relation to FIG. 10. The first decoding processing means 106 is constituted by means having functions corresponding to steps S6, S7, S8, S9, and S10. The second decoding processing means 108 is composed of means having functions corresponding to steps S11, S12, S13, and S14. And in this embodiment, the function of these means is implement | achieved by the program using a computer as shown in FIG.

  The example of decoding the RLCP progressive order code data as shown in FIG. 7 and displaying the resolution progressive image has been described above, but this is only an example.

  For example, image quality progressive image display can be performed on the code data of the LRCP progression order as shown in FIG. In this case, for example, the layer 0 packets 0 to 17 are designated as processing targets at the first time, the decoding process is performed to generate low-quality display image data, and the layer 1 packets 18 to 35 are processed the second time. High-quality display image data is specified by additionally specifying the target, executing the first decoding process on the packets, and executing the second decoding process using the result data and the result data of the first decoding process for the first time. Can be generated. When the first decoding process for the upper layer packet and the first decoding process for the lower layer are performed separately as in this example, the index (component number, resolution level, precinct number, tile number) is set in step S10. The storage unit 107 may store the wavelet coefficients decoded from the same upper layer packet and lower layer packet or bit planes of the quantized coefficients thereof in a concatenated form.

  The image processing apparatus 100 described above is an embodiment of the invention according to claim 2, and a program for operating a computer as the image processing apparatus 100 is an embodiment of the invention according to claim 7. The image processing procedure performed by the image processing apparatus 100 is also an embodiment of the invention according to claim 5.

  Also, an image processing apparatus that performs similar decoding processing on code data according to another subband encoding method, which is composed of a set of partial codes that can be processed independently, similar to JPEG2000 code data (claim). The image processing apparatus according to the first aspect of the present invention can be easily realized from the above description. In this case, the first decoding processing means 106 executes the processing up to the generation of the subband coefficients or the quantized coefficients thereof in the decoding processing by the subband coding method, and the second decoding processing means 108 after that. It can be configured to be executed in the above. Then, a partial code having a low resolution or low image quality index is designated as a processing target at the time of the first decoding process, and a partial code having a higher resolution or higher image quality index than the previous time is designated at the second and subsequent decoding processes. By additionally specifying as a processing target, it is possible to generate display image data for progressive image display relating to resolution or image quality.

<Second Embodiment>
FIG. 11 is a block diagram of an image processing apparatus 200 according to the second embodiment of the present invention.

  For example, in a system in which encoding processing of image data is performed on the server side, code data is generated and transmitted to the client, code data is decoded on the client side, and an image is displayed, the server first receives a low resolution (low image quality). ) Code data to the client so that the client can grasp the contents of the image at an early stage, and then the server sends high resolution (high image quality) code data to the client, and the client side sends the high resolution ( In some cases, it may be desirable to be able to display high-quality images. The image processing apparatus 200 can efficiently perform the code data generation process in such a case.

  In FIG. 11, reference numeral 201 denotes storage means for storing image data to be processed. Reference numeral 202 denotes encoding processing means for executing JPEG2000 encoding processing. Reference numeral 203 denotes output code generation processing means for generating output code data (JPEG2000 code stream) using the processing result of the encoding processing means 202. Reference numeral 204 denotes storage means for storing output code data. Reference numeral 205 denotes control means for controlling the encoding process and the like.

  The encoding processing unit 202 divides the JPEG2000 encoding processing into a first encoding process and a second encoding process along the processing flow, and the first encoding processing unit 206 and the second encoding process, respectively. The configuration is executed by the processing unit 208. The encoding processing means 202 also includes storage means 207 for storing the result data of the first encoding process, which is intermediate result data of the JPEG 2000 encoding process.

  In the first example of this embodiment, the result data of the first encoding process is a quantized coefficient of a wavelet coefficient. In other words, in the first embodiment, the JPEG 2000 encoding process is divided so that the quantization process is included in the first encoding process and the entropy encoding process and the subsequent processes are included in the second encoding process. Therefore, in contrast to the functional block configuration shown in FIG. 1, in the first embodiment, as shown in the middle part of FIG. 11, the first encoding processing means 206 includes a color space conversion unit 211, a wavelet transform. 212 and a quantization unit 213, while the second encoding processing unit 208 includes an entropy encoding unit 214 and a tag processing unit 215.

  In the second example of the present embodiment, the result data of the first encoding process is a wavelet coefficient. That is, in the second embodiment, the JPEG 2000 encoding process is divided so that the wavelet transform process is included in the first encoding process, and the quantization process and subsequent processes are included in the second encoding process. Therefore, in contrast to the functional block configuration shown in FIG. 1, in the second embodiment, as shown in the lower part of FIG. 11, the first encoding processing unit 206 includes a color space conversion unit 2111 and a wavelet. A conversion unit 212 is included, and the second encoding processing unit 208 includes a quantization unit 213, an entropy encoding unit 214, and a tag processing unit 215.

  The image processing apparatus 200 according to the present embodiment includes, for example, a CPU 301, a main memory 302, a hard disk device 303, a display 304, a display controller 305, an input device (a pointing device such as a keyboard and a mouse), a network interface 307, and the like illustrated in FIG. Is realized by a program using a computer connected to the bus 308. A program for that purpose, that is, a program that causes the computer to function as each means constituting the image processing apparatus 200 shown in FIG. 11 is loaded into the main memory 302 from the hard disk device 303, for example, and executed by the CPU 301, whereby the computer It operates as the processing device 200. Such a program and various information recording (storage) media readable by a computer on which the program is recorded are also included in the present invention.

  Note that memory areas allocated on the main memory 302 are used as the storage units 201, 204, and 207 of the image processing apparatus 200. The image data to be processed is read from, for example, the hard disk device 303 and written in the storage unit 101 on the main memory 302.

  FIG. 12 is a schematic flowchart for explaining the operation of the image processing apparatus 200. Hereinafter, the operation of the image processing apparatus 200 will be described with reference to this flowchart.

  The control unit 205 sets the encoding condition (step S21). The encoding conditions to be set include, for example, the image size, tile size, precinct size, number of resolution levels, number of layers, number of components, progression order, and the like.

  Depending on the setting of this encoding condition, the structure of the code data to be finally generated is determined. Then, the image processing apparatus 200 sequentially executes the encoding process for generating the code data having such a structure in two or more steps.

  Next, the control unit 205 creates a code table on the storage unit 207 (step S22). This code table stores, for each packet constituting code data to be finally generated, designation information as to whether or not it is a target of encoding processing and a flag indicating whether or not the processing has been completed. This is a five-dimensional table in which information of packets having corresponding attributes can be searched using five types of indexes (tile number, precinct number, component number, resolution level, layer number) that determine packet attributes. It is also possible to create a code table for each tile. In this case, the code table of each tile can search packet information by using four types of indexes (precinct number, component number, resolution level, layer number). A dimension table may be used.

  Now, the control means 205 determines a packet to be subjected to the first encoding process within the range of the packet constituting the code data to be finally generated, and writes the designation information in the code table (step S24). ) Instructing the first encoding processing means 206 to start the first process. For example, when it is desired to finally generate code data consisting of packets with resolution levels 0 to 2, when it is desired to generate code data consisting only of packets with resolution levels 0 and 1 in the first encoding process, resolution level 0, A packet having an attribute of 1 is designated as the target of the first encoding process.

  The first encoding processing unit 206 divides the image data stored in the storage unit 201 into tiles with the tile size specified by the encoding condition, selects tiles in order from the tile of tile number 0, and selects the image of the selected tile. Data is sequentially read in units of precinct (step S26). The first encoding processing unit 206 refers to the code table to determine whether or not the read precinct image data is a processing target (step S27). In the code table, when one or more packets having the precinct number and tile number are designated as processing targets, and the flag of the first encoding process for these packets is OFF (unprocessed), Precinct image data is determined to be processed.

  The first code processing unit 206 performs a first encoding process on the precinct image data determined to be processed (step S28), and writes the result data in the storage unit 207 in association with the packet (step S29). That is, in the case of the first embodiment, the color space conversion unit 211 performs color space conversion (DC level shift if necessary), and the wavelet conversion unit 212 performs wavelet conversion on each component data. The wavelet coefficients are quantized by the quantization unit 213, and the quantized coefficients are written in the storage unit 207 as result data. In the case of the second embodiment, processing up to wavelet transformation is performed, and the obtained wavelet coefficients are written in the storage means 207 as result data. In step S29, the first encoding processing unit 206 sets the first encoding processing flag on the code table to ON (processed) for all packets having the precinct number and the tile number corresponding to the processed precinct. The process to do is also performed.

  When the above processing is repeated for each tile and processing is performed up to the last precinct image data of the last tile, it is determined that the first encoding processing of the first encoding processing has ended (step S25). The control unit 205 instructs the second encoding processing unit 208 to start the first process.

  The second encoding processing means 208 performs the first encoding processing result data (wavelet coefficient or its quantization coefficient) corresponding to each packet according to the for loop as described above corresponding to the progression order specified as the encoding condition. ) Are sequentially read from the storage means 207 (step S31). If the packet is designated as a processing target in the code table and the flag of the second encoding process of the packet is OFF (unprocessed), processing is performed. It is determined that the packet is the target (step S32, Yes), and the second encoding process for the packet is executed. At this time, the flag of the second encoding process for the packet is set to ON (processed) (step S33). ). That is, in the case of the first embodiment, the quantization coefficient of the wavelet coefficient is read from the storage means 207, entropy coding is performed by the entropy coding unit 214, and a packet is generated by the tag processing unit 215 from the code. . Tag information and tags such as main header and tile part header necessary for JPEG2000 code data are also generated by the tag processing unit 215.

  Note that the second encoding processing unit 208 stores the “internal state” at the end of the processing of the entropy encoding unit 214 in the storage unit 207 in step S33. This internal state is the state of superiority (significant flag) of each coefficient processed by the arithmetic encoder of the entropy encoder 214 and the state of the register of the arithmetic encoder. In addition, when the second encoding processing unit 208 performs the entropy decoding process of the packet of the layer other than the highest layer in step S33, the “internal state” stored in the storage unit 207 prior to the process. And the entropy encoding unit 214 is controlled to be restored to the previous processing state of the upper layer packet. By performing such control, it is possible to perform entropy encoding of the lower layer packet without performing entropy encoding again from the packet of the highest layer. In the present embodiment, the “internal state” is stored in the storage unit 207, but it is natural that the second encoding processing unit 208 may include a storage unit for storing the “internal state”.

  By repeating the same processing of the second encoding processing unit 208, packets designated as targets for the first encoding processing (for example, packets of resolution levels 0 and 1) are generated in the order of designated progression order. The main header, tile part header, and other tags are added and output sequentially. The output code generation processing unit 203 performs processing for sequentially storing the packet, tag information, and tag output from the second encoding processing unit 208 in the storage unit 204.

  When the second encoding process for the first time is completed (step S30, Yes), in the above example, JPEG2000 code data composed of packets of resolution levels 0 and 1 is generated on the storage unit 204 as output code data. Is done.

  Next, the control unit 205 determines a packet to be added as a target of the second encoding process within the range of the packet constituting the code data to be finally generated, and writes the designation information in the code table ( Step S24) The first encoding processing unit 206 is instructed to start the second process. In the case of the above example, a packet having a resolution level 2 attribute is additionally specified as a processing target.

  The first encoding processing unit 206 executes the same process as that in the first process. As in the above example, in the case of encoding processing under an encoding condition that does not exclude a specific region (tile, precinct), first encoding processing for tile and precinct image data related to all packets to be generated Is completed at the time of the first processing, and the first encoding processing flag for all the packets is already set to ON. Therefore, as a result of determining that all the precinct image data is not subject to processing in step S27, the image data is actually read out in units of precincts, and the first encoding process is performed repeatedly for the same packet. Absent.

  When the second process of the first encoding processing unit 206 is completed (step S25, Yes), the control unit 205 instructs the second encoding processing unit 208 to start the second process. The second encoding processing unit 206 performs the same processing as the first time, but excludes packets whose second encoding processing flag is ON (processed) from the processing target (step S32) and designates it as the encoding processing target. The second encoding process (step S33) is executed only for the packets that have not been processed at the first time among the packets that have been processed. That is, in the case of the above example, the second encoding process is executed only for the packets of resolution level 2 out of the packet groups of resolution levels 0 to 2. Therefore, packets designated as the second encoding process target are generated, and the second encoding processing unit 208 sequentially outputs these packets and necessary tile part headers, and outputs the updated main header at the end. The The output code generation processing unit 203 combines the packet, tile part header, etc. output from the second encoding processing unit 208 with the output code data generated in the storage unit 204 during the first encoding process. When the main header updated in sequence and last updated is input, the old main header is rewritten by the main header. Thus, in the case of the above example, it is generated on the storage means 204 as higher-resolution output code data consisting of packets of resolution levels 0-2. That is, in the first encoding process, the output code generation processing unit 203 generates the code data output from the encoding processing unit 202 as it is as the output code data in the storage unit 204, and generates the second (after that) In each encoding process, new output code data is generated by synthesizing the code data output from the encoding processing means 202 and the generated output code data.

  In the case of the above example, when the second process ends (step S30, Yes), it is determined that the process is completed (step S23, Yes). When the encoding process is executed three times or more, the same process after the third time is repeated.

  As described above, in the present embodiment, the encoding process is performed in a plurality of times, but the process is performed repeatedly for the same packet in both the first encoding process and the second encoding process. There is nothing. Therefore, the process can be performed more efficiently than a method that simply and repeatedly executes the entire encoding process.

  Here, the configuration of the encoding processing means 202 will be further described in relation to FIG. 12. The first encoding processing means 206 is composed of means having functions corresponding to steps S25, S26, S27, S28, and S29. The second encoding processing means 208 includes means having functions corresponding to steps S30, S31, S32, and S33. And in this embodiment, the function of these means is implement | achieved by the program using a computer as shown in FIG.

  In the above example, low-resolution output code data is generated in the first process, and higher-resolution output code data is generated in the second process. Therefore, if the low-resolution output code data is generated and transmitted to the client, and then transmitted to the client when the high-resolution output code data is generated, the client side can quickly A low-resolution image can be displayed at a stage to confirm the content of the image, and then a fine image can be displayed.

  In addition, the process of generating code data of a plurality of layers is divided into two or more times, and low-quality output code data consisting of packets of only the upper layer is generated in the first process, and in the second and subsequent processes, It is also possible to generate higher quality output code data including lower layer packets.

  The image processing apparatus 200 described above is an embodiment of the invention according to claim 4, and a program for operating a computer as the image processing apparatus 200 is an embodiment of the invention according to claim 8. An image processing procedure performed by the image processing apparatus 200 is also an embodiment of the invention according to claim 6.

  Also, an image processing apparatus that generates code data composed of a set of subcodes that can be processed independently, similar to JPEG2000 code data, and that performs the same encoding process using another subband encoding method The image processing apparatus according to the third aspect of the present invention can be easily realized from the above description. In this case, the first encoding processing means 206 executes the processing up to the processing for generating the subband coefficient or the quantization coefficient thereof in the encoding processing by the subband encoding method, and the subsequent processing is performed by the second encoding. What is necessary is just to set it as the structure performed by the processing means 208. Then, a partial code having a low resolution or low image quality index is designated as a processing target at the time of the first encoding process, and a part having a higher resolution or higher image quality index than the previous time at the second and subsequent encoding processes By additionally specifying a code as a processing target, it is possible to generate code data with gradually improved resolution or image quality.

It is a schematic block diagram for demonstrating the outline | summary of JPEG2000. It is explanatory drawing of the encoding processing flow of JPEG2000. It is explanatory drawing of the decoding processing flow of JPEG2000. It is a figure which shows the example of the subband division | segmentation by wavelet transformation. It is explanatory drawing of an image, a tile, a precinct, and a code block. It is a figure which shows the example of the packet which comprises a layer division | segmentation and a layer. It is a figure which shows the example of the packet arrangement | sequence by RLCP progression order. It is a figure which shows the example of the packet arrangement | sequence by LRCP progression order. It is a block diagram for demonstrating the structure of the image processing apparatus which concerns on the 1st Embodiment of this invention. 3 is a flowchart for explaining the operation of the image processing apparatus according to the first embodiment. It is a block diagram for demonstrating the structure of the image processing apparatus which concerns on the 2nd Embodiment of this invention. 10 is a flowchart for explaining the operation of the image processing apparatus according to the second embodiment. It is a block diagram which shows the structural example of the computer which can be utilized in order to implement | achieve the image processing apparatus which concerns on each embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Image processing apparatus 101 Storage means 102 Decoding processing means 103 Display image generation processing means 104 Storage means 105 Control means 106 First decoding processing means 107 Storage means 108 Second decoding processing means 200 Image processing apparatus 201 Storage means 202 Encoding processing means 203 Output code generation processing means 204 Storage means 205 Control means 206 First encoding processing means 207 Storage means 208 Second encoding processing means

Claims (9)

Decoding processing means configured to perform decoding processing divided into a plurality of times for code data according to a specific subband encoding method, which is configured by a set of partial codes that can be processed independently, and control means for controlling the decoding processing means And
The decoding processing means is a first decoding process for executing a process (hereinafter referred to as a first decoding process) until a subband coefficient or a quantized coefficient thereof is generated in the decoding process according to the subband encoding method. Means, a second decoding processing means for executing a process after the first decoding process of the decoding process of the subband encoding method (hereinafter referred to as a second decoding process), and the first decoding processing means Storage means for storing the generated subband coefficients or their quantization coefficients (hereinafter referred to as result data),
The decoding processing means executes the first decoding processing by the first decoding processing means only for the partial code designated as the processing target by the control means during the first decoding processing for the code data, and the result data The image data is output by executing a second decoding process on the result data stored in the storage unit and stored in the storage unit by the second decoding processing unit,
The decoding processing means executes the first decoding processing by the first decoding processing means only for the partial code additionally designated as a processing target by the control means at the time of the second and subsequent decoding processes on the code data, The result data is stored in the storage unit, and the second decoding process is performed on the result data stored in the storage unit by the second decoding unit, so that the resolution or the image quality is higher than the previous decoding process. An image processing apparatus characterized by outputting improved image data. Decoding processing means for executing decoding processing on JPEG2000 code data in a plurality of times, and control means for controlling the decoding processing means,
The decoding processing means is a first decoding processing means for executing processing (hereinafter referred to as first decoding processing) up to generation of a wavelet coefficient or a quantized coefficient thereof in JPEG2000 decoding processing, JPEG2000 decoding processing Second decoding processing means for executing processing after the first decoding processing (hereinafter referred to as second decoding processing), and a wavelet coefficient generated by the first decoding processing means or a quantized coefficient thereof ( And storage means for storing the result data)
The decoding processing means executes the first decoding processing by the first decoding processing means only for the packet designated as the processing target by the control means at the time of the first decoding processing on the code data, and the result data The image data is output by executing a second decoding process on the result data stored in the storage means by the second decoding processing means,
The decoding processing means executes the first decoding processing by the first decoding processing means only for a packet that is additionally designated as a processing target by the control means at the time of the second and subsequent decoding processes on the code data, The result data is stored in the storage unit, and the second decoding process is performed on the result data stored in the storage unit by the second decoding unit, thereby improving the resolution or image quality compared to the previous decoding process. An image processing apparatus that outputs the processed image data. Coding processing means for performing coding processing by a specific subband coding method for generating code data composed of a set of partial codes that can be processed independently for image data in a plurality of times; Output code generation processing means for generating output code data from code data output from the encoding processing means, and control means for controlling the encoding processing means and the output code generation processing means,
The encoding processing means performs a process (hereinafter referred to as a first encoding process) for generating a subband coefficient or a quantized coefficient thereof in the encoding process by the subband encoding method. 1 encoding processing means, second encoding processing means for executing processing after the first encoding processing of the encoding processing by the subband encoding scheme (hereinafter referred to as second encoding processing), and Storage means for storing a subband coefficient generated by the first encoding processing means or a quantized coefficient thereof (hereinafter referred to as result data),
The encoding processing means performs the first encoding by the first encoding processing means only for the image area related to the partial code designated as the processing target by the control means during the first encoding processing on the image data. A second unit for executing the process, storing the result data in the storage unit, and generating the designated partial code using the result data stored in the storage unit by the second encoding unit. By executing the encoding process, code data including the designated partial code is output,
The encoding processing means is an image area related to a partial code additionally designated as a processing target by the control means at the time of encoding processing of the second and subsequent times for image data, and at the time of encoding processing up to the previous time Only the unprocessed image area is subjected to the first encoding processing by the first encoding processing means, the result data is stored in the storage means, and the second encoding processing means is stored in the storage means. Output code data including the additional specified partial code by executing a second encoding process for generating the additional specified partial code using the result data of
The output code generation processing unit generates the code data output from the encoding processing unit as it is as the output code data during the first encoding process, and performs the encoding during the second and subsequent encoding processes. By combining the code data output from the processing means with the output code data generated during the previous encoding process, output code data with improved resolution or image quality compared to the previous encoding process is generated. An image processing apparatus. Encoding processing means for executing JPEG2000 encoding processing on image data in a plurality of times, output code generation processing means for generating output code data from code data output from the encoding processing means, and the code And a control means for controlling the output code generation processing means,
The encoding processing means includes a first encoding processing means for executing a process (hereinafter referred to as a first encoding process) of generating a wavelet coefficient or a quantized coefficient thereof in the encoding process of JPEG2000, Generated by the second encoding processing means for executing processing after the first encoding processing of JPEG2000 encoding processing (hereinafter referred to as second encoding processing), and the first encoding processing means. Storage means for storing the wavelet coefficients or the quantized coefficients thereof (hereinafter referred to as result data),
The encoding processing means performs the first encoding processing by the first encoding processing means only for an image area related to a packet designated as a processing target by the control means during the first encoding processing for image data. The second encoding for generating the designated packet using the result data stored in the storage means by the second encoding processing means By executing the process, the code data including the designated packet is output,
The encoding processing means is an image area related to a packet additionally designated as a processing target by the control means at the second and subsequent encoding processes on image data, and has not been processed at the previous encoding process. The first encoding processing unit executes the first encoding process only for the image area to be processed, the result data is stored in the storage unit, and the second encoding processing unit is stored in the storage unit Outputting code data including the additionally specified packet by executing a second encoding process for generating the additional specified packet using the result data;
The output code generation processing unit generates the code data output from the encoding processing unit as it is as the output code data during the first encoding process, and performs the encoding during the second and subsequent encoding processes. By combining the code data output from the processing means with the output code data generated during the previous encoding process, output code data with improved resolution or image quality compared to the previous encoding process is generated. An image processing apparatus. A decoding process step for executing the decoding process for JPEG2000 code data in a plurality of times, and a control step for controlling the decoding process step,
The decoding processing step is a first decoding processing step for executing processing up to generation of wavelet coefficients or quantization coefficients thereof (hereinafter referred to as first decoding processing) of decoding processing of JPEG2000, decoding processing of JPEG2000 A second decoding process step for executing a process after the first decoding process (hereinafter referred to as a second decoding process), and a wavelet coefficient generated by the first decoding process step or a quantized coefficient thereof ( (Hereinafter referred to as result data) including a storage step for storing in the storage means,
In the decoding process step, the first decoding process is executed in the first decoding process step only for the packet designated as the processing target by the control step in the first decoding process for the code data, and the result data is converted into the data The image data is output by executing a second decoding process on the result data stored in the storage unit by the storing step and the result data stored in the storage unit by the second decoding process step,
In the decoding process step, the first decoding process is executed in the first decoding process step only for the packet that is additionally designated as the processing target by the control step during the second and subsequent decoding processes for the code data, The result data is stored in the storage unit in the storing step, and the second decoding process is performed on the result data stored in the storage unit in the second decoding process step, so that the resolution is higher than that in the previous decoding process. An image processing method characterized by outputting image data with improved image quality. An encoding process for executing JPEG2000 encoding processing on image data in a plurality of times, an output code generating process for generating output code data from the code data output from the encoding process, and the code And a control step for controlling the output code generation processing step,
The encoding processing step is a first encoding processing step for executing processing (hereinafter referred to as first encoding processing) until generation of wavelet coefficients or quantization coefficients thereof in JPEG2000 encoding processing, Generated by a second encoding process for executing a process after the first encoding process of the JPEG2000 encoding process (hereinafter referred to as a second encoding process), and the first encoding process. Including a storing step of storing the wavelet coefficient or the quantized coefficient thereof (hereinafter referred to as result data) in the storage means,
In the encoding process step, the first encoding process is performed in the first encoding process step only for the image region related to the packet designated as the processing target by the control process in the first encoding process for the image data. And the result data is stored in the result storage unit in the storage step, and the designated packet is generated using the result data stored in the storage unit in the second encoding process step. The code data including the designated packet is output by executing the second encoding process of
In the encoding processing step, the image region related to the packet additionally designated as a processing target by the control step at the time of the second and subsequent encoding processing on the image data, which has not been processed at the previous encoding processing. The first encoding process is executed in the first encoding process step only for the image area of the process, and the result data is stored in the storage means in the storage step, and the storage means is stored in the storage means in the second encoding process step. Outputting code data including the additional designated packet by executing a second encoding process for generating the additional designated packet using the stored result data;
In the output code generation processing step, the code data output from the encoding processing manual step is generated as it is as the output code data in the first encoding processing, and the code is output in the second and subsequent encoding processing. By combining the code data output from the encoding process with the output code data generated during the previous encoding process, generating output code data with improved resolution or image quality compared to the previous encoding process. A featured image processing method. Decoding processing means for executing decoding processing on JPEG2000 code data in a plurality of times, and control means for controlling the decoding processing means,
The decoding processing means is a first decoding processing means for executing processing (hereinafter referred to as first decoding processing) up to generation of a wavelet coefficient or a quantized coefficient thereof in JPEG2000 decoding processing, JPEG2000 decoding processing Second decoding processing means for executing processing after the first decoding processing (hereinafter referred to as second decoding processing), and a wavelet coefficient generated by the first decoding processing means or a quantized coefficient thereof ( And storage means for storing the result data)
The decoding processing means executes the first decoding processing by the first decoding processing means only for the packet designated as the processing target by the control means at the time of the first decoding processing on the code data, and the result data The image data is output by executing a second decoding process on the result data stored in the storage means by the second decoding processing means,
The decoding processing means executes the first decoding processing by the first decoding processing means only for a packet that is additionally designated as a processing target by the control means at the time of the second and subsequent decoding processes on the code data, The result data is stored in the storage unit, and the second decoding process is performed on the result data stored in the storage unit by the second decoding unit, thereby improving the resolution or image quality compared to the previous decoding process. A program for causing a computer to function as each of the means for operating the computer as an image processing apparatus that outputs the processed image data. Encoding processing means for executing JPEG2000 encoding processing on image data in a plurality of times, output code generation processing means for generating output code data from code data output from the encoding processing means, and the code And a control means for controlling the output code generation processing means,
The encoding processing means includes a first encoding processing means for executing a process (hereinafter referred to as a first encoding process) of generating a wavelet coefficient or a quantized coefficient thereof in the encoding process of JPEG2000, Generated by the second encoding processing means for executing processing after the first encoding processing of JPEG2000 encoding processing (hereinafter referred to as second encoding processing), and the first encoding processing means. Storage means for storing the wavelet coefficients or the quantized coefficients thereof (hereinafter referred to as result data),
The encoding processing means performs the first encoding processing by the first encoding processing means only for an image area related to a packet designated as a processing target by the control means during the first encoding processing for image data. The second encoding for generating the designated packet using the result data stored in the storage means by the second encoding processing means By executing the process, the code data including the designated packet is output,
The encoding processing means is an image area related to a packet additionally designated as a processing target by the control means at the second and subsequent encoding processes on image data, and has not been processed at the previous encoding process. The first encoding processing unit executes the first encoding process only for the image area to be processed, the result data is stored in the storage unit, and the second encoding processing unit is stored in the storage unit Outputting code data including the additionally specified packet by executing a second encoding process for generating the additional specified packet using the result data;
The output code generation processing unit generates the code data output from the encoding processing unit as it is as the output code data during the first encoding process, and performs the encoding during the second and subsequent encoding processes. By combining the code data output from the processing means with the output code data generated during the previous encoding process, output code data with improved resolution or image quality compared to the previous encoding process is generated. A program that causes a computer to function as each of the means for operating the computer as an image processing apparatus.   A computer-readable information recording medium on which the program according to claim 7 or 8 is recorded.

Images