JP2004201048A - Image information processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image information processing method capable of simplifying the management of image information and image related information related to the image information. <P>SOLUTION: The image information processing method manages the image related information related to a rectangular region image or a plurality of hierarchically organized divisions of the rectangular region image by using a prescribed marker segment specified by an encoding format by each rectangular region in the case of compression, and processes the image related information together with an expanded image of a prescribed hierarchy of a related rectangular region in the case of expansion. Thus, in the case of displaying an image by revising e.g. its hierarchy (resolution), the image related information managed according to the hierarchy (resolution) can be displayed together with the image of the hierarchy (with the resolution). That is, in the case of applying reduction processing to map image by using a district name being text information displayed overlapped on the map image as the image related information, the district name (image related information) in response to a degree of reduction can be displayed in cross-reference with the map image by using one file without the need for preparation of a database in addition to the image information. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention divides an image into one or a plurality of rectangular areas, and compresses pixel values hierarchically by a discrete wavelet transform, quantization, and encoding procedure for each of the rectangular areas. The present invention relates to an image information processing method for extending in a procedure.
[0002]
[Prior art]
2. Description of the Related Art Due to advances in image input technology and output technology thereof, demands for higher definition of images have been extremely increased in recent years. For example, taking a digital camera as an example of an image input device, the price of a high-performance charge-coupled device (CCD: Charge Coupled Device) having more than 3 million pixels has been reduced, and the price range has become widespread. Products have come to be widely used. And a product with 5 million pixels is coming soon. It is said that this increasing tendency of the number of pixels will continue for a while.
[0003]
On the other hand, with regard to image output / display devices, for example, products in the hard copy field such as laser printers, ink jet printers and sublimation printers, and flat devices such as CRTs, LCDs (liquid crystal display devices), and PDPs (plasma display devices). The high definition and low price of products in the field of soft copy of panel displays are remarkable.
[0004]
Due to the effect of bringing high-performance, low-cost image input / output products to the market, the popularization of high-definition images has begun, and it is expected that demand for high-definition images will increase in all scenes in the future. Indeed, the development of technologies relating to networks, including personal computers and the Internet, has accelerated these trends. In particular, recently, mobile devices such as mobile phones and notebook personal computers have become very popular, and opportunities to transmit or receive high-definition images from any point using communication means have been rapidly increasing.
[0005]
Against this background, the demand for higher performance or multifunctional image compression / decompression technology that facilitates the handling of high-definition images will inevitably increase in the future.
[0006]
Therefore, in recent years, as one of the image compression methods satisfying such demands, a new method called JPEG2000, which can restore a high-quality image even at a high compression rate, is being standardized. In JPEG2000, by dividing an image into rectangular areas (tiles), it is possible to perform compression / expansion processing in a small memory environment. That is, each tile is a basic unit when executing the compression / decompression process, and the compression / decompression operation can be performed independently for each tile.
[0007]
In recent years, the entire map of Japan is displayed on a display device on a screen, and when a partial area on the map of Japan is designated, the designated area is enlarged and displayed on the display device. Information providing devices, computer software, and the like that provide various information related to the designated area have been developed.
[0008]
In such information providing devices and computer software, various types of information relating to the above-mentioned areas are stored and held as text information in a database or the like, and extracted from the database in accordance with image information displayed on the display device. Then, the image information is superimposed and displayed.
[0009]
[Problems to be solved by the invention]
However, as described above, when the text information superimposed on the image information displayed on the display device is managed separately from the image information by using the database, the management of the database is difficult and there is no versatility. There is a problem. In particular, in image display including map information on the Internet, it is necessary to have a plurality of image information and text information related to each image information depending on an enlargement ratio, and thus management and maintenance of the image information and text information are complicated.
[0010]
An object of the present invention is to provide an image information processing method capable of simplifying management of image information and image-related information related to the image information.
[0011]
[Means for Solving the Problems]
The image information processing method according to the first aspect of the present invention divides an image into one or a plurality of rectangular regions, and compresses the pixel values for each of the rectangular regions hierarchically by a procedure of discrete wavelet transform, quantization, and encoding, In an image information processing method for decompressing compression-encoded image data in a reverse procedure, at the time of compression, image-related information related to a rectangular area image divided into one or a plurality of rectangular areas and hierarchized is related. Managing with a predetermined marker segment specified by a code format for each rectangular area to be expanded, and, at the time of decompression, expanding the image-related information managed by the marker segment into a decompressed image of a predetermined hierarchy of the associated rectangular area And processing together.
[0012]
Therefore, at the time of compression, image-related information related to a rectangular area image divided into one or a plurality of rectangular areas and hierarchized is managed by a predetermined marker segment defined in a code format for each rectangular area, At the time of decompression, the image-related information is associated with a decompressed image of a predetermined layer in a rectangular area to which the image-related information relates. Accordingly, for example, when the display is performed with the hierarchy (resolution) changed, it becomes possible to display the image-related information managed according to the hierarchy (resolution) together with the image of the hierarchy (resolution). In other words, in a case where a map image is reduced by using a place name, which is text information superimposed on a map image as image-related information, and a database is not prepared separately from the image information, one file can be used according to the degree of reduction. It becomes possible to display the place name (image-related information) in association with the map image.
[0013]
According to a second aspect of the present invention, in the image information processing method according to the first aspect, the code format is a JPEG2000 code format, and the marker segment for managing the image-related information is a COM marker.
[0014]
Therefore, it is possible to maintain the compatibility of the files, and to have versatility.
[0015]
According to a third aspect of the present invention, in the image information processing method of the second aspect, the COM marker is provided in a main header (Main Header) in a JPEG2000 code format.
[0016]
Therefore, it is possible to change the image-related information for each layer (resolution).
[0017]
According to a fourth aspect of the present invention, in the image information processing method of the second aspect, the COM marker is provided in a tile header (Tile Header) in a JPEG2000 code format.
[0018]
Therefore, image-related information can be set for each rectangular area (tile) and each layer (resolution).
[0019]
According to a fifth aspect of the present invention, in the image information processing method according to any one of the first to fourth aspects, the image-related information is generated in a binary format.
[0020]
Therefore, it is possible to easily manage the image-related information.
[0021]
According to a sixth aspect of the present invention, in the image information processing method according to any one of the first to fourth aspects, the image-related information is generated in XML (extensible Markup Language).
[0022]
Therefore, it is possible to easily manage the image-related information.
[0023]
BEST MODE FOR CARRYING OUT THE INVENTION
First, the outlines of the “hierarchical encoding algorithm” and the “JPEG2000 algorithm” which are the premise of the present embodiment will be described.
[0024]
FIG. 1 is a functional block diagram of a system that implements a basic hierarchical encoding algorithm of the JPEG2000 system. This system includes a color space conversion / inverse transformation unit 101, a two-dimensional wavelet transformation / inverse transformation unit 102, a quantization / inverse quantization unit 103, an entropy coding / decoding unit 104, and a tag processing unit 105. It is configured.
[0025]
One of the biggest differences between this system and the conventional JPEG algorithm is the conversion method. In JPEG, a discrete cosine transform (DCT: Discrete Cosine Transform) is used, whereas in this hierarchical coding algorithm, a two-dimensional wavelet transform / inverse transform unit 102 uses a discrete wavelet transform (DWT: Discrete Wavelet Transform). ing. DWT has an advantage that the image quality in a high compression area is better than DCT, and this is one of the major reasons why DWT was adopted in JPEG2000 which is a successor algorithm of JPEG.
[0026]
Another major difference is that in the hierarchical coding algorithm, a functional block of the tag processing unit 105 is added in order to form a code at the last stage of the system. The tag processing unit 105 generates compressed data as code string data at the time of image compression operation, and interprets code string data required for decompression at the time of decompression operation. Then, JPEG2000 can realize various convenient functions by the code string data. For example, the compression / expansion operation of a still image can be freely stopped at an arbitrary layer (decomposition level) corresponding to octave division in a DWT on a block basis (see FIG. 3 described later).
[0027]
In many cases, a color space conversion / inverse conversion 101 is connected to the input / output portion of the original image. For example, an RGB color system composed of R (red) / G (green) / B (blue) components of a primary color system, and Y (yellow) / M (magenta) / C (cyan) components of a complementary color system The conversion or inverse conversion from the YMC color system to the YUV or YCbCr color system corresponds to this.
[0028]
Next, the JPEG2000 algorithm will be described.
[0029]
Generally, in a color image, as shown in FIG. 2, each component 111 (here, the RGB primary color system) of the original image is divided by a rectangular area. The divided rectangular area is generally called a block or a tile. In JPEG2000, it is generally called a tile. Hereinafter, such a divided rectangular area is referred to as a tile. (In the example of FIG. 2, each component 111 is divided into a total of 16 rectangular tiles 112, 4 × 4 vertically and horizontally.) When such individual tiles 112 (in the example of FIG. 2, R00, R01,..., R15 / G00, G01,..., G15 / B00, B01,. Is the basic unit of Therefore, the compression / decompression operation of the image data is performed independently for each component and for each tile 112.
[0030]
At the time of encoding image data, the data of each tile 112 of each component 111 is input to the color space conversion / inverse conversion unit 101 of FIG. 1 and subjected to color space conversion. A dimensional wavelet transform (forward transform) is performed, and spatial division into frequency bands is performed.
[0031]
FIG. 3 shows subbands at each decomposition level when the number of decomposition levels is three. That is, a two-dimensional wavelet transform is performed on the tile original image (0LL) (decomposition level 0) obtained by dividing the original image into tiles, and the subbands (1LL, 1HL, 1LH) indicated by the decomposition level 1 are obtained. , 1HH). Subsequently, two-dimensional wavelet transform is performed on the low-frequency component 1LL in this layer to separate the subbands (2LL, 2HL, 2LH, 2HH) shown in the decomposition level 2. Similarly, two-dimensional wavelet transform is performed on the low-frequency component 2LL in the same manner to separate the sub-bands (3LL, 3HL, 3LH, 3HH) shown in the decomposition level 3. In FIG. 3, the subbands to be coded at each decomposition level are shaded. For example, when the number of decomposition levels is 3, the subbands (3HL, 3LH, 3HH, 2HL, 2LH, 2HH, 1HL, 1LH, 1HH) indicated by shading are to be encoded, and the 3LL subbands are encoded. Is not converted.
[0032]
Next, bits to be encoded are determined in the designated order of encoding, and the quantization / inverse quantization unit 103 shown in FIG. 1 generates a context from bits around the target bits.
[0033]
The wavelet coefficients after the quantization process are divided into non-overlapping rectangles called “precincts” for each subband. This was introduced to make efficient use of memory in the implementation. As shown in FIG. 4, one precinct is formed of three spatially coincident rectangular areas. Further, each precinct is divided into non-overlapping rectangular "code blocks". This is a basic unit when performing entropy coding.
[0034]
The coefficient values after the wavelet transform can be quantized and encoded as they are, but in JPEG2000, in order to increase the encoding efficiency, the coefficient values are decomposed into `` bit planes '', and each pixel or code block is decomposed. "Bit planes" can be ranked.
[0035]
Here, FIG. 5 is an explanatory diagram showing an example of a procedure for prioritizing bit planes. As shown in FIG. 5, in this example, the original image (32 × 32 pixels) is divided into four 16 × 16 pixel tiles, and the size of the precinct of the decomposition level 1 and the size of the code block are as follows. Each has 8 × 8 pixels and 4 × 4 pixels. The numbers of precincts and code blocks are assigned in raster order. In this example, the precincts are assigned numbers 0 to 3, and the code blocks are assigned numbers 0 to 3. The pixel expansion outside the tile boundary is performed by using a mirroring method, performing a wavelet transform using a reversible (5, 3) filter, and obtaining a wavelet coefficient value of decomposition level 1.
[0036]
FIG. 5 also shows an explanatory diagram showing an example of a typical “layer” configuration concept of tile 0 / precinct 3 / code block 3. The converted code block is divided into subbands (1LL, 1HL, 1LH, 1HH), and each subband is assigned a wavelet coefficient value.
[0037]
The layer structure is easy to understand when the wavelet coefficient value is viewed from the horizontal direction (bit plane direction). One layer is composed of an arbitrary number of bit planes. In this example, layers 0, 1, 2, and 3 are made up of 1, 3, 1, and 3 bit planes, respectively. Then, a layer including a bit plane closer to LSB (Least Significant Bit: Least Significant Bit) is subject to quantization first, and conversely, a layer closer to MSB (Most Significant Bit: Most Significant Bit) is quantized to the end. It will remain without being. A method of discarding from a layer close to the LSB is called truncation, and it is possible to finely control the quantization rate. As described above, the process of discarding a code from a code in which a bit plane (or a sub-bit plane) is not deleted until a predetermined compression rate is obtained is called post-quantization, which is the most significant feature of the JPEG2000 algorithm. .
[0038]
The entropy encoding / decoding unit 104 shown in FIG. 1 performs encoding on the tile 112 of each component 111 by probability estimation from the context and the target bit. In this way, the encoding process is performed on all the components 111 of the original image in tile 112 units. Finally, the tag processing unit 105 performs a process of combining all the encoded data from the entropy encoding / decoding unit 104 into one piece of code string data (code stream) and adding a tag thereto.
[0039]
On the other hand, at the time of decoding, the image data is generated from the code string data of each tile 112 of each component 111, contrary to the case of encoding the image data. In this case, the tag processing unit 105 interprets the tag information added to the code string data input from the outside, decomposes the code string data into code string data of each tile 112 of each component 111, and A decoding process (decompression process) is performed for each code string data of each tile 112. At this time, the positions of the bits to be decoded are determined in the order based on the tag information in the code string data, and the quantization / dequantization unit 103 sets the peripheral bits of the target bit position (the A context is generated from the sequence of (finished). The entropy coding / decoding unit 104 performs decoding by probability estimation from the context and the code string data, generates a target bit, and writes it to the position of the target bit. Since the data decoded in this way is spatially divided for each frequency band, the two-dimensional wavelet transform / inverse transform unit 102 performs an inverse two-dimensional wavelet transform on the data to obtain each component of the image data. The tile is restored. The restored data is converted by the color space conversion / inverse conversion unit 101 into the original color system image data.
[0040]
The above is the outline of the “JPEG2000 algorithm”.
[0041]
Hereinafter, an embodiment of the present invention will be described. Here, an example relating to an image compression / decompression technique represented by JPEG2000 will be described, but it goes without saying that the present invention is not limited to the content of the following description.
[0042]
FIG. 6 is a system configuration diagram showing a system including the image processing apparatus 1 to which the present invention is applied. As shown in FIG. 6, an image processing apparatus 1 to which the present invention is applied is, for example, a personal computer, and is connectable to a server computer S that stores and holds various image data via a network 5 that is the Internet. .
[0043]
In the present embodiment, the image data stored and held in the server computer S is a compression code generated according to the “JPEG2000 algorithm”. FIG. 7 shows a schematic configuration of a JPEG2000 code format. The code format starts with an SOC (Start of Codestream) marker indicating the start of code data. After the SOC marker, a main header, which is tag information describing coding parameters, quantization parameters, and the like, follows, followed by actual code data. The actual code data starts with a SOT (Start of Tile-part) marker, and is composed of a tile header (Tile Header) as tag information, a SOD (Start of data) marker, and tile data (code: bit stream). After the code data corresponding to the entire image, an EOC (End of Codestream) marker, which is tag information indicating the end of the code, is added. The main header and the tile header as described above can include a comment marker (COM marker) used when adding image-related information such as a comment on an image.
[0044]
In the present embodiment, image-related information that is text information associated with an image is stored in the comment marker of the main header or the tile header. In the text information, the image hierarchy, the position of the text on the image, the font or size of the text, the color, and the like are set as supplementary information. Such image-related information is generated as metadata, and XML (extensible Markup Language), a binary format, or the like is used.
[0045]
FIG. 8 is a block diagram schematically illustrating a hardware configuration of the image processing apparatus 1. As shown in FIG. 8, the image processing apparatus 1 includes a CPU (Central Processing Unit) 6 for performing information processing, a ROM (Read Only Memory) 7 for storing information, and a primary storage device such as a RAM (Random Access Memory) 8; A hard disk drive (HDD) 10, which is a storage unit for storing a compression code (see FIG. 7) downloaded from the server computer S via the network 5, for storing information, distributing information to the outside, and obtaining information from the outside CD-ROM drive 12, a communication control device 13 for transmitting information by communication with another external computer via the network 5, a CRT (Cathode Ray Tube) for displaying the progress and results of processing to an operator 15 such as a display and an LCD (Liquid Crystal Display), and an input device 14 such as a keyboard and a mouse for an operator to input commands, information, and the like to the CPU 6. The bus controller 9 operates by arbitrating data transmitted and received between these units.
[0046]
Since the RAM 8 has a property of storing various data in a rewritable manner, the RAM 8 functions as a work area of the CPU 6 and plays a role of, for example, a buffer memory in an image display process described later.
[0047]
In such an image processing apparatus 1, when the user turns on the power, the CPU 6 starts a program called a loader in the ROM 7, reads a program called an operating system, which manages computer hardware and software, from the HDD 10 into the RAM 8, Start the system. Such an operating system starts a program, reads information, and saves information in response to a user operation. As typical operating systems, Windows (registered trademark), UNIX (registered trademark), and the like are known. The operation programs running on these operating systems are called application programs.
[0048]
Here, the image processing apparatus 1 stores an image processing program in the HDD 10 as an application program. In this sense, the HDD 10 functions as a storage medium that stores the image processing program.
[0049]
In general, an operation program installed in the HDD 10 of the image processing apparatus 1 is recorded on an optical information recording medium such as a CD-ROM 11 or a DVD-ROM, or a magnetic medium such as an FD, and the recorded operation program. The program is installed on the HDD 10. Therefore, a portable storage medium such as an optical information recording medium such as the CD-ROM 11 or a magnetic medium such as an FD can be a storage medium for storing the image processing program. Further, the image processing program may be fetched from outside via the communication control device 13 and installed in the HDD 10, for example.
[0050]
In the image processing apparatus 1, when an image processing program operating on an operating system is started, the CPU 6 executes various arithmetic processes according to the image processing program to centrally control each unit. Among the various types of arithmetic processing executed by the CPU 6 of the image processing apparatus 1, the characteristic processing of the present embodiment will be described below.
[0051]
Here, among the image display processes executed by the CPU 6 according to the image processing program, an image display process using the metadata of the comment marker will be described.
[0052]
First, an image display process using the metadata of the comment marker in the main header will be described.
[0053]
Here, FIG. 9 is an explanatory diagram showing an example of image display. In the example shown in FIG. 9, the purpose is to hierarchically display the area names of the Japan map. FIG. 10 is an explanatory diagram showing an example of metadata stored in the comment marker of the main header of the image shown in FIG. In the example shown in FIG. 10, this metadata is generated in XML, and the layers of the image are classified by the <layer> tag. Then, in the first hierarchical level, it is shown that "Japan" is displayed in blue at 14 points at the position of x = 180 and y = 360 in the image pixel with respect to the image of the Japanese map (FIG. 9 (a) )reference). Similarly, in the second layer, a 12-point green “Kanto” is displayed at the position of x = 100, y = 200 on the image of the Japanese map, and “Kanto” is displayed at the position of x = 80, y = 240. Tohoku "is displayed (see FIG. 9B). In this way, the text and the image are associated with each other for each hierarchy.
[0054]
Next, an image display process using the metadata of the comment marker in the tile header will be described.
[0055]
Here, FIG. 11 is an explanatory diagram showing an example of an image display divided into tiles. The example shown in FIG. 11 is intended to partially enlarge and display the Japan map. FIG. 12 is an explanatory diagram showing an example of the metadata stored in the comment marker of the main header of the image shown in FIG. The metadata of the comment marker of the tile header is information of only a portion related to the tile image related to the tile header. That is, in the example shown in FIG. 12, for the tile image including the Kanto area, “Yokohama” is displayed in blue at 14 points at the position of x = 200, y = 400, and the position of x = 180, y = 360 "Kawasaki" is displayed in blue at 14 points (see FIG. 11B).
[0056]
Here, at the time of compression, image-related information relating to a rectangular area image divided into one or a plurality of rectangular areas and hierarchized is managed by a predetermined marker segment defined in a code format for each rectangular area. At the time of decompression, the image-related information is processed together with the decompressed image of a predetermined layer of the related rectangular area, so that, for example, when the layer (resolution) is changed and displayed, the The image-related information managed by the user can be displayed together with the image of the hierarchy (resolution). In other words, in a case where a map image is reduced by using the place name, which is text information superimposed on the map image as image-related information, a database is not prepared separately from the image information. Since the place name (image-related information) can be displayed in association with the map image, the management of the image information and the image-related information related to the image information can be simplified.
[0057]
【The invention's effect】
According to the image information processing method of the present invention, an image is divided into one or a plurality of rectangular areas, and pixel values are hierarchically compressed by a discrete wavelet transform, quantization, and encoding for each of the rectangular areas. Then, in the image information processing method for decompressing the compression-encoded image data in the reverse procedure, at the time of compression, image-related information related to a rectangular area image divided into one or a plurality of rectangular areas and hierarchized. Managing a predetermined marker segment defined by a code format for each related rectangular area, and, at the time of decompression, the image related information managed by the marker segment is stored in a predetermined hierarchy of the related rectangular area. Processing together with the decompressed image. In the case of compression, the image-related information relating to the rectangular area image divided into one or a plurality of rectangular areas and hierarchized For example, a layer (resolution) is managed by managing the image-related information together with a decompressed image of a predetermined layer of a related rectangular area at the time of decompression by managing with a predetermined marker segment defined by a code format for each area. In the case of changing the display, the image-related information managed according to the hierarchy (resolution) can be displayed together with the image of the hierarchy (resolution). In other words, in a case where a map image is reduced by using a place name, which is text information superimposed on a map image as image-related information, and a database is not prepared separately from the image information, one file can be used according to the degree of reduction. Since the place name (image-related information) can be displayed in association with the map image, the management of the image information and the image-related information related to the image information can be simplified.
[0058]
According to the second aspect of the present invention, in the image information processing method according to the first aspect, the code format is a JPEG2000 code format, and the marker segment for managing the image-related information is a COM marker. File compatibility can be maintained and versatility can be achieved.
[0059]
According to the third aspect of the present invention, in the image information processing method according to the second aspect, the COM marker is provided in a main header (Main Header) in a JPEG2000 code format, so that each layer (resolution) is provided. The image related information can be changed.
[0060]
According to the fourth aspect of the present invention, in the image information processing method according to the second aspect, the COM marker is provided in a tile header (Tile Header) in a JPEG2000 code format, thereby providing a rectangular area (tile). Image-related information can be set for each layer and for each layer (resolution).
[0061]
According to the invention described in claim 5, in the image information processing method according to any one of claims 1 to 4, the image-related information is generated in a binary format, so that the image-related information is easily managed. can do.
[0062]
According to a sixth aspect of the present invention, in the image information processing method according to any one of the first to fourth aspects, the image-related information is generated in XML (eXtensible Markup Language). Can be easily managed.
[Brief description of the drawings]
FIG. 1 is a functional block diagram of a system for realizing a hierarchical coding algorithm which is a basis of the JPEG2000 system which is a premise of the present invention.
FIG. 2 is an explanatory diagram showing a divided rectangular area of each component of an original image.
FIG. 3 is an explanatory diagram showing subbands at each decomposition level when the number of decomposition levels is three.
FIG. 4 is an explanatory diagram showing a precinct.
FIG. 5 is an explanatory diagram showing an example of a procedure for ranking bit planes.
FIG. 6 is a system configuration diagram showing a system including an image processing apparatus according to an embodiment of the present invention.
FIG. 7 is an explanatory diagram illustrating a schematic configuration of a JPEG2000 code format.
FIG. 8 is a block diagram schematically illustrating a hardware configuration of the image processing apparatus.
FIG. 9 is an explanatory diagram illustrating an example of an image display.
10 is an explanatory diagram showing an example of metadata stored in a comment marker of a main header of the image shown in FIG.
FIG. 11 is an explanatory diagram showing an example of displaying an image divided into tiles.
12 is an explanatory diagram showing an example of metadata stored in a comment marker of a main header of the image shown in FIG.

Claims (6)

The image is divided into one or a plurality of rectangular areas, and pixel values are hierarchically compressed by a discrete wavelet transform, quantization, and encoding for each of the rectangular areas, and the compressed and encoded image data is expanded in a reverse procedure. In the image information processing method,
At the time of compression, a step of managing image-related information related to a rectangular area image divided into one or a plurality of rectangular areas and hierarchized by a predetermined marker segment defined in a code format for each relevant rectangular area When,
At the time of decompression, processing the image-related information managed by the marker segment together with a decompressed image of a predetermined hierarchy of an associated rectangular area;
An image information processing method comprising: 2. The image information processing method according to claim 1, wherein the code format is a JPEG2000 code format, and the marker segment for managing the image-related information is a COM marker. The image information processing method according to claim 2, wherein the COM marker is provided in a main header (Main Header) in a JPEG2000 code format. The image information processing method according to claim 2, wherein the COM marker is provided in a tile header (Tile Header) in a JPEG2000 code format. 5. The image information processing method according to claim 1, wherein the image related information is generated in a binary format. The image information processing method according to claim 1, wherein the image-related information is generated in XML (extensible Markup Language).

Images