JP2001223984A - Device and method for processing picture data - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a picture data processor and its processing method, by which the deterioration of an original picture is reduced when picture data where additional information is superimposed as electronic transparent information is compressed and encoded. SOLUTION: Additional information data being electronic transparent information is superimposed on the free area of an area for storing original picture sub-block data which is encoded by division (step S312). In this case, the code amount of additional information data is calculated (step S304), a quantizing coefficient is adjusted to secure the free area for its arrangement and original picture sub-block data is encoded by compression (step S307 or S311). Then deterioration in picture quality owing to the superimposition of additional information data is prevented when encoded picture data is decoded and reproduced.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and a method for processing image data which encodes image data. The present invention relates to a processing apparatus and a processing method for image data that encodes image data superimposed as.

[0002]

2. Description of the Related Art In recent years, it has been established that various types of images are handled as digital data on a recording medium or a transmission medium, so that high-quality digital images can be easily recorded and transmitted while maintaining the high quality. You can now do it. Along with this, it has become easy to illegally copy and handle an image with high quality, and the importance of protecting the copyright of the creator of the image has been highlighted.

[0003] In order to prevent illegal duplication of digital information for commercial purposes, several schemes have conventionally been considered. For example, schemes for encrypting or scrambling image data on a recording medium have been proposed. Have been.

However, in the encryption and scramble processing of image data, it is difficult to refer to the contents of the image data, and once encrypted information is decrypted, information indicating copyright in the original image itself is displayed. Is lost and the copyright of the author cannot be protected by copying the image.

Therefore, in order to prevent unauthorized duplication of the content data of an image or to realize a levy system in which a copyright fee is added to the price of the medium on which the image is recorded for sale, the image itself is rewritten. "Digital watermark (digital watermark)", which superimposes additional information such as the ID information of the author or user or a logo mark as watermark information, and conceals the information.
ark) technology: ”has been proposed.

Here, an example of a case where digital watermark information is superimposed on image data will be described. As shown in FIG. 5, the digital watermark information superimposing circuit 502 applies the digital watermark information to the image data input from the input unit 501. For example, additional information such as charging information, information indicating copyright, or information indicating the user or the copyright of the user is superimposed as digital watermark information.

[0007] Thereafter, the image data is transmitted to the encoding circuit 5.
At 03, the data is subjected to compression encoding processing and sent to various media 504 such as a recording medium and a transmission medium.

When decoding the compressed and encoded image data, the image data is received from the medium 504, and is decoded by the decoding circuit 505. Thereafter, the digital watermark information detection circuit 506 outputs the additional information. Is detected. In this manner, accounting information, copyright of a copyrighted work, or ID information of a user or the like can be obtained from image data of a recording medium, a transmission medium, or the like. As a result, unauthorized copying of the image data is prevented, and the right of the original content is protected.

[0009]

However, in the conventional method, when additional information is superimposed as digital watermark information, the image data becomes large by the amount of the additional information. When compression is performed, the compression ratio of the original image data increases as a result, causing image degradation.

In particular, when additional information is superimposed as digital watermark information on moving image information such as a television image, the additional information is superimposed as noise on the original image information. The compression ratio of the original image itself becomes larger than when the additional information is not superimposed, which causes deterioration in the image quality of the decoded and reproduced original image.

In addition, when the superimposition processing is performed by the above method, it is necessary for the decoding side to hold the profile indicating the form of the digital watermark information to be superimposed on the encoding side. The form of digital watermark information that can be detected is limited.

Accordingly, a main object of the present invention is to provide an image data processing apparatus and image data processing apparatus capable of reducing deterioration of an original image when compression-coding image data on which additional information is superimposed as digital watermark information. It is to provide a method.

[0013]

According to the present invention, image data having original image data and additional information data is divided into a plurality of blocks constituting an image relating to the image data, and the block is divided into blocks. An image data processing apparatus for converting the original image data from the image data; a unit for extracting the additional information data from the image data; Means for generating a plurality of pieces of additional information block data, and dividing the extracted original image data into a plurality of sub-blocks constituting the block. Means for generating a plurality of original image sub-block data, compression means for compressing the original image sub-block data, and compression ratio of the compression means. Setting means for setting, the compressed original image sub-block data is grouped for each of the blocks, and a region of a predetermined size is allocated to each of the compressed original image sub-block data. Means for generating coded data, and arranging the additional information block data corresponding to the original image sub-block data included in the coded data in an empty portion of the area, thereby providing the coded data with Means for superimposing additional information block data, wherein the setting means includes means for compressing the original image sub-block data and a total size of the compressed original image sub-block data in the encoded data. First calculating means for calculating, and calculating a total size of the additional information block data in the encoded data Second calculating means, means for adding the calculated sizes, means for comparing the size of the added size with the total size of the area in the encoded data, and a result of the comparison. And a determining means for determining the compression ratio in accordance with (1).

Further, according to the present invention, image data having original image data and additional information data is divided into a plurality of blocks constituting an image related to the image data, and a plurality of blocks for each block are divided. A method of processing image data for converting into encoded data, the method comprising: extracting the original image data from the image data; extracting the additional information data from the image data; Dividing the data in units of the block,
Generating a plurality of additional information block data, dividing the extracted original image data into a plurality of sub-blocks constituting the block, and generating a plurality of original image sub-block data; A compression step of compressing original image sub-block data, a setting step of setting a compression ratio of the compression step, and grouping of the compressed original image sub-block data for each of the blocks; Generating encoded data for each block in which an area of a predetermined size is allocated to the sub-block data; and generating the additional information block data corresponding to the original image sub-block data included in the encoded data. Superimposing the additional information block data on the coded data by arranging the additional information block data on the empty portion of the area. Wherein the setting step includes a step of compressing the original image sub-block data, and a first calculating step of calculating a total size of the compressed original image sub-block data in the encoded data. When,
A second calculating step of calculating a total size of the additional information block data in the encoded data, a step of adding the calculated respective sizes, and a step of adding the added size; According to the result of the step of comparing the size of the total size and the size of the
And a determining step of determining the compression ratio.

Further, according to the present invention, image data having original image data and additional information data is divided into a plurality of blocks constituting an image related to the image data, and a plurality of blocks for each block are divided. In order to convert the encoded data into encoded data, the computer is configured to extract the original image data from the image data, extract the additional information data from the image data, and extract the extracted additional information data in units of the blocks. Means for generating a plurality of pieces of additional information block data, means for generating the plurality of original image sub-block data by dividing the extracted original image data in units of a plurality of sub-blocks constituting the block Compression means for compressing the original image sub-block data, setting means for setting a compression ratio of the compression means, Means for grouping image sub-block data for each block, generating encoded data for each block, wherein a region of a predetermined size is allocated to each of the compressed original image sub-block data, Means for superimposing the additional information block data on the coded data by arranging the additional information block data corresponding to the original image sub-block data included in the data in a vacant portion of the area,
A recording medium storing a program to function as: the setting unit includes a unit configured to compress the original image sub-block data and a total size of the compressed original image sub-block data in the encoded data. First calculating means for calculating, second calculating means for calculating the total size of the additional information block data in the encoded data, means for adding the calculated respective sizes, A recording medium comprising: means for comparing the total size of the area in the encoded data with the size of the area; and determining means for determining the compression ratio in accordance with the result of the comparison. Provided.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below with reference to the accompanying drawings.

FIG. 1 is a block diagram showing an image data processing apparatus A according to an embodiment of the present invention.

The processing apparatus A employs an image coding method used in a recording method (DV method) of a digital video camera.

In the DV system, a system in which encoded image data is recorded on a magnetic tape medium is employed. For example, as shown in FIG. For each pattern 802, a sub-code 803, encoded image data 804, audio data 805, ITI code 806, and the like are recorded.

The image data 804 is 8 pixels in one screen.
Data encoded for each two-dimensional block of eight pixels (hereinafter, also referred to as a sub-block) is grouped into four two-dimensional blocks (hereinafter, also referred to as a macro block), which are packetized and recorded. Is done.

FIG. 6 is a diagram showing a format of a byte area when image data of a macroblock unit is recorded in a fixed length, and is a diagram showing a data structure of image data constituting one macroblock. .

The image data is composed of a luminance component Y and color difference components CR and CB whose sampling frequency is a quarter of the luminance component. Then, one macroblock includes image data related to the luminance component Y for four sub-blocks (Y _{0 to} Y ₃ ), and image data related to the color difference components CR and CB for each one sub-block. And
Image data for the luminance component Y is allocated 14 bytes per sub-block, and image data for the color difference components CR and CB is allocated 10 bytes for each sub-block. For the data of each sub-block, 12 bits are assigned to the DC component area 601 indicating the average value, and the remaining area is assigned to the AC component area 602.

The data of each sub-block is subjected to orthogonal transformation processing, quantization and variable length coding, and further to one-dimensional processing, and recorded as a data string.

The processing apparatus A is characterized in that, in the AC component area 602, additional information data as digital watermark information is recorded instead of recording dummy data in a portion where image data is recorded. Hereinafter, the configuration and operation of the processing apparatus A will be described.

The image input unit 101 stores additional information data as digital watermark information and the remaining image data (hereinafter, referred to as additional information data).
It is called original image data. ) Is input.

The digital watermark information detecting section 102 extracts additional information data and original image data from the input image data. The additional information data is usually superimposed on the high frequency component of the image data so as to be visually inconspicuous.

In the additional information data blocking unit 103, the additional information data is divided into macroblocks as a unit.
Divided into multiple data. In the DV system, usually, moving image information is divided into 1350 macroblocks in units of one frame and encoded, so that additional information included in one frame is also divided into 1350 blocks. Hereinafter, each divided data is referred to as additional information block data.

The data amount calculation unit 104 of the additional information data sets the size (code amount) of each additional information block data.
Is calculated.

On the other hand, the original image data is divided by the original image data blocking unit 105 into a plurality of data in units of a two-dimensional block of 8 × 8 pixels, ie, a sub-block. Hereinafter, each divided data is referred to as original image sub-block data.

The divided blocks are divided into four blocks related to the luminance component.
The two two-dimensional blocks and the two two-dimensional blocks related to the color difference components form one macroblock, and 1350 macroblocks in one frame.

The orthogonal transform unit 106 performs orthogonal transform on each original image sub-block data, and temporarily stores the data in the buffer memory 113.

The original image sub-block data converted into orthogonal transform coefficients by the orthogonal transform unit 106 is
Is quantized by a certain quantization coefficient provided from the quantization parameter setting unit 110. The quantized original image sub-block data is subjected to variable-length encoding in the encoding circuit 108.

In the encoded original image sub-block data, the encoded data amount calculator 109 calculates the total number of encoded data in macroblock units. That is, the total number of the code amounts of the four sub-blocks related to the luminance component and the code amounts of the two sub-blocks related to the color difference component included in each macroblock is calculated.

Next, in the quantization parameter setting unit 110, the total number of codes of the original image sub-block data and the total number of codes of the additional information block data in macroblock units are added, and this is added to one macroblock. Area (size) given to the data of
Determine if byte is over.

When the total code amount exceeds 84 bytes, the quantization parameter setting unit 110 gives a coarser quantization coefficient to the quantization unit 107 so as to reduce the code amount.
Repeat the above procedure.

If the total code amount does not exceed 84 bytes, the quantization parameter setting section 110 gives the quantization coefficient at that time to the quantization section 114.

In the above-described example, the quantization coefficient is set commonly to the original image sub-block data included in one macroblock, but may be set for each original image sub-block.

In this case, the code amount is obtained for each original image sub-block data, and the original image sub-block data having a larger code amount or the original image sub-block data having a color difference component than a luminance component is obtained. By determining the quantization coefficient so as to be quantized more coarsely, it is also possible to prevent the deterioration of the image at the time of decoding from visually disappearing.

Next, the quantization unit 114 quantizes the original image sub-block data read from the buffer memory 113 with the quantization coefficient given by the quantization parameter setting unit 110, and The sub-block data is variable-length coded by the coding unit 115.

With respect to the original image sub-block data thus encoded, the digital watermark superimposing section 116
Following the EOB code 703 indicating the end of the block in the data area for each sub-block shown in FIG. 7, additional information data is sequentially superimposed on the empty area 704.

As described above, additional information data is superimposed as digital watermark information in macroblock units.
In addition, encoded data including a plurality of encoded original image sub-block data is packetized by adding necessary data in a packetizing unit 117, and the encoded data output unit 118 outputs the encoded data to a recording medium or a transmission medium. Will be output.

Next, FIG. 2 shows an example of an apparatus for decoding and reproducing image data encoded by the processing apparatus A.

The encoded data input from the encoded data input unit 201 is reproduced in the packet decoding unit 202, and this data is sequentially sent to the digital watermark detection unit 208.

A 14-byte counter 204 for counting 14 bytes in synchronization with the encoded data sent to the digital watermark information detecting section 208 from the information of the packet header for each of the four sub-blocks reproduced by the packet decoding section 202. To work.

On the other hand, the EOB code detector 203 detects an EOB code from the encoded data, and sends the signal to the digital watermark information detector 208.

Since the additional information data is superimposed until the 14-byte counter 204 indicates the end of the data area for one sub-block after the EOB code is detected, the digital watermark information detection unit 208 The additional information data is detected.

As described above, the additional information data is detected for each sub-block, and this operation is repeated. For the four sub-blocks of the luminance signal Y, the 14-byte counter is generated by using the quaternary counter 205. The counting operation is repeated four times. For the two sub-blocks of the color difference signals CR and CB, a signal indicating the end of the counting operation for the four sub-blocks of the luminance signal Y is received from the quaternary counter 205, and 10 bytes The operation of the counter 206 is started, and the counting of all coded image data for four blocks is completed by the binary counter 207.

The additional information data detected in this way is sent to the electronic watermark superimposing section 211, and the original image data is decoded by the decoding section 210.
In 11, the additional information data is superimposed on the high frequency component so as to be inconspicuous, and is output from the image information output unit 212 as a reproduced image.

As described above, the additional information data as the digital watermark information is superimposed on the free area of the area where the coded original image sub-block data is stored. Is calculated, and the amount of coding of the original image sub-block data is adjusted by adjusting the quantization coefficient so as to secure an empty area where the image data can be arranged. Image quality degradation due to superimposition of information data can be prevented as much as possible, and additional information data can be efficiently superimposed on encoded data. In addition, by superimposing the additional information data on the empty area where the dummy data in the packetized encoded data is stored, the decoder that receives the data has a method of superimposing the additional information data on the encoding side. Can be decrypted without being caught.

Next, an explanation will be given of an application program for realizing the processing in the processing device A by an operation on a computer. 3 and 4 show a flowchart of this program.

In FIG. 3, step S301 is an input process of image data on which additional information data is superimposed as digital watermark information.

In step S302, additional information data superimposed on the high-frequency component of the input image data so as to be inconspicuous is extracted, and the remainder is used as original image data.

In step S303, the detected additional information data is divided into macroblock units to generate a plurality of additional information block data.

As described above, in the DV system, moving picture data is divided into 1350 fixed-length macroblocks in units of one frame and encoded, so that additional information data included in one frame is divided into 1350 pieces. I do.

In step S304, the size (code amount) of each additional information block data is calculated.

In step S305, the original image data is divided into two-dimensional blocks (sub-blocks) of 8 pixels × 8 pixels to generate a plurality of original image sub-block data.
The four sub-blocks constitute one macro block.

In step S306, orthogonal transformation is performed for each original image sub-block data.

In step S307, a provisional quantization step is set when quantizing the original image sub-block data converted into the orthogonal transform coefficients.

In step S308, the original image sub-block data converted into the orthogonal transform coefficients is stored in step S30.
Quantization is performed according to the quantization step set in step 7.

In step S309, the quantized original image sub-block data is subjected to variable length coding.

In step S310, the code amount of the variable-length coded original image sub-block data is calculated for each macroblock. At this time, 2 subblocks CR according to 4 sub-blocks ₀ through Y ₃ minutes and the color difference signal of the luminance signal, is calculated by adding the code amount of the CB component.

In step S311, the sum of the calculated code amounts of the original image sub-block data is calculated, and step S304 is performed.
Is added to the code amount of the additional information block data calculated in (1), and it is determined whether or not this value (S) exceeds 84 bytes which is an area given in a macroblock unit.

If the total code amount S exceeds the specified 84 bytes, the process returns to step S307, and a coarser quantization step is performed so that a quantization operation with a smaller code amount is performed. Reset. Thereafter, the above-described procedure is repeated to check for a quantization step that results in a total code amount S not exceeding 84 bytes.

Here, if S ≦ 84 bytes finally, the process proceeds to step S312, and as shown in FIG. 12, an EOB code indicating the end of the arrangement area of the encoded original image sub-block data is set. Subsequently, the additional information data is sequentially superimposed to generate encoded data.

In step S313, the generated coded data is packetized by adding various types of data. In step S314, the coded data is output as coded image data to a recording medium or a transmission medium.

Next, FIG. 4 shows an example of a flowchart of a program for performing decoding / reproduction arithmetic processing of image data encoded in the procedure shown in the flowchart of FIG.

Step S401 is an encoded data input process for inputting a packet including encoded data from a recording medium or a transmission medium.

In step S402, the input packet is decoded and reproduced.

In step S403, step S402
The EOB code in each of the four sub-blocks Y _{0 to} Y ₃ relating to the luminance signal and each one of the sub-blocks CR and CB of the color difference signal is detected from the information of the packet header for each of the four sub-blocks reproduced by the above.

Then, as shown in FIG.
14 bytes for ₀ to _{Y 3,} chrominance signal block C
Since R and CB are 10-byte data areas, in step S404, data within the range after the EOB code (area 704 in FIG. 7) is detected as additional information data.

In step S405, each encoded original image sub-block data is decoded and reproduced.

In step S406, a process of superimposing the detected additional information data on the decoded original image sub-block data at a place where the high frequency component is not visually noticeable is performed.

In step S407, the image data thus decoded and reproduced is output.

While the preferred embodiment of the present invention has been described above, an object of the present invention is to provide a storage medium (or a recording medium) on which a program code of software for realizing the functions of the above-described embodiment is stored in a system. Alternatively, it is needless to say that this can be achieved by supplying the program code to the device and causing the computer (or CPU or MPU) of the system or device to read and execute the program code stored in the storage medium. In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention. By executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an operating system (OS) running on the computer based on the instruction of the program code. It goes without saying that a case where some or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing is also included.

Further, after the program code read from the storage medium is written into the memory provided in the function expansion card inserted into the computer or the function expansion unit connected to the computer, the program code is read based on the instruction of the program code. Needless to say, the CPU included in the function expansion card or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

When the present invention is applied to the storage medium, the storage medium stores program codes corresponding to the above-described flowcharts (shown in FIG. 3 and / or FIG. 4).

[0077]

As described above, according to the present invention, it is possible to reduce the deterioration of an original image when compression-coding image data in which additional information is superimposed as digital watermark information.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an image data processing apparatus A according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating an example of an apparatus that decodes and reproduces image data encoded by a processing apparatus A.

FIG. 3 is a flowchart showing a procedure for executing a process performed by a processing device A on a computer.

FIG. 4 is a flowchart showing a procedure for executing processing performed by the apparatus of FIG. 2 on a computer.

FIG. 5 is a diagram showing a conventional image data encoding and decoding apparatus.

FIG. 6 is a diagram illustrating a packet of encoded data used in a digital video camera.

FIG. 7 is a diagram showing an area for recording data for one sub-block in the packet of the encoded data of FIG. 6;

FIG. 8 is a diagram illustrating a recording track pattern on a tape medium of a digital video camera.

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 1/41 G06F 15/66 B 5C078 7/08 H04N 7/08 Z 5K041 7/081 7/13 Z 9A001 7/24 F-term (reference) 5B057 CA12 CA16 CB12 CB16 CE09 CG02 CG09 CH11 DA08 DA12 5C053 FA13 FA22 GB01 GB06 GB07 GB11 GB22 GB26 GB28 GB33 GB40 JA30 KA01 KA20 KA22 LA14 5C059 KK02 KK43 MA21 MC11 MC24 MC01 MC34 MC13 MC16 MC34 RC01 RC32.

Claims (39)

[Claims] An image data having original image data and additional information data is divided into a plurality of blocks constituting an image related to the image data, and converted into a plurality of encoded data for each block. Means for extracting the original image data from the image data, means for extracting the additional information data from the image data, and using the extracted additional information data as a unit of the block. Means for generating a plurality of pieces of additional information block data, and generating the plurality of original image sub-block data by dividing the extracted original image data in units of a plurality of sub-blocks constituting the block. Means for performing compression; compression means for compressing the original image sub-block data; setting means for setting a compression ratio of the compression means; Means for grouping the original image sub-block data into blocks and generating encoded data for each block, wherein a region of a predetermined size is allocated to each of the compressed original image sub-block data. Means for superimposing the additional information block data on the encoded data by arranging the additional information block data corresponding to the original image sub-block data included in the encoded data in a vacant portion of the area. The setting means comprises: means for compressing the original image sub-block data; and first calculating means for calculating the total size of the compressed original image sub-block data in the encoded data. A second calculating means for calculating a total size of the additional information block data in the encoded data; Means for adding each of the sizes obtained, and means for comparing the size of the added size with the total size of the area in the coded data. And a determining means for determining the image data. 2. The image data as claimed in claim 1, wherein, as a result of the comparison, when the added size is larger than the total size of the area, the determination unit increases the compression ratio. Processing equipment. 3. The apparatus according to claim 1, further comprising means for packetizing the image data, wherein one packet includes one of the encoded data. 4. The apparatus according to claim 3, further comprising means for recording the packet on a recording medium. 5. The image data processing apparatus according to claim 3, further comprising means for transmitting the packet to a communication line. 6. The apparatus according to claim 1, wherein the original image data includes luminance component data and chrominance component data. 7. The coded data includes four original image sub-block data relating to the luminance component data and two original image sub-block data relating to the corresponding color difference component data. The image data processing apparatus according to claim 6, wherein 8. The apparatus according to claim 1, wherein said compression means quantizes at least said original image sub-block data, and said setting means sets a quantization parameter of said compression means. An apparatus for processing image data according to any one of the above. 9. The image data processing apparatus according to claim 8, wherein the compression unit further performs variable length coding on the quantized original image sub-block data. 10. The apparatus according to claim 1, further comprising means for orthogonally transforming the original image sub-block data.
An apparatus for processing image data according to any one of the above. 11. The setting means, for the original image sub-block data included in the same encoded data,
11. The same compression ratio is given.
An apparatus for processing image data according to any one of the above. 12. The setting means, for the original image sub-block data included in the same encoded data,
2. A compression ratio is individually given.
0. The image data processing device according to any one of 0. 13. An image data having original image data and additional information data is divided into a plurality of blocks constituting an image related to the image data, and is converted into a plurality of encoded data for each block. Extracting the original image data from the image data, extracting the additional information data from the image data, and using the extracted additional information data as a unit of the block. Generating a plurality of pieces of additional information block data; and generating a plurality of original image sub-block data by dividing the extracted original image data into a plurality of sub-blocks constituting the block. A compression step of compressing the original image sub-block data; a setting step of setting a compression ratio of the compression step; Grouping the compressed original image sub-block data into blocks, and generating encoded data for each block in which a region of a predetermined size is allocated to each of the compressed original image sub-block data. And arranging the additional information block data corresponding to the original image sub-block data included in the encoded data in a vacant portion of the area, thereby superimposing the additional information block data on the encoded data. And a first calculating step of calculating a total size of the compressed original image sub-block data in the coded data. A second calculation step of calculating a total size of the additional information block data in the encoded data; Adding the calculated sizes, and comparing the size of the added size with the total size of the areas in the encoded data. And a determining step of determining the image data. 14. The image data compression method according to claim 13, wherein if the result of the comparison indicates that the added size is larger than the total size of the area, the determining step increases the compression ratio. Processing method. 15. The image data processing method according to claim 13, further comprising a step of packetizing the image data, wherein one packet includes one of the encoded data. 16. The method according to claim 15, further comprising a step of recording the packet on a recording medium. 17. The method according to claim 15, further comprising transmitting the packet to a communication line. 18. The image processing apparatus according to claim 31, wherein the original image data includes luminance component data and color difference component data.
18. The method for processing image data according to any one of claims 17 to 17. 19. The coded data includes four pieces of the original image sub-block data related to the luminance component data and two pieces of the original image sub-block data related to the corresponding color difference component data. Claim 18
2. A method for processing image data according to item 1. 20. The method according to claim 13, wherein in the compression step, at least the original image sub-block data is quantized, and in the setting step, a quantization parameter of the compression step is set. Processing method of the described image data. 21. The image data processing method according to claim 20, wherein in the compression step, the quantized original image sub-block data is further subjected to variable length coding. 22. The method according to claim 13, further comprising the step of orthogonally transforming the original image sub-block data.
A method for processing image data according to any one of the preceding claims. 23. The image according to claim 13, wherein in the setting step, the same compression ratio is given to the original image sub-block data included in the same encoded data. How to process the data. 24. The method according to claim 13, wherein in the setting step, a compression ratio is individually given to the original image sub-block data included in the same encoded data.
23. A method for processing image data according to any one of claims to 22. 25. Image data having original image data and additional information data is divided into a plurality of blocks constituting an image related to the image data, and converted into a plurality of encoded data for each block. Means for extracting the original image data from the image data, means for extracting the additional information data from the image data, dividing the extracted additional information data in units of the blocks, and Means for generating additional information block data; means for dividing the extracted original image data in units of a plurality of sub-blocks constituting the block to generate a plurality of original image sub-block data; Compression means for compressing data, setting means for setting a compression ratio of the compression means, the compressed original image sub-block Means for generating encoded data for each block, in which a predetermined size area is allocated to each of the compressed original image sub-block data, wherein the encoded data is included in the encoded data. A program for functioning as a means for superimposing the additional information block data on the encoded data by arranging the additional information block data corresponding to the original image sub-block data to be vacant in the area. Recording medium, wherein: the setting unit: a unit that compresses the original image sub-block data; and a first calculation that calculates a total size of the compressed original image sub-block data in the encoded data. Means for calculating a total size of the additional information block data in the encoded data 2, calculating means for adding the calculated sizes, means for comparing the size of the added size with the total size of the area in the encoded data, and according to the result of the comparison. And a determining means for determining the compression ratio. 26. The apparatus according to claim 2, wherein as a result of the comparison, when the added size is larger than the total size of the area, the determination unit increases the compression ratio.
6. The recording medium according to 5. 27. The program according to claim 27, wherein
27. A program including a program for functioning as a means for packetizing the image data, wherein one packet includes one of the encoded data.
A recording medium according to claim 1. 28. The program, wherein the program causes a computer to:
The recording medium according to claim 27, further comprising a program that functions as a unit that records the packet on the recording medium. 29. The program, wherein the computer
28. A program comprising a program for functioning as a means for sending said packet to a communication line.
9. The recording medium according to 8. 30. The original image data includes luminance component data and color difference component data.
30. The recording medium according to any one of claims to 29. 31. The coded data includes four original image sub-block data relating to the luminance component data and two original image sub-block data relating to the corresponding color difference component data. Claim 30
A recording medium according to claim 1. 32. The compression means for quantizing at least the original image sub-block data, and the setting means sets a quantization parameter of the compression means. The recording medium according to any one of the above. 33. The recording medium according to claim 32, wherein the compression unit further performs variable length coding on the quantized original image sub-block data. 34. The computer-readable storage medium,
34. The recording medium according to claim 25, further comprising a program for causing the original image sub-block data to function as a means for orthogonally transforming the original image sub-block data. 35. The setting means, for the original image sub-block data included in the same encoded data,
4. The method according to claim 1, wherein the same compression ratio is provided.
4. The recording medium according to any one of 4. 36. The setting means, for the original image sub-block data included in the same encoded data,
The recording medium according to any one of claims 25 to 34, wherein a compression ratio is individually given. 37. An image data processing device for reproducing the encoded data generated by the image data processing device according to claim 1, wherein the image data is compressed from the encoded data. Means for extracting original image sub-block data; means for extracting the additional information data from the encoded data; means for reproducing the extracted compressed original image sub-block data; Means for superimposing the extracted additional information data on the data. 38. A method of processing image data for reproducing the encoded data generated by the method of processing image data according to claim 13, wherein the compressed image data is compressed from the encoded data. Extracting the original image sub-block data; extracting the additional information data from the encoded data; reproducing the extracted compressed original image sub-block data; Superimposing the extracted additional information data on the data. 39. A computer for reproducing the encoded data generated by the apparatus for processing image data according to claim 1, wherein the computer is configured to control the original image sub-compressed from the encoded data. Means for extracting block data; means for extracting the additional information data from the encoded data; means for reproducing the extracted compressed original image sub-block data; A recording medium on which a program for functioning as means for superimposing additional information data is recorded.