JP4747074B2 - Image data transmission system and image data transmission method - Google Patents

Description

  The present invention relates to an image data transmission system and the like for compressing and transmitting an image, and more particularly to an image data transmission system and the like for compressing and transmitting a region-divided image.

  With the recent development of digital technology, image compression processing apparatuses using JPEG compression and JPEG2000 compression methods have been put into practical use. Among them, JPEG2000 compression is an enhancement standard for JPEG compression, and can perform high-quality image compression even at a high compression rate, and has a feature that block noise that is a problem in JPEG compression does not occur.

  As described above, JPEG2000 compression is an excellent compression method, but some problems to be solved remain, and one of them is a problem of tiling noise. In JPEG2000 compression, it is possible to perform a tiling process in which an image is divided into rectangular areas (tiles) and each area is independently encoded. When this tiling process is performed to compress an image, the compressed image is compressed. When the image is expanded and combined, the image is distorted at the boundary between the divided areas.

Therefore, for example, in Patent Documents 1 and 2, image data of the boundary portion of the divided region is created separately from the image data of the divided region, and the image data of the boundary portion is inserted into the digital blanking period of the HDTV signal. Thus, there is disclosed an image transmission display system that replaces image data of a portion where noise occurs with image data of a boundary portion when the image is expanded and combined on the image data receiving side. These are not intended for JPEG2000 compression, but can prevent distortion at the boundary of divided areas.
JP 2006-18005 A JP 2006-33673 A

  According to the configurations disclosed in Patent Documents 1 and 2, noise generated at the boundary of the divided areas can be eliminated. However, both Patent Documents 1 and 2 are specialized for HDTV transmission and have real-time characteristics. It is intended for the required transmission method. That is, in HDTV transmission, compression processing is performed in correspondence with the passage of time, and therefore the order of images must be observed in order to obtain an appropriate image after decompression processing. For this reason, there is a problem that the order of image data transmission processing and reception processing is restricted.

  Therefore, the present invention has been made in view of the above-described points, and even when an image is divided during compression processing, a high-quality decompressed image without distortion at the boundary portion of the divided image can be obtained. An object of the present invention is to provide an image data transmission system and an image data transmission method capable of transmitting image data without being restricted by the order of data transmission processing and reception processing.

In order to achieve the above object, the present invention provides an image data transmission system that divides image data into predetermined units, compresses each divided region independently to generate compressed data, and Compression means for compressing the boundary portion to generate boundary compressed data, packet generation means for generating packet data including the compressed data and the boundary compressed data, transmission means for transmitting the packet data, and transmitted packets A receiving means for receiving data, and after decompressing the compressed data included in the packet data, combine them to generate decompressed data, and decompress boundary compressed data included in the packet data to generate boundary decompressed data and expansion means for, on the basis of the boundary compressed data, and a correcting means for correcting the decompressed data, the compression means A region having a predetermined size including a boundary portion of the divided region is extracted from the image data to generate boundary region data, and the boundary region data is compressed to generate boundary region compressed data. The boundary region compressed data The boundary compressed data is generated by extracting a portion corresponding to the boundary portion of the divided region from

  According to the present invention, boundary compressed data obtained by compressing the boundary portion of each divided area is generated separately from the compressed data, and the compressed data is decompressed using the boundary decompressed data obtained by decompressing the boundary compressed data. Since the combined decompressed data is corrected and the distortion of the image generated at the boundary portion is corrected, it is possible to obtain a high-quality expanded image without distortion. In addition, according to the present invention, the compressed data and the boundary compressed data are transmitted as packet data, so that the image data can be transmitted without being restricted by the order of the image data transmission processing and reception processing. It becomes possible.

Further, according to the present invention, generates a boundary area data by extracting a region of a predetermined size including the boundary portion of the divided regions from the images data, the boundary region compressed data by compressing the boundary area data generation and to produce a boundary compressed data by extracting a portion corresponding to the boundary portion of the border region compressed data or al divider region, without compromising the accuracy of the compression process, reducing the capacity of the boundary compressed data Is possible.

  In the image data transmission system, the compression unit can be configured to switch whether or not the boundary compressed data is generated. According to the above configuration, by arbitrarily switching whether or not the compression processing is executed, it is possible to cope with both cases where it is desired to prioritize the memory capacity and the compression processing speed, thereby improving versatility. It becomes possible.

  In the image data transmission system, the correction unit can be configured to switch whether or not to perform the correction processing of the decompressed data. According to the above configuration, it is possible to switch the presence / absence of correction processing according to the user's request.

  In the image data transmission system, the compression unit may execute a compression process according to a JPEG2000 compression method and tile the image data into predetermined units.

The present invention also relates to an image data transmission method, in which image data is divided into predetermined units, each divided region is independently compressed to generate compressed data, and a boundary portion of the divided region is compressed. Generating boundary compressed data, generating packet data including the compressed data and the boundary compressed data, transmitting the packet data, receiving the transmitted packet data, and the packet After decompressing the compressed data included in the data, combine them to generate decompressed data, decompress the boundary compressed data included in the packet data to generate boundary decompressed data, and based on the boundary compressed data Te, step of chromatic and correcting the decompressed data, to generate the boundary compressed data, the A region having a predetermined size including a boundary portion of the split region is extracted from the image data to generate boundary region data, and the boundary region data is compressed to generate boundary region compressed data, from the boundary region compressed data The boundary compressed data is generated by extracting a portion corresponding to a boundary portion of the divided area . According to the present invention, similar to the above-described invention, even when an image is divided during compression processing, it is possible to obtain a high-quality expanded image without distortion at the boundary portion of the divided image, and transmission of image data. Image data can be transmitted without being restricted by the order of processing and reception processing.

  As described above, according to the present invention, even if an image is divided during compression processing, a high-quality expanded image without distortion can be obtained at the boundary portion of the divided image, and image data transmission processing and reception can be performed. It is possible to provide an image data transmission system and an image data transmission method capable of transmitting image data without being restricted by the processing order.

  Next, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 shows an embodiment of an image data transmission system according to the present invention. This image data transmission system 1 includes an image transmission device 2 and an image reception device connected to the image transmission device 2 via a transmission path 4. The apparatus 3 is configured to transmit image data from the image transmission apparatus 2 to the image reception apparatus 3.

  As shown in the figure, the image transmission device 2 includes an imaging unit 5 that generates image data, a compression unit 6 that compresses the image data to generate compressed data, and a transmission unit that transmits the compressed data to the transmission path 4. 7.

  The compression means 6 compresses image data in accordance with the JPEG2000 compression method. The compression means 6 divides the image data into a plurality of rectangular areas (tiles) to generate divided data, and the division output from the division means 8. First and second compression means 9 and 10 for compressing data, and packet generation means 11 for generating packet data of a predetermined format based on the compressed data output from the first and second compression means 9 and 10 Is done.

  As shown in FIG. 2, the first compression means 9 generates compressed data 32 by encoding the divided data 31 obtained by dividing the image data 30 into tiles. The encoding process in the first compression unit 9 is performed independently for each divided area. For example, when the image data 30 is divided into four tiles, four compressed data are generated.

  As shown in FIG. 2, the second compression means 10 generates boundary tile data 31a to 31d obtained by tile-dividing the image data 30 so as to extract a rectangular area centered on the boundary portion, and compresses them separately. The boundary tile compressed data 32a to 32d are generated, and the data corresponding to the boundary portion is extracted from the boundary tile compressed data 32a to 32d to generate the boundary compressed data 33a to 33d. The boundary tile data 31a to 31d, the boundary tile compressed data 32a to 32d, and the boundary compressed data 33a to 33d are, for example, when the image data 30 is divided into four tiles by the first compression means 9, as shown in FIG. In correspondence with the number of boundaries of the divided areas, four are generated.

  Further, the second compression unit 10 is configured to be able to switch whether or not the compression process is executed, and when the setting is made not to perform the compression process by the second compression unit 10, the boundary tile data 31a to 31d, the boundary None of the tile compressed data 32a to 32d and the boundary compressed data 33a to 33d is generated.

  The packet generation unit 11 generates the packet data 40 by dividing the compressed data 32 generated by the first compression unit 9 and the boundary compression data 33a to 33d generated by the second compression unit 10 into a predetermined capacity, respectively. . As shown in FIG. 3, the packet data 40 includes a packet number, header information 41 indicating the presence / absence of compression processing by the second compression means 10, JPEG2000 header information 42 corresponding to header information of the JPEG2000 compression method, It consists of compressed data information 43 corresponding to the compressed data 32 and boundary compressed data information 44 corresponding to the boundary compressed data 33a to 33d.

  As shown in FIG. 1, the image receiving device 3 includes a receiving unit 12 that receives packet data 40 transmitted from the image transmitting device 2, a decompressing unit 13 that decompresses compressed data to generate image data, and a decompressing unit. And display means 14 for displaying the image data generated in 13.

  The decompression means 13 decompresses the compressed data in accordance with the JPEG2000 compression method, the correction setting means 15 for setting the presence / absence of correction processing described later, and the first and second decompressions for decompressing the compressed data to generate image data. Means 16 and 17 and correction means 18 for correcting the image data.

  The correction setting means 15 extracts the compressed data information 43 and the boundary compressed data information 44 from the packet data 40 transmitted from the image transmission device 2 when the user has set the correction of the image data, and adds them to them. Based on this, compressed data 32 and boundary compressed data 33a to 33d are generated. On the other hand, when it is set not to correct, only the compressed data information 43 is extracted from the packet data 40 to generate the compressed data 32.

  As shown in FIG. 4, the first decompressing means 16 decompresses the compressed data 32 to generate decompressed data 50 a to 50 d and combines the decompressed data 50 a to 50 d to generate image data 50. As shown in FIG. 4, the second decompressing means 17 decompresses the boundary compressed data 33a to 33d to generate boundary decompressed data 51a to 51d. The correction unit 18 corrects the tiling noise of the image data 50 generated by the first expansion unit 16 based on the boundary expansion data 51 a to 51 d generated by the second expansion unit 17.

  Next, the operation of the image data transmission system 1 in FIG. 1 will be described with reference to FIG.

  When the image data 30 is generated by the imaging unit 5 (step S1), the image data 30 is tile-divided by the dividing unit 8 (step S2), and the setting for generating compressed data of the boundary portion of the divided region It is determined whether or not (step S3).

  If the setting is such that compressed data for the boundary portion should be generated (step S3: Yes), the divided data 31 that has been tile-divided by the dividing unit 8 is output to the first compressing unit 9, and the first compressing unit 9 In step S4, compression processing is executed to generate compressed data 32. In parallel with this, the second compression means 10 extracts a rectangular area centered on the boundary portion from the image data 30 to generate boundary tile data 31a to 31d, and through compression processing and extraction processing. The boundary compressed data 33a to 33d are generated (step S5). Note that the compression processing by the first compression unit 9 and the compression processing by the second compression unit 10 do not necessarily have to be performed in parallel, and after either one is performed, the other may be performed.

  On the other hand, when the setting is such that the compressed data of the boundary portion is not generated (step S3: No), the compression process by the second compression unit 10 is not executed, and only the compression process by the first compression unit 9 is performed. As a result, only the compressed data 32 is generated (step S6).

  Next, the packet generation unit 11 generates the packet data 40 shown in FIG. 3 using the compressed data 32 and the boundary compressed data 33a to 33d (step S7). When the boundary compressed data 33a to 33d are generated, information indicating that the boundary compressed data information 44 is included in the packet data 40 is recorded in the header information 41 of FIG. If 33d is not generated, information indicating that the boundary compressed data information 44 is not included in the packet data 40 is recorded.

  Next, the packet data 40 is transmitted in a predetermined communication format and received by the receiving means 12 of the image receiving device 3 (step S8). Since the image transmission apparatus 2 converts the compressed data 32 and the like into packet data and transmits it as a data stream of one file, the transmission order is not restricted, and the image reception apparatus 3 that receives the compressed data also transmits it. The data can be received without being restricted by the reception order of the received packet data 40.

  When the packet data 40 is received, it is determined by the correction setting means 15 whether or not it is set that the image data should be corrected (step S9). Even if it is set that the image data should be corrected, if the boundary compressed data information 44 is not included in the packet data 40, it is determined that the image data is not to be corrected.

  When it is set that the image data should be corrected (step S9: Yes), the first decompression unit 16 decompresses the compressed data 32 to generate the decompressed data 50a to 50d in FIG. The decompressed data 50a to 50d are combined to generate image data 50 (step S10). In parallel with this, the boundary decompression data 33a to 33d are decompressed by the second decompression means 17, and the boundary decompression data 51a to 51d of FIG. 4 are generated (step S11). The decompression process by the first decompression means 16 and the decompression process by the second decompression means 17 are the same as the compression processes by the first and second compression means 9 and 10, after one of them is performed, May be performed.

  Next, the correction unit 18 corrects the image data 50 based on the boundary expansion data 51a to 51d (step S12).

  6 and 7 are schematic diagrams illustrating an example of correction processing by the correction unit 18. Here, a case where tiling noise generated in the boundary portion 60 between the decompressed data 50a and the decompressed data 50b among the decompressed data 50a to 50d is illustrated.

  In the correction processing of the boundary portion 60, the boundary expansion data 51a corresponding to the boundary portion 60 among the boundary expansion data 51a to 51d is used as reference data. Then, the color data levels of the boundary portion 60 and the boundary extension data 51 a are compared, and it is determined whether or not tiling noise is generated in the boundary portion 60.

  As shown in FIGS. 6A and 6B, when the color data level of the boundary portion 60 is the same as the color data level of the boundary expansion data 51a, no tiling noise is generated. It is determined. In this case, the decompressed data 50a and the decompressed data 50b are not corrected and are output to the display means 14 as they are.

  On the other hand, for example, as shown in FIGS. 7A and 7B, when the color data levels of the boundary portion 60 and the boundary expansion data 51a are different, it is determined that tiling noise is generated. The In the example shown in FIGS. 7A and 7B, as a result of the tiling process, the level of the color data of the decompressed data 50a is high, and the level of the color data of the decompressed data 50b is low. As shown in c), the color data level of the decompression data 50a is lowered, the color data level of the decompression data 50b is raised, and the color data levels of the boundary portion 60 and the boundary decompression data 51a are set to the same level. In this way, as shown in FIG. 7D, the decompressed data 50a and the decompressed data 50b are corrected, and corrected data is generated.

  When the correction process is completed, as shown in FIG. 5, an image is displayed on the display unit 14 based on the correction data (step S14), and the image displayed on the display unit 14 is confirmed by the user. As a result, when it is necessary to execute the correction process again (step S15: Yes), the fact that correction is to be performed is set (step S16), and the correction process is executed again. On the other hand, when it is not necessary to execute the correction process, the correction data is recorded in the image reception apparatus 3 as data obtained by expanding the transmission data from the image transmission apparatus 2, and this process ends.

  On the other hand, when it is set not to correct the image data (step S9: No), the decompression process by the second decompression unit 17 is not performed, and only the decompression process by the first decompression unit 16 is performed. 4, the decompressed data 50a to 50d are generated, and the decompressed data 50a to 50d are combined to generate the image data 50 (step S13).

  Thereafter, as in the case where it is set that the image data should be corrected, an image is displayed on the display unit 14 based on the image data 50, and correction processing is executed as necessary ( Steps S15 and 16).

  As described above, according to the present embodiment, separately from the compressed data 32, boundary compressed data 33a to 33d obtained by compressing the boundary portion of each divided region is generated, and the boundary compressed data 33a to 33d is Using the expanded boundary expanded data 51a to 51d, the compressed data 32 is expanded and synthesized, the image data 50 is corrected, and tiling noise generated at the boundary is corrected, so that a high-quality expanded image without distortion is obtained. Is possible. In addition, according to the present embodiment, since the compressed data 32 and the boundary compressed data 33a to 33d are transmitted as packet data, the image data is not restricted by the order of image data transmission processing and reception processing. Data can be transmitted.

  Further, according to the present embodiment, after boundary tile data 31a to 31d are compressed and boundary tile compressed data 32a to 32d are generated, data corresponding to the boundary portion is extracted therefrom, and boundary compressed data is extracted. Since 33a to 33d are generated, the capacity of the boundary compressed data 33a to 33d can be reduced without impairing the accuracy of the compression process.

  Furthermore, according to the present embodiment, whether or not the compression processing of the second compression unit 10 is executed can be switched. Therefore, when the memory capacity is to be prioritized or compressed by arbitrarily switching whether or not the compression processing is executed. It is possible to deal with any case where priority is given to the processing speed, and the versatility can be improved.

1 is a block diagram showing an embodiment of an image data transmission system according to the present invention. It is a schematic diagram which shows compression data and boundary compression data. It is a schematic diagram which shows packet data. It is a schematic diagram which shows expansion data and boundary expansion data. 3 is a flowchart for explaining the operation of the image data transmission system of FIG. 1. It is a schematic diagram which shows an example of the correction process of the correction | amendment means of FIG. It is a schematic diagram which shows an example of the correction process of the correction | amendment means of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image data transmission system 2 Image transmission apparatus 3 Image reception apparatus 4 Transmission path 5 Imaging means 6 Compression means 7 Transmission means 8 Division means 9 First compression means 10 Second compression means 11 Packet generation means 12 Reception means 13 Expansion means 14 Display Means 15 Correction setting means 16 First decompression means 17 Second decompression means 18 Correction means 30 Image data 31 Division data 31a to 31d Boundary tile data 32 Compression data 32a to 32d Boundary tile compression data 33a to 33d Boundary compression data 40 Packet data 41 Header information 42 JPEG2000 header information 43 Compressed data information 44 Boundary compressed data information 50 Image data 50a to 50d Expanded data 51a to 51d Boundary expanded data 60 Boundary portion

Claims (6)

A compression unit that divides the image data into predetermined units, compresses each divided region independently to generate compressed data, and compresses a boundary portion of the divided region to generate boundary compressed data;
Packet generating means for generating packet data including the compressed data and the boundary compressed data;
Transmission means for transmitting the packet data;
Receiving means for receiving transmitted packet data;
After decompressing the compressed data included in the packet data, combine them to generate decompressed data, and decompressing means for decompressing the boundary compressed data included in the packet data to generate boundary decompressed data;
Correction means for correcting the decompressed data based on the boundary compressed data ,
The compression means extracts a region of a predetermined size including a boundary portion of the divided region from the image data to generate boundary region data, and compresses the boundary region data to generate boundary region compressed data. An image data transmission system which extracts the portion corresponding to the boundary portion of the divided region from the boundary region compressed data to generate the boundary compressed data . The image data transmission system according to claim 1 , wherein the compression unit is capable of switching whether to generate the boundary compressed data. Wherein the correction means, the image data transmission system according to claim 1 or 2, characterized in that the presence or absence of correction processing of the decompressed data is switchable. 4. The image data transmission system according to claim 1 , wherein the compression unit executes a compression process according to a JPEG2000 compression method and divides the image data into tiles in predetermined units. Dividing the image data into predetermined units, compressing each divided region independently to generate compressed data, and compressing the boundary portion of the divided region to generate boundary compressed data;
Generating packet data including the compressed data and the boundary compressed data;
Transmitting the packet data;
Receiving the transmitted packet data; and
After decompressing the compressed data included in the packet data, combine them to generate decompressed data, and decompress the boundary compressed data included in the packet data to generate boundary decompressed data;
On the basis of the boundary compressed data, it possesses and correcting the decompressed data,
The step of generating the boundary compression data includes extracting a region having a predetermined size including a boundary portion of the divided region from the image data to generate boundary region data, and compressing the boundary region data to compress the boundary region A method for transmitting image data, comprising: generating data, extracting a portion corresponding to a boundary portion of the divided region from the boundary region compressed data, and generating the boundary compressed data . 6. The image data transmission method according to claim 5 , wherein compression processing is executed according to a JPEG2000 compression method, and the image data is tiled into predetermined units.

Images