JP2013115455A - Image transmission apparatus and image transmission method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image transmission apparatus capable of transmitting large-sized image data such as image data with a 4k2k resolution (3840×2160 pixels) while more faithfully maintaining the image data.SOLUTION: The image transmission apparatus for transmitting image data comprises a compression unit for compressing the image data composed of plural components and a data transfer unit for outputting the compressed image data. The data transfer changes either an output bit width or output bit assignment in accordance with a transmission priority assigned to each component (a luminance/color component or an R/G/B component) of the image data, the compression ratio of each component of the image data, or the error ratio of a transmission path, and outputs the image data.

Description

  The technical field relates to transmission and reception of video information.

  In recent years, the number of pixels handled in digital image processing has been increased to 4k2k (3840 x 2160 pixels) for displays for general users, HD (High Definition: 1920 x 1080 pixels) for broadcasting, and high pixels for image sensors and displays for digital video cameras. It has been increasing year after year.

  Regarding the method of transmitting these image data between devices, DisplayPort (VESA registered trademark or VESA (registered trademark of HDMI Licensing, LLC) standard or VESA (Video Electronics Standards Association) Trademark) standards.

  In the above-mentioned HDMI data transmission system, Patent Document 1 describes that “a non-compressed video signal or a compressed video signal obtained by compressing a non-compressed video signal with a compression system that can be supported by a receiving device”. For selective transmission, a video signal having a desired bit rate can be satisfactorily transmitted within the transmission bit rate of the transmission path ”(see Patent Document 1 [0048]), and for the compression method,“ data compression ” Each of the units 121-1 to 121-n compresses the uncompressed video signal output from the codec 117 with a predetermined compression ratio, and outputs the compressed video signal. -n constitutes a video signal compression unit, and each of the data compression units 121-1 to 121-n performs a data compression process with a different compression method. RLE (Run Length Encoding) ”,“ Wavelet ”,“ SBM (Super Bit Mapping (registered trademark of Sony)) ”,“ LLVC (Low Latency Video Codec) ”,“ ZIP ”, etc. are considered” (Patent Document 1 [ [0077]).

  In HDMI, the data transmission format of TMDS (Transition Minimized Differential Signaling (registered trademark of Silicon Image, Inc.)) is used for image data, and Patent Document 2 is shown as an example.

JP 2009-213110 A JP 2005-514873 A

  However, in any of the prior art documents, there is no consideration regarding transmission of image data of a larger size (also referred to as “video”, hereinafter the same) data while maintaining more faithfulness.

  In order to solve the above problems, for example, the configuration described in the claims is adopted.

  The present application includes a plurality of means for solving the above-described problem. To give an example, an image transmission apparatus that transmits image data, a compression processing unit that compresses image data including a plurality of components, and A data transfer unit that outputs compressed image data, and the data transfer unit changes an image data output method based on each component of the image data.

  According to the above means, it is possible to transmit image data of a larger size while keeping it faithful.

1 illustrates an example of an image transmission device and an image reception device according to a first embodiment. An example of the validity / blanking period of the image data of 1st Example. An example of the unit of the image data to compress of 1st Example. An example of the unit of the image data to compress of 1st Example. An example of the structure of the main compression code information of 1st Example, subcompression code information, and compression image data. An example of the timing of the data transfer of 1st Example. An example of the compression process part of 1st Example. An example of the compression process part of 1st Example. An example of the compression process part of 1st Example. An example of the compression part A of 1st Example. An example of the compression part A of 1st Example. An example of the error correction code generation part of 1st Example. An example of the data transmission part of 1st Example. An example of the header of the compression code information packet of 1st Example. An example of the data of the compression code information packet of 1st Example. An example of the header of the compression code information packet of 1st Example. An example of the data of the compression code information packet of 1st Example. An example of the compression code information of 1st Example. An example of EDID description of the image receiver of 1st Example. An example of the data reception process part of 1st Example. An example of the expansion | extension process part of 1st Example. An example of the expansion | extension process part of 1st Example. An example of the expansion | extension process part of 1st Example. An example of the expansion | extension process part of 1st Example. An example of the timing of the data transfer of 1st Example. An example of the timing of the data transfer of 1st Example. An example of the compression code information of 1st Example. An example of the compression code information of 1st Example. An example of the waveform of the serializer of 2nd Example. An example of the data structure of the serializer output of 2nd Example. An example of the packet structure of the audio | voice data of 2nd Example. An example of the bit allocation of the transmission line with respect to each component of the compressed image data of 2nd Example. An example of the bit allocation of the transmission line with respect to each component of the compressed image data of 2nd Example. An example of the bit allocation of the transmission line with respect to each component of the compressed image data of 2nd Example. An example of the bit allocation of the transmission line with respect to each component of the compressed image data of 2nd Example. An example of the bit allocation of the transmission line with respect to each component of the compressed image data of 2nd Example. An example of the bit allocation of the transmission line with respect to each component of the compressed image data of 2nd Example. An example of the bit allocation of the transmission line with respect to each component of the compressed image data of 2nd Example.

  Conventionally, there is an uncompressed image data transmission system as an image data transmission system that minimizes the delay time, but there is a problem that a high-speed transmission path is required to send large-size image data. To solve this problem, a method of compressing and transmitting image data has been proposed. However, when an error occurs on the transmission path, there is a problem that the display image is disturbed in units of compressed blocks composed of a plurality of pixels. It was. Further, there is a problem that the amount of data that can be transmitted in the blanking period in which high error tolerance is ensured is smaller than the amount of data that can be transmitted in the effective pixel period.

  In this embodiment, in a transmission method in which image data is compressed and transmitted, compression is performed for each compression block unit to generate compression code information. Among the compression code information, compression code information (hereinafter referred to as main code information) having high importance. This problem was solved by transmitting the compression code information) in a blanking period with high error tolerance. Other compressed code information (hereinafter referred to as sub-compressed code information) is transmitted in a valid period as in the case of compressed image data. Hereinafter, this embodiment will be described with reference to the drawings.

  Hereinafter, embodiments of the image transmission device and the image reception device according to the present embodiment will be described.

  FIG. 1 is a block diagram illustrating an image transmission system according to this embodiment, in which an image transmission apparatus 100 and an image reception apparatus 200 are connected by a cable 300.

  The image transmission device 100 is an image transmission device that transmits image data. The image transmission device 100 receives image data that has been decoded so that digital broadcasts can be received and viewed, image data recorded on a recording medium, and image data captured by a camera or the like. A device that outputs to other devices via a cable or the like. Examples of the image transmitting apparatus 100 include a recorder, a digital TV with a built-in recorder function, a personal computer with a built-in recorder function, a mobile phone with a camera function and a recorder function, and a camcorder.

  The image receiving apparatus 200 is a display device that inputs image data and outputs an image to a monitor using an HDMI cable or the like. Examples of the image receiving apparatus 200 include a digital TV, a display, a projector, a mobile phone, and a signage device.

  The cable 300 is a data transmission path for performing data communication such as image data between the devices of the image transmission device 100 and the image reception device 200. As an example of the cable 300, there is a wired cable corresponding to the HDMI standard or the DisplayPort standard, or a data transmission path for performing wireless data communication.

First, the configuration of the image transmission device 100 will be described.
The input units 101, 102, and 103 are input units for inputting image data to the image transmission apparatus 100. An example of image data that is input to the input unit 101 and processed by the tuner reception processing unit 105 is digital broadcasting that is input as radio waves from a relay station such as a broadcasting station or a broadcasting satellite. The input unit 101 receives radio waves from a relay station such as this broadcasting station or broadcasting satellite.

  Examples of image data that is input to the input unit 102 and processed by the network reception processing unit 106 include digital broadcasts distributed via a network using an Internet broadband connection, information contents, and the like.

  An example of image data that is input to the input unit 103 and processed by the recording media control unit 107 is content recorded on an external recording medium connected to the input unit 103. Further, as an example of the video data processed by the recording media control unit 107, there is content recorded in the recording media 108 built in the image transmission apparatus 100. Examples of an external recording medium connected to the input unit 103 or a recording medium 108 built in the image transmission apparatus 100 include an optical disk, a magnetic disk, and a semiconductor memory.

  The tuner reception processing unit 105 is a reception processing unit that converts an input radio wave into a bit stream. Here, the radio wave of the RF band (Radio Frequency) is frequency-converted to an IF band (Intermediate Frequency) and does not depend on the reception channel. A modulation operation applied to the demodulated bit stream for transmission as a fixed band signal is demodulated.

  As an example of the bit stream, there are an MPEG2 transport stream (hereinafter referred to as MPEG2-TS), a bitstream of a format conforming to MPEG2-TS, and the like. The subsequent bit stream will be described with MPEG2-TS as a representative.

  The tuner reception processing unit 105 further detects and corrects a code error occurring during transmission, and after the descrambling of the error-corrected MPEG2-TS, a program for viewing or recording is multiplexed. One transponder frequency is selected, and the bit stream in the selected one transponder is separated into audio and video packets of one program.

  The MPEG2-TS from the tuner reception processing unit 105 is supplied to the stream control unit 111 via the data bus 181. The stream control unit 111 includes a PTS (Presentation Time Stamp) that is time management information from the received packet and a standard decoding of the MPEG system in order to maintain an interval when the tuner reception processing unit 105 receives the packet. An internal STC (System Time Clock) is detected, and a time stamp is added at a timing corrected according to the detection result.

  The packet to which the time stamp is added is supplied to one or both of the decoder unit 112 and the recording media control unit 107. The data path 194 to the decoder unit 112 is used for processing when viewing image data, and the data path 193 to the recording media control unit 107 is used when recording image data on a recording medium.

  The data bus 192 of the stream control unit 111 receives MPEG2-TS input from the input unit 102 via the network reception processing unit 106. The data path 192 is an input unit that acquires digital broadcast or digital content distributed via a network.

  Further, the digital broadcast or digital content recorded on the external recording medium connected to the input unit 103 or the recording medium 108 built in the image transmission apparatus 100 is read out as MPEG2-TS by the recording medium control unit 107. And input to the stream control unit 111 via the data bus 193. The stream control unit 111 selects at least one of these inputs and outputs it to the decoder unit 112.

  The decoder unit 112 decodes the MPEG2-TS input from the stream control unit 111 and outputs the generated image data to the display processing unit 113. The display processing unit 113 performs, for example, OSD (On Screen Display) superimposition processing, rotation, enlargement / reduction processing, and frame rate conversion processing on the input image data, and then outputs them to the compression processing unit 114. .

  The compression processing unit 114 performs compression processing on the image data from the display processing unit 113 and outputs it to the data transfer unit 115.

  The data transfer unit 115 converts the image data compressed by the compression processing unit 114 (hereinafter referred to as “compressed image data”) into a signal in a format suitable for transmission, and outputs the signal from the output unit 116. Regarding transmission of image data, an example of a signal in a format suitable for cable transmission is described in the HDMI standard. In HDMI, image data adopts a TMDS data transmission format.

  The input unit 104 is an input unit for inputting a signal for controlling the operation of the image transmission apparatus 100. As an example of the input unit 104, there is a receiving unit for a signal transmitted from a remote controller, a button provided on the apparatus main body, or the like. A control signal from the input unit 104 is supplied to the user IF 109. The user IF 109 outputs a signal from the input unit 104 to the control unit 110. The control unit 110 controls the entire image transmission apparatus 100 according to the signal from the input unit 104. An example of the control unit 110 is a microprocessor. Image data from the image transmission device 100 is supplied to the image reception device 200 via the cable 300.

Next, the configuration of the image receiving apparatus 200 will be described.
The input unit 201 receives a signal in a format suitable for cable transmission. The signal input to the input unit 201 is supplied to the data reception processing unit 205.

  The data reception processing unit 205 performs processing for converting a signal in a format suitable for cable transmission into predetermined digital data, and outputs the converted digital data to the expansion processing unit 206.

  The decompression processing unit 206 decompresses the compression processing performed by the compression processing unit 114 in the image transmission apparatus 100, generates image data, and outputs the image data to the display processing unit 207.

  The display processing unit 207 performs display processing on the input image data. Examples of display processing include OSD superimposition processing, enlargement / reduction processing for conversion to the resolution of the display unit 208, rotation processing, frame rate conversion processing, and the like. The output of the display processing unit 207 is output to the display unit 208.

  The display unit 208 converts the input image data into a signal that matches the display method and displays it on the screen. Examples of the display unit 208 include a display unit such as a liquid crystal display, a plasma display, an organic EL (Electro-Luminescence) display, and a projector projection display.

  The input unit 202 is an input unit for inputting a signal for controlling the operation of the image receiving apparatus 200. As an example of the input unit 202, there is a receiving unit for signals transmitted from a remote controller, buttons provided on the apparatus main body, and the like. A control signal from the input unit 202 is supplied to the user IF 203. The user IF 203 outputs a signal from the input unit 202 to the control unit 204. The control unit 204 is a control unit that controls the entire image receiving apparatus 200 in accordance with a signal from the input unit 202.

  FIG. 2 is a diagram illustrating an effective area in which image data for one frame period is transmitted and a blanking period in which image data is not transmitted.

  A region indicated by 400 indicates a vertical period, and the vertical period 400 includes a vertical blanking period 401 and a vertical effective period 402. The VSYNC signal is a 1-bit signal in which 1 is set between the number of lines defined from the top of the vertical blanking period 401 and 0 is set between the other vertical blanking periods and the vertical effective period 402. An example of the prescribed number of lines is 4 lines.

  An area indicated by 403 indicates a horizontal period, and the horizontal period 403 includes a horizontal blanking period 404 and a horizontal effective period 405. The HSYNC signal is a 1-bit signal in which 1 is set between the number of pixels defined from the head of the horizontal blanking period 404 and 0 is set between the other horizontal blanking periods and the horizontal effective period 405. An example of the prescribed number of pixels is 40 pixels.

  An effective period 406 indicates an area surrounded by a vertical effective period 402 and a horizontal effective period 405, and image data is allocated to this period. The blanking period 407 is an area surrounded by a vertical blanking period 401 and a horizontal blanking period 404.

  In this embodiment, in the above configuration, the compressed image data and the sub-compression code information are transmitted during the effective period 406, and the main compression code information is transmitted during the blanking period 407.

  In the blanking period 407, data obtained by packetizing audio data and other attached data is transmitted.

  A method of sending a reliable packet of voice data or the like in the blanking period 407 is disclosed in, for example, Japanese translations of PCT publication No. 2005-514873.

With this configuration, since the error correction code is included in the packet data in the blanking period, it is possible to correct an error occurring in the transmission path, and the error resistance is enhanced. In addition, the data for data transmission of the packet in the blanking period is configured to be transmitted to two physically different channels, and the channel to be transmitted is switched every certain time. Since the other channel is not affected by the error, the data error can be corrected. The error correction rate has an improvement effect of ^{10-14 in} the horizontal blanking period as compared to ^{10-9 in the} horizontal effective period.

  In this example, image data of 24 bits per clock is transmitted in the valid period 406, and one packet composed of a 3-byte header and 28-byte data is transmitted in a 32-clock period in the blanking period 407.

  For example, when 12 bits each of horizontal 3840 effective pixels, vertical 2160 effective lines, and YCbCr luminance color difference signal are transmitted in 444 format and frame frequency 60 Hz, a very high clock frequency of 891 MHz is required. The high clock frequency not only increases the cost of the transmission / reception unit, but also shortens the cable length capable of stably sending an image, resulting in poor usability.

  According to the present embodiment, it is possible to approach a practical clock frequency of 594 MHz with 2/3 compression and 297 MHz with 1/3 compression. In addition, in the 8-bit 444 format of each YCbCr luminance color difference signal and the 422 format of 12-bit each, a practical clock frequency of 297 MHz can be obtained by 1/2 compression.

  In the horizontal 3840 effective pixels and the vertical 2160 effective lines, for example, the horizontal blanking period is a horizontal 560 blanking pixel, and the vertical blanking period is a vertical 90 blanking line. In the following, an example will be described in which a horizontal 3840 effective pixel, a vertical 2160 effective line, and 12 bits of YCbCr luminance / chrominance signal are each compressed to 444 format and a video signal having a frame frequency of 60 Hz is compressed to 1/3.

  The compressed clock frequency is 297 MHz, and if the transmission is performed under the conditions of horizontal 1940 effective pixels, vertical 2160 effective lines, horizontal 280 blanking pixels, and vertical 90 blanking lines, the original clock 594 MHz, which is twice the frequency, is stabilized on the receiving side. Easy to play. In the horizontal effective pixel period, if each 12-bit total 36 bits of YCbCr luminance color difference signal per pixel is compressed to 1/3 of 12 bits, 24 bits can be transmitted per compressed pixel, so transmission of two original pixels is possible. The clock frequency after compression is half that of the original clock.

  Since one packet can be transmitted per 32 clocks, a maximum of 8 packets can be transmitted in the compressed horizontal 280 blanking pixels. On the other hand, audio data can be transmitted at 24 bits × 8 channels per packet. Since the horizontal frequency of the image data is 135 kHz (= 60 Hz × (2160 + 90)), when transmitting 24 channels of 24-bit linear PCM audio of 192 kHz samples, a maximum of 2 packets are required during one horizontal blanking period. It is desirable that the compression code method information can be described within the remaining 6 packets, 168 bytes (= 28 bytes × 6 packets).

  On the other hand, when the 32 pixels described above are compressed as a unit block, since they are horizontal 3840 effective pixels, a total of 360 description spaces for each compression code method information of YCbCr luminance color difference signals for 120 blocks are required. If the main compression code information is expressed in 3 bits, for example, it becomes a description space of 135 bytes and can be transmitted in 5 packets, so that it can be compatible with large-capacity audio data transmission of 192 kHz and 8 ch.

  3 and 4 are diagrams illustrating an example of image data input to the compression processing unit 114. A luminance signal of n pixels in the horizontal direction and m lines in the vertical direction is shown. In the case of the 444 format, the color difference signal has the same format as the luminance signal. As an example of the number of pixels n and the number of lines m, there are so-called full HD images with n = 1920 and m = 1080 and so-called 4k2k images with n = 3840 and m = 2160.

  Here, a unit block (hereinafter referred to as a compression block) of image data to be compressed by the compression processing unit 114 is defined as 1 pixel in the horizontal direction and k pixels in the vertical direction. In FIG. 3, reference numerals 501 and 502 denote examples where l = 32 and k = 1, and are constituted by data of 32 pixels continuous in the same line. The compression processing unit 114 performs compression in units of this image data.

  In FIG. 4, reference numerals 503 and 504 denote examples where l = 16 and k = 2, and are constituted by data of 16 pixels continuous between upper and lower two lines. The compression processing unit 114 performs compression in units of this image data. As compression processing, image data unit blocks having k1 and k2 (k1 <k2) having a horizontal compression unit and a vertical compression unit and different in the number of k pixels (number of lines) in the vertical direction are prepared, and the horizontal compression unit is an image of k1. The data unit block may be compressed by the vertical compression unit 134 for the k2 image data unit block.

  As an example of the unit of image data to be compressed, 32 pixels have been described as an example. However, a unit of 64 pixels or 128 pixels may be used.

  When the input color difference signal is in the 422 format, the Cb component and the Cr component of the color difference signal become nested data for each pixel. For example, in a 4k2k image, the Cb component and the Cr component may be combined and handled as image data of n = 3840 and m = 2160. In general, since the correlation between Cb components and Cr components is high, the Cb component and the Cr component are separated and handled as n = 1920 and m = 2160, thereby forming a unit block of image data compressed with only the same component. , Compression efficiency can be increased.

  When the input color difference signal is in the 420 format, the Cb component and Cr component of the color difference signal are data for one pixel with respect to four Y signal pixels. For example, in a 4k2k image, the Cb component and the Cr component may be combined and handled as image data of n = 1920 and m = 2160. In general, since the correlation between the Cb component and the Cr component is high, the Cb component and the Cr component are separated and handled as n = 1920 and m = 1080, so that the unit of image data to be compressed only with the same component is obtained. Compression efficiency can be increased.

  The compression code information is composed of main compression code information and sub compression code information. Based on the main compression code information and the sub compression code information, decompression processing can be performed from the compressed image data to the original image data.

  Simple decompression processing or partial decompression processing can be performed with only the main compression code information.

  The main compression code information is transmitted through a transmission path with higher error resistance than the sub compression code information. In this embodiment, compressed image data and sub-compression code information are transmitted during the effective period 406, and main compression code information is transmitted during the blanking period 407. As an example of transmission of the main compression code information in the blanking period 407, common main compression code information is transmitted in units of lines in the vertical blanking period 401, and main compression code information for compressed blocks in the same line is transmitted in the horizontal blanking period. There is a method of transmitting in 404.

  By adopting the above configuration, even if an error occurs in the sub-compression code information on a transmission line with a high transmission error rate, the probability that an error will occur in the main compression code information is greatly reduced. For this reason, when an error occurs in the sub-compression code information on a transmission line with a high transmission error rate, image data that is simply decompressed using the main compression code information or partially decompressed image data is used for error correction. Display disturbance can be suppressed. Further, by including the compression block size in the main compression code information, when an error occurs in the sub compression code information, display disturbance can be suppressed in the compression block.

  Further, the compression code information may be composed only of main compression code information or sub compression code information.

  A configuration example of the compression code information and the compressed image data is shown in FIG.

  In this example, the unit of the compression block 600 is composed of sub-compression blocks 610 and 620, and each sub-compression block 610 and 620 is composed of pixels 611, 612, 613, and 614 and pixels 621, 622, 623, and 624. Has been.

  An example of the configuration of the compressed block after compression is shown at 630. The compression block 630 includes compression code information 631 and compressed image data 632. The compressed image data 632 is compressed image data generated by compressing the pixel data 611, 612, 613, 614, 621, 622, 623, and 624. The compression code information 631 is information generated by the compression process. In this configuration, when the compression code information is transmitted in the valid period 406, if the transmission error rate is high, the probability that an error will occur in the compression code information is also high, and as a result, the display is disturbed in units of compression blocks. There is a problem that it is likely to occur. In addition, when the compression code information is transmitted in the blanking period 407, the amount of data that can be transmitted is significantly smaller than that in the valid period 406, so that the amount of compression code information is reduced.

  Another example of the configuration of the compressed block after compression is shown at 640. In this example, the compression code information is composed of two types of main compression code information 641 and sub compression code information 642 and 644. The compression block 640 includes main compression code information 641, sub compression code information 642 and 644, and compressed image data 643 and 645. The compressed image data 643 is compressed image data generated by compressing the image data 611, 612, 613, and 614 belonging to the sub-compression block 610. The sub compression code information 642 is information generated by the compression process for the pixel data 611, 612, 613, and 614. The compressed image data 645 is compressed image data generated by compressing the image data 621, 622, 623, and 624 belonging to the sub-compression block 620. The sub compression code information 644 is information generated by the compression process for the pixel data 621, 622, 623, and 624.

  Another example of the configuration of the compressed block after compression is shown at 650. In this example, the compression code information is composed of two types of main compression code information 651 and sub compression code information 652. The compression block 650 includes main compression code information 651, sub compression code information 652, and compressed image data 653. The compressed image data 653 is compressed image data generated by compressing the image data 611, 612, 613, 614, 621, 622, 623, and 624 included in the compressed block 600. The main compression code information 651 and the sub compression code information 652 are information generated by the compression process for the compression block 600.

  Another example of the configuration of the compressed block after compression is shown at 660. The difference between this example and the compressed block 650 after compression is that the sub-compression code information 662 is information obtained by further compressing the sub-compression code information 652 in the compressed block 650 after compression. Although not shown here, the transmission data amount may be reduced by further compressing the main compression code information 651.

  When the compressed blocks 640, 650, and 660 after compression are configured, the main compression code information is transmitted to a transmission path with higher error resistance by transmitting the main compression code information through a transmission path with higher error resistance than the sub compression code information. It is possible to suppress the influence of transmission errors on the display image (restored image) while suppressing the data amount.

FIG. 6 is an explanatory diagram of transmission timings for the compressed blocks 640, 650, and 660 after compression shown in FIG. 700 and 702 are effective periods 406, and 701 is a horizontal blanking period 404. Reference numerals 710, 711, and 712 denote image data for one line before compression transmitted in the validity period 700. In this example, compression processing is performed on the three compression blocks 710, 711, and 712.
Reference numeral 730 denotes main compression code information generated by compression processing for the compression blocks 710, 711, and 712. Reference numerals 731, 732, and 733 are compression blocks generated by the compression process for the compression blocks 710, 711, and 712. The compression block is composed of compressed image data and sub-compression code information generated by compression processing. 740, 750, and 760 are shown as examples of the configuration of the compressed block 731 after compression. These correspond to the sub-compression blocks 640, 650, and 660 shown in FIG.

  The main compression code information 730 is transmitted in the horizontal blanking period 701 having higher error resistance than the effective periods 700 and 702. In addition, compressed blocks 731, 732, and 733 after compression composed of compressed image data generated by the compression processing on the image data 710 and sub-compression code information are transmitted in the effective period 702 next to the horizontal blanking period 701. . A part or all of the main compression code information may be transmitted in the vertical blanking period 401.

  An example of main compression code information and sub compression code information will be described with reference to FIG.

  Consider a case in which compression processing is performed in which the unit of the compressed block 920 is 32 pixels horizontally and the unit of the sub-compressed blocks 921, 922, 923, and 924 is 8 pixels. The compression code information 926 for the first sub-compression block 921 is used as main compression code information, and the compression code information 927, 928, and 929 for the other three sub-compression blocks is used as sub-compression code information.

  The main compression code information includes compression code information 926 for the head sub-compression block 921 and other compression code information used for decompression processing of the sub-compression block 921 (for example, common compression code information 925 common to each sub-compression block). Consists of.

  The sub-compression code information includes compression code information 927, 928, and 929 for the second and subsequent sub-compression blocks 922, 923, and 924.

  By adopting the configuration of this example, if an error occurs in the sub-compression code information on a transmission path with a high transmission error rate, the image data belonging to the first sub-compression block decompressed using the main compression code information is in error. By using it for correction, display disturbance can be suppressed. As an example of error correction, there is a method of generating and displaying a complementary image belonging to a sub-compression block in which an error has occurred from image data belonging to the first sub-compression block of each compression block expanded by main compression code information.

  As an example of the transmission path, the sub-compression code information (FIG. 28C) and the compression unit output (FIG. 28D) are transmitted in the effective period 406, and the main compression code information is horizontally blanked with higher error resistance. There is a method of transmitting in the period 404.

  Another example of main compression code information and sub compression code information will be described with reference to FIG.

  Consider a case in which compression processing is performed in which the unit of the compressed block 900 is horizontal 32 pixels and the unit of the sub-compressed blocks 901, 902, 903, and 904 is 8 pixels.

  In the first compression unit (compression unit A133), the first compression processing is performed on the sub-compression blocks 901, 902, 903, and 904 in units of sub-compression blocks, and sub-compression code information (first unit) in units of sub-compression blocks. Compression code information 905, 906, 907, 908) and compressed image data (first compressed image data 909, 910, 911, 912) are generated. The second compression unit (compression unit B134) further performs second compression processing on the input compressed image data (first compressed image data 909, 910, 911, 912) in units of four sub-compression blocks. To generate one piece of main compression code information (second compression code information 914), compressed image data (second compressed image data 914), and compressed image data (second compressed image data 915). The main compression code information is transmitted through a transmission path having higher error resistance than the transmission path of the sub compression code information (first compression code information 905, 906, 907, 908) and the compressed image data (second compressed image data 915). As a result, even in a transmission line with a high transmission error rate, it is possible to perform decompression processing up to the sub-compression block unit, and it is possible to suppress the error influence range within the sub-compression block range.

  By transmitting the compression code information 913 common to the first compression code information 905, 906, 907, and 908 as the main compression code information in addition to the second compression code information 914, it is possible to further improve error resistance.

  As another example of the compression code information, consider a case where, for example, the compression block unit is horizontal 32 pixels, the sub-compression block unit is 8 pixels, and compression processing is performed in which size information is added for each sub-compression block unit. The sum of the size information for each sub-compression block unit, that is, the size information for each compression block is included in the main compression code information, and the size information for each sub-compression block unit is included in the sub-compression code information. By transmitting the main compression code information through a transmission path with higher error tolerance, when an error occurs in the sub compression code information in a transmission path with a high transmission error rate, the compression unit is compressed based on the main image code information. By generating a size and skipping the decompression process by that size, it is possible to prevent the influence of an error on the next compressed block.

  When there is a margin in the amount of data that can be transmitted on a transmission line with high error resistance, all the size information for each sub-compression block may be transmitted as main compression code information. In this case, if an error occurs in the sub-compression code information, the size of the sub-compression block in which the error has occurred is generated based on the main image code information, and the other sub-compression is performed by not performing the decompression process for that size. The effect of errors on the block can be prevented.

FIG. 7 is a block diagram illustrating an example of the configuration of the compression processing unit 114.
The input unit 130 is an input unit for inputting image data to the compression processing unit 114.

The input image data is supplied to the compression unit A133, the compression unit B134, and the compression unit C135.
The compression unit A133, the compression unit B134, and the compression unit C135 perform different compression processes on the input image data to generate compression code information and compressed image data. Note that power consumption can be reduced by not performing compression processing or stopping the operation clock itself except for the compression unit specified by the control signal 131.

  The compression unit A133, the compression unit B134, and the compression unit C135 are configured by a compression circuit that compresses a plurality of pieces of image data constituting the compression block. As an example of the compression method, Wavelet transform is calculated in the horizontal direction, and the calculation result is configured by an encoded compression method or the like. As a compression method, Hadamard transform, run length coding, Huffman coding, differential coding, or the like may be applied.

  As an example of another compression method, a compression circuit that compresses a plurality of pieces of image data in the vertical direction is configured. As an example of the compression method, as a unit block of image data for compressing image data of 2 lines in the vertical direction and 16 pixels in the horizontal direction, a difference is first taken in the vertical direction, and then a difference is taken in the horizontal direction. . The result is configured by a compression method for encoding the result.

  Further, as an example of another compression method, when a 444 format or 422 format color difference signal is input, it is configured by a circuit that thins out to a 422 format or 420 format. When a 444 format or a 422 format is input, if a predetermined compression rate is exceeded in the configuration of the compression processing unit 114 shown in FIG. 8 to be described later, the thinning process may be performed to the 422 format or the 420 format.

  Here, the compression rate is a ratio of the data amount before compression and the data amount after compression. For example, when the data amount before compression is 100 and the data amount after compression is 30, the compression rate is 30%. Therefore, the higher the compression rate, the greater the amount of data after compression and the less the image quality degradation.

  FIG. 10 is a block diagram illustrating an example of the configuration of the compression unit A133.

  The input unit 150 is an input unit for inputting image data to the compression unit A133.

  The input unit 151 is an input unit for inputting a control signal for controlling the compression unit A133.

  The first compression unit 153 is a block that performs compression processing on input image data to generate compression code information and compressed image data. The compression code information generated by the first compression unit 153 is supplied to the compression code information generation unit 155. The compressed image data generated by the first compression unit 153 is supplied to the selection unit 156.

  The compression code information generation unit 155 is a block that generates main compression code information and sub compression code information from the input compression code information. The compression code information generation unit 155 may include a memory that temporarily stores the generated main compression code information and sub compression code information.

  The selection unit 156 is a block that selects and outputs the compressed image data supplied from the first compression unit 153 and the main compression code information and sub compression code information supplied from the compression code information generation unit 155.

  FIG. 11 is a block diagram illustrating another example of the configuration of the compression unit A133.

  The input unit 160 is an input unit for inputting image data to the compression unit A133.

  The input unit 161 is an input unit for inputting a control signal for controlling the compression unit A133.

  The first compression unit 163 is a block that performs first compression processing on input image data and generates sub-compression code information and compressed image data. The sub compression code information generated by the first compression unit 163 is supplied to the selection unit 166. The compressed image data generated by the first compression unit 163 is supplied to the second compression unit 164.

  The second compression unit 164 is a block that performs a second compression process on the input compressed image data to generate main compression code information and compressed image data. The main compression code information and the compressed image data generated by the second compression unit 164 are supplied to the selection unit 166.

  The selection unit 166 is a block that selects and outputs the sub compression code information supplied from the first compression unit 163 and the main compression code information and compressed image data supplied from the second compression unit 164.

  With the configuration of this example, the two-stage compression processing shown in FIG. 27 can be performed. In this example, two compression units have been described as an example, but three or more compression units may be provided.

  The outputs of the compression unit A133, compression unit B134, and compression unit C135 whose operations have been described above are supplied to the selection unit 136.

  In this example, the compression processing unit having the three compression units 133, 134, and 135 has been described. However, the compression unit may include only one or two compression units, or may include four or more compression units. May be.

  The selection unit 136 selects a compression unit A133, compression unit B134, and compression unit C135 that satisfies a predetermined compression rate and has a high image quality index, and supplies the selected one to the error correction code generation unit 137. The image quality index includes, for example, an index that indicates a better value as the difference between the image data restored from the compressed image data and the image data before compression is smaller. The highest value is when lossless compression does not occur and lossless encoding is possible. In order to simplify the calculation of the image quality index, a value of the image quality index may be prepared for each compression method. A case where lossless encoding can be performed after thinning out to 422 format may be defined as a higher image quality index than when compression loss occurs when compression is performed in the 444 format. Conversely, if the amount of data increases due to compression, a predetermined compression ratio can be achieved by thinning out to 422 format or 420 format and reducing the number of quantization bits. Set the appropriate image quality index.

  Further, the operation of any one of the compression unit A133, the compression unit B134, and the compression unit C135 may be enabled by the control signal input from the input unit 131, and the other two may be stopped. In this case, control information indicating a compression unit whose operation is valid is input from the input unit 131 to the selection unit 136. The selection unit 136 outputs an output signal of the compression unit whose operation is valid to the error correction code generation unit 137 based on the control information.

  The error correction code generation unit 136 calculates an error correction code for each unit of the image data (compressed image data) compressed by the compression unit A133, the compression unit B134, and the compression unit C135, adds the error correction code to the compressed image data, and The data is output to the control unit 139. One of error correction methods includes a CRC (Cyclic Redundancy Check) method and a parity check method.

  Whether or not to add an error correction code may be determined according to the data transmission capacity. This is because, when the data transmission capacity of the cable is limited, if an error correction code is given, more pixels or gradations are thinned out, leading to deterioration in image quality of the entire screen. If the transmission capacity is sufficient, an error correction code may be added to the compressed image data to improve error resistance. Whether or not error correction processing is to be performed may be determined on the receiving side by transmitting together with metadata indicating whether or not error correction is added to the compressed image data. Further, the error resistance processing level may be changed by changing the error correction processing depending on the compression method to be applied, and information indicating which error correction code is assigned may be added as metadata. Further, input data may be output as it is without performing error correction processing.

  The memory control unit 139 temporarily stores the compressed image data, the main compression code information, and the sub compression code information supplied from the error code generation unit 137 in the memory unit 140. Further, the sub-compression code information and the compressed image data are read from the memory unit 140 and output during the valid period 406. Also, the main compression code information is read from the memory unit 140 and output in the horizontal blanking period 404 immediately before the effective period 406 for outputting the compressed image data. As another method, the compressed image data with error correction code for one line, the main compression code information, and the sub compression code information are all transmitted within the effective period 406 for one line to increase the transmission amount. You may plan. In addition, the error correction reliability may be improved by including the error correction code in the main compression code information and outputting it in the horizontal blanking period 404.

  The output unit 132 outputs the compressed image data, main compression code information, and sub compression code information from the memory control unit 139. Although not shown, the operation of each block in FIG. 7 is controlled according to the control signal of the control unit 110 in FIG.

FIG. 12 is a block diagram illustrating an example of the configuration of the error correction code generation unit 136. Compressed image data is input to the input unit 170. The compressed image data is input to the holding unit 175 and the error correction code calculation unit 173. The error correction code calculation unit 173 performs a cyclic calculation with the generator polynomial on the input compressed image data.
An example of a generator polynomial is

(Equation 1) G (X) = X ¹⁶ + X ¹² + X ⁵ +1
There is. This generator polynomial takes an exclusive OR for each bit in the input compressed image data and performs a cyclic operation. The unit of calculation is a unit of compressed image data.

  The input unit 171 receives a signal indicating a period during which the compressed image data is input and supplies the signal to the timing generation unit 174. The timing generation unit 174 outputs a signal indicating that the calculation for the unit block of the image data to be compressed by counting the valid period of the compressed image data has been processed to the data holding unit 175 as an error correction calculation result output timing signal. . Further, the timing generation circuit 174 outputs a timing signal indicating the input period of the compressed image data and a timing signal for outputting the compressed image data and the error correction code calculation result to the data holding unit 175.

  The data holding unit 175 temporarily stores the calculation result of the error correction code calculation unit 173 and the compressed image data by, for example, a memory, a flip-flop, a delay element, and the like according to the timing indicated by the timing generation unit 174, and sequentially outputs them. To the unit 132.

FIG. 13 is a block diagram illustrating an example of the configuration of the data transfer unit 115.
The input unit 180 outputs the compressed image data to the serializer unit 184. The input unit 181 receives a clock of image data and outputs the clock to the PLL 186 and the output unit 182.

  As the clock of the image data, a clock synchronized with the pixel clock used in the standard timing format of the uncompressed image data is used. For example, a clock obtained by dividing the pixel clock of uncompressed image data by two may be used. In this case, if the uncompressed image data is 12-bit quantized image data, the clock is 1/2 and the number of quantization bits is 8/12, so the predetermined compression rate is set to 1/3 or less. There is a need to. The clock may be multiplied by 3/4 or 2/3, in addition to dividing by two. By using a clock synchronized with the pixel clock of the uncompressed image data for transmission of the compressed image data, when restoring the uncompressed image data on the receiving side, it is 2 times, 4/3 times, 3/2 times the transmission clock. By using the multiplied clock as the pixel clock. There is an advantage that the jitter of the restored data can be minimized.

  The PLL 186 generates a clock obtained by multiplying or dividing the input clock. Examples of multiplication include 5 times and 10 times the frequency of the input clock. The clock generated by the PLL 186 may be one type of clock or two types of clocks. An example of one type of clock is 10 times the input clock. Examples of the two types of clocks include a first clock speed that prioritizes the amount of data transmission and a second clock speed that is slower than the first clock speed that prioritizes lowering the frequency of error occurrence. is there. As an example of the speed, the first clock speed is multiplied by 10 of the input clock, and the second clock speed is multiplied by 5 of the input clock.

  The multiplied clock generated by the PLL 186 is output to the serializer unit 184.

  The serializer 184 serializes the input compressed image data of the YCbCr luminance / chrominance signal one bit at a time multiplied by 10 and outputs it to the level conversion unit 185. TMDS transmission method that suppresses the DC component of a bit stream that is serialized by mapping the 8-bit data to 10 bits when there is 8 bits of data input to the input unit 180 for one clock input to the input unit 181 May be used. When there are three cables connected to the output unit 176, 24 bits of compressed image data can be sent per input clock by performing the serial processing for each cable.

  The level conversion unit 185 outputs a signal in a format suitable for cable transmission via the output unit 182.

  FIG. 8 is a block diagram illustrating another example of the configuration of the compression processing unit 114.

  The memory control unit 142 temporarily stores the compressed image data, main compression code information, and sub-compression code information supplied from the error code generation unit 137 in the memory unit 140. Further, the sub-compression code information and the compressed image data are read from the memory unit 140 and output during the valid period 406. Also, the main compression code information is read from the memory unit 140 and output in the horizontal blanking period 404 immediately before the effective period 406 for outputting the compressed image data. Further, the compressed image data can be read from the memory unit 140 and supplied to the selection unit 141.

  The selection unit 141 selects one of the image data input from the input unit 130 and the compressed image data 143 supplied from the memory control unit 142, and supplies the selected data to the compression unit A133, the compression unit B134, and the compression unit C135. It is a block. Further, the image data input from the input unit 130 may be output to a predetermined compression unit, and the compressed image data 143 may be output to another compression unit. With the configuration of this example, the two-stage compression processing shown in FIG. 27 can be performed. Further, a compression process of three or more stages may be performed.

  FIG. 9 is a block diagram illustrating another example of the configuration of the compression processing unit 114.

  The selection unit 138 outputs the main compression code information and the sub compression code information supplied from the error code generation unit 137 to the memory control unit 145, and outputs the compressed image data supplied from the error code generation unit 137 to the selection unit 144. To do.

  The memory control unit 145 temporarily stores the main compression code information and the sub compression code information supplied from the selection unit 138 in the memory unit 140. Also, the sub-compression code information is read from the memory unit 140 and output via the selection unit 144 during a later-described effective period 406. Also, the main compression code information is read from the memory unit 140 and output via the selection unit 144 to the horizontal blanking period 404 immediately before the effective period 406 for outputting the sub compression code information.

  The selection unit 144 is a block that selects the compressed image data supplied from the selection unit 138 and the main compression code information and sub compression code information supplied from the memory control unit 145, and outputs them to the output unit 132.

  In this example, the selection unit 138 may output the sub-compression code information together with the compressed image data directly to the selection unit 144 without passing through the memory control unit 145. In this case, the memory control unit 145 performs memory writing and reading processing on the main compression code information. By adopting the configuration of this example, the memory amount of the memory unit 140 on the transmitter 100 side can be reduced.

  14 to 17 show an example of a packet for transmitting a part of main compression code information.

  FIG. 14 and FIG. 16 are examples of packet headers, and a common header type 0Bh is described in the first header block HB0, which indicates information related to the compression coding transmission system of the present invention. Each bit of HB1 and Bits 4-7 of HB2 are set to 0 for future expansion. Eco_Packet # indicated in Bits 0 to 3 of HB2 indicates identification within the frame. FIG. 15 and FIG. 17 are examples of 28-byte data transmitted following the header.

  In the header of FIG. 14, Eco_Packet # is assigned 0h, and indicates that the packet configured by the header of FIG. 14 and the data of FIG. 15 is common information (main compression code information) in each frame. This packet is arranged during the vertical blanking period and is transmitted at least once for each image frame. Hereinafter, the contents of the data in FIG. 15 will be described.

  Color_Sample indicates color sample information. For example, 0 is a YCbCr luminance color difference signal in 444 format (hereinafter referred to as YCbCr444), 1 is a YCbCr luminance color difference signal in 422 format (hereinafter referred to as YCbCr422), and 2 is a YCbCr luminance color difference signal. 420 format (hereinafter referred to as YCbCr420), 3 represents an RGB signal and 444 format (hereinafter referred to as RGB444), and 4 to 7 are for future expansion. In the 422 format or 420 format, a bit indicating CbCr sample position information may be additionally allocated.

  Eco_Mem is set to 0 when a packet that transmits a part of main compression code information shown in FIGS. 16 and 17 to be described later is transmitted in the horizontal blanking period immediately before the effective period 406 for transmitting compressed image data. It is set to 1 when transmitting in the horizontal blanking period immediately after the effective period 406 for transmitting the compressed image data.

  CD is Color Depth, for example, 4h is each YCbCr component 8bit total 24bit Color, 5h is each YCbCr component 10bit total 30bit Color, 6h is each YCbCr component 12bit total 36bit Color, 7h is each YCbCr component 16bit total 48bit Color is shown, others are for future expansion. This definition conforms to the definition of Deep Color Mode defined by HDMI.

  Eco_FLM is set to 1 when the compression code system of all the blocks in the frame is the same, and is set to 0 when set for each block. In the case of 1, the compression code systems of Y, Cb, and Cr are described in Eco-CD0, Eco-CD1, and Eco-CD2, which will be described later.

  The ratio (CK_N / CM_M) of CK_N and CK_M indicates a frequency ratio between a pixel clock of uncompressed image data and a clock of a communication path for transmitting the compressed data, for example, a TMDS clock. For example, if CM_N = 1 and CK_M = 2, the TMDS clock of the transmission system is 297 MHz, which is 1/2 of the pixel clock 594 MHz of uncompressed image data in the case of 4k2k.

  Eco_Block indicates the number of pixels constituting the compressed block.

  Eco_CD0 to Eco_CD3 indicate four types of compression encoding information candidates to be applied to each image data unit block. As shown in FIG. 18, four types are selected from compression code information Eco_Code in units of image data to be compressed.

  One or more packets including the header of FIG. 16 and the data of FIG. 17 are transmitted in each horizontal blanking period. Eco_Packet # in the header of FIG. 16 indicates the serial number of the packet transmitted to each line, and starts from 1 and is incremented by 1.

Eco_length_0 to Eco_length_39 indicate size information of the compressed block that transmits the valid period 406. Examples of size information include the bit size and byte size of the compressed block. Moreover, the information which becomes the origin of the bit size and byte size of a compression block may be sufficient. For example, when the compressed block size S_Block takes two values from 32 bits to 64 bits, there is a method of defining the compressed block bit size by the following formula.
(Expression 2) S_Block = 32 + (2 × Eco_length_ #) (# is 0 to 39)
In the above example, Eco_length_ # is 4 bits.

  Eco_length_ # may be defined for each of Y, Cb, and Cr, or may be defined by a value obtained by adding the compressed block sizes of Y, Cb, and Cr. In the latter case, the transmission amount of Eco_length_ # can be reduced to 1/3.

  The compression code information defined in units of compressed blocks is transmitted as sub-compression code information during the effective period 406 together with the compressed image data. The types of sub-compression code information include Eco_Error_0 to 39 and Code_0 to Code_39.

  Eco_Error0 to Eco_Error39 indicate error encoding methods. The error encoding method is an error correction encoding method in which the error correction code generation unit 136 performs an operation on data transmitted during the valid period 406. As one of error correction coding systems, there are a CRC (Cyclic Redundancy Check) system, a parity check system, and the like.

  Code_0 to Code_39 describe each Y, Cb, and Cr component in order in each image data unit block, with numbers selected from the four types of compression coding information described in Eco_CD0 to Eco_CD3 in FIG. For example, if Code_0 indicating the compression code information of the Y component of the first image data unit block is 1, it indicates Eco_CD1. If Eco_CD1 indicates 10, it indicates that data obtained by compressing the 444 format Y component of the original image data by the differential encoding method from FIG.

  When the vertical two lines shown in FIG. 4 are image data unit blocks, Code_0 of the first line is compression code information of the image data unit block 503, and Code_0 of the second line is compression code information of the image data unit block 504. Indicates.

  When Color_Sample in FIG. 15 indicates the 444 format, Code_1 is Cb compression code information of the first image data unit block, Code_2 is Cr compression code information of the first image data unit, and Code_3 is second image data. The Y compression code information of the unit block is shown. When Color_Sample indicates 420 format, Code_1 is Y compression code information of the second image data unit block, Code_2 is Cb compression code information of the first and second image data units (Cr in even lines), Code_3 indicates Y compression code information of the third image data unit block. When Color_Sample indicates 422 format, Code_1 is Cb compression code information of the first and second image data unit blocks, Code_2 is Y compression code information of the second image data unit, and Code_3 is the first and second image data unit blocks. Cb compression code information of the second image data unit block is shown.

  If Code_0 is 0, it indicates Eco_CD0, and if Eco_CD0 indicates 6, the Y-, Cb-, and Cr-component 12-bit data of the 444 format of the original image data is thinned out to 420 format 8 bits from FIG. It is shown that. In this case, since the transmission form of Cb and Cr is determined only by Y component Code_0, information of Code_1 indicating the Cb component and Code_2 indicating the Cr component is unnecessary, and 0 may be described.

  Although not shown in FIG. 1, the image receiving apparatus 200 is equipped with a ROM that stores EDID (Enhanced Extended Display Identification Data) indicating the performance of the image receiving apparatus 200. Information for determining whether or not the image receiving apparatus 200 supports compression / decompression may be added to the ROM. As a result, the image transmission apparatus 100 reads information for determining whether or not it supports compression / decompression from the ROM storing the EDID of the image reception apparatus 200, and if it is a compatible apparatus, the compressed image data If the device is non-compatible, the image can be transmitted in a conventional size without being compressed, and compatibility with an image reception device not compatible with compression processing can be maintained. In addition, information for determining whether or not the error correction encoding method for transmitting the compression code information in the effective period 406 is supported is read, and if the device is compatible, an error correction encoding process is performed. If the device is transmitted as compressed code information and is incompatible with the device, transmission without performing the error correction encoding processing allows compatibility with an image reception device incompatible with the compression processing. In the case of a non-compliant device, the packet error correction function in the blanking period 407 may be used to increase resistance to transmission errors. Further, it is possible to notify the user by displaying on the display unit 208 that the image receiving apparatus is incompatible with compression, has a conventional image size, and incompatible with error correction coding.

  A description example of the EDID is shown in FIG. FIG. 19 shows an example of extension to an area called HDMI-VSDB.

  An Eco_transfer flag indicating whether or not it is possible to support the compression coding transmission system of the present embodiment is provided in Bit 2 of the 6th byte. Since this area has been treated as a reserved area, it is described as 0 for non-compliant legacy devices, and backward compatibility can be maintained by describing only 1 for compatible devices. When the Eco_transfer flag is 1, the description of Byte 9 and Byte 10 is valid.

  Block_64 and Block_128 are flags indicating that the size of the image data unit block to be compressed corresponds to 64 pixels and 128 pixels, respectively. The image data unit block size of 32 pixels is defined as an indispensable mode in correspondence with the transmission of the compressed image data, and is not intentionally written in order to save EDID description space.

  Eco-Codes 1 to 4 are flags indicating that they correspond to the compression coding method, Wavelet transform, run-length coding, Huffman coding, and differential coding, which are shown as examples in FIG.

  CLK_1, CLK_3 / 4, and CLK_1 / 2 are flags indicating that the mode corresponds to the mode in which the frequency of the TMDS transmission clock is 1 time, 3/4 time, and 1/2 time with respect to the uncompressed image data clock, respectively. is there.

  Eco_Error_1 to 4 are flags that are set to 1 when they correspond to the respective error encoding schemes, and are set to 0 when they are not supported.

  Eco_Mem is set to 1 when the main compression code information corresponds to the case where the main compression code information is transmitted in the horizontal blanking period immediately before the effective period 406 for transmitting the compressed image data, and is set to 1 in the effective period 406 for transmitting the compressed image data. It is set to 2 when transmitting in the immediately following horizontal blanking period. 3 indicates a case where both correspond, and 0 indicates a case where neither corresponds.

  In addition, when the image transmission apparatus 100 is used as a portable device, the power consumption of the image transmission apparatus 100 affects the continuous use time because it is a battery-driven apparatus. In this case, image data can be compressed and transmitted to reduce the amount of data transmission and reduce power consumption. This effect is achieved by adding a function such as “power saving mode” as an operation mode of the image transmission apparatus 100, and when power is supplied from the outside, the image transmission apparatus 100 is transmitted by non-compressed image data and driven by a battery. In this case, the continuous use time can be set longer by compressing and transmitting the image data.

FIG. 20 is a block diagram illustrating an example of the configuration of the data reception processing unit 205.
The input unit 220 outputs the signal converted by the level conversion unit 175 of the image transmission apparatus 100 to the level conversion unit 22.

The level conversion unit 224 converts the signal level-converted by the image transmission apparatus 100 into a digital signal and outputs the digital signal to the deserializer unit 225. An example of level conversion is conversion of a differential signal to a single-ended signal.
The input unit 221 receives the clock output from the image transmission device 100 and outputs the clock to the PLL 226. The PLL 226 generates a clock 10 times the input clock and outputs the generated clock to the deserializer unit 225. Further, the PLL 226 outputs a pixel clock used in the image receiving apparatus 200 from the output unit 222. When the pixel clock of the uncompressed image data of the original image is used in the image display device 200, the clock output by the PLL 226 multiplied by (CK_M / CK_N) times based on the packet data of FIG. To do.

  The deserializer unit 225 parallelizes the serialized data with the clock from the PLL 226 and outputs it from the output unit 222. The deserializer 225 parallelizes the 10-times clock data, and outputs the data from the output unit 222 as 8-bit parallel data by predetermined TMDS decoding, for example.

FIG. 21 is a block diagram illustrating an example of the configuration of the decompression processing unit 206. FIG. 26 is an explanatory timing diagram showing the processing concept of the decompression processing unit 206 for the compressed block shown in FIG.
The input unit 230 is a data input unit of the decompression processing unit 206. Data input to the input unit 230 includes HSYNC (FIG. 26 (a)) and VSYNC indicating a synchronization signal of image data, compressed image data and sub-compression code information 812 and 814 in a valid period 406, horizontal blanking period 404 includes main compression code information 811 and 813. The input unit 231 receives a pixel clock of uncompressed image data after restoration, a compressed image data clock, and the like.

  The HSYNC, VSYNC, compressed image data clock, and the pixel clock of the uncompressed image data after restoration are supplied to the timing generation unit 236. The timing generator 236 controls the counter based on the input HSYNC and VSYNC, and starts and expands the timing of the vertical blanking period 401, the vertical valid period 402, the horizontal blanking period 404, the horizontal valid period 405, the valid period 406, and the like. Generates and outputs timing necessary for control of each block in the processing unit.

  The compression code information extraction unit 233 extracts the compression code information of each image data unit block sent during the horizontal blanking period and stores it in the compression code information storage unit 234.

  The storage period is shown in FIG. Since the main compression code information 811 is data corresponding to the subsequent compressed image data 812, a storage period 815 until the main compression code information 813 of the second line comes is sufficient. However, for example, when two lines of image data are vertically compressed, it is necessary to retain only the compression code information 816 for vertical expansion until a period during which the compressed image data of the second line is expanded.

  The compressed image data sent within the horizontal effective period is subjected to transmission system error correction processing by the error correction unit 235. The error correction unit 235 calculates the same error correction code as the error correction code generation unit 137 for each compressed image data unit. The calculation result is compared with the error correction code input from the compression code information extraction unit 233, and if the comparison result is different, an error correction process is performed. An example of error correction processing is CRC calculation. Alternatively, only error detection may be performed, and errors may be interpolated in subsequent processing.

The input compressed image data is supplied to the expansion unit A237, the expansion unit B238, and the expansion unit C239.
The decompression unit A237, the decompression unit B238, and the decompression unit C239 perform different decompression processes on the input compressed image data based on the information in the compression code information storage unit 234 to generate decompressed image data. To the selection unit 261.

  26D and 26E show output data of each decompression unit when the decompression unit A237 performs horizontal decompression processing and the decompression unit B238 performs vertical decompression processing on the compressed block shown in FIG. Horizontally expanded image data 818 and 819 indicate output data of the expansion unit A237, and vertical expansion image data 820 and 821 indicate output data of the expansion unit B237.

  The selection unit 261 appropriately selects the image data input to the input unit 230, the output of the decompression unit A237, the output of the decompression unit B238, and the output of the decompression unit C239 based on information in the compression code information storage unit 234. Then, the restored image data 824 is output to the output unit 232 (FIG. 26 (f)).

  FIG. 25 is an explanatory timing diagram illustrating the processing concept of the decompression processing unit 206 when the decompression unit A237 performs horizontal decompression processing on the compressed block shown in FIG.

  The input unit 230 is a data input unit of the decompression processing unit 206. Data input to the input unit 230 includes HSYNC (FIG. 26A) and VSYNC indicating a synchronization signal of the image data, compressed image data and sub-compression code information 802 and 804 in the effective period 406, and a horizontal blanking period. 404 includes main compression code information 801 and 803. The input unit 231 receives a pixel clock of uncompressed image data after restoration, a compressed image data clock, and the like.

  The compression code information extraction unit 233 extracts the compression code information of each image data unit block sent during the horizontal blanking period and stores it in the compression code information storage unit 234.

  The storage period is shown in FIG. Since the main compression code information 801 is data corresponding to the subsequent compressed image data 802, a storage period 805 until the main compression code information 803 of the second line comes is sufficient.

  The input compressed image data is subjected to horizontal expansion processing by the expansion unit A237 to generate horizontal expanded image data 806 and 807, which are expanded image data, and output to the selection unit 261 (FIG. 25 (d)). .

  The selection unit 261 appropriately selects the image data input to the input unit 230, the output of the decompression unit A237, the output of the decompression unit B238, and the output of the decompression unit C239 based on information in the compression code information storage unit 234. Then, the restored image data 808 and 809 are output to the output unit 232 (FIG. 25 (f)).

  FIG. 22 is a block diagram illustrating an example of the configuration of the decompression processing unit 206. This example is an example of a decompression processing unit in a case where a method of transmitting sub-compression code information together with compressed image data within the effective period 406 instead of the horizontal blanking period 404 is employed.

  If the data to be sent within the valid period 406 is not only compressed image data but also compression code information, it may be necessary to reduce the compression rate of the compressed image data depending on the compression method. There is a concern that the image quality degradation of the image at the time of restoration becomes large. As a countermeasure, the horizontal blanking period is reduced to such an extent that two audio data transmission packets can be sent, and the horizontal effective period is extended. In the case where 4k2k image data is transmitted with a 297 MHz clock that is half the pixel clock 594 MHz of the uncompressed image, the horizontal effective period 1920 and the horizontal blanking period 280 are used in the first embodiment. Since it is sufficient that the horizontal blanking period is about 96 including the transmission period of two voice packets and the guard bands before and after, the remaining 184 can be increased in the horizontal effective period. There is an effect that the horizontal effective period 1920 can be expanded by about 9.5%.

  In the case of this example, the position and width of the horizontal synchronization signal deviate from the standard timing of the predetermined uncompressed image data. Therefore, the SVD (Short Video Descriptor) attached to the image data when reproducing the uncompressed image data on the receiving side. The timing should be restored so that the standard timing format is obtained with reference to the metadata.

In FIG. 22, blocks having the same functions as those in FIG. The difference is that a second video code information extraction unit 250 is added to the output unit of the error correction circuit 255.
In the example of FIG. 21, the compression code information extraction unit 233 includes compression code information (packets of FIGS. 14 and 15) within the vertical blanking period and compression code information (packets of FIGS. 16 and 17) within the horizontal blanking period. ) Was extracted. In this example, the compression code information extraction unit 233 extracts only the main compression code information transmitted in the vertical blanking period or the horizontal blanking period, and stores it in the compression code information storage unit 234.

  In this example, instead of sending compressed code information in a packet that has been subjected to error correction processing within the blanking period, error correction processing similar to that for other compressed image data is added. For this reason, the main compression code information after error correction processing of the error correction unit 255 output from the second compression code information extraction unit 250 and the sub compression code information output from the compression code information storage unit 234 are converted into an expansion unit. The data is output to A237, expansion unit B238, expansion unit C239, and selection unit 251.

  In this example, since the compressed image data and the compression code information are close in timing, storage of the compression code information over one horizontal period is unnecessary except for the compression code information common in the frame. There is an effect that can be reduced.

  FIG. 23 is a block diagram illustrating another example of the configuration of the decompression processing unit 206.

  In FIG. 23, blocks having functions similar to those in FIG. The difference is that a selection unit 260 is added in the preceding stage of each expansion unit.

  The selection unit 261 appropriately selects the image data input to the input unit 230, the output of the decompression unit A237, the output of the decompression unit B238, and the output of the decompression unit C239 based on information in the compression code information storage unit 234. Then, the data is output to the output unit 232. The selection unit 261 can further select any one of the output of the expansion unit A237, the output of the expansion unit B238, and the output of the expansion unit C239 and output the selected output to the selection unit 260. By adopting the method of this configuration, it is possible to perform decompression processing of two or more methods on the compressed image data input to the input unit 230.

  Although not shown, the output of the decompression unit A237, the output of the decompression unit B238, or the output of the decompression unit C239 may be selected and output to the compression code information storage unit 234. By adopting this configuration, for example, the decompression process of the compressed sub-compression code information 660 of FIG. 5 can be performed.

  FIG. 24 is a block diagram illustrating another example of the configuration of the decompression processing unit 206. In FIG. 24, blocks having the same functions as those in FIG. The difference is that a storage unit 270 is added after the input unit 230.

  The selection unit 271 has a function of outputting selected data to the storage unit 270 in addition to the function of the selection unit 251 illustrated in FIG. The storage unit 270 temporarily stores main compression code information, sub-compression code information, compressed image data, and decompressed data supplied from the selection unit 271 that are input from the input unit 230, and is a block that is supplied to subsequent blocks It is. With such a configuration, a plurality of stages of decompression processing can be performed on the data input to the input unit 230. In the case of only one-stage decompression processing, data supply from the selection unit 271 to the storage unit 270 may not be performed.

  By adopting this configuration, for example, it is possible to perform decompression processing on compressed image data compressed by the method shown in FIGS.

  Hereinafter, another embodiment of the image transmission device and the image reception device described in the first embodiment will be described.

  FIG. 29 is a diagram illustrating an example of input and output waveforms of the serializer 184. The serializer 184 is a clock obtained by multiplying the input image data of YCbCr luminance color difference signal (hereinafter referred to as YCbCr image data) or image data of RGB signals (hereinafter referred to as RGB image data) by 10 times. The data is serialized into three 1-bit data and output to the level conversion unit 175.

  As an example of serialization, 8-bit YCbCr luminance color difference signal or RGB signal image data is output in the order of MSB or LSB from the top with a 10-fold clock.

  The level conversion unit 185 outputs the signal converted into the standardized data transfer format via the output unit 182. An example of a standardized data transfer format is a TMDS differential level signal format. In this format, since it is not necessary to transmit image data during the image blanking period, the data to be serialized by the serializer 184 is used only for 4 bits in the clock multiplied by 10, and the remaining 6 bits are not used for transmission. It is possible to increase the strength against errors and transfer data other than image data. Further, by using two types of clocks, the same effect can be obtained by reducing the clock generated by the PLL 186 to ½ or less of the clock for transmitting image data.

  FIG. 30 is a diagram illustrating an example of a data configuration of the serializer 184. There are three outputs from the serializer 184, one of which consists of a synchronization signal (HSYNC, VSYNC), a packet header, and fixed bits. Data is transferred using the remaining two systems. The packet size is 32 cycles of the transfer clock.

  FIG. 31 is a diagram illustrating an example of a packet configuration of audio data superimposed in the horizontal blanking period. The voice packet generates 7-byte data using the same two bits for data transfer to the serializer, and an error correction code such as a parity check is attached to the data to form a subpacket. A packet of the horizontal blanking period is formed by the format of the four sub-packets and the packet header 4 bytes.

With this configuration, since the error correction code is included in the subpacket data, an error occurring in the transmission path can be corrected and the error resistance is increased. In addition, since the data for subpacket data transfer is configured in a staggered manner by two physically different channels, the other channel is not affected by errors that occur in bursts in one channel. Data errors can be corrected. The error correction rate has an improvement effect of ^{10-14 in} the horizontal blanking period as compared to ^{10-9 in the} horizontal effective period.

  The error correction code of the compressed image may be transmitted as a packet with high error tolerance. An example of the number of packets that can be transmitted will be described for a case where the number of pixels in the horizontal period is 2200 and the number of pixels in the horizontal effective period is 1920. The image format will be described by taking YCbCr 422 as an example.

  If the size of the image to be compressed is 64 pixels (luminance 32 pixels, color difference 32 pixels), the size of 60 error correction codes (2 bytes) per line needs to be 120 bytes.

  Since there is a capacity that can transfer 28 bytes per packet, there is a size that can be transferred if there are 5 packets. Since there are 280 pixels in the horizontal blanking period, 8 packets can be superimposed. With this configuration, even if a maximum of 2 packets are given to the audio packet as 192 kHz 8ch LPCM audio transmission, it is possible to transmit the above-mentioned maximum 5 error correction code packets in the horizontal period.

  When the compressed image data for the RGB image data input to the data transfer unit 115 is output to a predetermined TMDS channel in units of compressed blocks, a non-transmission period of the compressed image data occurs between the compressed blocks. When considered in line units, there is a problem that the horizontal effective period cannot be significantly reduced as compared with the case of non-compression.

  FIG. 32 is an example of an output waveform in each channel when the compressed image data for the RGB image data input to the data transfer unit 115 is output to the TMDS channel 0, the TMDS channel 1, and the TMDS channel 2.

  In the present embodiment, a case will be described in which compression processing is performed on RGB image data for each of R, G, and B components to generate R compressed image data, G compressed image data, and B compressed image data, respectively. CR0 and CR1 in the figure are compressed image data in sub-compressed blocks, respectively, and the compressed blocks are composed of CR0 and CR1. CR2 is the first sub-block of the next compressed block. CG0, CG1, CG2, CB0, CB1, and CB2 are the same as CR0, CR1, and CR2.

  In this embodiment, it is possible to reduce the non-transmission period of the compressed image data between the sub-compression block and the compression block by transmitting the R-compressed image data in the bit unit in the TMDS channel 0. .

  FIG. 35 is another example of output waveforms in each channel when the compressed image data for the RGB image data input to the data transfer unit 115 is output to the TMDS channel 0, the TMDS channel 1, and the TMDS channel 2.

  In this embodiment, if the sub-compression blocks 1300, 1301, 1302, 1305, 1306, 1309, and 1310 are not divisible by 8 bits, stuffing data 1303, 1304, 1307, 1308, and 1311 are added to the end points. The sub-compression block head bit is always positioned at the head bit of the channel. Thereby, it is possible to simplify the reception circuit of the sub-compression block on the image reception apparatus side. In this example, stuffing data is added in units of sub-compressed blocks, but may be performed in units of compressed blocks as shown in FIG.

  In the embodiment described with reference to FIGS. 32 and 35, the compressed image data corresponding to the RGB image data input to the data transfer unit 115 is output to a predetermined TMDS channel, and thus the transmission band occupied by the transmitted compressed image data. Is limited to the TMDS channel with the largest amount of data after compression, and there is a problem that the effective period becomes long.

  FIG. 33 shows R compressed image data, G compressed image data, and B compressed image data, which are components of compressed image data for RGB image data input to the data transfer unit 115, as TMDS channel 0, TMDS channel 1, and TMDS channel. 6 is another example of an output waveform in each channel when outputting to 2;

In the present embodiment, R-compressed image data, G-compressed image data, and B-compressed image data are sequentially interleaved and output to TMDS channel 0, TMDS channel 1, and TMDS channel 2 in sub-compression block units. Here, R compressed image data CR0 is 18 bits, G compressed image data CG0 is 37 bits, B compressed image data CB0 is 8 bits, R compressed image data CR1 is 20 bits, G compressed image data CG1 is 18 bits, and B compressed image data CB1 is 14 bits. In the case of the above output method, since the compressed image data for the RGB image data input to the data transfer unit 115 can be transmitted to the three TMDS channels on average, the compressed image data is The effective period for transmission can be shortened. In this example, output is performed in RGB order in units of sub-compression blocks, but may be performed in units of compression blocks as shown in FIG.

  FIG. 37 is another example of output waveforms in each channel when compressed image data for YCbCr444 image data input to the data transfer unit 115 is output to the TMDS channel 0, TMDS channel 1, and TMDS channel 2. The ratio of the data amount to each component of the image data of YCbCr444 is the same for Y image data, Cb image data, and Cr image data. Note that the ratio of the data amount to each component of the image data of YCbCr 422 is 1 for Cb image data and Cr image data for Y image data.

  1500 is image data input to the compression processing unit 114. Reference numerals 1501, 1502, and 1503 denote Y compressed image data (luminance compressed image data) and Cb compressed image data (components of compressed image data generated by compression processing on Y image data, Cb image data, and Cr image data, respectively). Cb color difference compressed image data) and Cr compressed image data (Cr color difference compressed image data).

  From the human visual characteristic that the sensitivity to the luminance (Y) component is higher than the color difference (Cb and Cr) component, the compression rate for the Y component is set higher than the compression rate for the Cb component and the Cr component, and the Y component The amount of Cb component compressed image data (hereinafter referred to as Cb compressed image data) and the amount of Cr component compressed image data (hereinafter referred to as Y compressed image data). The amount of data (referred to as Cr compressed image data) can be further reduced.

  In this embodiment, an example is shown in which compression processing is performed at a high compression rate on image data having a high transmission priority for each component of the image data.

  Specifically, the transmission priority of the Y compressed image data is set higher than the transmission priority of the Cb compressed image data and the Cr compressed image data, and the output bit width from the data transmission unit 115 is set to 12 bits in the Y compressed image data. , 6 bits are allocated to Cb compressed image data, and 6 bits are allocated to Cr compressed image data.

  When Y compressed image data 1501, Cb compressed image data 1502, and Cr compressed image data 1503 are output to TMDS channel 0 (8 bits / cycle), TMDS channel 1 (8 bits / cycle), and TMDS channel 2 (8 bits / cycle), respectively. The transmission band occupied by the compressed image data to be transmitted is limited to the TMDS channel 0 having the largest amount of data after compression, and the effective period becomes long.

  1505, 1506, 1507, 1508, 1511 allocated more channels (12 bits / cycle) to Y compressed image data than Cb compressed image data (6 bits / cycle) and Cr compressed image data (6 bits / cycle) It is an example of output data in the case. By using the above output method, the effective period for transmitting the compressed image data can be shortened.

  The assignment of the output bit width is instructed from the control unit 110 to the data transmission unit 115. Alternatively, the data transmission unit 115 may allocate at a predetermined distribution ratio according to an image format (for example, YCbCr444) instructed from the control unit. The distribution ratio may be set from the control unit 115.

  In this embodiment, the case where the image data is YCbCr444 has been described as an example. However, in other image signals such as RGB signals, a transmission priority is given to each compressed image data to output transmission paths (for example, TMDS channel 0, 1, 2) may be assigned an output bit width. For example, when the image data is an RGB signal, there is a method of setting the transmission priority for the G component higher than the transmission priority for the R component and the B component. Specifically, there is a method in which 12 bits are assigned as the output bit width for the G component and 6 bits are assigned as the output bit widths for the R component and the B component.

  As another example of the transmission priority when the image data is YCbCr444, there is a method of assigning a higher transmission priority to the 4: 2: 2 component than the remaining color difference components. Specifically, there is a method in which 20 bits are assigned as the output bit width for 4: 2: 2, and 4 bits are assigned to the remaining Cb component and Cr component.

FIG. 38 shows the Y-compressed image data 1601, Cb-compressed image data 1602, and Cr-compressed image data 1603 input to the data transfer unit 115 in each channel when output to the TMDS channel 0, TMDS channel 1, and TMDS channel 2. It is another example of an output waveform. Note that 1600 is image data input to the compression processing unit 114. In this embodiment, bit 4, bit 5, bit 6, bit 7 of TMDS channel 0 and bit 0, bit 1, bit 6, bit 7 of TMDS channel 1 Consider a case where the transmission error rate is lower than that of bits.

  Reference numerals 1604, 1605, 1606, 1607, 1608, and 1609 are examples of output data when Y compressed image data is allocated to bits with a low transmission error rate of the TMDS channel. With the output method described above, it is possible to reduce the error occurrence rate for Y-compressed image data.

  In this embodiment, Cb compressed image data is assigned to 1602, 1605 and 1607, and Cr compressed image data is assigned to 1603 and 1609.

  Information on the transmission error rate is supplied from the control unit 110 to the data transmission unit 115. Alternatively, based on the transmission error rate, the control unit may specify bit allocation of the Y compressed image data, Cb compressed image data, and Cr compressed image data to the TMDS channel. In this embodiment, the YCbCr luminance color difference signal has been described as an example. However, in other image formats such as RGB signals, priority may be given to each compressed image data to assign bits to the TMDS channel.

  The transmission priority of each component may be a compression rate for each component. In this case, the output bit width to be assigned is increased for components with a high compression rate, and the output bit width to be assigned is reduced for components with a low compression rate. As an example, when the compression rate for each component (Y, Cb, Cr) of YCbCr444 is 80%, 40%, 40%, the transmission priority is set to 2, 1, 1, respectively, or each component ( There is a method in which the output bit width of Y, Cb, Cr) is set to 12 bits, 6 bits, and 6 bits, respectively.

  According to the present embodiment described above, image data having a size larger than the currently specified image size is transmitted to the currently specified transmission path by compressing and transmitting the image data transmitted by the image transmission apparatus. Furthermore, by transmitting the main compression code information, which is a part of the compression code information, to a region where the error resistance is higher than the transmission region of the image data, a compressed image with high error resistance can be transmitted. Transmission can be performed.

  In addition, when transmitting image data of the image size currently specified, the data transmission amount per predetermined time or the data transmission clock can be lowered, so that the frequency of occurrence of errors can be lowered, and A highly reliable system can be constructed against errors in the transmission path.

  In addition, even when an error occurs in the transmission path and complete error correction cannot be performed, a system that performs error processing in which image quality deterioration due to an error is not noticeable can be realized.

DESCRIPTION OF SYMBOLS 100 Image transmission apparatus 101 Input part 102 Input part 103 Input part 104 Input part 105 Tuner reception process part 106 Network reception process part 107 Recording media control part 108 Recording medium 109 User IF part 110 Control part 111 Stream control part 112 Decoder part 113 Display Processing unit 114 Compression processing unit 115 Data transfer unit 116 Output unit 191 Data bus 192 Data bus 193 Data bus 200 Image receiving device 201 Input unit 202 Input unit 203 User IF unit 204 Control unit 205 Data reception processing unit 206 Decompression processing unit 207 Display Processing unit 208 Display unit 300 Cable

Claims (11)

An image transmission device for transmitting image data,
A compression processing unit for compressing image data composed of a plurality of components;
A data transfer unit for outputting the compressed image data,
The image transfer apparatus, wherein the data transfer unit changes an output method of the image data based on each component of the image data. In an image transmission device for compressing and transmitting image data,
A compression processing unit that compresses image data composed of a plurality of primary color components or image data composed of a luminance component and a color component, and generates compressed image data and compression code information related to the compression processing;
A data transfer unit that outputs the compressed image data and the compression code information;
The data transfer unit has at least the output bit width and the output bit allocation according to the transmission priority assigned to each component of the image data, the ratio of the compression rate of each component of the image data, or the transmission error rate of the transmission path. An image transmission apparatus characterized by changing any one of the outputs. The image transmission apparatus according to claim 2,
The output bit width assigned to the component having the first priority or the component having the first compression rate is higher than the component having the second priority lower than the first priority or the first compression rate. An image transmission apparatus having an output bit width larger than an output bit width allocated to a component having a lower second compression ratio. The image transmission apparatus according to claim 2,
The transmission error rate of the output bits assigned to the component having the first priority or the component having the first compression rate is the component having the second priority lower than the first priority or the first An image transmission apparatus having a transmission error rate lower than an output bit allocated to a component having a second compression rate lower than the compression rate. In the image transmission device according to claim 3 or 4,
When the image data is image data composed of a luminance component and a color component, an image transmission device having a transmission priority higher than that of the color component assigned to the luminance component. In the image transmission device according to claim 3 or 4,
When the image data is an RGB color difference signal, an image transmission apparatus that assigns a higher transmission priority to the G component than the R component and the B component. In the image transmission device according to claim 3 or 4,
When the image data is a 4: 4: 4 format YCbCr luminance color difference signal, an image transmission apparatus is characterized by assigning a higher transmission priority to the 4: 2: 2 component than the remaining color difference components. The image transmission apparatus according to claim 2,
The transmission error rate of the transmission path of the compressed image data having the first priority is smaller than the transmission error rate of the transmission path of the compressed image data having the second priority lower than the first priority. An image transmission device. In an image transmission device for compressing and transmitting image data,
A compression processing unit that compresses image data composed of a plurality of primary color components or image data composed of a luminance component and a color component, and generates compressed image data and compression code information related to the compression processing;
A data transfer unit that outputs the compressed image data and the compressed code information;
The image transfer apparatus, wherein the data transfer unit interleaves and outputs each component of the compressed image data or each component of the compressed image data. An image transmission method for transmitting image data from an image transmission apparatus,
Compressing image data composed of a plurality of components;
Outputting the compressed image data, and
An image transmission method, wherein an output method of the image data is changed based on each component of the image data. In an image transmission method for transmitting image data from an image transmission apparatus,
Compressing image data consisting of a plurality of primary color components or image data consisting of luminance components and color components to generate compressed image data and compression code information relating to the compression processing;
Outputting the compressed image data and the compression code information,
Depending on the transmission priority assigned to each component of the image data, the ratio of the compression rate of each component of the image data, or the transmission error rate of the transmission path, at least one of the output bit width and the output bit allocation is changed. An image transmission method comprising: outputting the image.

Images