Classifications

• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
  • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
  • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
  • G09G3/36—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
  • G09G3/3611—Control of matrices with row and column drivers
  • G09G3/3648—Control of matrices with row and column drivers using an active matrix
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2320/00—Control of display operating conditions
  • G09G2320/02—Improving the quality of display appearance
  • G09G2320/0252—Improving the response speed
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2320/00—Control of display operating conditions
  • G09G2320/02—Improving the quality of display appearance
  • G09G2320/0285—Improving the quality of display appearance using tables for spatial correction of display data
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2320/00—Control of display operating conditions
  • G09G2320/06—Adjustment of display parameters
  • G09G2320/0613—The adjustment depending on the type of the information to be displayed
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2320/00—Control of display operating conditions
  • G09G2320/10—Special adaptations of display systems for operation with variable images
  • G09G2320/106—Determination of movement vectors or equivalent parameters within the image
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2340/00—Aspects of display data processing
  • G09G2340/16—Determination of a pixel data signal depending on the signal applied in the previous frame

Definitions

• the present disclosure generally relates to response time compensation for a display, and more particularly, to a method and apparatus for compressing information used for response time compensation of display elements.
• a Liquid Crystal Display displays images using optical variations caused by injecting and arranging liquid crystal display elements between two glass plates and then applying a voltage to change the arrangement of the liquid crystal display elements.
• a current image can overlap a previous image due to a slow response time causing blurring.
• one frame typically has a duration of approximately 16.7 ms when display refresh is 60 Hz.
• a voltage is applied to both ends of a liquid crystal material, a physical torque is generated which begins to re-orient the liquid crystal material. The more torque (voltage) the quicker the liquid crystal material responds and the further it moves.
• the materials response and hence color changing accuracy
• Slow pixel response causes the visual effect of blurring.
• response time compensation such as dual frame overdrive or multiple frame overdrive can be used.
• dual frame overdrive a difference between a pixel value of a previous frame for an arbitrary pixel and a pixel value of a current frame for the pixel is obtained, and a sum of a value proportional to the difference and the pixel value of the current frame is generated. These values can then be used as indices to a LUT (with or without interpolation) to derive the most optimal logic driving value.
• Multiple frame overdrive operates in a similar manner as dual frame overdrive, but two consecutive previous frames are used rather than a single previous frame. In order to use either overdrive technique, the pixel values of previous frames must be stored in memory.
• Figure 1 is an exemplary functional block diagram of a device that includes a response time compensation and compression system
• Figure 2 is a flowchart depicting exemplary steps that can be taken by the response time compensation and compression system
• Figure 3 is a flowchart depicting exemplary steps that can be taken by the response time compensation and compression system using display mode information;
• Figure 4 is an exemplary functional block diagram of a compression module of the response time compensation and compression system;
• Figure 5 is a flowchart depicting exemplary steps that can be taken by an intra motion prediction module of the response time compensation and compression system
• Figure 6 is an exemplary functional block diagram of a quantization factor generation module of the response time compensation and compression system
• Figure 7 is a flowchart depicting exemplary steps that can be taken by the quantization factor generation module
• Figure 8 is an exemplary functional block diagram of a decompression module of the response time compensation and compression system
• Figure 9 is a flowchart depicting exemplary steps that can be taken by the decompression module
• Figure 10 is a flowchart depicting additional exemplary steps that can be taken by the response time compensation and compression system.
• an apparatus for a response time compensation system includes a plurality of complexity modules and a motion vector module.
• the complexity modules determine a plurality of complexity values based on current image information and prior image information.
• the motion vector module determines a desired complexity value based on a lowest of complexity values.
• the motion vector determines a desired motion vector based on the lowest of the plurality of complexity values.
• the desired complexity value and the desired motion vector are used to compress the current image information into a compressed bitstream.
• the compressed bitstream is used by the response time compensation system to provide display element response time compensation information for a display.
• a related method is also disclosed.
• the method and apparatus provide, among other advantages, previous frames of image information that are compressed which minimizes information stored in memory when using response time compensation to improve performance of a display.
• power consumption is minimized selectively powering down and/or bypassing the compression module, decompression module, and/or the display element response time compensation module when the modules are not needed due to the display mode of the display.
• at least one of the complexity values is based on a mean absolute difference of a plurality of blocks of the image information and at least one of the plurality of complexity values is based on a mean absolute difference of a plurality of blocks of the prior image information.
• the intra motion prediction apparatus includes a motion prediction shifting module.
• the motion prediction shifting module provides the prior image information by time and spatially shifting the current image information.
• an integrated circuit includes the intra motion prediction apparatus.
• a device includes a display and the intra motion prediction apparatus.
• an apparatus includes a control module and an activity module.
• the control module provides error control information based on a target number of bits and an actual number of bits required to pack at least one compressed block of image information.
• the activity module provides a quantization factor based on the error control information and a complexity value of the at least one compressed block of image information. The quantization factor is used to pack the at least one compressed block of image information into a bitstream comprising the target number of bits.
• the apparatus and method provide, among other advantages, a quantization factor used to pack image information into a compressed bitstream, which minimizes information stored in memory when using response time compensation to improve performance of a display.
• a quantization factor used to pack image information into a compressed bitstream, which minimizes information stored in memory when using response time compensation to improve performance of a display.
• control module is a proportional-integral-derivative control module.
• activity module is operative to provide the quantization factor by accessing a predetermined lookup table.
• predetermined lookup table includes the complexity value, an error value based on the error control information, and the quantization factor.
• error control information is based on a difference between the target number of bits and the actual number of bits required to pack at least one compressed block of image information.
• an apparatus includes a compression module, a decompression module, a display element response time compensation module, and a bypass control module.
• the compression module compresses a current frame to produce a compressed previous frame of image information.
• the decompression module decompresses the compressed previous frame of image information to produce a decompressed previous frame of image information.
• the display element response time compensation module provides display compensation information for a display based on the current frame and the decompressed previous frame.
• the bypass control module causes the current frame information to selectively bypass the compression module, the decompression module, and/or the display element response time compensation module based on display mode information.
• a related method is also disclosed.
• the apparatus and method provide, among other advantages, previous frames of image information that are compressed which minimizes information stored in memory when using response time compensation to improve performance of a display.
• power consumption is minimized selectively powering down and/or bypassing the compression module, decompression module, and/or the display element response time compensation module when the modules are not needed due to the display mode of the display.
• the display mode information includes a dynamic image mode, a still image mode, a lost input information mode, and/or a low power mode.
• the display element response time compensation module outputs the decompressed previous frame when the display mode information indicates the lost input information mode.
• bypass control module selectively powers down the compression module, the decompression module, and/or the display element response time compensation module based on the display mode information.
• the display image response time compensation includes a first multiplexer that communicates the current image to the display element response time compensation module or an output module, which is operatively coupled to the display, in response to bypass control information received from the bypass control module.
• the bypass control information is based on the display mode information.
• the image response time compensation includes a second multiplexer that communicates the current frame to the compression module in response to bypass control information received from the bypass control module
• a device includes a display and the display image response time compensation system.
• the compression module includes a quantization factor module, a transform quantization module, and an entropy module.
• the quantization factor provides a quantization factor based on a complexity value of spatial domain image information.
• the transform quantization transforms the spatial domain image into quantized frequency domain image information based on the quantization factor.
• the entropy module variable length encodes the quantized frequency domain information to produce compressed image information.
• the display element response time compensation module provides display element response time compensation information based on the compressed image information.
• the compression module includes an intra prediction module.
• the decompression module includes an inverse entropy module and an inverse transform quantization module.
• the inverse entropy module produces decompressed image information by variable length decode the compressed image information.
• the inverse transform quantization module provides decompressed spatial image information by transforming the decompressed image information.
• the display element response time compensation module that is operative to provide display element response time compensation information based on the decompressed spatial image information.
• the decompression module includes an intra compensation module.
• module can include an electronic circuit, one or more processors (e.g., shared, dedicated, or group of processors such as but not limited to microprocessors, DSPs, or central processing units), and memory that execute one or more software or firmware programs, combinational logic circuits, an ASIC, an integrated circuit, and/or other suitable components that provide the described functionality. Additionally, as will be appreciated by those of ordinary skill in the art, the operation, design, and organization, of a “module” can be described in a hardware description language such as Verilog, VHDL, or other suitable hardware description languages. Unless otherwise stated, the term “power down” refers to removing (or lowering) the source power of a “module” rendering it inoperative. In addition, the term “power up” refers to adding (or increasing) the source power of a “module” rendering it operative.
• processors e.g., shared, dedicated, or group of processors such as but not limited to microprocessors, DSPs, or central processing units
• memory execute one or more
• FIG. 1 an exemplary functional block diagram of a device 100 such as a liquid crystal display (LCD) television, an LCD monitor, an LCD panel, a mobile phone, a printer, a personal digital assistant, and/or other suitable device having a liquid crystal display 102.
• the device 100 includes a response time compensation and compression system 104 and the display 102.
• the response time compensation and compression system 104 includes an input module 106, a bypass control module 108, a color adjustment module 110, a first color conversion module 112, a second color conversion module 114, a compression module 116, a decompression module 118, a display element response time compensation (RTC) module 120, memory 122, and an output module 124.
• RTC display element response time compensation
• the input module 114 receives image information 126 that includes at least one color component such as red, green, and/or blue (RGB).
• the input module 114 sends image information 128 to the color adjustment module 110, which corrects color content (e.g., gamma, white balance), and a first multiplexer 130, which serves as a bypass.
• the color adjustment module 110 performs color correction on the image information 128 as known in the art and provides adjusted color information 132 to the multiplexer 130.
• the multiplexer 130 provides combined color information 134 to the color conversion module 112 based on the image information 128 and/or the adjusted color information 132.
• the color conversion module 112 converts the combined color information 134 from RGB information into YCrCb information 136 using a YCrCb transform as known in the art. When transforming to the YCrCb information 136 the color conversion module 112 maintains sufficient color depth information to ensure that an accurate reverse conversion can be achieved by the color conversion module 114.
• the compression module 116 compresses a current frame of the YCrCb information 136 to provide compressed information 138, which is stored in memory as a previous frame 140 and a prior previous frame 142 (e.g., the frame prior to the previous frame 140).
• the compression module 116 uses intra prediction combined with frequency domain quantization and a variable length compression method to provide the compressed information 138.
• the number of frames of storage can be predetermined based on requirements of the display element RTC module 120.
• the compression module 116 determines a complexity value of the YCrCb information 136 based on a mean absolute difference of blocks of the YCrCb information 136.
• the compression module 116 also determines previously processed image information for subsequent use by the compression module 116 based on the mean absolute difference of blocks of the YCrCb information 136.
• the compression module 116 transforms the YCrCb information 136 from spatial domain information to frequency domain information.
• the compression module 116 determines a block quantization factor (QF) based on the complexity value of a selected block of image information, QF table information 144 from a QF table 146, and a difference between a target number of bits 147, which can be predetermined, allocated to pack the compressed information 138 into a bitstream and an actual number of bits used to pack the compressed information into the bitstream. Furthermore, the compression module 116 uses the QF table information 144 to quantize the frequency domain information and then uses entropy information 148 from an entropy table 150 to variable length encode the quantized frequency domain information.
• QF block quantization factor
• the decompression module 118 receives prior compressed information 152 from memory 122.
• the prior compressed information 152 can be based on the previous frame 140 (n-1) when using dual frame overdrive or can be based on the previous frame 140 (n-1) and the prior previous frame 142 (n-2) when using multiple frame overdrive.
• the decompression module 118 decompresses the prior compressed information 152 based on entropy information 154 from the entropy table 150 and the quantization factor to provide decompressed prior image information 156 to the second color conversion module 114.
• the second color conversion module 114 converts the decompressed prior image information 156 from YCrCb information to prior image RGB information 158 using an inverse YCrCb transform as known in the art.
• the display element RTC module 120 performs any known response time compensation method such as dual frame overdrive, multiple frame overdrive, and/or any other suitable response time compensation method.
• the display element RTC module 120 provides display element RTC information 160 based on the prior image RGB information 158 and a current frame of combined color information 134 that is based on either the adjusted color information 132 or the image information 128.
• the display element RTC module 120 determines a difference between a pixel value of the previous frame 140 (n-1) and an arbitrary pixel of a current frame of the combined color information 134. A sum of a value proportional to the difference and the pixel value of the current frame is output as the display element RTC information 160. These values are typically used as inputs to a lookup table to determine the correct display driving level.
• the display element RTC module 120 uses both the previous frame 140 (n-1) and the prior previous frame 142 (n-2) to provide the display element RTC information 160.
• a second multiplexer 162 provides display element information 164 based on the combined color information 134, the prior image RGB information 158, or the display element RTC information 160.
• the output module 124 receives the display element information 164 and provides display information 166 to the display 102.
• the display 102 displays an image 168 based on the display information 166 as known in the art.
• the bypass control module 108 selectively controls multiplexers 130, 162 based on a change in display mode information 168, 170 via bypass control information 172, 174, 176 to cause image information 128 to bypass the color adjustment module 110 and/or the color conversion module 112, the second color conversion module 114, the compression module 116, the decompression module 118, the display element RTC module 120, and memory 122.
• the bypass control information 172, 174, 176 can also be used to selectively power down the color conversion module 112, the compression module 116, the decompression module 118, the second color conversion module 114, and/or the display element RTC module 120 when the respective modules 112, 114, 116, 118, 120 are bypassed.
• the display mode information 168 is based on the image information 126.
• the display mode information 170 can be received from a low power mode driver (not shown) executed by a processor (not shown) of the device 100.
• the display mode information 168, 170 can include various operating modes of the device 100 such as a dynamic image mode (e.g., the image information 126 is a moving image such as video image), a still image mode (e.g., the image information 126 is a static image such as a photograph), a lost input information mode (e.g., the image information 126 does not contain valid image information), a low power mode (e.g., the low power driver has the device 100 operating in a low power mode), and/or any other suitable operating mode of the device 100.
• a dynamic image mode e.g., the image information 126 is a moving image such as video image
• a still image mode e.g., the image information 126 is a static image such as a photograph
• a lost input information mode e.g., the image information 126 does not contain valid image information
• a low power mode e.g., the low power driver has the device 100 operating in a low power mode
• the bypass control module 108 controls the multiplexer 162 so that the display element information 164 is based solely on the prior image RGB information 158 rather than both the prior image RGB information 158 and the current frame of combined color information 134.
• the bypass control module 108 controls the multiplexer 162 so that the display element information 164 is based on the combined color information 134 (e.g., the still image) and not the prior image RGB information 158.
• the bypass control module 108 can reduce power consumption of the response time compensation and compression system 104 by selectively powering down and/or bypassing the compression module 116, decompression module 118, and/or the display element RTC module 120 when the modules are not needed due to the change in display mode conditions. Additional power savings may also be realized by upstream components (not shown) that no longer need to refresh the display 102 via the input module 106.
• exemplary steps that can be taken by the response time compensation and compression system 104 to provide the display element RTC information 160 are generally identified at 200.
• the process starts in step 202 when the compression module 116 receives the YCrCb information 136.
• the compression module 116 determines a quantization factor based on a complexity value which is based on a mean absolute difference of the spatial domain YCrCb information 136.
• the compression module 116 transforms the spatial domain YCrCb information 136 info quantized frequency domain information based on the quantization factor.
• the compression module 116 variable length encodes the quantized frequency information to produce the compressed information 138.
• the display element RTC module 120 generates the display element RTC information 160 based on the prior image RGB information 158, which is based on the compressed image information 138.
• the process ends in step 212.
• exemplary steps that can be taken by the response time compensation and compression system 104 using the display mode information 168, 170 are generally identified at 300.
• the process starts in step 302.
• the bypass control module 108 determines which mode the display 102 is operating in based on the display mode information 168, 170. If the display mode information 168, 170 indicates the dynamic image mode (e.g., video) in step 304, the bypass control module 108 controls the multiplexers 130, 162 so that the display element RTC module 120 provides the display element RTC information 160 based on both the prior image RGB information 158 and the combined color information 134 in step 308 and the process ends in step 310.
• the display mode information 168, 170 indicates the dynamic image mode (e.g., video) in step 304
• the bypass control module 108 controls the multiplexers 130, 162 so that the display element RTC module 120 provides the display element RTC information 160 based on both the prior image RGB information 158 and the combined color information 134 in step 308 and the process ends in
• bypass control module 108 determines whether the display mode information 168, 170 indicates the still image mode in step 312. If the display 102 is operating in the still image mode, the bypass control module 108 controls the multiplexers 130, 162 so that the display element RTC module 120 is bypassed and the display element information 164 is based on the current frame of combined color information 134 in step 314 and the process proceeds to step 308.
• bypass control module 108 determines whether the display is operating in the lost input information mode or the low power mode in step 316. If the display 102 is operating in either the lost input information mode or the low power mode, the bypass control module 108 controls the multiplexers 130, 162 so that the output module 124 is provided with the prior image RGB information 158, which is based on the decompressed prior image information 156, in step 318 and the process proceeds to step 308.
• the compression module 116 includes an intra motion prediction module 400, a quantization factor generation module 402, a transform quantization module 404, an inverse transform quantization module 439, a motion prediction module 408, an entropy module 410, and a packing module 412.
• the intra motion prediction module 400 determines desired (i.e., optimal) motion vector information 414 based on the current YCrCb information 136 and prior image information 416.
• the intra motion prediction module 400 provides a complexity value 418 of the image information 136 or the prior image information 416.
• the intra motion prediction module 400 includes a plurality of complexity modules 420 and a motion vector module 422. In some embodiments there are a total of 28 complexity modules 420 although more or less complexity modules 420 can be used.
• the motion vector module 422 provides the complexity value 418 based on the image information 136 and/or the prior image information 416, which ever produces the lowest complexity value.
• the complexity modules 420 sum a mean absolute difference between each block of the image information 136 (or prior image information 424) to determine a plurality of complexity values 426.
• the motion vector module 422 provides the desired (i.e., optimal) motion vector information 414 by selecting a prior motion vector corresponding to prior image information 416 having a lowest of the plurality of complexity values 426.
• the motion vector module 422 provides processed image information 428 that includes the current YCrCb information 136 and the prior image difference information 424.
• the quantization factor generation module 402 determines quantization factor information 430 based on the target number of bits 147, a number of bits used 432 to pack the compressed information 138 into a bitstream, the complexity value 418, and QF table information 144 from the QF table 146.
• the transform quantization module 404 provides quantized frequency domain information 432 based on the processed image information 428 and the quantization factor information 430. More specifically, a transform module 433 receives the processed image information 428, which is in the spatial domain, and transforms the processed image information 428 into frequency domain image information 434.
• the transform module 433 transforms the processed image information 428 into frequency domain image information 434 using any suitable transform such as, for example, a discrete cosine transform, an integer transform or any other suitable transform known in the art.
• a quantization module 436 provides the quantized frequency domain information 432 based on the quantization factor information 430 and the frequency domain image information 434.
• the entropy module 410 variable length encodes the quantized frequency domain information 432 into variable length encoded information 438 using the entropy information 144 from the entropy table 150.
• entropy encoding is a data compression scheme that assigns codes to symbols so as to match code lengths with the probabilities of the symbols.
• the entropy module 410 uses the entropy table 150, which includes predetermined symbol and code values determined using Huffman coding as known in the art. Although Huffman coding is used in this example, other known entropy coding methods can be used such as, for example, arithmetic coding.
• the packing module 412 receives the variable length encoded information 438 and packs the variable length encoded information 438, the motion vector information 414, and the quantization factor information 430 into a bitstream of compressed image information 138. In some embodiments, the motion vector information 414 and the quantization factor information 430 can also be entropy encoded prior to being packed into the bitstream of compressed image information 138.
• the packing module 412 provides the number of bits used 432 to pack the compressed information 138 into the bitstream.
• the quantization factor generation module 402 uses the number of bits used 432 to pack the compressed information 138 into the bitstream to determine the quantization factor information 430.
• the inverse transform quantization module 406 provides unquantized spatial domain image information 440 based on the quantized frequency domain information 432. More specifically, an inverse quantization module 439 provides unquantized frequency domain information 442 based on the quantized frequency domain information 432 and the quantization factor information 430. An inverse transform module 444 receives the unquantized frequency domain information 442 and transforms the unquantized frequency domain information 442 into the unquantized spatial domain image information 440. The inverse transform module 444 uses an inverse transform of the transform used by the transform module 433 such as, for example, an inverse discrete cosine transform or integer transform as known in the art.
• the motion prediction module 408 provides the prior image information 416 based on the unquantized spatial domain image information 440. More specifically, the motion prediction module 408 provides the prior image information 416 by shifting prior unquantized spatial domain image information 440 in order to provide "time and spatially shifted" image information based on previous image information 136. [0064]
• the motion prediction module 408 includes a motion prediction shifting module 450, a shifting selection module 452, and a summation module 454.
• the summation module 454 provides compensated image information 458 based on a sum of unquantized spatial domain image information 440 and previously processed image information 456 that is "time and spatially shifted.”
• the motion prediction shifting module 450 provides the prior image information 416 based on the unquantized spatial domain image information 440 and previously processed image information 456.
• the shift selection module 452 provides the previously processed image information 456 based on time and spatially shifted image information 458.
• exemplary steps that can be taken by the intra motion prediction module 400 when determining the motion vector 414 and the complexity value 418 are generally identified at 500.
• the process starts in step 502 when the complexity module 420 receives the current YCrCb image information 136.
• the plurality of complexity modules 420 determine the plurality of complexity values 426 based on the current YCrCb information 136 and the prior image information 416.
• the motion vector module 422 determines the desired complexity value 418 based on a lowest of the plurality of complexity values 426.
• the motion vector module determines the desired (i.e., optimal) motion vector based on a lowest of the plurality of complexity values 426.
• the desired complexity value 418 and the desired motion vector 414 are used by the response time compensation and compression system 104 to compress the current YCrCb image information 136 into the compressed bitstream of compressed information 138, which is used to provide display element RTC information 160 for the display 102.
• the process ends in step 510.
• the quantization factor generation module 402 includes a control module 600 and an activity module 602.
• the control module 600 is a proportional-integral-derivative (PID) controller that is responsive to previous error control information as is commonly known in the art.
• PID proportional-integral-derivative
• Other controllers are contemplated such as, for example, a PI controller, a PD controller, or other suitable controllers.
• the control module 600 provides error control information 604 based on the target number of bits 147 and the number of bits used 432 to pack the compressed information 138 into a bitstream.
• control module 600 provides the error control information 604 based on a difference 606 between the target number of bits 147 and the number of bits used 432 to pack the compressed information 138 into a bitstream. Although depicted externally, the control module 600 can include a difference module 608 to determine the difference 606.
• the activity module 602 provides the quantization factor information 430 based on the error control information 604 and the complexity value 418. More specifically, the activity module 602 accesses the QF table 146 using QF table query information 610 that includes the error control information 604 and the complexity value 418, and retrieves the QF table information 144 based on the error control information 604 and the complexity value 418.
• the QF table 146 can be a predetermined lookup table that includes empirically determined quantization factors based on the error control information 604 and the complexity value 418.
• the QF table 146 can return the quantization factor information 430 via indexed values based on the complexity value 418 and the error control information 604.
• the activity module 602 can interpolate a quantization factor when the values in the QF table do not match up one for one.
• step 702. the control module 600 provides the error control information 604 based on the target number of bits 147 and the number of bits used 432 to pack the compressed information 138 into a bitstream.
• step 706 the activity module 602 provides the quantization factor information 430 based on the error control information 604 and the complexity value 418.
• the activity module 602 accesses the QF table 146 to obtain QF table information 144 that is based on the error control information 604 and the complexity value 418 in order to determine the quantization factor information 430.
• step 708 the control module 600 provides the error control information 604 based on the target number of bits 147 and the number of bits used 432 to pack the compressed information 138 into a bitstream.
• step 706 the activity module 602 provides the quantization factor information 430 based on the error control information 604 and the complexity value 418.
• the activity module 602 accesses the QF table 146 to obtain QF table information 144 that is based on the error control information 604 and the complexity value 418
• FIG. 8 an exemplary functional block diagram of the decompression module 118 is depicted.
• the decompression module 118 essentially performs the inverse operation of the compression module 116. However, the decompression module 118 does not need determine a quantization factor since the compression module 116 provides the decompression module 118 with the quantization factor information 430 via the prior compressed information 152.
• the decompression module 118 includes an unpacking module 800, an inverse entropy module 802, an inverse transform quantization module 804, and a motion compensation module 806.
• the unpacking module 800 receives a bitstream of the prior compressed information 152 from memory 122 and unpacks the bitstream to provide unpacked prior compressed information 810.
• the unpacking module 800 unpacks the motion vector information 414 and the quantization factor information 430 from the prior compressed information 152.
• the inverse entropy module 802 variable length decodes the unpacked compressed image information 810 based on entropy information 151 from the entropy table 150 to provide decoded quantized image information 812.
• the inverse entropy module 802 essentially performs the inverse operation of the entropy module 410 to variable length decode the unpacked compressed image information 810.
• the inverse transform quantization module 804 provides unquantized spatial domain image information 814 based on the decoded quantized image information 812. More specifically, an inverse quantization module 816 provides unquantized frequency domain information 818 based on the decoded quantized image information 812, which is in the frequency domain, and the quantization factor information 430. An inverse transform module 820 receives the unquantized frequency domain information 818 and transforms the unquantized frequency domain information 818 into the unquantized spatial domain image information 814. The inverse transform module 820 uses an inverse transform of the transform used by the transform module 433 such as, for example, an inverse discrete cosine transform or integer transform as known in the art.
• the motion compensation module 806 includes a motion compensation module 822, a shift selection module 824, and a summation module 826.
• the summation module 826 provides the image information 156 based on a sum of the unquantized spatial domain image information 814 and previously processed image information 828 that is "time and spatially shifted.”
• the motion compensation module 822 provides time and spatially shifted image information 830 based on the unquantized spatial domain image information 814 and previously processed image information 828.
• the shift selection module 824 provides the previously processed image information 828 based on the time and spatially shifted image information 830 and the motion vector information 414.
• step 902. the unpacking module 800 unpacks the compressed information 152 to provide the motion vector information 414, the quantization factor information 430, and the unpacked compressed image information 810.
• the inverse entropy module 802 variable length decodes the unpacked compressed image information 810 based on the entropy information 154 from the entropy table 150 to provide the decoded quantized image information 812.
• the inverse transform quantization module 804 transforms the decoded quantized image information 812 into the unquantized spatial domain image information 814 based on the quantization factor 430.
• the motion compensation module 806 adds the previously processed image information 828 to the previously processed image information 828 based on the motion vector 414 to provide the image information 156 for the color conversion module 114.
• exemplary steps that can be taken by the response time compensation and compression system 104 are generally identified at 1000.
• the process start in step 1002 when the input module 102 receives the RGB image information 126.
• the color conversion module 112 converts the color information 134, which is based on the RGB information 126, into YCrCb information 136 using a YCrCb transform as known in the art.
• the motion vector module 422 determines the optimal motion vector 414 based on the plurality of complexity values 426 that are based on the YCrCb information 136 and the prior image information 416.
• the quantization factor generation module 402 determines the quantization factor information 430 based on the complexity value 418 (e.g., the lowest of the plurality of complexity values 426), the target bits 147, and the number of bits used 432 to pack the compressed information 138 into a bitstream.
• the transform quantization module 404 transforms the processed image information 428, which is in the spatial domain, into quantized frequency domain information 432 based on the quantized factor information 430.
• the entropy module 410 variable length encodes the quantized frequency domain information 432 based on the entropy information 148 to provide the variable length encoded information 438.
• the packing module 412 packs the variable length encoded information 438, the quantization factor information 430, and the motion vector information 414 into a bitstream of compressed image information 138.
• the quantization factor information 430, and the motion vector information 414 can also be variable length encoded using the entropy information 148 prior to being packed into the bitstream of compressed image information 138.
• the compressed image information 138 is stored in memory 122 as the previous frame 140 (n-1) and/or the prior previous frame 142 (n-2).
• the unpacking module 800 of the decompression module 118 unpacks the motion vector information 414, the quantization factor information 430, and the compressed image information 810 from the prior compressed information 152.
• step 1018 the inverse entropy module 802 variable length decodes the compressed image information 810 based on the entropy information 154 to provide the decoded quantized image information 812.
• step 1020 the inverse transform quantization module 804 transforms the decoded quantized image information 812 into the unquantized spatial domain image information 814.
• the motion compensation module 806 determines previously processed image information 828 based on the motion vector information 414 and the unquantized spatial domain image information 814.
• the color conversion module 114 converts the decompressed prior image information 156, which is the sum of the previously processed image information 828 and the unquantized spatial domain image information 814, into the prior image RGB information 158 using an inverse YCrCb transform.
• the display element RTC module 120 determines the display element RTC information 160 based on the prior image RGB information 158 and the current image information 134. The process ends in step 1028.
• previous frames of image information are compressed which minimizes information stored in memory when using response time compensation to improve performance of a display.
• power consumption is minimized selectively powering down and/or bypassing the compression module, decompression module, and/or the display element response time compensation module when the modules are not needed due to the display mode of the display.
• the quantization factor generation module and method provide a quantization factor used to pack image information into a compressed bitstream, which minimizes information stored in memory when using response time compensation to improve performance of a display.
• the system can maintain a static display image while upstream components are powered down.

Landscapes

• Engineering & Computer Science (AREA)
• Chemical & Material Sciences (AREA)
• Crystallography & Structural Chemistry (AREA)
• Physics & Mathematics (AREA)
• Computer Hardware Design (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Compression Or Coding Systems Of Tv Signals (AREA)
• Digital Computer Display Output (AREA)
• Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Priority Applications (3)

Applications Claiming Priority (6)

Publications (2)

Family

ID=40510713

Family Applications (1)

Country Status (4)

Cited By (1)

Families Citing this family (3)

Citations (10)

Family Cites Families (4)

• 2008
  • 2008-09-26 WO PCT/CA2008/001715 patent/WO2009039658A1/en active Application Filing
  • 2008-09-26 CN CN200880108353.6A patent/CN102934156B/zh not_active Expired - Fee Related
  • 2008-10-22 EP EP08800401A patent/EP2195804A4/de not_active Withdrawn
• 2013
  • 2013-03-20 HK HK13103503.9A patent/HK1176155A1/zh unknown

Patent Citations (10)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events