CN111462710B - Refreshing multiple regions of a display device simultaneously using multiple different refresh rates - Google Patents

Refreshing multiple regions of a display device simultaneously using multiple different refresh rates Download PDF

Info

Publication number
CN111462710B
CN111462710B CN202010422742.9A CN202010422742A CN111462710B CN 111462710 B CN111462710 B CN 111462710B CN 202010422742 A CN202010422742 A CN 202010422742A CN 111462710 B CN111462710 B CN 111462710B
Authority
CN
China
Prior art keywords
row
refresh rate
image data
displayed
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010422742.9A
Other languages
Chinese (zh)
Other versions
CN111462710A (en
Inventor
王超昊
李思贤
P·萨凯托
张世昌
黄俊尧
P·S·德尔泽克
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/472,272 external-priority patent/US9779664B2/en
Priority claimed from US14/558,663 external-priority patent/US9653029B2/en
Application filed by Apple Inc filed Critical Apple Inc
Publication of CN111462710A publication Critical patent/CN111462710A/en
Application granted granted Critical
Publication of CN111462710B publication Critical patent/CN111462710B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
    • G09G3/3611Control of matrices with row and column drivers
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/22Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
    • G09G3/30Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
    • G09G3/32Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2310/00Command of the display device
    • G09G2310/04Partial updating of the display screen
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/02Improving the quality of display appearance
    • G09G2320/0247Flicker reduction other than flicker reduction circuits used for single beam cathode-ray tubes
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/10Special adaptations of display systems for operation with variable images
    • G09G2320/103Detection of image changes, e.g. determination of an index representative of the image change
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/04Changes in size, position or resolution of an image
    • G09G2340/0407Resolution change, inclusive of the use of different resolutions for different screen areas
    • G09G2340/0435Change or adaptation of the frame rate of the video stream

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Liquid Crystal Display Device Control (AREA)

Abstract

The present invention relates to refreshing multiple regions of a display device simultaneously using multiple different refresh rates. Specifically, a display method is provided, which includes: operating a first subset of the pixel array at a first refresh rate, the first subset comprising a first row of pixels of the pixel array; simultaneously operating a second subset of the pixel array at a second refresh rate, the second refresh rate being different from the first refresh rate, the second subset including a second row of pixels of the pixel array adjacent to the first row of pixels; and during the operation and the simultaneous operation, altering image data to be displayed at the first row and image data to be displayed at the second row based at least on one of the first refresh rate or the second refresh rate.

Description

Refreshing multiple regions of a display device simultaneously using multiple different refresh rates
This application is a divisional application of the invention patent application having application number 201580041805.3, application date 2015, 7/15, entitled "refreshing multiple regions of a display device simultaneously using multiple different refresh rates".
Technical Field
The described embodiments relate generally to modifying a refresh rate of a display device. More particularly, the present embodiments relate to methods and apparatus for refreshing multiple regions of a display device simultaneously at different rates.
Background
Recent advances in computing devices have allowed visually impressive graphics to be displayed on many lightweight and often portable computing devices. Graphics may be provided by a variety of systems including a graphics processor and a display monitor. Many graphics processors may interact with a display monitor to provide images and video that may be updated or refreshed without the display monitor user perceiving any interruptions. However, during extended periods of time, both data transmission and light emission from the display monitor require a significant amount of energy that is not typically available when implemented in portable computing devices. Typically, this energy is dedicated to the conversion between the color and brightness levels of the display, and thus designing a display that does not provide the optimal conversion may degrade the user experience of the computing device. As a result, manufacturers must often choose between providing a more impressive visual display or conserving energy in order to provide a longer battery life for the computing device.
Many computing devices are used primarily for internet browsing, which may often require the display of various graphics. For example, some web pages are dedicated to streaming video and, therefore, may require a significant amount of effort from the graphics processor of the computing device. To provide a smooth video stream, the display monitor should be refreshed at a rate that allows the video to be presented smoothly on the display monitor. However, because typically the entire area of the display monitor is refreshed regardless of the size of the video being displayed, maintaining a high refresh rate may be inefficient with respect to energy consumption. Thus, even if a user of a computing device streams small videos on a large display monitor, the refresh rate will be dynamic relative to the video size. Because the hardware of many computing devices is not designed to adjust the refresh rate according to the application being executed, users are typically left with devices that cannot maintain a charge during frequent media playback periods. Thus, users are generally discouraged from displaying media streams until they can plug their computing device into a charging port, or until they know that they will not require battery life for other applications at a particular point in the day. Furthermore, while many processes of an application occur on a cloud server rather than a computing device, an idle screen displaying animations of various applications can also consume energy in a wasteful manner. In this way, in some cases, the application may consume more energy for aesthetic purposes only, rather than the primary purpose of the application.
Disclosure of Invention
Various embodiments are described herein that relate to methods and apparatus for controlling a refresh rate of a display device. In some embodiments, display devices such as Liquid Crystal Displays (LCDs) or Light Emitting Diode (LED) displays are listed. The display device may include: the display device includes a pixel array, a gate driver operatively coupled to the pixel array, and a data driver operatively coupled to the pixel array. The display device may further include a control circuit operatively coupled to the gate driver. The control circuit may be configured to: providing a normal refresh signal to the gate driver when the row of the first frame data set is different from the row of the second frame data set; and providing the modified refresh signal to the gate driver when the row of the first frame data set is the same as the row of the second frame data set.
In other embodiments, methods are listed for refreshing multiple regions of a display device simultaneously at different refresh rates. The method may include generating a first data frame and a second data frame, and comparing a plurality of rows of the first data frame to a plurality of rows of the second data frame. The method may also include determining a modified row of the second data frame, where the modified row is a different data row in the second data frame than a corresponding data row in the first data frame. Further, the method may comprise: a first portion of the display device corresponding to the modified row of the second data frame is caused to refresh at a first refresh rate, and a second portion of the display device adjacent to the first portion of the display device is caused to refresh at a second refresh rate.
In yet other embodiments, a machine-readable non-transitory storage medium is listed. The storage medium may store instructions that, when executed by a processor included in a computing device, cause the computing device to perform steps comprising: a first data frame and a second data frame corresponding to image data to be displayed on a display device are received. This step may also include comparing the first set of rows of the first data frame with the second set of rows and the third set of rows in the second data frame. Further, the step may include determining that a first subset of rows of the first set of rows is not the same as a first subset of rows of the second set of rows, and determining that a second subset of rows of the first set of rows is the same as a second subset of rows of the third set of rows. Further, the step may include: causing a first set of driver circuits corresponding to the second set of rows to transition to a high state and causing a second set of driver circuits corresponding to the third set of rows to transition to a low state.
Other aspects and advantages of the invention will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, illustrating by way of example the principles of the embodiments.
Drawings
The present disclosure will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like structural elements.
FIG. 1 illustrates a computing device having a display including multiple regions, where the displayed graphics are static or dynamic.
Fig. 2 illustrates a system diagram for controlling a display device according to some embodiments discussed herein.
Fig. 3 shows a diagram of a display device having an array of Light Emitting Diodes (LEDs) connected to a gate driver and a data driver.
Fig. 4A to 4B show a gate driver circuit having a unit circuit and an output selector circuit.
Fig. 5 shows a diagram listing how multiple rows and regions of an LED array may be refreshed at different rates based on the operation of the gate driver circuit.
Fig. 6A-6B illustrate problems and solutions associated with providing multiple refresh rates to an LED array.
FIG. 7 shows a diagram for performing multi-bank and multi-parameter gamma distributions in order to mitigate flicker and ripple issues at refresh boundaries.
Fig. 8 illustrates a method for modifying the refresh rate of a row or group of rows based on the difference between frames provided to an LED array.
FIG. 9 illustrates a method for adjusting the refresh rate of one or more rows of an LED array based on the blinking content of one or more frames or images to be displayed by the LED array.
FIG. 10 illustrates a method for refreshing one or more rows of an LED array based on the amount of time that one or more rows have remained static or unchanged.
FIG. 11 is a block diagram of a computing device that may represent components of various embodiments discussed herein.
Detailed Description
This section describes representative applications of the methods and apparatus according to the present patent application. These examples are provided solely to add context and aid in the understanding of the described embodiments. It will thus be apparent to one skilled in the art that the embodiments may be practiced without some or all of these specific details. In other instances, well known process steps have not been described in detail in order to avoid unnecessarily obscuring the embodiments. Other applications are possible, such that the following examples should not be considered limiting.
In the following detailed description, reference is made to the accompanying drawings which form a part hereof, and in which is shown by way of illustration specific embodiments in accordance with the embodiments. Although these embodiments are described in sufficient detail to enable those skilled in the art to practice the embodiments, it is to be understood that these examples are not limiting, such that other embodiments may be utilized and that modifications may be made without departing from the spirit and scope of the embodiments.
Embodiments discussed herein relate to a display device configured to refresh at different rates based on content to be displayed by the display device. Many computing devices have displays that typically display both still images and moving images over various periods of use. Still images and moving images may generally be displayed simultaneously on a display of a computing device. According to embodiments discussed herein, a lower refresh rate may be assigned to portions of a display that are displaying static images, and a normal refresh rate may be assigned to portions of the display that are displaying dynamic images. These differences in refresh rates may be implemented in part by output selector circuitry that may prevent updating one or more rows of the display. In particular, the display may include an array of LEDs having a plurality of rows, and each row may be connected to a gate driver, which may be prevented from allowing refresh of the respective row based on the action of the output selector circuit. In some cases, the data driver provides updated frame data to the LED array, and the gate driver may prevent refreshing one or more rows of the LED array if the updated frame data is the same for two or more refreshes. For example, when an LED array is outputting a static image at a portion of the LED array, a control signal may be provided to an output selector that prevents the portion of the LED array from being refreshed at a rate equal to other portions of the LED array. A single row or multiple sets of rows may be refreshed differently than other portions of the LED array, such that at least two refresh rates are used to provide output from the LED array. In some embodiments, the refresh rate assigned to a portion of the LED array may be based on the flashing content of one or more images to be output by the LED array. For example, when an image contains high flicker content, a corresponding portion of the LED array may be assigned a low refresh rate. Furthermore, when an image contains low flicker content, the corresponding portion of the LED array may be assigned a very low refresh rate. Furthermore, during each refresh, polarity changes may be performed in order to mitigate wear of the LEDs of the LED array.
When multiple refresh rates are used simultaneously on a display device, the ripple may be visible by a user of the computing device to which the display device is attached. The ripple may be caused by the boundary between two adjacent portions of the display that operate at different refresh rates. To mitigate and prevent the occurrence of ripple, compensation methods are discussed herein. In one embodiment, a digital compensation method is used. The digital compensation method allows at least 2-bit spatial dithering to be performed on the data presented at the display boundary in question. In another embodiment, an interpolation process is used that interpolates at least two gamma curves based on the refresh rate of the line or lines in question. The interpolation results are output to the line or lines in question to adjust the gamma of the image to be displayed at the line or lines for making any ripple effect imperceptible.
These and other embodiments are discussed below with reference to fig. 1-11; however, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes only and should not be construed as limiting.
FIG. 1 illustrates a computing device 100 having a display 102 that includes multiple regions, where the displayed graphics are static or dynamic. In particular, the display 102 of the computing device 100 includes a header row 104 and a dynamic icon row 106 that are continuously updated according to a cycle or period programmed within the computing device 100. The display 102 also includes a static area 108 that is not constantly updated but remains static until input is received from a user, a network connection, or other suitable input source of the computing device 100. The header line 104 may include indicators of wireless signal strength, clock time, and battery life, which may typically change at any given time. For this purpose, the header line 104 must display different values and adjust according to the dynamic changes that occur. The dynamic icon row 106 may also be modified according to the updates that occur at the dynamic icon 110. The dynamic icon 110 may display current date and clock time that is constantly changing and updated. In this way, the dynamic icon 110 should be refreshed more frequently than the static area 108 to reduce energy consumption, as discussed further herein. For example, during operation of an application on computing device 100, a display manager stored in computing device 100 may determine whether one or more lines currently presented on display 102 include dynamic data. Following this and as discussed further herein, the display manager may assign a higher refresh rate for rows that include dynamic data than rows that do not include dynamic data.
Fig. 2 illustrates a system diagram 200 for controlling a display device 210 according to some embodiments discussed herein. In particular, fig. 2 illustrates how the computing device 202 disclosed herein interacts with the display device 210 to simultaneously assign different refresh rates to various regions of the display device 210, thereby conserving battery life of the computing device 202. The computing device 202 may include a memory 204 that stores a display manager 206 for transferring display data between a processor 208 and a display device 210. The display device 210 may include a data driver 216 for providing display data to a Light Emitting Diode (LED) array 214. The LED array 214 may include any suitable type of LEDs for display at the display device 210. For example, the LED array 214 may be an organic light emitting diode array. The gate driver 212 may be responsible for providing power to the individual LEDs of the display device 210 and scanning the rows and/or columns of the LED array 214 according to the refresh rate provided from the display manager 206. The display device may include a plurality of gate drivers 212, a plurality of data drivers 216, and a plurality of LED arrays 214 arranged in any manner suitable for operating the display device 210. The data driver 216 and the gate driver 212 may be configured to control the brightness of each LED pixel on the display device 210. Further, the display device 210 may be any display monitor suitable for use by a computing device, such as a desktop computer, a mobile device, a media player, or any other computer-related apparatus. In some embodiments, display device 210 is a Liquid Crystal Display (LCD) with an LED backlight. The LED backlight may be decoupled from the gate driver 212 and the data driver 216, and the gate driver 212 and the data driver 216 may be used to control the transmittance of the liquid crystal for passing LED light from the LED backlight. In this manner, the LEDs of the liquid crystal or LED arrays discussed herein may be used as a pixel array to provide a channel or source for light projected from the display device 210.
Fig. 3 shows a diagram 300 of a display device 210 having an LED array 214 connected to a gate driver 212 and a data driver 216. As discussed further herein, the gate driver 212 may include a plurality of gate output controllers that provide power and scan data outputs to each row and/or each column of the LED array. According to embodiments discussed herein, each gate output 302 may be limited by the refresh rate of each individual row or group of rows. In this manner, one or more gate outputs 302 may be refreshed at a rate different from one or more other gate outputs 302. Further, the data driver 216 may include a plurality of data outputs 304 for updating and transmitting signals to the LED array 214. In some embodiments, one or more of the data outputs 304 may be stopped or transitioned to a low output state to reduce power consumption while the LED array 214 is displaying a static image on the screen. Further, when the data output 304 is stopped or in a low state, the refresh rate corresponding to the gate output 302 may be reduced in a region affecting a portion of the LED array 214 displaying a static image.
Fig. 4A to 4B show a gate driver circuit 400 having a unit circuit 410 and an output selector 412. The gate driver circuit 400 includes a control circuit 408 connected to a plurality of transistors and inputs for allowing the control circuit 408 to scan updates from the data driver 216. One or more of the plurality of transistors may be an oxide transistor (e.g., an oxide thin film transistor) that provides a very low off-state current, allowing for less power consumption when a low refresh rate is applied to the LED array 214, as discussed further herein. Furthermore, by using oxide transistors in combination with the LED array 214 of organic LEDs, a significant reduction in power consumption can be achieved compared to displays using low temperature polysilicon. Thus, the apparatus and methods discussed herein may be implemented using a gate driver circuit 400 having one or more oxide thin film transistors connected to an LED array 214 of organic LEDs. Furthermore, in some embodiments, a gate driver circuit 400 may be incorporated into each gate output 302 to simultaneously scan one or more rows based on one or more clock signals provided to the gate driver circuit 400. An output selector 412 is incorporated into the gate driver circuit 400 to prevent scanning based on the control input 402. For example, as shown in FIG. 4A, a scan signal 414 may be provided to the output selector 412 and prevented from being output from the selector output 404 by the absence of the control input 402. When the control input 402 is not provided to the output selector 412, a no signal or low voltage signal may be output from the selector output 404. Fig. 4B shows an example when a control signal 416 is received at the control input 402 of the output selector 412. Due to the control signal 416, a conductive path is formed at the transistor between the control input 402 and the selector output 404, allowing the scan signal 414 to be output from the selector output 404. In the context of logic circuits to which the scan signal is provided, the scan signal 414 may be a high voltage to indicate an "on" or "high" state of operation. Thus, although the scan signal 414 may be constantly applied throughout the gate driver circuit 400, the scan signal 414 will not be output from the selector output 404 until the control signal 416 is received at the control input 402. In this manner, because the gate driver circuit 400 may be incorporated at each gate output 302, one or more rows of gate outputs may be prevented from outputting scan signals 414, or caused to output "off" or "low" signals, simply by applying control signals 416 to one or more gate driver circuits 400.
Fig. 5 shows a graph 500 listing how multiple rows and regions of LED array 214 may be refreshed at different rates based on the operation of gate driver circuit 400. Specifically, fig. 5 lists an example when a first refresh rate is assigned to a first region 508 of LED array 214 that is greater than a second refresh rate assigned to a second region 510 of LED array 214. At frame 1, both the first region 508 and the second region 510 are refreshed based on the scanning performed on all rows of the LED array 214 due to both the first refresh rate and the second refresh rate. For purposes of explanation, the first region 508 may be streaming video and the second region 510 may be a still image that abuts the streaming video. From the second frame to the "N + 3" frame, the first refresh rate is such that the rows corresponding to the first region 508 are refreshed at each frame to allow the streaming video to be updated at each frame. However, the second refresh rate is such that rows corresponding to the second region 510 are not refreshed and remain static because the second refresh rate is lower than the first refresh rate. At an "N + 4" frame, the first region 508 and the second region 510 are refreshed simultaneously again after the second region 510 has remained unrefreshed for a plurality of consecutive frames. In this way, rather than refreshing the entire LED array 214 at the same rate, energy is conserved by refreshing portions of the LED array 214 at different refresh rates. In some embodiments, any suitable number of refresh rates may be applied to the LED array 214. For example, at least three different refresh rates may be applied to the LED array 214. Further, a minimum refresh rate for one or more rows of LED array 214 may be determined. The minimum refresh rate may be the lowest refresh rate that prevents flickering of the image displayed by the LED array 214. Further, the polarity change may be performed during each refresh performed at a respective area or row of the LED array 214.
Fig. 6A-6B illustrate problems and solutions associated with providing multiple refresh rates to LED array 214. In particular, fig. 6A illustrates a representation of a refresh boundary 608 that may be visible to a user when a refresh rate of the first region 508 is greater than a refresh rate of the second region 510. A representation of the refresh boundary 608 can be seen in FIG. 6A, where the average refresh line 606 is shown. The average refresh line 606 is an example as follows: when the first refresh rate 602 is greater than the second refresh rate 604 and two refresh rates are simultaneously exhibited adjacent to the refresh boundary 608. Due to the average refresh line 606, flicker or brightness ripple will be visible unless the refresh boundary 608 is compensated. To address the problems of flicker and ripple, solutions are listed in fig. 6B and 7. In particular, fig. 6B illustrates how compensation for the refresh boundary 608 can be performed in the digital domain using a set of pixels 610, the set of pixels being interchangeable over the refresh boundary 608 based on the refresh rate. For example, each pixel block 612 shown in pixel set 610 may be ordered and/or alternated for each set of at least 2 x 2 pixels that traverses refresh boundary 608. This technique (sometimes referred to as spatial dithering) may be performed to provide a visually smooth transition between two regions having different refresh rates.
Fig. 7 illustrates a system diagram 700 for performing multi-bank and multi-parameter gamma distributions in order to mitigate the flicker and ripple problem at the refresh boundary 608. In particular, fig. 7 shows an analog solution for applying gamma switching to rows or row blocks in order to correct for flicker and ripple. The system diagram 700 includes a first library 702 storing a first gamma curve and a second library 704 storing a second gamma curve. Each of the first and second gamma curves is associated with one of two refresh rates that may be respectively applied to the LED array 214. During compensation operations using gamma switching, the first and second gamma curves are input into the interpolation module 708 along with the row block refresh rate 706. After which the first and second gamma curves are interpolated. The interpolation method may be of any suitable form for interpolating image data. The interpolation results of the first and second gamma curves may be scaled or otherwise modified according to the row block refresh rate 706 provided to the interpolation module 708. Thus, the row block gamma 710 is output from the interpolation module 708 as a curve to provide an analog solution to hide the refresh boundary 608. Depending on the severity of the flicker and ripple occurring at the refresh boundary 608, the row block gamma 710 may be applied to one or more rows of the LED array 214 simultaneously.
Fig. 8 illustrates a method 800 for modifying the refresh rate of a row or group of rows based on differences between frames provided to the LED array 214. Specifically, the method 800 includes step 802: the first data frame and the second data frame are generated by the display manager 206. The first and second data frames may be generated at the computing device 202 or the display device 210 by one or more software modules within one or both respective devices. At step 804, the display manager 206 compares each first frame line (i.e., the line of the first data frame) to each second frame line (i.e., the line of the second data frame). The comparison of step 804 may be done sequentially for each row or one at a time, or the comparison of all rows may be performed simultaneously. At step 806, the display manager 206 determines whether the first frame line is different from the second frame line. If the first frame row is different than the second frame row, at step 808, the display manager 206 causes the array rows associated with the second frame row to be refreshed according to the normal refresh rate. If the first frame row is the same as the second frame row, at step 810, the display manager 206 causes the array rows associated with the second frame row to be refreshed according to a low refresh rate. In this way, the frame lines that remain static over multiple consecutive frames can be kept at a low refresh rate to conserve energy. For example, the normal refresh rate may be 30 hertz or 60 hertz, the low refresh rate may be 10 hertz or 2 hertz, and the very low refresh rate may be 1 Hz. The normal refresh rate, the low refresh rate, and the very low refresh rate may be one or more arbitrary values suitable for a given display device. As discussed further herein, the normal refresh rate may be greater than the low refresh rate, and the low refresh rate may be greater than the very low refresh rate.
Fig. 9 illustrates a method 900 for adjusting the refresh rate of one or more rows of LED array 214 based on the blinking content of one or more frames or images to be displayed by LED array 214. Flicker content or flicker refers to the amount or severity of an apparent transition from frame to frame that a user may perceive when viewing a display of a computing device. The method 900 includes step 902, wherein the display manager 206 generates a first data frame and a second data frame. Each of the first and second data frames includes one or more rows of data to be provided to the LED array 214. At step 904, the display manager 206 compares each first frame line of the first frame with each second frame line of the second frame. Thereafter, at step 906, the display manager 206 determines whether the first frame line is different from the second frame for one or more of the first frame lines of the first frame and one or more of the second frame lines of the second frame. If any of the first frame lines are different from the corresponding second frame lines, at step 908, the display manager 206 may refresh one or more corresponding second frame lines according to the normal refresh rate. If any of the first frame lines are the same as the corresponding second frame lines, the display manager 206 may proceed to step 910. At step 910, the display manager 206 may determine whether any second frame lines include high flicker content. If any of the second frame lines include high flicker content (e.g., content that would cause the user to notice flicker from the LED array 214), the display manager 206 may refresh the second frame lines according to a low refresh rate at step 912. The refresh rates provided herein may be assigned to one or more transitions between frames such that a next transition may be delayed according to the corresponding refresh rate. If any of the second frame lines do not contain high flicker content, at step 914, the display manager 205 may refresh the corresponding second frame line according to the very low refresh rate. In this way, the row or rows assigned to the very low refresh rate may remain static longer to save energy. Any of the methods discussed herein may analyze a single row at a time, iteratively, or multiple rows simultaneously, in order to effectively determine the refresh rate applicable to one or more rows of LED array 214.
Fig. 10 shows a method 1000 for refreshing one or more rows of LED array 214 based on the amount of time that one or more rows have remained static or unchanged. Method 1000 includes step 1002, where display manager 206 determines how long one or more rows of LED array 214 have been static. At step 1004, the display manager 206 compares the static time or the time that one or more rows have remained static or have not changed to a predetermined threshold time. The threshold time may be a value set by a user or manufacturer that remains constant throughout the life of the LED array 214 or that changes based on hardware changes of a computing device associated with the LED array 214. At step 1006, the display manager 206 determines whether the static time is greater than a threshold time. If the static time is greater than the threshold time, at step 1010, the display manager 206 may prevent refreshing one or more rows. In this manner, the refresh rate of one or more rows of LED array 214 will be based on the amount of time that one or more rows have been in a quiescent state. If the static time is less than or equal to the threshold time, at step 1008, the display manager 206 may allow one or more rows to be refreshed. After steps 1008 and 1010, at step 1012, the display manager 206 may analyze the next line or lines of the current frame or a subsequent frame. For example, method 1000 may be performed for each frame of data provided to LED array 214 and for each row of each frame. When all frames have been analyzed according to method 1000, display manager 206 may proceed to the next frame to be provided to LED array 214. It should be noted that any of the methods or embodiments discussed herein may be combined and performed in any order or arrangement suitable to mitigate energy consumption of a display device.
Fig. 11 is a block diagram of a computing device 1100 that may represent components of computing device 100 and/or computing device 202. It should be understood that the components, devices, or elements shown in fig. 11 and described with respect to fig. 11 may not be necessary, and thus some of them may be omitted in certain embodiments. The computing device 1100 may include a processor 1102, which represents a microprocessor, a coprocessor, circuitry, and/or a controller for controlling the overall operation of the computing device 1100. Although shown as a single processor, it is to be understood that the processor 1102 may comprise a plurality of processors. The multiple processors may be in operative communication with each other and may be collectively configured to perform one or more functions of the computing device 1100 as described herein. In some embodiments, the processor 1102 may be configured to execute instructions that may be stored at the computing device 1100 and/or otherwise accessible to the processor 1102. As such, whether configured by hardware or a combination of hardware and software, the processor 1102 is capable of performing operations and actions in accordance with the embodiments described herein.
Computing device 1100 can also include a user input device 1104 that allows a user of computing device 1100 to interact with computing device 1100. For example, user input device 1104 may take various forms, such as buttons, keypads, dials, touch screens, audio input interfaces, visual/image capture input interfaces, input in the form of sensor data, and so forth. Still further, the computing device 1100 may include a display 1108 (screen display) that is controllable by the processor 1102 to display information to a user. The controller 1110 may be used to interact with and control various devices via a device control bus 1112. Computing device 1100 can also include a network/bus interface 1114 coupled to a data link 1116. The data link 1116 may allow the computing device 1100 to couple to a host computer or an accessory device. The data link 1116 may be provided by a wired connection or a wireless connection. For wireless connectivity, the network/bus interface 1114 may include a wireless transceiver.
The computing device 1100 may also include a storage device 1118, which may have a single disk or multiple disks (e.g., hard disk drives), and a storage management module that manages one or more partitions (also referred to herein as "logical volumes") within the storage device 1118. In some embodiments, storage 1120 may include flash memory, semiconductor (solid state) memory, and the like. Still further, the computing device 1100 may include Read Only Memory (ROM)1122, Random Access Memory (RAM)1124, and the like. The ROM 1122 may store programs, code, instructions, utilities or processes to be executed in a non-volatile manner. RAM 1124 can provide volatile data storage and store instructions related to components of a storage management module configured to perform the various techniques described herein. The computing device may also include a data bus 1126. The data bus 1126 may facilitate data and signal transfer between at least the processor 1102, the controller 1110, the network interface 1114, the storage device 1118, the ROM 1122, and the RAM 1124.
The various aspects, embodiments, implementations, or features of the described embodiments may be used alone or in any combination. Various aspects of the described implementations may be implemented in software, hardware, or a combination of hardware and software. The embodiments may also be embodied as computer readable code on a computer readable medium for controlling a production operation or as computer readable code on a computer readable medium for controlling a production line. The computer readable storage medium is any data storage device that can store data which can thereafter be read by a computer system. Examples of the computer readable storage medium include read-only memory, random-access memory, CD-ROMs, HDDs, DVDs, magnetic tapes, and optical data storage devices. The computer readable storage medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. In some embodiments, the computer-readable storage medium may be non-transitory.
The foregoing description, for purposes of explanation, used specific nomenclature to provide a thorough understanding of the embodiments described. It will be apparent, however, to one skilled in the art that these specific details are not required in order to practice the embodiments. Thus, the foregoing descriptions of specific embodiments have been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the embodiments to the precise form disclosed. It will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teaching.

Claims (20)

1. A display method, comprising:
operating a first subset of a pixel array at a first refresh rate, the first subset comprising a first row of pixels of the pixel array;
simultaneously operating a second subset of the pixel array at a second refresh rate, the second refresh rate being different from the first refresh rate, the second subset including a second row of pixels of the pixel array adjacent to the first row of pixels; and
during the operation and the concurrent operation, image data to be displayed at a first row and image data to be displayed at a second row are altered based on at least one of a first refresh rate or a second refresh rate.
2. The method of claim 1, wherein altering the image data to be displayed prevents visible ripples at the boundary between the first subset and the second subset.
3. The method of claim 1, wherein altering the image data to be displayed at the first row and the image data to be displayed at the second row comprises: for each of the at least one pixel of the first row, the pixel value for that pixel is interchanged with the pixel value for the corresponding pixel of the second row.
4. The method of claim 3, wherein interchanging comprises digitally interchanging a pixel value for the pixel with a pixel value for a corresponding pixel of the second row.
5. The method of claim 3, wherein the first subset is a first set of rows of the pixel array and the second subset is a second set of rows of the pixel array.
6. The method of claim 1, wherein altering the image data is based on a first refresh rate and a second refresh rate.
7. The method of claim 1, wherein altering the image data to be displayed at the first row and the image data to be displayed at the second row comprises performing a dithering operation on a plurality of pixel values of the first row and a corresponding plurality of pixel values of the second row.
8. The method of claim 1, wherein altering the image data to be displayed at the first row and the image data to be displayed at the second row comprises:
interpolation is performed for a first gamma curve associated with a first refresh rate and a second gamma curve associated with a second refresh rate.
9. The method of claim 8, wherein altering the image data to be displayed at the first row and the image data to be displayed at the second row further comprises:
for each of the at least one pixel of the first row, the result of the interpolation is applied to that pixel and to the corresponding pixel in the second row.
10. The method of claim 9, further comprising:
scaling a result of the interpolation prior to applying the result of the interpolation.
11. The method of claim 10, further comprising:
operating a third subset of the array of pixels at a first refresh rate and using a first gamma curve.
12. The method of claim 10, wherein altering the image data to be displayed at the first row and the image data to be displayed at the second row further comprises:
an analog compensation operation is performed.
13. A device having a display with an array of pixels, the device comprising:
a first region of the array configured to display first display content at a first refresh rate, a first subset of the first region of the array comprising a first row of pixels of the array;
a second region of the array configured to simultaneously display second display content at a second refresh rate, the second refresh rate being different from the first refresh rate, the second region comprising a second row of pixels of the array adjacent to the first row of pixels; and
a processor configured to alter image data of first display content to be displayed at a first row and image data of second display content to be displayed at a second row based on at least one of a first refresh rate or a second refresh rate.
14. The apparatus of claim 13, wherein the processor is further configured to dither a portion of a first display content associated with a first row and a portion of a second display content associated with a second row.
15. The apparatus of claim 14, wherein the processor is further configured to display image data of a second display content using at least one pixel of a first row while dithering the portion of the first display content associated with the first row and a portion of the second display content associated with a second row.
16. The apparatus of claim 13, further comprising:
a first bank storing a first gamma curve associated with a first refresh rate;
a second bank storing a second gamma curve associated with a second refresh rate; and
the processor is configured to perform interpolation on the first gamma curve and the second gamma curve to generate a row block gamma curve.
17. The apparatus of claim 16, wherein the processor is further configured to apply the row block gamma curve to image data of a first display content associated with a first row.
18. A display method, comprising:
receiving first display content to be displayed by a first row of pixels at a first refresh rate;
receiving second display content to be displayed by a second row of pixels at a second refresh rate, the second refresh rate being different from the first refresh rate, wherein the first row and the second row are adjacent rows in the pixel array; and
while displaying the first display content at the first refresh rate and the second display content at the second refresh rate, based on at least one of the first refresh rate or the second refresh rate,
the image data of the first display content and the image data of the second display content are altered.
19. The method of claim 18, wherein altering image data comprises performing a dithering operation on the at least some of the first display content and the second display content.
20. The method of claim 18, wherein altering image data comprises performing interpolation between a first gamma curve associated with a first refresh rate and a second gamma curve associated with a second refresh rate.
CN202010422742.9A 2014-08-05 2015-07-15 Refreshing multiple regions of a display device simultaneously using multiple different refresh rates Active CN111462710B (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US201462033586P 2014-08-05 2014-08-05
US62/033,586 2014-08-05
US14/472,272 2014-08-28
US14/472,272 US9779664B2 (en) 2014-08-05 2014-08-28 Concurrently refreshing multiple areas of a display device using multiple different refresh rates
US14/558,663 2014-12-02
US14/558,663 US9653029B2 (en) 2014-08-05 2014-12-02 Concurrently refreshing multiple areas of a display device using multiple different refresh rates
CN201580041805.3A CN106663402B (en) 2014-08-05 2015-07-15 Refreshing multiple regions of a display device simultaneously using multiple different refresh rates

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201580041805.3A Division CN106663402B (en) 2014-08-05 2015-07-15 Refreshing multiple regions of a display device simultaneously using multiple different refresh rates

Publications (2)

Publication Number Publication Date
CN111462710A CN111462710A (en) 2020-07-28
CN111462710B true CN111462710B (en) 2022-02-18

Family

ID=58399180

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202010422742.9A Active CN111462710B (en) 2014-08-05 2015-07-15 Refreshing multiple regions of a display device simultaneously using multiple different refresh rates
CN201580041805.3A Active CN106663402B (en) 2014-08-05 2015-07-15 Refreshing multiple regions of a display device simultaneously using multiple different refresh rates

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201580041805.3A Active CN106663402B (en) 2014-08-05 2015-07-15 Refreshing multiple regions of a display device simultaneously using multiple different refresh rates

Country Status (3)

Country Link
EP (1) EP3178083A4 (en)
KR (1) KR101965079B1 (en)
CN (2) CN111462710B (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9779664B2 (en) 2014-08-05 2017-10-03 Apple Inc. Concurrently refreshing multiple areas of a display device using multiple different refresh rates
CN106920502A (en) * 2017-05-12 2017-07-04 京东方科技集团股份有限公司 A kind of control method of display device and display device
CN110189722B (en) 2018-08-10 2021-09-17 友达光电股份有限公司 Display device
CN109036246B (en) * 2018-08-10 2023-11-14 京东方科技集团股份有限公司 Display panel, display method and display device
KR102583819B1 (en) * 2018-12-18 2023-10-04 삼성디스플레이 주식회사 Display apparatus, method of driving display panel using the same
CN110083318B (en) * 2019-03-20 2022-12-23 中国航空无线电电子研究所 Multi-CDS (compact disc System) instance integrated high-performance cockpit display system
KR20210013492A (en) 2019-07-26 2021-02-04 삼성디스플레이 주식회사 Display apparatus, method of driving display panel using the same
US11151965B2 (en) * 2019-08-22 2021-10-19 Qualcomm Incorporated Methods and apparatus for refreshing multiple displays
CN113741676B (en) * 2020-05-29 2024-03-01 北京小米移动软件有限公司 Display screen frame rate control method, device and storage medium
CN112002276B (en) * 2020-08-06 2022-05-31 武汉华星光电半导体显示技术有限公司 Control method for display panel
WO2022119260A1 (en) * 2020-12-01 2022-06-09 삼성전자 주식회사 Electronic device comprising flexible display, and operating method thereof
KR20230116459A (en) * 2022-01-28 2023-08-04 경희대학교 산학협력단 Scan driver capable of selectively operating scan driving, and display device including the same
CN114661403A (en) * 2022-03-29 2022-06-24 联想(北京)有限公司 Processing method, system and electronic equipment
CN117059033A (en) * 2022-05-05 2023-11-14 荣耀终端有限公司 Screen driving circuit, display screen and electronic equipment
CN115497433B (en) * 2022-10-28 2023-11-28 信利(仁寿)高端显示科技有限公司 Multi-region multi-frequency display device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1499824A (en) * 2002-11-04 2004-05-26 李治福 Method for raising quality of image on liquid crystal display device
CN1755789A (en) * 2004-09-27 2006-04-05 Idc公司 Controller and driver features for bi-stable display
CN101088116A (en) * 2004-12-30 2007-12-12 英特尔公司 Method and apparatus for controlling display refresh
CN101093658A (en) * 2006-05-30 2007-12-26 英特尔公司 Conversion of display refreshing speed
CN103505230A (en) * 2012-06-25 2014-01-15 通用电气公司 Image display method
CN103680382A (en) * 2012-09-24 2014-03-26 三星显示有限公司 Display driving method and integrated driving apparatus thereof
CN103956145A (en) * 2014-03-27 2014-07-30 深圳市中兴移动通信有限公司 Terminal display mode determining method and apparatus

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100618191B1 (en) * 2004-06-25 2006-09-01 주식회사 대우일렉트로닉스 Frame Rate Processing Circuit of PDP Device and the Method thereof
TWI349259B (en) * 2006-05-23 2011-09-21 Au Optronics Corp A panel module and power saving method thereof
JP5174329B2 (en) * 2006-05-23 2013-04-03 株式会社日立製作所 Image processing apparatus and image display apparatus
KR101277862B1 (en) * 2006-08-21 2013-06-21 엘지디스플레이 주식회사 Appratus and method for driving LCD
JP5227502B2 (en) * 2006-09-15 2013-07-03 株式会社半導体エネルギー研究所 Liquid crystal display device driving method, liquid crystal display device, and electronic apparatus
US7898538B2 (en) * 2007-01-31 2011-03-01 International Business Machines Corporation Method and system for estimating screen refresh rates of computing units participating in an internet-based collaboration
GB2458958B (en) * 2008-04-04 2010-07-07 Sony Corp Driving circuit for a liquid crystal display
US8068087B2 (en) * 2008-05-29 2011-11-29 Sharp Laboratories Of America, Inc. Methods and systems for reduced flickering and blur
US8578192B2 (en) * 2008-06-30 2013-11-05 Intel Corporation Power efficient high frequency display with motion blur mitigation
US8405770B2 (en) * 2009-03-12 2013-03-26 Intellectual Ventures Fund 83 Llc Display of video with motion
JP5479808B2 (en) * 2009-08-06 2014-04-23 株式会社ジャパンディスプレイ Display device
KR101761400B1 (en) * 2009-12-21 2017-07-25 엘지디스플레이 주식회사 Liquid crystal display
KR20120070921A (en) * 2010-12-22 2012-07-02 엘지디스플레이 주식회사 Timing controller and organic light emitting diode display using the same
US8749541B2 (en) * 2012-04-05 2014-06-10 Apple Inc. Decreasing power consumption in display devices
CN104813392B (en) * 2012-11-20 2017-06-23 夏普株式会社 The control method of control device, display device and display device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1499824A (en) * 2002-11-04 2004-05-26 李治福 Method for raising quality of image on liquid crystal display device
CN1755789A (en) * 2004-09-27 2006-04-05 Idc公司 Controller and driver features for bi-stable display
CN101088116A (en) * 2004-12-30 2007-12-12 英特尔公司 Method and apparatus for controlling display refresh
CN101093658A (en) * 2006-05-30 2007-12-26 英特尔公司 Conversion of display refreshing speed
CN103505230A (en) * 2012-06-25 2014-01-15 通用电气公司 Image display method
CN103680382A (en) * 2012-09-24 2014-03-26 三星显示有限公司 Display driving method and integrated driving apparatus thereof
CN103956145A (en) * 2014-03-27 2014-07-30 深圳市中兴移动通信有限公司 Terminal display mode determining method and apparatus

Also Published As

Publication number Publication date
KR101965079B1 (en) 2019-04-02
EP3178083A4 (en) 2018-02-21
CN106663402B (en) 2020-05-19
CN106663402A (en) 2017-05-10
EP3178083A1 (en) 2017-06-14
CN111462710A (en) 2020-07-28
KR20170024106A (en) 2017-03-06

Similar Documents

Publication Publication Date Title
US20200258454A1 (en) Concurrently refreshing multiple areas of a display device using multiple different refresh rates
CN111462710B (en) Refreshing multiple regions of a display device simultaneously using multiple different refresh rates
US9653029B2 (en) Concurrently refreshing multiple areas of a display device using multiple different refresh rates
US10600379B2 (en) Low power display device with variable refresh rates
CN110060642B (en) Receiving apparatus and liquid crystal display apparatus including the same
US9524694B2 (en) Display with spatial and temporal refresh rate buffers
US8749541B2 (en) Decreasing power consumption in display devices
US9373300B2 (en) Power management method and power management device
US20130057519A1 (en) Display refresh system
US9881566B2 (en) Display device, electronic apparatus, and control method for display device
US11423817B2 (en) Display device, and method of operating a display device
JP2014202855A (en) Display divice
CN115188306A (en) Pixel refreshing method and device, storage medium and display
CN113870766A (en) Display panel and display device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant