WO2020172822A1

WO2020172822A1 - Image display processing method and apparatus, display apparatus, and storage medium

Info

Publication number: WO2020172822A1
Application number: PCT/CN2019/076344
Authority: WO
Inventors: 史天阔; 时凌云; 姬治华; 段欣; 孙伟
Original assignee: 京东方科技集团股份有限公司; 北京京东方光电科技有限公司
Priority date: 2019-02-27
Filing date: 2019-02-27
Publication date: 2020-09-03
Also published as: US11244636B2; CN112513968B; US20210225298A1; CN112513968A; EP3933823A1

Abstract

An image display processing method and an image display processing apparatus (100) for a display apparatus (300), the display apparatus (300), and a storage medium (400). The display apparatus (300) comprises a backlight unit (303), and the backlight unit (303) comprises a plurality of backlight partitions and is driven in a local dimming manner. The image display processing method comprises: according to display data, transmitted in the current frame of image, of pixels corresponding to N rows of backlight partitions, acquiring backlight values of the N rows of backlight partitions; and based on the display data of the pixels corresponding to the N rows of backlight partitions and the acquired backlight values of the N rows of backlight partitions, acquiring compensated display data, in the current frame of image, of the pixels corresponding to the N rows of backlight partitions, wherein the current frame of image corresponds to L rows of backlight partitions, and N is an integer greater than or equal to 1 and less than L. The image display processing method can save on the storage space needed for a display panel, improve the display image contrast and the display effect of a picture, and reduce the power consumption of the display panel.

Description

Image display processing method and device, display device and storage medium

Technical field

The embodiments of the present disclosure relate to an image display processing method, an image display processing device, a display device, and a storage medium.

Background technique

With the continuous advancement of electronic technology, Virtual Reality (VR) or Augmented Reality (AR) technology, as a high-tech, has been increasingly used in daily life such as games and entertainment. Virtual reality technology is also called spiritual technology or artificial environment.

The existing virtual reality system mainly simulates a virtual three-dimensional world through a high-performance computing system including a central processing unit, and provides users with visual and auditory sensory experiences through head-mounted devices, thereby making users feel like they are there. At the same time, human-computer interaction is also possible.

Summary of the invention

At least one embodiment of the present disclosure provides an image display processing method of a display device, the display device includes a backlight unit, the backlight unit includes L rows of backlight partitions and is driven by a local dimming method, and the image display processing method includes : Obtain the backlight value of the N-row backlight subarea according to the display data of the pixels corresponding to the N-row backlight subarea in the current frame image; based on the display data of the pixels corresponding to the N-row backlight subarea and the obtained N rows The backlight value of the backlight subarea is to obtain the compensated display data of the pixels corresponding to the N rows of backlight subarea in the current frame image; N is an integer greater than or equal to 1 and less than L.

For example, in the image display processing method provided by some embodiments of the present disclosure, the display device further includes a display panel, the backlight unit is disposed on the non-display side of the display panel, and the image display processing method further includes: The backlight values of the N rows of backlight subarea are input to the backlight unit; the compensated display data of the pixels corresponding to the N rows of backlight subarea in the current frame image is input to the display panel of the display device to Perform display of the display panel.

For example, the image display processing method provided by some embodiments of the present disclosure further includes: before acquiring the backlight values of the N rows of backlight subregions, converting the display data of the pixels corresponding to the N rows of backlight subregions in the current frame of image Write the storage unit to obtain two copies of the display data; one copy of the display data is used to obtain the backlight value of the N-row backlight subarea, and the other copy of the display data is stored and used to obtain the corresponding The compensated display data of the pixels of the N rows of backlight subarea.

For example, the image display processing method provided by some embodiments of the present disclosure further includes: the storage unit at least stores the display data of the pixels corresponding to the N rows of backlight subregions.

For example, in the image display processing method provided by some embodiments of the present disclosure, obtaining the compensated display data of the pixels corresponding to the N rows of backlight partitions in the current frame of image includes: The backlight values of the partitions and the backlight values of the backlight partitions of at least one row adjacent to the N rows of backlight partitions are fitted to obtain a backlight diffusion model, and based on the backlight diffusion model, the corresponding backlight partitions in the N rows are obtained. The actual backlight value of each pixel; according to the actual backlight value, the display data of the pixels corresponding to the N rows of backlight subregions in the current frame of image are compensated to obtain the compensated display data of the pixels.

For example, in the image display processing method provided by some embodiments of the present disclosure, acquiring the backlight values of the N rows of backlight subregions according to the display data of the pixels corresponding to the N rows of backlight subregions in the current frame of image includes: separately counting the The gray value of the display data of the pixel corresponding to each backlight subarea in each row of the N rows of backlight subarea; and the backlight value of each backlight subarea is obtained based on the gray value of the display data of the pixel corresponding to each of the backlight subarea.

For example, in the image display processing method provided by some embodiments of the present disclosure, the gray values of the display data of the pixels corresponding to each backlight subarea in each row of the N rows of backlight subarea are respectively counted through a histogram.

For example, in the image display processing method provided by some embodiments of the present disclosure, the gray values of the display data of the pixels corresponding to the respective backlight subarea are counted in order of 80% to 90% of the gray values from small to large. , Or set the average value of the gray value of the display data of the pixels corresponding to each backlight subarea as the backlight value of the corresponding backlight subarea.

For example, in the image display processing method provided by some embodiments of the present disclosure, the compensated display data of the pixel is obtained according to the following formula:

Vc=V0*(BL_M/BL_P)

Wherein, Vc represents the compensated display data of a certain pixel among all the pixels corresponding to the N rows of backlight partitions, V0 represents the display data before the pixel is compensated, and BL_M represents that the pixel corresponds to the highest gray level BL_P represents the actual backlight value corresponding to the pixel.

For example, the image display processing method provided by some embodiments of the present disclosure further includes: sequentially acquiring the compensated display data of all pixels of the current frame image in the N-line period.

For example, in the image display processing method provided by some embodiments of the present disclosure, the backlight subarea includes mini light emitting diodes.

For example, in the image display processing method provided by some embodiments of the present disclosure, N is equal to 1.

At least one embodiment of the present disclosure further provides an image display processing device, including: a storage unit configured to store display data of pixels corresponding to the N rows of backlight partitions in the current frame image; and a local dimming unit configured to receive The transmitted display data of the pixels corresponding to the N backlight subarea in the current frame image, and the backlight value of the N rows of backlight subarea is obtained according to the transmitted display data of the pixels corresponding to the N backlight subarea, Based on the stored display data of the pixels corresponding to the N rows of backlight subregions and the acquired backlight values of the N rows of backlight subregions, obtain the compensated pixels corresponding to the N rows of backlight subregions in the current frame image Display data; the current frame image corresponds to the L row backlight subarea, and N is an integer greater than or equal to 1 and less than L.

For example, in the image display processing device provided by some embodiments of the present disclosure, the local dimming unit includes a backlight value acquisition unit and a display data acquisition unit; the backlight value acquisition unit is configured to correspond to the The display data of the pixels of the N rows of backlight subarea is obtained, and the backlight value of the N rows of backlight subarea is acquired; the display data obtaining unit is configured to be based on the stored display data corresponding to the pixels of the N row of backlight subarea and the obtained all The backlight values of the N rows of backlight subarea are obtained, and the compensated display data of the pixels corresponding to the N rows of backlight subarea in the current frame image are obtained.

For example, in the image display processing device provided by some embodiments of the present disclosure, the storage unit is configured to store at least the display data of the pixels corresponding to the N rows of backlight subregions.

At least some embodiments of the present disclosure also provide an image display processing device, including: a processor; a memory, storing one or more computer program modules, the one or more computer program modules are configured to be executed by the processor The one or more computer program modules include instructions for executing the image display processing method provided by any embodiment of the present disclosure.

At least some embodiments of the present disclosure also provide a display device, including a display panel, a backlight unit, a storage unit, and a local dimming unit; the backlight unit includes L rows of backlight partitions and is driven by a local dimming method; the storage unit, Is configured to store the display data of the pixels corresponding to the N rows of backlight subarea in the current frame image; the local dimming unit is configured to receive the display of the pixels corresponding to the N rows of backlight subarea in the current frame image According to the transmitted display data corresponding to the pixels of the N-row backlight subarea, the backlight value of the N-row backlight subarea is obtained, based on the stored display data of the pixels corresponding to the N-row backlight subarea and the obtained display data The backlight value of the N-row backlight subarea obtains the compensated display data of the pixels corresponding to the N-row backlight subarea in the current frame image; N is an integer greater than or equal to 1 and less than L.

At least one embodiment of the present disclosure further provides a storage medium that non-transitory stores computer-readable instructions. When the non-transitory computer-readable instructions are executed by a computer, the image display provided according to any embodiment of the present disclosure can be executed. Instructions for processing methods.

Description of the drawings

In order to explain the technical solutions of the embodiments of the present disclosure more clearly, the following will briefly introduce the drawings of the embodiments. Obviously, the drawings in the following description only relate to some embodiments of the present disclosure, rather than limit the present disclosure. .

Figure 1A is a schematic diagram of a backlight unit;

FIG. 1B is a schematic diagram of an exemplary system for performing local dimming of the backlight unit shown in FIG. 1A;

Figure 1C is a schematic diagram of an image display processing method;

2A is a flowchart of an image display processing method provided by some embodiments of the present disclosure;

2B is a schematic diagram of an image display processing method provided by some embodiments of the present disclosure;

FIG. 3 is a flowchart of another image display processing method provided by some embodiments of the present disclosure;

FIG. 4 is a flowchart of an example of obtaining a backlight value provided by some embodiments of the present disclosure;

5 is a flowchart of an example of obtaining compensated display data provided by some embodiments of the present disclosure;

FIG. 6 is a schematic diagram of a specific example of an image display processing method provided by some embodiments of the present disclosure;

FIG. 7 is a schematic block diagram of an image display processing apparatus provided by some embodiments of the present disclosure;

FIG. 8 is a schematic block diagram of another image display processing apparatus provided by some embodiments of the present disclosure;

FIG. 9 is a schematic block diagram of a display device provided by some embodiments of the present disclosure; and

FIG. 10 is a schematic diagram of a storage medium provided by some embodiments of the present disclosure.

detailed description

In order to make the objectives, technical solutions, and advantages of the embodiments of the present disclosure clearer, the technical solutions of the embodiments of the present disclosure will be described clearly and completely in conjunction with the accompanying drawings of the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the described embodiments of the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative labor are within the protection scope of the present disclosure.

Unless otherwise defined, the technical terms or scientific terms used in the present disclosure shall have the usual meanings understood by those with ordinary skills in the field to which this disclosure belongs. The "first", "second" and similar words used in the present disclosure do not indicate any order, quantity, or importance, but are only used to distinguish different components. Similarly, similar words such as "a", "one" or "the" do not mean quantity limitation, but mean that there is at least one. "Include" or "include" and other similar words mean that the element or item appearing before the word encompasses the element or item listed after the word and its equivalents, but does not exclude other elements or items. Similar words such as "connected" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "Down", "Left", "Right", etc. are only used to indicate the relative position relationship. When the absolute position of the described object changes, the relative position relationship may also change accordingly.

The present disclosure will be described below through several specific embodiments. In order to keep the following description of the embodiments of the present disclosure clear and concise, detailed descriptions of known functions and known components may be omitted. When any component of the embodiment of the present disclosure appears in more than one drawing, the component is represented by the same or similar reference numeral in each drawing.

The liquid crystal display panel includes a liquid crystal panel and a backlight unit. Generally, a liquid crystal panel includes an array substrate and a counter substrate (such as a color filter substrate) arranged opposite to each other to form a liquid crystal cell. The liquid crystal cell is filled with a liquid crystal layer between the array substrate and the counter substrate; the array substrate is provided with a first polarizer. A second polarizer is arranged on the opposite substrate, and the polarization directions of the first polarizer and the second polarizer are perpendicular to each other. The backlight unit is arranged on the non-display side of the liquid crystal panel and is used to provide a flat light source for the display of the liquid crystal panel. Under the action of the driving electric field formed between the pixel electrode provided on the array substrate and the common electrode provided on the array substrate or the common electrode provided on the opposite substrate, the liquid crystal molecules of the liquid crystal layer are twisted, thereby controlling the passage through the liquid crystal layer The polarization direction of the light, and the light transmittance is controlled under the cooperation of the first polarizer and the second polarizer, so as to achieve grayscale display.

The backlight unit may be a direct type backlight unit or an edge type backlight unit. A direct type backlight unit includes a plurality of point light sources (such as light emitting diodes (LED)) arranged side by side and a diffuser. The light emitted by these point light sources is homogenized by the diffuser, and then enters the liquid crystal panel for use display.

At present, for example, high-resolution liquid crystal display panels are gradually being used in VR devices. During the use of the VR device, since the human eye is closer to the display screen, it is easier to perceive the display effect of the displayed image, so the requirements for the resolution and display quality of the display panel are becoming higher and higher.

For example, for a liquid crystal display panel, the direct-lit backlight unit can be controlled through Local Dimming (LD) technology, thereby improving the display quality of the display panel. The local dimming technology can not only reduce the power consumption of the display panel, but also realize dynamic dimming of the backlight area, greatly improve the contrast of the displayed image, and improve the display quality of the display panel.

The local dimming technology can divide the entire backlight unit into multiple individually driveable backlight blocks, and each backlight block includes one or more LEDs. According to the gray scales to be displayed in different parts of the display screen, the driving current of the LEDs of the backlight partitions corresponding to these parts is automatically adjusted to realize the individual adjustment of the brightness of each partition in the backlight unit, thereby improving the contrast of the display screen. Local dimming technology is usually only applicable to direct-lit backlight units, and multiple LEDs as light sources are, for example, evenly distributed across the entire backplane.

For example, in an exemplary direct-lit backlight unit, the area division diagram of the LED light source in the entire backplane is shown in Figure 1A. The small squares in the figure represent one LED unit, and the multiple areas separated by dotted lines represent multiple backlights. Partition. Each backlight zone includes one or more LED units and can be controlled independently of other backlight zones. For example, multiple LEDs in each backlight subarea are linked, that is, the currents passed by multiple LEDs located in the same backlight subarea are the same, so that the luminous brightness is basically the same.

FIG. 1B is a schematic diagram of an exemplary system for performing local dimming processing on the backlight unit shown in FIG. 1A. For example, the system is implemented by hardware circuits in this example. As shown in Figure 1B, the system includes, for example, DC power supply 10, TCON (Timer Control Register, timing controller)/SOC (System on Chip, system on chip) 11, FPGA (Field-Programmable Gate Array, field programmable gate array) /SOC/TCON 12 and an LED drive circuit board 13 for driving the LED to emit light. As shown in FIG. 1B, the LED driving circuit board 13 includes a Micro-chip Unit (MCU) 131, an LED integrated circuit driving chip 132, a DC/DC circuit 133, and a current sampling circuit 134, and is configured for each frame The image signal is processed to obtain the processed backlight brightness data of each backlight partition, and based on the backlight brightness data, driving currents for different backlight partitions are generated, and these driving currents are output to the corresponding backlight partitions to control the backlights by the current The LEDs in the zones emit light.

MCU 131 receives the backlight local control signal (Local Dimming SPI (Serial Peripheral Interface)) from FPGA/SOC/TCON 12, and performs an AND operation with the brightness modulation signal (DIM_PMW) from TCON11 ( The enable signal (BL_EN) controls whether the AND operation is performed) to obtain the brightness control signals of each backlight partition, and then the MCU 131 outputs these brightness control signals to the LED integrated circuit driver chip 132 to realize the LED of each backlight partition The current control to control the brightness of each backlight zone. For example, the TCON 12 and the TCON 11 may be the same TCON. For example, the backlight local control signal and the brightness modulation signal may both be implemented by the TCON 11, which is not limited in the embodiment of the present disclosure.

For example, the local dimming driving system is powered by an external DC power supply 10, and the power supply voltage Vin is generally 24 volts (V). For example, the DC/DC circuit 133 may use a voltage conversion circuit (for example, a Boost circuit) to boost the supply voltage Vin to the driving voltage required to light up the LEDs of each backlight zone.

Since small fluctuations in the operating voltage on the LED will cause a large change in the current on the LED, the LED in this system can be dimmed by a constant current control method. In order to realize constant current control, the cathodes (LED-) of the multiple LEDs connected in series in the backlight zone are connected to the current sampling circuit 134 to monitor the current stability of the driven LEDs in real time. The current sampling circuit 134 converts the current flowing through the LED into a voltage signal and feeds it back to the LED integrated circuit driver chip 132, which is then fed back to the DC/DC circuit 133 by the LED integrated circuit driver chip 132, and the DC/DC circuit 133 receives the control signal Then adjust the output voltage input to the LED anode (LED+) to realize the LED current stabilization function. For example, the above-mentioned converted voltage signal is sampled, and the sampled voltage is compared with a preset reference voltage. When the sampling voltage is higher than the reference voltage, the current sampling circuit 134 outputs a control signal to make the DC/DC circuit 133 reduce the output voltage, thereby reducing the current flowing through the LED; otherwise, the current sampling circuit 134 outputs another control signal to make The DC/DC circuit 133 boosts the output voltage to increase the current flowing through the LED. That is, the circuit sampling circuit 134 can be used as a negative feedback circuit to realize constant current control of the LED, so that the LED can work stably.

The exemplary backlight unit shown in FIGS. 1A and 1B includes a plurality of rectangular backlight regions arranged in an array. The local dimming technology can adjust the brightness of the corresponding backlight partition according to the gray level of the screen content displayed by the liquid crystal display panel. , For the higher screen brightness (gray scale), the brightness of the corresponding backlight partition is also high, and for the lower screen brightness, the brightness of the corresponding backlight partition is also low, so as to reduce the backlight power consumption and improve the contrast of the display screen , The purpose of enhancing the display quality.

However, the traditional local dimming technology usually uses a frame buffer to store the display data of the current frame image, and performs statistics on the display data of the current frame image to obtain the corresponding backlight value. For example, as shown in FIG. 1C, after the vertical synchronization signal Vsync is detected, the backlight value obtained from the current frame (for example, the Nth (N is an integer greater than 1) frame shown in FIG. 1C) image can only be used To compensate for the display data of the image of the next frame (for example, the N+1th frame shown in FIG. 1C), that is, perform data calculations based on the display data of the next frame of image and the backlight value corresponding to the current frame of image Obtain the compensated display data of the next frame of image. Correspondingly, the compensated display data of the display image of the current frame is based on the display data of the current frame of image (for example, uncompensated) and the backlight value calculated according to the display data of the previous frame of image (for example, the N-1th The backlight value corresponding to the frame image) is obtained.

Since the compensated display data of the current frame image is calculated by the backlight value corresponding to the previous frame image and the display data of the current frame image, rather than calculated by the backlight value corresponding to the current frame image and the display data of the current frame image Therefore, this method of calculating the compensated display data of the displayed image will have the problem of the delay mismatch between the backlight information and the image information, which is not suitable for applications such as VR and other applications that require high latency in. Moreover, because the traditional local dimming technology needs to store all the display data of a frame of image, the amount of stored data is very large, and it needs to take up a large storage space, so it needs to be equipped with a large capacity high-speed memory, which increases the cost. , Is not conducive to product promotion.

At least one embodiment of the present disclosure provides an image display processing method of a display device. The display device includes a backlight unit. The backlight unit includes L rows of backlight partitions and is driven by a local dimming method. The image display processing method includes: The display data of the pixels in the image corresponding to the N rows of backlight subregions is obtained, and the backlight values of the N rows of backlight subregions are obtained; the current frame image is obtained based on the display data of the pixels corresponding to the N rows of backlight subregions and the obtained backlight values of the N rows of backlight subregions The compensated display data of pixels corresponding to the N rows of backlight partitions in, N is an integer greater than or equal to 1 and less than L.

At least one embodiment of the present disclosure also provides an image display processing device, a display device, and a storage medium corresponding to the foregoing image display processing method.

The image display processing method provided by the above embodiments of the present disclosure can save the storage space of the display panel, and can compensate the display data of the current frame of the displayed image based on the backlight value corresponding to the current frame of image, thereby solving the problem of backlight information and image information. The delay mismatch problem can further improve the contrast of the displayed image and the display effect of the screen, reduce the power consumption of the display panel, and reduce the cost of the display panel.

The reason why the traditional local dimming technology cannot realize real-time frame calculation is that the calculation time of the entire frame of data backlight is too long and cannot meet the requirement of refresh time. However, the present disclosure calculates the backlight value of at least one row of backlight partitions immediately after calculating the backlight of the row. Compensation of the display data of the pixels corresponding to the subarea. While performing the display data compensation of the pixels corresponding to the backlight subarea of this row, the backlight value of the next line of backlight subarea is calculated, which only causes the delay of the display data compensation for the first line of backlight subarea. However, in the VR system, there is a delay due to the need to wait for the response of the liquid crystal, so it does not affect the normal use of the VR system, so that the backlight value corresponding to the current frame image can compensate for the display data of the current frame display image. Solve the problem of the delay mismatch between the backlight information and the image information, thereby improving the contrast of the displayed image and the display effect of the screen, reducing the power consumption of the display panel, and reducing the cost of the display panel.

The embodiments and examples of the present disclosure will be described in detail below with reference to the accompanying drawings.

FIG. 2A is a flowchart of an image display processing method of a display device according to some embodiments of the present disclosure. For example, the display device includes a backlight unit and a display panel, and the backlight unit is disposed on the non-display side of the display panel, includes a plurality of backlight partitions, and is driven by a local dimming method. For example, the multiple backlight partitions of the backlight unit may be arranged in an array arrangement as shown in FIG. 1A, for example, including multiple rows (for example, at least three rows) and multiple columns (for example, at least five columns). It can also be set in other ways, for example, an irregular arrangement, which is not limited in the embodiments of the present disclosure. For example, each backlight subarea of the backlight unit includes one or more LEDs. For example, mini-LEDs can be used. For example, the device size is 10 μm-100 μm. The mini light emitting diode has the advantages of small size, thin thickness, high color gamut, and narrow frame design. For example, the display device may be a liquid crystal display (LCD) or an electronic paper display device. For example, the display device may be a virtual reality device, such as a virtual display helmet. Correspondingly, the display panel of the display device may be a liquid crystal display panel or an electronic paper display panel, etc. The embodiments of the present disclosure do not limit the specific structure and type of the display panel (for example, vertical electric field type or horizontal electric field type liquid crystal display panel).

The image display processing method of some embodiments of the present disclosure may be implemented in software, loaded and executed by a processor in a display panel, for example, loaded and executed by a graphics processing unit (GPU) in the display panel; or, Realization at least in part by means of software, hardware, firmware or any combination thereof can solve the problem of the delay mismatch between the backlight information and the image information in the display panel, and save the storage space of the display panel. For example, the graphics processor may be an internal component of the display device (for example, an all-in-one form of a VR system), or a component of an external device (for example, a computer) of the display device (for example, a split of the VR system). Machine format), the embodiment of the present disclosure does not limit this.

For example, the LCD display device may also include a pixel array, a data decoding circuit, a timing controller, a gate driver, a data driver, and a storage device (such as flash memory, etc.). The data decoding circuit receives the display input signal and decodes it to obtain the display data signal; the timing controller outputs the timing signal to control the synchronous operation of the gate driver, data driver, etc., and can perform gamma correction on the display data signal, Input the processed display data signal to the data driver for display operation. These components can be implemented in a conventional manner, and the embodiments of the present disclosure are not limited, and will not be repeated here.

Hereinafter, an image display processing method of a display device provided by some embodiments of the present disclosure will be described with reference to FIG. 2A. As shown in FIG. 2A, in one example, the image display processing method includes step S120 to step S130; in another example, the image display processing method further includes step S110. Steps S110 to S130 of the image display processing method and their respective exemplary implementation manners are respectively introduced below.

Step S110: Store and transmit display data of pixels corresponding to the N rows of backlight subarea in the current frame of image.

Step S120: Obtain the backlight values of the N rows of backlight subregions according to the display data of the pixels corresponding to the N rows of backlight subregions in the current frame image.

Step S130: Based on the display data of the pixels corresponding to the N rows of backlight partitions and the acquired backlight values of the N rows of backlight partitions, obtain the compensated display data of the pixels corresponding to the N rows of backlight partitions in the current frame image.

Here, the current frame image corresponds to L-row backlight subregions, that is, the backlight unit includes L-row backlight subregions, and N is an integer greater than or equal to 1 and less than L.

For example, in some embodiments of the present disclosure, the backlight unit includes multiple rows of backlight subregions, and each row of backlight subregions may correspond to one or more rows of pixels in the current frame image. For example, in the embodiment of the present disclosure, taking the N rows of backlight subregions as a period, sequentially perform the above-mentioned image display processing on the display data of the pixels corresponding to each N row of backlight subregions to obtain all the compensated display data of the current frame image . For example, in some embodiments of the present disclosure, when calculating the compensated display data of the pixels corresponding to the N rows of backlight partitions, the backlight values of the N rows of backlight partitions calculated in step 120 may correspond to the N rows. Perform display data compensation for pixels of, and calculate the backlight value of at least one row of backlight subregions on each of the upper and lower rows adjacent to the N row based on step S120, so as to achieve real-time calculation of the compensated display data of the pixels corresponding to each row of backlight subregions .

For example, in some embodiments of the present disclosure, "pixels corresponding to N rows of backlight subregions" refer to pixels corresponding to the N rows of backlight subregions. For example, it can be understood as the display panel on the front projection direction of the backlight subregion. Pixels. For example, the N rows of backlight partitions may be 1 row, 2 rows, 3 rows, etc., which is not limited in the embodiment of the present disclosure. For example, in the process of processing the entire frame of the picture with N-line cycles, when the number of lines of the last remaining backlight partition is less than N lines, the remaining lines can be used as a cycle for backlight value calculation and display data compensation.

For example, as shown in FIG. 2B, the image display processing method provided by some embodiments of the present disclosure, compared with the image display processing method in FIG. 1C, can obtain the compensated display of the current frame image based on the backlight value corresponding to the current frame image data. For example, the compensated display data of the Nth frame image may be obtained based on the backlight value corresponding to the Nth frame image, and the compensated display data of the N+1th frame image may be based on the backlight value corresponding to the N+1th frame image. Obtained, and so on.

For step S110, for example, since the display data of the pixels corresponding to the N rows of backlight partitions are used twice in the calculation of the corresponding backlight value and the compensation of the corresponding display pixels, it is necessary to obtain (for example, store, transmit) the current The frame image corresponds to the display data of this part of the backlight zone.

For example, in some embodiments of the present disclosure, before obtaining the backlight value of the N-row backlight subarea, the display data of the pixels corresponding to the N-row backlight subarea in the current frame image is written into the storage unit to obtain two copies of the display data. Display data (including the written display data itself). For example, after a piece of display data is transferred to the display driver chip, it is temporarily stored in the register. For example, the display data in the register is written into the storage unit. At this time, there is one copy of the display data in the register and the storage unit, thereby including two copies of the display data. Afterwards, the local dimming unit (Local Dimming IP) calls the display data in the register to obtain the backlight value of the N-row backlight partition; and the other display data is stored in the storage unit for subsequent use, for example, in the subsequent process The display data in the storage unit can be read by the local dimming unit to obtain the compensated display data of the pixels corresponding to the N rows of backlight subarea in the current frame image. For example, this register is used to buffer the data stream in the display driver chip. For example, the storage unit may be a part of the storage unit in the display device, that is, a RAM (random access memory) of a certain size in the display device. For example, this part of the storage unit is also used to store display data in conventional applications. For example, this part of the storage unit can store the entire frame of data. For example, the storage unit may also be another set of registers.

In some embodiments of the present disclosure, the storage unit stores at least the display data of the pixels corresponding to the N rows of backlight subareas. For example, when the display data of pixels corresponding to N rows of backlight subarea enters the local dimming unit to calculate the backlight value of the N rows of backlight subarea, the storage unit stores the display data of the pixels corresponding to the N rows of backlight subarea. When the domain dimming unit performs display data compensation of pixels in the N rows of backlight subregions, after the display data of the pixels corresponding to the N rows of backlight subregions stored in the storage unit is read, the subsequent display data is sequentially entered into the storage unit for storage, and For the specific process of overwriting the read display data, please refer to the working process of the conventional storage device, which will not be repeated here.

The display data corresponding to the pixels of the N rows of backlight partitions will no longer be used after being recalled from the storage unit for compensation calculations. The subsequent entry of display data can overwrite the previous data. Therefore, the storage unit only needs to store at least the corresponding The display data of the pixels in the N-row backlight subarea can meet the demand.

In some embodiments of the present disclosure, by using part of the storage unit in combination with the local dimming unit that obtains the backlight value, the corresponding backlight value can be obtained according to the display data of the current frame image, and based on the display of the current frame image The backlight value corresponding to the data and the display data of the current frame image obtain the compensated display data of the current frame image, and the display data of the pixels corresponding to the current N-row backlight partition can be compensated while the next N-row backlight partition is performed. The calculation of the backlight value also avoids the use of the backlight value corresponding to the display data of the previous frame of image, thereby solving the problem of delay and mismatch between the backlight information and the image information.

At the same time, because the storage unit is a part of the storage unit in the display panel, it only stores the display data of the pixels corresponding to at least N rows of backlight partitions in the current frame image, thereby saving the storage space of the display panel and reducing the power consumption of the display panel. , Reduce the cost of the display panel.

For example, a storage unit and a transmission unit may be provided, and the storage unit and the transmission unit respectively store and transmit the display data of the pixels corresponding to at least N rows of backlight partitions in the current frame image; for example, the transmission unit may be a wired unit or a wireless transmission unit. The wired transmission can be an electrical signal transmission device or an optical signal transmission device. The electrical signal transmission device transmits data through, for example, a coaxial cable, and the optical signal transmission device transmits data through, for example, an optical fiber, and they are based on respective related data transmission standards, such as a synchronous digital system. (SDH), Dense Wavelength Division Multiplexing (DWDM), etc. The wireless transmission unit can be based on invalid communication devices of various standards, such as WIFI, Bluetooth, ZigBee, infrared, 2G/3G/4G/5G mobile communication, etc. For example, the storage unit and transmission unit may include a central processing unit (CPU), an image processor (GPU), a tensor processor (TPU), a field programmable logic gate array (FPGA), or have data processing capabilities and/or instructions Other forms of processing units with execution capabilities and corresponding computer instructions.

For step S120, for example, after the display data of the pixels corresponding to the N rows of backlight divisions are transmitted to the local dimming unit, the local dimming unit is based on the transmitted display data of the pixels corresponding to the N rows of backlight divisions. To obtain the backlight values of the N rows of backlight subregions.

FIG. 4 is a flowchart of an example of obtaining a backlight value provided by some embodiments of the present disclosure. That is, FIG. 4 is a flowchart of an example of step S120 shown in FIG. 2A. For example, in the example shown in FIG. 4, the method for acquiring the backlight value includes step S121 to step S122. Hereinafter, the image display processing method of the embodiment of the present disclosure will be described with reference to FIG. 4.

Step S121: respectively count the gray values of the display data of the pixels corresponding to each backlight subarea in each row of the N rows of backlight subarea.

For example, the gray values of the display data of the pixels corresponding to the respective backlight subregions in each row of the two rows of backlight subregions are separately counted.

For example, the gray value of the display data of the pixels corresponding to each backlight subarea in each row of the two rows of backlight subarea can be counted separately through the histogram. It should be noted that other statistical methods in the art can also be used to calculate the gray value of the display data of the pixels corresponding to each backlight zone, which is not limited in the embodiment of the present disclosure.

For example, by using histogram statistics to determine the backlight value of the backlight zone, it is possible to filter out deviation data such as a smaller number of higher grayscales or lower grayscales, so that the calculation of the gray value data is more accurate, so that The display brightness of the display panel is closer to the target brightness.

Step S122: Obtain the backlight value of each backlight partition based on the gray value of the display data of the pixel corresponding to each backlight partition.

For example, calculate the gray value of the display data of the pixels corresponding to each backlight partition according to the gray value at 80% to 90% sorted from small to large, or the gray value of the display data of the pixels corresponding to each backlight partition The average value of is set as the backlight value of the corresponding backlight zone. For example, if the display data of the pixel corresponding to the backlight partition is filtered out and there are 100 data remaining after the deviation data is filtered, the grayscale value at 90% of the display data of the pixel corresponding to a backlight partition is taken as the backlight value of the backlight partition That is, after sorting the remaining display data from small to large, the 90th display data of the 100 display data is taken as the backlight value of the backlight subarea.

It should be noted that the method for determining the backlight value of each backlight zone can also be determined according to other methods in the art, which is not limited in the embodiment of the present disclosure.

For step S130, for example, based on the display data of the pixels corresponding to the N rows of backlight partitions stored in step S110 and the backlight values of the N rows of backlight partitions acquired in step S120, the pixels corresponding to the N rows of backlight partitions in the current frame image are acquired Display data after compensation. For example, the compensated display data is the compensated display data of each pixel in each backlight zone.

FIG. 5 is a flowchart of an example of obtaining compensated display data provided by some embodiments of the present disclosure. That is, FIG. 5 is a flowchart of an example of step S130 shown in FIG. 2A. For example, in the example shown in FIG. 5, the method for acquiring the compensated display data includes step S131 to step S132. Hereinafter, an image display processing method according to an embodiment of the present disclosure will be described with reference to FIG. 5.

Step S131: Fitting the backlight diffusion model based on the backlight value of each backlight subarea in the N rows, and obtain the actual backlight value of each pixel corresponding to each backlight subarea in the N rows based on the backlight diffusion model.

For example, based on the backlight value of each backlight subarea in the N rows and the backlight value of the backlight subarea adjacent to at least one row (for example, two rows) up and down the backlight subarea of the N rows, the backlight diffusion model is obtained by fitting, and the backlight diffusion model is obtained The actual backlight value of each pixel corresponding to each backlight subarea in the N rows.

For example, the actual backlight value of a certain pixel in the area of the display panel corresponding to one backlight zone will be described as an example. Since the light emitted by each LED in the backlight unit will cause light diffusion and other phenomena, the backlight brightness (that is, the backlight value) emitted by the LEDs located at different positions in the backlight unit all have an effect on the actual backlight brightness at the location of the pixel. For example, the closer the pixel is to an LED, the greater the influence of the brightness of the light emitted by the LED on the actual backlight brightness at the location of the pixel. Therefore, it is necessary to integrate the various LEDs in the backlight unit with different distances to the pixel. The coupling of the brightness at the location of the pixel to obtain the actual backlight brightness at the location of the pixel. Therefore, it is necessary to fit their backlight diffusion models at the location of the pixel according to the distance between each LED in each backlight zone and the pixel, and calculate the actual backlight brightness of the pixel based on these backlight diffusion models, so that each backlight The actual backlight brightness of each pixel corresponding to the partition. For example, the backlight diffusion model can be actually measured according to conventional methods in the field, and will not be repeated here.

For example, in an example, the backlight diffusion model can be expressed as:

Among them, n is the maximum value of polynomial fitting, i is an integer greater than or equal to 0 and less than or equal to n, ai/bi is the coefficient of the corresponding order of different piecewise functions, x is the pixel distance from the pixel to the center of the specific area, d1 Is the pixel distance of the segmented function, d2 is the farthest extended pixel distance of valid data, and pxf(x) represents the actual backlight brightness corresponding to each pixel.

It should be noted that the backlight diffusion model is not limited to the above formula expression form, and it is determined according to the actual fitting situation, which is not limited in the embodiment of the present disclosure.

For example, in the embodiment of the present disclosure, the N rows of backlight partitions correspond to the inside of the current frame image (that is, the outermost row of backlight partitions are not included), and the backlight values of the upper and lower rows of backlight partitions of the N rows of backlight partitions can be combined. And the backlight value of the backlight subarea of the N rows, and the actual backlight value of each pixel corresponding to each backlight subarea in the N rows is obtained based on the backlight diffusion model.

For example, when the backlight partition of the N rows includes two rows of backlight partitions, if the current row of backlight partitions is not the first row of backlight partitions, due to the relevant data of the previous row of backlight partitions adjacent to the current row of backlight partitions (for example, The backlight value) has been obtained in the previous calculations. Therefore, in the subsequent calculations, it can be directly taken into account. You only need to wait for the calculation of the relevant data (for example, the backlight value) of the next row of backlight partitions to complete the calculation. Calculation of the actual backlight value of the row backlight partition. If the current row of backlight subarea is the first row of backlight subarea, then the actual backlight value of the current row of backlight subarea can be calculated only according to the backlight value of the first row of backlight subarea and the second row of backlight subarea, for example, you can copy The backlight value of the first row of backlight subregions is used as the backlight value of the previous row of backlight subregions of the first row, and the backlight values of the first two rows of backlight subregions are combined to calculate the actual backlight value of the first row of backlight subregions. For example, it may include the previous row or multiple rows of backlight subarea adjacent to the current row and/or the next row or multiple rows of backlight subarea adjacent to the current row, and the actual backlight value of the current row of backlight subarea is calculated in combination with the current row of backlight subarea, The embodiment of the present disclosure does not limit this.

Since one backlight subarea corresponds to the display data of multiple rows and columns of pixels, the storage space required for the backlight value of a row of backlight subarea is much less than the storage space of the display data of its corresponding pixel, so that it can be used on the premise of not requiring a large amount of storage space. , Store the backlight value of each row of backlight subarea as needed. For example, in the process of compensating the display data, the backlight value may be used multiple times, so the backlight value can all be stored. In another embodiment, the backlight value can be deleted after multiple uses. For example, according to the backlight model, the actual backlight value of the backlight partition of a row needs to be based on the backlight of the adjacent rows of the backlight partition of the row. When the actual backlight value of the next row of the row is calculated, the backlight value of the backlight partition of the row will be used in the actual backlight value calculation of the previous row, this row, and the next row of the row in order. The data of the backlight value of this row can be overwritten by the data of the backlight value calculated subsequently, that is, deleted. The specific process can refer to the working process of the conventional storage device, which will not be repeated here.

Step S132: Compensate the display data of the pixels corresponding to the N rows of backlight subregions in the current frame of the image according to the actual backlight value to obtain the compensated display data.

Since the display brightness (luminous intensity) of each pixel in a liquid crystal display panel at a certain moment is not only related to the actual backlight value at that moment, but also related to the display data of the pixel, when the backlight diffusion model is used to obtain each pixel in the backlight partition After the actual backlight value is set, it may be necessary to perform display compensation on the display data of the pixels to make the display panel achieve the desired display brightness.

For example, the compensated display data of the pixel can be obtained according to the following formula:

Vc=V0*(BL_M/BL_P)

Among them, Vc represents the compensated display data of a certain pixel among all the pixels corresponding to the N-row backlight partition, V0 represents the display data before the pixel is compensated, BL_M represents the backlight value corresponding to the pixel at the highest gray level, BL_P Indicates the actual backlight value corresponding to the pixel.

It should be noted that the highest gray level may be 255, 1023, etc., and the specific setting may be determined according to actual conditions, which is not limited in the embodiment of the present disclosure.

In some embodiments of the present disclosure, since the compensation of the display data of the pixels corresponding to the N rows of backlight subregions needs to be calculated based on the backlight values of the backlight subregions of at least one row adjacent to the upper and lower rows of the N rows of backlight subregions, the storage unit needs at least To store the display data of the pixels corresponding to the N+1 rows of backlight partitions, that is, to compensate for the display data of the pixels corresponding to the N rows of backlight partitions, it is necessary to wait for the display data of the pixels corresponding to the next row of backlight partitions to be stored in the storage unit and calculate After the backlight value of the row is completed, the display data of the pixels corresponding to the N rows of backlight subarea is compensated.

The image display processing method provided by the above embodiments of the present disclosure can save the storage space of the display panel, and can compensate the display data of the current frame of the displayed image based on the backlight value corresponding to the current frame of image, thereby solving the problem of backlight information and image information. The delay mismatch problem can further improve the contrast of the displayed image and the display effect of the image, reduce the power consumption of the display panel, and reduce the cost of the display panel.

FIG. 6 is a schematic diagram of a specific example of an image display processing method provided by some embodiments of the present disclosure, and N=1 in this embodiment. As shown in FIG. 6, r represents the number of pixel rows corresponding to a row of backlight partitions, 2160 represents the number of pixel columns of the display panel, and 24bit represents the display data included in each pixel (the number of bits is 24bit). When the vertical synchronization signal Vsync is activated, the display data of the pixels of the current frame image corresponding to each row of backlight partitions, for example, 1, 2, 3, ..., enter the local dimming unit in a row in a row, and sequentially Obtain the histogram statistics of the display data of the pixels corresponding to each row of backlight partitions, and at the same time, the r row of display data is written into the RAM for storage. For example, the 256-level grayscale distribution of the display data of the pixel corresponding to each backlight partition is obtained through histogram statistics, h represents the number of rows of the backlight partition corresponding to the display panel, w represents the number of columns of the backlight partition corresponding to the display panel, and 13bit represents The number of pixels that each grayscale histogram can hold, that is, the number of pixels in each backlight partition is less than or equal to 2 ¹³ , w*256*13bit means that each Histo includes the histogram statistics corresponding to w backlight partitions, And each of the w histogram statistics counts the 256 gray levels of the display data of the pixels corresponding to the corresponding backlight partition and the number of pixels corresponding to each gray level. For example, each of the 256 gray levels is the largest Corresponding to 2 ¹³ pixels (for example, in the case of the same gray scale of all pixels on a backlight partition, the number of pixels corresponding to the gray scale is 2 ¹³ ), so that the corresponding to each backlight partition is calculated through the histogram The number of gray levels of the pixels, so that the backlight value of the corresponding backlight subarea can be determined according to the number of pixels corresponding to each gray level in the histogram corresponding to each backlight subarea (refer to step S122). Histo1 represents (or includes) the w histogram statistics corresponding to the w backlight partitions in the first row, and Histo2 represents (or includes) the w histogram statistics corresponding to the w backlight partitions in the second row. Statistics, Histo3 represents (or includes) the histogram statistics corresponding to the w backlight partitions in the third row, .... After statistics of the display data of the pixels corresponding to each backlight partition of a row of backlight partitions are completed, the backlight values of the pixels corresponding to the row of backlight partitions can be obtained (for example, obtained by step S120).

As shown in Figure 6, while performing histogram statistics in the local dimming unit, another piece of display data is stored in the partial storage unit RAM. After obtaining the backlight values of the first two rows of backlight partitions according to the above method, at this time, the stored data in the RAM includes the display data of the pixels corresponding to the two rows of backlight partitions (the first row and the second row); read part of the storage unit The stored display data of the pixels corresponding to the backlight partition in the first row is calculated with the actual backlight value (for example, the actual backlight value obtained based on the backlight diffusion model formed by the backlight partition in the first two rows) to obtain the display panel The compensated display data of each pixel corresponding to the first row of backlight subarea in the current frame image, such as 1', at the same time, the display data of the pixel corresponding to the third row of backlight subarea is written into RAM (the first row of data Covering), and the calculation of the backlight value of the backlight partition in the third row is completed. At this time, the data stored in the RAM still only includes the display data of the pixels corresponding to the two backlight partitions (rows 2 and 3); then it can be read Take the display data of the pixels corresponding to the second row of backlight partitions stored in the partial storage unit and calculate with the actual backlight value (for example, the actual backlight value obtained based on the backlight diffusion model formed by the first three rows of backlight partitions) to obtain the display The compensated display data of each pixel corresponding to the second line of the backlight subarea in the current frame of the panel, such as 2', at the same time, the display data of the pixel corresponding to the fourth line of the backlight subarea is written in the RAM (the second Line data coverage). At this time, the data stored in RAM still only includes the display data of the pixels corresponding to the two rows of backlight subarea (row 3 and row 4), .... In the whole process, only two rows of display data of pixels corresponding to the backlight subarea are stored in RAM, and real-time compensation of the display data of the current frame is realized. It should be noted that each data shown in FIG. 6 can be specifically set according to actual conditions, which is not limited in the embodiment of the present disclosure.

FIG. 3 is a flowchart of another image display processing method provided by some embodiments of the present disclosure. As shown in FIG. 3, based on the example shown in FIG. 2A, the image display processing method further includes step S140 and step S150. The steps S140 and S150 are described in detail below.

Step S140: Input the backlight values of the N rows of backlight partitions to the backlight unit.

For example, input the backlight values of the N rows of backlight partitions to the LED driving circuit board 13. The LED driving circuit board 13 generates driving currents for each backlight subarea according to the backlight value of each backlight subarea, and outputs these driving currents to the corresponding backlight subarea, so as to control the LEDs in the backlight subarea to emit light through the current.

Step S150: Input the compensated display data of the pixels corresponding to the N rows of backlight subregions in the current frame image to the display panel of the display device to perform display on the display panel.

For example, the compensated display data is transmitted to the data driver of the display panel, and transmitted to the corresponding pixels of the display panel through the data driver. The pixels in the display panel are turned on line by line under the drive of the gate scan signal to control the deflection of the liquid crystal molecules of the liquid crystal layer in the pixels corresponding to the display panel according to the compensated display data transmitted by the data driver, so that the backlight unit emits The light is transmitted through, so that the display image is displayed on the display panel.

For example, a local dimming unit for obtaining backlight values and compensated display data can be provided, and the local dimming unit can obtain the compensated display data of pixels corresponding to the N rows of backlight partitions; for example, A central processing unit (CPU), a field programmable logic gate array (FPGA) or other forms of processing units with data processing capabilities and/or instruction execution capabilities and corresponding computer instructions implement the local dimming unit. For example, the processing unit may be a general-purpose processor or a special-purpose processor, and may be a processor based on the X86 or ARM architecture.

It should be noted that the flow of the display compensation method provided by some embodiments of the present disclosure may include more or fewer operations, and these operations may be executed sequentially or in parallel. Although the flow of the display compensation method described above includes multiple operations appearing in a specific order, it should be clearly understood that the order of the multiple operations is not limited. The display compensation method described above can be executed once or multiple times according to predetermined conditions.

FIG. 7 is a schematic block diagram of an image display processing apparatus provided by some embodiments of the present disclosure. For example, in an example, the image display processing device 100 includes a storage unit 110 and a local dimming unit 120. For example, these units may be implemented in the form of hardware (for example, circuit) modules, software modules, and any combination thereof.

The storage unit 110 is configured to store display data of pixels corresponding to the N rows of backlight subregions in the current frame of image. For example, the storage unit 110 can implement step S110, and the specific implementation method can refer to the related description of step S110, which will not be repeated here. For example, after the display data stored in the storage unit 110 is used to calculate the backlight value of the corresponding row of backlight subarea and the compensated display data of the pixel corresponding to the row of backlight subarea, it is overwritten by the display data of the pixel corresponding to the next row of backlight subarea. , That is, the previously stored display data will be deleted.

The local dimming unit 120 is configured to receive the transmitted display data of pixels corresponding to the N rows of backlight subarea in the current frame of image, and obtain the N rows of backlight subarea according to the transmitted display data of the pixels corresponding to the N rows of backlight subarea. Based on the stored display data of the pixels corresponding to the N rows of backlight partitions and the acquired backlight values of the N rows of backlight partitions, the compensated display data of the pixels corresponding to the N rows of backlight partitions in the current frame image is obtained. For example, the local dimming unit 120 can implement step S120 and step S130, and the specific implementation method can refer to the related description of step S120 and step S130, which will not be repeated here.

For example, in another example, the local dimming unit 120 may include a backlight value acquisition unit 121 and a display data acquisition unit 122.

For example, the backlight value acquisition unit 121 is configured to acquire the backlight values of the backlight sub-areas of the N rows according to the transmitted display data of pixels corresponding to the backlight sub-areas of the N rows. For example, the backlight value acquisition unit 121 can implement step S120, and its specific implementation method can refer to the related description of step S120, which will not be repeated here.

For example, the display data obtaining unit 122 is configured to obtain the compensation of the pixels corresponding to the N rows of backlight subregions in the current frame image based on the stored display data of the pixels corresponding to the N rows of backlight subregions and the obtained backlight values of the N rows of backlight subregions. After the display data. For example, the display data obtaining unit 122 may implement step S130, and the specific implementation method can refer to the related description of step S130, which will not be repeated here.

It should be noted that the image display processing device provided by the embodiments of the present disclosure may include more or fewer circuits or units, and the connection relationship between the respective circuits or units is not limited and may be determined according to actual requirements. The specific structure of each circuit is not limited, and may be composed of analog devices according to the circuit principle, or may be composed of digital chips, or be composed in other suitable manners.

FIG. 8 is a schematic block diagram of another image display processing apparatus provided by some embodiments of the present disclosure. As shown in FIG. 8, the image display processing apparatus 200 includes a processor 210, a memory 220, and one or more computer program modules 221.

For example, the processor 210 and the memory 220 are connected through a bus system 230. For example, one or more computer program modules 221 are stored in the memory 220. For example, one or more computer program modules 221 include instructions for executing the image display processing method provided by any embodiment of the present disclosure. For example, instructions in one or more computer program modules 221 may be executed by the processor 210. For example, the bus system 230 may be a commonly used serial or parallel communication bus, etc., which is not limited in the embodiments of the present disclosure.

For example, the processor 210 may be a central processing unit (CPU), a field programmable logic gate array (FPGA), or another form of processing unit with data processing capability and/or instruction execution capability, and may be a general-purpose processor or a dedicated processing unit. And can control other components in the image display processing apparatus 200 to perform desired functions.

The memory 220 may include one or more computer program products, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and/or nonvolatile memory. The volatile memory may include, for example, random access memory (RAM) and/or cache memory (cache). The non-volatile memory may include read-only memory (ROM), hard disk, flash memory, etc., for example. One or more computer program instructions may be stored on a computer-readable storage medium, and the processor 210 may run the program instructions to implement the functions (implemented by the processor 210) and/or other desired functions in the embodiments of the present disclosure, For example, image display processing methods. Various application programs and various data can also be stored in the computer-readable storage medium, such as backlight values of the N-row backlight subarea and various data used and/or generated by the application programs.

It should be noted that, for the sake of clarity and conciseness, the embodiment of the present disclosure does not provide all the components of the image display processing device 200. In order to realize the necessary functions of the display compensation device 200, those skilled in the art can provide and set other unshown component units according to specific needs, which are not limited in the embodiments of the present disclosure.

Regarding the technical effects of the image display processing device 100 and the image display processing device 200 in different embodiments, reference may be made to the technical effects of the image display processing method provided by the embodiments of the present disclosure, which will not be repeated here.

At least one embodiment of the present disclosure further provides a display device including a display panel, a backlight unit, and the image display processing device provided in any embodiment of the present disclosure. FIG. 9 is a schematic block diagram of a display device provided by some embodiments of the present disclosure. As shown in FIG. 9, the display device 300 includes an AP (Application Processor) 301, a display driver chip 304, a display panel 302, a backlight unit 303, and the image display processing device 100 provided by any embodiment of the present disclosure.

For example, the backlight unit 303 includes a plurality of backlight zones and is driven by a local dimming method.

For example, the image display processing device 100 may be the image display processing device 100 shown in FIG. 7, and includes a storage unit 110 and a local dimming unit 120.

For example, the storage unit 110 is configured to store display data of pixels corresponding to the N rows of backlight subregions in the current frame image. For example, the storage unit is configured to store display data of pixels corresponding to at least N rows of backlight subregions. For example, after obtaining compensated display data of pixels corresponding to the N rows of backlight subregions in the current frame of image, the storage The display data of is deleted.

The local dimming unit 120 is configured to receive the transmitted display data of pixels corresponding to the N rows of backlight subarea in the current frame of image, and obtain the N rows of backlight subarea according to the transmitted display data of the pixels corresponding to the N rows of backlight subarea. Based on the stored display data of the pixels corresponding to the N rows of backlight partitions and the acquired backlight values of the N rows of backlight partitions, the compensated display data of the pixels corresponding to the N rows of backlight partitions in the current frame image is obtained.

For example, after the display data of the current frame image is transmitted from the AP 301 to the display driver chip 304, a copy of the display data of the pixels corresponding to the N rows of backlight partitions in the current frame image is transmitted to the local dimming unit 120 Backlight statistics are performed to obtain the backlight value, and another piece of display data is stored in the storage unit 110. After obtaining the backlight value, the local dimming unit 120 obtains the stored display data from the storage unit 110, calculates the backlight value and the display data of the corresponding pixel, and obtains the display data compensated by the corresponding display data.

For example, the backlight value is, for example, transmitted to the LED driving circuit board in the backlight unit 303, thereby controlling the light emission of the LEDs in the corresponding backlight subarea included in the backlight unit 303; at the same time, the compensated display data is sent, for example, to the driver in the display panel 302. A chip (not shown in the figure, for example, a data driver) to control the deflection of the liquid crystal molecules of the liquid crystal layer corresponding to the pixel in the display panel, so that the light emitted by the backlight unit 303 is transmitted through, so that the display is displayed on the display panel 302 image.

For example, the display device 100 may be a thin film transistor liquid crystal display device, an electronic paper display device, etc., for example, the display device is a VR device, such as a VR helmet, etc., which is not limited in the embodiments of the present disclosure.

For example, these components are interconnected by a bus system and/or other forms of coupling mechanisms (not shown). For example, the bus system may be a commonly used serial or parallel communication bus, etc., which is not limited in the embodiments of the present disclosure. It should be noted that the components and structure of the display device 300 shown in FIG. 9 are only exemplary and not restrictive, and the display device 300 may also have other components and structures as required.

For the technical effects of the display device 300 provided by some embodiments of the present disclosure, reference may be made to the corresponding description of the image display processing method in the above-mentioned embodiments, which will not be repeated here.

Some embodiments of the present disclosure also provide a storage medium. FIG. 10 is a schematic diagram of a storage medium provided by some embodiments of the present disclosure. For example, the storage medium 400 non-transitory stores computer-readable instructions 401, and when the non-transitory computer-readable instructions 401 are executed by a computer (including a processor), the image display processing method provided in any embodiment of the present disclosure can be executed.

For example, the storage medium may be any combination of one or more computer-readable storage media. For example, a computer-readable storage medium contains computer-readable program code for obtaining the backlight value of the N-row backlight subarea, and another computer-readable The storage medium contains computer-readable program codes for obtaining the compensated display data of the pixels corresponding to the N rows of backlight partitions in the current frame of image. For example, when the program code is read by a computer, the computer can execute the program code stored in the computer storage medium, and execute, for example, the image display processing method provided in any embodiment of the present disclosure.

For example, the storage medium may include a memory card of a smart phone, a storage component of a tablet computer, a hard disk of a personal computer, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM), The portable compact disk read-only memory (CD-ROM), flash memory, or any combination of the above storage media can also be other suitable storage media.

For the technical effects of the storage medium provided by the embodiments of the present disclosure, reference may be made to the corresponding description of the image display processing method in the foregoing embodiments, and details are not repeated here.

The following points need to be explained:

(1) The drawings of the embodiments of the present disclosure only refer to the structures related to the embodiments of the present disclosure, and other structures can refer to the usual design.

(2) In the case of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other to obtain new embodiments.

The foregoing descriptions are merely exemplary implementations of the present disclosure, and are not used to limit the protection scope of the present disclosure, which is determined by the appended claims.

Claims

An image display processing method of a display device, the display device including a backlight unit, the backlight unit including L rows of backlight subarea and driven by a local dimming method, the image display processing method includes:

Obtaining the backlight value of the N-row backlight subarea according to the display data of the pixels corresponding to the N-row backlight subarea in the current frame image;

Based on the display data of the pixels corresponding to the N rows of backlight subregions and the acquired backlight values of the N rows of backlight subregions, obtain the compensated display data of the pixels corresponding to the N rows of backlight subregions in the current frame image ；

Wherein, N is an integer greater than or equal to 1 and less than L.
The image display processing method according to claim 1, wherein the display device further comprises a display panel, the backlight unit is disposed on a non-display side of the display panel, and the image display processing method further comprises:

Inputting the backlight values of the N rows of backlight partitions to the backlight unit;

Inputting the compensated display data of the pixels corresponding to the N rows of backlight subarea in the current frame image to the display panel of the display device to perform display of the display panel.
The image display processing method according to claim 1 or 2, further comprising:

Before obtaining the backlight value of the N rows of backlight subarea,

Writing the display data of the pixels corresponding to the N rows of backlight subarea in the current frame image into a storage unit to obtain two copies of the display data;

Wherein, one copy of the display data is used to obtain the backlight value of the N-row backlight subarea, and another copy of the display data is stored and used to obtain the compensated pixel value of the N-row backlight subarea in the current frame image. Display data.
The image display processing method according to claim 3, further comprising:

The storage unit stores at least the display data of the pixels corresponding to the N rows of backlight subregions.
The image display processing method according to any one of claims 1 to 4, wherein obtaining the compensated display data of the pixels corresponding to the N rows of backlight subarea in the current frame of image comprises:

Based on the backlight value of each backlight subarea in the N rows and the backlight value of the backlight subarea adjacent to at least one row above and below the N rows of backlight subarea, the backlight diffusion model is obtained by fitting,

And obtaining the actual backlight value of each pixel corresponding to each backlight subarea in the N rows based on the backlight diffusion model;

Compensating the display data of the pixels corresponding to the N rows of backlight subregions in the current frame image according to the actual backlight value to obtain the compensated display data of the pixels.
The image display processing method according to any one of claims 1 to 5, wherein, according to the display data of the pixels corresponding to the N rows of backlight subregions in the current frame of image, obtaining the backlight value of the N rows of backlight subregions comprises:

Respectively statistics the gray value of the display data of the pixels corresponding to each backlight subarea in each row of the N rows of backlight subarea;

Obtain the backlight value of each backlight subarea based on the gray value of the display data of the pixel corresponding to each backlight subarea.
7. The image display processing method according to claim 6, wherein the gray values of the display data of the pixels corresponding to each backlight subarea in each row of the N rows of backlight subarea are respectively counted through a histogram.
The image display processing method according to claim 6 or 7, wherein the calculated gray values of the display data of the pixels corresponding to the respective backlight partitions are sorted from small to large gray values at 80% to 90% , Or set the average value of the gray value of the display data of the pixels corresponding to each backlight subarea as the backlight value of the corresponding backlight subarea.
The image display processing method according to claim 5, wherein the compensated display data of the pixel is obtained according to the following formula:

Vc=V0*(BL_M/BL_P)

Wherein, Vc represents the compensated display data of a certain pixel among all the pixels corresponding to the N rows of backlight partitions, V0 represents the display data before the pixel is compensated, and BL_M represents that the pixel corresponds to the highest gray level BL_P represents the actual backlight value corresponding to the pixel.
The image display processing method according to any one of claims 1-9, further comprising:

In the N row period, the compensated display data of all pixels of the current frame image are sequentially acquired.
The image display processing method according to any one of claims 1-10, wherein the backlight subarea includes mini light emitting diodes.
The image display processing method according to any one of claims 1-11, wherein N is equal to 1.
An image display processing device, including:

The storage unit is configured to store the display data of the pixels corresponding to the N rows of backlight subarea in the current frame of image;

The local dimming unit is configured to receive the transmitted display data of the pixels corresponding to the N backlight subarea in the current frame image, and obtain according to the transmitted display data of the pixels corresponding to the N rows of backlight subarea The backlight values of the N rows of backlight subregions are acquired based on the stored display data of pixels corresponding to the N rows of backlight subregions and the acquired backlight values of the N rows of backlight subregions, to obtain the current frame image corresponding to the The compensated display data of the pixels of the N-row backlight subarea;

Wherein, the current frame image corresponds to L row backlight subarea, and N is an integer greater than or equal to 1 and less than L.
The image display processing device according to claim 13, wherein the local dimming unit includes a backlight value acquisition unit and a display data acquisition unit; wherein,

The backlight value obtaining unit is configured to obtain the backlight value of the N rows of backlight subregions according to the transmitted display data of pixels corresponding to the N rows of backlight subregions;

The display data acquisition unit is configured to acquire, based on the stored display data of the pixels corresponding to the N rows of backlight subregions and the acquired backlight values of the N rows of backlight subregions, obtain the current frame image corresponding to the N rows The compensated display data of the pixels in the backlight zone.
13. The image display processing device according to claim 13, wherein the storage unit is configured to store at least the display data of the pixels corresponding to the N rows of backlight subregions.
An image display processing device, including:

processor;

The memory stores one or more computer program modules, among which,

The one or more computer program modules are configured to be executed by the processor, and the one or more computer program modules include instructions for executing the image display processing method according to any one of claims 1-12.
A display device including a display panel, a backlight unit, a storage unit and a local dimming unit;

Wherein, the backlight unit includes L rows of backlight partitions and is driven by a local dimming method;

The storage unit is configured to store the display data of the pixels corresponding to the N rows of backlight subarea in the current frame of image;

The local dimming unit is configured to receive the transmitted display data of the pixels corresponding to the N rows of backlight subarea in the current frame image, and according to the transmitted display data of the pixels corresponding to the N rows of backlight subarea, Acquire the backlight value of the N-row backlight subarea, and obtain the backlight value corresponding to all the pixels in the current frame image based on the stored display data of the pixels corresponding to the N-row backlight subarea and the acquired backlight value of the N-row backlight subarea. The compensated display data of the pixels of the N rows of backlight partitions;

Wherein, N is an integer greater than or equal to 1 and less than L.
A storage medium non-transitory storing computer readable instructions, when the non-transitory computer readable instructions are executed by a computer, the instructions of the image display processing method according to any one of claims 1-12 can be executed.