CN113380151B - Picture compensation method and device, display panel and storage medium - Google Patents
Picture compensation method and device, display panel and storage medium Download PDFInfo
- Publication number
- CN113380151B CN113380151B CN202110644329.1A CN202110644329A CN113380151B CN 113380151 B CN113380151 B CN 113380151B CN 202110644329 A CN202110644329 A CN 202110644329A CN 113380151 B CN113380151 B CN 113380151B
- Authority
- CN
- China
- Prior art keywords
- image
- displayed
- compensation
- display panel
- temperature distribution
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
- G09F9/30—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements
- G09F9/33—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements being semiconductor devices, e.g. diodes
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
- G09G3/30—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
- G09G3/32—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0233—Improving the luminance or brightness uniformity across the screen
Abstract
The embodiment of the invention provides a picture compensation method, a device, a display panel and a storage medium, wherein the method comprises the following steps: acquiring a first temperature distribution diagram of a display panel, wherein the first temperature distribution diagram comprises a first temperature of an environment where pixel units in the display panel are located; acquiring a first image to be displayed, and inputting a first temperature distribution map and the first image to be displayed into a pre-training compensation image generation network; and acquiring a first compensation image output by the compensation image generation network, and displaying the first compensation image in the display panel. The first temperature distribution diagram and the first image to be displayed of the display panel are obtained, the first temperature distribution diagram and the first image to be displayed are processed by the compensation image generation network, and the first compensation image after temperature compensation is obtained, so that the first temperature distribution diagram and the first image to be displayed are displayed in the display panel, and the display picture non-uniformity of the display panel caused by temperature can be rapidly compensated.
Description
Technical Field
The present invention relates to the field of display technologies, and in particular, to a method and apparatus for compensating a picture, a display panel, and a storage medium.
Background
In a Micro-LED (Micro light emitting diode) display panel, micro-LEDs can be affected by aging, working temperature (generally referred to as junction temperature of a Micro-LED PN junction) and other factors, so that light attenuation (brightness attenuation) occurs to a certain extent, and in the Micro-LED display panel, micro-LEDs at different positions are different in aging degree, working temperature, display picture and the like, so that serious uniformity (display non-uniformity) problem can occur when the Micro-LED display panel displays pictures, and compensation is needed for the display pictures of the Micro-LED display panel.
Disclosure of Invention
The embodiment of the invention aims to provide a picture compensation method, a picture compensation device, a display panel and a storage medium, so as to realize the beneficial effect of compensating a display picture of the display panel. The specific technical scheme is as follows:
in a first aspect of the embodiment of the present invention, there is provided a picture compensation method, including:
acquiring a first temperature distribution diagram of a display panel, wherein the first temperature distribution diagram comprises a first temperature of an environment where a pixel unit in the display panel is located;
acquiring a first image to be displayed, and inputting the first temperature distribution map and the first image to be displayed into a pre-training compensation image generation network;
And acquiring a first compensation image output by the compensation image generation network, and displaying the first compensation image in the display panel.
In an alternative embodiment, the acquiring the first temperature profile of the display panel includes:
the first temperature distribution map of the display panel is acquired by temperature detection devices arranged in an array manner in the display panel.
In an alternative embodiment, the compensation image generation network includes an encoder and a decoder;
the inputting the first temperature distribution diagram and the first image to be displayed into a pre-trained compensation image generating network comprises the following steps:
extracting a first compensation image from the first temperature distribution diagram and the first image to be displayed by using the encoder to generate a required first feature matrix;
generating the first compensation image by using the decoder according to the first characteristic matrix required by the extracted first compensation image.
In an alternative embodiment, the compensation image generation network is obtained in particular by:
acquiring a second temperature distribution diagram of the display panel, wherein the second temperature distribution diagram comprises a second temperature of the environment where the pixel units in the display panel are located;
Acquiring a second image to be displayed, and inputting the second temperature distribution map and the second image to be displayed into a compensation image generation network;
acquiring a second compensation image output by the compensation image generation network, and inputting the second temperature distribution map and the second compensation image into a display effect simulation network;
obtaining a simulation display image output by the display effect simulation network, and determining an error between the simulation display image and the second image to be displayed;
under the condition that the error is smaller than a preset threshold value, determining that the compensation image generation network training is completed;
and if the error is not smaller than a preset threshold value, jumping to the step of acquiring the second temperature distribution diagram of the display panel.
In an alternative embodiment, the acquiring the second temperature profile of the display panel includes:
and acquiring a second temperature distribution diagram of the display panel through temperature detection devices arranged in an array mode in the display panel.
In an alternative embodiment, the compensation image generation network includes an encoder and a decoder;
the inputting the second temperature distribution map and the second image to be displayed to a compensation image generation network includes:
Extracting a second compensation image from the second temperature distribution diagram and the second image to be displayed by using the encoder to generate a required second feature matrix;
generating the second compensation image by using the decoder according to the second characteristic matrix required by the extracted second compensation image.
In an optional embodiment, after the obtaining the analog display image output by the display effect analog network, the method further includes:
and inputting the analog display image and the second image to be displayed into an authentication network, and obtaining the probability output by the authentication network, wherein the probability is used for representing the similarity degree between the analog display image and the second image to be displayed.
In an alternative embodiment, the determining an error between the analog display image and the second image to be displayed includes:
determining the image size of the analog display image, the second compensation image or the second image to be displayed, and acquiring the pixel gray scale of the analog display image and the pixel gray scale of the second image to be displayed;
and determining an error between the analog display image and the second image to be displayed based on the pixel gray scale of the analog display image, the pixel gray scale of the second image to be displayed and the image size.
In an alternative embodiment, the determining the error between the analog display image and the second image to be displayed based on the pixel gray level of the analog display image, the pixel gray level of the second image to be displayed, and the image size includes:
inputting the pixel gray level of the analog display image, the pixel gray level of the second image to be displayed and the image size into a preset loss function;
obtaining an error between the analog display image output by the loss function and the second image to be displayed, wherein the loss function comprises:
L total ＝L content +λ*L Perception of ；
The L is total And the errors are included, the m and the n comprise the image sizes, the a comprises the pixel gray scale of the analog display image, and the b comprises the pixel gray scale of the second image to be displayed.
In a second aspect of the embodiments of the present invention, there is also provided a picture compensation apparatus, the apparatus including:
the distribution map acquisition module is used for acquiring a first temperature distribution map of the display panel, wherein the first temperature distribution map comprises a first temperature of the environment where the pixel units in the display panel are located;
The image input module is used for acquiring a first image to be displayed, and inputting the first temperature distribution map and the first image to be displayed into a pre-training compensation image generation network;
and the image display unit is used for acquiring a first compensation image output by the compensation image generation network and displaying the first compensation image in the display panel.
In a third aspect of the embodiment of the present invention, there is also provided a display panel, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;
a memory for storing a computer program;
and a processor, configured to implement the picture compensation method according to any one of the first aspect when executing the program stored in the memory.
In an alternative embodiment, the display panel comprises a Micro-LED display panel.
In a fourth aspect of embodiments of the present invention, there is also provided a storage medium having stored therein instructions that, when executed on a computer, cause the computer to perform the picture compensation method of any one of the first aspects described above.
In a fifth aspect of embodiments of the present invention, there is also provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform the picture compensation method as described in any one of the first aspects above.
According to the technical scheme provided by the embodiment of the invention, a first temperature distribution diagram of the display panel is obtained, wherein the first temperature distribution diagram comprises a first temperature of an environment where a pixel unit in the display panel is located, a first image to be displayed is obtained, the first temperature distribution diagram and the first image to be displayed are input into a pre-training compensation image generation network, a first compensation image output by the compensation image generation network is obtained, and the first compensation image is displayed in the display panel. The first temperature distribution diagram and the first image to be displayed of the display panel are obtained, the first temperature distribution diagram and the first image to be displayed are processed by using the compensation image generation network, and the first compensation image after temperature compensation is obtained, so that the first temperature distribution diagram and the first image to be displayed are displayed in the display panel, and the display picture non-uniformity of the display panel caused by temperature can be rapidly compensated.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
In order to more clearly illustrate the embodiments of the invention or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, and it will be obvious to a person skilled in the art that other drawings can be obtained from these drawings without inventive effort.
Fig. 1 is a schematic flow chart of an implementation of a picture compensation method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a first temperature profile of a Micro-LED display panel according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a Micro-LED display panel of a specific temperature sensor according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a compensation image generation network architecture according to an embodiment of the present invention;
FIG. 5 is a timing diagram of a picture compensation method according to an embodiment of the present invention;
FIG. 6 is a schematic flow chart of a method for obtaining a compensation image generating network according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a Micro-LED display screen compensation network architecture based on GAN according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of a display effect simulation network architecture according to an embodiment of the present invention;
FIG. 9 is a schematic flow chart of an implementation of a method for determining an error between a simulated display image and a second image to be displayed according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of a picture compensation device according to an embodiment of the present invention;
fig. 11 is a schematic structural diagram of a display panel according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It should be noted that, in the embodiment of the present invention, the display panel may include a Micro-LED display panel, and of course, may be other types of display panels, which is not limited in the embodiment of the present invention. The picture compensation method provided by the embodiment of the invention is described by taking a Micro-LED display panel as an example.
As shown in fig. 1, a schematic implementation flow chart of a picture compensation method according to an embodiment of the present invention is provided, and the method may be used for a CPU/GPU in a system, and specifically may include the following steps:
s101, acquiring a first temperature distribution diagram of a display panel, wherein the first temperature distribution diagram comprises a first temperature of an environment where a pixel unit in the display panel is located.
For a Micro-LED display panel, the Micro-LED can generate light attenuation (brightness attenuation) to a certain extent due to the influence of factors such as working temperature (generally referred to as junction temperature of a PN junction of the Micro-LED), and in the Micro-LED display panel, the working temperatures of the Micro-LEDs at different positions are different, so that the first temperature of the environment where a pixel unit in the Micro-LED display panel is located is detected, and a first temperature distribution diagram of the Micro-LED display panel can be formed.
Thus, for a CPU/GPU within the system, a first temperature profile of the Micro-LED display panel may be obtained, the first temperature profile comprising a first temperature of the environment in which the pixel cells in the Micro-LED display panel are located. For example, as shown in fig. 2, detecting the first temperature (P1, P2, P3 and … …) of the environment where the pixel unit in the Micro-LED display panel is located may form a first temperature distribution diagram of the Micro-LED display panel, where the correspondence between the pixel unit and the first temperature is shown in the following table 1.
| Pixel unit | First temperature |
| A1 | P1 |
| A2 | P2 |
| A3 | P3 |
| …… | …… |
TABLE 1
In this embodiment of the present invention, a temperature monitoring device, such as a temperature sensor (thermocouple), may be provided in the Micro-LED display panel in an array arrangement in advance, and the temperature sensor may be provided at the edge of the pixel unit. For example, as shown in fig. 3, temperature sensors are arranged in a 3×4 array arrangement in a Micro-LED display panel, and each temperature sensor may be arranged at an edge of a pixel unit. Thus, the first temperature distribution map of the Micro-LED display panel can be obtained by the temperature detection devices arranged in an array manner in the Micro-LED display panel.
It should be noted that, the array may be configured, for example, by providing a temperature sensor at an edge of each pixel unit to form a temperature sensor array, so that the first temperature distribution map includes a first temperature of an environment where each pixel unit in the Micro-LED display panel is located, or may be configured by dividing the Micro-LED display panel into a plurality of areas, and providing a temperature sensor in each area to form a temperature sensor array, so that the first temperature distribution map includes a first temperature of an environment where each pixel unit in each area in the Micro-LED display panel is located.
S102, acquiring a first image to be displayed, and inputting the first temperature distribution map and the first image to be displayed into a pre-training compensation image generation network.
For the CPU/GPU in the system, a first image to be displayed can be acquired, wherein for the first image to be displayed, a first frame image refreshed by the display of the Micro-LED display panel can be used, and the embodiment of the invention is not limited to the first frame image. Wherein for the first image to be displayed, it may be sent out by the server/terminal.
After the first temperature distribution diagram of the Micro-LED display panel and the first image to be displayed are obtained, for the CPU/GPU in the system, the first temperature distribution diagram and the first image to be displayed may be input to a pre-trained compensation image generation network. The training process for the compensation image generation network will be described later.
For the compensation image generation network, the method comprises two parts of an encoder and a decoder, and the process of generating a first compensation image by using the compensation image generation network is specifically as follows: and extracting a first feature matrix required for generating the first compensation image from the first temperature distribution diagram and the first image to be displayed by using the encoder, so that the first compensation image is generated by using the decoder according to the first feature matrix required for generating the first compensation image.
For example, as shown in fig. 4, for the compensation image generation network, the network is composed of an encoder and a decoder, the encoder is used for extracting a first feature matrix required for generating a first compensation image from a first temperature distribution diagram of the Micro-LED display panel and a first image to be displayed, so that the decoder is used for generating the first compensation image according to the extracted first compensation image to generate the first feature matrix required for generating the first compensation image, and finally the generated first compensation image is displayed in the Micro-LED display panel.
It should be noted that, for the step of acquiring the first temperature distribution diagram of the Micro-LED display panel and the step of acquiring the first image to be displayed, the execution sequence of the two steps is not limited, and the embodiments of the present invention may have a sequential order, and may of course also be executed simultaneously.
In addition, the compensation image generation network is a Micro-LED compensation image generation network in a Micro-LED display screen compensation network based on GAN (Generative Adversarial Network, generation type countermeasure network), which is not limited in the embodiment of the present invention. The Micro-LED display compensation network architecture based on GAN will be described later.
And S103, acquiring a first compensation image output by the compensation image generation network, and displaying the first compensation image in the display panel.
For the compensation image generation network, the first temperature distribution diagram of the Micro-LED display panel and the first image to be displayed are processed, so that the first compensation image can be output, and the first compensation image is an image subjected to temperature compensation, so that the first compensation image can be displayed in the Micro-LED display panel.
The first temperature distribution diagram and the first image to be displayed are processed by the compensation image generation network, so that the first compensation image after temperature compensation is obtained, and the first compensation image is displayed in the Micro-LED display panel, and the quick compensation of the non-uniformity of the display picture of the Micro-LED display panel caused by temperature can be realized.
For example, as shown in fig. 5, a first temperature distribution diagram of a Micro-LED display panel is obtained, a first image to be displayed is obtained, the first temperature distribution diagram and the first image to be displayed are input into a Micro-LED compensation image generation network in a GAN-based Micro-LED display screen compensation network, and a first compensation image is obtained, so that display in the Micro-LED display panel can be performed.
Through the description of the technical scheme provided by the embodiment of the invention, the first temperature distribution diagram of the display panel is obtained, wherein the first temperature distribution diagram comprises the first temperature of the environment where the pixel units in the display panel are located, the first image to be displayed is obtained, the first temperature distribution diagram and the first image to be displayed are input into the pre-training compensation image generation network, the first compensation image output by the compensation image generation network is obtained, and the first compensation image is displayed in the display panel.
The first temperature distribution diagram and the first image to be displayed of the display panel are obtained, the first temperature distribution diagram and the first image to be displayed are processed by using the compensation image generation network, and the first compensation image after temperature compensation is obtained, so that the first temperature distribution diagram and the first image to be displayed are displayed in the display panel, and the display picture non-uniformity of the display panel caused by temperature can be rapidly compensated.
In addition, it should be noted that, the picture compensation method provided by the embodiment of the invention is applied to the CPU/GPU in the system, does not occupy the computing resource of the IC (Integrated Circuit ), and can save the cost of IC customization.
As shown in fig. 6, a schematic implementation flow chart of a method for obtaining a compensation image generating network according to an embodiment of the present invention is provided, and the method may be used for a CPU/GPU in a system, and specifically may include the following steps:
s601, acquiring a second temperature distribution diagram of the display panel, wherein the second temperature distribution diagram comprises a second temperature of the environment where the pixel units in the display panel are located.
For a CPU/GPU in the system, a second temperature profile of the Micro-LED display panel can be obtained, wherein the second temperature profile comprises a second temperature of the environment where the pixel units in the Micro-LED display panel are located.
For example, a second temperature of the environment where the pixel unit in the Micro-LED display panel is located is detected, so that a second temperature distribution diagram of the Micro-LED display panel can be formed, wherein the correspondence between the pixel unit and the second temperature is shown in the following table 2.
| Pixel unit | Second temperature |
| A1 | P1 |
| A2 | P2 |
| A3 | P3 |
| …… | …… |
TABLE 2
Among them, as can be seen from the above, temperature monitoring devices, such as temperature sensors (thermocouples), are previously provided in an array arrangement in the Micro-LED display panel, and the temperature sensors may be provided at the edges of the pixel units, as shown in fig. 3.
Thus, by the temperature detection device arranged in the Micro-LED display panel in an array manner, a second temperature distribution diagram of the Micro-LED display panel can be obtained, where the second temperature distribution diagram includes a second temperature of an environment where the pixel units (in each or each area) in the Micro-LED display panel are located.
S602, acquiring a second image to be displayed, and inputting the second temperature distribution diagram and the second image to be displayed into a compensation image generation network.
For the CPU/GPU in the system, a second image to be displayed may be acquired, where for the second image to be displayed, the second image may be a first frame image that is refreshed by the Micro-LED display panel, which is not limited by the embodiment of the present invention.
After the second temperature distribution diagram and the second image to be displayed of the Micro-LED display panel are obtained, the second temperature distribution diagram and the second image to be displayed can be input into a compensation image generation network so as to facilitate the subsequent processing of the second temperature distribution diagram and the second image to be displayed, and a second compensation image is obtained.
The above-mentioned compensation image generation network is composed of an encoder and a decoder, and the process of generating the second compensation image by using the compensation image generation network specifically comprises: and extracting a second characteristic matrix required by the generation of the second compensation image from the second temperature distribution diagram and the second image to be displayed by using the encoder, so that the decoder generates the second compensation image according to the extracted second characteristic matrix required by the generation of the second compensation image.
For example, as shown in fig. 7, the GAN-based Micro-LED display screen compensation network architecture is configured to, for a compensation image generation network, consist of two parts, namely an encoder and a decoder, and extract, by the encoder, a second feature matrix required for generating a second compensation image from a second temperature distribution map and a second image to be displayed, thereby generating, by the decoder, the second compensation image according to the extracted second feature matrix required for generating the second compensation image.
It should be noted that, in the training process of the GAN-based Micro-LED display screen compensation network, frequent display of the generated second compensation image in the Micro-LED display panel is avoided, a display effect simulation network is added in the GAN to form the GAN-based Micro-LED display screen compensation network, as shown in fig. 7, the display effect simulation network is used for simulating the display effect of the second compensation image in the Micro-LED display panel under the current temperature distribution, that is, simulating the actual gray scale of the second compensation image in the Micro-LED display panel under the current temperature distribution, so as to ensure that the display effect simulated is as consistent as possible with the display effect of the second image, that is, the picture input into the Micro-LED display panel can be displayed through compensation under the condition of considering the temperature influence.
And S603, acquiring a second compensation image output by the compensation image generation network, and inputting the second temperature distribution map and the second compensation image into a display effect simulation network.
And for the CPU/GPU in the system, a second compensation image output by the compensation image generation network can be acquired, and the second temperature distribution diagram and the second compensation image are input into the display effect simulation network, so that the display effect of the second compensation image in the Micro-LED display panel under the current temperature distribution can be simulated, namely the actual gray scale of the second compensation image in the Micro-LED display panel under the current temperature distribution is simulated.
It should be noted that, for example, the display effect simulation network may be a three-layer artificial neural network, as shown in fig. 8, the input is a second temperature distribution map and a second compensation image, and the output is a simulation display image, which is not limited in the embodiment of the present invention.
S604, obtaining the analog display image output by the display effect analog network, and determining the error between the analog display image and the second image to be displayed.
For the display effect simulation network, the display effect of the second compensation image in the Micro-LED display panel under the current temperature distribution can be simulated, namely the actual gray scale of the second compensation image in the Micro-LED display panel under the current temperature distribution is simulated, so that the simulated display image can be output.
For a CPU/GPU in the system, an analog display image output by a display effect analog network can be acquired, so that an error between the analog display image and a second image to be displayed can be determined, wherein the error comprises two errors of content loss and perception loss.
After the analog display image output by the display effect analog network is obtained, the analog display image and the second image to be displayed can be input into the authentication network, and the probability of the output of the authentication network is obtained, so that the error between the analog display image and the second image to be displayed can be determined in the authentication network later.
It should be noted that, the probability of the output of the discrimination network is used to represent the similarity degree between the analog display image and the second image to be displayed, if the probability of the output of the discrimination network is close to 1, it indicates that there is little difference between the analog display image and the second image to be displayed, and if the probability of the output of the discrimination network is close to 0, it indicates that there is great difference between the analog display image and the second image to be displayed, which is not limited by the embodiment of the present invention.
In addition, as shown in fig. 9, a schematic implementation flow chart of a method for determining an error between a simulated display image and a second image to be displayed according to an embodiment of the present invention is provided, and the method may be used for a CPU/GPU in a system, and specifically may include the following steps:
S901 determining an image size of the analog display image, the second compensation image, or the second image to be displayed, and acquiring a pixel gray level of the analog display image and a pixel gray level of the second image to be displayed.
For the image size of the analog display image, the image size of the second compensation image, and the size of the second image to be displayed, the three image sizes are consistent, so that the image size of the analog display image, the second compensation image, or the second image to be displayed can be determined for the CPU/GPU in the system.
For example, for the image size of the second image to be displayed, m, n may be used to represent the length of the second image to be displayed, n may represent the width of the second image to be displayed, so that the image size (m, n) of the second image to be displayed may be determined for the CPU/GPU within the system.
In addition, for the CPU/GPU in the system, the pixel gray level of the analog display image and the pixel gray level of the second image to be displayed may be acquired, so as to facilitate subsequent determination of an error between the analog display image and the second image to be displayed.
Here, the image size is generally the length and width of the image, for example, the length of the second image to be displayed is 50cm, and the width of the second image to be displayed is 30cm, which is not limited in the embodiment of the present invention.
S902, determining an error between the analog display image and the second image to be displayed based on the pixel gray scale of the analog display image, the pixel gray scale of the second image to be displayed and the image size.
For the CPU/GPU in the system, after determining the image size of the analog display image, the second compensation image, or the second image to be displayed, and acquiring the pixel gray level of the analog display image and the pixel gray level of the second image to be displayed, an error between the analog display image and the second image to be displayed may be determined based on the pixel gray level of the analog display image, the pixel gray level of the second image to be displayed, and the image size described above.
In the embodiment of the invention, a loss function is provided, and the pixel gray level of the analog display image, the pixel gray level of the second image to be displayed and the image size are input into the loss function, so that the error between the analog display image and the second image to be displayed can be obtained. The loss function is divided into content loss, which is the root mean square error of the analog display image and the second image to be displayed, and perceptual loss, which is the network feature loss extracted by the CNN. Wherein the loss function is as follows.
L total ＝L Content +λ*L Perception of (1)；
Wherein the L is total And the errors are included, the m and the n comprise the image sizes, the a comprises the pixel gray scale of the analog display image, and the b comprises the pixel gray scale of the second image to be displayed.
Specifically, the pixel gray level of the analog display image, the pixel gray level of the second image to be displayed, and the image size are input into the above formula (2), L can be obtained Content Inputting the pixel gray level of the analog display image, the pixel gray level of the second image to be displayed and the image size into the above formula (3), L can be obtained Perception of Finally, L is Content L and perception of Input into the above formula (1), an error L between the analog display image and the second image to be displayed can be obtained total 。
And S605, determining that the compensation image generation network training is completed under the condition that the error is smaller than a preset threshold value.
Judging whether the error between the analog display image and the second image to be displayed is smaller than a preset threshold value or not for the CPU/GPU in the system, and if the error between the analog display image and the second image to be displayed is smaller than the preset threshold value, indicating that the Micro-LED display screen compensation network based on GAN is completed, meaning that the adjustment of parameters such as the compensation image generation network, the display effect simulation network and the identification network is completed at the moment, determining that the compensation image generation network is completed, so that the temperature distribution diagram of the subsequent Micro-LED display panel and the image to be displayed can be processed by using the compensation image generation network to obtain a compensation image, and displaying the compensation image in the Micro-LED display panel.
For example, a threshold u is set in advance, and for a CPU/GPU in the system, an error between the analog display image and the second image to be displayed is judged (L total ) Whether or not less than a preset threshold value (u), an error (L total ) When the parameters are smaller than the preset threshold (u), the Micro-LED display picture compensation network based on GAN is completely trained, and the parameters such as the compensation image generation network, the display effect simulation network and the identification network can be completely adjusted, so that the completion of the compensation image generation network training can be determined.
And S606, jumping to the step of acquiring the second temperature distribution diagram of the display panel under the condition that the error is not smaller than a preset threshold value.
Judging whether the error between the analog display image and the second image to be displayed is smaller than a preset threshold value or not for the CPU/GPU in the system, and if the error between the analog display image and the second image to be displayed is not smaller than the preset threshold value, indicating that the Micro-LED display screen compensation network based on GAN needs to be trained continuously, wherein the adjustment of parameters such as a compensation image generation network, a display effect simulation network and a discrimination network is not proper, feeding the error back to the compensation image generation network, adjusting the parameters such as the compensation image generation network, the display effect simulation network and the discrimination network again, and jumping to the step of acquiring a second temperature distribution diagram of the Micro-LED display panel, namely S601, continuing to train the Micro-LED display screen compensation network based on GAN until the error between the analog display image and the second image to be displayed is smaller than the preset threshold value.
For example, a threshold u is set in advance, and for a CPU/GPU in the system, an error between the analog display image and the second image to be displayed is judged (L total ) Whether or not less than a preset threshold value (u), an error (L total ) If the error is not smaller than the preset threshold (u), it is indicated that the GAN-based Micro-LED display screen compensation network needs to continue training, where adjustment of parameters such as the compensation image generation network, the display effect simulation network, and the identification network is not appropriate, at this time, the error may be fed back to the compensation image generation network, and the parameters such as the compensation image generation network, the display effect simulation network, and the identification network may be adjusted again, and step S601 is skipped, and training is continued on the GAN-based Micro-LED display screen compensation network until the error between the simulation display image and the second image to be displayed is smaller than the preset threshold.
It should be noted that, in each training process of the GAN-based Micro-LED display screen compensation network, the obtained second temperature distribution diagram of the Micro-LED display panel may be identical or not, and the obtained second image to be displayed may be identical or not, which is preferable, if the error between the analog display image and the second image to be displayed is not smaller than the preset threshold, the parameters such as the compensation image generation network, the display effect analog network, the identification network, etc. are adjusted again, and the step S601 is skipped, so that the second temperature distribution diagram of the Micro-LED display panel and the second image to be displayed are obtained again, which means that the second temperature distribution diagram of the Micro-LED display panel and the second image to be displayed obtained last time are not identical.
Through the description of the technical scheme provided by the embodiment of the invention, the second temperature distribution diagram of the display panel is obtained, wherein the second temperature distribution diagram comprises a second temperature of an environment where a pixel unit in the display panel is located, a second image to be displayed is obtained, the second temperature distribution diagram and the second image to be displayed are input into a compensation image generation network, a second compensation image output by the compensation image generation network is obtained, the second temperature distribution diagram and the second compensation image are input into a display effect simulation network, a simulation display image output by the display effect simulation network is obtained, the simulation display image and the second image to be displayed are input into an identification network, the probability of the output of the identification network is obtained, the error between the simulation display image and the second image to be displayed is determined, and whether training of the compensation image generation network, the display effect simulation network, the identification network and the like is completed is determined by the error.
And processing the first temperature distribution map and the first image to be displayed by using a compensation image generation network after the first temperature distribution map and the first image to be displayed of the display panel are acquired, so that the first compensation image after temperature compensation is obtained, and the first compensation image is displayed in the display panel, and therefore, the display picture non-uniformity of the display panel caused by temperature can be rapidly compensated.
Corresponding to the above method embodiment, the embodiment of the present invention further provides a picture compensation device, as shown in fig. 10, where the device may include: a profile acquisition module 1010, an image input module 1020, and an image display unit 1030.
A profile obtaining module 1010, configured to obtain a first temperature profile of a display panel, where the first temperature profile includes a first temperature of an environment where a pixel unit in the display panel is located;
the image input module 1020 is configured to obtain a first image to be displayed, and input the first temperature distribution map and the first image to be displayed to a pre-trained compensation image generation network;
and an image display unit 1030, configured to obtain a first compensation image output by the compensation image generating network, and display the first compensation image on the display panel.
The embodiment of the invention also provides a display panel, as shown in fig. 11, which comprises a processor 111, a communication interface 112, a memory 113 and a communication bus 114, wherein the processor 111, the communication interface 112 and the memory 113 complete communication with each other through the communication bus 114,
a memory 113 for storing a computer program;
The processor 111 is configured to execute a program stored in the memory 113, and implement the following steps:
acquiring a first temperature distribution diagram of a display panel, wherein the first temperature distribution diagram comprises a first temperature of an environment where a pixel unit in the display panel is located; acquiring a first image to be displayed, and inputting the first temperature distribution map and the first image to be displayed into a pre-training compensation image generation network; and acquiring a first compensation image output by the compensation image generation network, and displaying the first compensation image in the display panel.
The communication bus mentioned in the above display panel may be a peripheral component interconnect standard (Peripheral Component Interconnect, abbreviated to PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, abbreviated to EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.
The communication interface is used for communication between the display panel and other devices.
The memory may include random access memory (Random Access Memory, RAM) or non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.
The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU for short), a network processor (Network Processor, NP for short), etc.; but also digital signal processors (Digital Signal Processing, DSP for short), application specific integrated circuits (Application Specific Integrated Circuit, ASIC for short), field-programmable gate arrays (Field-Programmable Gate Array, FPGA for short) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
In yet another embodiment of the present invention, a storage medium is provided, in which instructions are stored, which when executed on a computer, cause the computer to perform the picture compensation method according to any one of the above embodiments.
In a further embodiment of the present invention, a computer program product comprising instructions, which when run on a computer, causes the computer to perform the picture compensation method according to any of the above embodiments is also provided.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present invention, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a storage medium or transmitted from one storage medium to another, for example, from one website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The storage media may be any available media that can be accessed by a computer or a data storage device such as a server, data center, or the like that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments.
The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.
Claims (10)
1. A picture compensation method, the method comprising:
acquiring a first temperature distribution diagram of a display panel, wherein the first temperature distribution diagram comprises a first temperature of an environment where a pixel unit in the display panel is located;
acquiring a first image to be displayed, and inputting the first temperature distribution map and the first image to be displayed into a pre-training compensation image generation network;
acquiring a first compensation image output by the compensation image generation network, and displaying the first compensation image in the display panel;
the compensation image generation network is specifically obtained by the following modes:
acquiring a second temperature distribution diagram of the display panel, wherein the second temperature distribution diagram comprises a second temperature of the environment where the pixel units in the display panel are located;
acquiring a second image to be displayed, and inputting the second temperature distribution map and the second image to be displayed into a compensation image generation network;
Acquiring a second compensation image output by the compensation image generation network, and inputting the second temperature distribution map and the second compensation image into a display effect simulation network;
obtaining a simulation display image output by the display effect simulation network, and determining an error between the simulation display image and the second image to be displayed;
under the condition that the error is smaller than a preset threshold value, determining that the compensation image generation network training is completed;
jumping to the step of acquiring a second temperature distribution diagram of the display panel under the condition that the error is not smaller than a preset threshold value;
the determining an error between the simulated display image and the second image to be displayed comprises:
determining the image size of the analog display image, the second compensation image or the second image to be displayed, and acquiring the pixel gray scale of the analog display image and the pixel gray scale of the second image to be displayed;
determining an error between the analog display image and the second image to be displayed based on the pixel gray scale of the analog display image, the pixel gray scale of the second image to be displayed, and the image size;
The determining an error between the analog display image and the second image to be displayed based on the pixel gray scale of the analog display image, the pixel gray scale of the second image to be displayed, and the image size includes:
inputting the pixel gray level of the analog display image, the pixel gray level of the second image to be displayed and the image size into a preset loss function;
obtaining an error between the analog display image output by the loss function and the second image to be displayed, wherein the loss function comprises:
L total ＝L content +λ*L Perception of ；
The L is total Represents the error, lambda is a constant, L Content Representing content loss, L Perception of Representing a perceptual loss, the m, n representing an image size of the analog display image, the m, n also representing an image size of the second image to be displayed, the a representing a pixel gray level of the analog display image, the b representing a pixel gray level of the second image to be displayed, f (a) representing a feature of the pixel gray level of the analog display image extracted through the identification network, and f (b) representing a feature of the pixel gray level of the second image to be displayed extracted through the identification network.
2. The method of claim 1, wherein the acquiring the first temperature profile of the display panel comprises:
the first temperature distribution map of the display panel is acquired by temperature detection devices arranged in an array manner in the display panel.
3. The method of claim 1, wherein the compensation image generation network comprises an encoder and a decoder;
the inputting the first temperature distribution diagram and the first image to be displayed into a pre-trained compensation image generating network comprises the following steps:
extracting a first compensation image from the first temperature distribution diagram and the first image to be displayed by using the encoder to generate a required first feature matrix;
generating the first compensation image by using the decoder according to the first characteristic matrix required by the extracted first compensation image.
4. The method of claim 1, wherein the acquiring the second temperature profile of the display panel comprises:
and acquiring a second temperature distribution diagram of the display panel through temperature detection devices arranged in an array mode in the display panel.
5. The method of claim 1, wherein the compensation image generation network comprises an encoder and a decoder;
the inputting the second temperature distribution map and the second image to be displayed to a compensation image generation network includes:
extracting a second compensation image from the second temperature distribution diagram and the second image to be displayed by using the encoder to generate a required second feature matrix;
generating the second compensation image by using the decoder according to the second characteristic matrix required by the extracted second compensation image.
6. The method of claim 1, wherein after the obtaining the simulated display image output by the display effect simulation network, the method further comprises:
and inputting the analog display image and the second image to be displayed into an authentication network, and obtaining the probability output by the authentication network, wherein the probability is used for representing the similarity degree between the analog display image and the second image to be displayed.
7. Picture compensation apparatus for performing a picture compensation method as claimed in any one of claims 1-6, characterized in that the apparatus comprises:
The distribution map acquisition module is used for acquiring a first temperature distribution map of the display panel, wherein the first temperature distribution map comprises a first temperature of the environment where the pixel units in the display panel are located;
the image input module is used for acquiring a first image to be displayed, and inputting the first temperature distribution map and the first image to be displayed into a pre-training compensation image generation network;
and the image display unit is used for acquiring a first compensation image output by the compensation image generation network and displaying the first compensation image in the display panel.
8. The display panel is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any one of claims 1-6 when executing a program stored on a memory.
9. The display panel of claim 8, wherein the display panel comprises a Micro-LED display panel.
10. A storage medium having stored thereon a computer program, which when executed by a processor, implements the method of any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110644329.1A CN113380151B (en) | 2021-06-09 | 2021-06-09 | Picture compensation method and device, display panel and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110644329.1A CN113380151B (en) | 2021-06-09 | 2021-06-09 | Picture compensation method and device, display panel and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113380151A CN113380151A (en) | 2021-09-10 |
| CN113380151B true CN113380151B (en) | 2023-08-08 |
Family
ID=77573358
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110644329.1A Active CN113380151B (en) | 2021-06-09 | 2021-06-09 | Picture compensation method and device, display panel and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113380151B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5914629A (en) * | 1995-11-10 | 1999-06-22 | Sony Corporation | Temperature sensing device, semiconductor device having temperature sensing device installed therein and auto-focusing system using this semiconductor device |
| CN109410873A (en) * | 2018-12-14 | 2019-03-01 | 惠科股份有限公司 | A kind of driving method, system and display device |
| CN109493805A (en) * | 2018-12-12 | 2019-03-19 | 合肥鑫晟光电科技有限公司 | A kind of compensation method of display panel and device |
| CN109637496A (en) * | 2019-02-25 | 2019-04-16 | 昆山龙腾光电有限公司 | Liquid crystal display device and its driving method |
| CN109935206A (en) * | 2019-04-15 | 2019-06-25 | 京东方科技集团股份有限公司 | Display device luminance compensation method, device and equipment neural network based |
| CN110853580A (en) * | 2019-11-29 | 2020-02-28 | 厦门天马微电子有限公司 | Driving device of organic light emitting display panel, driving method thereof and display device |
| CN111028779A (en) * | 2020-01-02 | 2020-04-17 | 昆山国显光电有限公司 | Display panel compensation method and device and display panel |
| CN111354287A (en) * | 2018-12-20 | 2020-06-30 | 京东方科技集团股份有限公司 | Method, device and equipment for determining aging attenuation degree of pixel and compensating pixel |
| CN112053658A (en) * | 2019-06-07 | 2020-12-08 | 苹果公司 | Two-dimensional temperature compensation for pixel drive compensation |
-
2021
- 2021-06-09 CN CN202110644329.1A patent/CN113380151B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5914629A (en) * | 1995-11-10 | 1999-06-22 | Sony Corporation | Temperature sensing device, semiconductor device having temperature sensing device installed therein and auto-focusing system using this semiconductor device |
| CN109493805A (en) * | 2018-12-12 | 2019-03-19 | 合肥鑫晟光电科技有限公司 | A kind of compensation method of display panel and device |
| CN109410873A (en) * | 2018-12-14 | 2019-03-01 | 惠科股份有限公司 | A kind of driving method, system and display device |
| CN111354287A (en) * | 2018-12-20 | 2020-06-30 | 京东方科技集团股份有限公司 | Method, device and equipment for determining aging attenuation degree of pixel and compensating pixel |
| CN109637496A (en) * | 2019-02-25 | 2019-04-16 | 昆山龙腾光电有限公司 | Liquid crystal display device and its driving method |
| CN109935206A (en) * | 2019-04-15 | 2019-06-25 | 京东方科技集团股份有限公司 | Display device luminance compensation method, device and equipment neural network based |
| CN112053658A (en) * | 2019-06-07 | 2020-12-08 | 苹果公司 | Two-dimensional temperature compensation for pixel drive compensation |
| CN110853580A (en) * | 2019-11-29 | 2020-02-28 | 厦门天马微电子有限公司 | Driving device of organic light emitting display panel, driving method thereof and display device |
| CN111028779A (en) * | 2020-01-02 | 2020-04-17 | 昆山国显光电有限公司 | Display panel compensation method and device and display panel |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113380151A (en) | 2021-09-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11163991B2 (en) | Method and apparatus for detecting body | |
| CN110222791B (en) | Sample labeling information auditing method and device | |
| JP2018525042A5 (en) | ||
| US10101827B2 (en) | Method and apparatus for controlling a touch-screen based application ported in a smart device | |
| CN110225366B (en) | Video data processing and advertisement space determining method, device, medium and electronic equipment | |
| US20210027425A1 (en) | Multiscale image generation | |
| CN111324764B (en) | Image detection method and device, electronic equipment and storage medium | |
| CN109255767B (en) | Image processing method and device | |
| CN110084317B (en) | Method and device for recognizing images | |
| CN108053025B (en) | Multi-column neural network medical image analysis method and device | |
| CN104680489A (en) | Image correcting method and system | |
| US10089719B2 (en) | Signal observation device and signal observation method | |
| CN109766742B (en) | Corn seed crack identification method, device, system, equipment and storage medium | |
| CN109324956B (en) | System testing method, apparatus and computer readable storage medium | |
| CN109191386B (en) | BPNN-based rapid Gamma correction method and device | |
| CN109284700B (en) | Method, storage medium, device and system for detecting multiple faces in image | |
| US10423829B2 (en) | Signal observation device and signal observation method | |
| US8483487B2 (en) | Image processing device and method for capturing object outline | |
| CN113380151B (en) | Picture compensation method and device, display panel and storage medium | |
| CN111402220B (en) | Method and device for acquiring information | |
| CN109324967A (en) | The method, apparatus and terminal device of application program pop-up components testing | |
| CN111222558B (en) | Image processing method and storage medium | |
| US20220109517A1 (en) | Detection device, detection method, and program | |
| CN109426599A (en) | power estimation method and power estimation device | |
| CN116597246A (en) | Model training method, target detection method, electronic device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |