CN114333710A - Image compensation method, device, display equipment, chip and medium - Google Patents

Image compensation method, device, display equipment, chip and medium Download PDF

Info

Publication number
CN114333710A
CN114333710A CN202111636913.9A CN202111636913A CN114333710A CN 114333710 A CN114333710 A CN 114333710A CN 202111636913 A CN202111636913 A CN 202111636913A CN 114333710 A CN114333710 A CN 114333710A
Authority
CN
China
Prior art keywords
backlight
accumulation amount
sub
determining
pixel point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111636913.9A
Other languages
Chinese (zh)
Inventor
查林
葛中峰
滕立伟
郝才研
夏建龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Xinxin Microelectronics Technology Co Ltd
Original Assignee
Qingdao Xinxin Microelectronics Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Xinxin Microelectronics Technology Co Ltd filed Critical Qingdao Xinxin Microelectronics Technology Co Ltd
Priority to CN202111636913.9A priority Critical patent/CN114333710A/en
Publication of CN114333710A publication Critical patent/CN114333710A/en
Pending legal-status Critical Current

Links

Images

Abstract

Some embodiments of the present application provide an image compensation method, an image compensation device, a display device, a chip, and a medium, and in some embodiments of the present application, when performing image compensation, data after compensation of each component of RGB is determined according to not only a backlight accumulation amount of each pixel but also original data of each component in RGB of each pixel, thereby avoiding an image distortion situation after image compensation, and ensuring authenticity of an image after compensation.

Description

Image compensation method, device, display equipment, chip and medium
Technical Field
The present application relates to the field of image processing technologies, and in particular, to an image compensation method and apparatus, a display device, a chip, and a medium.
Background
With the development of science and technology, MINI Light Emitting diodes (MINI led) are beginning to be widely applied to displays, and MINI led has a small volume and good Light convergence, can realize a million-level contrast ratio, has higher brightness, and can be manufactured in a very large size. However, the number of the mini leds in the current display is larger than that of the backlight control chips in the display, and therefore, a plurality of mini leds need to be controlled by one control signal, so as to adjust the backlight of the display. However, when a display displays an image, the image quality of the image displayed on the display is deteriorated by adjusting only the backlight of the display, and in order to secure the image quality of the displayed image, it is necessary to compensate Red Green Blue (RGB) data of the image, that is, to perform image compensation after adjusting the backlight.
In the prior art, when performing image compensation, data compensated for each component of RGB of each pixel point on a display is determined according to an adjusted backlight accumulation amount. However, for two pixels with the same gray scale but different backlight accumulation in an image, the gray scale may be different after image compensation, thereby causing image distortion.
Disclosure of Invention
The application provides an image compensation method, an image compensation device, display equipment, a chip and a medium, which are used for solving the problem that image distortion may occur after image compensation is performed on the basis of the backlight accumulation of pixel points in the prior art.
In a first aspect, some embodiments of the present application provide an image compensation method, including:
the method comprises the steps of obtaining a first backlight accumulation amount of each preset pixel point on a pre-stored display, wherein the display is divided into a plurality of sub-areas, and one sub-area comprises one preset pixel point;
aiming at each pixel point on the display, determining a first preset number of target preset pixel points adjacent to the pixel point; determining a second backlight accumulation amount of the pixel point according to the position information of the pixel point and each target preset pixel point and the first backlight accumulation amount of each target preset pixel point; aiming at each component of red, green and blue RGB of the pixel point, searching a target increment corresponding to the component in a mapping relation among the pre-stored backlight accumulation amount of the pixel point, the pre-stored original data and the increment according to the second backlight accumulation amount and the pre-stored original data of the component; and determining the data after the component compensation according to the original data of the component and the target increment corresponding to the component.
In a second aspect, some embodiments of the present application further provide an image compensation apparatus, including:
the device comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring a first backlight accumulation amount of each preset pixel point on a pre-stored display, the display is divided into a plurality of sub-regions, and one sub-region comprises one preset pixel point;
the processing module is used for determining a first preset number of target preset pixel points adjacent to each pixel point on the display; determining a second backlight accumulation amount of the pixel point according to the position information of the pixel point and each target preset pixel point and the first backlight accumulation amount of each target preset pixel point; aiming at each component of red, green and blue RGB of the pixel point, searching a target increment corresponding to the component in a mapping relation among the pre-stored backlight accumulation amount of the pixel point, the pre-stored original data and the increment according to the second backlight accumulation amount and the pre-stored original data of the component; and determining the data after the component compensation according to the original data of the component and the target increment corresponding to the component.
In a third aspect, some embodiments of the present application further provide a display device, including:
the display screen is used for displaying;
a processor for performing the steps of any of the image compensation methods described above.
In a fourth aspect, some embodiments of the present application further provide a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a computer program or instructions to implement the steps of any of the image compensation methods described above.
In a fifth aspect, some embodiments of the present application further provide a computer-readable storage medium storing a computer program, which when executed by a processor performs the steps of any of the image compensation methods described above.
In some embodiments of the present application, a first backlight accumulation amount of each preset pixel point on a pre-stored display is obtained, where the display is divided into a plurality of sub-regions, and one sub-region includes one preset pixel point; aiming at each pixel point on the display, determining a first preset number of target preset pixel points adjacent to the pixel point; determining a second backlight accumulation amount of the pixel point according to the position information of the pixel point and each target preset pixel point and the first backlight accumulation amount of each target preset pixel point; aiming at each component of red, green and blue RGB of the pixel point, searching a target increment corresponding to the component in a mapping relation among the pre-stored backlight accumulation amount of the pixel point, the pre-stored original data and the increment according to the second backlight accumulation amount and the pre-stored original data of the component; and determining the data after the component compensation according to the original data of the component and the target increment corresponding to the component. That is, in some embodiments of the present application, when performing image compensation, data after compensation of each component of RGB is determined according to not only the backlight accumulation amount of each pixel point, but also the original data of each component in RGB of each pixel point, thereby avoiding the situation of image distortion after image compensation, and ensuring the authenticity of the compensated image.
Drawings
In order to more clearly illustrate the technical solutions of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
FIG. 1 is a schematic diagram of an image compensation process provided in some embodiments of the present application;
FIG. 2 illustrates a usage scenario of a display device according to some embodiments;
fig. 3 shows a block diagram of a hardware configuration of the control apparatus 100 according to some embodiments;
fig. 4 illustrates a hardware configuration block diagram of the display apparatus 200 according to some embodiments;
FIG. 5 is a schematic diagram of an image compensation process provided in some embodiments of the present application;
FIG. 6 is a schematic illustration of sub-regions in a block region according to some embodiments of the present application;
fig. 7 is a schematic diagram of a pixel point and a target preset pixel point according to some embodiments of the present disclosure;
fig. 8 is a schematic diagram of a process of finding a value of a target corresponding to RGB components of a pixel point in a mapping relationship according to some embodiments of the present application;
fig. 9 is a schematic diagram illustrating an operation of an image compensation unit in a display device according to some embodiments of the present application;
fig. 10 is a schematic structural diagram of an image compensation apparatus according to some embodiments of the present application;
fig. 11 is a schematic structural diagram of a chip according to some embodiments of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the accompanying drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In order to avoid the situation of image distortion and improve the reality of compensated images, some embodiments of the present application provide an image compensation method, apparatus, display device, chip and medium.
Fig. 1 is a schematic structural diagram of a display device according to some embodiments of the present application, as shown in fig. 1, the display device includes a backlight source group 1 disposed on a single side or both sides of a display screen or behind the display screen, a liquid crystal display 2 for displaying a video image, a PWM circuit 3 for controlling a backlight source to emit light according to a determined value, a backlight processing unit 4, a VBO data transmission unit 5, an SOC or signal generator (TX)6, an image compensation unit 7, a Tcon or driving circuit 8, a P2P connection line 9, a backlight unit connection line 10, an SPI transmission line 11, a data reception unit 12, and an image-transmitting backlight data path 13 inside an ASIC or fpga.
Example 1:
the terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.
The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.
In the prior art, when an image is compensated, the image is compensated based on the backlight accumulation amount of the pixel points, and the problem of image distortion may occur after the image compensation. Therefore, in order to further improve the effect of image compensation and ensure the authenticity of the compensated image, some embodiments of the present application provide an image compensation method, an apparatus, a display device, a chip and a medium.
The following describes a usage scenario of a display device according to some embodiments of the present application with reference to the drawings.
Fig. 2 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 2, the display apparatus 200 is also in data communication with a server 400, and a user can operate the display apparatus 200 through the smart device 300 or the control device 100.
In some embodiments of the present application, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and the display device 200 is controlled by a wireless or wired method. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.
In some embodiments of the present application, the smart device 300 may include any one of a mobile terminal, a tablet, a computer, a laptop, an AR/VR device, and the like.
In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.
In some embodiments of the present application, the smart device 300 and the display device may also be used for data communication.
In some embodiments of the present application, the display device 200 may also be controlled by a manner other than the control apparatus 100 and the smart device 300, for example, the voice instruction control of the user may be directly received by a module configured inside the display device 200 to obtain a voice instruction, or may be received by a voice control apparatus provided outside the display device 200.
In some embodiments of the present application, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.
In some embodiments of the present application, software steps executed by one step execution agent may be migrated to another step execution agent in data communication therewith for execution as needed. Illustratively, software steps performed by the server may be migrated to be performed on a display device in data communication therewith, and vice versa, as desired.
Fig. 3 shows a block diagram of the configuration of the control apparatus 100 according to the exemplary embodiment. As shown in fig. 3, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.
In some embodiments of the present application, the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.
In some embodiments of the present application, the user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a key, or an alternative module.
Fig. 4 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.
In some embodiments of the present application, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280.
In some embodiments of the present application, the controller includes a central processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, a first interface to an nth interface for input/output.
In some embodiments of the present application, the display 260 includes a display screen component for displaying pictures, and a driving component for driving image display, and is configured to receive image signals from the controller output, perform components for displaying video content, image content, and menu manipulation interface, perform user manipulation UI interface, and the like.
In some embodiments of the present application, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
In some embodiments of the present application, the tuner demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
In some embodiments of the present application, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.
In some embodiments of the present application, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.
In some embodiments of the present application, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.
In some embodiments of the present application, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
In some embodiments of the present application, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
In some embodiments of the present application, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.
In some embodiments of the present application, the controller includes at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first interface to an nth interface for input/output, a communication Bus (Bus), and the like.
A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.
In some embodiments of the present application, a graphics processor for generating various graphics objects, such as: at least one of an icon, an operation menu, and a user input instruction display figure. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.
In some embodiments of the present application, the video processor is configured to receive an external video signal, and perform at least one of video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal displayed or played on the direct display apparatus 200.
In some embodiments of the present application, the video processor includes at least one of a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like. And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received video output signal after the frame rate conversion, and changing the signal to be in accordance with the signal of the display format, such as an output RGB data signal.
In some embodiments of the present application, the audio processor is configured to receive an external audio signal, perform at least one of decompression and decoding according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played in the speaker.
In some embodiments of the present application, a user may input a user command on a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
In some embodiments of the present application, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.
In some embodiments of the present application, the user interface 280 is an interface (e.g., physical buttons on the body of the display device, or the like) that can be used to receive control inputs.
In some embodiments of the present application, a system of a display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.
Example 2:
fig. 5 is a schematic diagram of an image compensation process provided in some embodiments of the present application, where the process includes:
s501: the method comprises the steps of obtaining a first backlight accumulation amount of each preset pixel point on a displayer which is stored in advance, wherein the displayer is divided into a plurality of sub-areas, and one sub-area comprises one preset pixel point.
Some embodiments of the present application provide an image compensation method applied to a display device, where the display device may be a television, a mobile phone, or the like.
In some embodiments of the present application, image compensation is performed on each pixel point in the display according to the backlight accumulation amount of each pixel point in the display, but because the calculation process of the backlight accumulation amount is too complex, if the display device determines the backlight accumulation amount corresponding to the pixel point for each pixel point, overload of the display device may be caused, and normal operation of the display device may be affected.
Therefore, in some embodiments of the present application, the display device divides the display into a plurality of block areas with the same size according to the position of the MINILED in the display, and each block area includes one MINILED. For each block area, the block area is further divided into a plurality of sub-areas, and the number of pixel points included in each sub-area is the same, for example, 20 × 20 pixel points are included in one sub-area.
Fig. 6 is a schematic diagram of sub-regions in a block area according to some embodiments of the present application, and as shown in fig. 6, a block area is divided into 6 × 6 sub-regions.
The display equipment determines and stores a first backlight accumulation amount of each preset pixel point in each sub-area according to the lighting condition of the MINILED in the sub-area and the brightness distribution data of the MINILED in other adjacent sub-areas.
When the display device performs image compensation on each pixel point subsequently, the backlight accumulation amount of each pixel point in the display can be further determined according to the first backlight accumulation amount of the preset pixel point in each sub-area.
S502: aiming at each pixel point on the display, determining a first preset number of target preset pixel points adjacent to the pixel point; determining a second backlight accumulation amount of the pixel point according to the position information of the pixel point and each target preset pixel point and the first backlight accumulation amount of each target preset pixel point; aiming at each component of red, green and blue RGB of the pixel point, searching a target increment corresponding to the component in a mapping relation among the pre-stored backlight accumulation amount of the pixel point, the pre-stored original data and the increment according to the second backlight accumulation amount and the pre-stored original data of the component; and determining the data after the component compensation according to the original data of the component and the target increment corresponding to the component.
In some embodiments of the present application, when performing image compensation, compensation is performed for each component of RGB of each pixel point in the display. And when each component of RGB of each pixel point is compensated, the compensation is carried out based on the original data of the component and the second backlight accumulation amount of the pixel point.
And aiming at each pixel point in the display, determining a first preset number of preset pixel points adjacent to the pixel point as target preset pixel points. And determining a second backlight accumulation amount of the pixel point according to a first backlight accumulation amount corresponding to the target preset pixel points with the first preset number, wherein generally, the first preset number is 4.
Specifically, in some embodiments of the present application, when determining the second backlight accumulation amount of the pixel point according to the first backlight accumulation amount of the target preset pixel points of the first preset number, one or more of the following manners may be adopted:
the first method is as follows: and determining the average value of the first backlight accumulation amounts of the target preset pixel points with the first preset number, and determining the average value as the second backlight accumulation amount of the pixel points.
For example, four target preset pixel points adjacent to the pixel point are determined, then an average value of the first backlight accumulation amount of each target preset pixel point is determined, and finally the average value is determined to be the second backlight accumulation amount of the pixel point.
The second method comprises the following steps: and determining the product of each weight and the corresponding first backlight accumulation amount according to the preset weight corresponding to each target preset pixel point and the first backlight accumulation amount of each target preset pixel point, and determining the sum of all the products as the second backlight accumulation amount of the pixel point. Optionally, the weight corresponding to each target preset pixel point may also be calculated according to a pre-configured calculation rule.
For example, four target preset pixel points adjacent to the pixel point are determined, then, according to the first backlight accumulation amount of each target preset pixel point and the weight of each target preset pixel point, the product of each weight and the corresponding first backlight accumulation amount is determined, and finally, the sum of all the products is determined as the second backlight accumulation amount of the pixel point.
The display device stores the backlight accumulation amount of the pixel points, the original data of each component in RGB and the mapping relation of the added value, and the mapping relation is used for searching the added value corresponding to a certain component of a certain pixel point. The mapping relationship may be stored for each component, or only one mapping relationship may be stored, which is not limited herein.
Specifically, in some embodiments of the present application, after the second backlight accumulation amount of each pixel point is determined, for each component of RGB of the pixel point, a target increment corresponding to the second backlight accumulation amount and original data of the component is searched in the mapping relationship. And determining the data after the component compensation according to the original data of the component and the target increment.
It should be noted that in some embodiments of the present application, the target increment may be a specific value of increase or may be a multiple of the increase. If the target increment is a specific increased numerical value, determining the sum of the original data of the component and the target increment, and determining the sum as compensated data; and if the target increment is a multiple of the increase, determining the product of the original data of the component and the target increment, and determining the product as compensated data.
In some embodiments of the present application, when performing image compensation, the compensated data of each component of RGB is determined according to not only the backlight accumulation amount of each pixel point, but also the original data of each component in the original RGB of each pixel point, thereby avoiding the situation of image distortion after image compensation, and ensuring the authenticity of the compensated image.
Example 2:
in order to reduce the load pressure of the display device, in some embodiments of the present application on the basis of the foregoing embodiments, the method for determining the first accumulated backlight amount of each preset pixel point on the display includes:
for each subregion, determining a first product of brightness diffusion distribution data corresponding to each subregion in the target block area and each other block area and a backlight lighting value according to a pre-saved backlight lighting value of the target block area where the subregion is located and each other block area in a set range including the target block area, and pre-saved brightness diffusion distribution data of each subregion in the target block area and each other block area in the set range including the target block area; and determining the first sum of each first product as a first backlight accumulation of preset pixel points contained in the sub-area.
In some embodiments of the present application, a backlight lighting value of each block area and luminance spread distribution data (profile) of each sub-area in each block area of the display device are stored in the display device. The backlight lighting value may be stored in a Static Random-Access Memory (SRAM) of the display device, the brightness diffusion distribution Data may be configured in a Central Processing Unit (CPU) in advance, and the brightness diffusion distribution Data may also be stored in a Double Rate synchronous dynamic Random Access Memory (BLDDR).
For each subregion, the display device obtains a target block area where the subregion is located and a backlight lighting value of each other block area within a set range including the target block area according to a backlight lighting value of each block area and brightness diffusion distribution data of each subregion, which are pre-stored, and obtains the brightness diffusion distribution data of each subregion in the target block area and each other block area within the set range including the target block area.
Aiming at each block area in a target block area and other block areas, determining a first product of a backlight lighting value of the block area and brightness diffusion distribution data corresponding to each subregion in the block area; and determining the first sum of each first product as a first backlight accumulation amount of preset pixel points contained in the sub-area of the target block area.
Specifically, in some embodiments of the present application, the first backlight accumulation amount of each sub-region may be determined according to the following formula:
S(x,y,i,j)=ΣΣP(x,y,i,j)×B(x,y)
the method comprises the steps that S is a first backlight accumulation amount of a preset pixel point of a subregion, P is brightness diffusion distribution data of the subregion, B is a backlight lighting value of a block area, x and y are used for representing the position of the block area in a display, and i and j are used for representing the position of the subregion in the display.
Example 3:
in order to determine the second backlight accumulation amount of each pixel point, on the basis of the foregoing embodiments, in some embodiments of the present application, the determining the second backlight accumulation amount of the pixel point according to the position information of the pixel point and each target preset pixel point and the first backlight accumulation amount of each target preset pixel point includes:
aiming at each target preset pixel point, determining the horizontal distance and the vertical distance between the pixel point and the target pixel point in a display; determining the weight corresponding to the target preset pixel point according to the horizontal distance and the vertical distance;
and determining a second backlight accumulation amount of each pixel point according to the first backlight accumulation amount of each target preset pixel point and the corresponding weight of each target preset pixel point.
In some embodiments of the present application, when determining the second backlight accumulation amount of the pixel points, the determination may be performed based on the first backlight accumulation amounts of the target preset pixel points of the first preset number and the weight corresponding to each target preset pixel point. For each target preset pixel point, the weight corresponding to the target preset pixel point can be determined according to the position relationship between the pixel point and the target preset pixel point.
Specifically, for each target preset pixel point, a horizontal distance and a vertical distance between the pixel point and the target preset pixel point in the display are determined, and the weight corresponding to the target preset pixel point is determined according to the horizontal distance and the vertical distance. And if the product of the horizontal distance and the vertical distance is determined as the weight corresponding to the target preset pixel point. And determining the product of the first backlight accumulation amount of the target preset pixel point and the weight.
And determining the sum of the products of the first backlight accumulation amounts of all the target preset pixel points and the weights corresponding to the target preset pixel points as a second backlight accumulation amount of the pixel points.
Fig. 7 is a schematic diagram of a pixel point and a target preset pixel point according to some embodiments of the present disclosure, and as shown in fig. 7, the target preset pixel point is represented by lt, rt, ld, and rd, and the corresponding first backlight accumulation amounts are lt _ data, rt _ data, ld _ data, and rd _ data, respectively. Wherein, the horizontal distance between lt and the pixel point is q, the vertical distance is p, and the weight lt _ weight corresponding to lt is q × p; the horizontal distance between rt and the pixel point is 1-q, the vertical distance is p, and the weight corresponding to rt is rt _ weight which is (1-q) × p; the horizontal distance between ld and the pixel point is q, the vertical distance is 1-p, and the weight ld _ weight corresponding to ld is q (1-p); and the horizontal distance between the rd and the pixel point is 1-q, the vertical distance is 1-p, and the weight corresponding to the rd is (1-q) × (1-p). And finally determining a second backlight accumulation amount Data ═ lt _ Data _ weight + rt _ Data _ rt _ weight + ld _ Data _ ld _ weight + rd _ Data _ rd _ weight of the pixel point, namely Data ═ lt _ Data q × + rt _ Data × (1-q) p + ld _ Data × (1-p) + rd _ Data (1-q).
In addition, in some embodiments of the present application, when the display displays an image, for any pixel point on the display, when different images are displayed, the pixel values of the pixel point are also different. The pixel point may be a boundary point with a black-white color change, the pixel value of the target preset pixel point may be different from the pixel point, and if the weight of the target preset pixel point is determined only according to the horizontal distance and the vertical distance between the pixel point and the target preset pixel point in the display, it may be caused that the second backlight accumulation amount for determining the pixel point may cause a black-white color boundary blur.
Therefore, in some embodiments of the present application, if the pixel point is a boundary point with a black-and-white color change, when determining the second backlight accumulation amount of the pixel point, besides determining a weight according to a position relationship between the pixel point and a target preset pixel point, another weight may be determined according to a cable operator template and a pixel value of the target preset pixel point, and according to the two weights, a final weight corresponding to the target preset pixel point is obtained; and finally determining the sum of the products of each final weight and the first backlight accumulation of the corresponding target preset pixel point, and determining the ratio of the sum to the sum of each final weight as the second backlight accumulation of the pixel point. The process of determining the weight according to the able operator template and the pixel value of the target preset pixel point is the prior art, and is not repeated here.
Continuing to use the example in embodiment 3, if the pixel point is a boundary point with black and white color change, determining that another weight corresponding to lt is a _ weight, another weight corresponding to rt is b _ weight, another weight corresponding to ld is c _ weight, and another weight corresponding to rd is d _ weight according to the able operator template; and the final weight corresponding to lt is lt _ weight _ m ═ lt _ weight _ a _ weight, the final weight corresponding to rt is rt _ weight _ m ═ rt _ weight _ b _ weight, the final weight corresponding to ld is ld _ weight _ m ═ ld _ weight _ c _ weight, the final weight corresponding to rd _ weight _ m ═ rd _ weight _ d _ weight, and the second backlight accumulation amount of the pixel is Data (lt _ weight _ m + rt _ weight _ m + ld _ Data _ ld _ weight _ Data).
Example 4:
in order to determine compensated data of each component based on the backlight accumulation amount of each pixel and the original data of each component in RGB, and improve the reality of the compensated image, on the basis of the foregoing embodiments, in some embodiments of the present application, the finding a target added value corresponding to the component in a mapping relationship between the backlight accumulation amount of the pixel, the original data, and the added value that are pre-stored according to the second backlight accumulation amount and the original data of the component includes:
acquiring a target first data length of the original data of the component, and determining intermediate quantized original data of a second data length corresponding to the original data of the target first data length according to a first conversion relation of the original data of the first data length and quantized original data of the second data length in the mapping relation, wherein the first conversion relation is preserved in advance;
determining first sub-quantization original data and second sub-quantization original data according to the intermediate quantization original data;
acquiring a target third data length of the second backlight accumulation amount, and determining a middle quantized backlight accumulation amount of a fourth data length corresponding to the second backlight accumulation amount of the target third data length according to a second conversion relation of the second backlight accumulation amount of the third data length and the quantized backlight accumulation amount of the fourth data length in the mapping relation, wherein the second conversion relation is pre-stored;
determining a first sub-quantization backlight accumulation amount and a second sub-quantization backlight accumulation amount according to the intermediate quantization backlight accumulation amount;
using the sub-quantization backlight accumulation amount as an x coordinate, using the sub-quantization original data as a y coordinate, determining a coordinate corresponding to each combination according to the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data and the second sub-quantization original data, and determining an increment corresponding to each coordinate according to a corresponding relation of the backlight accumulation amount, the original data and the increment stored in the mapping relation;
and determining a target increment according to the increment corresponding to each coordinate and the weight coefficients respectively corresponding to the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data and the second sub-quantization original data which are stored.
When performing image compensation on each pixel point of the display, image compensation is performed on each component of RGB of each pixel point, that is, a target value added corresponding to each component of RGB of each pixel point is determined, where a process of determining the target value added of each component is the same.
In some embodiments of the present application, a 2D color lookup Table (LUT) is stored in the display device, and the 2D LUT stores a mapping relationship between the backlight accumulation amount of the pixel point, the original data, and the added value. Since the 2DLUT is fixedly stored in the display device, the backlight accumulation amount of each pixel point in the display of the display device and the raw data of each component of RGB can be adjusted according to the actual display situation. Therefore, it may occur that the data length of each component of RGB of the pixel point is not consistent with the data length of the original data in the 2DLUT, and similarly, the data length of the backlight accumulation amount of the pixel point may also be not consistent with the data length of the backlight accumulation amount in the 2 DLUT. If the data length of each component of RGB of the pixel point is inconsistent with the data length of the original data in the 2DLUT, the original data cannot be searched in the 2 DLUT; if the data length of the backlight accumulation of the pixel point may not be consistent with the data length of the backlight accumulation in the 2DLUT, the backlight accumulation cannot be found in the 2 DLUT.
Therefore, in the implementation of the present application, when searching for the target added value corresponding to each component of RGB of each pixel point in the 2DLUT, the data length of the original data of the component needs to be converted into the data length of the original data in the 2DLUT, and the data length of the second backlight accumulation amount of the pixel point needs to be converted into the data length of the backlight accumulation amount in the 2 DLUT.
Specifically, in some embodiments of the present application, for each component of RGB of each pixel point, a target first data length of original data of the component is obtained, and according to a first conversion relationship between the original data of the first data length stored in advance and quantized original data of a second data length in the mapping relationship, intermediate quantized original data of the second data length corresponding to the original data of the target first data length is determined. And acquiring a target third data length of the second backlight accumulation amount, and determining a middle quantized backlight accumulation amount of a fourth data length corresponding to the second backlight accumulation amount of the target third data length according to a second conversion relation between the prestored second backlight accumulation amount of the third data length and the quantized backlight accumulation amount of the fourth data length in the mapping relation. The first conversion relationship may be determined in advance and stored in the display device, or after the original data and the second backlight accumulation amount are acquired, a ratio of a target first data length of the original data to a second data length in the mapping relationship may be determined as the first conversion relationship, and a ratio of a target third data length of the second backlight accumulation amount to a fourth data length in the mapping relationship may be determined as the second conversion relationship.
For example, if a target first data length of original data of RGB components of a pixel point is 12 bits, and a second data length of the original data in the mapping relationship is 8 bits, the first conversion relationship is 12 bits/8 bits ═ 4 bits ═ 16, and according to the first conversion relationship, intermediate quantized original data corresponding to the original data is determined; if the target third data length of the second backlight accumulation amount of the pixel point is 14 bits, and the fourth data length of the backlight accumulation amount in the mapping relation is 8 bits, the second conversion relation is 14 bits/8 bits-6 bits-256, and the intermediate quantized backlight accumulation amount corresponding to the second backlight accumulation amount is determined according to the second conversion relation.
It should be noted that, all the original data and the backlight accumulation amount stored in the mapping relationship are integers, and the intermediate quantized original data and the intermediate quantized backlight accumulation amount obtained by the determination may be decimal numbers, which results in that the corresponding increment of the intermediate quantized original data and the intermediate quantized backlight accumulation amount may not be found in the mapping relationship.
Based on this, in order to ensure that the second backlight accumulation amount of the pixel point and the target added value corresponding to the original data can be found in the mapping relationship, in some embodiments of the present application, after the intermediate quantized original data corresponding to the original data is determined, the first sub-quantized original data and the second sub-quantized original data are determined according to the intermediate quantized original data; similarly, after determining an intermediate quantized backlight accumulation amount corresponding to the second backlight accumulation amount, the first sub-quantized backlight accumulation amount and the second sub-quantized backlight accumulation amount are determined according to the intermediate quantized backlight accumulation amount. The first sub-quantization original data, the second sub-quantization original data, the first sub-quantization backlight accumulation amount and the second sub-quantization backlight accumulation amount are integers.
After the first sub-quantization original data, the second sub-quantization original data, the first sub-quantization backlight accumulation amount, and the second sub-quantization backlight accumulation amount are determined, a target increment corresponding to a component may be determined according to the first sub-quantization original data, the second sub-quantization original data, the first sub-quantization backlight accumulation amount, and the second sub-quantization backlight accumulation amount.
Specifically, the sub-quantization backlight accumulation amount is used as an x coordinate, the sub-quantization original data is used as a y coordinate, and the coordinate corresponding to each combination is determined according to the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data and the second sub-quantization original data. In some embodiments of the present application, the mapping relationship is stored in a 2DLUT, the 2DLUT is a planar coordinate system, the backlight accumulation amount is an x coordinate, the raw data is a y coordinate, one coordinate can be determined by one backlight accumulation amount and one raw data, and each coordinate corresponds to an increment in the 2 DLUT. Based on this, after the coordinates corresponding to each combination are determined, the added value corresponding to each coordinate may be determined according to the backlight accumulated amount and the original data included in the coordinates and the corresponding relationship of the backlight accumulated amount, the original data, and the added value stored in the mapping relationship.
And determining a target increment according to the increment corresponding to each coordinate and the weight coefficients respectively corresponding to the stored first sub-quantization backlight accumulation amount, the stored second sub-quantization backlight accumulation amount, the stored first sub-quantization original data and the stored second sub-quantization original data.
In some embodiments of the present application, bilinear interpolation may be used to determine the target increment. Specifically, in some embodiments of the present application, four coordinates are determined according to the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data, and the second sub-quantization original data, and two coordinates of the four coordinates, which have the same y coordinate, are grouped into one group. For each group of coordinates, inserting a coordinate into the two coordinates of the group according to the increment corresponding to each coordinate in the group of coordinates and the weight coefficient corresponding to the x coordinate of each coordinate, and determining the increment corresponding to the coordinate; and then inserting a coordinate into the two newly inserted coordinates according to the increment corresponding to each newly inserted coordinate and the weight coefficient corresponding to the y coordinate of each newly inserted coordinate, and determining the increment corresponding to the coordinate as the target increment.
Fig. 8 is a schematic diagram of a process of finding a value of a target corresponding to an RGB component of a pixel point in a mapping relationship according to some embodiments of the present application, where the process includes:
s801: according to a first conversion relation stored in advance, determining intermediate quantized original data corresponding to original data of RGB components of a pixel point, and according to the intermediate quantized original data, determining first sub-quantized original data and second sub-quantized original data.
S802: and determining the weight coefficients corresponding to the first sub-quantization original data and the second sub-quantization original data respectively.
S803: and determining an intermediate quantization backlight accumulation amount corresponding to the second backlight accumulation amount of the pixel point according to a second conversion relation stored in advance, and determining the first sub-quantization backlight accumulation amount and the second sub-quantization backlight accumulation amount according to the intermediate quantization backlight accumulation amount.
S804: and determining weight coefficients corresponding to the first sub-quantization backlight accumulation amount and the second sub-quantization backlight accumulation amount respectively.
Wherein, the above-mentioned S801-S802 and S803-S804 are parallel processing procedures.
S805: and determining the coordinate corresponding to each combination according to the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data and the second sub-quantization original data, and determining the increment corresponding to each coordinate according to the corresponding relation of the backlight accumulation amount, the original data and the increment stored in the mapping relation.
S806: and determining a target increment according to the increment corresponding to each coordinate and the weight coefficients respectively corresponding to the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data and the second sub-quantization original data which are stored.
Example 5:
for determining the first sub-quantized original data and the second sub-quantized original data, on the basis of the above embodiments, in some embodiments of the present application, the determining the first sub-quantized original data and the second sub-quantized original data according to the intermediate quantized original data includes:
determining an integer part of the intermediate quantized raw data as first sub-quantized raw data;
and determining a fifth sum of the integer part of the intermediate quantized original data and a preset value, and determining the fifth sum as the second sub-quantized original data.
After the intermediate quantized original data is determined, the intermediate quantized original data cannot be found in the mapping relationship saved in advance because the intermediate quantized original data may be decimal. Therefore, in order to avoid the situation that the mapping relation cannot be found, in some embodiments of the present application, after the intermediate quantized original data is determined, whether the intermediate quantized original data is an integer or not, the first sub-quantized original data and the second sub-quantized original data are determined based on the intermediate quantized original data. In order to reduce the amount of calculation, when the intermediate quantized original data is an integer, the intermediate quantized original data may be directly determined as the first sub-quantized original data or the second sub-quantized original data.
Specifically, an integer part of the intermediate quantized original data is determined as first sub-quantized original data, a fifth sum of the integer part and a preset value is determined, and the fifth sum is determined as second sub-quantized original data. In order to improve the accuracy of the search in the mapping relationship, the preset data is a difference value between two adjacent original data in the mapping relationship, and generally, the preset data is 1.
For example, in some embodiments of the present application, the second scaling relationship is 256, the raw data of RGB components of the pixel point is image _ data, and the determined intermediate quantized raw data is image _ data/256. Correspondingly, the first sub-quantization original data is represented by image _ int _ x, where image _ int _ x is an integer part of image _ data/256, the second sub-quantization original data is represented by image _ int _ x _ right, and image _ int _ x _ right is 1+ image _ int _ x.
Example 6:
to determine the first sub-quantization backlight accumulation amount and the second sub-quantization backlight accumulation amount, on the basis of the above embodiments, in some embodiments of the present application, the determining the first sub-quantization backlight accumulation amount and the second sub-quantization backlight accumulation amount according to the intermediate quantization backlight accumulation amount includes:
determining an integer portion of the intermediate quantization backlight accumulation amount as a first sub-quantization backlight accumulation amount;
determining a sixth sum of the integer part of the intermediate quantization backlight accumulation amount and a preset numerical value, and determining the sixth sum as the second sub-quantization backlight accumulation amount.
After the intermediate quantized backlight accumulation amount is determined, the intermediate quantized backlight accumulation amount may not be found in the pre-saved mapping because the intermediate quantized backlight accumulation amount may be a small number. Therefore, in order to avoid the situation that the mapping relation cannot be found, in some embodiments of the present application, after the intermediate quantized backlight accumulation amount is determined, whether the intermediate quantized backlight accumulation amount is an integer or not, the first sub-quantized backlight accumulation amount and the second sub-quantized backlight accumulation amount are determined based on the intermediate quantized backlight accumulation amount. In order to reduce the amount of calculation, when the intermediate quantized backlight accumulation amount is an integer, the intermediate quantized backlight accumulation amount may be directly determined as the first sub-quantized backlight accumulation amount or the second sub-quantized backlight accumulation amount.
Specifically, an integer part of the intermediate quantization backlight accumulation amount is determined as a first sub-quantization backlight accumulation amount, a sixth sum of the integer part and a preset numerical value is determined, and the sixth sum is determined as a second sub-quantization backlight accumulation amount. In order to improve the accuracy of the search in the mapping relationship, the preset data is a difference value between two adjacent backlight accumulation amounts in the mapping relationship, and generally, the preset data is 1.
For example, in some embodiments of the present application, the first scaling relationship is 16, the second backlight accumulation amount of the pixel is pixel _ bl, and the determined intermediate quantization backlight accumulation amount is pixel _ bl/16. Correspondingly, the first sub-quantization backlight accumulation amount is represented by image _ int _ y, where image _ int _ y is an integer part of pixel _ bl/16, the second sub-quantization backlight accumulation amount is represented by image _ int _ y _ bottom, and image _ int _ y _ bottom is 1+ image _ int _ y.
Example 7:
in order to maximize the accuracy of the finally determined target increment and improve the capability of image compensation, on the basis of the foregoing embodiments, in some embodiments of the present application, a method for determining weighting coefficients corresponding to a first sub-target quantized backlight accumulation amount, a second sub-target quantized backlight accumulation amount, a first sub-target quantized original data, and a second sub-target quantized original data respectively includes:
determining a decimal part of the intermediate quantization backlight accumulation amount as a first weight coefficient corresponding to the second sub-quantization backlight accumulation amount;
determining a first difference value between a preset numerical value and a fractional part of the intermediate quantization backlight accumulation amount, and determining the first difference value as a second weight coefficient corresponding to the first sub-quantization backlight accumulation amount;
determining a decimal part of the intermediate quantized original data as a third weight coefficient corresponding to the second sub-quantized original data;
and determining a second difference value between the preset numerical value and the decimal part of the intermediate quantized original data, and determining the second difference value as a fourth weight coefficient corresponding to the first sub-quantized original data.
In order to better determine a target increment corresponding to a component of RGB of a pixel point based on a first sub-target quantized backlight accumulation amount, a second sub-target quantized backlight accumulation amount, a first sub-target quantized raw data and a second sub-target quantized raw data, in some embodiments of the present application, a weight coefficient corresponding to each of the first sub-target quantized backlight accumulation amount, the second sub-target quantized backlight accumulation amount, the first sub-target quantized raw data and the second sub-target quantized raw data is determined respectively.
Specifically, a fractional part of the intermediate quantization backlight accumulation amount is determined as a first weight coefficient corresponding to the second sub-quantization backlight accumulation amount; determining a first difference value between a preset numerical value and a fractional part of the intermediate quantization backlight accumulation amount, and determining the first difference value as a second weight coefficient corresponding to the first sub-quantization backlight accumulation amount; determining the decimal part of the intermediate quantized original data as a third weight coefficient corresponding to the second sub-quantized original data; and determining a second difference value between the preset value and the decimal part of the intermediate quantized original data, and determining the second difference value as a fourth weight coefficient corresponding to the first sub-quantized original data. Typically, the predetermined value is 1.
Continuing with the example in embodiment 5 and embodiment 6, the weight _ iny _ bottom _ coe represents the first weight coefficient corresponding to the second sub-quantization backlight accumulation amount, the weight _ inx _ coe represents the second weight coefficient corresponding to the first sub-quantization backlight accumulation amount, the weight _ inx _ coe _ right represents the third weight coefficient corresponding to the first sub-quantization original data, the weight _ inx _ coe represents the fourth weight coefficient corresponding to the first sub-quantization original data, the weight _ inx _ coe is 1-weight _ iny _ bottom _ coe, the weight _ inx _ coe _ right _ data/256 is the decimal portion, and the weight _ 3529 _ coe _ weight _ 356 is the decimal portion.
Example 8:
in order to implement image compensation for a pixel point of a display, on the basis of the foregoing embodiments, in some embodiments of the present application, the determining a target increment according to the increment corresponding to each coordinate and the weight coefficients respectively corresponding to the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data, and the second sub-quantization original data, includes:
determining an x coordinate as each second product of each increment of the first sub backlight accumulation amount and the second weight coefficient respectively, and determining a second sum of each second product;
determining an x coordinate as each third product of each increment of the second sub backlight accumulation amount and the first weight coefficient respectively, and determining a third sum of each third product;
determining a fourth product of the second sum and the fourth weighting factor, and a fifth product of the third sum and the fourth weighting factor;
determining a fourth sum of the fourth product and the fifth product, the fourth sum being determined as the target increment.
In some embodiments of the present application, after determining the coordinates corresponding to each combination and the increment corresponding to each coordinate in the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data, and the second sub-quantization original data, the target increment may be determined according to bilinear interpolation.
Specifically, the x coordinate is determined as each second product of each increment of the first sub-backlight accumulation amount and the second weight coefficient, and a second sum of each second product is determined; determining an x coordinate as each third product of each increment of the second sub backlight accumulation amount and the first weight coefficient respectively, and determining a third sum of each third product; determining a fourth product of the second sum and the fourth weight coefficient, and a fifth product of the third sum and the fourth weight coefficient; determining a fourth sum of the fourth product and the fifth product, the fourth sum being determined as the target increment.
Continuing with the example in the above embodiments 5-7, based on the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data, and the second sub-quantization original data, the coordinates corresponding to each combination are determined to be (image _ int _ x, image _ int _ y), (image _ int _ x _ right, image _ int _ y), (image _ int _ x, image _ int _ y _ bottom), and (image _ int _ x _ right, image _ int _ y _ bottom), and the corresponding increments of each coordinate in the mapping relationship are respectively data1, data2, data3, and data 4. The second sum is represented by data5, data5 ═ data1 ═ weight _ int _ x _ coe + data2 ═ weight _ int _ x _ right _ coe; the third sum is represented by data6, data6 ═ data3 ═ weight _ int _ x _ coe + data4 ═ weight _ int _ x _ right _ coe; the fourth sum is represented by data7, and data7 is data5 weight _ int _ y _ coe + data6 weight _ int _ y _ bottom _ coe, that is, the target increment is data 7.
In addition, in some embodiments of the present application, the target increment in the mapping relationship is an increment multiple, and therefore, after the target increment of the RGB component of the pixel point is obtained, a product of the original data of the component and the target increment is determined as the data after the component is increased. It should be noted that, in order to avoid that the increased data of the component is large and causes image distortion, a threshold value of the increased data is stored in the display device, and if the product of the original data of the component and the target increment is larger than the threshold value, the threshold value is determined as the increased data of the component.
Fig. 9 is a schematic diagram of an operation of an image compensation unit in a display device according to some embodiments of the present application, and as shown in fig. 9, for each component of RGB of each pixel point, according to a pre-stored 2DLUT, a target increment corresponding to the component is determined, a product of original data of the component and the target increment is determined, if the product is smaller than a threshold, the product is determined as data after the component is increased and output, and if the product is larger than the threshold, the threshold is determined as data after the component is increased and output.
Example 9:
fig. 10 is a schematic structural diagram of an image compensation apparatus according to some embodiments of the present application, the apparatus including:
an obtaining module 1001, configured to obtain a first backlight accumulation amount of each preset pixel on a pre-stored display, where the display is divided into multiple sub-regions, and each sub-region includes one preset pixel;
a processing module 1002, configured to determine, for each pixel point on the display, a first preset number of target preset pixel points adjacent to the pixel point; determining a second backlight accumulation amount of the pixel point according to the position information of the pixel point and each target preset pixel point and the first backlight accumulation amount of each target preset pixel point; aiming at each component of red, green and blue RGB of the pixel point, searching a target increment corresponding to the component in a mapping relation among the pre-stored backlight accumulation amount of the pixel point, the pre-stored original data and the increment according to the second backlight accumulation amount and the pre-stored original data of the component; and determining the data after the component compensation according to the original data of the component and the target increment corresponding to the component.
In a possible implementation manner, the processing module 1002 is further configured to determine, for each sub-region, a first product of brightness diffusion distribution data corresponding to each sub-region in the target block area and each other block area in the set range including the target block area according to a pre-stored backlight lighting value of each other block area in the target block area where the sub-region is located and the set range including the target block area, and pre-stored brightness diffusion distribution data of each sub-region in the target block area and each other block area in the set range including the target block area, and the backlight lighting value; and determining the first sum of each first product as a first backlight accumulation of preset pixel points contained in the sub-area.
In a possible implementation manner, the processing module 1002 is specifically configured to preset a pixel point for each target, and determine a horizontal distance and a vertical distance between the pixel point and the target pixel point in a display; determining the weight corresponding to the target preset pixel point according to the horizontal distance and the vertical distance;
and determining a second backlight accumulation amount of each pixel point according to the first backlight accumulation amount of each target preset pixel point and the corresponding weight of each target preset pixel point.
In a possible implementation manner, the processing module 1002 is specifically configured to obtain a target first data length of the original data of the component, and determine intermediate quantized original data of a second data length corresponding to the original data of the target first data length according to a first conversion relationship between the original data of the first data length and quantized original data of the second data length in the mapping relationship, where the first conversion relationship is pre-stored; determining first sub-quantization original data and second sub-quantization original data according to the intermediate quantization original data; acquiring a target third data length of the second backlight accumulation amount, and determining a middle quantized backlight accumulation amount of a fourth data length corresponding to the second backlight accumulation amount of the target third data length according to a second conversion relation of the second backlight accumulation amount of the third data length and the quantized backlight accumulation amount of the fourth data length in the mapping relation, wherein the second conversion relation is pre-stored; determining a first sub-quantization backlight accumulation amount and a second sub-quantization backlight accumulation amount according to the intermediate quantization backlight accumulation amount; using the sub-quantization backlight accumulation amount as an x coordinate, using the sub-quantization original data as a y coordinate, determining a coordinate corresponding to each combination according to the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data and the second sub-quantization original data, and determining an increment corresponding to each coordinate according to a corresponding relation of the backlight accumulation amount, the original data and the increment stored in the mapping relation; and determining a target increment according to the increment corresponding to each coordinate and the weight coefficients respectively corresponding to the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data and the second sub-quantization original data which are stored.
In a possible implementation manner, the processing module 1002 is specifically configured to determine a fractional part of the intermediate quantization backlight accumulation amount as a first weight coefficient corresponding to the second sub-quantization backlight accumulation amount; determining a first difference value between a preset numerical value and a fractional part of the intermediate quantization backlight accumulation amount, and determining the first difference value as a second weight coefficient corresponding to the first sub-quantization backlight accumulation amount; determining a decimal part of the intermediate quantized original data as a third weight coefficient corresponding to the second sub-quantized original data; and determining a second difference value between the preset numerical value and the decimal part of the intermediate quantized original data, and determining the second difference value as a fourth weight coefficient corresponding to the first sub-quantized original data.
In a possible implementation manner, the processing module 1002 is specifically configured to determine an x coordinate as each increment of the first sub-backlight accumulation amount and each second product of the second weight coefficient, and determine a second sum of each second product; determining an x coordinate as each third product of each increment of the second sub backlight accumulation amount and the first weight coefficient respectively, and determining a third sum of each third product; determining a fourth product of the second sum and the fourth weighting factor, and a fifth product of the third sum and the fourth weighting factor; determining a fourth sum of the fourth product and the fifth product, the fourth sum being determined as the target increment.
In a possible implementation manner, the processing module 1002 is specifically configured to determine an integer part of the intermediate quantized original data as a first sub-quantized original data; and determining a fifth sum of the integer part of the intermediate quantized original data and a preset value, and determining the fifth sum as the second sub-quantized original data.
In a possible implementation manner, the processing module 1002 is specifically configured to determine an integer part of the intermediate quantization backlight accumulation amount as a first sub-quantization backlight accumulation amount; determining a sixth sum of the integer part of the intermediate quantization backlight accumulation amount and a preset numerical value, and determining the sixth sum as the second sub-quantization backlight accumulation amount.
Example 10:
fig. 11 is a schematic structural diagram of a chip according to some embodiments of the present application. The chip includes one or more (including two) processors 1101 and a communication interface 1102.
Optionally, the chip further includes a memory 1103, and the memory 1103 may include a read-only memory and a random access memory and provide operating instructions and data to the processor. The portion of memory may also include non-volatile random access memory (NVRAM).
In some embodiments, as shown in FIG. 11, the memory 1103 stores elements, execution modules, or data structures, or a subset thereof, or an expanded set thereof.
As shown in fig. 11, in some embodiments of the present application, by calling an operation instruction stored in the memory 1103 (the operation instruction may be stored in an operating system), a corresponding operation is performed.
As shown in fig. 11, a processor 1101 controls the processing operations of the head-end device, and may also be referred to as a Central Processing Unit (CPU).
As shown in fig. 11, the memory 1103 may include both read-only memory and random access memory, and provides instructions and data to the processor. A portion of the memory 1103 may also include NVRAM. Such as application specific communication interfaces, and memory are coupled together by a bus system 1104, where the bus system 1104 may include a power bus, a control bus, a status signal bus, etc., in addition to a data bus. For clarity of illustration, however, the various buses are designated as the bus system 1104 in FIG. 11.
The methods disclosed in some embodiments of the present application may be implemented in or by a processor. The processor may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The processor may be a general purpose processor, a Digital Signal Processor (DSP), an ASIC, an FPGA (field-programmable gate array) or other programmable logic device, discrete gate or transistor logic device, or discrete hardware components. The various methods, steps and logic blocks disclosed in some embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with some embodiments of the present application may be embodied directly in the hardware decoding processor, or in a combination of the hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory, and a processor reads information in the memory and completes the steps of the method in combination with hardware of the processor.
Example 11:
on the basis of the foregoing embodiments, the present application further provides a computer-readable storage medium, in which a computer program executable by an electronic device is stored, and when the program runs on the electronic device, the electronic device is caused to execute the method disclosed in some embodiments of the present application.
Since the principle of solving the problem of the computer-readable storage medium is similar to that of the image compensation method, the implementation of the computer-readable storage medium can be referred to as an embodiment of the method, and repeated details are omitted.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims (10)

1. An image compensation method, characterized in that the method comprises:
the method comprises the steps of obtaining a first backlight accumulation amount of each preset pixel point on a pre-stored display, wherein the display is divided into a plurality of sub-areas, and one sub-area comprises one preset pixel point;
aiming at each pixel point on the display, determining a first preset number of target preset pixel points adjacent to the pixel point; determining a second backlight accumulation amount of the pixel point according to the position information of the pixel point and each target preset pixel point and the first backlight accumulation amount of each target preset pixel point; aiming at each component of red, green and blue RGB of the pixel point, searching a target increment corresponding to the component in a mapping relation among the pre-stored backlight accumulation amount of the pixel point, the pre-stored original data and the increment according to the second backlight accumulation amount and the pre-stored original data of the component; and determining the data after the component compensation according to the original data of the component and the target increment corresponding to the component.
2. The method of claim 1, wherein determining the first backlight accumulation amount for each predetermined pixel on the display comprises:
for each subregion, determining a first product of brightness diffusion distribution data corresponding to each subregion in the target block area and each other block area and a backlight lighting value according to a pre-saved backlight lighting value of the target block area where the subregion is located and each other block area in a set range including the target block area, and pre-saved brightness diffusion distribution data of each subregion in the target block area and each other block area in the set range including the target block area; and determining the first sum of each first product as a first backlight accumulation of preset pixel points contained in the sub-area.
3. The method of claim 1, wherein determining the second backlight accumulation amount of the pixel point according to the position information of the pixel point and each target preset pixel point and the first backlight accumulation amount of each target preset pixel point comprises:
aiming at each target preset pixel point, determining the horizontal distance and the vertical distance between the pixel point and the target pixel point in a display; determining the weight corresponding to the target preset pixel point according to the horizontal distance and the vertical distance;
and determining a second backlight accumulation amount of each pixel point according to the first backlight accumulation amount of each target preset pixel point and the corresponding weight of each target preset pixel point.
4. The method of claim 1, wherein the searching for the target added value corresponding to the component in the mapping relationship between the pre-stored backlight accumulation amount of the pixel, the pre-stored original data and the added value according to the second backlight accumulation amount and the pre-stored original data of the component comprises:
acquiring a target first data length of the original data of the component, and determining intermediate quantized original data of a second data length corresponding to the original data of the target first data length according to a first conversion relation of the original data of the first data length and quantized original data of the second data length in the mapping relation, wherein the first conversion relation is preserved in advance;
determining first sub-quantization original data and second sub-quantization original data according to the intermediate quantization original data;
acquiring a target third data length of the second backlight accumulation amount, and determining a middle quantized backlight accumulation amount of a fourth data length corresponding to the second backlight accumulation amount of the target third data length according to a second conversion relation of the second backlight accumulation amount of the third data length and the quantized backlight accumulation amount of the fourth data length in the mapping relation, wherein the second conversion relation is pre-stored;
determining a first sub-quantization backlight accumulation amount and a second sub-quantization backlight accumulation amount according to the intermediate quantization backlight accumulation amount;
using the sub-quantization backlight accumulation amount as an x coordinate, using the sub-quantization original data as a y coordinate, determining a coordinate corresponding to each combination according to the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data and the second sub-quantization original data, and determining an increment corresponding to each coordinate according to a corresponding relation of the backlight accumulation amount, the original data and the increment stored in the mapping relation;
and determining a target increment according to the increment corresponding to each coordinate and the weight coefficients respectively corresponding to the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data and the second sub-quantization original data which are stored.
5. The method of claim 4, wherein the determining method of the weighting coefficients corresponding to the first sub-target quantized backlight accumulation amount, the second sub-target quantized backlight accumulation amount, the first sub-target quantized original data and the second sub-target quantized original data respectively comprises:
determining a decimal part of the intermediate quantization backlight accumulation amount as a first weight coefficient corresponding to the second sub-quantization backlight accumulation amount;
determining a first difference value between a preset numerical value and a fractional part of the intermediate quantization backlight accumulation amount, and determining the first difference value as a second weight coefficient corresponding to the first sub-quantization backlight accumulation amount;
determining a decimal part of the intermediate quantized original data as a third weight coefficient corresponding to the second sub-quantized original data;
and determining a second difference value between the preset numerical value and the decimal part of the intermediate quantized original data, and determining the second difference value as a fourth weight coefficient corresponding to the first sub-quantized original data.
6. The method of claim 5, wherein the determining a target increment according to the increment corresponding to each coordinate and the weight coefficients corresponding to the first sub-quantization backlight accumulation amount, the second sub-quantization backlight accumulation amount, the first sub-quantization original data and the second sub-quantization original data respectively comprises:
determining an x coordinate as each second product of each increment of the first sub backlight accumulation amount and the second weight coefficient respectively, and determining a second sum of each second product;
determining an x coordinate as each third product of each increment of the second sub backlight accumulation amount and the first weight coefficient respectively, and determining a third sum of each third product;
determining a fourth product of the second sum and the fourth weighting factor, and a fifth product of the third sum and the fourth weighting factor;
determining a fourth sum of the fourth product and the fifth product, the fourth sum being determined as the target increment.
7. An image compensation apparatus, characterized in that the apparatus comprises:
the device comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring a first backlight accumulation amount of each preset pixel point on a pre-stored display, the display is divided into a plurality of sub-regions, and one sub-region comprises one preset pixel point;
the processing module is used for determining a first preset number of target preset pixel points adjacent to each pixel point on the display; determining a second backlight accumulation amount of the pixel point according to the position information of the pixel point and each target preset pixel point and the first backlight accumulation amount of each target preset pixel point; aiming at each component of red, green and blue RGB of the pixel point, searching a target increment corresponding to the component in a mapping relation among the pre-stored backlight accumulation amount of the pixel point, the pre-stored original data and the increment according to the second backlight accumulation amount and the pre-stored original data of the component; and determining the data after the component compensation according to the original data of the component and the target increment corresponding to the component.
8. A display device, characterized in that the display device comprises:
the display screen is used for displaying;
a processor for performing the steps of the image compensation method of any of claims 1-6.
9. A chip, characterized in that the chip comprises a processor and a communication interface, the communication interface being coupled to the processor, the processor being configured to execute a computer program or instructions to implement the steps of the image compensation method according to any of claims 1-6.
10. A computer-readable storage medium, characterized in that it stores a computer program which, when being executed by a processor, carries out the steps of the image compensation method according to any one of claims 1 to 6.
CN202111636913.9A 2021-12-29 2021-12-29 Image compensation method, device, display equipment, chip and medium Pending CN114333710A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111636913.9A CN114333710A (en) 2021-12-29 2021-12-29 Image compensation method, device, display equipment, chip and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111636913.9A CN114333710A (en) 2021-12-29 2021-12-29 Image compensation method, device, display equipment, chip and medium

Publications (1)

Publication Number Publication Date
CN114333710A true CN114333710A (en) 2022-04-12

Family

ID=81017549

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111636913.9A Pending CN114333710A (en) 2021-12-29 2021-12-29 Image compensation method, device, display equipment, chip and medium

Country Status (1)

Country Link
CN (1) CN114333710A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080029416A (en) * 2006-09-29 2008-04-03 엘지전자 주식회사 Method and apparatus for adjusting image according to lightness of backlight
CN102568386A (en) * 2010-12-29 2012-07-11 上海易维视科技有限公司 Method and system for dynamic backlight local control liquid crystal display
US20130016141A1 (en) * 2011-07-12 2013-01-17 Orise Technology Co., Ltd. Method and apparatus of compensating image in a backlight local dimming system
US20180182356A1 (en) * 2016-12-23 2018-06-28 Samsung Electronics Co., Ltd. Display apparatus and method for controlling the same
CN108648700A (en) * 2018-05-18 2018-10-12 京东方科技集团股份有限公司 A kind of the dynamic light adjustment display control method and device of backlight
CN109817170A (en) * 2017-11-21 2019-05-28 华为技术有限公司 Pixel compensation method, device and terminal device
CN110136657A (en) * 2019-06-28 2019-08-16 京东方科技集团股份有限公司 The acquisition methods of backlight value and offset, display device
CN112367477A (en) * 2020-10-30 2021-02-12 思特威(上海)电子科技有限公司 Image acquisition backlight compensation method and system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080029416A (en) * 2006-09-29 2008-04-03 엘지전자 주식회사 Method and apparatus for adjusting image according to lightness of backlight
CN102568386A (en) * 2010-12-29 2012-07-11 上海易维视科技有限公司 Method and system for dynamic backlight local control liquid crystal display
US20130016141A1 (en) * 2011-07-12 2013-01-17 Orise Technology Co., Ltd. Method and apparatus of compensating image in a backlight local dimming system
US20180182356A1 (en) * 2016-12-23 2018-06-28 Samsung Electronics Co., Ltd. Display apparatus and method for controlling the same
CN109817170A (en) * 2017-11-21 2019-05-28 华为技术有限公司 Pixel compensation method, device and terminal device
CN108648700A (en) * 2018-05-18 2018-10-12 京东方科技集团股份有限公司 A kind of the dynamic light adjustment display control method and device of backlight
CN110136657A (en) * 2019-06-28 2019-08-16 京东方科技集团股份有限公司 The acquisition methods of backlight value and offset, display device
CN112367477A (en) * 2020-10-30 2021-02-12 思特威(上海)电子科技有限公司 Image acquisition backlight compensation method and system

Similar Documents

Publication Publication Date Title
CN112214189B (en) Image display method and display device
CN113630655B (en) Method for changing color of peripheral equipment along with picture color and display equipment
JP2008257218A (en) On-screen display control system and control method
CN113240644B (en) Display processing method of high dynamic range image and related device
CN114286138A (en) Display device, external device and multi-view-angle proportion display method
CN114630053B (en) HDR image display method and display device
CN113094142A (en) Page display method and display equipment
CN111899175A (en) Image conversion method and display device
CN111432257A (en) Method for starting screen protection of display equipment and display equipment
US9875521B2 (en) Image output apparatus, image output method, and program
CN112289271B (en) Display device and dimming mode switching method
CN110858388B (en) Method and device for enhancing video image quality
CN113453069B (en) Display device and thumbnail generation method
CN114333710A (en) Image compensation method, device, display equipment, chip and medium
CN113015017B (en) Image quality compensation method and display device
CN112565915B (en) Display apparatus and display method
CN112218156B (en) Method for adjusting video dynamic contrast and display equipment
CN115547265A (en) Display apparatus and display method
CN114745555A (en) Motion estimation method of video image and display equipment
CN114694599B (en) Display device and mura processing method
CN113613007B (en) Three-dimensional color lookup table generation method and display device
CN115119035B (en) Display device, image processing method and device
CN112419988B (en) Backlight adjusting method and display device
CN114360453B (en) Noise removing method and device, display equipment, chip and medium
CN114927110B (en) Backlight control method, display equipment, chip system and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20220412

RJ01 Rejection of invention patent application after publication