CN116884359A - Adaptive dimming method, device, equipment and storage medium based on picture content - Google Patents
Adaptive dimming method, device, equipment and storage medium based on picture content Download PDFInfo
- Publication number
- CN116884359A CN116884359A CN202311142640.1A CN202311142640A CN116884359A CN 116884359 A CN116884359 A CN 116884359A CN 202311142640 A CN202311142640 A CN 202311142640A CN 116884359 A CN116884359 A CN 116884359A
- Authority
- CN
- China
- Prior art keywords
- color
- brightness
- value
- pixel
- obtaining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000003044 adaptive effect Effects 0.000 title claims description 47
- 230000004456 color vision Effects 0.000 claims description 60
- 238000013527 convolutional neural network Methods 0.000 claims description 14
- 238000000605 extraction Methods 0.000 claims description 10
- 238000012937 correction Methods 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 6
- 230000000694 effects Effects 0.000 abstract description 6
- 238000005265 energy consumption Methods 0.000 abstract description 5
- 230000001105 regulatory effect Effects 0.000 abstract 3
- 230000008569 process Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 3
- 230000008447 perception Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011176 pooling Methods 0.000 description 1
- 238000012706 support-vector machine Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
- G09G3/3413—Details of control of colour illumination sources
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
- G09G2330/02—Details of power systems and of start or stop of display operation
- G09G2330/021—Power management, e.g. power saving
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
The application belongs to the technical field of screen display, and discloses a self-adaptive dimming method, device and equipment based on picture content and a storage medium. According to the application, the pixel information of each pixel point in the image to be displayed is extracted to obtain the pixel information set, the brightness value set of the pixel point is obtained according to the pixel information set, the average brightness value of the display image is obtained according to the brightness value set, the color set of the pixel point is obtained according to the pixel information set, the color saturation of the pixel point is obtained according to the color set, the color perceptibility is obtained according to the color saturation, the backlight brightness of the display screen is regulated according to the average brightness value and the color perceptibility, and the brightness of the current display screen is regulated from the brightness and the color perceptibility together through the brightness and the color of the display content, so that the brightness of the display screen can be regulated to the optimal position, the display content has better presentation effect, and the backlight brightness does not need to be improved when the display content has higher quality, thereby reducing the energy consumption of the display screen.
Description
Technical Field
The present application relates to the field of screen display technologies, and in particular, to a self-adaptive dimming method, device, apparatus and storage medium based on screen content.
Background
When the display screen displays the picture content, the backlight brightness of the display screen is usually fixed, and when the display screen displays different picture contents, the quality and brightness of the image are different, the quality displayed under the same backlight brightness is not uniform, the bad experience of reducing the image quality can occur, the existing solution is to improve the backlight brightness of the display screen to enhance the display details of the image, but the simple improvement of the backlight brightness can lead to the increase of the energy consumption of the display screen.
The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present application and is not intended to represent an admission that the foregoing is prior art.
Disclosure of Invention
The application mainly aims to provide a self-adaptive dimming method, device, equipment and storage medium based on picture content, and aims to solve the technical problem that the backlight brightness of a display screen cannot be self-adaptively adjusted according to a display image in the prior art.
In order to achieve the above object, the present application provides an adaptive dimming method based on picture content, the method comprising the steps of:
extracting pixel information of each pixel point in an image to be displayed to obtain a pixel information set;
obtaining a brightness value set of the pixel point according to the pixel information set;
obtaining an average brightness value of the display image according to the brightness value set;
obtaining a color set of the pixel point according to the pixel information set;
obtaining the color saturation of the pixel point according to the color set, and obtaining the color perception according to the color saturation;
and adjusting the backlight brightness of the display screen according to the average brightness value and the color perceptibility.
Optionally, the adjusting the backlight brightness of the display screen according to the average brightness value and the color perceptibility includes:
obtaining a brightness difference set according to the average brightness value and the brightness value set of each pixel point;
obtaining a backlight brightness adjustment value according to the brightness difference set;
and adjusting the backlight brightness of the display screen according to the backlight brightness adjusting value and the color perceptibility.
Optionally, the obtaining a backlight brightness adjustment value according to the brightness difference set includes:
traversing the brightness values of the pixel points to obtain a maximum brightness value;
a brightness similarity index is obtained according to the average brightness value and the maximum brightness value;
and obtaining the backlight brightness adjustment value according to the brightness similarity index.
Optionally, the obtaining the backlight brightness adjustment value according to the brightness similarity index includes:
obtaining a high-brightness pixel contribution value according to the brightness similarity index;
obtaining a backlight brightness correction value according to the high brightness pixel contribution value and the brightness difference;
and obtaining the backlight brightness adjustment value according to the backlight brightness correction value.
Optionally, the obtaining the color saturation of the pixel point according to the color set and obtaining the color perceptibility according to the color saturation includes:
acquiring color components of the pixel points in the color set;
obtaining the color saturation of the pixel point according to the color component;
setting a color perception recognition area in a preset range by taking the position of the pixel point as the center, obtaining the color perception of the color perception recognition area according to the color saturation of the color perception recognition area, moving the color perception recognition area according to a preset path to obtain the color perception of the next color perception recognition area, and obtaining a color perception set according to the color perception;
and when the color perception recognition area moves to the tail end of the preset path, obtaining the color perception according to the color perception set.
Optionally, after adjusting the backlight brightness of the display screen according to the average brightness value and the color perceptibility, the method further includes:
detecting the display image according to the adjusted backlight brightness;
when an image dark area is detected, acquiring a pixel value corresponding to the image dark area;
comparing the brightness value of the pixel value corresponding to the image dark area with the brightness value of the display screen to obtain a compensation coefficient;
and adjusting the contrast ratio of the dark area of the image according to the compensation coefficient to obtain an enhanced image.
Optionally, the adjusting the contrast ratio of the dark area of the image according to the compensation coefficient to obtain an enhanced image includes:
performing contrast compensation on the pixel value of the image dark area according to the compensation coefficient to obtain a compensation pixel value;
convolving the compensation pixel value through an improved convolutional neural network model to obtain an enhanced pixel value, wherein in the improved convolutional neural network model, an SPP layer is added between the last convolutional layer and the full-connection layer;
and adjusting the contrast of the dark area of the image according to the enhanced pixel value pair to obtain the enhanced image.
In addition, to achieve the above object, the present application also provides an adaptive dimming device based on picture content, the adaptive dimming device based on picture content includes:
the pixel extraction module is used for extracting pixel information of each pixel point in the image to be displayed to obtain a pixel information set;
the brightness extraction module is used for obtaining a brightness value set of the pixel points according to the pixel information set;
the brightness calculation module is used for obtaining the average brightness value of the display image according to the brightness value set;
the color extraction module is used for obtaining a color set of the pixel points according to the pixel information set;
the color sensing module is used for obtaining the color saturation of the pixel point according to the color set and obtaining the color sensing degree according to the color saturation;
and the brightness adjusting module is used for adjusting the backlight brightness of the display screen according to the average brightness value and the color perceptibility.
In addition, to achieve the above object, the present application also proposes an adaptive dimming device based on picture content, including: a memory, a processor, and a picture content based adaptive dimming program stored on the memory and executable on the processor, the picture content based adaptive dimming program configured to implement the steps of a picture content based adaptive dimming method as described above.
In addition, in order to achieve the above object, the present application also proposes a storage medium having stored thereon an adaptive dimming program based on picture content, which when executed by a processor, implements the steps of the adaptive dimming method based on picture content as described above.
According to the application, the pixel information of each pixel point in the image to be displayed is extracted to obtain a pixel information set, the brightness value set of the pixel point is obtained according to the pixel information set, the average brightness value of the display image is obtained according to the brightness value set, the color set of the pixel point is obtained according to the pixel information set, the color saturation of the pixel point is obtained according to the color set, the color perceptibility is obtained according to the color saturation, the backlight brightness of the display screen is adjusted according to the average brightness value and the color perceptibility, and the brightness of the current display screen is adjusted from the brightness and the color perceptibility together through the brightness and the color of the display content, so that the brightness of the display screen can be adjusted to the optimal position, the display content has better presentation effect, and the backlight brightness does not need to be improved when the display content has higher quality, thereby reducing the energy consumption of the display screen.
Drawings
Fig. 1 is a schematic structural diagram of an adaptive dimming device based on picture content in a hardware running environment according to an embodiment of the present application;
FIG. 2 is a flowchart of a first embodiment of an adaptive dimming method based on frame content according to the present application;
FIG. 3 is a coverage area diagram of a color-aware identification area according to an embodiment of an adaptive dimming method based on picture content of the present application;
FIG. 4 is a flowchart of a second embodiment of an adaptive dimming method based on frame content according to the present application;
fig. 5 is a block diagram illustrating a first embodiment of an adaptive dimming device based on picture content according to the present application.
The achievement of the objects, functional features and advantages of the present application will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.
Referring to fig. 1, fig. 1 is a schematic structural diagram of an adaptive dimming device based on picture content in a hardware running environment according to an embodiment of the present application.
As shown in fig. 1, the adaptive dimming device based on picture content may include: a processor 1001, such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, a memory 1005. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (Wi-Fi) interface). The Memory 1005 may be a high-speed random access Memory (Random Access Memory, RAM) Memory or a stable nonvolatile Memory (NVM), such as a disk Memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the structure shown in fig. 1 does not constitute a limitation of the adaptive dimming device based on picture content, and may include more or less components than illustrated, or may combine certain components, or may be a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and an adaptive dimming program based on screen contents may be included in a memory 1005 as one storage medium.
In the adaptive dimming device based on picture content shown in fig. 1, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 in the adaptive dimming device based on picture content according to the present application may be disposed in the adaptive dimming device based on picture content, and the adaptive dimming device based on picture content calls the adaptive dimming program based on picture content stored in the memory 1005 through the processor 1001 and executes the adaptive dimming method based on picture content provided by the embodiment of the present application.
The embodiment of the application provides a self-adaptive dimming method based on picture content, and referring to fig. 2, fig. 2 is a flow chart of a first embodiment of the self-adaptive dimming method based on picture content.
In this embodiment, the adaptive dimming method based on the picture content includes the following steps:
step S10: and extracting pixel information of each pixel point in the image to be displayed to obtain a pixel information set.
It should be noted that, the execution body of the embodiment is an adaptive dimming device based on picture content, where the adaptive dimming device based on picture content has functions of data processing, data communication, program running, etc., and the adaptive dimming device based on picture content may be an integrated controller, a control computer, etc., or may be other devices with similar functions, which is not limited in this embodiment.
It should be understood that the image to be displayed is input into the display screen through the local resource or the network resource for temporary buffering, and the image to be displayed is read out from the buffer when the image display is required, so that when the image to be displayed is displayed, the information of the pixels in the image to be displayed can be extracted, and for one image, the pixels with different numbers according to different image resolutions are included in each pixel, wherein the brightness information, the color information and the like of the pixels can reflect the information of the image imaging.
In a specific implementation, when the display screen enters a working state, each pixel point in an image to be displayed is analyzed, pixel information in each pixel point is extracted to obtain a pixel information set, wherein in the process of extracting each pixel point, pixel information extraction can be performed according to a predetermined mode, for example, pixel information is extracted one by one according to the pixel point, or pixel value information is extracted according to each block in the image in a block mode, which is not limited in this embodiment. For example, if the image resolution of an image to be displayed is m×n, the obtained pixel information set P may be expressed as:
step S20: and obtaining a brightness value set of the pixel point according to the pixel information set.
It should be noted that the luminance value set includes luminance information of each pixel point, where each pixel has a corresponding luminance, and there is no direct connection between the luminance and the hue. The luminance value of the pixel is between 0 and 255, and the luminance of the pixel close to 255 is higher, and the luminance close to 0 is lower, so that it can be known that the closer the luminance value is to 255, the higher the luminance of the pixel is.
In a specific implementation, color information is extracted from pixel information of each pixel point in the pixel information set P, and when an image to be displayed is a gray image, since the pixel points of the gray image have only 1 component and are between 0 and 255, 0 represents black, darkest, 255 represents white and brightest. When the image to be displayed is a color image, each pixel has 3 components, each component is between 0 and 255, at this time, the color image can be converted into a gray image by constructing a mapping function, and then the brightness can be judged according to the gray image, at this time, any one of an R channel, a G channel and a B channel can be selected as the gray, or the maximum value in R, G, B is used as the gray, namely, gray=max (R, G, B), or the average value of R, G, B is used as the gray value to perform brightness calculation, or the corresponding gray can be obtained according to the formula of gray=0.3×r+0.55×g+0.11×b, and the gray value at this time can be used as the current brightness value. Calculating corresponding brightness values of the pixel information in each pixel information set to obtain a brightness value set bl:
step S30: and obtaining the average brightness value of the display image according to the brightness value set.
Step S40: and obtaining a color set of the pixel point according to the pixel information set.
Note that, the color set refers to color information included in each pixel information in a pixel information set of a set to be displayed, and the color information may be stored in an RGB format or may be stored in an HSL format, preferably an HSL color model, in which H represents a color attribute, S represents saturation, and L represents brightness.
Step S50: and obtaining the color saturation of the pixel point according to the color set, and obtaining the color perceptibility according to the color saturation.
The color perception refers to the look and feel of a person when viewing the color, and may be specifically represented by comfort, dazzling, dullness, and the like, which is not limited in this embodiment.
In a specific implementation, according to the color information in the obtained pixel point information, the corresponding saturation can be obtained by obtaining the color information of each pixel point, if the color information is the color information in the HSL mode, the saturation information in the HSL mode is directly obtained, and if the color information is the color information in the RGB color model, the saturation information is calculated according to the maximum value and the minimum value of R, G, B, specifically:
when the color saturation of each pixel is obtained, the color saturation of each pixel point in the image to be displayed is input into a color perceptibility model to obtain the color perceptibility, wherein the color perceptibility model comprises a CNN convolutional neural network model and an SVM support vector machine, the specific process is that the color saturation of each pixel point is input into a convolutional layer of the CNN convolutional neural network, the pixel point of 3*3 can be used as a convolutional unit, the convolutional unit is subjected to convolutional operation to obtain the color saturation of each convolutional unit, the size of a convolutional kernel is the same as that of the convolutional unit, and the step length is the side length of the convolutional unit. After the color saturation of each convolution unit is obtained, the color saturation of each convolution unit is input into a pooling layer, an equivalent value in a certain area is selected according to the color saturation of each convolution unit, at this time, an average value can be output as the equivalent value, the convolved color saturation is obtained according to the combined action of the equivalent value and an activation function, the convolved color saturation is input into an SVM support vector set, the final color perceptibility is obtained through linear classification, and the color perceptibility PE can be expressed as:
wherein c is a constant.
Further, the obtaining the color saturation of the pixel point according to the color set, and obtaining the color perceptibility according to the color saturation includes:
acquiring color components of the pixel points in the color set;
obtaining the color saturation of the pixel point according to the color component;
setting a color perception recognition area in a preset range by taking the position of the pixel point as the center, obtaining the color perception of the color perception recognition area according to the color saturation of the color perception recognition area, moving the color perception recognition area according to a preset path to obtain the color perception of the next color perception recognition area, and obtaining a color perception set according to the color perception;
and when the color perception recognition area moves to the tail end of the preset path, obtaining the color perception according to the color perception set.
It should be noted that, the color perception recognition area is an area for extracting color perception of a pixel point in an image to be displayed, and color components include color components, for example, RGB color mode is red, green and blue three-color value, and HSL mode is color, saturation, brightness, and the like.
In a specific implementation, the color components of the pixel point are obtained from the color set, and the color saturation of the pixel point is obtained through color cost. And forming a color perception identification area by taking the current pixel point as the center, wherein the color perception identification area can acquire the saturation of the pixel point in the coverage area, continuously moves in the image area to be displayed and covers all the image area to be displayed. When the color perception recognition area is formed, the current pixel point is taken as the center, the color perception recognition area is formed in a certain range around, and if the distance between the current pixel point and the image edge is smaller than the area radius of the color perception recognition area, the size of the color perception recognition area can be adjusted in a self-adaptive mode, and particularly as shown in fig. 3, fig. 3 is a coverage map of the color perception recognition area. And moving to the end of the path according to the preset path, and at the moment, traversing the whole image to obtain the color perceptibility according to the color saturation obtained in the process.
Step S60: and adjusting the backlight brightness of the display screen according to the average brightness value and the color perceptibility.
In a specific implementation, when the average brightness value and the color perceptibility are obtained, the current backlight brightness of the current screen can be obtained, and the backlight brightness is determined according to the current screen brightness, the average brightness value and the color perceptibility, and at this time, the following formula can be adopted:
for the current backlight brightness +.>And L is the adjusted backlight brightness value.
Further, after adjusting the backlight brightness of the display screen according to the average brightness value and the color perceptibility, the method further includes:
detecting the display image according to the adjusted backlight brightness;
when an image dark area is detected, acquiring a pixel value corresponding to the image dark area;
comparing the brightness value of the pixel value corresponding to the image dark area with the brightness value of the display screen to obtain a compensation coefficient;
and adjusting the contrast ratio of the dark area of the image according to the compensation coefficient to obtain an enhanced image.
It should be noted that, the dark image area refers to an area where brightness intersection occurs after brightness adjustment is performed on the image to be displayed.
In a specific implementation, detecting the display image at the adjusted backlight brightness, if an image dark area exists, acquiring a pixel value corresponding to the image dark area, simultaneously comparing the brightness value of the pixel value corresponding to the image dark area with the brightness value of the display screen to a compensation coefficient, and adjusting the contrast of the image dark area according to the compensation coefficient to obtain an enhanced image.
Further, the adjusting the contrast ratio of the dark area of the image according to the compensation coefficient to obtain an enhanced image includes:
performing contrast compensation on the pixel value of the image dark area according to the compensation coefficient to obtain a compensation pixel value;
convolving the compensation pixel value through an improved convolutional neural network model to obtain an enhanced pixel value, wherein in the improved convolutional neural network model, an SPP layer is added between the last convolutional layer and the full-connection layer;
and adjusting the contrast of the dark area of the image according to the enhanced pixel value pair to obtain the enhanced image.
In the specific implementation, when the contrast of the image dark area is adjusted, the image can be convolved through the compensation coefficient and the CNN convolutional neural network, and meanwhile, after the last convolutional layer, an SPP layer is added for adjusting the contrast of the image dark area, so that the image can be filtered once before full connection, and the image enhancement rate is improved.
According to the embodiment, the pixel information of each pixel point in the image to be displayed is extracted to obtain a pixel information set, the brightness value set of the pixel point is obtained according to the pixel information set, the average brightness value of the display image is obtained according to the brightness value set, the color set of the pixel point is obtained according to the pixel information set, the color saturation of the pixel point is obtained according to the color set, the color perceptibility is obtained according to the color saturation, the backlight brightness of the display screen is adjusted according to the average brightness value and the color perceptibility, the brightness of the current display screen is adjusted from the brightness and the color perceptibility through the brightness and the color of the display content, the brightness of the display screen can be adjusted to the optimal position, the display content has better presentation effect, and the backlight brightness does not need to be improved when the display content has higher quality, so that the energy consumption of the display screen is reduced.
Referring to fig. 4, fig. 4 is a flowchart illustrating a second embodiment of an adaptive dimming method based on picture content according to the present application.
Based on the first embodiment, the adaptive dimming method based on the picture content in this embodiment further includes, at the step S60:
step S601: obtaining a brightness difference set according to the average brightness value and the brightness value set of each pixel point;
step S602: obtaining a backlight brightness adjustment value according to the brightness difference set;
step S603: and adjusting the backlight brightness of the display screen according to the backlight brightness adjusting value and the color perceptibility.
In a specific implementation, after obtaining an average luminance value, a difference is made between the luminance value in each pixel value and the average luminance value to obtain a luminance difference between the average luminance value and a luminance value set of each pixel point, and a luminance difference set is formed, and a maximum luminance value max is obtained from the luminance value set, and according to the maximum luminance value and the average luminance valueObtaining a similarity index PI of a current image, wherein the calculation formula is as follows:
and judging the current image type according to the similarity index, wherein the larger the similarity index is, the more high-brightness pixels are indicated, and in order to improve the image effect, the brightness needs to be reduced at the moment, and conversely, the smaller the similarity index is, the more low-brightness pixels are indicated, and in order to improve the backlight brightness at the moment, the more low-brightness pixels are indicated.
In order to further adjust the backlight brightness, it is necessary to obtain a high brightness contributionThe calculation mode is as follows:
the larger the value, the greater the contribution of the pixel value representing the high-gray-level pixel detail portion of the image to the image as a whole, and the greater the effect of the loss of the high-gray-level pixel detail portion on the image. Thus (S)>When the value is smaller, the backlight brightness can be properly reduced so as to reduce the display power consumption; />When the value is large, it is necessary toBacklight brightness is increased to reduce image detail loss.
At the time of determining the high brightness pixel contribution valueThen, a backlight brightness correction value which needs brightness correction is determined according to the formula>：
，
Wherein the method comprises the steps ofIs the difference between the maximum luminance value and the average luminance value.
And adjusting the backlight brightness according to the following formula:
after the backlight brightness L to be adjusted is obtained, the backlight brightness of the display screen is adjusted to the calculated backlight brightness.
According to the embodiment, the perception of the color in the display image is obtained through the color saturation of the image to be displayed, the image look and feel under the condition of the current display screen brightness is determined according to the perception and the brightness, and when the current image brightness is low, the image details cannot be displayed, so that the brightness of the display screen needs to be adjusted. When the adjustment value of the backlight brightness is calculated, adjustment is performed according to the contribution degree of the high-brightness pixels in the image, so that the overall look and feel of the image to be displayed can be ensured.
In addition, the embodiment of the application also provides a storage medium, wherein the storage medium stores an adaptive dimming program based on picture content, and the adaptive dimming program based on picture content realizes the steps of the adaptive dimming method based on picture content when being executed by a processor.
Referring to fig. 5, fig. 5 is a block diagram illustrating a first embodiment of an adaptive dimming device based on picture content according to the present application.
As shown in fig. 5, an adaptive dimming device based on picture content according to an embodiment of the present application includes:
the pixel extraction module 10 is used for extracting pixel information of each pixel point in the image to be displayed to obtain a pixel information set;
the brightness extraction module 20 is configured to obtain a brightness value set of the pixel point according to the pixel information set;
a brightness calculation module 30, configured to obtain an average brightness value of the display image according to the brightness value set;
a color extraction module 40, configured to obtain a color set of the pixel point according to the pixel information set;
the color sensing module 50 is configured to obtain color saturation of the pixel according to the color set, and obtain color sensing degree according to the color saturation;
the brightness adjustment module 60 is configured to adjust the backlight brightness of the display screen according to the average brightness value and the color perceptibility.
According to the embodiment, the pixel information of each pixel point in the image to be displayed is extracted to obtain a pixel information set, the brightness value set of the pixel point is obtained according to the pixel information set, the average brightness value of the display image is obtained according to the brightness value set, the color set of the pixel point is obtained according to the pixel information set, the color saturation of the pixel point is obtained according to the color set, the color perceptibility is obtained according to the color saturation, the backlight brightness of the display screen is adjusted according to the average brightness value and the color perceptibility, the brightness of the current display screen is adjusted from the brightness and the color perceptibility through the brightness and the color of the display content, the brightness of the display screen can be adjusted to the optimal position, the display content has better presentation effect, and the backlight brightness does not need to be improved when the display content has higher quality, so that the energy consumption of the display screen is reduced.
In an embodiment, the brightness adjustment module 60 is further configured to obtain a brightness difference set according to the average brightness value and the brightness value set of each pixel point;
obtaining a backlight brightness adjustment value according to the brightness difference set;
and adjusting the backlight brightness of the display screen according to the backlight brightness adjusting value and the color perceptibility.
In an embodiment, the brightness adjustment module 60 is further configured to traverse the brightness values of the pixel points to obtain a maximum brightness value;
a brightness similarity index is obtained according to the average brightness value and the maximum brightness value;
and obtaining the backlight brightness adjustment value according to the brightness similarity index.
In one embodiment, the brightness adjustment module 60 is further configured to obtain a high brightness pixel contribution value according to a brightness similarity index;
obtaining a backlight brightness correction value according to the high brightness pixel contribution value and the brightness difference;
and obtaining the backlight brightness adjustment value according to the backlight brightness correction value.
In an embodiment, the color sensing module 50 is further configured to obtain color components of the pixel points in the color set;
obtaining the color saturation of the pixel point according to the color component;
setting a color perception recognition area in a preset range by taking the position of the pixel point as the center, obtaining the color perception of the color perception recognition area according to the color saturation of the color perception recognition area, moving the color perception recognition area according to a preset path to obtain the color perception of the next color perception recognition area, and obtaining a color perception set according to the color perception;
and when the color perception recognition area moves to the tail end of the preset path, obtaining the color perception according to the color perception set.
In one embodiment, the brightness adjustment module 60 is further configured to detect the display image according to the adjusted backlight brightness;
when an image dark area is detected, acquiring a pixel value corresponding to the image dark area;
comparing the brightness value of the pixel value corresponding to the image dark area with the brightness value of the display screen to obtain a compensation coefficient;
and adjusting the contrast ratio of the dark area of the image according to the compensation coefficient to obtain an enhanced image.
In an embodiment, the brightness adjustment module 60 is further configured to perform contrast compensation on the pixel values of the dark area of the image according to the compensation coefficient to obtain compensated pixel values;
convolving the compensation pixel value through an improved convolutional neural network model to obtain an enhanced pixel value, wherein in the improved convolutional neural network model, an SPP layer is added between the last convolutional layer and the full-connection layer;
and adjusting the contrast of the dark area of the image according to the enhanced pixel value pair to obtain the enhanced image.
It should be understood that the foregoing is illustrative only and is not limiting, and that in specific applications, those skilled in the art may set the application as desired, and the application is not limited thereto.
It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily occurring in sequence, but may be performed alternately or alternately with other steps or at least a portion of the other steps or stages.
It should be noted that the above-described working procedure is merely illustrative, and does not limit the scope of the present application, and in practical application, a person skilled in the art may select part or all of them according to actual needs to achieve the purpose of the embodiment, which is not limited herein.
Furthermore, it should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present application are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of embodiments, it will be clear to a person skilled in the art that the above embodiment method may be implemented by means of software plus a necessary general hardware platform, but may of course also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. Read Only Memory (ROM)/RAM, magnetic disk, optical disk) and comprising several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present application.
The foregoing description is only of the preferred embodiments of the present application, and is not intended to limit the scope of the application, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (10)
1. An adaptive dimming method based on picture content, wherein the adaptive dimming method based on picture content comprises the following steps:
extracting pixel information of each pixel point in an image to be displayed to obtain a pixel information set;
obtaining a brightness value set of the pixel point according to the pixel information set;
obtaining an average brightness value of the display image according to the brightness value set;
obtaining a color set of the pixel point according to the pixel information set;
obtaining the color saturation of the pixel point according to the color set, and obtaining the color perception according to the color saturation;
and adjusting the backlight brightness of the display screen according to the average brightness value and the color perceptibility.
2. The method of claim 1, wherein said adjusting the backlight brightness of the display screen based on the average brightness value and the color perceptibility comprises:
obtaining a brightness difference set according to the average brightness value and the brightness value set of each pixel point;
obtaining a backlight brightness adjustment value according to the brightness difference set;
and adjusting the backlight brightness of the display screen according to the backlight brightness adjusting value and the color perceptibility.
3. The method of claim 2, wherein obtaining a backlight brightness adjustment value from the set of brightness differences comprises:
traversing the brightness values of the pixel points to obtain a maximum brightness value;
a brightness similarity index is obtained according to the average brightness value and the maximum brightness value;
and obtaining the backlight brightness adjustment value according to the brightness similarity index.
4. The method of claim 3, wherein said deriving the backlight brightness adjustment value from the brightness similarity index comprises:
obtaining a high-brightness pixel contribution value according to the brightness similarity index;
obtaining a backlight brightness correction value according to the high brightness pixel contribution value and the brightness difference;
and obtaining the backlight brightness adjustment value according to the backlight brightness correction value.
5. The method of claim 1, wherein the obtaining the color saturation of the pixel point according to the color set and obtaining the color perceptibility according to the color saturation comprises:
acquiring color components of the pixel points in the color set;
obtaining the color saturation of the pixel point according to the color component;
setting a color perception recognition area in a preset range by taking the position of the pixel point as the center, obtaining the color perception of the color perception recognition area according to the color saturation of the color perception recognition area, moving the color perception recognition area according to a preset path to obtain the color perception of the next color perception recognition area, and obtaining a color perception set according to the color perception;
and when the color perception recognition area moves to the tail end of the preset path, obtaining the color perception according to the color perception set.
6. The method of any of claims 1-5, wherein after adjusting the backlight brightness of the display screen based on the average brightness value and the color perceptibility, further comprising:
detecting the display image according to the adjusted backlight brightness;
when an image dark area is detected, acquiring a pixel value corresponding to the image dark area;
comparing the brightness value of the pixel value corresponding to the image dark area with the brightness value of the display screen to obtain a compensation coefficient;
and adjusting the contrast ratio of the dark area of the image according to the compensation coefficient to obtain an enhanced image.
7. The method of claim 6, wherein said adjusting the contrast of the image dark areas based on the compensation factors results in an enhanced image, comprising:
performing contrast compensation on the pixel value of the image dark area according to the compensation coefficient to obtain a compensation pixel value;
convolving the compensation pixel value through an improved convolutional neural network model to obtain an enhanced pixel value, wherein in the improved convolutional neural network model, an SPP layer is added between the last convolutional layer and the full-connection layer;
and adjusting the contrast of the dark area of the image according to the enhanced pixel value pair to obtain the enhanced image.
8. An adaptive dimming device based on picture content, wherein the adaptive dimming device based on picture content comprises:
the pixel extraction module is used for extracting pixel information of each pixel point in the image to be displayed to obtain a pixel information set;
the brightness extraction module is used for obtaining a brightness value set of the pixel points according to the pixel information set;
the brightness calculation module is used for obtaining the average brightness value of the display image according to the brightness value set;
the color extraction module is used for obtaining a color set of the pixel points according to the pixel information set;
the color sensing module is used for obtaining the color saturation of the pixel point according to the color set and obtaining the color sensing degree according to the color saturation;
and the brightness adjusting module is used for adjusting the backlight brightness of the display screen according to the average brightness value and the color perceptibility.
9. An adaptive dimming device based on picture content, the device comprising: a memory, a processor and a picture content based adaptive dimming program stored on the memory and executable on the processor, the picture content based adaptive dimming program configured to implement the steps of the picture content based adaptive dimming method as claimed in any one of claims 1 to 7.
10. A storage medium having stored thereon a picture content based adaptive dimming program which when executed by a processor implements the steps of the picture content based adaptive dimming method according to any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311142640.1A CN116884359A (en) | 2023-09-06 | 2023-09-06 | Adaptive dimming method, device, equipment and storage medium based on picture content |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311142640.1A CN116884359A (en) | 2023-09-06 | 2023-09-06 | Adaptive dimming method, device, equipment and storage medium based on picture content |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116884359A true CN116884359A (en) | 2023-10-13 |
Family
ID=88257257
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311142640.1A Pending CN116884359A (en) | 2023-09-06 | 2023-09-06 | Adaptive dimming method, device, equipment and storage medium based on picture content |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116884359A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117606371A (en) * | 2024-01-24 | 2024-02-27 | 湖南信健科技有限公司 | Coating thickness online monitoring system and method based on visual detection |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050206776A1 (en) * | 2004-03-22 | 2005-09-22 | Lg Electronics Inc. | Apparatus for digital video processing and method thereof |
| US20070288435A1 (en) * | 2006-05-10 | 2007-12-13 | Manabu Miki | Image storage/retrieval system, image storage apparatus and image retrieval apparatus for the system, and image storage/retrieval program |
| CN101763803A (en) * | 2008-10-23 | 2010-06-30 | 统宝光电股份有限公司 | Method of color gamut mapping of color input values of input image pixels of an input image to rgbw output values for an rgbw display, display module, display controller and apparatus using such method |
| CN102810306A (en) * | 2012-07-26 | 2012-12-05 | 广东欧珀移动通信有限公司 | Method for automatically controlling brightness of display screen wallpaper |
| CN107067004A (en) * | 2017-03-20 | 2017-08-18 | 上海云从企业发展有限公司 | The adjusting method and device of a kind of electronic equipment and its screen intensity |
| CN108257580A (en) * | 2016-12-28 | 2018-07-06 | 中科创达软件股份有限公司 | A kind of adjusting method and device of the display picture based on backlight illumination |
| CN108830815A (en) * | 2018-06-22 | 2018-11-16 | 上海顺久电子科技有限公司 | A kind of method, apparatus and terminal improving dark picture areas contrast |
| CN109801240A (en) * | 2019-01-15 | 2019-05-24 | 武汉鸿瑞达信息技术有限公司 | A kind of image enchancing method and image intensifier device |
| CN110473486A (en) * | 2018-05-10 | 2019-11-19 | 联咏科技股份有限公司 | The method and electronic device of display device are controlled based on color-aware brightness |
| CN112785984A (en) * | 2019-11-08 | 2021-05-11 | 南京航空航天大学 | LCD high-efficiency self-adaptive global backlight adjusting method for image gray level perception |
| CN113053324A (en) * | 2021-03-15 | 2021-06-29 | 生迪智慧科技有限公司 | Backlight control method, device, equipment, system and storage medium |
| CN115602136A (en) * | 2021-06-28 | 2023-01-13 | Oppo广东移动通信有限公司（Cn） | Brightness adjusting method and device, electronic equipment and storage medium |
| CN115798417A (en) * | 2022-11-24 | 2023-03-14 | 北京奕斯伟计算技术股份有限公司 | Backlight brightness determination method, device, equipment and computer readable storage medium |
| CN116168652A (en) * | 2022-12-26 | 2023-05-26 | 武汉Tcl集团工业研究院有限公司 | Image display method, device, electronic equipment and computer readable storage medium |
-
2023
- 2023-09-06 CN CN202311142640.1A patent/CN116884359A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050206776A1 (en) * | 2004-03-22 | 2005-09-22 | Lg Electronics Inc. | Apparatus for digital video processing and method thereof |
| US20070288435A1 (en) * | 2006-05-10 | 2007-12-13 | Manabu Miki | Image storage/retrieval system, image storage apparatus and image retrieval apparatus for the system, and image storage/retrieval program |
| CN101763803A (en) * | 2008-10-23 | 2010-06-30 | 统宝光电股份有限公司 | Method of color gamut mapping of color input values of input image pixels of an input image to rgbw output values for an rgbw display, display module, display controller and apparatus using such method |
| CN102810306A (en) * | 2012-07-26 | 2012-12-05 | 广东欧珀移动通信有限公司 | Method for automatically controlling brightness of display screen wallpaper |
| CN108257580A (en) * | 2016-12-28 | 2018-07-06 | 中科创达软件股份有限公司 | A kind of adjusting method and device of the display picture based on backlight illumination |
| CN107067004A (en) * | 2017-03-20 | 2017-08-18 | 上海云从企业发展有限公司 | The adjusting method and device of a kind of electronic equipment and its screen intensity |
| CN110473486A (en) * | 2018-05-10 | 2019-11-19 | 联咏科技股份有限公司 | The method and electronic device of display device are controlled based on color-aware brightness |
| CN108830815A (en) * | 2018-06-22 | 2018-11-16 | 上海顺久电子科技有限公司 | A kind of method, apparatus and terminal improving dark picture areas contrast |
| CN109801240A (en) * | 2019-01-15 | 2019-05-24 | 武汉鸿瑞达信息技术有限公司 | A kind of image enchancing method and image intensifier device |
| CN112785984A (en) * | 2019-11-08 | 2021-05-11 | 南京航空航天大学 | LCD high-efficiency self-adaptive global backlight adjusting method for image gray level perception |
| CN113053324A (en) * | 2021-03-15 | 2021-06-29 | 生迪智慧科技有限公司 | Backlight control method, device, equipment, system and storage medium |
| CN115602136A (en) * | 2021-06-28 | 2023-01-13 | Oppo广东移动通信有限公司（Cn） | Brightness adjusting method and device, electronic equipment and storage medium |
| CN115798417A (en) * | 2022-11-24 | 2023-03-14 | 北京奕斯伟计算技术股份有限公司 | Backlight brightness determination method, device, equipment and computer readable storage medium |
| CN116168652A (en) * | 2022-12-26 | 2023-05-26 | 武汉Tcl集团工业研究院有限公司 | Image display method, device, electronic equipment and computer readable storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117606371A (en) * | 2024-01-24 | 2024-02-27 | 湖南信健科技有限公司 | Coating thickness online monitoring system and method based on visual detection |
| CN117606371B (en) * | 2024-01-24 | 2024-04-19 | 湖南信健科技有限公司 | Coating thickness online monitoring system and method based on visual detection |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109618173B (en) | Video compression method, device and computer readable storage medium | |
| US8374458B2 (en) | Tone correcting method, tone correcting apparatus, tone correcting program, and image equipment | |
| JP4870617B2 (en) | Image data automatic mapping method and image processing device | |
| JP4870618B2 (en) | Image data automatic mapping method and image processing device | |
| US8135215B2 (en) | Correction of color balance of face images | |
| US20210158488A1 (en) | Image edge processing method, electronic device, and computer readable storage medium | |
| US20200034997A1 (en) | An image processing method and apparauts | |
| US9432551B2 (en) | Image processing apparatus configured to execute correction on scan image data | |
| CN112351195B (en) | Image processing method, device and electronic system | |
| CN116884359A (en) | Adaptive dimming method, device, equipment and storage medium based on picture content | |
| US20220044369A1 (en) | Image processing method, terminal and non-transitory computer-readable storage medium | |
| US20200099823A1 (en) | System and method for image dynamic range adjusting | |
| US20090274368A1 (en) | Image correction method and apparatus | |
| CN113596573B (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| CN110660365A (en) | Regional backlight control method, display and storage medium | |
| US20120081548A1 (en) | Method, device, and system for performing color enhancement on whiteboard color image | |
| CN113140197A (en) | Display picture adjusting method and device, electronic equipment and readable storage medium | |
| CN101197917A (en) | Image processing process | |
| US20200160492A1 (en) | Image Adjustment Method and Device, Image Display Method and Device, Non-Transitory Storage Medium | |
| US20220058781A1 (en) | Image processing device and image enhancing method thereof | |
| JP2018196096A (en) | Image processing system, image processing method and program | |
| US20140099027A1 (en) | Apparatus and method for processing an image | |
| CN111160063B (en) | Internet of things IPC two-dimensional code distribution network image enhancement method and system | |
| CN109685861B (en) | Picture compression method, device and equipment and computer readable storage medium | |
| CN112333514B (en) | Display mode switching method and device, intelligent television and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |