WO2020078347A1 - 基于背光调整的图像动态增强方法、装置和计算机设备 - Google Patents

基于背光调整的图像动态增强方法、装置和计算机设备 Download PDF

Info

Publication number
WO2020078347A1
WO2020078347A1 PCT/CN2019/111217 CN2019111217W WO2020078347A1 WO 2020078347 A1 WO2020078347 A1 WO 2020078347A1 CN 2019111217 W CN2019111217 W CN 2019111217W WO 2020078347 A1 WO2020078347 A1 WO 2020078347A1
Authority
WO
WIPO (PCT)
Prior art keywords
brightness
current frame
maximum
frame image
weight value
Prior art date
Application number
PCT/CN2019/111217
Other languages
English (en)
French (fr)
Inventor
陈奕鑫
谢仁礼
Original Assignee
深圳Tcl新技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳Tcl新技术有限公司 filed Critical 深圳Tcl新技术有限公司
Priority to US17/257,537 priority Critical patent/US11527212B2/en
Priority to EP19872951.9A priority patent/EP3869447A4/en
Publication of WO2020078347A1 publication Critical patent/WO2020078347A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/90—Dynamic range modification of images or parts thereof
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406—Control of illumination source
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/10—Intensity circuits
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20004—Adaptive image processing
    • G06T2207/20008—Globally adaptive
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0626—Adjustment of display parameters for control of overall brightness
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0626—Adjustment of display parameters for control of overall brightness
    • G09G2320/0646—Modulation of illumination source brightness and image signal correlated to each other
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/16—Calculation or use of calculated indices related to luminance levels in display data

Definitions

  • the present disclosure relates to the field of computer technology, and in particular, to an image dynamic enhancement method, device, and computer equipment based on backlight adjustment.
  • backlight adjustment is a common display processing technology, but traditional backlight adjustment schemes generally need to sacrifice some of the image details. Due to inappropriate sacrifice of signal details, it will cause the picture to be incomplete and unable to truly convey the director ’s True intentions.
  • An image dynamic enhancement method based on backlight adjustment includes:
  • the analysis data includes the average brightness of the current frame image, the feature points of the dark state, the actual maximum brightness of the current frame image, the theoretical maximum brightness of the current frame image, and the optimal brightness of the current frame image;
  • the step of acquiring the encoding information included in the display content specifically includes: the system software of the display performs codec processing on the input display content to obtain the encoding information included in the display content.
  • the encoded information includes the maximum display brightness of the monitor, the minimum display brightness of the monitor, and the maximum signal amplitude of the content.
  • the optical indicator parameters include the maximum display brightness of the full screen and the maximum display brightness of multiple backlit small windows.
  • the display content is parsed according to the encoded information and the optical index parameters
  • the step of obtaining the information of the current displayed content includes: entering the encoded information into the first query module to obtain the maximum query brightness of the monitor; and the optical index parameters Enter the second query module to get the maximum display brightness parameter curve of the small backlight window; perform photoelectric conversion according to the maximum query brightness of the monitor and the maximum display brightness of the small backlight window, and perform statistical analysis on the current frame image to obtain a statistical list.
  • the value range of the maximum query brightness of the monitor is 0-1023.
  • the step of obtaining analysis data based on the analysis and calculation of the information of the display content further includes: performing statistical analysis on the display content to obtain a signal mapping function.
  • the step of obtaining the first detail statistical weight value and the second detail statistical weight value according to the analysis data includes: the analysis data includes the average brightness of the current frame image, the dark state detail feature points and the actual maximum of the current frame image The brightness is input into the third query module to obtain the first detail statistical weight value; the theoretical maximum brightness of the current frame image and the best brightness of the current frame image are input into the fourth query module to obtain the second detail statistical weight value.
  • the average brightness of the current frame image is the number of signals in each signal interval in the statistical list multiplied by the end point signal value of the signal interval, and then the sum of the product values is divided by the signal of all intervals
  • the sum of the quantities, divided by the maximum signal value gives an example of a percentage.
  • the dark detail feature point is an image, when the number of signals below a certain signal interval multiplied by the sum of the end point signal values of the signal interval accounts for the closest proportion to the overall proportion of the overall value At this time, the signal interval point is the dark-state detail feature point.
  • the actual maximum brightness of the current frame image refers to the absolute value brightness corresponding to the largest section signal in the section with the number of signals in all signal sections in the statistical list.
  • the step of calculating the backlight control parameters according to the first detailed statistical weight value and the second detailed statistical weight value includes: according to the monitor maximum display brightness, the monitor minimum display brightness, the content maximum signal amplitude, and the full screen maximum Display brightness to obtain a function curve; map the curve function through the signal mapping function, and obtain the signal control curve and the backlight control parameter according to the first detail statistical weight value and the limitation of the first detailed statistical weight value.
  • An image dynamic enhancement device based on backlight adjustment includes:
  • the first obtaining module is used to obtain the coding information of the display content
  • the second obtaining module is used to obtain the optical index parameters of the display
  • the parsing module is used to parse the display content according to the coding information and optical index parameters to obtain the information of the current display content;
  • the analysis module is used to analyze and calculate the information based on the displayed content to obtain the analysis data; wherein, the analysis data includes the average brightness of the current frame image, the feature points of the dark state, the actual maximum brightness of the current frame image, the theoretical maximum brightness of the current frame image and the current frame The best brightness of the image;
  • the detailed statistical weight acquisition module is used to obtain the first detailed statistical weight value and the second detailed statistical weight value according to the analysis data;
  • the calculation module is used to calculate and obtain the backlight control parameters and the signal control curve according to the first detailed statistical weight value and the second detailed statistical weight value;
  • the adjustment module is used to adjust the details of the current frame image according to the backlight control parameters and the signal control curve.
  • a computer device includes a memory and a processor.
  • the memory stores a computer program.
  • the processor implements the computer program to implement the following steps:
  • the analysis data includes the average brightness of the current frame image, the feature points of the dark state, the actual maximum brightness of the current frame image, the theoretical maximum brightness of the current frame image, and the optimal brightness of the current frame image;
  • the analysis data includes the average brightness of the current frame image, the feature points of the dark state, the actual maximum brightness of the current frame image, the theoretical maximum brightness of the current frame image, and the optimal brightness of the current frame image;
  • the above image dynamic enhancement method, device and computer equipment based on backlight adjustment by analyzing the display content and the optical parameters of the display, and further adjusting the backlight according to the analysis data, can adjust the backlight without increasing any hardware cost.
  • the image details will not be sacrificed, and the image details can be enhanced to a certain extent, making the picture more layered and the three-dimensional feeling deeper, making the details of the displayed image clearer.
  • FIG. 1 is a schematic flowchart of an image dynamic enhancement method based on backlight adjustment in an embodiment
  • FIG. 2 is a schematic diagram of multiple TDP_L_LUT
  • Figure 3 shows the intention of the statistical list
  • Figure 4 is a schematic diagram of the cumulative value of multiple sets of backlight control lists
  • FIG. 5 is a structural block diagram of an image dynamic enhancement device based on backlight adjustment in an embodiment
  • FIG. 6 is an internal structure diagram of a computer device in an embodiment.
  • the image dynamic enhancement method based on backlight adjustment provided by the present disclosure may be applied in a terminal, where the terminal may be, but not limited to, various personal computers, notebook computers, mobile phones, tablet computers, in-vehicle computers, and portable wearable devices.
  • an image dynamic enhancement method based on backlight adjustment is provided. Taking the method applied to a terminal as an example for description, it includes the following steps:
  • Step 102 Obtain the encoding information included in the display content.
  • the display content is the specific content of the chip source signal input to the display.
  • the encoding information of the input signal can be obtained.
  • the coding information includes MDMA (MasterDisplayMaxLuminance, monitor maximum display brightness), MDMI (MasterDisplayMinLuminance, monitor minimum display brightness) and CLL (ContentLightLv, content maximum signal amplitude).
  • Step 104 Obtain the optical index parameters of the display.
  • the optical index parameters include the maximum display brightness of the full screen and the maximum display brightness of multiple backlit small windows.
  • the maximum display brightness of the backlight small window includes the maximum display brightness of the first backlight small window, the maximum display brightness of the second backlight small window, and the maximum display brightness of the third backlight small window.
  • the maximum display brightness of the first backlit small window, the maximum display brightness of the second backlit small window, and the maximum display brightness of the third backlit small window are respectively denoted as TDP_L10, TDP_L20, and TDP_L50.
  • Step 106 Analyze the display content according to the encoded information and the optical index parameters to obtain the information of the current display content.
  • this step specifically includes: entering the encoded information into the first query module to obtain the maximum query brightness of the monitor; entering the optical index parameter into the second query module to obtain the maximum display brightness parameter curve of the small backlight window; according to the monitoring
  • the maximum query brightness of the device and the maximum display brightness of the small backlight window are photoelectrically converted, and the current frame image is statistically analyzed to obtain a statistical list.
  • a three-dimensional table is preset in the first query module, which is denoted as 3D_LUT_1.
  • the three-dimensional includes rows, columns, and layers.
  • the values obtained after MDMA, MDMI, and CLL are compressed by 100 times correspond to these three dimensions.
  • the three-dimensional table is obtained based on multiple tests.
  • the terminal inputs the encoded information to the first query module to obtain the maximum query brightness of the monitor.
  • the value range of the maximum query brightness of the monitor is 0-1023.
  • a second three-dimensional table is preset in the second query module, denoted as 3D_LUT_2, three-dimensional rows, columns, and layers. In this embodiment, it is 11 rows, 11 columns, and 11 layers.
  • the suffix i is 3D_LUT_2_i for distinction.
  • a specific parameter curve TDP_L_LUT can be found.
  • Specific query method normalize TDP_L10 / TDP_L20 / TDP_L50 (respectively divided by TDP), and then multiply by 11 respectively, and the resulting values correspond to the three dimensions of 3D_LUT_2_i. Each time you query, you will get a specific value ai (a1 / a2 / a3 ......
  • TDP_L_LUT TDP_L_LUT (TDP_LUT).
  • Step 108 Analyze and calculate based on the information of the displayed content to obtain the analysis data; wherein, the analysis data includes the average brightness of the current frame image, the feature points of the dark state, the actual maximum brightness of the current frame image, the theoretical maximum brightness of the current frame image, and the maximum of the current frame image Best brightness.
  • the average brightness of the current frame image APL the dark state detail feature point K
  • the actual maximum brightness of the current frame image A1 the current frame The theoretical maximum brightness of the image is A2
  • the optimal brightness of the current frame image is A3.
  • the average brightness of the current frame image APL refers to the above linear domain statistics list L_HIST, the number of signals in each signal interval is multiplied by the end point signal value of the signal interval (as shown in the third column of FIG. 3), the above product value The sum is divided by the sum of the number of signals in all intervals, and then divided by the maximum signal value to obtain a percentage of the sample value.
  • Dark-state detail feature point K refers to an image in which the number of signals below a certain signal interval multiplied by the sum of the end point signal values of the signal interval accounts for the overall proportion closest to a certain level (such as 8%, the The value depends on the actual situation), the signal interval point is called the dark-state detail feature point K.
  • the actual maximum brightness A1 of the current frame image refers to the absolute value brightness A1 (the value range of A1 is 0 to 10000) corresponding to the signal in the section with the largest number of all signal sections in the above L_HIST. Taking L_HIST in FIG. 3 as an example, the maximum interval signal is 231, and the value is used as an input parameter.
  • the optimal brightness of the current frame image A3 refers to the above A1, MDM_LUT and TDP_LUT, which is calculated by the built-in conversion function f3:
  • Step 110 According to the analyzed data, obtain the first detailed statistical weight value and the second detailed statistical weight value.
  • the analysis parameters APL, K, and A1 of step 108 are input into the third query module, which presets a series of three-dimensional data (a 3-row table with 10 rows, 10 columns, and 10 layers), which is searched (search The method is the same as 3.1, except that APL / K / A1 needs to be compressed in different proportions to correspond to the three dimensions of row, column, and layer.
  • APL compression is rounded after 10 times compression
  • K compression is rounded after 2.5 times
  • A1 compression is 1000 times. After rounding), get the detailed statistical weight value P1.
  • the fourth query module which presets a series of three-dimensional data (a 3-row table with 10 rows, 10 columns, and 10 layers), and performs a search (the search method is the same as 3.1 However, A1 / A2 / A3 needs to be compressed at the same ratio to correspond to the three dimensions of row, column, and layer, which is rounded after 1000 times compression), and the detailed statistical weight value P2 is obtained.
  • Step 112 Calculate and obtain the backlight control parameter and the signal control curve according to the first detailed statistical weight value and the second detailed statistical weight value.
  • the core algorithm module will output a detailed processing list DL1.
  • the interpolation fitting operation includes cubic interpolation, Gaussian filtering and Bessel fitting.
  • a function curve f4 (MDMA, MDMI, CLL, TDP, IN) is obtained, where IN corresponds to the signal code value, and the value range is 0-255.
  • MDMA Data processing of MDMA, MDMI, CLL, TDP to get the coordinates of three points PB1 (MDMI / MDMA, 0.001), PB2 (TDP / MDMA, 0.8), PB3 (CLL / MDMA, 0.99);
  • B (t) PB0 * (1-t) ⁇ 3 + 3 * PB1 * t * (1- t) ⁇ 2 + 3 * PB2 * t ⁇ 2 * (1-t) + PB3 * t ⁇ 3, t ⁇ [0,1], where the coordinates of PB0 are (0,0), and the interval of t is 0.01, You can get 100 points;
  • the piecewise linear function f4 is obtained from the above 100 point connections;
  • the core algorithm module will output a backlight control list BLL1 (the list has 10 elements: BLL1_1, BLL1_2 ... BLL1_10 specific calculation process is as follows),
  • Figure 4 is the accumulation of several sets of backlight control lists Examples of values.
  • step_1 B3_N-B1;
  • BLL1_10 is the 10th element of the above backlight control list, and the remaining 9 are backstepped according to the step size.
  • BLL1_9 BLL1_10-Step_9
  • BLL1_8 BLL1_9-step_8, and so on.
  • Step 114 Adjust the details of the current frame image according to the backlight control parameters and the signal control curve.
  • Each frame of picture will produce a corresponding backlight adjustment list BLL1 and signal control curve M1. Under the combined effect of the two, the details of the current frame image will be enhanced to an appropriate degree, making the picture better layered and deeper.
  • the most important thing is that the detail enhancement of this algorithm is a dynamic enhancement combined with the detail distribution of each frame image and the change of the image before and after the frame and scene recognition.
  • the terminal analyzes the display content and the optical parameters of the display, and further adjusts the backlight according to the analysis data.
  • the image details will not be sacrificed, and the To a certain extent, the details of the image are enhanced to make the picture more layered and the three-dimensional feeling deeper, so that the details of the displayed image are clearer.
  • steps in the flowchart of FIG. 1 are displayed in order according to the arrows, the steps are not necessarily executed in the order indicated by the arrows. Unless clearly stated in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in FIG. 2 may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed and completed at the same time, but may be executed at different times, the execution of these sub-steps or stages The order is not necessarily sequential, but may be executed in turn or alternately with at least a part of other steps or sub-steps or stages of other steps.
  • the present disclosure provides an image dynamic enhancement device based on backlight adjustment, including: a first acquisition module 510, a second acquisition module 520, an analysis module 530, an analysis module 540, a detail statistical weight acquisition module 550, Calculation module 560 and adjustment module 570, in which:
  • the first obtaining module 510 is used to obtain the coding information of the display content
  • the second obtaining module 520 is used to obtain the optical index parameters of the display
  • the parsing module 530 is used to parse the displayed content according to the encoded information and optical index parameters to obtain the information of the currently displayed content;
  • the analysis module 540 is used to analyze and calculate based on the information of the displayed content to obtain analysis data; wherein, the analysis data includes the average brightness of the current frame image, the feature points of the dark state, the actual maximum brightness of the current frame image, the theoretical maximum brightness of the current frame image and the current Best brightness of frame image;
  • the detail statistical weight obtaining module 550 is used to obtain the first detail statistical weight value and the second detail statistical weight value according to the analysis data;
  • the calculation module 560 is configured to calculate and obtain a backlight control parameter and a signal control curve according to the first detailed statistical weight value and the second detailed statistical weight value;
  • the adjustment module 570 is used to adjust the details of the current frame image according to the backlight control parameters and the signal control curve.
  • the first acquisition module is specifically configured to: the system software of the display performs codec processing on the input display content to obtain the encoding information that comes with the display content; wherein, the encoding information includes the maximum display brightness of the monitor, The minimum display brightness of the monitor and the maximum signal amplitude of the content.
  • the optical indicator parameters include the maximum display brightness of the full screen and the maximum display brightness of multiple backlit small windows.
  • the image dynamic enhancement device based on backlight adjustment further includes a correction module for correcting graphics of the document picture using an image processing algorithm.
  • the parsing module is specifically used to input the encoded information into the first query module to obtain the maximum query brightness of the monitor; enter the optical index parameters into the second query module to obtain the maximum display brightness parameter curve of the small backlight window; according to the monitor
  • the maximum query brightness and the maximum display brightness of the backlit small window are photoelectrically converted, and the current frame image is statistically analyzed to obtain a statistical list.
  • the analysis module is also used to perform statistical analysis on the displayed content to obtain a signal mapping function.
  • the detail statistical weight acquisition module is further used to input the analysis data including the average brightness of the current frame image, the dark feature points and the actual maximum brightness of the current frame image into the third query module to obtain the first detail statistical weight value; Input the theoretical maximum brightness of the current frame image and the optimal brightness of the current frame image into the fourth query module to obtain the second detail statistical weight value.
  • the adjustment module is further used to obtain a function curve according to the maximum display brightness of the monitor, the minimum display brightness of the monitor, the maximum signal amplitude of the content, and the maximum display brightness of the full screen; the curve function is mapped through the signal mapping function, and A limitation of the detail statistical weight value and the first detail statistical weight value to obtain the signal control curve and the backlight control parameter.
  • Each module in the above image dynamic enhancement device based on backlight adjustment may be implemented in whole or in part by software, hardware, and a combination thereof.
  • the above modules may be embedded in the hardware or independent of the processor in the computer device, or may be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
  • the present disclosure provides a computer device.
  • the computer device may be a camera device, and an internal structure diagram thereof may be as shown in FIG. 6.
  • the computer equipment includes a processor, a memory, a network interface, a display screen, and an input device connected through a system bus.
  • the processor of the computer device is used to provide computing and control capabilities.
  • the memory of the computer device includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system and computer programs.
  • the internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium.
  • the network interface of the computer device is used to communicate with an external camera or server via a network connection.
  • the display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen
  • the input device of the computer device may be a touch layer covered on the display screen, or may be a button, a trackball or a touchpad provided on the computer device housing , Can also be an external keyboard, touchpad or mouse.
  • FIG. 6 is only a block diagram of a part of the structure related to the disclosed solution, and does not constitute a limitation on the computer device to which the disclosed solution is applied.
  • the specific computer device may Include more or less components than shown in the figure, or combine certain components, or have a different arrangement of components.
  • the present disclosure provides a computer device, including a memory and a processor, where a computer program is stored in the memory, and the processor implements the following steps when the processor executes the computer program: acquiring encoding information that comes with the display content;
  • the analysis data includes the average brightness of the current frame image, the feature points of the dark state, the actual maximum brightness of the current frame image, the theoretical maximum brightness of the current frame image and the optimal brightness of the current frame image
  • the step of acquiring the encoding information included in the display content specifically includes: the system software of the display performs encoding and decoding processing on the input display content to obtain the encoding information included in the display content; wherein, the encoding information includes the monitor maximum Display brightness, minimum display brightness of monitor, maximum signal amplitude of content.
  • the optical indicator parameters include the maximum display brightness of the full screen and the maximum display brightness of multiple backlit small windows.
  • the display content is parsed according to the encoded information and the optical index parameters
  • the step of obtaining the information of the current displayed content includes: entering the encoded information into the first query module to obtain the maximum query brightness of the monitor; and the optical index parameters Enter the second query module to get the maximum display brightness parameter curve of the small backlight window; perform photoelectric conversion according to the maximum query brightness of the monitor and the maximum display brightness of the small backlight window, and perform statistical analysis on the current frame image to obtain a statistical list.
  • the step of obtaining analysis data based on the analysis and calculation of the information of the display content further includes: performing statistical analysis on the display content to obtain a signal mapping function.
  • the step of obtaining the first detail statistical weight value and the second detail statistical weight value according to the analysis data includes: the analysis data includes the average brightness of the current frame image, the dark state detail feature points and the actual maximum of the current frame image The brightness is input into the third query module to obtain the first detail statistical weight value; the theoretical maximum brightness of the current frame image and the best brightness of the current frame image are input into the fourth query module to obtain the second detail statistical weight value.
  • the step of calculating the backlight control parameters according to the first detailed statistical weight value and the second detailed statistical weight value includes: according to the monitor maximum display brightness, the monitor minimum display brightness, the content maximum signal amplitude, and the full screen maximum Display brightness to obtain a function curve; map the curve function through the signal mapping function, and obtain the signal control curve and the backlight control parameter according to the first detail statistical weight value and the limitation of the first detailed statistical weight value.
  • the present disclosure provides a computer-readable storage medium on which a computer program is stored.
  • the computer program is executed by a processor, the following steps are implemented: acquiring coding information that comes with the display content;
  • the analysis data includes the average brightness of the current frame image, the feature points of the dark state, the actual maximum brightness of the current frame image, the theoretical maximum brightness of the current frame image and the optimal brightness of the current frame image
  • the step of obtaining the encoding information included in the display content specifically includes: the system software of the display performs codec processing on the input display content to obtain the encoding information included in the display content; wherein, the encoding information includes a monitor Maximum display brightness, minimum display brightness of monitor, and maximum signal amplitude of content.
  • the optical indicator parameters include the maximum display brightness of the full screen and the maximum display brightness of multiple backlit small windows.
  • the display content is parsed according to the encoded information and the optical index parameters
  • the step of obtaining the information of the current displayed content includes: entering the encoded information into the first query module to obtain the maximum query brightness of the monitor; and the optical index parameters Enter the second query module to get the maximum display brightness parameter curve of the small backlight window; perform photoelectric conversion according to the maximum query brightness of the monitor and the maximum display brightness of the small backlight window, and perform statistical analysis on the current frame image to obtain a statistical list.
  • the step of obtaining analysis data based on the analysis and calculation of the information of the display content further includes: performing statistical analysis on the display content to obtain a signal mapping function.
  • the step of obtaining the first detail statistical weight value and the second detail statistical weight value according to the analysis data includes: the analysis data includes the average brightness of the current frame image, the dark state detail feature points and the actual maximum of the current frame image The brightness is input into the third query module to obtain the first detail statistical weight value; the theoretical maximum brightness of the current frame image and the best brightness of the current frame image are input into the fourth query module to obtain the second detail statistical weight value.
  • the step of calculating the backlight control parameters according to the first detailed statistical weight value and the second detailed statistical weight value includes: according to the monitor maximum display brightness, the monitor minimum display brightness, the content maximum signal amplitude, and the full screen maximum Display brightness to obtain a function curve; map the curve function through the signal mapping function, and obtain the signal control curve and the backlight control parameter according to the first detail statistical weight value and the limitation of the first detailed statistical weight value.
  • Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory.
  • Volatile memory can include random access memory (RAM) or external cache memory.
  • RAM random access memory
  • DRAM dynamic RAM
  • SDRAM synchronous DRAM
  • DDRSDRAM double data rate SDRAM
  • ESDRAM enhanced SDRAM
  • SLDRAM synchronous chain (Synchlink) DRAM
  • RDRAM direct RAM
  • DRAM direct memory bus dynamic RAM
  • RDRAM memory bus dynamic RAM

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Liquid Crystal Display Device Control (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Processing (AREA)

Abstract

一种基于背光调整的图像动态增强方法、装置和计算机设备。方法包括：获取显示内容自带的编码信息（S102）；获取显示器的光学指标参数(S104)；根据编码信息和光学指标参数对显示内容进行解析，获得当前显示内容的信息(S106)；根据显示内容的信息分析计算，得到分析数据；根据分析数据，获得第一细节统计权重值和第二细节统计权重值(S110)；根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数和信号控制曲线(S112)；根据背光控制参数和信号控制曲线调整当前帧图像的细节(S114)。采用本方法可在调整背光时，不会牺牲掉图像细节，且可以一定程度增强图像细节，使得画面层次感更好，立体感更深，使得显示的图像的细节更清晰。

Description

基于背光调整的图像动态增强方法、装置和计算机设备 技术领域
本公开涉及计算机技术领域，尤其涉及一种基于背光调整的图像动态增强方法、装置和计算机设备。
背景技术
目前，背光调整是一种常见的显示处理技术，但是传统的背光调整方案，一般需要牺牲掉一部分图像细节，由于不恰当的牺牲掉信号的细节，会造成画面呈现不够完整，无法真正传递导演的真实意图。
发明内容
基于此，有必要针对上述技术问题，提供一种可在调整背光时，不会牺牲掉图像细节，且可以一定程度增强图像细节，使得画面层次感更好，立体感更深，使得显示的图像的细节更清晰的基于背光调整的图像动态增强方法、装置和计算机设备。
一种基于背光调整的图像动态增强方法，所述方法包括：
获取显示内容自带的编码信息；
获取显示器的光学指标参数；
根据编码信息和光学指标参数对显示内容进行解析，获得当前显示内容的信息；
根据显示内容的信息分析计算，得到分析数据；其中，分析数据包括当前帧图像平均亮度、暗态细节特征点、当前帧图像实际最大亮度、当前帧图像理论最大亮度和当前帧图像最佳亮度；
根据分析数据，获得第一细节统计权重值和第二细节统计权重值；
根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数和信号控制曲线；
根据背光控制参数和信号控制曲线调整当前帧图像的细节。
在其中一个实施例中，获取显示内容自带的编码信息的步骤具体包括：显示器的系统软件对输入的显示内容进行编解码处理，获得显示内容自带的编码信息。
在其中一个实施例中，编码信息包括监视器最大显示亮度、监视器最小显示亮度、内容最大信号幅度。
在其中一个实施例中，光学指标参数包括全屏最大显示亮度和多个背光小窗口最大显示亮度。
在其中一个实施例中，根据编码信息和光学指标参数对显示内容进行解析，获得当前显示内容的信息的步骤包括：将编码信息输入第一查询模块，得到监视器最大查询亮度；将光学指标参数输入第二查询模块，得到背光小窗口最大显示亮度参数曲线；根据监视器最大查询亮度和背光小窗口最大显示亮度进行光电转换，并对当前帧图像进行统计分析，得到统计列表。
在其中一个实施例中，所述监视器最大查询亮度的取值范围为0-1023。
在其中一个实施例中，根据显示内容的信息分析计算，得到分析数据的步骤还包括：对显示内容进行统计分析，得到信号映射函数。
在其中一个实施例中，根据分析数据，获得第一细节统计权重值和第二细节统计权重值的步骤包括：将分析数据包括当前帧图像平均亮度、暗态细节特征点和当前帧图像实际最大亮度输入第三查询模块，得到第一细节统计权重值；将当前帧图像理论最大亮度和当前帧图像最佳亮度输入第四查询模块，得到第二细节统计权重值。
在其中一个实施例中，所述当前帧图像平均亮度为所述统计列表中，各个信号区间下的信号数量乘以信号区间的端点信号值，然后将各个乘积值的总和除以所有区间信号的数量总和，再除以最大信号值，所得到的一个百分比例值。
在其中一个实施例中，所述暗态细节特征点为在一幅图像中，当某个信号区间以下的信号数量乘以该信号区间的端点信号值的总和占总体比例最接近一预设值时，所述信号区间点即为所述暗态细节特征点。
在其中一个实施例中，当前帧图像实际最大亮度指的是在所述统计列表中，所有信号区间内有信号数量的区间中最大的区间信号对应的绝对值亮度。
在其中一个实施例中，根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数的步骤包括：根据监视器最大显示亮度、监视器最小显示亮度、内容最大信号幅度和全屏最大显示亮度得到函数曲线；将曲线函数通过信号映射函数进行映射，并根据第一细节统计权重值和第一细节统计权重值的限制，得到信号控制曲线和背光控制参数。
一种基于背光调整的图像动态增强装置，所述装置包括：
第一获取模块，用于获取显示内容自带的编码信息；
第二获取模块，用于获取显示器的光学指标参数；
解析模块，用于根据编码信息和光学指标参数对显示内容进行解析，获得当前显示内容的信息；
分析模块，用于根据显示内容的信息分析计算，得到分析数据；其中，分析数据包括当前帧图像平均亮度、暗态细节特征点、当前帧图像实际最大亮度、当前帧图像理论最大亮度 和当前帧图像最佳亮度；
细节统计权重获取模块，用于根据分析数据，获得第一细节统计权重值和第二细节统计权重值；
计算模块，用于根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数和信号控制曲线；
调整模块，用于根据背光控制参数和信号控制曲线调整当前帧图像的细节。
一种计算机设备，包括存储器、处理器，所述存储器存储有计算机程序，所述处理器执行所述计算机程序时实现以下步骤：
获取显示内容自带的编码信息；
获取显示器的光学指标参数；
根据编码信息和光学指标参数对显示内容进行解析，获得当前显示内容的信息；
根据显示内容的信息分析计算，得到分析数据；其中，分析数据包括当前帧图像平均亮度、暗态细节特征点、当前帧图像实际最大亮度、当前帧图像理论最大亮度和当前帧图像最佳亮度；
根据分析数据，获得第一细节统计权重值和第二细节统计权重值；
根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数和信号控制曲线；
根据背光控制参数和信号控制曲线调整当前帧图像的细节。
一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现以下步骤：
获取显示内容自带的编码信息；
获取显示器的光学指标参数；
根据编码信息和光学指标参数对显示内容进行解析，获得当前显示内容的信息；
根据显示内容的信息分析计算，得到分析数据；其中，分析数据包括当前帧图像平均亮度、暗态细节特征点、当前帧图像实际最大亮度、当前帧图像理论最大亮度和当前帧图像最佳亮度；
根据分析数据，获得第一细节统计权重值和第二细节统计权重值；
根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数和信号控制曲线；
根据背光控制参数和信号控制曲线调整当前帧图像的细节。
上述基于背光调整的图像动态增强方法、装置和计算机设备，通过分析显示内容和显示器的光学参数，根据分析数据进一步对背光进行调整，可在不增加任何硬件成本的基础上，在调整背光时，不会牺牲掉图像细节，且可以一定程度增强图像细节，使得画面层次感更好， 立体感更深，使得显示的图像的细节更清晰。
附图说明
图1为为一个实施例中基于背光调整的图像动态增强方法的流程示意图；
图2为多条TDP_L_LUT的示意图；
图3为统计列表举意图；
图4为多组背光控制列表的累计值示意图；
图5为一个实施例中基于背光调整的图像动态增强装置的结构框图；
图6为一个实施例中计算机设备的内部结构图。
具体实施方式
为了使本公开的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本公开进行进一步详细说明。应当理解，此处描述的具体实施例仅仅用以解释本公开，并不用于限定本公开。
本公开提供的基于背光调整的图像动态增强方法，可以应用于终端内，其中，终端可以但不限于是各种个人计算机、笔记本电脑、手机、平板电脑、车载电脑和便携式可穿戴设备。
实施例1
如图1所示，提供了一种基于背光调整的图像动态增强方法，以该方法应用于终端为例进行说明，包括以下步骤：
步骤102，获取显示内容自带的编码信息。
其中，显示内容为输入至显示器的片源信号的具体内容。显示器的系统软件经过系列编解码处理后，可获取到输入信号的自带的编码信息。其中，编码信息包括MDMA(MasterDisplayMaxLuminance，监视器最大显示亮度)、MDMI(MasterDisplayMinLuminance，监视器最小显示亮度)和CLL(ContentLightLv，内容最大信号幅度)。
步骤104，获取显示器的光学指标参数。
光学指标参数包括全屏最大显示亮度和多个背光小窗口最大显示亮度。本实施例中，背光小窗口最大显示亮度包括第一背光小窗口最大显示亮度、第二背光小窗口最大显示亮度和第三背光小窗口最大显示亮度。本实施例中，将第一背光小窗口最大显示亮度、第二背光小窗口最大显示亮度和第三背光小窗口最大显示亮度分别记为TDP_L10、TDP_L20和TDP_L50。
步骤106，根据编码信息和光学指标参数对显示内容进行解析，获得当前显示内容的信息。
在其中一个实施例中，本步骤具体包括：将编码信息输入第一查询模块，得到监视器最大查询亮度；将光学指标参数输入第二查询模块，得到背光小窗口最大显示亮度参数曲线；根据监视器最大查询亮度和背光小窗口最大显示亮度进行光电转换，并对当前帧图像进行统计分析，得到统计列表。
其中，第一查询模块中预设置有一个三维表格，记为3D_LUT_1，三维包括行、列、层，MDMA、MDMI和CLL压缩100倍后取整得到的值分别对应这三个维度。本实施例中，三维表格为10行10列10层的表格，假设MDMA＝3,MDMI＝1,CLL＝2,那么MDM_LUT＝3D_LUT_1(3,1,2)。该三维表格根据多次试验测试得到。具体地，终端将编码信息输入第一查询模块，得到监视器最大查询亮度。其中，监视器最大查询亮度的取值范围为0-1023。
第二查询模块中预设置有一个三维表格，记为3D_LUT_2，三维行、列、层，本实施例中，为11行11列11层，加后缀i为3D_LUT_2_i以作区分，根据输入的参数，可查询到一条特定参数曲线TDP_L_LUT。具体查询方式：将TDP_L10/TDP_L20/TDP_L50作归一化处理(分别除以TDP)，然后再分别乘以11,最终得到的值分别对应3D_LUT_2_i的三个维度。每查询一次，会得到一个具体数值ai(a1/a2/a3……a11)(取值范围0-1023),查询11次后得到11个数值，根据这11个数值，经过线性插值之后，得到上述的参数曲线TDP_L_LUT:f1(13,26,51,77,102,128,153,179,204,230,255,a1,a2……a11)。图2是几条TDP_L_LUT的示意图。根据步骤二得到的参数TDP,将其作为函数值输出值，反过来求其输入值，得到最终的查找值TDP_LUT，即TDP＝TDP_L_LUT(TDP_LUT)。
根据上述得到MDM_LUT和TDP_LUT，通过光电转换函数及线性插值，得到信号映射函数fa2，然后对显示内容先做一次光电转换，再通过信号映射函数fa2进行映射解析(相当于原来的输入信号幅度为A，经光电转换变成YA,通过曲线fa2将其映射成m倍YA，m的取值范围为0-5，最后将最大值归一化到255)，之后对帧图像各像素值进行统计分析，得到一个线性域统计列表L_HIST，如图3是一个统计列表的举例，该列表共有32个数值，横坐标是信号区间，纵坐标是该区间对应的统计数值。
具体地，MDM_LUT和TDP_LUT，经过光电转换函数(现有公开函数)的转换后，得到对应的绝对值亮度Y_MDM_LUT和Y_TDP_LUT。以(0，0)和(Y_MDM_LUT，Y_TDP_LUT)这两点作为端点，进行线性插值，fa2(in)＝Y_TDP_LUT/Y_MDM_LUT*in。
步骤108，根据显示内容的信息分析计算，得到分析数据；其中，分析数据包括当前帧图像平均亮度、暗态细节特征点、当前帧图像实际最大亮度、当前帧图像理论最大亮度和当前帧图像最佳亮度。
根据步骤106获取的统计列表L_HIST和两个查找值MDM_LUT、TDP_LUT，通过分析计算，得到以下分析数据：当前帧图像平均亮度APL、暗态细节特征点K、当前帧图像实际最大亮度A1，当前帧图像理论最大亮度A2，当前帧图像最佳亮度A3。具体过程如下：
当前帧图像平均亮度APL，指的是上述的线性域统计列表L_HIST中，各个信号区间下的信号数量乘以该信号区间的端点信号值(如图3的第三列)，上述各个乘积值的总和除以所有区间信号的数量总和，再除以最大信号值，从而得到一份百分比例值。以图3的L_HIST为例，APL＝(7*0+15*0+23*0+31*45742+……+255*0)/65521/255*100＝20.876354。
暗态细节特征点K，指的是在一幅图像中，某个信号区间以下的信号数量乘以该信号区间的端点信号值的总和占总体比例最接近某一水平时(如8％，该值根据实际情况而定)，该信号区间点即称为暗态细节特征点K。
当前帧图像实际最大亮度A1,指的是在上述的L_HIST中，所有信号区间内有信号数量的区间中最大的那个区间信号对应的绝对值亮度A1(A1的取值范围为0到10000)。以图3的L_HIST为例，这个最大区间信号为231，将该值作为输入参数，经过内置转换函数f1的计算,可得到相应的绝对值亮度A1＝f1(231)＝OETF(231),其中OETF代表现有公开的光电转换函数。
当前帧图像理论最大亮度A2,指的是上述的A1和TDP_LUT，经过内置转换函数f2的计算得到:A2＝f2(A1,TDP_LUT)＝OETF(TDP_LUT)/10000*A1。
当前帧图像最佳亮度A3,指的是上述的A1、MDM_LUT和TDP_LUT，经过内置转换函数f3的计算得到:A2＝f3(A1,MDM_LUT,TDP_LUT)＝OETF(TDP_LUT)/OETF(MDM_LUT)*A1。
步骤110，根据分析数据，获得第一细节统计权重值和第二细节统计权重值。
具体地，将步骤108的分析参数APL、K和A1,输入到第三查询模块中，该模块预置了系列的三维数据(一个10行10列10层的3维表)，经过查找(查找方式同3.1，只是APL/K/A1需作不同的比例压缩之后对应到行、列、层三个维度，在此APL压缩10倍后取整，K压缩2.5倍后取整，A1压缩1000倍后取整)，得到细节统计权重值P1。
将步骤108的分析参数A1、A2和A3，输入到第四查询模块中，该模块预置了系列的三维数据(一个10行10列10层的3维表)，经过查找(查找方式同3.1，只是A1/A2/A3需作相同的比例压缩之后对应到行、列、层三个维度，在此压缩1000倍后取整)，得到了细节统计权重值P2。
步骤112，根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数和信号控制曲线。
根据上述步骤得到的参数MDMA、MDMCLLDPa2()、P1和P2,经过系列推导、插值拟 合运算，核心算法模块将输出一个细节处理列表DL1。其中，插值拟合运算包括三次方插值、高斯滤波和贝塞尔拟合。
根据MDMA、DMI、CLL和TDP,得到一个函数曲线f4(MDMA，MDMI，CLL，TDP，IN)，其中IN对应信号码值，取值范围0-255。具体过程如下：
将MDMA,MDMI,CLL,TDP做数据处理得到三个点的坐标PB1(MDMI/MDMA,0.001)、PB2(TDP/MDMA,0.8)、PB3(CLL/MDMA,0.99)；
将PB1、PB2、PB3作为贝塞尔曲线的控制点，代入贝塞尔曲线的公式,公式如下：B(t)＝PB0*(1-t)^3+3*PB1*t*(1-t)^2+3*PB2*t^2*(1-t)+PB3*t^3,t∈[0,1],其中PB0的坐标为(0,0)，t的间隔为0.01，可得到100个点；
由上述的100个点连线得到分段线性函数f4；
上述的分段线性函数曲线f4，经过信号映射函数fa2的映射，同时加入权重值P1/P2的限制，得到新的函数曲线f5(IN)＝P1/(P1+P2)*f4(IN)+P2,这就是最终的细节处理列表DL1,即信号控制曲线M1。
根据参数TDP_LUT、TDP_L_LUT、P1和P2,核心算法模块将输出一个背光控制列表BLL1(该列表有10个元素:BLL1_1、BLL1_2……BLL1_10具体计算过程如下)，图4是几组背光控制列表的累计值举例。
具体地，根据TDP_LUT和P1/P2可以得到一个背光控制值BLL1_10＝TDP_LUT*P1/P2+a,a为配置值，默认为0，若BLL1_10大于1000，BLL1_10＝1000。
根据TDP_L_LUT以及当前的BL背光值BL_N和目标背光值BLL1_10,得到9个背光变化步长值step_i。详细计算举例如下：
由BL_N代入TDP_L_LUT得到：B1＝TDP_L_LUT(BL_N)；
由BLL1_10代入TDP_L_LUT得到：B2＝TDP_L_LUT(BLL1_10)；
B3＝B1+(B2-B1)/10,由B3＝TDP_L_LUT(B3_N),反推得到B3_N；
step_1＝B3_N-B1；
其中，BLL1_10作为上述背光控制列表的第10个元素，其余的9个根据步长进行反推。BLL1_9＝BLL1_10-Step_9,BLL1_8＝BLL1_9-step_8，以此类推。
步骤114，根据背光控制参数和信号控制曲线调整当前帧图像的细节。
每一帧画面，都会产生相应的背光调整列表BLL1和信号控制曲线M1，在两者的共同作用下，以适当的程度增强当前帧图像的细节，使得画面层次感更好，立体感更深。最重要的是，本算法的细节增强，是结合每帧图像的细节分布以及前后帧图像变化和场景识别而进行的动态增强。
本实施例中，终端通过分析显示内容和显示器的光学参数，根据分析数据进一步对背光进行调整，可在不增加任何硬件成本的基础上，在调整背光时，不会牺牲掉图像细节，且可以一定程度增强图像细节，使得画面层次感更好，立体感更深，使得显示的图像的细节更清晰。
应该理解的是，虽然图1的流程图中的各个步骤按照箭头的指示依次显示，但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明，这些步骤的执行并没有严格的顺序限制，这些步骤可以以其它的顺序执行。而且，图2中的至少一部分步骤可以包括多个子步骤或者多个阶段，这些子步骤或者阶段并不必然是在同一时刻执行完成，而是可以在不同的时刻执行，这些子步骤或者阶段的执行顺序也不必然是依次进行，而是可以与其它步骤或者其它步骤的子步骤或者阶段的至少一部分轮流或者交替地执行。
实施例2
如图5所示，本公开提供了一种基于背光调整的图像动态增强装置，包括：第一获取模块510、第二获取模块520、解析模块530、分析模块540、细节统计权重获取模块550、计算模块560和调整模块570，其中：
第一获取模块510，用于获取显示内容自带的编码信息；
第二获取模块520，用于获取显示器的光学指标参数；
解析模块530，用于根据编码信息和光学指标参数对显示内容进行解析，获得当前显示内容的信息；
分析模块540，用于根据显示内容的信息分析计算，得到分析数据；其中，分析数据包括当前帧图像平均亮度、暗态细节特征点、当前帧图像实际最大亮度、当前帧图像理论最大亮度和当前帧图像最佳亮度；
细节统计权重获取模块550，用于根据分析数据，获得第一细节统计权重值和第二细节统计权重值；
计算模块560，用于根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数和信号控制曲线；
调整模块570，用于根据背光控制参数和信号控制曲线调整当前帧图像的细节。
在一个实施例中，第一获取模块具体用于：显示器的系统软件对输入的显示内容进行编解码处理，获得显示内容自带的编码信息；其中，所述编码信息包括监视器最大显示亮度、监视器最小显示亮度、内容最大信号幅度。
在一个实施例中，光学指标参数包括全屏最大显示亮度和多个背光小窗口最大显示亮度。
在一个实施例中，基于背光调整的图像动态增强装置还包括矫正模块，用于利用图像处 理算法对文档图片进行图形矫正。
在一个实施例中，解析模块具体用于将编码信息输入第一查询模块，得到监视器最大查询亮度；将光学指标参数输入第二查询模块，得到背光小窗口最大显示亮度参数曲线；根据监视器最大查询亮度和背光小窗口最大显示亮度进行光电转换，并对当前帧图像进行统计分析，得到统计列表。
在一个实施例中，分析模块还用于对显示内容进行统计分析，得到信号映射函数。
在一个实施例中，细节统计权重获取模块还用于将分析数据包括当前帧图像平均亮度、暗态细节特征点和当前帧图像实际最大亮度输入第三查询模块，得到第一细节统计权重值；将当前帧图像理论最大亮度和当前帧图像最佳亮度输入第四查询模块，得到第二细节统计权重值。
在一个实施例中，调整模块还用于根据监视器最大显示亮度、监视器最小显示亮度、内容最大信号幅度和全屏最大显示亮度得到函数曲线；将曲线函数通过信号映射函数进行映射，并根据第一细节统计权重值和第一细节统计权重值的限制，得到信号控制曲线和背光控制参数。
关于基于背光调整的图像动态增强装置的具体限定可以参见上文中对于基于背光调整的图像动态增强方法的限定，在此不再赘述。上述基于背光调整的图像动态增强装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中，也可以以软件形式存储于计算机设备中的存储器中，以便于处理器调用执行以上各个模块对应的操作。
实施例3
本公开提供了一种计算机设备，该计算机设备可以是摄像装置，其内部结构图可以如图6所示。该计算机设备包括通过系统总线连接的处理器、存储器、网络接口、显示屏和输入装置。其中，该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统和计算机程序。该内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境。该计算机设备的网络接口用于与外部的摄像装置或服务器通过网络连接通信。该计算机程序被处理器执行时以实现一种基于背光调整的图像动态增强方法。该计算机设备的显示屏可以是液晶显示屏或者电子墨水显示屏，该计算机设备的输入装置可以是显示屏上覆盖的触摸层，也可以是计算机设备外壳上设置的按键、轨迹球或触控板，还可以是外接的键盘、触控板或鼠标等。
本领域技术人员可以理解，图6中示出的结构，仅仅是与本公开方案相关的部分结构的框图，并不构成对本公开方案所应用于其上的计算机设备的限定，具体的计算机设备可以包 括比图中所示更多或更少的部件，或者组合某些部件，或者具有不同的部件布置。
实施例4
本公开提供了一种计算机设备，包括存储器和处理器，存储器中存储有计算机程序，该处理器执行计算机程序时实现以下步骤：获取显示内容自带的编码信息；
获取显示器的光学指标参数；
根据编码信息和光学指标参数对显示内容进行解析，获得当前显示内容的信息；
根据显示内容的信息分析计算，得到分析数据；其中，分析数据包括当前帧图像平均亮度、暗态细节特征点、当前帧图像实际最大亮度、当前帧图像理论最大亮度和当前帧图像最佳亮度；
根据分析数据，获得第一细节统计权重值和第二细节统计权重值；
根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数和信号控制曲线；
根据背光控制参数和信号控制曲线调整当前帧图像的细节。
在一个实施例中，获取显示内容自带的编码信息的步骤具体包括：显示器的系统软件对输入的显示内容进行编解码处理，获得显示内容自带的编码信息；其中，编码信息包括监视器最大显示亮度、监视器最小显示亮度、内容最大信号幅度。
在一个实施例中光学指标参数包括全屏最大显示亮度和多个背光小窗口最大显示亮度。
在其中一个实施例中，根据编码信息和光学指标参数对显示内容进行解析，获得当前显示内容的信息的步骤包括：将编码信息输入第一查询模块，得到监视器最大查询亮度；将光学指标参数输入第二查询模块，得到背光小窗口最大显示亮度参数曲线；根据监视器最大查询亮度和背光小窗口最大显示亮度进行光电转换，并对当前帧图像进行统计分析，得到统计列表。
在其中一个实施例中，根据显示内容的信息分析计算，得到分析数据的步骤还包括：对显示内容进行统计分析，得到信号映射函数。
在其中一个实施例中，根据分析数据，获得第一细节统计权重值和第二细节统计权重值的步骤包括：将分析数据包括当前帧图像平均亮度、暗态细节特征点和当前帧图像实际最大亮度输入第三查询模块，得到第一细节统计权重值；将当前帧图像理论最大亮度和当前帧图像最佳亮度输入第四查询模块，得到第二细节统计权重值。
在其中一个实施例中，根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数的步骤包括：根据监视器最大显示亮度、监视器最小显示亮度、内容最大信号幅度和全屏最大显示亮度得到函数曲线；将曲线函数通过信号映射函数进行映射，并根据第一细节统计权重值和第一细节统计权重值的限制，得到信号控制曲线和背光控制参数。
实施例5
本公开提供了一种计算机可读存储介质，其上存储有计算机程序，计算机程序被处理器执行时实现以下步骤：获取显示内容自带的编码信息；
获取显示器的光学指标参数；
根据编码信息和光学指标参数对显示内容进行解析，获得当前显示内容的信息；
根据显示内容的信息分析计算，得到分析数据；其中，分析数据包括当前帧图像平均亮度、暗态细节特征点、当前帧图像实际最大亮度、当前帧图像理论最大亮度和当前帧图像最佳亮度；
根据分析数据，获得第一细节统计权重值和第二细节统计权重值；
根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数和信号控制曲线；
根据背光控制参数和信号控制曲线调整当前帧图像的细节。
在其中一个实施例中，获取显示内容自带的编码信息的步骤具体包括：显示器的系统软件对输入的显示内容进行编解码处理，获得显示内容自带的编码信息；其中，编码信息包括监视器最大显示亮度、监视器最小显示亮度、内容最大信号幅度。
在其中一个实施例中，光学指标参数包括全屏最大显示亮度和多个背光小窗口最大显示亮度。
在其中一个实施例中，根据编码信息和光学指标参数对显示内容进行解析，获得当前显示内容的信息的步骤包括：将编码信息输入第一查询模块，得到监视器最大查询亮度；将光学指标参数输入第二查询模块，得到背光小窗口最大显示亮度参数曲线；根据监视器最大查询亮度和背光小窗口最大显示亮度进行光电转换，并对当前帧图像进行统计分析，得到统计列表。
在其中一个实施例中，根据显示内容的信息分析计算，得到分析数据的步骤还包括：对显示内容进行统计分析，得到信号映射函数。
在其中一个实施例中，根据分析数据，获得第一细节统计权重值和第二细节统计权重值的步骤包括：将分析数据包括当前帧图像平均亮度、暗态细节特征点和当前帧图像实际最大亮度输入第三查询模块，得到第一细节统计权重值；将当前帧图像理论最大亮度和当前帧图像最佳亮度输入第四查询模块，得到第二细节统计权重值。
在其中一个实施例中，根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数的步骤包括：根据监视器最大显示亮度、监视器最小显示亮度、内容最大信号幅度和全屏最大显示亮度得到函数曲线；将曲线函数通过信号映射函数进行映射，并根据第一细节统计权重值和第一细节统计权重值的限制，得到信号控制曲线和背光控制参数。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件来完成，所述的计算机程序可存储于一非易失性计算机可读取存储介质中，该计算机程序在执行时，可包括如上述各方法的实施例的流程。其中，本公开所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用，均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限，RAM以多种形式可得，诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。
以上实施例的各技术特征可以进行任意的组合，为使描述简洁，未对上述实施例中的各个技术特征所有可能的组合都进行描述，然而，只要这些技术特征的组合不存在矛盾，都应当认为是本说明书记载的范围。
以上所述实施例仅表达了本公开的几种实施方式，其描述较为具体和详细，但并不能因此而理解为对发明专利范围的限制。应当指出的是，对于本领域的普通技术人员来说，在不脱离本公开构思的前提下，还可以做出若干变形和改进，这些都属于本公开的保护范围。因此，本公开专利的保护范围应以所附权利要求为准。

Claims (15)

  1. 一种基于背光调整的图像动态增强方法，所述方法包括：
    获取显示内容自带的编码信息；
    获取显示器的光学指标参数；
    根据所述编码信息和所述光学指标参数对显示内容进行解析，获得当前显示内容的信息；
    根据显示内容的信息分析计算，得到分析数据；其中，分析数据包括当前帧图像平均亮度、暗态细节特征点、当前帧图像实际最大亮度、当前帧图像理论最大亮度和当前帧图像最佳亮度；
    根据所述分析数据，获得第一细节统计权重值和第二细节统计权重值；
    根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数和信号控制曲线；
    根据背光控制参数和信号控制曲线调整当前帧图像的细节。
  2. 根据权利要求1所述的方法，其特征在于，所述获取显示内容自带的编码信息的步骤具体包括：显示器的系统软件对输入的显示内容进行编解码处理，获得显示内容自带的编码信息。
  3. 根据权利要求2所述的方法，其特征在于，所述编码信息包括监视器最大显示亮度、监视器最小显示亮度、内容最大信号幅度。
  4. 根据权利要求1所述的方法，其特征在于，所述光学指标参数包括全屏最大显示亮度和多个背光小窗口最大显示亮度。
  5. 根据权利要求1所述的方法，其特征在于，所述根据所述编码信息和所述光学指标参数对显示内容进行解析，获得当前显示内容的信息的步骤包括：
    将所述编码信息输入第一查询模块，得到监视器最大查询亮度；
    将光学指标参数输入第二查询模块，得到背光小窗口最大显示亮度参数曲线；
    根据监视器最大查询亮度和背光小窗口最大显示亮度进行光电转换，并对当前帧图像进行统计分析，得到统计列表。
  6. 根据权利要求5所述的方法，其特征在于，所述监视器最大查询亮度的取值范围为0-1023。
  7. 根据权利要求1所述的方法，其特征在于，所述根据显示内容的信息分析计算，得到分析数据的步骤还包括：对所述显示内容进行统计分析，得到信号映射函数。
  8. 根据权利要求5所述的方法，其特征在于，所述根据所述分析数据，获得第一细节统计权重值和第二细节统计权重值的步骤包括：
    将所述分析数据包括当前帧图像平均亮度、暗态细节特征点和当前帧图像实际最大亮度输入第三查询模块，得到第一细节统计权重值；
    将所述当前帧图像理论最大亮度和当前帧图像最佳亮度输入第四查询模块，得到第二细节统计权重值。
  9. 根据权利要求8所述的方法，其特征在于，所述当前帧图像平均亮度为所述统计列表中，各个信号区间下的信号数量乘以信号区间的端点信号值，然后将各个乘积值的总和除以所有区间信号的数量总和，再除以最大信号值，所得到的一个百分比例值。
  10. 根据权利要求8所述的方法，其特征在于，所述暗态细节特征点为在一幅图像中，当某个信号区间以下的信号数量乘以该信号区间的端点信号值的总和占总体比例最接近一预设值时，所述信号区间点即为所述暗态细节特征点。
  11. 根据权利要求8所述的方法，其特征在于，当前帧图像实际最大亮度指的是在所述统计列表中，所有信号区间内有信号数量的区间中最大的区间信号对应的绝对值亮度。
  12. 根据权利要求8所述的方法，其特征在于，所述根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数的步骤包括：
    根据监视器最大显示亮度、监视器最小显示亮度、内容最大信号幅度和全屏最大显示亮度得到函数曲线；
    将曲线函数通过信号映射函数进行映射，并根据第一细节统计权重值和第一细节统计权重值的限制，得到信号控制曲线和背光控制参数。
  13. 一种基于背光调整的图像动态增强装置，其特征在于，所述装置包括：
    第一获取模块，用于获取显示内容自带的编码信息；
    第二获取模块，用于获取显示器的光学指标参数；
    解析模块，用于根据所述编码信息和所述光学指标参数对显示内容进行解析，获得当前显示内容的信息；
    分析模块，用于根据显示内容的信息分析计算，得到分析数据；其中，分析数据包括当前帧图像平均亮度、暗态细节特征点、当前帧图像实际最大亮度、当前帧图像理论最大亮度和当前帧图像最佳亮度；
    细节统计权重获取模块，用于根据所述分析数据，获得第一细节统计权重值和第二细节统计权重值；
    计算模块，用于根据第一细节统计权重值和第二细节统计权重值计算获得背光控制参数和信号控制曲线；
    调整模块，用于根据背光控制参数和信号控制曲线调整当前帧图像的细节。
  14. 一种计算机设备，包括存储器和处理器，所述存储器存储有计算机程序，其特征在于，所述处理器执行所述计算机程序时实现权利要求1至12中任一项所述方法的步骤。
  15. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，所述计算机程序被处理器执行时实现权利要求1至12中任一项所述的方法的步骤。
PCT/CN2019/111217 2018-10-16 2019-10-15 基于背光调整的图像动态增强方法、装置和计算机设备 WO2020078347A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US17/257,537 US11527212B2 (en) 2018-10-16 2019-10-15 Dynamic image enhancement method and device using backlight adjustment, and computer apparatus
EP19872951.9A EP3869447A4 (en) 2018-10-16 2019-10-15 METHOD AND DEVICE FOR DYNAMIC IMAGE IMPROVEMENT USING BACKLIGHT ADJUSTMENT, AND COMPUTER APPARATUS

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811203310.8 2018-10-16
CN201811203310.8A CN111063319B (zh) 2018-10-16 2018-10-16 基于背光调整的图像动态增强方法、装置和计算机设备

Publications (1)

Publication Number Publication Date
WO2020078347A1 true WO2020078347A1 (zh) 2020-04-23

Family

ID=70283658

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/111217 WO2020078347A1 (zh) 2018-10-16 2019-10-15 基于背光调整的图像动态增强方法、装置和计算机设备

Country Status (4)

Country Link
US (1) US11527212B2 (zh)
EP (1) EP3869447A4 (zh)
CN (1) CN111063319B (zh)
WO (1) WO2020078347A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112365861A (zh) * 2020-10-26 2021-02-12 深圳Tcl新技术有限公司 显示画面调整方法、电子设备及计算机可读存储介质
CN113077459A (zh) * 2021-04-28 2021-07-06 北京的卢深视科技有限公司 图像清晰度检测方法、装置、电子设备及存储介质

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114639355B (zh) * 2022-02-25 2023-07-25 展讯通信（上海）有限公司 图像显示方法及装置、存储介质、终端

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102210145A (zh) * 2008-10-02 2011-10-05 Lg电子株式会社 清晰度控制方法和使用该方法的图像显示装置
CN103313002A (zh) * 2013-07-05 2013-09-18 福建邮科通信技术有限公司 基于情境的移动流媒体节能优化方法
EP2947881A1 (en) * 2014-05-20 2015-11-25 Thomson Licensing Method and device for scalable encoding of a high-dynamic range frame and/or decoding a bitstream
CN105321487A (zh) * 2014-07-30 2016-02-10 瑞萨电子株式会社 图像处理设备和图像处理方法
CN105654436A (zh) * 2015-12-24 2016-06-08 广东迅通科技股份有限公司 一种基于前景背景分离的背光图像增强去噪方法
CN107274364A (zh) * 2017-06-06 2017-10-20 中科创达软件股份有限公司 一种图像增强方法及装置

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7760961B2 (en) * 2004-10-15 2010-07-20 Caba Moldvai Adaptive contrast enhancement
JP2007013666A (ja) * 2005-06-30 2007-01-18 Victor Co Of Japan Ltd 画像処理装置
JP4504284B2 (ja) * 2005-08-30 2010-07-14 株式会社東芝 映像信号処理装置及び映像信号処理方法
CN101278315A (zh) * 2005-09-30 2008-10-01 皇家飞利浦电子股份有限公司 图像细节增强
CN101364384B (zh) * 2007-08-06 2010-05-26 深圳Tcl工业研究院有限公司 一种液晶图像处理的方法及装置
EP2745507A1 (en) 2011-09-27 2014-06-25 Koninklijke Philips N.V. Apparatus and method for dynamic range transforming of images
EP2819414A3 (en) 2013-06-28 2015-02-25 Samsung Electronics Co., Ltd Image processing device and image processing method
CN105303586B (zh) * 2014-07-16 2018-05-11 深圳Tcl新技术有限公司 获取直方图的方法、亮度动态调整的方法及图像处理装置
CN105139809B (zh) * 2015-09-01 2018-06-12 青岛海信电器股份有限公司 液晶显示亮度控制方法和装置以及液晶显示设备
CN108257580B (zh) * 2016-12-28 2020-08-28 中科创达软件股份有限公司 一种基于背光亮度的显示画面的调节方法及装置
KR102435875B1 (ko) * 2017-07-21 2022-08-25 삼성디스플레이 주식회사 하이 다이내믹 레인지 영상 신호 처리를 위한 구동 회로 및 그것을 포함하는 표시 장치

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102210145A (zh) * 2008-10-02 2011-10-05 Lg电子株式会社 清晰度控制方法和使用该方法的图像显示装置
CN103313002A (zh) * 2013-07-05 2013-09-18 福建邮科通信技术有限公司 基于情境的移动流媒体节能优化方法
EP2947881A1 (en) * 2014-05-20 2015-11-25 Thomson Licensing Method and device for scalable encoding of a high-dynamic range frame and/or decoding a bitstream
CN105321487A (zh) * 2014-07-30 2016-02-10 瑞萨电子株式会社 图像处理设备和图像处理方法
CN105654436A (zh) * 2015-12-24 2016-06-08 广东迅通科技股份有限公司 一种基于前景背景分离的背光图像增强去噪方法
CN107274364A (zh) * 2017-06-06 2017-10-20 中科创达软件股份有限公司 一种图像增强方法及装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3869447A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112365861A (zh) * 2020-10-26 2021-02-12 深圳Tcl新技术有限公司 显示画面调整方法、电子设备及计算机可读存储介质
CN112365861B (zh) * 2020-10-26 2022-07-08 深圳Tcl新技术有限公司 显示画面调整方法、电子设备及计算机可读存储介质
CN113077459A (zh) * 2021-04-28 2021-07-06 北京的卢深视科技有限公司 图像清晰度检测方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
US20210366413A1 (en) 2021-11-25
EP3869447A1 (en) 2021-08-25
EP3869447A4 (en) 2021-12-01
CN111063319B (zh) 2021-05-18
CN111063319A (zh) 2020-04-24
US11527212B2 (en) 2022-12-13

Similar Documents

Publication Publication Date Title
WO2020078347A1 (zh) 基于背光调整的图像动态增强方法、装置和计算机设备
US9406132B2 (en) Vision-based quality metric for three dimensional video
WO2020094089A1 (zh) 视频画面调整方法、装置、计算机设备和存储介质
CN112365861B (zh) 显示画面调整方法、电子设备及计算机可读存储介质
CN112399120B (zh) 电子装置及其控制方法
CN110110152B (zh) 思维导图的处理方法、装置、计算机设备和存储介质
US11928793B2 (en) Video quality assessment method and apparatus
US20210365726A1 (en) Method and apparatus for object detection in image, vehicle, and robot
CN105979192A (zh) 一种视频显示方法和装置
WO2023092386A1 (zh) 一种图像处理方法、终端设备及计算机可读存储介质
CN109785239B (zh) 图像处理的方法和装置
Tu et al. V-PCC projection based blind point cloud quality assessment for compression distortion
CN115293994B (zh) 图像处理方法、装置、计算机设备和存储介质
CN111026912A (zh) 基于iptv的协同推荐方法、装置、计算机设备以及存储介质
Zhang et al. Using saliency-weighted disparity statistics for objective visual comfort assessment of stereoscopic images
US10735703B2 (en) Electronic device and associated image processing method
CN114332297A (zh) 图像的绘制方法、装置、计算机设备和存储介质
CN113256487A (zh) 图像处理方法、装置、设备和存储介质
Li et al. Perceptual quality assessment of face video compression: A benchmark and an effective method
CN114998634B (zh) 图像处理方法、装置、计算机设备和存储介质
CN115623284B (zh) 一种短视频的推送方法、装置、设备及存储介质
CN116188332B (zh) 一种图像处理方法、装置、设备及存储介质
CN117456969A (zh) 亮度调节方法、装置、设备、存储介质和程序产品
CN114638951B (zh) 房屋模型的展示方法、装置、电子设备和可读存储介质
CN114743147A (zh) 视频质量检测方法、装置及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19872951

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019872951

Country of ref document: EP

Effective date: 20210517