WO2019179106A1 - 背光亮度处理方法及系统、背光亮度调节方法、存储介质 - Google Patents

背光亮度处理方法及系统、背光亮度调节方法、存储介质 Download PDF

Info

Publication number
WO2019179106A1
WO2019179106A1 PCT/CN2018/112955 CN2018112955W WO2019179106A1 WO 2019179106 A1 WO2019179106 A1 WO 2019179106A1 CN 2018112955 W CN2018112955 W CN 2018112955W WO 2019179106 A1 WO2019179106 A1 WO 2019179106A1
Authority
WO
WIPO (PCT)
Prior art keywords
initial
pixel
luminance
image
pixels
Prior art date
Application number
PCT/CN2018/112955
Other languages
English (en)
French (fr)
Inventor
王雪丰
孙玉坤
苗京花
陈丽莉
张�浩
赵斌
王立新
李茜
索健文
李文宇
彭金豹
范清文
陆原介
刘亚丽
王晨如
孙建康
Original Assignee
京东方科技集团股份有限公司
北京京东方光电科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司, 北京京东方光电科技有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US16/473,804 priority Critical patent/US11398195B2/en
Publication of WO2019179106A1 publication Critical patent/WO2019179106A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406—Control of illumination source
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406—Control of illumination source
    • G09G3/342—Control of illumination source using several illumination sources separately controlled corresponding to different display panel areas, e.g. along one dimension such as lines
    • G09G3/3426—Control of illumination source using several illumination sources separately controlled corresponding to different display panel areas, e.g. along one dimension such as lines the different display panel areas being distributed in two dimensions, e.g. matrix
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/10—Intensity circuits
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • H04N9/3194—Testing thereof including sensor feedback
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0233—Improving the luminance or brightness uniformity across the screen
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0626—Adjustment of display parameters for control of overall brightness
    • G09G2320/0646—Modulation of illumination source brightness and image signal correlated to each other
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/16—Calculation or use of calculated indices related to luminance levels in display data
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals

Definitions

  • Embodiments of the present disclosure relate to a backlight brightness processing method, a backlight brightness adjustment method, a backlight brightness processing system, and a computer readable storage medium.
  • the liquid crystal display device is a passive light emitting device, which mainly comprises a liquid crystal display panel and a backlight.
  • the liquid crystal display panel itself does not emit light, but relies on a backlight to provide a light source.
  • At least one embodiment of the present disclosure provides a backlight brightness processing method, including: acquiring a display image; dividing the display image to obtain one or more initial partial regions; and calculating respective initial partial regions An average luminance value; an output image is obtained according to an average luminance value of each of the initial local regions and the display image.
  • an output image is obtained according to an average luminance value of each of the initial local regions and the display image, including:
  • the luminance pixel image and the display image are synthesized to obtain the output image.
  • the texture type of the display image is a rendering texture type.
  • Synthesizing the luminance pixel image and the display image to obtain the output image comprising:
  • the luminance pixel image is overlaid on the intermediate composite region to obtain the output image.
  • the size of the intermediate synthesis region is the same as the size of the luminance pixel image.
  • the texture type of the display image is a two-dimensional texture type.
  • Synthesizing the luminance pixel image and the display image to obtain the output image comprising:
  • the luminance pixel image is overlaid on the initial composite area to obtain the output image.
  • the size of the initial composite area is the same as the size of the luminance pixel image.
  • the luminance pixel image includes one or more luminance pixels.
  • Storing the one or more average luminance values in the luminance pixel image respectively includes:
  • the one or more average luminance values are sequentially filled into the one or more luminance pixels.
  • the one or more average luminance values are sequentially filled into the luminance pixels, including:
  • the one or more average luminance values are respectively used as grayscale values of the sub-pixels of the one or more luminance pixels, and are sequentially filled into the respective sub-pixels of the one or more luminance pixels.
  • the texture type of the display image is a rendering texture type
  • the average luminance value of each of the initial partial regions is separately calculated, including: converting the display image. a texture type to obtain an intermediate display image, the texture type of the intermediate display image being a two-dimensional texture type; dividing the intermediate display image according to the display image and the one or more initial partial regions to obtain the Displaying one or more intermediate partial regions of the image in the middle, the one or more initial partial regions are in one-to-one correspondence with the one or more intermediate partial regions; respectively calculating intermediate average brightness values of each of the intermediate partial regions, each The intermediate average luminance value of the intermediate partial region is an average luminance value of each of the initial partial regions.
  • the intermediate display image includes a plurality of intermediate pixels, and respectively calculating an intermediate average luminance value of each of the intermediate partial regions, including: acquiring each intermediate partial region.
  • An intermediate pixel luminance value of each of the intermediate pixels; and an intermediate average luminance value corresponding to each of the intermediate partial regions is calculated according to an intermediate pixel luminance value of each of the intermediate pixels in each of the intermediate partial regions.
  • each intermediate pixel includes a red sub-pixel, a green sub-pixel, and a blue sub-pixel, and a calculation formula of the intermediate pixel luminance value corresponding to each intermediate pixel is used. for:
  • r is the grayscale value of the red subpixel of each of the intermediate pixels
  • g is the grayscale value of the green subpixel of each of the intermediate pixels
  • b is the blue subpixel of each of the intermediate pixels.
  • a gray scale value, L represents an intermediate pixel luminance value corresponding to each of the intermediate pixels.
  • an intermediate average corresponding to each intermediate local region is calculated according to an intermediate pixel luminance value of each intermediate pixel in each of the intermediate partial regions.
  • the brightness value includes: averaging the intermediate pixel brightness values of all the intermediate pixels in each of the intermediate partial regions to obtain an intermediate average brightness value corresponding to each of the intermediate partial regions; or, selecting each of the intermediate N intermediate pixels in the local area, averaging intermediate pixel brightness values of the selected N intermediate pixels in each of the intermediate partial areas to obtain intermediate average brightness corresponding to each of the intermediate partial areas a value, where N is a positive integer and is less than the number of all intermediate pixels in each of the intermediate partial regions.
  • the texture type of the display image is a two-dimensional texture type.
  • Calculating average brightness values of each of the initial local regions including:
  • an average corresponding to each initial local region is calculated according to initial pixel luminance values of the plurality of initial pixels in each initial local region.
  • Brightness values including:
  • a size of each of the one or more initial partial regions is variable.
  • At least one embodiment of the present disclosure provides a backlight brightness adjustment method, including:
  • the output image is displayed.
  • the display is a virtual reality display or an augmented reality display.
  • At least one embodiment of the present disclosure provides a backlight brightness processing system including: an image acquisition device configured to acquire a display image; a memory configured to store non-transitory computer readable instructions; and a processor configured to operate Non-transitory computer readable instructions, wherein the non-transitory computer readable instructions are executed by the processor to perform a backlight brightness processing method according to any of the above.
  • At least one embodiment of the present disclosure provides a computer readable storage medium for storing non-transitory computer readable instructions for performing backlighting according to any of the above when the non-transitory computer readable instructions are executed by a computer Brightness processing method.
  • FIG. 1 is a schematic flowchart of a backlight brightness processing method according to an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram of displaying an image according to an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram showing a calculation result of an average luminance value of a part of an initial partial region in the display image shown in FIG. 2;
  • FIG. 4 is a schematic diagram of a luminance pixel image according to an embodiment of the present disclosure.
  • FIG. 5 is a schematic diagram of an output image according to an embodiment of the present disclosure.
  • FIG. 6 is a schematic flowchart of a backlight brightness adjustment method according to an embodiment of the present disclosure
  • FIG. 7 is a schematic block diagram of a backlight brightness processing system according to an embodiment of the present disclosure.
  • the backlight since the backlight needs to consume more energy, reducing the power consumption of the backlight also reduces the power consumption of the entire liquid crystal display device; on the other hand, because the liquid crystal display panel
  • the displayed image has a light and dark change. If the brightness of the backlight remains unchanged during the display, the saturation and contrast of the displayed image will be reduced, which will affect the display effect.
  • Methods for reducing the power consumption of the backlight include improving the driving circuit of the backlight, improving the luminous efficiency of the backlight, developing a new type of backlight, local backlight adjustment, and the like.
  • Local Dimming can replace backlights consisting of cold cathode fluorescent lamps (CCFLs) with hundreds of backlights composed of light-emitting diodes (LEDs).
  • the backlights of LEDs can be based on backlights.
  • the brightness of the image is adjusted by local brightness, so that the brightness of the brighter portion in the displayed image can be increased and the brightness of the darker portion can be reduced, thereby improving the contrast of the displayed image.
  • Embodiments of the present disclosure provide a rendering engine-based backlight luminance processing method, a backlight luminance adjustment method, a backlight luminance processing system, and a computer readable storage medium that implement calculation of an average luminance value of a local region in a rendering engine, and The average brightness value of the local area is transmitted to the hardware device together with the original image, thereby reducing power consumption, improving contrast, realizing image real-time sampling and transmission, and meeting the requirement of processing large amounts of data in real time in virtual reality technology.
  • FIG. 1 is a schematic flowchart of a method for processing backlight brightness according to an embodiment of the present disclosure.
  • a rendering engine-based backlight brightness processing method may include, but is not limited to, the following steps:
  • the calculation of the local backlight brightness value can be implemented in the rendering engine, that is, in the software of the host, so that the backlight brightness processing method has the characteristics of editability and high flexibility.
  • the backlight brightness processing method does not need to add a chip on the hardware end (for example, the display end), thereby reducing the weight of the hardware end.
  • the rendering engine can create a virtual space in which the currently captured display image can be processed, and then the processed display image is transmitted to the display device for display. It can realize real-time sampling and transmission of images, which meets the requirements of VR technology that needs to process large amounts of data in real time.
  • the period of the backlight luminance processing can be set according to actual application conditions.
  • the processing period of the backlight brightness processing may be one frame or multiple frames, or the processing period of the backlight brightness processing may also be a preset time period (for example, 1 second, 5 seconds, etc.).
  • the processing period of the backlight brightness processing may be small (for example, one frame), thereby adjusting the local backlight brightness of each frame in real time, thereby improving the display effect;
  • the processing period of the backlight luminance processing may be large (for example, 1 second), thereby reducing the calculation amount of the rendering engine.
  • the current scene may be sampled by the camera to obtain a display image, and then the display image is saved.
  • the display image can be saved in a graphics processing unit (GPU).
  • the texture type of the displayed image is of the render texture type.
  • the image format of the displayed image is ARGB32, and the size of the display image can be 1080 ⁇ 1200. It should be noted that the present disclosure is not limited thereto, and an image format, a texture type, a size, and the like of the display image may be set according to actual conditions.
  • the current scene may be sampled by the camera to obtain an original image, and then the original image is processed to obtain a display image, and the texture type of the display image is two.
  • Dimension Texture (Texture2D) type is two.
  • the display image may be a color image or a grayscale image.
  • the display image can have a variety of different shapes, such as a rectangle, a circle, a trapezoid, and the like.
  • the display image may be divided according to the size, brightness change relationship, and the like of the displayed image to obtain one or more initial partial regions.
  • the sizes of the plurality of initial partial regions may be the same or different.
  • the size of the initial partial region may be small; and in the portion where the light and dark changes are small in the display image, the size of the initial partial region may be large.
  • the size of a plurality of initial partial regions can be controlled in real time. That is, the dimensions of the plurality of initial partial regions are variable.
  • a programming operation can be performed in the rendering engine, and the display image can be re-divided according to actual needs to obtain different initial partial regions, thereby improving the flexibility of backlight brightness processing.
  • the user can input different initial local area sizes through the user interface, thereby controlling the size of each initial local area.
  • the size of the display image may be 1080 ⁇ 1200, and the display image may be divided into 9 ⁇ 10 initial partial regions, the 9 ⁇ 10 initial partial regions having the same size, and both being 120 ⁇ 120.
  • step S30 may include:
  • S302 Divide the intermediate display image according to the display image and the one or more initial partial regions to obtain one or more intermediate partial regions of the intermediate display image, one or more initial partial regions and one or more intermediate partial regions. correspond;
  • S303 Calculate an intermediate average luminance value of each intermediate local region, and an intermediate average luminance value of each intermediate local region is an average luminance value of each initial local region.
  • the texture type of the intermediate display image is a 2D texture (Texture 2D) type. Since the texture type of the displayed image is the render texture type, the render texture type cannot directly read the information of each pixel, so the texture type of the displayed image can be converted into the Texture2D type, so that the brightness information of each pixel can be read.
  • Texture 2D Texture 2D
  • the intermediate display image is stored in a central processing unit (CPU).
  • CPU central processing unit
  • the difference between the intermediate display image and the display image is different only from the Texture type, and the remaining information (eg, displayed content, etc.) is the same.
  • the size of the intermediate display image and the display image, the texture type are different, and the rest of the information (eg, displayed content, etc.) are the same, for example, the size of the display image is M ⁇ N, and the size of the intermediate display image is M. /T ⁇ N/T, M and N are positive integers, T is a positive number. When T is greater than 1, the size of the intermediate display image is larger than the size of the displayed image.
  • the size ratio of the intermediate display image The size of the display image is small, that is, when the size of the intermediate display image and the display image are different, the display image may be scaled up or down to obtain an intermediate display image; when T is equal to 1, the size and display of the intermediate display image The size of the image is the same.
  • the intermediate display image is divided according to the correspondence relationship between the intermediate display image and the display image and the division manner of the initial partial region in the display image to obtain one or more intermediate partial regions of the intermediate display image.
  • the intermediate display image is the same size as the display image, that is, if the size of the display image may be 1080 ⁇ 1200, the size of the intermediate display image may also be 1080 ⁇ 1200, thereby ensuring each intermediate partial region and The sizes of the initial partial regions are respectively the same and one-to-one correspondence.
  • the image format of the intermediate display image and the display image is also the same, that is, if the image format of the display image is ARGB32, the image format of the intermediate display image is also ARGB32.
  • the intermediate display image may include a plurality of intermediate pixels.
  • each intermediate pixel may include three sub-pixels, and the three sub-pixels are a red sub-pixel, a green sub-pixel, and a blue sub-pixel, respectively.
  • the disclosure does not limit this, and each intermediate pixel may also include four sub-pixels (for example, four sub-pixels of red, green, blue, and white).
  • intermediate pixel means a pixel in an intermediate display image.
  • step S303 one or more initial local regions are respectively in one-to-one correspondence with one or more average luminance values, and one or more intermediate partial regions are in one-to-one correspondence with one or more intermediate average luminance values, and one or The plurality of intermediate average brightness values are one or more average brightness values.
  • step S303 the brightness of the displayed image can be reflected by the luminance information of each pixel on the display image, so the luminance information of each intermediate partial region can be obtained by acquiring the luminance information of the intermediate pixels in each intermediate partial region.
  • step S303 can include:
  • S3031 Acquire an intermediate pixel luminance value of each intermediate pixel in each intermediate local area
  • S3032 Calculate an intermediate average luminance value corresponding to each intermediate local region according to an intermediate pixel luminance value of each intermediate pixel in each intermediate local region.
  • intermediate pixel luminance value indicates the luminance value of the intermediate pixel.
  • the intermediate pixel luminance value corresponding to each intermediate pixel may be calculated according to the luminance formula between the color (RGB) and the luminance.
  • the calculation formula of the intermediate pixel luminance value corresponding to each intermediate pixel may be:
  • r is the grayscale value of the red subpixel of the intermediate pixel
  • g is the grayscale value of the green subpixel of the intermediate pixel
  • b is the grayscale value of the blue subpixel of the intermediate pixel
  • L is the intermediate pixel Corresponding intermediate pixel brightness value. Since different colors of light have different wavelengths, and the sensitivity of the human eye to color is different, the sensitivity of the human eye to the blue and red sub-pixels is lower than that of the green sub-pixels. Therefore, the intermediate pixel corresponding to an intermediate pixel has a brightness value. The brightness values of the sub-pixels of the intermediate pixel are calculated in different proportions, so that the visual brightness of the intermediate pixel can be better reflected, and the display effect is improved.
  • the calculation formula of the intermediate pixel luminance value of each intermediate pixel may be adjusted according to the color of each sub-pixel in the intermediate pixel.
  • the user may edit the calculation formula of the intermediate pixel luminance value through the user interface (for example, changing the calculation)
  • the equation in the formula, etc. is a calculation formula for adjusting the luminance value of the intermediate pixel according to the color of each sub-pixel of the intermediate pixel.
  • FIG. 2 is a schematic diagram of displaying an image according to an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of a calculation result of an average luminance value of a portion of an initial partial region in the display image illustrated in FIG. 2 .
  • the size of the display image shown in FIG. 2 may be 1080 ⁇ 1200, and the display image is divided into 9 ⁇ 10 initial partial regions.
  • Figure 3 shows the average luminance values of 30 initial local regions in 9 x 10 initial local regions.
  • the grayscale value of the sub-pixel is a normalized value, that is, the grayscale value of the sub-pixel is represented by floating-type data of 0-1, and therefore, as shown in FIG. It is shown that the average luminance value of the initial local area is also represented by 0-1 floating type data.
  • step S3032 can include averaging intermediate pixel luminance values for all intermediate pixels in each intermediate local region to obtain an intermediate average luminance value corresponding to the intermediate local region. For example, after calculating the intermediate pixel luminance value of each intermediate pixel in each intermediate local region, the intermediate pixel luminance values of all the intermediate pixels of the intermediate local region may be averaged to obtain an intermediate corresponding to the intermediate partial region. Average brightness value.
  • step S3032 may include: selecting N intermediate pixels in each intermediate local region; averaging intermediate pixel luminance values of the selected N intermediate pixels in each intermediate partial region to An intermediate average luminance value corresponding to each intermediate local region is obtained, where N is a positive integer and less than the number of all intermediate pixels in the corresponding intermediate partial region.
  • N intermediate pixels may be selected in the intermediate partial region according to pixel luminance values of intermediate pixels in an intermediate local region, and intermediate pixel luminance values of the selected N intermediate pixels are acquired, and then selected. The intermediate pixel luminance values of the N intermediate pixels are averaged to obtain an intermediate average luminance value of the intermediate local region.
  • the number, position, and the like of the selected intermediate pixels may be determined according to actual needs, and the number of selected intermediate pixels in each intermediate partial area may be the same or different. The disclosure does not limit this.
  • the intermediate average luminance value of the intermediate local region may be an arithmetic mean of intermediate pixel luminance values of all intermediate pixels or selected intermediate pixels in the intermediate local region, thereby simplifying the calculation process and increasing the calculation speed. . Therefore, in step S3032, the calculation formula of the intermediate average luminance value of each intermediate partial region may be:
  • L' represents the intermediate average luminance value of the intermediate local region
  • L i represents the intermediate pixel luminance value of the i-th intermediate pixel of the intermediate local region
  • the intermediate average luminance value of the intermediate local region is all of the intermediate partial region.
  • n represents the number of all intermediate pixels in the intermediate partial region
  • the intermediate average luminance value of the intermediate partial regions is the intermediate pixel of the selected intermediate pixel in the intermediate partial region.
  • i and n are both positive integers, and 1 ⁇ i ⁇ n.
  • the intermediate average luminance value of the intermediate local region may also be a geometric mean value, a weighted average value, and the like of the intermediate pixel luminance values of all the intermediate pixels or the selected intermediate pixels in the intermediate local region. No restrictions.
  • the backlight luminance processing method provided by the embodiment of the present disclosure may further include an operation of screening the intermediate pixel luminance values of the intermediate pixels to remove noise information in the intermediate pixel luminance values to obtain a more accurate intermediate average.
  • Brightness value For example, if the absolute value of the difference between the intermediate pixel luminance value of one intermediate pixel and the intermediate pixel luminance value of each adjacent intermediate pixel is greater than a preset threshold, the intermediate pixel luminance value of the intermediate pixel may belong to noise information.
  • the preset threshold can be determined according to the actual application, and the disclosure does not limit this.
  • step S30 may include:
  • S311 Acquire initial pixel brightness values of multiple initial pixels in each initial local area
  • S312 Calculate an average brightness value corresponding to each initial local area according to initial pixel brightness values of the plurality of initial pixels in each initial local area.
  • step S312 may include averaging initial pixel luminance values of all initial pixels in each initial local region to obtain an average luminance value corresponding to each initial local region.
  • step S312 may further include: selecting N initial pixels in each initial local region; averaging initial pixel luminance values of the selected N initial pixels in each initial local region to obtain each initial partial The average brightness value corresponding to the area.
  • N is a positive integer and is less than the number of all initial pixels in the corresponding initial local region.
  • initial pixel means a pixel in the display image
  • initial pixel brightness value represents a luminance value of the initial pixel.
  • the operation procedure of calculating the average luminance value corresponding to the initial local region from the initial pixel in steps S311 and S312 and the intermediate average luminance value corresponding to the intermediate local region calculated from the intermediate pixel are described above. Types, repetitions are not repeated here.
  • a plurality of initial pixels are in one-to-one correspondence with a plurality of initial pixel luminances, that is, one initial pixel corresponds to one initial pixel luminance.
  • a plurality of initial local regions are in one-to-one correspondence with a plurality of average luminance values, that is, an initial local region corresponds to only one average luminance value.
  • the plurality of intermediate partial regions are in one-to-one correspondence with the plurality of intermediate average luminance values, that is, one intermediate local region corresponds to only one intermediate average luminance value. If the display image includes W initial local regions, the W initial local regions correspond to W average luminance values, and the first initial local region corresponds to the first average luminance value, and the second initial local region corresponds to the second average luminance value. And, by analogy, the Wth initial local region corresponds to the Wth average luminance value.
  • the first intermediate local region corresponds to the first intermediate average luminance value
  • the second intermediate local region corresponds to the second intermediate average luminance value
  • the W intermediate partial regions correspond to the Wth intermediate average luminance values.
  • the correspondence between the plurality of intermediate pixels and the plurality of intermediate pixel luminance values, the correspondence between the plurality of initial pixels, and the plurality of initial pixel luminance values are also similar to the correspondence between the plurality of initial partial regions and the plurality of average luminance values. , will not repeat them here.
  • step S40 may include the following steps:
  • S401 Create a luma pixel image according to the number of one or more initial local regions
  • S403 Synthesize the luminance pixel image and the display image to obtain an output image.
  • the texture type of the luma pixel image may be of the Texture2D type.
  • the luma pixel image may include one or more luma pixels, and the one or more luma pixels may be arranged in a row, a plurality of columns, a plurality of rows, a column, or a plurality of rows and columns.
  • the disclosure does not limit this.
  • “brightness pixels” represent pixels in a luminance pixel image.
  • the number of luma pixels in the luma pixel image may be less than the number of initial local regions; alternatively, the number of luma pixels in the luma pixel image may be equal to the number of initial local regions.
  • step S402 can include sequentially filling one or more average luminance values into one or more luminance pixels.
  • each sub-pixel of each luma pixel may store an average luminance value of the same initial local area, such that the number of luma pixels in the luma pixel image may be equal to the number of initial local regions.
  • each sub-pixel of each luma pixel may separately store an average luminance value of different initial local regions, such that the number of luma pixels in the luma pixel image may be smaller than the number of initial local regions.
  • one or more average luma values are sequentially filled into one or more luma pixels, including: one or more The average luminance values are respectively used as grayscale values of sub-pixels of each luma pixel, and are sequentially filled into each sub-pixel of one or more luma pixels.
  • each luma pixel may contain an average luminance value of three initial local regions, thereby reducing the size of the luma pixel image.
  • the number of average luminance values of the initial partial regions is 90, and the number of luminance pixels in the luminance pixel image may be 30.
  • FIG. 4 is a schematic diagram of a luminance pixel image according to an embodiment of the present disclosure.
  • luminance pixels in a luminance pixel image are arranged in a row and a plurality of columns.
  • Each luminance pixel includes three sub-pixels (for example, a red sub-pixel, a blue sub-pixel, and a green sub-pixel).
  • FIG. 4 shows two luminance pixels in a luminance pixel image, which are a first luminance pixel 11 and a second luminance pixel 12, respectively.
  • FIG. 4 shows average luminance values of six initial local regions, the average luminance value of the first initial local region P1 is 0.8627, and the average luminance value of the second initial local region P2 is 0.8627, and the third initial partial region P3
  • the average luminance value is 0.8667
  • the average luminance value of the fourth initial local region P4 is 0.4078
  • the average luminance value of the fifth initial local region P5 is 0.3804
  • the average luminance value of the sixth initial partial region P6 is 0.3804.
  • the average luminance value of the first initial local region P1, the average luminance value of the second initial local region P2, and the average luminance value of the third initial partial region P3 are respectively filled to the first luminance pixel 11
  • the average luminance value of the fourth initial local region P4 the average luminance value of the fifth initial local region P5, and the average luminance value of the sixth initial local region P6 are respectively filled into the three sub-pixels of the second luminance pixel 12.
  • step S402 first, a plurality of average luminance values corresponding to the plurality of initial partial regions are converted into grayscale values of the sub-pixels, and then filled into the sub-pixels.
  • step S402 for an 8-bit color (8-bit) display (that is, each color is represented by an 8-bit bit), the grayscale value of the sub-pixel has a level ranging from 0 to 255.
  • the average luminance value of the first initial partial region P1 is 0.8627
  • the grayscale value of one sub-pixel of the first luminance pixel 11 is 0.8627 ⁇ 255 ⁇ 220.
  • the calculation process of the grayscale values of the remaining sub-pixels is similar to the above calculation process. Therefore, as shown in FIG.
  • the grayscale values of the respective sub-pixels in the first luminance pixel 11 are 220, 220, and 221, respectively; the grayscale values of the respective sub-images in the second luminance pixel 12 are 104, 97, and 97, respectively.
  • the grayscale value of the sub-pixel is an integer
  • the nearest integer to the non-integer is taken.
  • the grayscale value as a subpixel.
  • step S403 may include the following steps:
  • S4031 Convert the texture type of the display image to obtain an intermediate display image, and the texture type of the intermediate display image is a two-dimensional texture type;
  • step S301 the intermediate display image has been obtained based on the display image, and the intermediate display image is stored in the CPU, and therefore, in step S4031, the intermediate display image stored in the CPU can be directly acquired.
  • step S4031 the step of converting the display image into the intermediate display image, that is, the step of converting the texture type of the display image to obtain the intermediate display image, may be performed again.
  • the size of the intermediate composite area may be the same as the size of the luminance pixel image. However, it is not limited thereto, and the size of the intermediate synthesis area may also be larger than the size of the luminance pixel image.
  • overlaying the luma pixel image on the intermediate composite region of the intermediate display image to obtain the output image may include: placing the luma pixel image on the first layer; placing the intermediate display image on the second layer The first layer is located above the second layer; the brightness pixel image is aligned with the intermediate composite area of the intermediate display image; the first layer and the second layer are combined to obtain an output image.
  • overlaying the luma pixel image on the intermediate synthesis area of the intermediate display image to obtain the output image may include: replacing the intermediate synthesis area of the intermediate display image with the luma pixel image, for example, each pixel in the intermediate synthesis area of the intermediate display image. The grayscale value is replaced with the grayscale value of the corresponding luminance pixel of the luminance pixel image to obtain an output image.
  • both the luma pixel image and the intermediate display image are rendered images, and both the luma pixel image and the intermediate display image are stored in the CPU.
  • step S403 after the output image is obtained (in this case, the output image can be stored in the CPU), the output image can be sampled into the GPU and stored in the GPU for subsequent operations.
  • the output image in this case, the output image can be stored in the CPU
  • the output image can be sampled into the GPU and stored in the GPU for subsequent operations.
  • FIG. 5 is a schematic diagram of an output image according to an embodiment of the present disclosure.
  • the intermediate composite area may be located at an edge region of the intermediate display image, for example, the lower right corner. However, it is not limited thereto, and depending on the actual situation, the intermediate composite area may be located in other areas of the intermediate display image, such as the lower left corner.
  • the size of the luminance pixel image is small, the area of the intermediate composite area occupied by the luminance pixel image is also small, and the luminance pixel image covers the edge region of the intermediate display image, and therefore, in practical applications, the luminance pixel The image does not affect the display.
  • the intermediate display image includes a plurality of intermediate pixels
  • the output image includes a plurality of output pixels.
  • the output image 30 may include a first area 31 and a second area 32, the first area 31 corresponding to an intermediate composite area of the intermediate display image.
  • the intermediate synthesis area is located at the lower right corner of the intermediate display image
  • the first area 31 is also located at the lower right corner of the output image 30.
  • the value of at least a portion of the output pixels in the first region 31 is the same as the value of each luminance pixel 20 of the luminance pixel image.
  • the values of the respective output pixels in the first area 31 are in one-to-one correspondence with the values of the respective luminance pixels 20 of the luminance pixel image.
  • the value of each output pixel in the second region 32 is the same as the value of each intermediate pixel at the corresponding position in the intermediate display image.
  • each pixel indicates the grayscale value of each sub-pixel in each pixel.
  • output pixel means a pixel in the output image.
  • the size of the output image is the same as the size of the intermediate display image.
  • the backlight brightness processing method further includes outputting the output image.
  • the output image includes a value of a portion of the intermediate pixels in the intermediate display image and a value of all the luminance pixels in the pixel luminance image. Therefore, the backlight brightness processing method provided by the embodiment of the present disclosure can transmit the calculation result of the partial backlight brightness and the original display image to a hardware device (for example, a display or the like).
  • step S403 may include the steps of: acquiring an initial composite region of the display image; overlaying the luminance pixel image on the initial composite region to obtain an output image.
  • the size of the initial composite area is the same as the size of the luminance pixel image
  • the size of the output image is the same as the size of the display image.
  • the specific operation of overlaying the luma pixel image on the initial synthesis area to obtain an output image may refer to the above operation of overlaying the luma pixel image on the intermediate synthesis area to obtain an output image. The repetitions are not repeated here.
  • FIG. 6 is a schematic flowchart of a backlight brightness adjustment method according to an embodiment of the present disclosure.
  • the backlight brightness adjustment method may include the backlight brightness processing method described in any of the above embodiments.
  • the backlight brightness adjustment method may include the following steps:
  • S63 obtaining an output image according to an average brightness value of each initial local area and a display image
  • S65 processing the output image through the display to obtain an average brightness value of each initial local area
  • S66 adjusting a backlight brightness of the display according to an average brightness value of each initial local area
  • the backlight brightness adjustment method provided by the embodiment of the present disclosure can implement the calculation of the partial backlight brightness on the rendering engine end, and then transmit the calculation result of the partial backlight brightness together with the original display image to the display end, and then the display is based on the partial backlight.
  • the brightness calculation results adjust the brightness of the backlight, thereby reducing power consumption, improving contrast, real-time sampling and transmission of images, and meeting the requirements of real-time processing of large amounts of data in virtual reality technology.
  • the display can adjust the backlight brightness of each partial area so that the backlight brightness of each partial area is the same as the calculation result of the partial backlight brightness of each partial area.
  • a detailed description of each of the steps S60-S64 performed in the rendering engine may refer to the description of the backlight brightness processing method in the above embodiment.
  • the detailed description of step S60 can refer to the description of step S10 above.
  • the detailed description of step S61 can refer to the description of step S20 above.
  • the detailed description of step S62 can refer to the description of step S30 above.
  • the detailed description of step S63 can refer to the above steps. Description of S40.
  • the display may be a virtual reality (VR) display or an augmented reality (AR) display or the like, that is, the backlight brightness adjustment method may be applied to a VR or an AR to reduce power consumption and improve contrast of a display screen.
  • VR virtual reality
  • AR augmented reality
  • the display can be a liquid crystal display or the like.
  • the display may extract the value of the output pixel corresponding to each luma pixel in the output image, and convert the value of the output pixel corresponding to each luma pixel into an average luminance value of each initial local region.
  • step S66 may include: calculating backlight brightness of each initial local area according to an average brightness value of each initial local area; determining and adjusting backlight brightness of the display according to backlight brightness of each initial partial area.
  • the backlight brightness of the display corresponding to each initial local area is the same as the calculated backlight brightness of each initial partial area.
  • the display can include a display panel and a backlight.
  • the backlight can be a direct type backlight and is a dynamic backlight.
  • the backlight can correspond to the entire display panel such that the backlight brightness of all of the sub-pixels in the pixels of the display panel can be adjusted.
  • the backlight may include an array of light emitting cells including a plurality of light emitting cells arranged in an array, for example, the light emitting cells include a red light unit (R), a green light unit (G), and a blue light unit (B), which Combine together to emit white light.
  • These lighting units can be light emitting diodes (LEDs), such as inorganic LEDs or organic LEDs. These lighting units can for example be at least partially controlled individually.
  • FIG. 7 is a schematic block diagram of a backlight brightness processing system according to an embodiment of the present disclosure.
  • the backlight brightness processing system 200 includes an image acquisition device 201, a memory 202, and a processor 203. It should be noted that the components of the backlight brightness processing system shown in FIG. 7 are merely exemplary and not limiting, and the backlight brightness processing system may have other components depending on actual application needs.
  • image acquisition device 201 is configured to acquire a display image; memory 202 is configured to store non-transitory computer readable instructions; processor 203 is configured to execute the non-transitory computer readable instructions.
  • the processor 203 executes one or more of the backlight brightness processing methods described in any of the above embodiments when the non-transitory computer readable instructions are executed.
  • the image acquisition device 201, the memory 202, the processor 203, and the like may be disposed at the host side.
  • image acquisition device 201 may be interconnected by a bus system and/or other form of connection mechanism (not shown).
  • components such as image acquisition device 201, memory 202, and processor 203 may communicate with each other directly or indirectly.
  • the image acquisition device 201 may be a digital camera, a camera of a smart phone, a camera of a tablet computer, a camera of a personal computer, or even a web camera, so that the display image may be obtained by sampling the current scene by the image acquisition device 201. image.
  • the image acquisition device 201 may also include various software and/or hardware having data reading capabilities, so that the display image can be obtained by directly reading the image stored in the memory by the image acquisition device 201.
  • processor 203 can be a central processing unit (CPU) or other form of processing unit having data processing capabilities and/or program execution capabilities, such as a field programmable gate array (FPGA) or a tensor processing unit (TPU), Processor 203 can control other components in the backlight brightness processing system to perform the desired functions.
  • the central processing unit (CPU) may be an X86 or ARM architecture or the like.
  • memory 202 can include any combination of one or more computer program products, which can include various forms of computer readable storage media, such as volatile memory and/or nonvolatile memory.
  • Volatile memory can include, for example, random access memory (RAM) and/or caches and the like.
  • the non-volatile memory may include, for example, a read only memory (ROM), a hard disk, an erasable programmable read only memory (EPROM), a portable compact disk read only memory (CD-ROM), a USB memory, a flash memory, and the like.
  • ROM read only memory
  • EPROM erasable programmable read only memory
  • CD-ROM portable compact disk read only memory
  • USB memory a flash memory
  • flash memory and the like.
  • One or more computer instructions can be stored on the memory 202, and the processor 203 can execute the computer instructions to perform various functions.
  • Various applications and various data as well as various data used and/or generated by the application, and the like can also be stored in the computer readable storage medium.
  • the backlight brightness processing system may further include a display or the like according to actual needs.
  • the display may be configured to process the output image to obtain an average luminance value for each of the initial local regions; to adjust the backlight brightness of the display according to the average luminance value of each of the initial local regions; and display the output image.
  • An embodiment of the present disclosure also provides a computer readable storage medium.
  • the computer readable storage medium can be used to store non-transitory computer readable instructions.
  • One or more non-transitory computer readable instructions may be stored on a computer readable storage medium.
  • one or more of the backlight brightness processing methods described in any of the above embodiments may be performed when the computer executes the non-transitory computer readable instructions.
  • the computer readable storage medium can be applied to the backlight brightness processing system described above.
  • the computer readable storage medium can be the memory 202 of the backlight brightness processing system 200 in the embodiment shown in FIG.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Chemical & Material Sciences (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Liquid Crystal Display Device Control (AREA)

Abstract

一种背光亮度处理方法、背光亮度调节方法、背光亮度处理系统以及计算机可读存储介质，该背光亮度处理方法包括：获取显示图像(S10)；划分显示图像，以得到一或多个初始局部区域(S20)；分别计算各初始局部区域的平均亮度值(S30)；根据各初始局部区域的平均亮度值和显示图像，得到输出图像(S40)。

Description

背光亮度处理方法及系统、背光亮度调节方法、存储介质
本申请要求于2018年03月19日递交的中国专利申请第201810225834.0号的优先权，在此全文引用上述中国专利申请公开的内容以作为本申请的一部分。
技术领域
本公开的实施例涉及一种背光亮度处理方法、背光亮度调节方法、背光亮度处理系统以及计算机可读存储介质。
背景技术
液晶显示装置(LCD，Liquid Crystal Display)具有超长寿命、反应速度快、体积小、辐射低等优点，已广泛应用于笔记本电脑、手机和液晶电视等电子设备中。液晶显示装置是一种被动发光器件，其主要包括液晶显示面板以及背光源，液晶显示面板本身并不发光，而是依靠背光源为其提供光源。
发明内容
本公开至少一实施例提供一种背光亮度处理方法，该背光亮度处理方法包括：获取显示图像；划分所述显示图像，以得到一或多个初始局部区域；分别计算各所述初始局部区域的平均亮度值；根据各所述初始局部区域的平均亮度值和所述显示图像，得到输出图像。
例如，在本公开至少一实施例提供的背光亮度处理方法中，根据各所述初始局部区域的平均亮度值和所述显示图像，得到输出图像，包括：
根据所述一或多个初始局部区域的数量，创建亮度像素图像；
将各所述初始局部区域的平均亮度值分别存储在所述亮度像素图像中；
合成所述亮度像素图像和所述显示图像，以得到所述输出图像。
例如，在本公开至少一实施例提供的背光亮度处理方法中，所述显示图像的纹理类型为渲染纹理类型，
合成所述亮度像素图像和所述显示图像，以得到所述输出图像，包括：
转换所述显示图像的纹理类型，以得到中间显示图像，所述中间显示图像的纹理类型为二维纹理类型；
获取所述中间显示图像的中间合成区域；
将所述亮度像素图像覆盖在所述中间合成区域上，以得到所述输出图像。
例如，在本公开至少一实施例提供的背光亮度处理方法中，所述中间合成区域的尺寸与所述亮度像素图像的尺寸相同。
例如，在本公开至少一实施例提供的背光亮度处理方法中，所述显示图像的纹理类型为二维纹理类型，
合成所述亮度像素图像和所述显示图像，以得到所述输出图像，包括：
获取所述显示图像的初始合成区域；
将所述亮度像素图像覆盖在所述初始合成区域上，以得到所述输出图像。
例如，在本公开至少一实施例提供的背光亮度处理方法中，所述初始合成区域的尺寸与所述亮度像素图像的尺寸相同。
例如，在本公开至少一实施例提供的背光亮度处理方法中，所述亮度像素图像包括一或多个亮度像素，
将所述一或多个平均亮度值分别存储在所述亮度像素图像中，包括：
将所述一或多个平均亮度值依次填充到所述一或多个亮度像素中。
例如，在本公开至少一实施例提供的背光亮度处理方法中，将所述一或多个平均亮度值依次填充到所述亮度像素中，包括：
将所述一或多个平均亮度值分别作为所述一或多个亮度像素的各子像素的灰阶值，并依次填充到所述一或多个亮度像素的各子像素中。
例如，在本公开至少一实施例提供的背光亮度处理方法中，所述显示图像的纹理类型为渲染纹理类型，分别计算各所述初始局部区域的平均亮度值，包括：转换所述显示图像的纹理类型，以得到中间显示图像，所述中间显示图像的纹理类型为二维纹理类型；根据所述显示图像和所述一或多个初始局部区域，划分所述中间显示图像，以得到所述中间显示图像的一或多个中间局部区域，所述一或多个初始局部区域与所述一或多个中间局部区域一一对应；分别计算各所述中间局部区域的中间平均亮度值，各所述中间局部区域的中间平均亮度值为各所述初始局部区域的平均亮度值。
例如，在本公开至少一实施例提供的背光亮度处理方法中，所述中间显示图像包括多个中间像素，分别计算各所述中间局部区域的中间平均亮度值，包括：获取每个中间局部区域中的各中间像素的中间像素亮度值；根据所述每个中间局部区域中的所述各中间像素的中间像素亮度值，计算所述每个中间局部 区域对应的中间平均亮度值。
例如，在本公开至少一实施例提供的背光亮度处理方法中，每个中间像素包括红色子像素、绿色子像素和蓝色子像素，所述每个中间像素对应的中间像素亮度值的计算公式为：
L＝0.30×r+0.59×g+0.11×b，
其中，r表示所述每个中间像素的红色子像素的灰阶值，g表示所述每个中间像素的绿色子像素的灰阶值，b表示所述每个中间像素的蓝色子像素的灰阶值，L表示所述每个中间像素对应的中间像素亮度值。
例如，在本公开至少一实施例提供的背光亮度处理方法中，根据所述每个中间局部区域中的所述各中间像素的中间像素亮度值，计算所述每个中间局部区域对应的中间平均亮度值，包括：将所述每个中间局部区域中的所有中间像素的中间像素亮度值求平均，以得到所述每个中间局部区域对应的中间平均亮度值；或者，选取所述每个中间局部区中的N个中间像素，将所述每个中间局部区域中的被选取的所述N个中间像素的中间像素亮度值求平均，以得到所述每个中间局部区域对应的中间平均亮度值，其中，N为正整数，且小于所述每个中间局部区域中的所有中间像素的数量。
例如，在本公开至少一实施例提供的背光亮度处理方法中，所述显示图像的纹理类型为二维纹理类型，
分别计算各所述初始局部区域的平均亮度值，包括：
获取所述每个初始局部区域中的多个初始像素的初始像素亮度值；
根据所述每个初始局部区域中的所述多个初始像素的初始像素亮度值，计算所述每个初始局部区域对应的平均亮度值。
例如，在本公开至少一实施例提供的背光亮度处理方法中，根据所述每个初始局部区域中的所述多个初始像素的初始像素亮度值，计算所述每个初始局部区域对应的平均亮度值，包括：
将所述每个初始局部区域中的所有初始像素的初始像素亮度值求平均，以得到所述每个初始局部区域对应的平均亮度值；或者
选取所述每个初始局部区中的N个初始像素，
将所述每个初始局部区域中的被选取的所述N个初始像素的初始像素亮度值求平均，以得到所述每个初始局部区域对应的平均亮度值，其中，N为正整数，且小于所述每个初始局部区域中的所有初始像素的数量。
例如，在本公开至少一实施例提供的背光亮度处理方法中，所述一或多个初始局部区域中的每个的尺寸是可变化的。
本公开至少一实施例提供一种背光亮度调节方法，包括：
在渲染引擎中：
执行根据上述任一实施例所述的背光亮度处理方法；以及
在显示器中：
通过所述显示器处理所述输出图像，以得到各所述初始局部区域的平均亮度值；
根据各所述初始局部区域的平均亮度值调节所述显示器的背光亮度；以及
显示所述输出图像。
例如，在本公开至少一实施例提供的背光亮度调节方法中，所述显示器为虚拟现实显示器或增强现实显示器。
本公开至少一实施例提供一种背光亮度处理系统，包括：图像获取装置，被配置为获取显示图像；存储器，被配置为存储非暂时性计算机可读指令；以及处理器，被配置为运行所述非暂时性计算机可读指令，其中，所述非暂时性计算机可读指令被所述处理器运行时执行根据上述任一项所述的背光亮度处理方法。
本公开至少一实施例提供一种计算机可读存储介质，用于存储非暂时性计算机可读指令，当所述非暂时性计算机可读指令由计算机执行时执行根据上述任一项所述的背光亮度处理方法。
附图说明
为了更清楚地说明本公开实施例的技术方案，下面将对实施例的附图作简单地介绍，显而易见地，下面描述中的附图仅仅涉及本公开的一些实施例，而非对本公开的限制。
图1为本公开一实施例提供的一种背光亮度处理方法的示意性流程图；
图2为本公开一实施例提供一种显示图像的示意图；
图3为图2所示的显示图像中部分初始局部区域的平均亮度值的计算结果示意图；
图4为本公开一实施例提供的一种亮度像素图像的示意图；
图5为本公开一实施例提供的一种输出图像的示意图；
图6为本公开一实施例提供的一种背光亮度调节方法的示意性流程图；
图7为本公开一实施例提供的一种背光亮度处理系统的示意性框图。
具体实施方式
为了使得本公开实施例的目的、技术方案和优点更加清楚，下面将结合本公开实施例的附图，对本公开实施例的技术方案进行清楚、完整地描述。显然，所描述的实施例是本公开的一部分实施例，而不是全部的实施例。基于所描述的本公开的实施例，本领域普通技术人员在无需创造性劳动的前提下所获得的所有其他实施例，都属于本公开保护的范围。
除非另外定义，本公开使用的技术术语或者科学术语应当为本公开所属领域内具有一般技能的人士所理解的通常意义。本公开中使用的“第一”、“第二”以及类似的词语并不表示任何顺序、数量或者重要性，而只是用来区分不同的组成部分。“包括”或者“包含”等类似的词语意指出现该词前面的元件或者物件涵盖出现在该词后面列举的元件或者物件及其等同，而不排除其他元件或者物件。“连接”或者“相连”等类似的词语并非限定于物理的或者机械的连接，而是可以包括电性的连接，不管是直接的还是间接的。“上”、“下”、“左”、“右”等仅用于表示相对位置关系，当被描述对象的绝对位置改变后，则该相对位置关系也可能相应地改变。
为了保持本公开实施例的以下说明清楚且简明，本公开省略了已知功能和已知部件的详细说明。
目前，在液晶显示装置中，一方面，因为背光源需要消耗较多的能量，因此，降低背光源的功耗也就降低了整个液晶显示装置的功耗；另一方面，因为液晶显示面板所显示的图像具有明暗变化，若在显示过程中背光源的亮度始终保持不变，则会导致显示的图像的饱和度和对比度降低，影响显示效果。
降低背光源的功耗的方法包括改善背光源的驱动电路、改善背光源的发光效率、开发新的背光源种类、局部背光调节等。局部背光调节(Local Dimming)可以利用数百个有机二极管(light-emitting diode,LED)组成的背光灯代替冷阴极荧光灯管(cold cathode fluorescent lamp,CCFL)组成的背光灯，LED的背光灯可根据图像的明暗进行局部亮度调节，从而可以增加显示图像中的较亮部分的亮度和降低较暗部分的亮度，提高显示图像的对比度。
本公开的实施例提供一种基于渲染引擎的背光亮度处理方法、背光亮度调 节方法、背光亮度处理系统以及计算机可读存储介质，其在渲染引擎中实现局部区域的平均亮度值的计算，并将局部区域的平均亮度值与原始图像一并传输给硬件设备，从而降低功耗，提高对比度，实现图像的实时采样和传输，满足虚拟现实技术中实时处理大量数据的要求。
下面结合附图对本公开的几个实施例进行详细说明，但是本公开并不限于这些具体的实施例。
图1为本公开一实施例提供的一种背光亮度处理方法的示意性流程图。
例如，如图1所示，本公开一实施例提供的基于渲染引擎的背光亮度处理方法可以包括，但不限于，以下步骤：
S10：获取显示图像；
S20：划分显示图像，以得到一或多个初始局部区域；
S30：分别计算各初始局部区域的平均亮度值；
S40：根据各初始局部区域的平均亮度值和显示图像，得到输出图像。
例如，在背光亮度处理方法中，局部背光亮度值的计算可以在渲染引擎中实现，即在主机的软件中实现，从而该背光亮度处理方法具有可编辑性、灵活性高等特点。同时，该背光亮度处理方法不需要在硬件端(例如显示器端)增加芯片，从而可以减轻硬件端的重量。对于虚拟现实(VR)显示，渲染引擎可以创建出一个虚拟的空间，在虚拟的空间中，可以对当前捕捉到的显示图像进行处理，然后将处理后的显示图像传输给显示器件进行显示，从而可以实现图像的实时采样和传输，满足VR技术中需要实时处理大量数据的要求。
例如，在背光亮度处理方法中，背光亮度处理的周期可以根据实际应用情况进行设定。例如，背光亮度处理的处理周期可以为一帧或多个帧，或者，背光亮度处理的处理周期还可以为预设时间段(例如，1秒、5秒等)。当相邻两帧或相邻多帧显示图像的亮度差异较大时，背光亮度处理的处理周期可以较小(例如，一帧)，从而实时调整每帧的局部背光亮度，提升显示效果；当相邻两帧或相邻多帧显示图像的亮度差异较小时，背光亮度处理的处理周期可以较大(例如，1秒)，从而降低渲染引擎的计算量。
例如，在一些实施例中，在步骤S10中，可以通过相机对当前场景进行采样，以获得显示图像，然后保存该显示图像。例如，该显示图像可以被保存在图像处理器(graphics processing unit,GPU)中。
例如，显示图像的纹理(texture)类型为渲染纹理(render texture)类型。 显示图像的图像格式为ARGB32，显示图像的尺寸可以为1080×1200。需要说明的是，本公开不限于此，显示图像的图像格式、纹理类型和尺寸等可以根据实际情况设定。
例如，在另一些实施例中，在步骤S10中，可以通过相机对当前场景进行采样，以获得原始图像，然后对该原始图像进行处理，以得到显示图像，且该显示图像的纹理类型为二维纹理(Texture2D)类型。
例如，显示图像可以为彩色图像，也可以为灰度图像。
例如，显示图像可以具有各种不同的形状，例如矩形、圆形、梯形等。
例如，在步骤S20中，可以根据显示图像的尺寸、明暗变化关系等划分显示图像，以得到一或多个初始局部区域。
例如，当显示图像被划分为多个初始局部区域时，多个初始局部区域的尺寸可以相同，也可以不同。例如，在显示图像中明暗变化较大的部分，初始局部区域的尺寸可以较小；而在显示图像中明暗变化较小的部分，初始局部区域的尺寸可以较大。
例如，在本公开实施例中，多个初始局部区域的尺寸可实时控制。也就是说，多个初始局部区域的尺寸是可变化的。在步骤S20中，在渲染引擎中可以进行编程操作，显示图像可以根据实际需求被重新划分，以得到不同的初始局部区域，从而提高背光亮度处理的灵活性。例如，根据实际应用需求，用户可以通过用户界面输入不同的初始局部区域的尺寸，从而控制各初始局部区域的尺寸。
例如，在一个示例中，显示图像的尺寸可以为1080×1200，显示图像可以被划分为9×10个初始局部区域，该9×10个初始局部区域尺寸相同，且均为120×120。
例如，在一个示例中，当显示图像的texture类型为render texture类型时，步骤S30可以包括：
S301：转换显示图像的纹理类型，以得到中间显示图像；
S302：根据显示图像和一或多个初始局部区域，划分中间显示图像，以得到中间显示图像的一或多个中间局部区域，一或多个初始局部区域与一或多个中间局部区域一一对应；
S303：分别计算各中间局部区域的中间平均亮度值，各中间局部区域的中间平均亮度值为各初始局部区域的平均亮度值。
例如，在步骤S301中，中间显示图像的纹理类型为二维纹理(Texture2D)类型。由于显示图像的texture类型为render texture类型，render texture类型无法直接读取每个像素的信息，所以显示图像的纹理类型可以转换为Texture2D类型，以便于读取每个像素的亮度信息。
例如，中间显示图像被存储在中央处理器(CPU)中。
需要说明的是，在一些示例中，中间显示图像和显示图像的区别仅在与Texture类型不同，其余信息(例如，显示的内容等)均相同。在另一些示例中，中间显示图像和显示图像的尺寸、Texture类型不同，其余信息(例如，显示的内容等)均相同，例如，显示图像的尺寸为M×N，中间显示图像的尺寸为M/T×N/T，M和N均为正整数，T为正数，当T大于1时，中间显示图像的尺寸比显示图像的尺寸大，当T小于1时，中间显示图像的尺寸比显示图像的尺寸小，也就是说，当中间显示图像和显示图像的尺寸不同时，可以将显示图像等比例扩大或缩小以得到中间显示图像；当T等于1时，中间显示图像的尺寸和显示图像的尺寸相同。
例如，在步骤S302中，根据中间显示图像和显示图像的对应关系、显示图像中初始局部区域的划分方式，对中间显示图像进行划分，以得到中间显示图像的一或多个中间局部区域。例如，在一些实施例中，中间显示图像与显示图像的尺寸相同，即若显示图像的尺寸可以为1080×1200，则中间显示图像的尺寸也可以为1080×1200，从而保证各中间局部区域和各初始局部区域的尺寸分别相同且一一对应。
例如，中间显示图像与显示图像的图像格式也相同，即若显示图像的图像格式为ARGB32，则中间显示图像的图像格式也为ARGB32。
例如，中间显示图像可以包括多个中间像素。在一个示例中，每个中间像素可以包括三个子像素，且该三个子像素分别为红色子像素、绿色子像素和蓝色子像素。本公开对此不作限制，每个中间像素也可以包括四个子像素(例如，红、绿、蓝、白四个子像素)。
需要说明的是，“中间像素”表示中间显示图像中的像素。
例如，在步骤S303中，一或多个初始局部区域分别与一或多个平均亮度值一一对应，一或多个中间局部区域与一或多个中间平均亮度值一一对应，且一或多个中间平均亮度值为一或多个平均亮度值。
例如，在步骤S303中，显示图像的明暗程度可以通过显示图像上各像素 点的亮度信息反映，所以各中间局部区域的亮度信息可以通过获取各中间局部区域中的中间像素的亮度信息得到。例如，步骤S303可以包括：
S3031：获取每个中间局部区域中的各中间像素的中间像素亮度值；以及
S3032：根据每个中间局部区域中的各中间像素的中间像素亮度值，计算每个中间局部区域对应的中间平均亮度值。
需要说明的是，“中间像素亮度值”表示中间像素的亮度值。
例如，在步骤S3031中，可以根据彩色(RGB)和亮度之间的亮度公式计算每个中间像素对应的中间像素亮度值，例如，每个中间像素对应的中间像素亮度值的计算公式可以为：
L＝0.30×r+0.59×g+0.11×b，
其中，r表示该中间像素的红色子像素的灰阶值，g表示该中间像素的绿色子像素的灰阶值，b表示该中间像素的蓝色子像素的灰阶值，L表示该中间像素对应的中间像素亮度值。由于不同颜色的光具有不同的波长，且人眼对颜色的敏感程度不同，人眼对蓝、红子像素的敏感程度低于绿色子像素敏感程度，因此，一个中间像素对应的中间像素亮度值为该中间像素的各子像素的亮度值按不同比例计算得到，从而可以更好地反应该中间像素的视觉上的亮度，提升显示效果。
需要说明的是，每个中间像素的中间像素亮度值的计算公式可以根据该中间像素中各子像素的颜色调整，例如，用户可以通过用户界面编辑中间像素亮度值的计算公式(例如，改变计算公式中的系等)，以根据中间像素的各子像素的颜色调整中间像素亮度值的计算公式。
图2为本公开一实施例提供一种显示图像的示意图，图3为图2所示的显示图像中部分初始局部区域的平均亮度值的计算结果示意图。
例如，图2所示的显示图像的尺寸可以为1080×1200，该显示图像被划分为9×10个初始局部区域。图3示出了9×10个初始局部区域中的30个初始局部区域的平均亮度值。
例如，在渲染引擎中，子像素的灰阶值为归一化的值，也就是说，子像素的灰阶值采用0-1的浮点(float)型数据表示，因此，如图3所示，初始局部区域的平均亮度值也采用0-1的浮点(float)型数据表示。
例如，在一些示例中，步骤S3032可以包括：将每个中间局部区域中的所有中间像素的中间像素亮度值求平均，以得到该中间局部区域对应的中间平均 亮度值。例如，在每个中间局部区域中，计算得到每个中间像素的中间像素亮度值后，可以将该中间局部区域的所有中间像素的中间像素亮度值求平均，以得到该中间局部区域对应的中间平均亮度值。
例如，在另一些示例中，步骤S3032可以包括：选取每个中间局部区中的N个中间像素；将每个中间局部区域中的被选取的N个中间像素的中间像素亮度值求平均，以得到每个中间局部区域对应的中间平均亮度值，其中，N为正整数，且小于对应的中间局部区域中的所有中间像素的数量。例如，可以根据一个中间局部区域中的各中间像素的像素亮度值，在该中间局部区域中选取N个中间像素，并获取被选取的N个中间像素的中间像素亮度值，然后将被选取的N个中间像素的中间像素亮度值求平均，从而得到该中间局部区域的中间平均亮度值。
需要说明的是，在各中间局部区域中，被选取的中间像素的数量、位置等可以根据实际需求确定，各中间局部区域中被选取的中间像素的数量可以相同，也可以不相同。本公开对此不作限制。
例如，在一个示例中，中间局部区域的中间平均亮度值可以为该中间局部区域中的所有中间像素或被选取的中间像素的中间像素亮度值的算术平均值，从而简化计算过程，提高计算速度。因此，在步骤S3032中，每个中间局部区域的中间平均亮度值的计算公式可以为：
Figure PCTCN2018112955-appb-000001
其中，L'表示中间局部区域的中间平均亮度值，L i表示该中间局部区域的第i个中间像素的中间像素亮度值，当中间局部区域的中间平均亮度值为该中间局部区域中的所有中间像素的中间像素亮度值的平均值时，n表示该中间局部区域中的所有中间像素的数量，当中间局部区域的中间平均亮度值为该中间局部区域中的被选取的中间像素的中间像素亮度值的平均值时，n表示该中间局部区域中的被选取的中间像素的数量，i和n均为正整数，且1≤i≤n。
需要说明的是，中间局部区域的中间平均亮度值也可以为该中间局部区域中的所有中间像素或被选取的中间像素的中间像素亮度值的几何平均值、加权平均值等，本公开对此不作限制。
例如，在步骤S3032中，本公开实施例提供的背光亮度处理方法还可以包括对中间像素的中间像素亮度值进行筛选的操作，以去除中间像素亮度值中的 噪声信息，获得更准确的中间平均亮度值。例如，若一个中间像素的中间像素亮度值和相邻的各中间像素的中间像素亮度值的差值的绝对值大于预设阈值，则该中间像素的中间像素亮度值可能属于噪声信息。预设阈值可以根据实际应用情况确定，本公开对此不作限制。
例如，在另一些示例中，当显示图像的Texture类型为Texture2D类型时，步骤S30可以包括：
S311：获取每个初始局部区域中的多个初始像素的初始像素亮度值；
S312：根据每个初始局部区域中的多个初始像素的初始像素亮度值，计算每个初始局部区域对应的平均亮度值。
例如，步骤S312可以包括：将每个初始局部区域中的所有初始像素的初始像素亮度值求平均，以得到每个初始局部区域对应的平均亮度值。或者，步骤S312也可以包括：选取每个初始局部区中的N个初始像素；将每个初始局部区域中的被选取的N个初始像素的初始像素亮度值求平均，以得到每个初始局部区域对应的平均亮度值。例如，N为正整数，且小于对应的初始局部区域中的所有初始像素的数量。
需要说明的是，“初始像素”表示显示图像中的像素，“初始像素亮度值”表示初始像素的亮度值。另外，在本示例中，关于步骤S311和S312中根据初始像素计算得到初始局部区域对应的平均亮度值的操作过程与上面描述的根据中间像素计算得到中间局部区域对应的中间平均亮度值的操作过程类型，重复之处不再赘述。
例如，在每个初始局部区域中，多个初始像素与多个初始像素亮度一一对应，也就是说，一个初始像素对应一个初始像素亮度。
需要说明的是，在本公开中，多个初始局部区域与多个平均亮度值一一对应，即一个初始局部区域仅对应一个平均亮度值。多个中间局部区域与多个中间平均亮度值一一对应，即一个中间局部区域仅对应一个中间平均亮度值。若显示图像包括W个初始局部区域，W个初始局部区域对应W个平均亮度值，且第一个初始局部区域对应第一个平均亮度值，第二个初始局部区域对应第二个平均亮度值，依次类推，第W个初始局部区域对应第W个平均亮度值。类似地，若多个中间局部区域的数量也为W，则第一个中间局部区域对应第一个中间平均亮度值，第二个中间局部区域对应第二个中间平均亮度值，依次类推，第W个中间局部区域对应第W个中间平均亮度值。同样地，多个中间像素和 多个中间像素亮度值的对应关系、多个初始像素和多个初始像素亮度值的对应关系也与上述多个初始局部区域和多个平均亮度值的对应关系相似，在此不再赘述。
例如，步骤S40可以包括以下步骤：
S401：根据一或多个初始局部区域的数量，创建亮度像素图像；
S402：将各初始局部区域的平均亮度值分别存储在亮度像素图像中；
S403：合成亮度像素图像和显示图像，以得到输出图像。
例如，在步骤S401中，亮度像素图像的Texture类型可以为Texture2D类型。
例如，亮度像素图像可以包括一或多个亮度像素，该一或多个亮度像素可以排列为一行多列、多行一列或多行多列等。本公开对此不作限制。需要说明的是，“亮度像素”表示亮度像素图像中的像素。
例如，亮度像素图像中的亮度像素的数量可以小于初始局部区域的数量；或者，亮度像素图像中的亮度像素的数量可以与初始局部区域的数量相等。
例如，步骤S402可以包括：将一或多个平均亮度值依次填充到一或多个亮度像素中。
例如，每个亮度像素的各子像素可以存储同一个初始局部区域的平均亮度值，从而亮度像素图像中的亮度像素的数量可以与初始局部区域的数量相等。又例如，每个亮度像素的各子像素可以分别存储不同初始局部区域的平均亮度值，从而亮度像素图像中的亮度像素的数量可以小于初始局部区域的数量。
例如，在一个示例中，当亮度像素图像中的亮度像素的数量小于初始局部区域的数量时，将一或多个平均亮度值依次填充到一或多个亮度像素中，包括：将一或多个平均亮度值分别作为各亮度像素的子像素的灰阶值，并依次填充到一或多个亮度像素的各子像素中。
例如，若亮度像素包括三个子像素，则每个亮度像素可以包含三个初始局部区域的平均亮度值，从而缩小亮度像素图像的尺寸。例如，当显示图像被划分为9×10个初始局部区域时，初始局部区域的平均亮度值的数量为90，则亮度像素图像中的亮度像素的数量可以为30。
图4为本公开一实施例提供的一种亮度像素图像的示意图。
例如，在一个示例中，如图4所示，亮度像素图像中的亮度像素排列为一行多列。每个亮度像素包括三个子像素(例如，红色子像素、蓝色子像素和绿 色子像素)。图4示出了亮度像素图像中的两个亮度像素，分别为第一亮度像素11和第二亮度像素12。
例如，图4示出了6个初始局部区域的平均亮度值，第一初始局部区域P1的平均亮度值为0.8627，第二初始局部区域P2的平均亮度值为0.8627，第三初始局部区域P3的平均亮度值为0.8667，第四初始局部区域P4的平均亮度值为0.4078，第五初始局部区域P5的平均亮度值为0.3804，第六初始局部区域P6的平均亮度值为0.3804。
例如，如图4所示，第一初始局部区域P1的平均亮度值、第二初始局部区域P2的平均亮度值、第三初始局部区域P3的平均亮度值分别填充到第一亮度像素11的三个子像素中，第四初始局部区域P4的平均亮度值、第五初始局部区域P5的平均亮度值、第六初始局部区域P6的平均亮度值分别填充到第二亮度像素12的三个子像素中。
例如，在步骤S402中，首先，将多个初始局部区域对应的多个平均亮度值转换为子像素的灰阶值，然后，填充到子像素中。
例如，在步骤S402中，对于8位色(8bit)的显示器(也就是说，每个颜色用8bit位表示)，子像素的灰阶值的等级范围为0-255。如图4所示，在8bit的显示器中，第一初始局部区域P1的平均亮度值为0.8627，则第一亮度像素11的一个子像素的灰阶值为0.8627×255≈220。其余子像素的灰阶值的计算过程与上述计算过程类似。由此，如图4所示，第一亮度像素11中各子像素的灰阶值分别为220、220、221；第二亮度像素12中各子像的灰阶值分别为104、97、97。
需要说明的是，上述计算子像素的灰阶值的过程中，由于子像素的灰阶值为整数，因此，当计算得到的灰阶值是非整数时，则取与该非整数最邻近的整数作为子像素的灰阶值。
例如，在一个示例中，当显示图像的texture类型为render texture类型时，步骤S403可以包括以下步骤：
S4031：转换显示图像的纹理类型，以得到中间显示图像，中间显示图像的纹理类型为二维纹理类型；
S4032：获取中间显示图像的中间合成区域；
S4033：将亮度像素图像覆盖在中间合成区域上，以得到输出图像。
需要说明的是，在上述的步骤S301中，已经根据显示图像得到中间显示 图像，且该中间显示图像存储在CPU中，因此，在步骤S4031中，可以直接获取存储在CPU中的中间显示图像。当中间显示图像未被存储在CPU中，则在步骤S4031中，可以再次执行将显示图像转换为中间显示图像的步骤，即执行转换显示图像的纹理类型，以得到中间显示图像的步骤。
例如，中间合成区域的尺寸与亮度像素图像的尺寸可以相同。但不限于此，中间合成区域的尺寸也可以大于亮度像素图像的尺寸。
例如，在一个示例中，将亮度像素图像覆盖在中间显示图像的中间合成区域上，以得到输出图像可以包括：将亮度像素图像放置在第一图层；将中间显示图像放置在第二图层，第一图层位于第二图层上方；将亮度像素图像和中间显示图像的中间合成区域对齐；合成第一图层和第二图层以得到输出图像。又例如，将亮度像素图像覆盖在中间显示图像的中间合成区域上以得到输出图像可以包括：使用亮度像素图像替换中间显示图像的中间合成区域，例如将中间显示图像的中间合成区域内的各像素的灰阶值替换为亮度像素图像的对应亮度像素的灰阶值，以得到输出图像。
需要说明的是，亮度像素图像和中间显示图像均为渲染后的图像，且亮度像素图像和中间显示图像均存储在CPU中。
例如，在步骤S403中，在得到输出图像(此时，输出图像可以存储在CPU中)后，可以将输出图像采样到GPU中，并在GPU中存储该输出图像以备后续操作。
图5为本公开一实施例提供的一种输出图像的示意图。
例如，中间合成区域可以位于中间显示图像的边缘区域，例如，右下角。但不限于此，根据实际情况，中间合成区域可以位于中间显示图像的其他区域，例如左下角等。对于中间显示图像，亮度像素图像的尺寸较小，亮度像素图像所占用的中间合成区域的面积也较小，且亮度像素图像覆盖在中间显示图像的边缘区域，因此，在实际应用中，亮度像素图像不会影响显示效果。
例如，中间显示图像包括多个中间像素，输出图像包括多个输出像素。如图5所示，输出图像30可以包括第一区域31和第二区域32，第一区域31与中间显示图像的中间合成区域相对应。当中间合成区域位于中间显示图像的右下角时，则第一区域31也位于输出图像30的右下角。第一区域31中至少部分输出像素的值和亮度像素图像的各亮度像素20的值相同。若中间合成区域的尺寸与亮度像素图像的尺寸相同，则第一区域31中各输出像素的值分别与 亮度像素图像的各亮度像素20的值一一对应且相同。第二区域32中各输出像素的值则与中间显示图像中对应位置的各中间像素的值相同。
需要说明的是，“各像素的值”表示各像素中的各子像素的灰阶值。“输出像素”表示输出图像中的像素。
例如，输出图像的尺寸和中间显示图像的尺寸相同。
例如，在一些实施例中，背光亮度处理方法还包括输出所述输出图像。在输出所述输出图像的操作中，输出图像包括中间显示图像中的部分中间像素的值和像素亮度图像中的全部亮度像素的值。因此，本公开实施例提供的背光亮度处理方法可以将局部背光亮度的计算结果和原始的显示图像一并传输至硬件设备(例如，显示器等)。
例如，在另一些示例中，当显示图像的Texture类型为Texture2D类型时，步骤S403可以包括以下步骤：获取显示图像的初始合成区域；将亮度像素图像覆盖在初始合成区域上，以得到输出图像。
例如，初始合成区域的尺寸与亮度像素图像的尺寸相同，输出图像的尺寸和显示图像的尺寸相同。
需要说明的是，在不冲突的情况下，将亮度像素图像覆盖在初始合成区域上以得到输出图像的具体操作可以参考上述将所述亮度像素图像覆盖在中间合成区域上以得到输出图像的操作，重复之处在此不再赘述。
本公开一实施例还提供一种背光亮度调节方法。图6为本公开一实施例提供的一种背光亮度调节方法的示意性流程图。背光亮度调节方法可以包括上述任一实施例所述的背光亮度处理方法。在一个示例中，如图6所示，背光亮度调节方法可以包括以下步骤：
S60：获取显示图像；
S61：划分显示图像，以得到一或多个初始局部区域；
S62：分别计算各初始局部区域的平均亮度值；
S63：根据各初始局部区域的平均亮度值和显示图像，得到输出图像；以及
S64：将输出图像输出至显示器；
S65：通过显示器处理输出图像，以得到各初始局部区域的平均亮度值；
S66：根据各初始局部区域的平均亮度值调节显示器的背光亮度；
S67：显示输出图像。
例如，上述步骤S60-S64均在渲染引擎中实现，步骤S65-S67则在显示器中实现。由此，本公开实施例提供的背光亮度调节方法可以在渲染引擎端实现局部背光亮度的计算，接着将局部背光亮度的计算结果和原始的显示图像一并传输至显示器端，然后显示器根据局部背光亮度的计算结果调节背光亮度，从而降低功耗，提高对比度，实现图像的实时采样和传输，满足虚拟现实技术中实时处理大量数据的要求。例如，根据各局部区域的局部背光亮度的计算结果，显示器可以调节各局部区域的背光亮度，以使各局部区域的背光亮度与各局部区域的局部背光亮度的计算结果相同。
例如，在背光亮度调节方法中，在渲染引擎中执行的各步骤S60-S64的详细说明可以参考上述实施例中关于背光亮度处理方法的描述。例如，步骤S60的详细说明可以参考上述步骤S10的描述，步骤S61的详细说明可以参考上述步骤S20的描述，步骤S62的详细说明可以参考上述步骤S30的描述，步骤S63的详细说明可以参考上述步骤S40的描述。
例如，显示器可以为虚拟现实(VR)显示器或增强现实(AR)显示器等，即该背光亮度调节方法可以应用于VR或AR中，以降低功耗、提高显示画面的对比度。
例如，显示器可以为液晶显示器等。在步骤S65中，显示器可以提取输出图像中与各亮度像素对应的输出像素的值，将与各亮度像素对应的输出像素的值转换为各初始局部区域的平均亮度值。
例如，步骤S66可以包括：根据各初始局部区域的平均亮度值，计算得到各初始局部区域的背光亮度；根据各初始局部区域的背光亮度确定并调节显示器的背光亮度。与各初始局部区域对应的显示器的背光亮度和计算得到的各初始局部区域的背光亮度相同。
例如，显示器可以包括显示面板和背光源。该背光源可以为直下式背光源且为动态背光源。背光源可以与整个显示面板相对应，从而显示面板的像素中的所有子像素的背光亮度都可以被调节。
例如，背光源可以包括发光单元阵列，该发光单元阵列包括多个排列为阵列的发光单元，例如这些发光单元包括红光单元(R)、绿光单元(G)和蓝光单元(B)，它们组合在一起以发出白光。这些发光单元可以为发光二极管(LED)，例如无机LED或有机LED。这些发光单元例如可以至少部分被单独控制。
本公开一实施例还提供一种背光亮度处理系统。图7为本公开一实施例提供的一种背光亮度处理系统的示意性框图。例如，如图7所示，背光亮度处理系统200包括图像获取装置201、存储器202和处理器203。应当注意，图7所示的背光亮度处理系统的组件只是示例性的，而非限制性的，根据实际应用需要，该背光亮度处理系统还可以具有其他组件。
例如，图像获取装置201被配置为获取显示图像；存储器202被配置为存储非暂时性计算机可读指令；处理器203被配置为运行所述非暂时性计算机可读指令。例如，所述处理器203运行非暂时性计算机可读指令时执行上述任一实施例所述的背光亮度处理方法中的一个或多个步骤。
例如，图像获取装置201、存储器202和处理器203等可以设置在主机端。
例如，图像获取装置201、存储器202和处理器203之间可以通过总线系统和/或其它形式的连接机构(未示出)互连。
例如，图像获取装置201、存储器202和处理器203等组件之间可以直接或间接地互相通信。
例如，图像获取装置201可以为数码相机、智能手机的摄像头、平板电脑的摄像头、个人计算机的摄像头、或者甚至可以是网络摄像头，从而显示图像可以为通过图像获取装置201对当前场景进行采样得到的图像。例如，图像获取装置201也可以包括各种具有数据读取能力的软件和/或硬件，从而显示图像可以通过图像获取装置201直接读取内存中存储的图像得到。
例如，处理器203可以是中央处理单元(CPU)或者具有数据处理能力和/或程序执行能力的其它形式的处理单元，例如现场可编程门阵列(FPGA)或张量处理单元(TPU)等，处理器203可以控制背光亮度处理系统中的其它组件以执行期望的功能。又例如，中央处理器(CPU)可以为X86或ARM架构等。
例如，存储器202可以包括一个或多个计算机程序产品的任意组合，计算机程序产品可以包括各种形式的计算机可读存储介质，例如易失性存储器和/或非易失性存储器。易失性存储器例如可以包括随机存取存储器(RAM)和/或高速缓冲存储器(cache)等。非易失性存储器例如可以包括只读存储器(ROM)、硬盘、可擦除可编程只读存储器(EPROM)、便携式紧致盘只读存储器(CD-ROM)、USB存储器、闪存等。在存储器202上可以存储一个或多个计算机指令，处理器203可以运行所述计算机指令，以实现各种功能。在计算机 可读存储介质中还可以存储各种应用程序和各种数据以及应用程序使用和/或产生的各种数据等。
需要说明的是，关于通过背光亮度处理系统200进行计算显示图像上各局部区域的平均亮度值的详细说明可以参考背光亮度处理方法的实施例中的相关描述，重复之处不再赘述。
例如，在一些实施例中，根据实际需求，该背光亮度处理系统还可以包括显示器等。显示器可以被配置为：处理输出图像，以得到各初始局部区域的平均亮度值；根据各初始局部区域的平均亮度值调节显示器的背光亮度；显示输出图像。
需要说明的是，关于显示器的详细说明可以参考上述背光亮度调节方法的实施例中的相关描述，重复之处不再赘述。
本公开一实施例还提供一种计算机可读存储介质。例如，该计算机可读存储介质可以用于存储非暂时性计算机可读指令。在计算机可读存储介质上可以存储一个或多个非暂时性计算机可读指令。例如，当计算机执行所述非暂时性计算机可读指令时可以执行上述任一实施例所述的背光亮度处理方法中的一个或多个步骤。
例如，该计算机可读存储介质可以应用于上述背光亮度处理系统中。例如，计算机可读存储介质可以为图7所示的实施例中的背光亮度处理系统200的存储器202。
例如，关于计算机可读存储介质的说明可以参考图7所示的背光亮度处理系统200的实施例中对于存储器202的描述，重复之处不再赘述。
对于本公开，还有以下几点需要说明：
(1)本公开实施例附图只涉及到与本公开实施例涉及到的结构，其他结构可参考通常设计。
(2)在不冲突的情况下，本公开的实施例及实施例中的特征可以相互组合以得到新的实施例。
以上所述仅为本公开的具体实施方式，但本公开的保护范围并不局限于此，本公开的保护范围应以所述权利要求的保护范围为准。

Claims (19)

  1. 一种背光亮度处理方法，包括：
    获取显示图像；
    划分所述显示图像，以得到一或多个初始局部区域；
    分别计算各所述初始局部区域的平均亮度值；
    根据各所述初始局部区域的平均亮度值和所述显示图像，得到输出图像。
  2. 根据权利要求2所述的背光亮度处理方法，其中，根据各所述初始局部区域的平均亮度值和所述显示图像，得到输出图像，包括：
    根据所述一或多个初始局部区域的数量，创建亮度像素图像；
    将各所述初始局部区域的平均亮度值分别存储在所述亮度像素图像中；
    合成所述亮度像素图像和所述显示图像，以得到所述输出图像。
  3. 根据权利要求2所述的背光亮度处理方法，其中，所述显示图像的纹理类型为渲染纹理类型，
    合成所述亮度像素图像和所述显示图像，以得到所述输出图像，包括：
    转换所述显示图像的纹理类型，以得到中间显示图像，所述中间显示图像的纹理类型为二维纹理类型；
    获取所述中间显示图像的中间合成区域；
    将所述亮度像素图像覆盖在所述中间合成区域上，以得到所述输出图像。
  4. 根据权利要求3所述的背光亮度处理方法，其中，所述中间合成区域的尺寸与所述亮度像素图像的尺寸相同。
  5. 根据权利要求2所述的背光亮度处理方法，其中，所述显示图像的纹理类型为二维纹理类型，
    合成所述亮度像素图像和所述显示图像，以得到所述输出图像，包括：
    获取所述显示图像的初始合成区域；
    将所述亮度像素图像覆盖在所述初始合成区域上，以得到所述输出图像。
  6. 根据权利要求5所述的背光亮度处理方法，其中，所述初始合成区域的尺寸与所述亮度像素图像的尺寸相同。
  7. 根据权利要求2-6任一项所述的背光亮度处理方法，其中，所述亮度像素图像包括一或多个亮度像素，
    将所述一或多个平均亮度值分别存储在所述亮度像素图像中，包括：
    将所述一或多个平均亮度值依次填充到所述一或多个亮度像素中。
  8. 根据权利要求8所述的背光亮度处理方法，其中，将所述一或多个平均亮度值依次填充到所述亮度像素中，包括：
    将所述一或多个平均亮度值分别作为所述一或多个亮度像素的各子像素的灰阶值，并依次填充到所述一或多个亮度像素的各子像素中。
  9. 根据权利要求1或2所述的背光亮度处理方法，其中，所述显示图像的纹理类型为渲染纹理类型，
    分别计算各所述初始局部区域的平均亮度值，包括：
    转换所述显示图像的纹理类型，以得到中间显示图像，所述中间显示图像的纹理类型为二维纹理类型；
    根据所述显示图像和所述一或多个初始局部区域，划分所述中间显示图像，以得到所述中间显示图像的一或多个中间局部区域，所述一或多个初始局部区域与所述一或多个中间局部区域一一对应；
    分别计算各所述中间局部区域的中间平均亮度值，各所述中间局部区域的中间平均亮度值为各所述初始局部区域的平均亮度值。
  10. 根据权利要求9所述的背光亮度处理方法，其中，所述中间显示图像包括多个中间像素，
    分别计算各所述中间局部区域的中间平均亮度值，包括：
    获取每个中间局部区域中的各中间像素的中间像素亮度值；
    根据所述每个中间局部区域中的所述各中间像素的中间像素亮度值，计算所述每个中间局部区域对应的中间平均亮度值。
  11. 根据权利要求10所述的背光亮度处理方法，其中，每个中间像素包括红色子像素、绿色子像素和蓝色子像素，
    所述每个中间像素对应的中间像素亮度值的计算公式为：
    L＝0.30×r+0.59×g+0.11×b，
    其中，r表示所述每个中间像素的红色子像素的灰阶值，g表示所述每个中间像素的绿色子像素的灰阶值，b表示所述每个中间像素的蓝色子像素的灰阶值，L表示所述每个中间像素对应的中间像素亮度值。
  12. 根据权利要求10或11所述的背光亮度处理方法，其中，根据所述每个中间局部区域中的所述各中间像素的中间像素亮度值，计算所述每个中间局部区域对应的中间平均亮度值，包括：
    将所述每个中间局部区域中的所有中间像素的中间像素亮度值求平均，以得到所述每个中间局部区域对应的中间平均亮度值；或者
    选取所述每个中间局部区中的N个中间像素，
    将所述每个中间局部区域中的被选取的所述N个中间像素的中间像素亮度值求平均，以得到所述每个中间局部区域对应的中间平均亮度值，其中，N为正整数，且小于所述每个中间局部区域中的所有中间像素的数量。
  13. 根据权利要求1或2所述的背光亮度处理方法，其中，所述显示图像的纹理类型为二维纹理类型，
    分别计算各所述初始局部区域的平均亮度值，包括：
    获取所述每个初始局部区域中的多个初始像素的初始像素亮度值；
    根据所述每个初始局部区域中的所述多个初始像素的初始像素亮度值，计算所述每个初始局部区域对应的平均亮度值。
  14. 根据权利要求13所述的背光亮度处理方法，其中，根据所述每个初始局部区域中的所述多个初始像素的初始像素亮度值，计算所述每个初始局部区域对应的平均亮度值，包括：
    将所述每个初始局部区域中的所有初始像素的初始像素亮度值求平均，以得到所述每个初始局部区域对应的平均亮度值；或者
    选取所述每个初始局部区中的N个初始像素，
    将所述每个初始局部区域中的被选取的所述N个初始像素的初始像素亮度值求平均，以得到所述每个初始局部区域对应的平均亮度值，其中，N为正整数，且小于所述每个初始局部区域中的所有初始像素的数量。
  15. 根据权利要求1-14任一项所述的背光亮度处理方法，其中，所述一或多个初始局部区域中的每个的尺寸是可变化的。
  16. 一种背光亮度调节方法，包括：
    在渲染引擎中：
    执行根据权利要求1-15任一项所述的背光亮度处理方法；以及
    在显示器中：
    通过所述显示器处理所述输出图像，以得到各所述初始局部区域的平均亮度值；
    根据各所述初始局部区域的平均亮度值调节所述显示器的背光亮度；以及
    显示所述输出图像。
  17. 根据权利要求16所述的背光亮度调节方法，其中，所述显示器为虚拟现实显示器或增强现实显示器。
  18. 一种背光亮度处理系统，包括：
    图像获取装置，被配置为获取显示图像；
    存储器，被配置为存储非暂时性计算机可读指令；以及
    处理器，被配置为运行所述非暂时性计算机可读指令，其中，所述非暂时性计算机可读指令被所述处理器运行时执行根据权利要求1-15任一项所述的背光亮度处理方法。
  19. 一种计算机可读存储介质，用于存储非暂时性计算机可读指令，当所述非暂时性计算机可读指令由计算机执行时执行根据权利要求1-15任一项所述的背光亮度处理方法。
PCT/CN2018/112955 2018-03-19 2018-10-31 背光亮度处理方法及系统、背光亮度调节方法、存储介质 WO2019179106A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/473,804 US11398195B2 (en) 2018-03-19 2018-10-31 Backlight brightness processing method and system, backlight brightness adjustment method, storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810225834.0A CN108389552B (zh) 2018-03-19 2018-03-19 背光亮度处理方法及系统、背光亮度调节方法、存储介质
CN201810225834.0 2018-03-19

Publications (1)

Publication Number Publication Date
WO2019179106A1 true WO2019179106A1 (zh) 2019-09-26

Family

ID=63067644

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/112955 WO2019179106A1 (zh) 2018-03-19 2018-10-31 背光亮度处理方法及系统、背光亮度调节方法、存储介质

Country Status (3)

Country Link
US (1) US11398195B2 (zh)
CN (1) CN108389552B (zh)
WO (1) WO2019179106A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114927109A (zh) * 2022-06-24 2022-08-19 深圳万橙物联科技有限公司 背光源控制方法、装置、显示设备及存储介质

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108389552B (zh) * 2018-03-19 2019-08-27 京东方科技集团股份有限公司 背光亮度处理方法及系统、背光亮度调节方法、存储介质
CN110070842B (zh) 2019-04-02 2021-03-12 Oppo广东移动通信有限公司 显示亮度调整方法及相关设备
CN110322823B (zh) * 2019-05-09 2023-02-17 京东方科技集团股份有限公司 显示基板、亮度检测方法及其装置、以及显示装置
CN111161685B (zh) * 2020-02-28 2022-02-01 京东方科技集团股份有限公司 一种虚拟现实显示设备及其控制方法
CN112565915B (zh) * 2020-06-04 2023-05-05 海信视像科技股份有限公司 显示设备和显示方法
CN112700751B (zh) * 2020-12-30 2022-08-19 联想(北京)有限公司 一种显示方法及电子设备
CN113823233A (zh) * 2021-09-30 2021-12-21 深圳市华星光电半导体显示技术有限公司 显示装置及其控制方法
US11710462B1 (en) * 2022-03-21 2023-07-25 Himax Technologies Limited Display device with backlight and method thereof

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013218215A (ja) * 2012-04-11 2013-10-24 Sharp Corp 表示装置、表示装置の制御方法、テレビジョン受像機、制御プログラム、および記録媒体
CN103996382A (zh) * 2014-05-07 2014-08-20 成都京东方光电科技有限公司 提高rgbw图像饱和度的方法及系统
CN105047145A (zh) * 2015-09-14 2015-11-11 青岛海信电器股份有限公司 背光亮度控制方法、背光亮度控制装置及显示终端
CN105513543A (zh) * 2016-01-28 2016-04-20 贵阳海信电子有限公司 基于大屏lcm的图像处理方法及装置
CN107103886A (zh) * 2017-06-08 2017-08-29 武汉华星光电技术有限公司 一种动态背光控制显示方法及装置
CN108389552A (zh) * 2018-03-19 2018-08-10 京东方科技集团股份有限公司 背光亮度处理方法及系统、背光亮度调节方法、存储介质

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7683964B2 (en) * 2005-09-05 2010-03-23 Sony Corporation Image capturing apparatus and image capturing method
US8031166B2 (en) * 2007-11-06 2011-10-04 Hisense Beijing Electric Co., Ltd. Liquid crystal display method and the appratus thereof
US11551602B2 (en) * 2016-09-01 2023-01-10 Innovega Inc. Non-uniform resolution, large field-of-view headworn display
US10475395B2 (en) 2017-06-08 2019-11-12 Wuhan China Star Optoelectronics Technology Co., Ltd Display method and device of dynamically controlling backlight

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013218215A (ja) * 2012-04-11 2013-10-24 Sharp Corp 表示装置、表示装置の制御方法、テレビジョン受像機、制御プログラム、および記録媒体
CN103996382A (zh) * 2014-05-07 2014-08-20 成都京东方光电科技有限公司 提高rgbw图像饱和度的方法及系统
CN105047145A (zh) * 2015-09-14 2015-11-11 青岛海信电器股份有限公司 背光亮度控制方法、背光亮度控制装置及显示终端
CN105513543A (zh) * 2016-01-28 2016-04-20 贵阳海信电子有限公司 基于大屏lcm的图像处理方法及装置
CN107103886A (zh) * 2017-06-08 2017-08-29 武汉华星光电技术有限公司 一种动态背光控制显示方法及装置
CN108389552A (zh) * 2018-03-19 2018-08-10 京东方科技集团股份有限公司 背光亮度处理方法及系统、背光亮度调节方法、存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PENG, BO: "Research of Dynamic LED Backlight Algorithm for Large-scale LCD", CHINESE MASTER S THESES FULL-TEXT DATABASE, INFORMATION SCIENCE & TECHNOLOGY, 15 June 2014 (2014-06-15), ISSN: 1074-0246 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114927109A (zh) * 2022-06-24 2022-08-19 深圳万橙物联科技有限公司 背光源控制方法、装置、显示设备及存储介质
CN114927109B (zh) * 2022-06-24 2023-11-21 深圳万橙物联科技有限公司 背光源控制方法、装置、显示设备及存储介质

Also Published As

Publication number Publication date
CN108389552B (zh) 2019-08-27
CN108389552A (zh) 2018-08-10
US20210358427A1 (en) 2021-11-18
US11398195B2 (en) 2022-07-26

Similar Documents

Publication Publication Date Title
WO2019179106A1 (zh) 背光亮度处理方法及系统、背光亮度调节方法、存储介质
CN110914891B (zh) 显示基板及其驱动方法和显示装置
US11120726B2 (en) Method and device for driving display panel, and display apparatus
US11037523B2 (en) Display method of display panel that uses different display algorithms for different display areas, display panel and display device
CN101630498B (zh) 显示装置、驱动用的集成电路、其驱动方法及信号处理方法
TWI479469B (zh) 背光單元及方法
US10176745B2 (en) Data conversion unit and method
JP5735100B2 (ja) 表示装置、及び表示方法
WO2020224387A1 (zh) 驱动方法、驱动装置、显示设备和计算机可读介质
CN108962167B (zh) 数据处理方法及装置、驱动方法、显示面板和存储介质
US10825408B2 (en) Display driving method, device and apparatus
WO2021233010A1 (zh) 显示屏及电子设备
US9460675B2 (en) Display device having signal processing circuits, electronic apparatus having display device, driving method of display device, and signal processing method
US11508286B2 (en) Method for driving a display panel, display driving device and electronic device
JP2010033009A (ja) 画像表示装置及びその駆動方法、並びに、画像表示装置組立体及びその駆動方法
JP6315931B2 (ja) 有機発光ダイオードディスプレイの動作を制御する、ＳｏＣ、モバイルアプリケーションプロセッサ、及び携帯用電子装置
WO2020094006A1 (zh) 显示设备及其驱动方法、驱动装置和计算机可读介质
CN111785224B (zh) 一种亮度驱动方法
US20110069078A1 (en) Method, system or apparatus for adjusting a brightness level associated with at least a portion of a backlight of a display device
WO2020200015A1 (zh) 一种对比度提升算法及双面板显示装置
CN113795879A (zh) 用于确定显示面板中灰度映射相关性的方法及系统
CN106531101A (zh) 显示面板及具有该显示面板的显示装置
KR20180077268A (ko) 자발광 어레이 표시 제어 방법, 장치, 및 디바이스
JP2012226178A (ja) 表示制御装置、表示システム、画像データ出力方法、プログラム、及び記録媒体
TWI424416B (zh) 顯示裝置及其驅動方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18911007

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 29.01.2021)

122 Ep: pct application non-entry in european phase

Ref document number: 18911007

Country of ref document: EP

Kind code of ref document: A1