WO2025201159A1 - 图像处理装置、方法和电子设备 - Google Patents

图像处理装置、方法和电子设备

Info

Publication number
WO2025201159A1
WO2025201159A1 PCT/CN2025/083691 CN2025083691W WO2025201159A1 WO 2025201159 A1 WO2025201159 A1 WO 2025201159A1 CN 2025083691 W CN2025083691 W CN 2025083691W WO 2025201159 A1 WO2025201159 A1 WO 2025201159A1
Authority
WO
WIPO (PCT)
Prior art keywords
brightness
backlight brightness
image data
chip
target backlight
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2025/083691
Other languages
English (en)
French (fr)
Inventor
曹凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Publication of WO2025201159A1 publication Critical patent/WO2025201159A1/zh
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/22Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
    • G09G3/30Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
    • G09G3/32Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
    • G09G3/3208Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406Control of illumination source
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/57Control of contrast or brightness
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/06Adjustment of display parameters
    • G09G2320/0626Adjustment of display parameters for control of overall brightness

Definitions

  • Standard Dynamic Range (SDR) video is produced based on SDR technical standards
  • High Dynamic Range (HDR) video is produced based on HDR technical standards. Because HDR technology produces and displays images with a wider range of colors and brightness, HDR video offers superior image quality and visual effects compared to SDR video.
  • the system-level chip is used to determine the initial backlight brightness, target backlight brightness and brightness threshold of the screen, send the initial backlight brightness and the brightness threshold to the independent display chip for initialization, and send the image data to be processed and the target backlight brightness to the independent display chip when it is determined that the independent display chip has completed initialization;
  • the display panel is configured to display the adjusted image data based on the target backlight brightness.
  • the image data to be processed and the target backlight brightness are sent to the independent display chip, the initial backlight brightness, the target backlight brightness and the brightness threshold are used by the independent display chip to adjust the pixel value of the image data, and the adjusted image data and the target backlight brightness are sent to the display panel, and the display panel displays the adjusted image data based on the target backlight brightness.
  • an embodiment of the present application provides an image processing method, comprising:
  • the display brightness of the pixel when processing an image, since the pixel value of the image data can be adjusted according to the initial backlight brightness, target backlight brightness and brightness threshold of the screen, the display brightness of the pixel can be adjusted. Since the initial backlight brightness of the screen can be increased to the target backlight brightness, the backlight brightness of the screen can be increased. Since the display brightness of the pixel and the backlight brightness of the screen are related to the contrast of the image, by adjusting the display brightness of the pixel in the image and increasing the backlight brightness of the screen, the contrast of the image can be greatly improved, further improving the visual effect of the image. In addition, since the image format conversion is not involved when processing the image, when displaying the processed image, there is no need for the terminal device to support the corresponding technical standards, thereby avoiding restrictions on the terminal device and having a wider range of applications.
  • FIG1 is a schematic structural diagram of an image processing device according to an embodiment of the present application.
  • FIG2 is a schematic diagram of an image processing apparatus according to an embodiment of the present application processing image data in an SDR video;
  • FIG3 is a schematic diagram of an image processing apparatus according to an embodiment of the present application processing image data in an SDR video;
  • FIG4 is a flow chart of an image processing method according to an embodiment of the present application.
  • FIG5 is a flow chart of an image processing method according to an embodiment of the present application.
  • FIG6 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • FIG7 is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application.
  • FIG1 is a schematic structural diagram of an image processing device 10 according to an embodiment of the present application.
  • the image processing device 10 includes a system-on-chip 11, an independent display chip 12, and a display panel 13.
  • the system-on-chip 11 is used to determine the initial backlight brightness, target backlight brightness, and brightness threshold of the screen, and send the initial backlight brightness and brightness threshold to the independent display chip 12 for initialization.
  • the image data to be processed and the target backlight brightness are sent to the independent display chip 12.
  • the independent display chip 12 is used to initialize according to the initial backlight brightness and brightness threshold.
  • the pixel values of the image data to be processed are adjusted according to the initial backlight brightness, target backlight brightness, and brightness threshold, and the adjusted image data and target backlight brightness are sent to the display panel 13.
  • the display panel 13 is used to display the adjusted image data based on the target backlight brightness.
  • the SDR2HDR function may be enabled automatically by the terminal device. For example, after a user opens a game application in the terminal device, the terminal device may recognize that the current scene is a game scene, and the game screen (which can be considered an SDR video) generally has higher image quality requirements. In this case, the terminal device may enable the SDR2HDR function automatically.
  • the system-level chip 11 can send these parameters and the image data to be processed to the independent display chip 12.
  • the sending can be carried out in steps. Specifically, when the image data to be processed is a single frame of image data, the system-level chip 11 can first send the initial backlight brightness and brightness threshold to the independent display chip 12 for initialization. When it is determined that the independent display chip 12 has completed initialization, the image data to be processed and the target backlight brightness are sent to the independent display chip 12. When the image data to be processed is multiple frames of image data, the system-level chip 11 can first send the initial backlight brightness and brightness threshold to the independent display chip 12 for initialization.
  • the first frame of image data to be processed and the target backlight brightness corresponding to the frame of image data are sent to the independent display chip 12. Then, the second frame of image data to be processed and the target backlight brightness corresponding to the frame of image data are sent to the independent display chip 12. And so on and so forth, until the last frame of image data to be processed and the target backlight brightness corresponding to the frame of image data are sent to the independent display chip 12.
  • the system-level chip 11 can also send the screen's initial backlight brightness, target backlight brightness, brightness threshold, and the first frame of image data to be processed (if the image data to be processed is a frame of image data, then the first frame of image data here is the frame of image data to be processed) to the independent display chip 12, and then the independent display chip 12 will initialize and process the first frame of image data in a relatively short time.
  • the screen's initial backlight brightness, target backlight brightness, brightness threshold, and image data to be processed can be sent in steps.
  • the microcontroller unit (MCU) in the independent display chip 12 can optionally initialize the image processing module in the independent display chip 12 (specifically, the module in the independent display chip 12 for adjusting the pixel values of the image data) based on the initial backlight brightness and brightness threshold. If the image data to be processed is image data in an SDR video, the image processing module in the independent display chip 12 can be an SDR2HDR module.
  • the independent display chip 12 can send a notification message to the system-on-chip 11, notifying the system-on-chip 11 that the independent display chip 12 has completed initialization. The system-on-chip 12 can confirm whether the independent display chip 12 has completed initialization based on the received notification message.
  • the independent display chip 12 can be initialized before processing the image data to be processed, when the independent display chip 12 adjusts the pixel values of the image data to be processed, it can do so based on the initial backlight brightness and brightness threshold during initialization, thus avoiding errors.
  • the display brightness of the pixel can be adjusted. Since the initial backlight brightness of the screen can be increased to the target backlight brightness, the backlight brightness of the screen can be increased. Since the display brightness of the pixel and the backlight brightness of the screen are related to the contrast of the image, by adjusting the display brightness of the pixels in the image and increasing the backlight brightness of the screen, the contrast of the image can be greatly increased, further improving the visual effect of the image.
  • the image data to be processed when the image data to be processed is multiple consecutive frames of image data from the same video, the image data to be processed may include first image data corresponding to transition frames and second image data corresponding to non-transition frames.
  • a transition frame may be a video frame corresponding to the transition from the initial backlight brightness to the target backlight brightness to be increased. The purpose of a transition frame is to avoid video flickering caused by a significant difference in backlight brightness between two adjacent frames when increasing the screen backlight brightness.
  • a non-transition frame is a video frame displayed after the initial backlight brightness is increased to the target backlight brightness.
  • the system-on-chip is configured to send the to-be-processed image data and the target backlight brightness to the independent display chip, and may include:
  • the first image data includes N frames
  • the second image data includes M frames (both N and M are integers greater than 0). Then, when the system-level chip sends the image data and the corresponding target backlight brightness to the independent display chip, it can first send the first frame of first image data and the corresponding first target backlight brightness to the independent display chip, and then send the second frame of first image data and the corresponding first target backlight brightness to the independent display chip, ...
  • the system-level chip is further configured to:
  • the first target backlight brightness is determined according to the number of transition frames, the initial backlight brightness, and the second target backlight brightness.
  • the system-on-chip is further configured to enable the display panel's high brightness mode (HBM).
  • HBM high brightness mode
  • the preset backlight brightness can be the maximum backlight brightness that the screen allows users to adjust.
  • the high brightness mode is not enabled, the backlight brightness can be increased to the preset backlight brightness.
  • the high brightness mode is enabled, a greater brightness increase can be achieved. Therefore, when the target backlight brightness is greater than the maximum backlight brightness, the high brightness mode needs to be enabled. Only in the high brightness mode can the screen's backlight brightness be increased to the target backlight brightness.
  • the independent display chip is configured to adjust the pixel value of the image data according to the initial backlight brightness, the target backlight brightness, and the brightness threshold, which may include:
  • the independent display chip is used to determine a first grayscale value of each pixel value in the image data at the initial screen brightness and a second grayscale value of the brightness threshold at the initial screen brightness;
  • the independent display chip is used to determine the low brightness area and the high brightness area of the image data according to the first grayscale value and the second grayscale value;
  • the independent display chip is used to adjust the pixel values in the low brightness area and the pixel values in the high brightness area according to the target backlight brightness.
  • the first grayscale value and the second grayscale value are grayscale values of brightness. There is a correspondence between pixel values and grayscale values, and the grayscale value of each pixel value in the image data under the initial backlight brightness (i.e., the above-mentioned first grayscale value) can be obtained based on the correspondence.
  • the first grayscale value corresponding to the pixel value (100, 100, 100) can be calculated as 100 according to the RGB to YUV formula specified in the BT.709 standard (or the color gamut conversion formula specified in other standards).
  • the grayscale value of the brightness threshold at the initial backlight brightness i.e., the second grayscale value mentioned above
  • the second grayscale value of the brightness threshold at the initial backlight brightness i.e., the second grayscale value mentioned above
  • the second grayscale value can be obtained as 168 based on the backlight curve of gamma 2.2.
  • the independent display chip can be used to divide the image data into regions based on the first grayscale value and the second grayscale value to obtain a low-brightness region and a high-brightness region, wherein the first grayscale value corresponding to the pixel value in the low-brightness region is less than the second grayscale value, and the first grayscale value corresponding to the pixel value in the high-brightness region is greater than or equal to the second grayscale value.
  • the independent display chip can be used to adjust the pixel values in the low-brightness area and the pixel values in the high-brightness area according to the target backlight brightness.
  • the independent display chip adjusts the pixel values in the low-brightness area to a different degree than the pixel values in the high-brightness area.
  • the independent display chip is configured to adjust pixel values in a low-brightness area and pixel values in a high-brightness area according to a target backlight brightness, which may include:
  • the independent display chip is used to reduce the pixel value of the low brightness area according to the target backlight brightness, and keep the pixel value of the high brightness area unchanged; or,
  • the independent display chip is used to reduce the pixel value of the low brightness area and increase the pixel value of the high brightness area according to the target backlight brightness.
  • the size of the pixel value is related to (directly proportional to) the pixel's display brightness, which is in turn related to (directly proportional to) the screen's backlight brightness.
  • the reason for reducing the pixel values in low-brightness areas and increasing or keeping the pixel values in high-brightness areas unchanged is to ensure that after the initial backlight brightness is increased to the target backlight brightness, the display brightness of the pixels in low-brightness areas remains unchanged (or changes slightly), while the display brightness of the pixels in high-brightness areas increases.
  • the contrast ratio of the image can be significantly improved by increasing the initial backlight brightness to the target backlight brightness, keeping the display brightness of the pixels in low-brightness areas unchanged, and increasing the display brightness of the pixels in high-brightness areas.
  • the pixel value of the high-brightness area can be increased, and the pixel value of the low-brightness area can remain unchanged, or the pixel values of both the high-brightness area and the low-brightness area can be reduced and the adjustment degree of the low-brightness area can be larger, or the pixel values of both the high-brightness area and the low-brightness area can be increased and the adjustment degree of the high-brightness area can be larger.
  • the adjustment method there is no specific limitation on the adjustment method here.
  • the adjustment method can be multiple.
  • the independent display chip is used to adjust the pixel value of the low brightness area according to the target backlight brightness, which may include:
  • the independent display chip is used to determine an adjustment coefficient according to the initial backlight brightness and the target backlight brightness, and to reduce the pixel value of the low-brightness area according to the adjustment coefficient.
  • the adjustment coefficient is greater than 0 and less than 1.
  • the adjustment coefficient can be determined by the following formula:
  • Ln is the target backlight brightness
  • L0 is the initial backlight brightness
  • Adjusting the pixel values of pixels in different regions based on the first target backlight brightness Ln Specifically, the pixel values of pixels in low-brightness regions are adjusted downward so that the actual display brightness of the pixels in these regions remains unchanged after the initial backlight brightness is increased to the first target backlight brightness Ln.
  • the pixel values of pixels in high-brightness regions can remain unchanged or be increased.
  • the RGB value of the pixel is obtained, for example (100, 100, 100), and the first grayscale value of the pixel under the initial backlight brightness is calculated.
  • the first grayscale value corresponding to the RGB value (100, 100, 100) can be calculated as 100 according to the RGB to YUV conversion formula specified in the BT.709 standard (or the color gamut conversion formula specified in other standards).
  • the brightness threshold Lth 120 nits
  • the initial backlight brightness L0 300 nits
  • the backlight curve of gamma 2.2 it can be obtained that the second grayscale value corresponding to the brightness threshold Lth at a backlight brightness of 300 nits is 168.
  • the pixel is classified as a low-brightness area.
  • the reduction method can be to multiply the RGB value of the pixel by a fixed coefficient a.
  • the calculation formula of coefficient a is:
  • Ln 600 nit
  • L0 300 nit
  • a is calculated to be 0.7262.
  • the pixel value of (100, 100, 100) becomes (73, 73, 73) after being processed by the SDR2HDR module.
  • the adjusted pixel value of each pixel in the image data Dn can be calculated.
  • Step 5 The independent display IC sends the processed image data Dn and the screen backlight control command corresponding to the first target backlight brightness Ln to the DDIC in the display module, and the DDIC completes the screen backlight adjustment and display driving tasks.
  • Step 6 After processing n frames of image data, the backlight brightness of the screen smoothly transitions from the initial backlight brightness of 300 nit to the second target backlight brightness of 600 nit, achieving the SDR2HDR effect.
  • FIG 3 is a schematic diagram of an image processing device according to an embodiment of the present invention processing image data in an SDR video.
  • the structure of the processing device shown in Figure 3 is the same as that of the processing device shown in Figure 2, and will not be described in detail here.
  • the processing device shown in Figure 3 may include the following steps when processing the image data in the SDR video:
  • Step 2 If the SoC determines that the target backlight brightness LN is higher than the maximum brightness Lmax2 open to the user, the SoC turns on the HBM mode of the DDIC. That is, the SoC sends an HBM on command to the independent graphics IC, and the independent graphics IC sends the HBM on command to the display module. The display module turns on the high-brightness mode according to the HBM on command so that the backlight brightness can be brightened subsequently.
  • GPIO transmission interfaces such as I2C and SPI can be used
  • Step 4 After receiving L0 and Lth, the MCU module of the independent graphics IC initializes the SDR2HDR module in the independent graphics IC and notifies the SoC of the successful initialization.
  • the SoC sends the image data Dn and the screen backlight control command corresponding to the first target backlight brightness Ln of the image frame via the DSI to the independent graphics IC.
  • the independent graphics IC receives the image data Dn and the screen backlight control command corresponding to the first target backlight brightness Ln of the image frame via DSI Rx. It is important to note that the image data Dn and the screen backlight control command corresponding to the first target backlight brightness Ln of the image frame must be sent to the independent graphics IC in the same frame and cannot be sent across frames.
  • Step 5 The independent graphics IC parses the screen backlight control command and obtains the first target backlight brightness Ln.
  • the independent graphics IC's SDR2HDR module processes the image data Dn based on the initial backlight brightness L0, the brightness threshold Lth, and the first target backlight brightness Ln.
  • the specific implementation is the same as that of step 4 in the embodiment shown in Figure 2 and will not be repeated here.
  • Step 6 The independent display IC sends the processed image data Dn and the screen backlight control command corresponding to the first target backlight brightness Ln to the DDIC in the display module, and the DDIC completes the screen backlight adjustment and display driving tasks.
  • Step 7 After processing n frames of image data, the backlight brightness of the screen smoothly transitions from the initial backlight brightness of 800 nit to the second target backlight brightness of 1600 nit, achieving the SDR2HDR effect.
  • the display brightness of the pixel when processing an image, since the pixel value of the image data can be adjusted according to the initial backlight brightness, target backlight brightness and brightness threshold of the screen, the display brightness of the pixel can be adjusted. Since the initial backlight brightness of the screen can be increased to the target backlight brightness, the backlight brightness of the screen can be increased. Since the display brightness of the pixel and the backlight brightness of the screen are related to the contrast of the image, by adjusting the display brightness of the pixel in the image and increasing the backlight brightness of the screen, the contrast of the image can be greatly improved, further improving the visual effect of the image. In addition, since the image format conversion is not involved when processing the image, when displaying the processed image, there is no need for the terminal device to support the corresponding technical standards, thereby avoiding restrictions on the terminal device and having a wider range of applications.
  • the image processing device in the embodiment of the present application can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip.
  • the electronic device can be a terminal or a device other than a terminal.
  • the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR)/virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc.
  • It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.
  • the image processing device in the embodiment of the present application may be a device having an operating system.
  • the operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
  • An embodiment of the present application provides an electronic device, which may include the image processing device provided in the embodiment of the present application.
  • the electronic device can significantly improve the contrast of the image, resulting in a better visual effect.
  • Figure 4 is a flow chart of an image processing method according to an embodiment of the present application, which can be executed by the system-on-chip shown in Figure 1 and can include the following steps.
  • S42 Determine the initial backlight brightness, target backlight brightness, and brightness threshold of the screen.
  • the initial backlight brightness may be the backlight brightness of the screen when displaying the image data to be processed.
  • the target backlight brightness of the screen may be the backlight brightness to which the initial backlight brightness needs to be increased.
  • a high brightness mode HBM of the display panel may be enabled.
  • the brightness threshold is a comparative threshold that can be used by the independent display chip to determine different regions in the image data so that when the independent display chip adjusts the pixel values of the image data, the pixel values of different regions of the image data can be adjusted to different degrees.
  • determining the brightness threshold may include:
  • the brightness threshold is determined according to the initial backlight brightness and a preset coefficient, where the preset coefficient is greater than 0 and less than 1.
  • S44 Send the initial backlight brightness and brightness threshold to the independent display chip for initialization.
  • the image data to be processed may be one frame of image data or multiple frames of image data.
  • the multiple frames of image data may be multiple frames of continuous image data in the same video, which may be an SDR video, for example.
  • the image data to be processed when the image data to be processed is a plurality of continuous frames of image data in a video, the image data to be processed may include first image data corresponding to a transition frame and second image data corresponding to a non-transition frame.
  • the target backlight brightness includes a first target backlight brightness corresponding to the first image data and a second target backlight brightness corresponding to the second image data, where the first target backlight brightness is less than the second target backlight brightness.
  • the first image data and the first target backlight brightness are first sent to the independent display chip, and then the second image data and the second target backlight brightness are sent to the independent display chip.
  • determining the target backlight brightness may further include:
  • the first target backlight brightness is determined according to the number of transition frames, the initial backlight brightness, and the second target backlight brightness.
  • the electronic device 700 includes but is not limited to components such as a radio frequency unit 701 , a network module 702 , an audio output unit 703 , an input unit 704 , a sensor 705 , a display unit 706 , a user input unit 707 , an interface unit 708 , a memory 709 , and a processor 710 .
  • the image data to be processed and the target backlight brightness are sent to the independent display chip, the initial backlight brightness, the target backlight brightness and the brightness threshold are used by the independent display chip to adjust the pixel value of the image data, and the adjusted image data and the target backlight brightness are sent to the display panel, and the display panel displays the adjusted image data based on the target backlight brightness.
  • the processor 710 is configured to:
  • the adjusted image data and the target backlight brightness are sent to a display panel, and the display panel displays the adjusted image data based on the target backlight brightness.
  • An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored.
  • a program or instruction is stored.
  • the various processes of the above-mentioned image processing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
  • An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image processing method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.
  • the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
  • the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.
  • a storage medium such as ROM/RAM, magnetic disk, optical disk

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Chemical & Material Sciences (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Liquid Crystal Display Device Control (AREA)

Abstract

本申请公开了一种图像处理装置、方法和电子设备,属于显示技术领域。该装置包括系统级芯片、独立显示芯片和显示面板,系统级芯片用于确定屏幕的初始背光亮度、目标背光亮度和亮度阈值,将初始背光亮度和亮度阈值发送给独立显示芯片进行初始化,在确定独立显示芯片完成初始化的情况下,将待处理的图像数据和目标背光亮度发送给独立显示芯片;独立显示芯片用于根据初始背光亮度和亮度阈值进行初始化,在完成初始化的情况下,根据初始背光亮度、目标背光亮度和亮度阈值对图像数据的像素值进行调整,将调整后的图像数据和目标背光亮度发送给显示面板进行显示。

Description

图像处理装置、方法和电子设备
相关申请的交叉引用
本申请要求在2024年03月26日提交中国专利局、申请号为202410353072.8、发明名称为“图像处理装置、方法和电子设备”的中国专利申请的优先权,该中国专利申请的全部内容通过引用包含于此。
技术领域
本申请属于显示技术领域,具体涉及一种图像处理装置、方法和电子设备。
背景技术
标准动态范围(Standard Dynamic Range,SDR)视频是基于SDR技术标准制作的视频,高动态范围(High Dynamic Range,HDR)视频是基于HDR技术标准制作的视频。由于HDR技术是一种以更高的颜色范围和亮度范围制作和显示图像的技术,因此,HDR视频相较于SDR视频而言具有更好的画质体验和视觉效果。
目前的互联网视频通常是SDR视频,为了改善视频画质,在相关技术中,可以采用SDR2HDR(Standard Dynamic Range to High Dynamic Range)技术对SDR视频进行处理。在采用SDR2HDR技术对SDR视频进行处理时,一种方案是对SDR视频进行格式转换得到HDR视频,另一种方案是对视频图像的像素值进行修改,以使修改后视频图像达到近似HDR显示的效果。然而,在实际应用中,上述两种方案具有一定的局限性,具体而言,上述第一种方案需要终端设备支持对应的HDR技术标准才能解码转换得到的HDR视频,而上述第二种方案对视频画面的对比度提升有限,导致视频画面的对比度无法满足实际需求,视觉效果不佳。在实际应用中,除了上述的SDR视频外,一些图像也有改善画质的需求,在采用SDR2HDR技术对图像进行处理时,同样存在上述的局限性。
发明内容
本申请实施例的目的是提供一种图像处理装置、方法和电子设备,能够解决在需要改善图像画质或视频画质的情况下,如何克服现有方案的局限性,以实现对图像画质或视频画质的有效改善的问题。
第一方面,本申请实施例提供了一种图像处理装置,包括系统级芯片、独立显示芯片和显示面板,其中:
所述系统级芯片用于确定屏幕的初始背光亮度、目标背光亮度和亮度阈值,将所述初始背光亮度和所述亮度阈值发送给所述独立显示芯片进行初始化,在确定所述独立显示芯片完成初始化的情况下,将待处理的图像数据和所述目标背光亮度发送给所述独立显示芯片;
所述独立显示芯片用于根据所述初始背光亮度和所述亮度阈值进行初始化,在完成初始化的情况下,根据所述初始背光亮度、所述目标背光亮度和所述亮度阈值对所述图像数据的像素值进行调整,将调整后的图像数据和所述目标背光亮度发送给所述显示面板;
所述显示面板用于基于所述目标背光亮度显示所述调整后的图像数据。
第二方面,本申请实施例提供了一种电子设备,该电子设备包括如第一方面所述的图像处理装置。
第三方面,本申请实施例提供了一种图像处理方法,包括:
确定屏幕的初始背光亮度、目标背光亮度和亮度阈值;
将所述初始背光亮度和所述亮度阈值发送给独立显示芯片进行初始化;
在确定所述独立显示芯片完成初始化的情况下,将待处理的图像数据和所述目标背光亮度发送给所述独立显示芯片,所述初始背光亮度、所述目标背光亮度和所述亮度阈值用于所述独立显示芯片对所述图像数据的像素值进行调整,并将调整后的图像数据和所述目标背光亮度发送给显示面板,由所述显示面板基于所述目标背光亮度显示所述调整后的图像数据。
第四方面,本申请实施例提供了一种图像处理方法,包括:
接收系统级芯片发送的屏幕的初始背光亮度和亮度阈值;
根据所述初始背光亮度和所述亮度阈值进行初始化;
在完成初始化的情况下,接收所述系统级芯片发送的待处理的图像数据和目标背光亮度;
根据所述初始背光亮度、所述目标背光亮度和所述亮度阈值,对所述图像数据的像素值进行调整;
将调整后的图像数据和所述目标背光亮度发送给显示面板,由所述显示面板基于所述目标背光亮度显示所述调整后的图像数据。
第五方面,本申请实施例提供了一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如第三方面或第四方面所述的方法的步骤。
第六方面,本申请实施例提供了一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现如第三方面或第四方面所述的方法。
第七方面,本申请实施例提供一种计算机程序产品,该程序产品被存储在存储介质中,该程序产品被至少一个处理器执行以实现如第三方面或第四方面所述的方法。
在本申请实施例中,在对图像进行处理时,由于可以根据屏幕的初始背光亮度、目标背光亮度和亮度阈值对图像数据的像素值进行调整,因此,可以实现对像素的显示亮度的调整,由于可以将屏幕的初始背光亮度提升至目标背光亮度,因此,可以提升屏幕的背光亮度,由于像素的显示亮度和屏幕的背光亮度与图像画面的对比度有关,因此,通过调整图像中像素的显示亮度以及提升屏幕的背光亮度,可以大幅提升图像画面的对比度,进一步改善图像的视觉效果。此外,由于在对图像进行处理时,不涉及图像格式的转换,因此,在显示处理后的图像时,无需终端设备支持相应的技术标准,从而可以避免对终端设备造成限制,适用范围更广。
附图说明
图1是根据本申请实施例的图像处理装置的结构示意图;
图2是根据本申请实施例的图像处理装置对SDR视频中的图像数据进行处理的示意图;
图3是根据本申请实施例的图像处理装置对SDR视频中的图像数据进行处理的示意图;
图4是根据本申请实施例的图像处理方法的流程示意图;
图5是根据本申请实施例的图像处理方法的流程示意图;
图6是根据本申请实施例的电子设备的结构示意图;
图7是根据本申请实施例的电子设备的硬件结构示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员获得的所有其他实施例,都属于本申请保护的范围。
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象,而不用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施,且“第一”、“第二”等所区分的对象通常为一类,并不限定对象的个数,例如第一对象可以是一个,也可以是多个。此外,说明书以及权利要求中“和/或”表示所连接对象的至少其中之一,字符“/”,一般表示前后关联对象是一种“或”的关系。
下面结合附图,通过具体的实施例及其应用场景对本申请实施例提供的图像处理装置、方法和电子设备进行详细地说明。
图1是根据本申请实施例的一种图像处理装置10的结构示意图。
如图1所示,图像处理装置10包括系统级芯片11、独立显示芯片12和显示面板13。系统级芯片11用于确定屏幕的初始背光亮度、目标背光亮度和亮度阈值,将初始背光亮度和亮度阈值发送给独立显示芯片12进行初始化,在确定独立显示芯片12完成初始化的情况下,将待处理的图像数据和目标背光亮度发送给独立显示芯片12。独立显示芯片12用于根据初始背光亮度和亮度阈值进行初始化,在完成初始化的情况下,根据初始背光亮度、目标背光亮度和亮度阈值对待处理的图像数据的像素值进行调整,将调整后的图像数据和目标背光亮度发送给显示面板13。显示面板13用于基于目标背光亮度显示调整后的图像数据。
待处理的图像数据可以是一帧图像数据或多帧图像数据,在多帧图像数据的情况下,该多帧图像数据可以是同一视频中的多帧连续的图像数据,该视频比如可以是SDR视频。其中,在待处理的图像数据为SDR视频中的多帧连续的图像数据的情况下,在对待处理的图像数据进行处理之前,可以开启终端设备中的SDR2HDR功能。比如,在终端设备播放SDR视频时,如果用户想要改善SDR视频的画质,以使SDR视频能够具有HDR视频的显示效果,那么用户可以开启终端设备的SDR2HDR功能(终端设备可以提供SDR2HDR功能的开启按钮,用户可以通过该按钮开启SDR2HDR功能)。或者,在其他可能的实施方式中,SDR2HDR功能也可以由终端设备自行开启。比如,在用户打开了终端设备中的某个游戏应用后,终端设备可以识别到当前的场景为游戏场景,而游戏画面(可以视为SDR视频)一般有较高的画质要求,此时终端设备可以自行开启SDR2HDR功能。
上述的系统级芯片11可以是终端设备中的SoC(System on Chip)。在一些实施方式中,系统级芯片11可以包括处理器内核、数字信号处理器、存储模块、通讯接口、电源管理、射频前端等模块。在对图像数据进行处理时,系统级芯片11可以确定屏幕的初始背光亮度、目标背光亮度和亮度阈值。屏幕的初始背光亮度可以是屏幕在显示待处理的图像数据时的背光亮度。屏幕的目标背光亮度可以是在需要将初始背光亮度提升到的背光亮度。目标背光亮度可以是一个设定值,也可以由系统级芯片11根据初始背光亮度和独立显示芯片12的提亮能力(比如提亮倍数)计算得到。亮度阈值是一个比较阈值,可以用于独立显示芯片12确定图像数据中的不同区域,以便独立显示芯片12在对图像数据的像素值进行调整时,可以对图像数据的不同区域的像素值进行不同程度的调整。亮度阈值可以是一个设定值,也可以由系统级芯片11根据初始背光亮度计算得到。
系统级芯片11在确定屏幕的初始背光亮度、目标背光亮度和亮度阈值后,可以将这些参数以及待处理的图像数据发送给独立显示芯片12,在发送时,可以分步骤发送。具体地,在待处理的图像数据为一帧图像数据的情况下,系统级芯片11可以先将初始背光亮度和亮度阈值发送给独立显示芯片12进行初始化,在确定独立显示芯片12完成初始化的情况下,再将待处理的图像数据和目标背光亮度发送给独立显示芯片12。在待处理的图像数据为多帧图像数据的情况下,系统级芯片11可以先将初始背光亮度和亮度阈值发送给独立显示芯片12进行初始化,在确定独立显示芯片12完成初始化的情况下,再将待处理的第一帧图像数据和该帧图像数据对应的目标背光亮度发送给独立显示芯片12,然后再将待处理的第二帧图像数据和该帧图像数据对应的目标背光亮度发送给独立显示芯片12,……,依此类推,直至将待处理的最后一帧图像数据和该帧图像数据对应的目标背光亮度发送给独立显示芯片12。可选地,在一些实施方式中,在独立显示芯片12具有足够快的处理能力的情况下,系统级芯片11也可以将屏幕的初始背光亮度、目标背光亮度、亮度阈值以及待处理的第一帧图像数据(若待处理的图像数据为一帧图像数据,则这里的第一帧图像数据就是该待处理的一帧图像数据)一起发送给独立显示芯片12,然后由独立显示芯片12在较短时间内先进行初始化再对第一帧图像数据进行处理。在实际应用中,为了更为稳妥,可以选择分步骤发送屏幕的初始背光亮度、目标背光亮度、亮度阈值以及待处理的图像数据。
独立显示芯片12在进行初始化时,可选地,可以由独立显示芯片12中的微控制单元(Microcontroller Unit,MCU)根据初始背光亮度和亮度阈值对独立显示芯片12中的图像处理模块(具体而言,可以是独立显示芯片12中用于对图像数据的像素值进行调整的模块)进行初始化。其中,在待处理的图像数据为SDR视频中的图像数据的情况下,独立显示芯片12中的图像处理模块可以是SDR2HDR模块。独立显示芯片12在完成初始化的情况下,可以向系统级芯片11发送通知信息,该通知信息用于向系统级芯片11通知独立显示芯片12已完成初始化。系统级芯片12可以根据接收到的通知信息确认独立显示芯片12是否完成初始化。这样,由于在对待处理的图像数据进行处理之前,可以先对独立显示芯片12进行初始化,因此,可以使得独立显示芯片12在对待处理的图像数据的像素值进行调整时,可以基于初始化时的初始背光亮度和亮度阈值进行像素值的调整,避免出错。
基于本申请实施例提供的图像处理装置,在对图像进行处理时,由于可以根据屏幕的初始背光亮度、目标背光亮度和亮度阈值对图像数据的像素值进行调整,因此,可以实现对像素的显示亮度的调整,由于可以将屏幕的初始背光亮度提升至目标背光亮度,因此,可以提升屏幕的背光亮度,由于像素的显示亮度和屏幕的背光亮度与图像画面的对比度有关,因此,通过调整图像中像素的显示亮度以及提升屏幕的背光亮度,可以大幅提升图像画面的对比度,进一步改善图像的视觉效果。此外,由于在对图像进行处理时,不涉及图像格式的转换,因此,在显示处理后的图像时,无需终端设备支持相应的技术标准,从而可以避免对终端设备造成限制,适用范围更广。比如,在待处理的图像数据为SDR视频中的图像数据,并对图像数据进行处理以得到HDR视频的显示效果的情况下,由于整个图像处理过程中不涉及视频格式的转换,即没有将SDR视频转换为HDR视频格式,因此,在显示处理后的SDR视频时,无需终端设备支持对应的HDR技术标准,从而可以避免对终端设备造成限制,适用范围更广。
在一些实施方式中,在待处理的图像数据为同一视频中的多帧连续的图像数据的情况下,待处理的图像数据可以包括过渡帧对应的第一图像数据和非过渡帧对应的第二图像数据。过渡帧可以是将初始背光亮度过渡到需要提升到的目标背光亮度时对应的视频帧。过渡帧的目的是为了避免在提升屏幕的背光亮度时,由于相邻两帧图像之间的背光亮度差异过大导致的视频闪烁的问题。非过渡帧即为将初始背光亮度提升至需要提升到的目标背光亮度后显示的视频帧。在图像数据包括过渡帧对应的第一图像数据和非过渡帧对应的第二图像数据的情况下,相应的,系统级芯片发送给独立显示芯片目标背光亮度可以包括与第一图像数据对应的第一目标背光亮度以及与第二图像数据对应的第二目标背光亮度,第一目标背光亮度小于第二目标背光亮度。第二目标背光亮度是最终需要将初始背光亮度提升到的目标背光亮度,不同帧的第二图像数据对应相同的第二目标背光亮度。第一目标背光亮度为初始背光亮度过渡到第二目标背光亮度时对应的过渡亮度,不同帧的第一图像数据可以对应不同的第一背光亮度,第一目标背光亮度可以跟随第一图像数据的帧数缓慢递增(线性或非线性递增)至第二目标背光亮度。
在图像数据包括过渡帧对应的第一图像数据和非过渡帧对应的第二图像数据,且目标背光亮度包括第一目标背光亮度和第二目标背光亮度的情况下,系统级芯片用于将待处理的图像数据和目标背光亮度发送给独立显示芯片,可以包括:
系统级芯片用于先将第一图像数据和第一目标背光亮度发送给独立显示芯片,再将第二图像数据和第二目标背光亮度发送给独立显示芯片。
比如,第一图像数据包括N帧,第二图像数据包括M帧(N和M均为大于0的整数),那么,系统级芯片在向独立显示芯片发送图像数据和对应的目标背光亮度时,可以先将第一帧第一图像数据和对应的第一目标背光亮度发送给独立显示芯片,然后将第二帧第一图像数据和对应的第一目标背光亮度发送给独立显示芯片,……,依此类推,直至将第N帧第一图像数据和对应的第一目标背光亮度发送给独立显示芯片,之后,继续将第一帧第二图像数据和对应的第二目标背光亮度发送给独立显示芯片,然后将第二帧第二图像数据和对应的第二目标背光亮度发送给独立显示芯片,……依此类推,直至将第M帧第二图像数据和对应的第二目标背光亮度发送给独立显示芯片。
这样,由于图像数据中包括过渡帧对应的第一图像数据和非过渡帧对应的第二图像数据,第一图像数据对应第一目标背光亮度,第二图像数据对应第二背光亮度,系统级芯片在向独立显示芯片发送图像数据和目标背光亮度时,先发送过渡帧对应的第一图像数据和第一目标背光亮度,再发送非过渡帧对应的第二图像数据和第二目标背光亮度,因此,在后续进行亮度提升时,可以基于过渡帧对应的第一图像数据和第一目标背光亮度,将初始背光亮度平滑提升到第二目标背光亮度,避免画面闪烁。
需要说明的是,系统级芯片在向独立显示芯片发送第一图像数据以及对应的第一目标背光亮度时,针对某个过渡帧而言,与该过渡帧对应的第一图像数据和第一目标背光亮度需要在同一帧发送完,不能跨帧,否则就会出现第一图像数据和第一目标背光亮度不对应的问题,导致后续在对第一图像数据的初始背光亮度进行提升时,提升到的第一目标背光亮度出现问题,进而导致初始背光亮度无法平滑过渡到第二目标背光亮度。
在一些实施方式中,系统芯片在向独立显示芯片发送目标背光亮度(第一目标背光亮度或第二目标背光亮度)时,具体可以是向独立显示芯片发送屏幕背光控制命令,该屏幕背光控制命令中携带有目标背光亮度的信息。由此可以通过屏幕背光控制命令实现目标背光亮度的发送,便于后续根据基于屏幕背光控制命令实现背光亮度的提升。
在一些实施方式中,在图像数据包括过渡帧对应的第一图像数据和非过渡帧对应的第二图像数据,目标背光亮度包括第一目标背光亮度和第二目标背光亮度的情况下,系统级芯片在向独立显示芯片发送目标背光亮度之前,还用于:
根据初始背光亮度和提亮倍数确定第二目标背光亮度;
确定过渡帧的数量;
根据过渡帧的数量、初始背光亮度和第二目标背光亮度确定第一目标背光亮度。
提亮倍数可以根据独立显示芯片的提亮能力确定,或者,也可以根据实际的提亮需求确定,这里不做具体限定。在根据初始背光亮度和提亮倍数确定第二目标背光亮度时,具体可以是将初始背光亮度和提亮倍数的乘积确定为第二目标背光亮度。比如,初始屏幕亮度为300nit,提亮倍数为2,则第二目标背光亮度为600nit。需要说明的是,第二目标背光亮度需要小于屏幕可以显示的最大背光亮度。比如,屏幕可以显示的最大背光亮度为3000nit,则第二目标背光亮度需要小于3000nit。
过渡帧的数量可以根据实际需求确定。比如,如果需要背光亮度过渡的更为平滑,则过渡帧的数量可以多一些,如果对过渡平滑度要求不高,则过渡帧的数量可以少一些。
在根据过渡帧的数量、初始背光亮度和第二目标背光亮度确定第一目标背光亮度时,如果是线性过渡,则可以根据线性公式确定第一目标背光亮度,如果不是线性过渡,则可以根据非线性公式确定第一目标背光亮度。以线性过渡为例,假设初始屏幕亮度为300nit,第二目标屏幕亮度为600nit,过渡帧的数量为30,则第i帧过渡帧的第一目标背光亮度等于300+i*(600-300)/30,i=1,2,……29,30。
在一些实施方式中,系统级芯片用于确定亮度阈值,可以包括:
系统级芯片用于根据初始背光亮度和预设系数确定亮度阈值,预设系数大于0且小于1。
系统级芯片在根据初始背光亮度和预设系数确定亮度阈值时,可以是将初始背光亮度和预设系数的乘积确定为亮度阈值。比如,初始背光亮度为300nit,预设系统为0.4,则亮度阈值为120nit。
在一些实施方式中,在目标背光亮度大于或等于预设背光亮度的情况下,系统级芯片还用于开启显示面板的高亮度模式(High Brightness Mode,HBM)。预设背光亮度可以是屏幕开放给用户调整的最大背光亮度,在未开启高亮度模式的情况下,背光亮度最大可以提升至该预设背光亮度,在开启高亮度模式的情况下,可以实现更大亮度的提升。因此,当目标背光亮度大于该最大背光亮度的情况下,就需要开启高亮度模式,在高亮度模式下,才可以将屏幕的背光亮度提升至目标背光亮度。
在一些实施方式中,独立显示芯片用于根据初始背光亮度、目标背光亮度和亮度阈值,对图像数据的像素值进行调整,可以包括:
独立显示芯片用于确定图像数据中的每个像素值在初始屏幕亮度下的第一灰阶值以及亮度阈值在初始屏幕亮度下的第二灰阶值;
独立显示芯片用于根据第一灰阶值和第二灰阶值,确定图像数据的低亮度区域和高亮度区域;
独立显示芯片用于根据目标背光亮度对低亮度区域内的像素值以及高亮度区域内的像素值进行调整。
第一灰阶值和第二灰阶值为亮度的灰阶值。像素值和灰阶值之间具有对应关系,根据该对应关系可以得到图像数据中的每个像素值在初始背光亮度下的灰阶值(即上述第一灰阶值)。比如,以一个像素为例,假设该像素对应的像素值为(100,100,100),初始背光亮度为300nit,则在确定像素值在初始背光亮度300nit下的第一灰阶值时,可以按照BT.709标准中规定的RGB转YUV公式(也可以按其他标准中规定的色域转换公式)计算出像素值(100,100,100)对应的第一灰阶值为100。
亮度阈值与灰阶值之间也有对应关系,根据该对应关系可以得到亮度阈值在初始背光亮度下的灰阶值(即上述第二灰阶值)。比如,假设阈值亮度为120nit,初始屏幕亮度为300nit,则在确定亮度阈值120nit在背光亮度为300nit下的第二灰阶值时,可以根据伽马2.2的背光曲线得到第二灰阶值为168。
在得到图像数据中每个像素值在初始背光亮度下的第一灰阶值以及亮度阈值在初始背光亮度下的第二灰阶值后,独立显示芯片可以用于根据该第一灰阶值和第二灰阶值对图像数据进行区域划分,得到低亮度区域和高亮度区域。其中,低亮度区域内的像素值对应的第一灰阶值小于第二灰阶值,高亮度区域内的像素值对应的第一灰阶值大于或等于第二灰阶值。
在划分得到低亮度区域和高亮度区域后,独立显示芯片可以用于根据目标背光亮度对低亮度区域内的像素值以及高亮度区域内的像素值进行调整。其中,独立显示芯片对低亮度区域的像素值的调整程度与对高亮度区域的像素值的调整程度不同。
在一些实施方式中,独立显示芯片用于根据目标背光亮度对低亮度区域内的像素值以及高亮度区域内的像素值进行调整,可以包括:
独立显示芯片用于根据目标背光亮度将低亮度区域的像素值调小,高亮度区域的像素值保持不变;或,
独立显示芯片用于根据目标背光亮度将低亮度区域的像素值调小,将高亮度区域的像素值调大。
像素值的大小与像素的显示亮度有关(呈正比),像素的显示亮度与屏幕的背光亮度有关(呈正比),这里之所以将低亮度区域的像素值调小,将高亮度区域的像素值调大或保持不变,是为了保证在将初始背光亮度提升至目标背光亮度后,低亮度区域的像素的显示亮度可以保持不变(或变化较小),高亮度区域的像素的显示亮度增加。由于像素之间的显示亮度差异与对比度有关(呈正比),因此,在将初始背光亮度提升至目标背光亮度,低亮度区域的像素的显示亮度保持不变、高亮度区域的像素的显示亮度增加的情况下,可以大幅提升画面的对比度。
需要说明的是,在一些可能的实施方式中,也可以将高亮度区域的像素值调大,低亮度区域的像素值保持不变,或,将高亮度区域和低亮度区域的像素值均调小且低亮度区域的调整程度较大,或,将高亮度区域和低亮度区域的像素值均调大且高亮度区域的调整程度较大,只要可以提高低亮度区域和高亮度区域之间的显示亮度差异进而可以大幅提升画面对比度即可,这里不对的调整方式做具体限定。
独立显示芯片在根据目标屏幕亮度对低亮度区域的像素值调小时,调整方式可以有多种。可选地,在一些实施方式中,独立显示芯片用于根据目标背光亮度将低亮度区域的像素值调小,可以包括:
独立显示芯片用于根据初始背光亮度和目标背光亮度确定调整系数,根据调整系数将低亮度区域的像素值调小。
调整系数大于0且小于1。独立显示芯片在根据初始背光亮度和目标背光亮度确定调整系数时,可选地,在一些实施方式中,可以通过以下公式确定调整系数:
其中,a为调整系数,Ln为目标背光亮度,L0为初始背光亮度。
应理解,在其他实施方式中,也可以通过其他方式确定调整系数,这里不再一一举例说明。
在确定调整系数后,在根据调整系数将低亮度区域的像素值调小时,针对每个像素值,可以将像素值与调整系数的乘积确定为调整后的像素值,由于调整系数小于1,因此,可以将低亮度区域的像素值调小。
独立显示芯片在根据目标背光亮度将高亮度区域的像素值调大时,调整方式可以有多种,比如,可以将像素值与预设值(大于0)的和确定为调整后的像素值,或者,也可以将像素值与某个指定系数(大于1,比如可以是上述调整系数的倒数)的乘积确定为调整后的像素值,只要可以实现像素值的调大即可,这里不对调整方式做具体限定。
上述举例说明了独立显示芯片如何根据初始背光亮度、目标背光亮度和亮度阈值,对图像数据的像素值进行调整,应理解,独立显示芯片也可以通过其他方式对图像数据的像素值进行调整,只要可以保证在亮度提升的情况下可以大幅提升画面对比度即可。比如,在划分高亮度区域和低亮度区域时,可以将亮度阈值转化为像素值,通过该像素值与图像的像素值之间的大小关系划分高亮度区域和低亮度区域。再比如,在根据第一灰阶值和第二灰阶值进行区域划分时,也可以划分更多个区域,比如高亮度区域、中亮度区域和低亮度区域,高亮度区域的像素值调大,中亮度区域的像素值不变,低亮度区域的像素值调小。这里不再对其他可能的实现方式进行一一举例说明。
在一些实施方式中,显示面板中包括显示驱动芯片(Display Driver IC,DDIC),显示驱动芯片可以用于提供显示面板工作必需的电源和时序信号等。显示面板在接收到独立显示芯片发送的调整后的图像数据和目标背光亮度后,显示面板中的显示驱动芯片会完成背光亮度的调整和图像数据的驱动显示,即由显示驱动芯片将屏幕的初始背光亮度提升至目标背光亮度并显示调整后的图像数据。由于在对图像数据中的像素值进行调整时,具体是将低亮度区域的像素值调小,将高亮度区域的像素值调大或保持不变,因此,在对屏幕背光进行提亮后,在显示调整后的图像数据时,图像数据的高亮度区域的像素值的显示亮度和低亮度区域的像素值的显示亮度之间的差异较大,从而可以大幅提升画面的对比度,视觉效果更佳。
为了便于理解本申请实施例提供的图像处理装置以及该处理装置如何对图像数据进行处理,以下将以图2和图3所示的一些更为具体的实现方式为例进行说明。
图2是根据本申请实施例的图像处理装置对SDR视频中的图像数据进行处理的示意图。图2所示的处理装置包括SoC(对应图1所示实施例中的系统级芯片)、独显IC(对应图1所示实施例中的独立显示芯片)和显示模组(对应图1所示实施例中的显示面板)。SoC中包括显示串行接口(Display Serial Interface,DSI)和通用输入输出接口(General Purpose Input/Output Port,GPIO)。独显IC中包括显示串行接口接收模块DSIRx、显示串行接口发送模块DSI Tx、GPIO、SDR2HDR模块和MCU模块。显示模组中包括DDIC。
假设终端屏幕可显示的最大背光亮度Lmax1为3000nit,开放给用户调整的最大背光亮度Lmax2为800nit。独显IC中的SDR2HDR功能的提亮倍数设置为2倍,亮度阈值Lth设置为初始背光亮度L0的0.4倍。初始背光亮度L0为300nit时,用户开启SDR2HDR功能,在这种情况下,图2所示的处理装置在对SDR视频中的图像数据进行处理时,可以包括如下步骤:
步骤1:SoC获取初始背光亮度L0=300nit,计算亮度阈值Lth=300*0.4=120nit、第二目标背光亮度LN=300*2=600nit、初始背光亮度过渡到目标背光亮度对应的帧数为n以及每帧图像对应的第一目标背光亮度Ln。
步骤2:SoC将初始背光亮度L0=300nit、亮度阈值Lth=120nit通过GPIO(可以使用I2C、SPI等传输接口)发送给独显IC,用于独显IC对SDR2HDR模块进行初始化。
步骤3:独显IC的MCU模块接收L0和Lth后,对独显IC中的SDR2HDR模块进行初始化,初始化完成后通知SoC初始化成功。SoC将图像数据Dn以及该帧图像的第一目标背光亮度Ln对应的屏幕背光控制命令通过DSI发送给独显IC,独显IC通过DSI Rx接收图像数据Dn以及该帧图像的第一目标背光亮度Ln对应的屏幕背光控制命令。这里需要注意的是,图像数据Dn和该帧图像对应的第一目标背光亮度Ln对应的屏幕背光控制命令需要在同一帧发送给独显IC,不能跨帧。
步骤4:独显IC解析屏幕背光控制命令,获取第一目标背光亮度Ln。独显IC的SDR2HDR模块基于初始背光亮度L0、亮度阈值Lth和第一目标背光亮度Ln对图像数据Dn进行处理,具体包括:
1)计算图像数据Dn中各像素在初始背光亮度L0时的第一灰阶值以及亮度阈值Lth在初始背光亮度L0时的第二灰阶值;
2)根据第一灰阶值和第二灰阶值对图像数据Dn中的各像素点进行分区处理,第一灰阶值小于第二灰阶值的像素被划分到低亮度区域,第一灰阶值大于或等于第二灰阶值的像素被划分到高亮度区域;
3)根据第一目标背光亮度Ln对不同区域内像素的像素值分别进行调整。其中,低亮度区域像素的像素值被调小,使得该区域像素在初始背光亮度提高到第一目标背光亮度Ln后的实际显示亮度仍维持不变。高亮度区域像素的像素值可保持不变或调大。
以图像数据Dn中的一个像素为例,具体实现方式举例如下:
首先,获取像素的RGB值,例如(100,100,100),计算该像素在初始背光亮度下的第一灰阶值。比如,可以按照BT.709标准中规定的RGB转YUV公式(也可以按其他标准中规定的色域转换公式)计算出RGB值(100,100,100)对应的第一灰阶值为100。
其次,计算亮度阈值在初始背光亮度时的第二灰阶值。亮度阈值Lth=120nit,初始背光亮度L0=300nit,由伽马2.2的背光曲线可以得到亮阈值度Lth在背光亮度为300nit时对应的第二灰阶值为168。
最后,由于(100,100,100)对应的第一灰阶值100小于168,因此,该像素被划分到低亮度区域,为使得该像素的显示亮度在屏幕提亮后保持不变,该像素的RGB值需要调小。调小方式可以是像素的RGB值乘以固定系数a。系数a的计算公式为:
Ln为600nit,L0为300nit,a计算为0.7262。像素值为(100,100,100)的像素经过SDR2HDR模块处理后的像素值变为(73,73,73)。
基于相同的方式可以计算得到图像数据Dn中每个像素调整后的像素值。
步骤5:独显IC将处理后的图像数据Dn和第一目标背光亮度Ln对应的屏幕背光控制命令发送给显示模组中的DDIC,由DDIC完成屏幕背光调整和显示驱动的工作。
步骤6:经过对n帧图像数据的处理后,屏幕的背光亮度由初始背光亮度300nit平滑过渡到第二目标背光亮度600nit,实现SDR2HDR效果。
图3是根据本申请实施例的图像处理装置对SDR视频中的图像数据进行处理的示意图。图3所示的处理装置的结构与图2所示的处理装置的结构相同,这里不再详细说明。
假设终端屏幕可显示的最大背光亮度Lmax1为3000nit,开放给用户调整的最大背光亮度Lmax2为800nit。独显IC中的SDR2HDR功能的提亮倍数设置为2倍,亮度阈值Lth设置为初始背光亮度L0的0.4倍。用户手动拖动亮度条将屏幕的初始背光亮度设置为最大值Lmax2(即初始背光亮度L0=800nit)后开启SDR2HDR功能,在这种情况下,图3所示的处理装置在对SDR视频中的图像数据进行处理时,可以包括如下步骤:
步骤1:SoC获取初始背光亮度L0=800nit,计算亮度阈值Lth=800*0.4=320nit、第二目标背光亮度LN=800*2=1600nit、初始背光亮度过渡到目标背光亮度对应的帧数为n以及每帧图像对应的第一目标背光亮度Ln。
步骤2:SoC判断目标背光亮度LN高于开放给用户的最大亮度Lmax2,则SoC开启DDIC的HBM模式,即SoC向独显IC发送HBM on命令,独显IC将HBM on命令发送给显示模组,显示模组根据HBM on命令开启高亮度模式,以便后续对背光亮度进行提亮。
步骤3:SoC将初始背光亮度L0=800nit、亮度阈值Lth=320nit通过GPIO(可以使用I2C、SPI等传输接口)发送给独显IC,用于独显IC对SDR2HDR模块进行初始化。
步骤4:独显IC的MCU模块接收L0和Lth后,对独显IC中的SDR2HDR模块进行初始化,初始化完成后通知SoC初始化成功。SoC将图像数据Dn以及该帧图像的第一目标背光亮度Ln对应的屏幕背光控制命令通过DSI发送给独显IC,独显IC通过DSI Rx接收图像数据Dn以及该帧图像的第一目标背光亮度Ln对应的屏幕背光控制命令。这里需要注意的是,图像数据Dn和该帧图像对应的第一目标背光亮度Ln对应的屏幕背光控制命令需要在同一帧发送给独显IC,不能跨帧。
步骤5:独显IC解析屏幕背光控制命令,获取第一目标背光亮度Ln。独显IC的SDR2HDR模块基于初始背光亮度L0、亮度阈值Lth和第一目标背光亮度Ln对图像数据Dn进行处理。具体实现方式与图2所示实施例中的步骤4的具体实现方式相同,这里不再重复描述。
步骤6:独显IC将处理后的图像数据Dn和第一目标背光亮度Ln对应的屏幕背光控制命令发送给显示模组中的DDIC,由DDIC完成屏幕背光调整和显示驱动的工作。
步骤7:经过对n帧图像数据的处理后,屏幕的背光亮度由初始背光亮度800nit平滑过渡到第二目标背光亮度1600nit,实现SDR2HDR效果。
在本申请实施例中,在对图像进行处理时,由于可以根据屏幕的初始背光亮度、目标背光亮度和亮度阈值对图像数据的像素值进行调整,因此,可以实现对像素的显示亮度的调整,由于可以将屏幕的初始背光亮度提升至目标背光亮度,因此,可以提升屏幕的背光亮度,由于像素的显示亮度和屏幕的背光亮度与图像画面的对比度有关,因此,通过调整图像中像素的显示亮度以及提升屏幕的背光亮度,可以大幅提升图像画面的对比度,进一步改善图像的视觉效果。此外,由于在对图像进行处理时,不涉及图像格式的转换,因此,在显示处理后的图像时,无需终端设备支持相应的技术标准,从而可以避免对终端设备造成限制,适用范围更广。
本申请实施例中的图像处理装置可以是电子设备,也可以是电子设备中的部件,例如集成电路或芯片。该电子设备可以是终端,也可以为除终端之外的其他设备。示例性的,电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、移动上网装置(Mobile Internet Device,MID)、增强现实(augmented reality,AR)/虚拟现实(virtual reality,VR)设备、机器人、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本或者个人数字助理(personal digital assistant,PDA)等,还可以为服务器、网络附属存储器(Network Attached Storage,NAS)、个人计算机(personal computer,PC)、电视机(television,TV)、柜员机或者自助机等,本申请实施例不作具体限定。
本申请实施例中的图像处理装置可以为具有操作系统的装置。该操作系统可以为安卓(Android)操作系统,可以为ios操作系统,还可以为其他可能的操作系统,本申请实施例不作具体限定。
本申请实施例提供一种电子设备,该电子设备可以包括本申请实施例提供的图像处理装置。该电子设备在对图像进行处理时,可以大幅提升画面的对比度,视觉效果更佳。
可选地,本申请提供一种图像处理方法,如图4所示。图4是根据本申请实施例的图像处理方法的流程示意图,该处理方法可以由图1所示的系统级芯片执行,可以包括以下步骤。
S42:确定屏幕的初始背光亮度、目标背光亮度和亮度阈值。
初始背光亮度可以是屏幕在显示待处理的图像数据时的背光亮度。
屏幕的目标背光亮度可以是在需要将初始背光亮度提升到的背光亮度。在一些实施方式中,在目标背光亮度大于或等于预设背光亮度的情况下,还可以开启显示面板的高亮度模式HBM。
亮度阈值是一个比较阈值,可以用于独立显示芯片确定图像数据中的不同区域,以便独立显示芯片在对图像数据的像素值进行调整时,可以对图像数据的不同区域的像素值进行不同程度的调整。在一些实施方式中,确定亮度阈值,可以包括:
根据初始背光亮度和预设系数确定亮度阈值,预设系数大于0且小于1。
比如,可以将初始背光亮度和预设系数的乘积确定为亮度阈值。
S44:将初始背光亮度和亮度阈值发送给独立显示芯片进行初始化。
S46:在确定独立显示芯片完成初始化的情况下,将待处理的图像数据和目标背光亮度发送给独立显示芯片,初始背光亮度、目标背光亮度和亮度阈值用于独立显示芯片对图像数据的像素值进行调整,并将调整后的图像数据和目标背光亮度发送给显示面板,由显示面板基于目标背光亮度显示调整后的图像数据。
待处理的图像数据可以是一帧图像数据或多帧图像数据,在多帧图像数据的情况下,该多帧图像数据可以是同一视频中的多帧连续的图像数据,该视频比如可以是SDR视频。
在一些实施方式中,在待处理的图像数据为视频中的多帧连续的图像数据的情况下,待处理的图像数据可以包括过渡帧对应的第一图像数据和非过渡帧对应的第二图像数据。目标背光亮度包括第一图像数据对应的第一目标背光亮度和第二图像数据对应的第二目标背光亮度,第一目标背光亮度小于第二目标背光亮度。这样,在将待处理的图像数据和目标背光亮度发送给独立显示芯片时,可以包括:
先将第一图像数据和第一目标背光亮度发送给独立显示芯片,再将第二图像数据和第二目标背光亮度发送给独立显示芯片。
在目标背光亮度包括第一目标背光亮度和第二目标背光亮度的情况下,在确定目标背光亮度时,还可以包括:
根据初始背光亮度和提亮倍数确定第二目标背光亮度;
确定过渡帧的数量;
根据过渡帧的数量、初始背光亮度和第二目标背光亮度确定第一目标背光亮度。
上述S42至S46中各步骤的具体实现方式可以参见图1所示实施例中的系统级芯片所执行的相应步骤的具体实现,并可以实现相应的技术效果,这里都不再重复说明。
可选地,本申请还提供一种图像处理方法,如图5所示。图5是根据本申请实施例的图像处理方法的流程示意图,该处理方法可以由图1所示的独立显示芯片执行,可以包括以下步骤。
S52:接收系统级芯片发送的屏幕的初始背光亮度和亮度阈值。
S54:根据初始背光亮度和亮度阈值进行初始化。
S56:在完成初始化的情况下,接收所系统级芯片发送的待处理的图像数据和目标背光亮度。
S58:根据初始背光亮度、目标背光亮度和亮度阈值,对图像数据的像素值进行调整。
在一些实施方式中,根据初始背光亮度、目标背光亮度和亮度阈值,对所述图像数据的像素值进行调整,可以包括:
确定图像数据中的每个像素值在初始背光亮度下的第一灰阶值以及亮度阈值在初始屏幕亮度下的第二灰阶值;
根据第一灰阶值和第二灰阶值,确定图像数据的低亮度区域和高亮度区域;
根据目标背光亮度对低亮度区域内的像素值以及高亮度区域内的像素值进行调整。
在一些实施方式中,根据目标背光亮度对低亮度区域内的像素值以及高亮度区域内的像素值进行调整,包括:
根据目标背光亮度将低亮度区域的像素值调小,高亮度区域的像素值保持不变;或,
根据目标背光亮度将低亮度区域的像素值调小,将高亮度区域的像素值调大。
在一些实施方式中,根据目标背光亮度将低亮度区域的像素值调小,可以包括:
根据初始背光亮度和目标背光亮度确定调整系数,根据调整系数将低亮度区域的像素值调小。
S510:将调整后的图像数据和目标背光亮度发送给显示面板,由显示面板基于目标背光亮度显示调整后的图像数据。
上述S52至S510中各步骤的具体实现方式可以参见图1所示实施例中的独立显示芯片所执行的相应步骤的具体实现,并可以实现相应的技术效果,这里都不再重复说明。
可选地,如图6所示,本申请实施例还提供一种电子设备600,包括处理器601和存储器602,存储器602上存储有可在所述处理器601上运行的程序或指令,该程序或指令被处理器601执行时实现上述图像处理方法实施例的各个步骤,且能达到相同的技术效果,为避免重复,这里不再赘述。
需要说明的是,本申请实施例中的电子设备包括上述所述的移动电子设备和非移动电子设备。
图7为实现本申请实施例的一种电子设备的硬件结构示意图。
该电子设备700包括但不限于:射频单元701、网络模块702、音频输出单元703、输入单元704、传感器705、显示单元706、用户输入单元707、接口单元708、存储器709、以及处理器710等部件。
本领域技术人员可以理解,电子设备700还可以包括给各个部件供电的电源(比如电池),电源可以通过电源管理系统与处理器710逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。图7中示出的电子设备结构并不构成对电子设备的限定,电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置,在此不再赘述。
其中,处理器710,用于:
确定屏幕的初始背光亮度、目标背光亮度和亮度阈值;
将所述初始背光亮度和所述亮度阈值发送给独立显示芯片进行初始化;
在确定所述独立显示芯片完成初始化的情况下,将待处理的图像数据和所述目标背光亮度发送给所述独立显示芯片,所述初始背光亮度、所述目标背光亮度和所述亮度阈值用于所述独立显示芯片对所述图像数据的像素值进行调整,并将调整后的图像数据和所述目标背光亮度发送给显示面板,由所述显示面板基于所述目标背光亮度显示所述调整后的图像数据。
或者,处理器710,用于:
根据所述初始背光亮度和所述亮度阈值进行初始化;
在完成初始化的情况下,接收所述系统级芯片发送的待处理的图像数据和目标背光亮度;
根据所述初始背光亮度、所述目标背光亮度和所述亮度阈值,对所述图像数据的像素值进行调整;
将调整后的图像数据和所述目标背光亮度发送给显示面板,由所述显示面板基于所述目标背光亮度显示所述调整后的图像数据。
这样,在对图像进行处理时,由于可以根据屏幕的初始背光亮度、目标背光亮度和亮度阈值对图像数据的像素值进行调整,因此,可以实现对像素的显示亮度的调整,由于可以将屏幕的初始背光亮度提升至目标背光亮度,因此,可以提升屏幕的背光亮度,由于像素的显示亮度和屏幕的背光亮度与图像画面的对比度有关,因此,通过调整图像中像素的显示亮度以及提升屏幕的背光亮度,可以大幅提升图像画面的对比度,进一步改善图像的视觉效果。此外,由于在对图像进行处理时,不涉及图像格式的转换,因此,在显示处理后的图像时,无需终端设备支持相应的技术标准,从而可以避免对终端设备造成限制,适用范围更广。
应理解的是,本申请实施例中,输入单元704可以包括图形处理器(Graphics Processing Unit,GPU)7041和麦克风7042,图形处理器7041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。显示单元706可包括显示面板7061,可以采用液晶显示器、有机发光二极管等形式来配置显示面板7061。用户输入单元707包括触控面板7071以及其他输入设备7072中的至少一种。触控面板7071,也称为触摸屏。触控面板7071可包括触摸检测装置和触摸控制器两个部分。其他输入设备7072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆,在此不再赘述。
存储器709可用于存储软件程序以及各种数据。存储器709可主要包括存储程序或指令的第一存储区和存储数据的第二存储区,其中,第一存储区可存储操作系统、至少一个功能所需的应用程序或指令(比如声音播放功能、图像播放功能等)等。此外,存储器709可以包括易失性存储器或非易失性存储器,或者,存储器709可以包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(Read-Only Memory,ROM)、可编程只读存储器(Programmable ROM,PROM)、可擦除可编程只读存储器(Erasable PROM,EPROM)、电可擦除可编程只读存储器(Electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory,RAM),静态随机存取存储器(Static RAM,SRAM)、动态随机存取存储器(Dynamic RAM,DRAM)、同步动态随机存取存储器(Synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM,DDRSDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(Synch link DRAM,SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM,DRRAM)。本申请实施例中的存储器709包括但不限于这些和任意其它适合类型的存储器。
处理器710可包括一个或多个处理单元;可选的,处理器710集成应用处理器和调制解调处理器,其中,应用处理器主要处理涉及操作系统、用户界面和应用程序等的操作,调制解调处理器主要处理无线通信信号,如基带处理器。可以理解的是,上述调制解调处理器也可以不集成到处理器710中。
本申请实施例还提供一种可读存储介质,所述可读存储介质上存储有程序或指令,该程序或指令被处理器执行时实现上述图像处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。
其中,所述处理器为上述实施例中所述的电子设备中的处理器。所述可读存储介质,包括计算机可读存储介质,如计算机只读存储器ROM、随机存取存储器RAM、磁碟或者光盘等。
本申请实施例另提供了一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现上述图像处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。
应理解,本申请实施例提到的芯片还可以称为系统级芯片、系统芯片、芯片系统或片上系统芯片等。
本申请实施例提供一种计算机程序产品,该程序产品被存储在存储介质中,该程序产品被至少一个处理器执行以实现如上述图像处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外,需要指出的是,本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能,还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能,例如,可以按不同于所描述的次序来执行所描述的方法,并且还可以添加、省去、或组合各种步骤。另外,参照某些示例所描述的特征可在其他示例中被组合。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以计算机软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端(可以是手机,计算机,服务器,或者网络设备等)执行本申请各个实施例所述的方法。
上面结合附图对本申请的实施例进行了描述,但是本申请并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本申请的启示下,在不脱离本申请宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本申请的保护之内。

Claims (12)

  1. 一种图像处理装置,包括系统级芯片、独立显示芯片和显示面板,其中:
    所述系统级芯片用于确定屏幕的初始背光亮度、目标背光亮度和亮度阈值,将所述初始背光亮度和所述亮度阈值发送给所述独立显示芯片进行初始化,在确定所述独立显示芯片完成初始化的情况下,将待处理的图像数据和所述目标背光亮度发送给所述独立显示芯片;
    所述独立显示芯片用于根据所述初始背光亮度和所述亮度阈值进行初始化,在完成初始化的情况下,根据所述初始背光亮度、所述目标背光亮度和所述亮度阈值对所述图像数据的像素值进行调整,将调整后的图像数据和所述目标背光亮度发送给所述显示面板;
    所述显示面板用于基于所述目标背光亮度显示所述调整后的图像数据。
  2. 根据权利要求1所述的装置,其中,在所述待处理的图像数据为视频中的图像数据的情况下,所述待处理的图像数据包括过渡帧对应的第一图像数据和非过渡帧对应的第二图像数据;所述目标背光亮度包括所述第一图像数据对应的第一目标背光亮度和所述第二图像数据对应的第二目标背光亮度,所述第一目标背光亮度小于所述第二目标背光亮度;
    其中,所述系统级芯片用于将待处理的图像数据和所述目标背光亮度发送给所述独立显示芯片,包括:
    所述系统级芯片用于先将所述第一图像数据和所述第一目标背光亮度发送给所述独立显示芯片,再将所述第二图像数据和所述第二目标背光亮度发送给所述独立显示芯片。
  3. 根据权利要求2所述的装置,其中,所述系统级芯片还用于:
    根据所述初始背光亮度和提亮倍数确定所述第二目标背光亮度;
    确定所述过渡帧的数量;
    根据所述过渡帧的数量、所述初始背光亮度和所述第二目标背光亮度确定所述第一目标背光亮度。
  4. 根据权利要求1所述的装置,其中,所述系统级芯片用于确定所述亮度阈值,包括:
    所述系统级芯片用于根据所述初始背光亮度和预设系数确定所述亮度阈值,所述预设系数大于0且小于1。
  5. 根据权利要求1所述的装置,其中,在所述目标背光亮度大于或等于预设背光亮度的情况下,所述系统级芯片还用于开启所述显示面板的高亮度模式HBM。
  6. 根据权利要求1所述的装置,其中,所述独立显示芯片用于根据所述初始背光亮度、所述目标背光亮度和所述亮度阈值,对所述图像数据的像素值进行调整,包括:
    所述独立显示芯片用于确定所述图像数据中的每个像素值在所述初始背光亮度下的第一灰阶值以及所述亮度阈值在所述初始背光亮度下的第二灰阶值;
    所述独立显示芯片用于根据所述第一灰阶值和所述第二灰阶值,确定所述图像数据的低亮度区域和高亮度区域;
    所述独立显示芯片用于根据所述目标背光亮度对所述低亮度区域内的像素值以及所述高亮度区域内的像素值进行调整。
  7. 根据权利要求6所述的装置,其中,所述独立显示芯片用于根据所述目标背光亮度对所述低亮度区域内的像素值以及所述高亮度区域内的像素值进行调整,包括:
    所述独立显示芯片用于根据所述目标背光亮度将所述低亮度区域的像素值调小,所述高亮度区域的像素值保持不变;或,
    所述独立显示芯片用于根据所述目标背光亮度将所述低亮度区域的像素值调小,将所述高亮度区域的像素值调大。
  8. 根据权利要求7所述的装置,其中,所述独立显示芯片用于根据所述目标背光亮度将所述低亮度区域的像素值调小,包括:
    所述独立显示芯片用于根据所述初始背光亮度和所述目标背光亮度确定调整系数,根据所述调整系数将所述低亮度区域的像素值调小。
  9. 一种电子设备,包括权利要求1至8任一项所述的图像处理装置。
  10. 一种图像处理方法,包括:
    确定屏幕的初始背光亮度、目标背光亮度和亮度阈值;
    将所述初始背光亮度和所述亮度阈值发送给独立显示芯片进行初始化;
    在确定所述独立显示芯片完成初始化的情况下,将待处理的图像数据和所述目标背光亮度发送给所述独立显示芯片,所述初始背光亮度、所述目标背光亮度和所述亮度阈值用于所述独立显示芯片对所述图像数据的像素值进行调整,并将调整后的图像数据和所述目标背光亮度发送给显示面板,由所述显示面板基于所述目标背光亮度显示所述调整后的图像数据。
  11. 一种图像处理方法,包括:
    接收系统级芯片发送的屏幕的初始背光亮度和亮度阈值;
    根据所述初始背光亮度和所述亮度阈值进行初始化;
    在完成初始化的情况下,接收所述系统级芯片发送的待处理的图像数据和目标背光亮度;
    根据所述初始背光亮度、所述目标背光亮度和所述亮度阈值,对所述图像数据的像素值进行调整;
    将调整后的图像数据和所述目标背光亮度发送给显示面板,由所述显示面板基于所述目标背光亮度显示所述调整后的图像数据。
  12. 一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如权利要求10或11所述的图像处理方法的步骤。
PCT/CN2025/083691 2024-03-26 2025-03-20 图像处理装置、方法和电子设备 Pending WO2025201159A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202410353072.8A CN118101865A (zh) 2024-03-26 2024-03-26 图像处理装置、方法和电子设备
CN202410353072.8 2024-03-26

Publications (1)

Publication Number Publication Date
WO2025201159A1 true WO2025201159A1 (zh) 2025-10-02

Family

ID=91163527

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2025/083691 Pending WO2025201159A1 (zh) 2024-03-26 2025-03-20 图像处理装置、方法和电子设备

Country Status (2)

Country Link
CN (1) CN118101865A (zh)
WO (1) WO2025201159A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118101865A (zh) * 2024-03-26 2024-05-28 维沃移动通信有限公司 图像处理装置、方法和电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210166638A1 (en) * 2019-05-06 2021-06-03 Beijing Boe Optoelectronics Technology Co., Ltd. Backlight control method and apparatus for backlight module, display device
CN113053327A (zh) * 2021-03-22 2021-06-29 京东方科技集团股份有限公司 显示驱动装置及显示驱动方法、显示设备
CN115457920A (zh) * 2022-09-09 2022-12-09 展讯通信(上海)有限公司 图像处理方法、装置及设备
CN116466899A (zh) * 2022-01-12 2023-07-21 华为技术有限公司 图像处理方法及电子设备
CN117373396A (zh) * 2023-11-07 2024-01-09 维沃移动通信有限公司 电子设备
CN118101865A (zh) * 2024-03-26 2024-05-28 维沃移动通信有限公司 图像处理装置、方法和电子设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210166638A1 (en) * 2019-05-06 2021-06-03 Beijing Boe Optoelectronics Technology Co., Ltd. Backlight control method and apparatus for backlight module, display device
CN113053327A (zh) * 2021-03-22 2021-06-29 京东方科技集团股份有限公司 显示驱动装置及显示驱动方法、显示设备
CN116466899A (zh) * 2022-01-12 2023-07-21 华为技术有限公司 图像处理方法及电子设备
CN115457920A (zh) * 2022-09-09 2022-12-09 展讯通信(上海)有限公司 图像处理方法、装置及设备
CN117373396A (zh) * 2023-11-07 2024-01-09 维沃移动通信有限公司 电子设备
CN118101865A (zh) * 2024-03-26 2024-05-28 维沃移动通信有限公司 图像处理装置、方法和电子设备

Also Published As

Publication number Publication date
CN118101865A (zh) 2024-05-28

Similar Documents

Publication Publication Date Title
CN109783178B (zh) 一种界面组件的颜色调整方法、装置、设备和介质
JP4779995B2 (ja) 画像表示装置及び電子機器
EP3745390A1 (en) Transitioning between video priority and graphics priority
US12598394B2 (en) Image processing method and apparatus, and electronic device
US20240346616A1 (en) Image processing method and apparatus, and electronic device
CN112367557B (zh) Led电视墙的显示方法、电视和计算机可读存储介质
CN104269155A (zh) 一种调整屏幕刷新频率的方法及装置
US20250006119A1 (en) Display control chip, display panel, and related device, method, and apparatus
EP4459976A1 (en) Image processing circuit, image processing method, electronic device, and readable storage medium
CN111510773A (zh) 一种分辨率调整方法、显示屏、计算机存储介质和设备
WO2020056744A1 (zh) 拖影评价、改善方法和电子设备
WO2023125677A1 (zh) 独显插帧电路、方法、装置、芯片、电子设备及介质
US20090160945A1 (en) Systems and Methods for Enhancing Image Quality of a Web Camera Image
WO2025201159A1 (zh) 图像处理装置、方法和电子设备
CN111901519A (zh) 屏幕补光方法、装置及电子设备
WO2024251062A1 (zh) 增益图的生成方法、装置、电子设备及介质
US20050237432A1 (en) Apparatus, method, and program for processing image
CN115641824B (zh) 画面调整设备、显示设备及画面调整方法
CN1725291A (zh) 信息处理设备及显示控制方法
WO2025214317A1 (zh) 一种电源模块的控制方法、装置、设备和存储介质
JP2004198512A (ja) 表示装置及び表示方法
CN117079608A (zh) 显示控制方法、装置、电子设备及可读存储介质
CN115035850B (zh) 亮度调节方法及其装置
WO2024001829A1 (zh) Hdr图像编辑方法、装置、电子设备及可读存储介质
KR102079880B1 (ko) 투명 디스플레이 장치 및 투명 디스플레이 장치의 영상 출력 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 25778484

Country of ref document: EP

Kind code of ref document: A1