WO2023273844A1 - 一种显示方法及电子设备 - Google Patents

一种显示方法及电子设备 Download PDF

Info

Publication number
WO2023273844A1
WO2023273844A1 PCT/CN2022/098236 CN2022098236W WO2023273844A1 WO 2023273844 A1 WO2023273844 A1 WO 2023273844A1 CN 2022098236 W CN2022098236 W CN 2022098236W WO 2023273844 A1 WO2023273844 A1 WO 2023273844A1
Authority
WO
WIPO (PCT)
Prior art keywords
brightness
image
area
display
fingerprint identification
Prior art date
Application number
PCT/CN2022/098236
Other languages
English (en)
French (fr)
Inventor
孙家亮
徐铠
李睿哲
申孟虎
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP22831664.2A priority Critical patent/EP4350537A1/en
Publication of WO2023273844A1 publication Critical patent/WO2023273844A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/22Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
    • G09G3/30Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
    • G09G3/32Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/22Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
    • G09G3/30Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
    • G09G3/32Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
    • G09G3/3208Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/22Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
    • G09G3/30Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
    • G09G3/32Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
    • G09G3/3208Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]
    • G09G3/3225Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED] using an active matrix
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00Aspects of interface with display user
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/03Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes specially adapted for displays having non-planar surfaces, e.g. curved displays
    • G09G3/035Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes specially adapted for displays having non-planar surfaces, e.g. curved displays for flexible display surfaces

Definitions

  • the present application relates to the technical field of computers, in particular to a display method and electronic equipment.
  • Fingerprint recognition technology is widely used in electronic devices, such as optical fingerprint recognition technology: electronic devices can display specific shapes and specific brightness spots (such as elliptical or circular highlight spots) in the fingerprint recognition area on the display screen. When the finger acts on the light spot, the electronic device can collect the user's optical fingerprint information to realize functions such as fingerprint unlocking, fingerprint payment, and fingerprint photography.
  • optical fingerprint recognition technology electronic devices can display specific shapes and specific brightness spots (such as elliptical or circular highlight spots) in the fingerprint recognition area on the display screen. When the finger acts on the light spot, the electronic device can collect the user's optical fingerprint information to realize functions such as fingerprint unlocking, fingerprint payment, and fingerprint photography.
  • Embodiments of the present application provide a display method and an electronic device, which can improve the display effect of optical fingerprint recognition and improve user experience.
  • the embodiment of the present application provides an electronic device, the electronic device includes an application processor AP and a display screen, the display screen includes a display driver chip DDIC and a display panel, wherein: the display panel is used to display the first Image; the above-mentioned AP is used to send the first indication information and the first parameter to the above-mentioned DDIC; the above-mentioned DDIC is used to control the brightness of the fingerprint recognition area in the above-mentioned first image to the first brightness based on the received first indication information , and controlling the brightness of the mask area in the first image to be the second brightness, the brightness of the mask area is controlled based on the first parameter, and the mask area is an area other than the fingerprint recognition area in the first image
  • the display panel is configured to display the updated first image, the brightness of the fingerprint recognition area in the updated first image is the first brightness, and the brightness of the mask area is the second brightness.
  • the first image is an image before fingerprint identification
  • the updated first image is an image during fingerprint identification.
  • the brightness of the first image is the second brightness.
  • the first brightness is greater than the second brightness and greater than or equal to a preset brightness value.
  • the electronic device collects the optical fingerprint information of the finger acting on the touch operation of the fingerprint recognition area.
  • DDIC can send the first instruction information based on the AP, and at the same time control the brightness of the fingerprint recognition area, and control the brightness of the mask area through the first parameter sent by the AP (which can be understood as updating the first image), avoiding the splash screen .
  • the AP does not need to draw the updated first image, which simplifies the processing flow on the AP side and improves the recognition speed.
  • the updated first image will not be processed by the color module on the AP side, which can ensure that the display modes such as eye protection mode and vivid mode will not be turned off when displaying the updated first image, avoiding user public opinion, and can also ensure masking Areas are better displayed.
  • the gray scale of the pixels in the display panel ranges from 0 to 255, and the first value is 255. In some embodiments, the value range of the DBV of the pixel in the display panel is 0-4095, and the second value is 4095.
  • the AP is further configured to send the brightness code of the fingerprint identification area to the DDIC, and the brightness code is used to indicate at least one of the following: brightness, color, shape, size, position; the DDIC Controlling the brightness of the fingerprint identification area in the first image to be the first brightness includes: controlling the display of the fingerprint identification area in the first image based on the received brightness code.
  • the DDIC controlling the brightness of the fingerprint identification area in the first image to be the first brightness includes: controlling the display of the fingerprint identification area in the first image based on a preset brightness code.
  • the dimming mode of the above-mentioned display screen is direct current regulation DC
  • the above-mentioned first parameter is based on the above-mentioned The dimming mode of the display, and the alpha value determined by the gray scale of the masked area above.
  • the dimming mode of the display screen is PWM, and the first parameter is less than 1; when the display panel displays the first image, If the dimming mode of the above-mentioned display screen is DC, then the above-mentioned first parameter is equal to 1.
  • the fingerprint identification area includes a first fingerprint identification area and a second fingerprint identification area
  • the DDIC includes a first DDIC and a second DDIC
  • the first DDIC is configured to An indication information for controlling the brightness of the first fingerprint identification area in the first image
  • the second DDIC is used for controlling the brightness of the second fingerprint identification area in the first image based on the received first indication information .
  • the display methods such as the number and position of fingerprint recognition areas can be flexibly configured according to actual needs, and the brightness of different fingerprint recognition areas can be controlled through different DDICs, so as to avoid excessive processing pressure caused by a single DDIC controlling multiple fingerprint recognition areas .
  • the communication device is an application processor AP.
  • the first image is an image before fingerprinting.
  • the image displayed after controlling the brightness of the fingerprint identification area and the mask area in the first image displayed on the display screen, that is, the updated first image is an image during fingerprint identification.
  • the brightness of the first image is the second brightness.
  • the first brightness is greater than the second brightness and greater than or equal to a preset brightness value.
  • the display screen can control the brightness of the fingerprint recognition area based on the first indication information sent by the AP, and control the brightness of the mask area through the first parameter sent by the AP (which can be understood as updating the first image) to avoid flickering.
  • the AP does not need to draw the updated first image, which simplifies the processing flow on the AP side and improves the recognition speed.
  • the updated first image will not be processed by the color module on the AP side, which can ensure that the display modes such as eye protection mode and vivid mode will not be turned off when displaying the updated first image, avoiding user public opinion, and can also ensure masking Areas are better displayed.
  • the parameters used to control the display of the fingerprint identification area may be parameters configured by the AP in real time according to different scenarios, which has stronger adaptability and wider application scenarios.
  • the embodiment of the present application provides yet another communication device, including a processor, a memory, and a communication interface, wherein: the processor is used to control the display panel of the display screen to display the first image; the communication interface is used to receiving the first instruction information and the first parameter, and transmitting the above-mentioned first instruction information and the above-mentioned first parameter to the above-mentioned processor; the above-mentioned processor is configured to control
  • the brightness of the fingerprint identification area is the first brightness
  • the brightness of the mask area in the first image is controlled to be the second brightness.
  • the brightness of the mask area is controlled based on the first parameter, and the mask area is the first brightness.
  • the area in the image other than the fingerprint identification area; the processor is configured to control the display panel to display the updated first image, the brightness of the fingerprint identification area in the updated first image is the first brightness, and the mask The brightness of the plate area is the above-mentioned second brightness.
  • the communication device is a display driver chip DDIC of the display screen.
  • the first indication information and the first parameter received by the communication interface are sent by the application processor AP.
  • the first image is an image before fingerprint identification
  • the updated first image is an image during fingerprint identification.
  • the brightness of the first image is the second brightness.
  • the first brightness is greater than the second brightness and greater than or equal to a preset brightness value.
  • DDIC can simultaneously control the brightness of the fingerprint identification area based on the received first instruction information, and control the brightness of the mask area through the received first parameter (which can be understood as updating the first image), avoiding flickering. Screen.
  • the AP does not need to draw the updated first image, which simplifies the processing flow on the AP side and improves the recognition speed.
  • the updated first image will not be processed by the color module on the AP side, which can ensure that the display modes such as eye protection mode and vivid mode will not be turned off when displaying the updated first image, avoiding user public opinion, and can also ensure masking Areas are better displayed.
  • the processor controls the brightness of the fingerprint identification area in the first image to be the first brightness, including: setting the gray scale of the pixels in the fingerprint identification area to a first value, and displaying the brightness value DBV is set to the second value, the value of the gray scale of the pixel in the above-mentioned display panel is less than or equal to the above-mentioned first value, the DBV of the pixel in the above-mentioned display panel is less than or equal to the above-mentioned second value, and the gray scale corresponding to the above-mentioned first brightness is For the above first value, the corresponding DBV is the above second value.
  • the gray scale of the pixels in the display panel ranges from 0 to 255, and the first value is 255. In some embodiments, the value range of the DBV of the pixel in the display panel is 0-4095, and the second value is 4095.
  • the above-mentioned communication interface is also used to receive the brightness code of the above-mentioned fingerprint recognition area, and transmit the above-mentioned brightness code to the above-mentioned processor, and the above-mentioned brightness code is used to indicate at least one of the following: brightness, color , shape, size, position; the processor controls the brightness of the fingerprint identification area in the first image to be the first brightness, including: controlling the display of the fingerprint identification area in the first image based on the received brightness code.
  • controlling the brightness of the fingerprint identification area in the first image to be the first brightness includes: controlling the display of the fingerprint identification area in the first image based on a preset brightness code.
  • the brightness of the above-mentioned fingerprint identification area in the above-mentioned updated first image is greater than the brightness of the above-mentioned fingerprint identification area in the above-mentioned first image; the brightness of the above-mentioned mask area in the above-mentioned updated first image is
  • the brightness and display content are the same as the brightness and display content of the above-mentioned mask area in the above-mentioned first image.
  • the dimming mode of the display screen is direct current regulation DC, and the first parameter is based on the value of the display screen controlled by the processor.
  • the processor controls the display panel of the display screen to display the first image
  • the dimming mode of the display screen is PWM
  • the first parameter is less than 1
  • the processor controls the display
  • the dimming mode of the display screen is DC
  • the first parameter is equal to 1.
  • the processor controls the display panel of the display screen to display the first image
  • the dimming mode of the display screen is PWM
  • the gray scale of the mask area is the first gray scale
  • the processor is further configured to switch the dimming mode of the display screen to DC based on the received first instruction information
  • the processor controls the brightness of the mask area in the first image to be the second brightness, including: After the dimming mode of the display screen is switched to DC, the second grayscale corresponding to the mask area is multiplied by the first parameter, and the second grayscale is higher than the first grayscale; the processor controls the display panel to update In the subsequent first image, the grayscale of the mask area is the first grayscale obtained by multiplying the second grayscale by the first parameter, and the grayscale corresponding to the second brightness is the first grayscale.
  • the first parameter is equal to the ratio of the first gray scale to the second gray scale.
  • the above-mentioned display screen is a folding screen.
  • an embodiment of the present application provides a display method, which is applied to an electronic device.
  • the electronic device includes an application processor AP and a display screen, and the display screen includes a display driver chip DDIC and a display panel.
  • the method includes: the above display The panel displays the first image; the AP sends the first indication information and the first parameter to the DDIC; the DDIC controls the brightness of the fingerprint identification area in the first image to be the first brightness based on the received first indication information, and Controlling the brightness of the mask area in the first image to be the second brightness, the brightness of the mask area is controlled based on the first parameter, and the mask area is an area other than the fingerprint identification area in the first image;
  • the display panel displays the updated first image, the brightness of the fingerprint recognition area in the updated first image is the first brightness, and the brightness of the mask area is the second brightness.
  • the first image is an image before fingerprint identification
  • the updated first image is an image during fingerprint identification.
  • the brightness of the first image is the second brightness.
  • the first brightness is greater than the second brightness and greater than or equal to a preset brightness value.
  • the electronic device collects the optical fingerprint information of the finger acting on the touch operation of the fingerprint recognition area.
  • DDIC can send the first instruction information based on the AP, and at the same time control the brightness of the fingerprint recognition area, and control the brightness of the mask area through the first parameter sent by the AP (which can be understood as updating the first image), avoiding the splash screen .
  • the AP does not need to draw the updated first image, which simplifies the processing flow on the AP side and improves the recognition speed.
  • the updated first image will not be processed by the color module on the AP side, which can ensure that the display modes such as eye protection mode and vivid mode will not be turned off when displaying the updated first image, avoiding user public opinion, and can also ensure masking Areas are better displayed.
  • the controlling the brightness of the fingerprint identification area in the first image to the first brightness includes: setting the grayscale of the pixel in the fingerprint identification area to the first value, and setting the display brightness value DBV to is the second value, the value of the gray scale of the pixel in the display panel is less than or equal to the first value, the DBV of the pixel in the display panel is less than or equal to the second value, and the gray scale corresponding to the first brightness is the first value One value, the corresponding DBV is the above-mentioned second value.
  • the gray scale of the pixels in the display panel ranges from 0 to 255, and the first value is 255. In some embodiments, the value range of the DBV of the pixel in the display panel is 0-4095, and the second value is 4095.
  • the method further includes: the above-mentioned AP sends the brightness code of the fingerprint recognition area to the above-mentioned DDIC, and the above-mentioned brightness code is used to indicate at least one of the following: brightness, color, shape, size, position; Controlling the brightness of the fingerprint identification area in the first image to be the first brightness includes: controlling the display of the fingerprint identification area in the first image based on the received brightness code.
  • the parameters used to control the display of the fingerprint identification area may be parameters configured by the AP in real time according to different scenarios, which has stronger adaptability and wider application scenarios.
  • controlling the brightness of the fingerprint identification area in the first image to be the first brightness includes: controlling the display of the fingerprint identification area in the first image based on a preset brightness code.
  • the brightness of the above-mentioned fingerprint identification area in the above-mentioned updated first image is greater than the brightness of the above-mentioned fingerprint identification area in the above-mentioned first image; the brightness of the above-mentioned mask area in the above-mentioned updated first image is
  • the brightness and display content are the same as the brightness and display content of the above-mentioned mask area in the above-mentioned first image.
  • the dimming mode of the above-mentioned display screen is direct current regulation DC
  • the above-mentioned first parameter is based on the above-mentioned The dimming mode of the display, and the alpha value determined by the gray scale of the masked area above.
  • the dimming mode of the display screen is PWM, and the first parameter is less than 1; when the display panel displays the first image, If the dimming mode of the above-mentioned display screen is DC, then the above-mentioned first parameter is equal to 1.
  • the first parameter is equal to the ratio of the first gray scale to the second gray scale.
  • the fingerprint identification area includes a first fingerprint identification area and a second fingerprint identification area
  • the DDIC includes a first DDIC and a second DDIC
  • the DDIC controls the The brightness of the fingerprint identification area in the first image is the first brightness, including: the first DDIC controls the brightness of the first fingerprint identification area in the first image based on the received first indication information, and the second DDIC Controlling the brightness of the second fingerprint identification area in the first image based on the received first indication information.
  • the embodiment of the present application provides a computer program product, which, when the computer program product runs on the communication device, causes the communication device to execute the fourth aspect of the embodiment of the present application, and any implementation of the fourth aspect
  • the display method provided by method
  • Figures 1-4 are schematic structural views of some electronic devices provided by the embodiments of the present application.
  • Fig. 5 is a schematic diagram of a process of displaying a highlighted image of a fingerprint icon provided by an embodiment of the present application
  • FIGS. 7-8 are schematic diagrams of some user interface embodiments provided by the embodiments of the present application.
  • FIG. 9 is a schematic flowchart of a display method provided by an embodiment of the present application.
  • Fig. 10 is a schematic diagram of a dimming mode of a display screen provided by an embodiment of the present application.
  • 11-12 are schematic diagrams of some electronic devices provided by the embodiments of the present application.
  • the electronic devices involved in the embodiments of the present application may be mobile terminals such as mobile phones, tablet computers, handheld computers, personal digital assistants (Personal Digital Assistant, PDA), smart home devices such as smart TVs and smart cameras, smart bracelets, smart watches, Wearable devices such as smart glasses, or other devices such as desktops, laptops, notebooks, Ultra-mobile Personal Computers (UMPCs), netbooks, smart screens, etc.
  • PDA Personal Digital Assistant
  • smart home devices such as smart TVs and smart cameras
  • smart bracelets smart watches
  • Wearable devices such as smart glasses
  • UMPCs Ultra-mobile Personal Computers
  • netbooks smart screens, etc.
  • FIG. 1 exemplarily shows a schematic diagram of a hardware structure of an electronic device 100 .
  • the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, and a battery 142 , antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193 , a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.
  • the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100 .
  • the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc.
  • application processor application processor
  • AP application processor
  • modem processor graphics processing unit
  • graphics processing unit graphics processing unit
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit
  • NPU neural-network processing unit
  • different processing units may be independent devices, or may be integrated in one or more processors.
  • the multiple processing units shown above are all integrated in a system chip (system on chip, SoC), or the AP is a separate semiconductor chip, and other processing units are integrated in a SoC, which is not limited by
  • the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is a cache memory.
  • the memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.
  • the processor 110 may include one or more communication interfaces (interfaces for short).
  • the interface may include: integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, general asynchronous transceiver Transmitter (universal asynchronous receiver/transmitter, UART) interface, MIPI, general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and/or universal serial bus ( universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • PCM pulse code modulation
  • MIPI general asynchronous transceiver Transmitter
  • general-purpose input and output general-purpose input/output, GPIO
  • subscriber identity module subscriber identity module
  • SIM subscriber identity module
  • the MIPI interface can be used to connect the processor 110 with peripheral devices such as the camera 193 and the display screen 194 .
  • the MIPI interface may include a display serial interface (display serial interface, DSI), a camera serial interface (camera serial interface, CSI), and the like.
  • the processor 110 communicates with the camera 193 through the CSI interface to realize the shooting function of the electronic device 100 .
  • the processor 110 communicates with the display screen 194 through a DSI interface to realize the display function of the electronic device 100 .
  • the interface connection relationship between the modules shown in the embodiment of the present invention is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 .
  • the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the charging management module 140 is configured to receive a charging input from a charger.
  • the charger may be a wireless charger or a wired charger.
  • the charging management module 140 can receive charging input from the wired charger through the USB interface 130 .
  • the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 100 . While the charging management module 140 is charging the battery 142 , it can also provide power for electronic devices through the power management module 141 .
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the power management module 141 receives the input from the battery 142 and/or the charging management module 140 to provide power for the processor 110 , the internal memory 121 , the display screen 194 , the camera 193 , and the wireless communication module 160 .
  • the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the power management module 141 may also be disposed in the processor 110 .
  • the power management module 141 and the charging management module 140 may also be set in the same device.
  • the wireless communication function of the electronic device 100 can be realized by the antenna 1 , the antenna 2 , the mobile communication module 150 , the wireless communication module 160 , a modem processor, a baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 100 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 100 .
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves through the antenna 1 for radiation.
  • at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.
  • a modem processor may include a modulator and a demodulator.
  • the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is passed to the application processor after being processed by the baseband processor.
  • the application processor outputs sound signals through audio equipment (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194 .
  • the modem processor may be a stand-alone device.
  • the modem processor may be independent of the processor 110, and be set in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wireless Fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite, etc. applied on the electronic device 100.
  • System global navigation satellite system, GNSS
  • frequency modulation frequency modulation, FM
  • near field communication technology near field communication, NFC
  • infrared technology infrared, IR
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR techniques, etc.
  • GSM global system for mobile communications
  • GPRS general packet radio service
  • code division multiple access code division multiple access
  • CDMA broadband Code division multiple access
  • WCDMA wideband code division multiple access
  • time division code division multiple access time-division code division multiple access
  • TD-SCDMA time-division code division multiple access
  • the GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • Beidou navigation satellite system beidou navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the electronic device 100 may implement a display function through a GPU, a display screen 194, an application processor, and the like.
  • the GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.
  • the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
  • a display screen 194 may include 1 or N DDICs.
  • the ISP is used for processing the data fed back by the camera 193 .
  • the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin color.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be located in the camera 193 .
  • Camera 193 is used to capture still images or video.
  • the object generates an optical image through the lens and projects it to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other image signals.
  • the electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs.
  • the electronic device 100 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the electronic device 100 can be realized through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. Such as saving music, video and other files in the external memory card.
  • the internal memory 121 may be used to store computer-executable program codes including instructions.
  • the internal memory 121 may include an area for storing programs and an area for storing data.
  • the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like.
  • the storage data area can store data created during the use of the electronic device 100 (such as audio data, phonebook, etc.) and the like.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.
  • the electronic device 100 can implement audio functions through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
  • the audio module 170 may also be used to encode and decode audio signals.
  • the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 .
  • Speaker 170A also referred to as a "horn" is used to convert audio electrical signals into sound signals.
  • Electronic device 100 can listen to music through speaker 170A, or listen to hands-free calls.
  • Receiver 170B also called “earpiece” is used to convert audio electrical signals into sound signals.
  • the receiver 170B can be placed close to the human ear to receive the voice.
  • the microphone 170C also called “microphone” or “microphone” is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can put his mouth close to the microphone 170C to make a sound, and input the sound signal to the microphone 170C.
  • the electronic device 100 may be provided with at least one microphone 170C. In some other embodiments, the electronic device 100 may be provided with two microphones 170C, which may also implement a noise reduction function in addition to collecting sound signals. In some other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions, etc.
  • the earphone interface 170D is used for connecting wired earphones.
  • the earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal.
  • pressure sensor 180A may be disposed in display screen 194 .
  • pressure sensors 180A such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors.
  • a capacitive pressure sensor may be comprised of at least two parallel plates with conductive material. When a force is applied to the pressure sensor, the capacitance between the electrodes changes.
  • the electronic device 100 determines the intensity of pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 may detect the intensity of the touch operation according to the pressure sensor 180A.
  • the electronic device 100 may also calculate the touch position according to the detection signal of the pressure sensor 180A, for example, determine that the touch operation is located in the fingerprint recognition area.
  • touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example but not limited to, when a touch operation with a pressure value less than the first pressure threshold acts on the short message application icon, an instruction to view short messages is executed. When a touch operation with a pressure value greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.
  • the touch sensor 180K is also called “touch device”.
  • the touch sensor 180K can be disposed in the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”.
  • the touch sensor 180K is used to detect a touch operation on or near it.
  • the touch sensor 180K can transmit the detected touch operation to the processor 110 to determine the type of the touch event. For example, when the display screen 194 displays the lock screen interface, the touch sensor 180K can transmit the detected touch operation acting on the fingerprint recognition area. For the AP, the AP can determine that the touch event type corresponding to the touch operation is fingerprint unlocking.
  • the electronic device 100 may provide a visual output related to the touch operation through the display screen 194.
  • the electronic device 100 displays the visual output related to the touch operation on the fingerprint identification area through the display screen 194: the brightness of the fingerprint identification area is increased.
  • the touch sensor 180K may also be disposed on the surface of the electronic device 100 , which is different from the position of the display screen 194 .
  • the fingerprint sensor 180H is used to collect fingerprints.
  • the fingerprint sensor 180H is disposed in the fingerprint recognition area of the display screen 194 , and in other embodiments, the fingerprint sensor 180H is disposed below the fingerprint recognition area of the display screen 194 .
  • the electronic device 100 can use the fingerprint sensor 180H to collect the optical fingerprint information of the finger acting on the fingerprint recognition area.
  • the electronic device 100 can use the collected fingerprint features to implement functions such as fingerprint unlocking, fingerprint payment, access to application locks, fingerprint photography, and fingerprint answering of incoming calls.
  • the ambient light sensor 180L is used for sensing ambient light brightness.
  • the electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness.
  • the DDIC in the display screen 194 controls the brightness of the fingerprint identification area, even if the ambient light brightness sensed by the ambient light sensor changes, it will ensure that the area outside the fingerprint identification area (abbreviated as Mongolian area) before and after the brightness adjustment of the fingerprint identification area The brightness of the plate area) does not change.
  • the gyro sensor 180B can be used to determine the motion posture of the electronic device 100 .
  • the angular velocity of the electronic device 100 around three axes may be determined by the gyro sensor 180B.
  • the gyro sensor 180B may be used to detect a lifting operation on the electronic device 100, for example, the electronic device 100 may display a user interface in fingerprint unlocking in response to the lifting operation.
  • the gyro sensor can also be used for shooting anti-shake, navigation, and somatosensory game scenes.
  • the keys 190 include a power key, a volume key and the like.
  • the key 190 may be a mechanical key. It can also be a touch button.
  • the electronic device 100 can receive key input and generate key signal input related to user settings and function control of the electronic device 100 .
  • the motor 191 can generate a vibrating reminder.
  • the motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.
  • touch operations applied to different applications may correspond to different vibration feedback effects.
  • the motor 191 can also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 194 .
  • Different application scenarios for example: time reminder, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like.
  • FIG. 2 exemplarily shows a schematic diagram of a hardware structure of another electronic device 100 .
  • the electronic device 100 can realize optical fingerprint recognition.
  • the user's finger generally acts on the fingerprint identification area in the display panel 222, and the light at the fingerprint identification area can be used to irradiate the finger and be detected by another receiving place (such as a fingerprint sensor). The reflection information of the light, and then obtain the optical fingerprint information. Therefore, during fingerprint identification, the brightness of the fingerprint identification area is usually very high, for example, higher than the brightness of other areas (referred to as the mask area) in the display panel 222 except the fingerprint identification area. Before fingerprint recognition, the brightness of the fingerprint recognition area is usually consistent with the brightness of the mask area. Before fingerprint recognition and during fingerprint recognition, the display effect of the fingerprint recognition area is different. For example, the fingerprint icon is displayed on the fingerprint recognition area before fingerprint recognition, and the color of the content displayed on the fingerprint recognition area is white during fingerprint recognition. Before and during fingerprint recognition, the display effect of the mask area remains unchanged, for example, the display content remains unchanged.
  • the brightness of the fingerprint recognition area is greater than or equal to a preset brightness value, for example, greater than or equal to 800 nits (nit), which may be referred to as highlighting of the fingerprint recognition area.
  • the brightness of the fingerprint identification area is greater than or equal to the preset brightness value and higher than the brightness of the mask area, which may be referred to as local highlighting of the fingerprint identification area.
  • the image drawn by the AP211 can be sent to the DDIC221 through a communication interface (such as MIPI), and the DDIC221 controls the display panel 222 to display.
  • the drawn image is, for example, the image displayed on the display screen 220 during optical fingerprint identification.
  • the electronic device 100 may include multiple APs 211, and the multiple APs 211 may belong to different manufacturers and different platforms. Electronic devices generally only include a display screen 220 from one manufacturer. In different scenarios, the electronic device 100 may use different APs 211 to draw images. For example, under fingerprint unlocking and fingerprint payment, the APs used to draw images are different, so it is likely that the mask area will be displayed before and during fingerprint recognition. The effect is different, and the user experience is not good.
  • AP211 can send instruction information to DDIC221 through a communication interface (such as MIPI), so that DDIC221 can control the brightness of the fingerprint identification area and the brightness of the mask area, and the display panel 222 can display fingerprint identification under the control of DDIC221.
  • a communication interface such as MIPI
  • AP211 instructs DDIC211 to realize partial highlighting of the fingerprint identification area. The image during fingerprint recognition does not need to be drawn by AP211, and does not depend on the manufacturer and platform of AP211, so the display effect is better and the user experience is improved.
  • the AP 211 may include a fingerprint spot module 211A, a communication interface 211B, a rendering module 211C, a sub pixel rearrangement (SPR) module 211D and a color module 211E.
  • the DDIC 221 of the display screen 220 may include a communication interface 2211 , a partial highlight module 2212 and a conversion module 2213 , for details, please refer to the electronic device 100 shown in FIG. 3 .
  • FIG. 3 only shows the AP 211 and the display screen 220 .
  • FIGS. 1-2 refer to the descriptions in FIGS. 1-2 .
  • the fingerprint spot module 211A may be used to determine first indication information, and the first indication information is used to indicate the image when the DDIC 221 determines the fingerprint identification.
  • the fingerprint spot module 211A can be used to determine the parameters for realizing the local highlighting of the fingerprint identification area.
  • the parameters can include the alpha (alpha) value used when the grayscale of the mask area is reduced, and the value range of the alpha value It is [0,1], the smaller the value, the stronger the effect of reducing the gray scale.
  • the alpha value can be used by DDIC221 to control the brightness of the mask area, so that the display effect of the mask area remains unchanged before and during fingerprint identification (for example, the display content and brightness remain unchanged).
  • this parameter may include the brightness code of the fingerprint identification area, and the brightness code may be used to indicate the brightness value of the fingerprint identification area, not limited thereto, and may also be used to indicate the number, size, location, and shape of the fingerprint identification area , color and other parameters.
  • the brightness code can be used for the DDIC221 to control the brightness of the fingerprint identification area, so that the fingerprint identification area is highlighted during fingerprint identification, so that the electronic device 100 can collect the optical fingerprint information of the finger acting on the touch operation of the fingerprint identification area.
  • the communication interface 211B may be a MIPI interface. Not limited thereto, in some other embodiments, the communication interface 211B may also be other communication interfaces such as a high definition multimedia interface (high definition multimedia interface, HDMI).
  • the communication interface 211B can be used to send data and/or instructions to the DDIC221, such as the first indication information determined by the fingerprint spot module 211A, the parameters for realizing the local highlighting of the fingerprint identification area, etc., and the image determined by the drawing module 211C (through the SPR module 211D and The color module 211E processes and transmits to the communication interface 211B) and the like.
  • the drawing module 211C may be used to draw images, and the drawn images are sent to the display screen 220 for display.
  • the drawing module 211C may draw an image during fingerprint recognition (for example, an image including an animation effect of fingerprint unlocking), and a specific example may be shown in FIG. 6 below.
  • the drawing module 211C may also draw an image before fingerprint recognition (such as a lock screen interface, etc.), and an image after fingerprint recognition (such as a desktop of the electronic device 100 or an interface of an application program, etc.).
  • the SPR module 211D can be used to perform SPR processing on the image obtained by the rendering module 211C.
  • the pixels inside the display panel may not be arranged in a real (real) three primary color light mode (red green blue, RGB): a pixel includes three sub-pixels R, G, and B, that is, R and G are respectively lit. and B these three sub-pixels, this one pixel is displayed as white.
  • a pixel inside the display panel may be composed of at least one sub-pixel among three sub-pixels R, G, and B. For example, a pixel 1 includes an R sub-pixel and a G sub-pixel, and another pixel 2 includes a B sub-pixel and a G pixels.
  • the SPR processing can realize "borrowing" the B sub-pixel of pixel 2 to "complement” the missing B pixel of pixel 1, and light up the B sub-pixel of pixel 2 to form a white pixel 1. Therefore, the SPR processing can reduce the amount of image data transmitted between the AP211 and the DDIC221, thereby reducing transmission bandwidth and power consumption. Understandably, compared to DDIC221 with a 40 nanometer (nm) process, the AP211 adopts a better process, such as 7nm or 5nm. The power consumption of the same SPR algorithm running on the AP211 side is lower than that running on the DDIC221 side, and one electronic device 100 can use a set of SPR algorithms to meet the requirements.
  • the SPR algorithm is usually run on the AP211 side to achieve the purpose of saving power consumption of electronic equipment (so that about 100 milliampere hours (mAh) of battery capacity can be saved a day).
  • the image obtained by the drawing module 211C for fingerprint recognition is processed by the SPR module 211D, there is an obvious boundary line in the excessive gray scale of the image on the mask area, that is, it is impossible to guarantee low power consumption at the same time, and the optical fingerprint recognition is relatively slow. Good display effect.
  • the color module 211E can be used to implement display modes such as eye protection mode and vivid mode of the electronic device 100 . When these display modes are turned on, the color module 211E can process the image obtained by the rendering module 211C, such as adjusting brightness, adjusting color, and the like. However, after the fingerprint recognition image obtained by the drawing module 211C is processed by the color module 211E, the image in the mask area will have serious color cast and excessive gray scale, and the display effect is poor. If you turn off the eye protection mode, bright mode and other modes during fingerprint recognition, and turn them on after the fingerprint recognition is completed, users with sensitive experience may perceive flickering screens, color changes, etc., causing user public opinion.
  • display modes such as eye protection mode and vivid mode of the electronic device 100 .
  • the communication interface 2211 of the DDIC221 is similar to the communication interface 211B of the AP211.
  • the communication interface 2211 may be used to receive data and/or instructions sent by other devices (such as the AP 211 ).
  • the DDIC221 may receive the image determined by the drawing module 211C sent by the AP211, and control the display panel 222 to display it.
  • the DDIC221 may receive the first indication information determined by the fingerprint spot module 211A sent by the AP211, and optionally parameters for realizing local highlighting of the fingerprint recognition area, and transmit the information to the local highlighting module 2212 for processing.
  • the first indication information determined by the fingerprint spot module 211A can be directly transmitted to the DDIC211 through the communication interface 211B, which can be understood as a bypass
  • the SPR module 211D and the color module 211E are provided.
  • the local highlighting module 2212 may be configured to determine an image during fingerprint identification in response to the first indication information sent by the AP 211 .
  • the local highlighting module 2212 can control the brightness of the fingerprint identification area and the brightness of the mask area simultaneously in response to the first instruction information, so as to avoid the flickering problem.
  • the fingerprint recognition image determined by the partial highlight module 2212 may be transmitted to the conversion module 2213 .
  • the conversion module 2213 can be used to process the image to be displayed, so as to convert it into a signal for controlling the display on the display panel 222, and the signal can be transmitted to the display panel 222, so that the display panel 222 displays the above-mentioned image to be displayed, such as fingerprint recognition time image.
  • the local highlighting module 2212 may include an enabling module 2212A, a fingerprint module 2212B, and a mask module 2212C, for details, please refer to the electronic device 100 shown in FIG. 4 .
  • the enabling module 2212A can be used to instruct the fingerprint module 2212B to control the brightness of the fingerprint identification area based on the first instruction information sent by the AP 211, and instruct the mask module 2212C to control the brightness of the mask area, so as to determine the image during fingerprint identification.
  • the AP 211 when the AP 211 sends the first indication information, it may also send the address information of the enabling module 2212A.
  • the first indication information may be written into the enabling module 2212A corresponding to the address information.
  • the bit (bit) of the enabling module 2212A can be set to 1, which can be understood as setting the corresponding hardware circuit to a high level, which can be understood as enabling The function of local highlighting of the fingerprint recognition area.
  • the fingerprint module 2212B can be used to control the brightness of the fingerprint identification area, not limited thereto, and can also control the number, size, position, shape, color and other display effects of the fingerprint identification area. In some embodiments, the fingerprint module 2212B can control the brightness of the fingerprint recognition area based on the enabling signal sent by the enabling module 2212A. In other embodiments, the fingerprint module 2212B can control the The brightness of the identified area.
  • the fingerprint module 2212B can control the brightness of the fingerprint identification area based on the brightness code of the fingerprint identification area sent by the AP211.
  • the AP211 sends the brightness code of the fingerprint identification area, it will also send the address of the fingerprint module 2212B information
  • the brightness code can be written into the fingerprint module 2212B corresponding to the address information
  • the brightness code can include the enable signal of the fingerprint module 2212B, when the brightness code is written into the fingerprint module 2212B, the fingerprint module 2212B can Enabled to control the brightness of the fingerprint recognition area.
  • the bit of the fingerprint module 2212B can be set to 1, which can be understood as enabling the function of controlling the display of the fingerprint identification area.
  • the brightness code may be used to indicate the brightness value of the fingerprint identification area, for example, the brightness code of 1110 indicates a brightness value of 800 nit, and the brightness code of 1111 indicates a brightness value of 850 nit.
  • brightness coding can also be used to indicate other parameters of the fingerprint recognition area, such as quantity, size, position, shape, color, and so on.
  • the fingerprint module 2212B can control the brightness of the fingerprint identification area based on the preset brightness of the fingerprint identification area. It is not limited thereto, and other parameters such as quantity, size, position, shape, color, etc. can also be preset. The display of the fingerprint identification area can be controlled based on the preset parameters of the fingerprint identification area.
  • the fingerprint module 2212B controls the brightness of the fingerprint identification area, specifically setting the grayscale and display brightness value (display brightness value, DBV) of the pixels in the fingerprint identification area.
  • DBV display brightness value
  • the fingerprint module 2212B controls the highlighting of the fingerprint identification area DBV can be set as the first threshold value
  • the gray scale can be set as the second threshold value.
  • the DBV corresponding to the brightness value of the pixel is the maximum value, for example, the value of DBV is 0-4095, and the first threshold is 4095.
  • the gray scale of the pixel is set to the maximum value, for example, the value of the gray scale is 0-255, and the second threshold is 255.
  • the pixel gray scale of the fingerprint identification area is usually When the gray scale is set to the maximum value, the color of the image in the fingerprint identification area is white.
  • the mask module 2212C can be used to control the brightness of the mask area. In some embodiments, the mask module 2212C can control the brightness of the mask area based on the enable signal sent by the enable module 2212A. In other embodiments, The mask module 2212C may control the brightness of the mask area based on the first indication information sent by the AP211.
  • the display panel 222 displays an image for fingerprint recognition. It can be understood that the mask module 2212C controls the brightness of the mask area when the display panel 222 displays an image for fingerprint recognition. Display brightness.
  • the masking module 2212C controls the brightness of the masked area specifically as follows: lowering the gray scale of the image in the masked area (for example, lowering the brightness, darkening the color, etc.)
  • the image in the mask area (which may be referred to as a display mask) is consistent with the display effect of the image in the mask area (which may be referred to as a reference mask) when the display panel 22 displays an image before fingerprint identification, for example, the image content , brightness, frame rate, etc. are all the same, where the frame rate can be understood as the number of frames of images displayed per second, and the unit is hertz (hz).
  • the mask module 2212C may first process the reference mask (for example, increase the brightness), and then multiply the gray scale of the processed image in the mask area by an alpha value to obtain the gray scale of the display mask.
  • the value range of alpha is [0,1]. The smaller the value of alpha, the stronger the effect of reducing the gray scale.
  • the mask module 2212C may not process the reference mask, and directly use the reference mask as a display mask (it can be understood that the alpha value is equal to 1).
  • the mask module 2212C can reduce the gray scale of the image in the mask area based on the alpha value sent by the AP211.
  • the AP211 when the AP211 sends the alpha value, it will also send the address information of the mask module 2212C, which can be
  • the enable signal when AP211 sends the alpha value, it will send the enable signal of the mask module 2212C together.
  • the enable signal can be written into the mask module 2212C corresponding to the address information.
  • the enable When the signal is written into the mask module 2212C, the bit of the mask module 2212 can be set to 1, which can be understood as enabling the function of controlling the display of the mask area.
  • the alpha value can be written into the mask module 2212C corresponding to the address information.
  • the mask module 2212C can reduce the gray scale of the reference mask by the alpha value , so that the display effect of the display mask and the reference mask are consistent.
  • any module included in the electronic device 100 in the above examples may be a hardware module or a software module. Any one of the above-mentioned modules may be an independent module, and at least one of the above-mentioned modules may be integrated together.
  • the AP 211 may include a GPU and a display subsystem (DSS).
  • the GPU can be used to perform drawing and rendering calculations on image data to generate images to be displayed.
  • the GPU can also be called a display core or a visual processor. It is a microprocessor that performs image calculations and can include 2D (Dimension) and/or 3D processing functions.
  • DSS can be used to connect to the display screen to display and process the image to be displayed generated by the CPU or GPU.
  • the device Unlike the GPU’s specific pixel-level processing of the displayed image, the device performs such as image scaling (size transformation), direction reversal, brightness and contrast.
  • Desktop-level display handling for resizing, overlaying of multiple layers/windows, etc.
  • the fingerprint spot module 211A and the drawing module 211C may be integrated in the GPU
  • the SPR module 211D and the color module 211E may be integrated in the DSS.
  • the memory of DDIC 221 may include one or more registers.
  • a specific example is as follows:
  • Example 2 in the DDIC221 shown in FIG. 4 above, the enable module 2212A, the fingerprint module 2212B and the mask module 2212C may be different registers with different addresses in the memory.
  • Example 3 in the DDIC221 shown in FIG. 4 above, the enabling module 2212A and the fingerprint module 2212B can be submodules with different addresses on a register.
  • Example 4 in the DDIC221 shown in FIG. 4 above, the enabling module 2212A and the masking module 2212C may be submodules with different addresses on a register.
  • the electronic device 100 may receive a user operation that triggers the display of the fingerprint recognition image, and in response to the user operation, may determine the fingerprint recognition image and control the display screen 220 to display it.
  • the above-mentioned user operations are, for example but not limited to, pressure sensors and/or touch sensors detecting touch operations acting on the display screen, pressure sensors and/or touch sensors detecting touch operations acting on the fingerprint recognition area, acceleration sensors and/or gyroscopes
  • the sensor detects a lifting operation, etc. If the fingerprint recognition image is drawn by the AP211, for example, the fingerprint recognition image is drawn by the drawing module 211C, the image will be processed by the SPR module 211D and the color module 211E, resulting in poor actual display effect of the mask area.
  • the fingerprint spot module 211A may directly send the first indication information to the DDIC221 through the communication interface 211B, and the DDIC221 determines the image for fingerprint identification.
  • the image does not need to pass through the SPR module 211D, so lower power consumption and better display effect of the mask area can be guaranteed at the same time.
  • the image does not need to go through the color module 211E, which can ensure that the eye protection mode, bright mode and other display modes will not be turned off during fingerprint recognition, avoiding user public opinion, and can also ensure a better display effect in the masked area.
  • this application also simplifies the processing flow on the AP side and improves the recognition speed. For a specific example, see Figure 5 below.
  • FIG. 5 exemplarily shows a schematic diagram of a processing flow.
  • the horizontal axis is time
  • the vertical axis is level value, where high level represents the non-display state, low level represents the display state, and high level and low level appear alternately. Therefore, the time shown on the horizontal axis may include multiple display periods (periods in which the level value is low level) and non-display periods (periods in which the level value is high level), the display period occurs periodically, and one display period It can be understood as the period during which the display screen displays the current frame of image, and a non-display period can be understood as the period during which the display screen does not display or displays the image of the previous frame. For example, when the frame rate is 90hz, one display period is 1/90 second, that is, 11.1 milliseconds (ms). When the frame rate is 120hz, a display period is 1/120 second, which is 8.3ms.
  • the first solution (that is, the image when the AP determines the fingerprint identification) needs 3 display periods to realize, specifically: firstly, in the display period 1, the AP draws and fuses the image for fingerprint identification (a specific process example Refer to Figure 6 below); then in display period 2, the AP sends the fingerprint identification image to DDIC through a communication interface (such as MIPI); finally, in display period 3, DDIC controls the display panel to display the fingerprint identification image.
  • the fingerprint image drawn by the AP cannot be sent to the display screen until the next frame.
  • the second scheme of the present application (that is, the image when DDIC determines the fingerprint recognition) only needs 2 display periods to realize, specifically: firstly, in the display period 1, the AP determines the first indication information, and optionally realizes fingerprint recognition The parameters of the local highlighting of the area, and send the first indication information to the DDIC through a communication interface (such as MIPI), and optionally realize the parameters of the local highlighting of the fingerprint recognition area; then in the display period 2, the DDIC based on the first indication information (Optional and the above parameters) Control the brightness of the fingerprint identification area on the display panel, and control the brightness of the mask area, that is, control the display panel to display the image during fingerprint identification.
  • This application (namely the second solution) does not need to draw the process of image fusion to obtain the fingerprint recognition, which saves one frame time, simplifies the processing flow on the AP side, and has higher usability.
  • FIG. 6 exemplarily shows a process in which an AP draws and fuses an image for fingerprint recognition.
  • this process may be implemented by the drawing module 211C of the AP211 shown in FIGS. 3-4 above.
  • this process may be implemented by a GPU included in the AP.
  • the AP may first draw a full-screen highlighted image 410 , that is, the full-screen brightness is greater than or equal to a preset brightness value.
  • other display effects of the image 410 may be the same as those of the image displayed before fingerprint recognition, for example, display parameters such as hue are the same.
  • the AP can first draw an image 420 in which the fingerprint identification area is hollowed out.
  • the "fingerprint identification area is hollowed out" is actually a display parameter without setting the fingerprint identification area. If the image 420 is displayed, the fingerprint recognition area may be completely black.
  • the display effect of the mask area in the image 420 may be the same as the display effect of the mask area in the image before fingerprint identification, for example, display parameters such as brightness and hue are the same.
  • the AP can fuse the image 410 and the image 420 to obtain an image 430 for fingerprint recognition, as shown in (C) of FIG. 6 .
  • the AP may place the image 410 below the image 420 (the size of the image 410 is the same as that of the image 420), and the image 410 and the image 420 are completely overlapped.
  • the brightness of the fingerprint identification area in the image 430 is greater than or equal to a preset brightness value and higher than the brightness of the mask area, which may be called a local highlight of the fingerprint identification area.
  • the display effect of the mask area in the image 430 may be the same as the display effect of the mask area in the image 420, for example, display parameters such as brightness and hue are the same.
  • the image 430 can be transmitted from the AP to the DDIC through the communication interface, and the DDIC can control the display on the display panel to realize optical fingerprint identification.
  • the AP also draws an animation effect of fingerprint unlocking in the fingerprint recognition area and the nearby area (in the mask area).
  • FIG. 7 exemplarily shows a schematic diagram of a user interface for fingerprint unlocking.
  • the electronic device may display a user interface 700, and in some embodiments, the user interface 200 may be a lock screen interface.
  • the electronic device may receive a user operation (such as a lifting operation, a touch operation acting on the display screen, etc.), and in response to the user operation, the electronic device may display a fingerprint icon in the fingerprint identification area 701 on the display screen, as shown in FIG. 7 for a specific example. (B) shown.
  • the above user operations can be understood as being used to trigger fingerprint unlocking.
  • the brightness of the fingerprint identification area 701 is the same as the brightness of the mask area on the user interface 700 except the fingerprint identification area 701 .
  • the electronic device may receive a user operation (such as a touch operation) acting on the fingerprint recognition area 701, and in response to the user operation, the electronic device may control the brightness of the fingerprint recognition area 701, as shown in (C) of FIG. 7 for a specific example.
  • Both the user interface 700 shown in (A) of FIG. 7 and (B) of FIG. 7 may be referred to as a user interface before fingerprint identification.
  • the user interface 700 may display prompt information 702 for fingerprint unlocking, for example: "During fingerprint identification, please do not remove your finger", and the user may obtain through the prompt information 702 that the electronic device is currently identifying the user's fingerprint.
  • the electronic device can identify the identity of the user based on the optical fingerprint information, for example, compare the preset optical fingerprint information with the collected optical fingerprint information, if the degree of similarity (such as the proportion of the same part to the entire content) is greater than or equal to the preset similarity value, then it is determined that the identification has passed (determining that the current user is a legal user), at this time, the electronic device can display the user interface of the desktop or application program, etc., and the similarity is less than the preset similarity value, then it is determined that the identification fails (determining that the current user is not a legal user), at this time, the electronic device The device can keep displaying the lock screen interface, where the prompt message 702 can be used to indicate the recognition result, for example: "fingerprint recognition failed, please try again".
  • the electronic device may directly display the user interface 700 shown in (C) of FIG. User interface 700 is shown. In some other embodiments, the electronic device may not display the user interface 700 shown in (A) of FIG. 7 , and directly display the user interface 700 shown in (B) of FIG. 7 and the User interface 700 .
  • FIG. 8 exemplarily shows a schematic diagram of a user interface for fingerprint payment.
  • FIG. 8 takes the user interface of the payment application as an example for illustration.
  • the electronic device may display a user interface 810 .
  • the user interface 810 may include an interface theme 811 (ie, “Payment Details”), a payment amount 812 , a payment method 813 and a payment control 814 .
  • the payment amount 812 is used to display the amount to be paid by the user (ie "256.5", the unit is yuan).
  • Payment method 813 may be used to display the payment method (ie, "balance") used by the user.
  • the payment method 813 can also be used for the user to switch the payment method.
  • the electronic device may display a user interface 820 .
  • the user interface 820 may include an interface theme 821 (namely "payment interface"), a fingerprint identification area 822, some prompt information, and the like.
  • a fingerprint icon may be displayed on the fingerprint recognition area 822 .
  • the brightness of the fingerprint identification area 822 is the same as the brightness of the mask area on the user interface 820 except the fingerprint identification area 822 .
  • the electronic device may receive a user operation (such as a touch operation) acting on the fingerprint identification area 822, and in response to the user operation, the electronic device may control the brightness of the fingerprint identification area 822, that is, control the highlighting of the fingerprint identification area on the display screen, specifically shown For example, as shown in (C) of FIG. 8 .
  • the brightness of the fingerprint identification area 822 is greater than or equal to a preset brightness value, and higher than the brightness of mask areas on the user interface 820 except the fingerprint identification area 822 .
  • the electronic device can collect the optical fingerprint information of the finger acting on the fingerprint identification area 822 through the light provided by the fingerprint identification area 822.
  • the user interface 820 can display a prompt message 823 for fingerprint unlocking, for example: "Fingerprint identification, Do not remove your finger", the user can obtain the electronic device is currently recognizing the user's fingerprint through the prompt message 823.
  • the electronic device can identify the user's identity according to the optical fingerprint information.
  • the electronic device can display a prompt message of successful payment; It can be used to indicate the recognition result, for example: "Fingerprint recognition failed, please try again".
  • An example of an electronic device identifying a user based on optical fingerprint information is similar to Figure 7 above.
  • the user interface 820 shown in (C) of FIG. 8 may not include the prompt information 823 .
  • optical fingerprint recognition can also be applied to other scenarios such as identity authentication and fingerprint photography. This application does not limit the specific application scenarios of optical fingerprint recognition.
  • the first user operation is, for example but not limited to: a touch operation acting on the display screen, a touch operation acting on the fingerprint recognition area on the display screen, a lifting operation, voice (such as "unlock", “pay”), Gestures (such as making a fist, spreading fingers), etc.
  • the AP may determine to trigger optical fingerprint recognition, and then the AP may control the display screen to display a user interface for fingerprint recognition.
  • the method before S101, further includes: displaying the first image on a display panel of the display screen.
  • the first image is an image before fingerprint recognition, such as the user interface 700 shown in FIG. 7(A) and FIG. 7(B), and the user interface 820 shown in FIG. 8 .
  • the display panel displays the first image
  • the brightness of the fingerprint recognition area is equal to the brightness of the mask area.
  • the AP sends the first indication information, the fingerprint parameter and the mask parameter to the display driver chip (DDIC).
  • DDIC display driver chip
  • the first instruction information is used to instruct the DDIC to determine and display the second image, that is, the above-mentioned image during fingerprint identification.
  • the first instruction information is specifically used to instruct the DDIC to control the fingerprint identification area and the fingerprint identification area on the display panel The brightness of the masked area.
  • the mask parameter can be used to control the brightness of the mask area, for example, to reduce the gray scale of the image in the mask area (eg, lower the brightness, darken the color, etc.).
  • the mask parameter may include information indicating the dimming mode, and in other embodiments, the mask parameter may be sent to the DDIC together with the information indicating the dimming mode.
  • the dimming mode of the display screen may include direct current regulation (direct current, DC) and pulse-width modulation (pulse-width modulation, PWM).
  • the DC mode is to adjust the brightness of the display screen by changing the current, not limited to this, the brightness can also be adjusted by changing the voltage, and the brightness can also be adjusted by changing the current and voltage.
  • PWM mode does not change current and/or voltage.
  • the PWM mode is to adjust the brightness of the display screen by adjusting the duty cycle, not limited to this, the brightness of the display screen can also be adjusted by adjusting the number of pulses, and the brightness of the display screen can also be adjusted by the number of pulses and the duty cycle .
  • PWM mode please refer to Figure 10 below, where Figure 10 uses 4 pulses as an example for illustration.
  • a frame of image can include 4 black bars that cover the black, and the part where the black bars are located can be understood as an off-screen state. These 4 black bars correspond to 4 high-level pulses, so it can be understood Because the high level indicates the off-screen state, and the low level indicates the on-screen state.
  • PWM pulse width modulation
  • the display screen will not continue to emit light, but will keep on and off the display screen continuously, that is, the brightness of the display screen will be adjusted by turning on and off the display screen alternately.
  • each black bar that is, the longer the high level lasts (that is, the longer the off-screen time), the lower the brightness of the display screen to the naked eye, and the narrower the width of each black bar, that is, the higher The shorter the duration of the level (that is, the longer the screen is on), the higher the brightness of the display to the naked eye.
  • the high and low levels appear periodically, and the position of the black bar also changes with time.
  • the black bar is constantly moving on each frame of the image.
  • the PWM adjustment duty cycle is actually realized by adjusting the width of the black bar (adjusting the duration of the high level).
  • the AP can send information indicating that the dimming mode is DC mode to the DDIC.
  • the dimming mode of the display screen may be a DC mode or a PWM mode.
  • the dimming mode is PWM mode
  • the dimming mode is DC mode
  • the above information indicating that the dimming mode is DC mode can be sent together with the address of the module used to control the dimming mode on the DDIC.
  • the above information indicating that the dimming mode is DC mode is written into the When the address corresponds to a module used to control the dimming mode, the bit of the module can be set to 1, that is, the dimming mode is set to DC mode.
  • the dimming mode is set to PWM mode.
  • the above-mentioned module for controlling the dimming mode on the DDIC may be integrated in the mask module 2212C shown in FIG. 4 , or may be independent of the mask module 2212C.
  • the above-mentioned information for indicating the dimming mode may also be included in the first indication information, and the DDIC may set the dimming mode in response to the first indication information.
  • the information used for indicating the dimming mode in this application The specific sending form is not limited.
  • the mask parameters may include an alpha value used when reducing the gray scale.
  • the value range of alpha is [0,1]. The smaller the value of alpha, the stronger the effect of reducing the grayscale, for example, the lower the brightness and the darker the color.
  • the alpha value may be determined by the AP based on the image of the mask area (which may be referred to as a reference mask) before fingerprint recognition.
  • the display screen displays an image before fingerprint recognition, and the dimming mode is PWM
  • the brightness of the brightened image is higher than that of the reference mask image
  • the alpha is less than 1.
  • the display screen displays an image before fingerprint recognition, and the dimming mode is DC
  • the brightness of the brightened image is equal to the image of the reference mask
  • alpha is equal to 1.
  • the image is the image displayed in the DC mode of the image before fingerprint recognition. It can also be understood that the AP does not need to determine the image of the mask area based on the image displayed in the full screen, and then determine the alpha value based on the image of the mask area. The alpha value can be determined directly based on the image displayed in full screen.
  • the DDIC determines a locally highlighted image of the fingerprint recognition area based on the fingerprint parameters and the mask parameters.
  • the DDIC may determine and control the display panel to display the second image, that is, the image during fingerprint identification, in response to the first indication information.
  • the DDIC may update the first image displayed on the display panel in response to the first indication information, specifically controlling the brightness of the fingerprint recognition area in the first image to be the first brightness, and controlling the mask area in the first image
  • the brightness of is the second brightness
  • the updated first image is the above-mentioned second image, that is, the image during fingerprint identification.
  • the display panel displays the first image (that is, the image before fingerprint identification)
  • the brightness of the fingerprint identification area is the same as the brightness of the mask area, that is, the above-mentioned second brightness.
  • the display panel displays the second image (that is, the image during fingerprint identification)
  • the brightness of the fingerprint identification area is greater than or equal to the preset brightness value, and greater than the brightness of the mask area
  • the display effect of the mask area is It is consistent with the display effect of the mask area in the image before fingerprint recognition, that is, the display effect of the display mask is consistent with that of the reference mask (for example, the display parameters such as brightness and hue are the same). Therefore, it can be said that in the fingerprint recognition image, the fingerprint recognition area is partially highlighted.
  • the DDIC can control the brightness of the fingerprint identification area on the display panel based on the fingerprint parameters in response to the first indication information, and at the same time control the brightness of the mask area based on the mask parameters, so as to ensure that no flickering occurs.
  • the DDIC can control the brightness of the fingerprint identification area on the display panel based on the fingerprint parameters sent by the AP in response to the first indication information, not limited thereto, and can also control the number, size, position, and shape of the fingerprint identification area , color and other display effects.
  • the DDIC may determine the driving voltage and/or current of the fingerprint identification area as the first voltage and/or the first current based on the fingerprint parameters.
  • the DDIC may set the DBV of the pixels in the fingerprint identification area as the first threshold and the gray scale as the second threshold based on the fingerprint parameters. When the DBV is the first threshold and the gray scale is the second threshold, the corresponding driving voltage and/or current is the first voltage and/or the first current.
  • the DBV corresponding to the brightness value of the pixel is the maximum value, for example, the value of DBV is 0-4095, and the first threshold is 4095.
  • the gray scale of the pixel is set to the maximum value, for example, the value of the gray scale is 0-255, and the second threshold is 255.
  • the pixel gray scale of the fingerprint identification area is usually When the gray scale is set to the maximum value, the color of the image in the fingerprint identification area is white.
  • the DDIC may, in response to the first indication information, determine the image of the mask area during fingerprint identification (that is, display the mask) based on the mask parameters sent by the AP. In some embodiments, the DDIC may receive information from the AP indicating that the dimming mode is the DC mode, and set the dimming mode as the DC mode. In some embodiments, the DDIC can reduce the image of the mask area before the fingerprint recognition when the dimming mode is DC mode (that is, the reference mask when the dimming mode is DC, that is, the brightened image) based on the mask parameters. Grayscale processing to obtain a display mask.
  • the mask parameter may include the alpha value used when reducing the grayscale
  • the AP may not send the fingerprint parameters to the DDIC, and the DDIC may respond to the first indication information and control the local highlighting of the fingerprint identification area based on the preset fingerprint parameters.
  • the DDIC may be preset with the brightness value of the fingerprint identification area, and the DDIC may control the brightness of the fingerprint identification area based on the preset brightness value in response to the first instruction information. , position, shape, color and other parameters, DDIC can control the display of the fingerprint identification area based on the preset parameters.
  • the AP may not send mask parameters to the DDIC, and the DDIC may respond to the first indication information and lower the gray scale of the mask area based on the preset mask parameters, to get the display mask.
  • the DDIC may calculate the alpha value by itself. For an example of the calculation method, refer to the description of the alpha value calculation by the AP in S101-S102.
  • the DDIC may determine the display mask based on the self-calculated alpha value in response to the first indication information.
  • the DDIC may perform some processing (such as gamma processing) on the image to be displayed, and then control the display panel to display. Therefore, when DDIC calculates the alpha value by itself, the determined brightened image is more in line with the actual display effect on the display panel, and the display mask obtained after reducing the grayscale is more consistent with the display effect of the reference mask, which improves the image quality of the mask area. display effect.
  • the AP sends the first indication information to the DDIC to control the DDIC to determine and display the image of the fingerprint identification, and the DDIC can control the brightness of the fingerprint identification area and the mask area at the same time, without the AP drawing fusion to obtain the fingerprint identification
  • the display effect does not depend on the AP platform and manufacturer, and it also simplifies the AP side processing flow and improves the recognition speed.
  • the image during fingerprint identification will not undergo SPR processing on the AP side, which ensures low power consumption and better display effect in the mask area, and the image during fingerprint identification will not undergo color processing on the AP side. It can ensure that the display modes such as eye protection mode and bright mode will not be turned off during fingerprint recognition, avoiding user public opinion, and can also ensure a better display effect in the masked area.
  • the fingerprint parameters and/or mask parameters that realize the local highlighting of the fingerprint identification area can be the parameters preset by DDIC, or the parameters configured by the AP in real time according to different screens in different scenarios, which has stronger adaptability and application scenarios more extensive.
  • the DDIC can independently control the display mode of the fingerprint identification area, such as controlling the size, shape, quantity, position, color, brightness, etc. of the fingerprint identification area, without affecting the mask area outside the fingerprint identification area. display effect.
  • the DDIC can independently control the brightness of the fingerprint identification area without affecting the brightness of the mask area outside the fingerprint identification area (that is, the brightness of the mask area remains unchanged).
  • the AP may send the first indication information and fingerprint parameters to the DDIC.
  • the DDIC may individually control the display of the fingerprint identification area based on the fingerprint parameters sent by the AP in response to the first indication information.
  • the AP may send the first indication information to the DDIC, and the DDIC may respond to the first indication information and independently control the display of the fingerprint identification area based on preset fingerprint parameters.
  • the display methods of these multiple fingerprint identification areas can be the same or different, for example, some are highlighted and some are not highlighted. For specific examples, please refer to Figure 11-12 below.
  • the electronic device can be configured with a non-foldable display screen.
  • This display screen can include at least one DDIC.
  • the one or more DDICs may be all or part of at least one DDIC included in the display screen. A specific example is shown in FIG. 11 below.
  • FIG. 11 exemplarily shows a schematic view of an electronic device.
  • the electronic device may include a display screen, and the display panel of the display screen may be divided into upper and lower areas: area 1 and area 2, and there may be a fingerprint identification area on area 1 and area 2 respectively.
  • the fingerprint identification area of area 1 can be displayed by controlling DDIC1 of the display screen, and the fingerprint identification area of area 2 can be controlled by DDCI2 of the display screen.
  • DDIC1 and DDIC2 can be connected in series.
  • the fingerprint identification areas of area 1 and area 2 may also be controlled by one DDIC.
  • the area 1 and the area 2 may also be left and right areas.
  • one area may include multiple fingerprint identification areas, and this application does not limit the specific display manner of the fingerprint identification area and the DDIC for controlling the display.
  • the electronic device may be configured with a foldable display screen (which may be called a foldable screen), the foldable screen may include at least one DDIC, and there may be multiple fingerprint recognition areas on the foldable screen, and the multiple fingerprint recognition areas It can be controlled by one or more DDICs, and the one or more DDICs can be all or part of at least one DDIC included in the folding screen.
  • a foldable display screen which may be called a foldable screen
  • the foldable screen may include at least one DDIC
  • there may be multiple fingerprint recognition areas on the foldable screen and the multiple fingerprint recognition areas It can be controlled by one or more DDICs, and the one or more DDICs can be all or part of at least one DDIC included in the folding screen.
  • FIG. 12 A specific example is shown in FIG. 12 below.
  • FIG. 12 exemplarily shows a schematic view of another electronic device.
  • (A) of FIG. 12 shows a schematic diagram of one viewing angle of the electronic device
  • (B) of FIG. 12 shows a schematic diagram of another viewing angle of the electronic device.
  • the electronic device may include a flexible folding screen, and the folding screen may include a first display area and a second display area on both sides of a bending line, and the folding screen may be bent along the bending line.
  • the folding screen can be in an unfolded state or a bent state (including the folded state), and it can also be understood that an electronic device equipped with a folding screen can be in an unfolded state or a bent state.
  • the bending angle a of the folding screen is about 180 degrees.
  • the bending angle a may also be greater than or equal to 170 degrees and less than or equal to 180 degrees, and this application does not limit the specific value of the bending angle of the folding screen in the unfolded state.
  • the bending angle b of the folding screen when the folding screen is in the bent state, the bending angle b of the folding screen is about 120 degrees, but not limited thereto, the bending angle b can be greater than or equal to 0 degrees and less than 180 degrees, For example, but not limited to, 0 degrees (this time can also be called the folded state, at this time, the light emitting surfaces of the first display area and the second display area face each other), 60 degrees, 90 degrees, etc.
  • the specific value of the bending angle is not limited.
  • the first display area can be divided into upper and lower areas: area 1 and area 2
  • the second display area can be divided into upper and lower areas: area 3 and area 4 .
  • the fingerprint identification areas of area 1 and area 3 can be controlled by DDIC1 of the folding screen
  • the fingerprint identification areas of area 2 and area 4 can be controlled by DDIC2 of the folding screen.
  • DDIC1 and DDIC2 can be connected in series.
  • the master DDIC can be used to control the work of the slave DDIC to realize the first display area and the second display area.
  • the two display areas jointly display one frame of image.
  • the fingerprint recognition areas of area 1 and area 2 can be controlled by DDIC1 of the folding screen, and the fingerprint identification areas of area 3 and area 4 can be controlled by DDIC2 of the folding screen.
  • the fingerprint identification areas of area 3 and area 4 can be controlled by DDIC2 of the folding screen.
  • 4 areas on the folding screen are controlled by one DDIC.
  • the folding screen of the electronic device can also be a display screen spliced by connecting components such as a rigid screen, a flexible screen, and a chain.
  • the folding screen can be composed of two rigid screens and The chains used to connect the two rigid screens are spliced together, and the first display area and the second display area are areas on the above two rigid screens, both of which are used to display the user interface.
  • the first display area may include at least one DDIC, and the fingerprint recognition areas of area 1 and area 2 on the first display area may be respectively controlled by different DDICs.
  • the second display area may include at least one DDIC, and the area 3 and area 4 on the second display area may be respectively controlled by different DDICs.
  • the DDIC used to control area 1 in the first display area and the DDIC used to control area 3 in the second display area can be connected in series.
  • the master DDIC can be used to control the work of the slave DDIC, so that area 1 and area 3 can display a frame of image together.
  • the present application does not limit the structure of the display screen of the electronic device, the specific display mode of the fingerprint recognition area, and the DDIC for controlling the display.
  • control method of each fingerprint identification area mentioned above is similar to the control mode of the fingerprint identification area shown in Figures 1-10 above, and will not be repeated here.
  • the DDIC can independently implement the function of reducing the gray scale, so as to adjust the brightness of the displayed image. For example, when the anti-flicker function is turned on, the DDIC can receive the image drawn by the AP, and then perform processing to reduce the grayscale of the image, so as to display the reduced grayscale image on the display panel.
  • the implementation of grayscale reduction is similar to the implementation of grayscale reduction in the mask area in Figure 1-10 above, except that the grayscale reduction is not limited to the mask area, but can be all or any other part of the display area.
  • the AP can send information indicating that the dimming mode is DC mode to the DDIC to realize the anti-flicker function.
  • the AP in this application can also be replaced by other processing chips or processing units such as SoC.
  • other processing chips or processing units such as SoC can be integrated with APs.
  • the AP is independent For other processing chips or processing units such as SoC.
  • the DDIC in this application can also be replaced by other internal driver chips or processing units of the display screen, in some embodiments, the internal driver chips or processing units of other display screens can be integrated with DDIC, in other embodiments , DDIC can be independent from other driver chips or processing units inside the display.
  • One or more of the above modules or units may be realized by software, hardware or a combination of both.
  • the processor can be a separate semiconductor chip, or can be integrated with other circuits into a semiconductor chip, for example, can form a SoC (on-chip chip) with other circuits (such as codec circuits, hardware acceleration circuits, or various bus and interface circuits). system), or may also be integrated in the ASIC as a built-in processor of the ASIC, and the ASIC integrated with the processor may be packaged separately or together with other circuits.
  • the processor can further include necessary hardware accelerators, such as field programmable gate array (field programmable gate array, FPGA), PLD (programmable logic device) , or a logic circuit that implements a dedicated logic operation.
  • the hardware can be CPU, microprocessor, DSP, MCU, artificial intelligence processor, ASIC, SoC, FPGA, PLD, dedicated digital circuit, hardware accelerator or non-integrated discrete device Any one or any combination of them, which can run necessary software or not depend on software to execute the above method flow.

Abstract

本申请实施例提供了一种显示方法及电子设备,该电子设备包括应用处理器AP、显示驱动芯片DDIC和显示面板,其中:显示面板,用于显示第一图像;AP,用于向DDIC发送第一指示信息和第一参数;DDIC,用于基于接收到的第一指示信息,控制第一图像中指纹识别区域的亮度为第一亮度,以及控制第一图像中蒙版区域的亮度为第二亮度,蒙版区域的亮度是基于第一参数控制的,蒙版区域为第一图像中指纹识别区域以外的区域;显示面板,用于显示更新后的第一图像,更新后的第一图像中指纹识别区域的亮度为第一亮度,蒙版区域的亮度为第二亮度。本申请能够提高光学指纹识别时蒙版区域的显示效果,避免用户舆情。

Description

一种显示方法及电子设备
本申请要求于2021年06月30日提交中国专利局、申请号为202110745146.9、申请名称为“一种显示方法及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及计算机技术领域,尤其涉及一种显示方法及电子设备。
背景技术
指纹识别技术在电子设备上应用广泛,例如光学指纹识别技术:电子设备可以在显示屏上的指纹识别区域,显示特定形状和特定亮度的光斑(例如椭圆形或圆形的高亮光斑),用户手指作用于该光斑时,电子设备可以采集用户的光学指纹信息,实现指纹解锁、指纹支付、指纹拍照等功能。
电子设备可以包括应用处理器(application processor,AP),光学指纹识别的用户界面一般是由AP绘制,然后发送至显示屏上显示。但这样的显示效果不佳,例如,电子设备开启护眼模式、鲜艳模式等模式时,AP绘制的图像需经过和上述模式对应的色彩模块处理,会导致实际显示的图像出现严重的偏色和灰阶过度问题。若在光学指纹识别时关闭护眼模式、鲜艳模式等模式,光学指纹识别结束后再打开,可能会出现闪屏、色调突变等情况,导致用户舆情。
发明内容
本申请实施例提供了一种显示方法及电子设备,能够提高光学指纹识别的显示效果,提升用户体验。
第一方面,本申请实施例提供了一种电子设备,该电子设备包括应用处理器AP和显示屏,上述显示屏包括显示驱动芯片DDIC和显示面板,其中:上述显示面板,用于显示第一图像;上述AP,用于向上述DDIC发送第一指示信息和第一参数;上述DDIC,用于基于接收到的上述第一指示信息,控制上述第一图像中指纹识别区域的亮度为第一亮度,以及控制上述第一图像中蒙版区域的亮度为第二亮度,上述蒙版区域的亮度是基于上述第一参数控制的,上述蒙版区域为上述第一图像中上述指纹识别区域以外的区域;上述显示面板,用于显示更新后的第一图像,上述更新后的第一图像中上述指纹识别区域的亮度为上述第一亮度,上述蒙版区域的亮度为上述第二亮度。
在一些实施例中,第一图像为指纹识别前的图像,更新后的第一图像为指纹识别时的图像。第一图像的亮度为第二亮度。在一些实施例中,第一亮度大于第二亮度,且大于或等于预设亮度值。在一些实施例中,显示面板显示第一图像时,电子设备采集作用于指纹识别区域的触摸操作的手指的光学指纹信息。
本申请中,DDIC可以基于AP发送第一指示信息,同时控制指纹识别区域的亮度,以及通过AP发送的第一参数控制蒙版区域的亮度(可理解为是更新第一图像),避免闪屏。并且,无需AP绘制更新后的第一图像,简化了AP侧处理流程,提升了识别速度。更新后的第一图 像不会经过AP侧的色彩模块处理,既可以保证显示更新后的第一图像时护眼模式、鲜艳模式等显示模式不会被关闭,避免用户舆情,也可以保证蒙版区域较好的显示效果。
在一种可能的实现方式中,上述DDIC控制上述第一图像中指纹识别区域的亮度为第一亮度,包括:将上述指纹识别区域中像素的灰阶设置为第一值,以及显示亮度值DBV设置为第二值,上述显示面板中像素的灰阶的取值小于或等于上述第一值,上述显示面板中像素的DBV小于或等于上述第二值,上述第一亮度对应的灰阶为上述第一值,对应的DBV为上述第二值。
在一些实施例中,显示面板中像素的灰阶的取值范围为0到255,第一值为255。在一些实施例中,显示面板中像素的DBV的取值范围为0-4095,第二值为4095。
在一种可能的实现方式中,上述AP,还用于向上述DDIC发送上述指纹识别区域的亮度编码,上述亮度编码用于指示以下至少一项:亮度、颜色、形状、大小、位置;上述DDIC控制上述第一图像中指纹识别区域的亮度为第一亮度,包括:基于接收到的上述亮度编码控制上述第一图像中上述指纹识别区域的显示。
本申请中,用于控制指纹识别区域的显示的参数可以为AP根据不同场景实时配置的参数,可适配性更强,应用场景更为广泛。
在一种可能的实现方式中,上述DDIC控制上述第一图像中指纹识别区域的亮度为第一亮度,包括:基于预置的亮度编码控制上述第一图像中上述指纹识别区域的显示。
在一种可能的实现方式中,上述更新后的第一图像中上述指纹识别区域的亮度,大于上述第一图像中上述指纹识别区域的亮度;上述更新后的第一图像中上述蒙版区域的亮度和显示内容,和上述第一图像中上述蒙版区域的亮度和显示内容相同。
在一种可能的实现方式中,上述显示面板显示上述更新后的第一图像时,上述显示屏的调光模式为直流电调节DC,上述第一参数是根据上述显示面板显示上述第一图像时上述显示屏的调光模式,以及上述蒙版区域的灰阶确定的阿尔法值。
在一种可能的实现方式中,上述显示面板显示上述第一图像时,上述显示屏的调光模式为脉宽调节PWM,则上述第一参数小于1;上述显示面板显示上述第一图像时,上述显示屏的调光模式为DC,则上述第一参数等于1。
在一种可能的实现方式中,上述显示面板显示上述第一图像时,上述显示屏的调光模式为PWM,上述蒙版区域的灰阶为第一灰阶;上述DDIC,还用于基于接收到的上述第一指示信息,将上述显示屏的调光模式切换为DC;上述DDIC控制上述显示面板中蒙版区域的亮度,包括:将上述显示屏的调光模式切换为DC后上述蒙版区域对应的第二灰阶乘以上述第一参数,上述第二灰阶高于上述第一灰阶;上述显示面板显示上述更新后的第一图像时,上述蒙版区域的灰阶为上述第二灰阶乘以上述第一参数得到的上述第一灰阶,上述第二亮度对应的灰阶为上述第一灰阶。
在一些实施例中,第一参数等于第一灰阶和第二灰阶的比值。
在一种可能的实现方式中,上述指纹识别区域包括第一指纹识别区域和第二指纹识别区域,上述DDIC包括第一DDIC和第二DDIC;上述第一DDIC,用于基于接收到的上述第一指示信息,控制上述第一图像中上述第一指纹识别区域的亮度;上述第二DDIC,用于基于接收到的上述第一指示信息,控制上述第一图像中上述第二指纹识别区域的亮度。
本申请中,指纹识别区域的数量、位置等显示方式可以根据实际需求灵活配置,可以通过不同的DDIC分别控制不同的指纹识别区域的亮度,避免单个DDIC控制多个指纹识别区域而处理压力过大。
在一种可能的实现方式中,上述显示屏为折叠屏。
第二方面,本申请实施例提供了一种通信装置,包括处理器、存储器和通信接口,其中:上述处理器,用于确定第一指示信息和第一参数;上述通信接口,用于向显示屏发送上述第一指示信息和上述第一参数,上述第一指示信息用于指示控制上述显示屏显示的第一图像中指纹识别区域和蒙版区域的亮度,上述蒙版区域为上述第一图像中上述指纹识别区域以外的区域,上述第一参数用于控制上述蒙版区域的亮度。
在一些实施例中,通信装置为应用处理器AP。
在一些实施例中,第一图像为指纹识别前的图像。上述控制上述显示屏显示的第一图像中指纹识别区域和蒙版区域的亮度后显示的图像,即更新后的第一图像为指纹识别时的图像。第一图像的亮度为第二亮度。在一些实施例中,第一亮度大于第二亮度,且大于或等于预设亮度值。
本申请中,显示屏可以基于AP发送第一指示信息,同时控制指纹识别区域的亮度,以及通过AP发送的第一参数控制蒙版区域的亮度(可理解为是更新第一图像),避免闪屏。并且,无需AP绘制更新后的第一图像,简化了AP侧处理流程,提升了识别速度。更新后的第一图像不会经过AP侧的色彩模块处理,既可以保证显示更新后的第一图像时护眼模式、鲜艳模式等显示模式不会被关闭,避免用户舆情,也可以保证蒙版区域较好的显示效果。
在一种可能的实现方式中,上述处理器,还用于确定上述指纹识别区域的亮度编码,上述亮度编码用于指示以下至少一项:亮度、颜色、形状、大小、位置;上述通信接口,还用于向上述显示屏发送上述亮度编码,上述亮度编码用于控制上述第一图像中上述指纹识别区域的显示。
本申请中,用于控制指纹识别区域的显示的参数可以为AP根据不同场景实时配置的参数,可适配性更强,应用场景更为广泛。
第三方面,本申请实施例提供了又一种通信装置,包括处理器、存储器和通信接口,其中:上述处理器,用于控制显示屏的显示面板显示第一图像;上述通信接口,用于接收第一指示信息和第一参数,并将上述第一指示信息和上述第一参数传输至上述处理器;上述处理器,用于基于接收到的上述第一指示信息,控制上述第一图像中指纹识别区域的亮度为第一亮度,以及控制上述第一图像中蒙版区域的亮度为第二亮度,上述蒙版区域的亮度是基于上述第一参数控制的,上述蒙版区域为上述第一图像中上述指纹识别区域以外的区域;上述处理器,用于控制上述显示面板显示更新后的第一图像,上述更新后的第一图像中上述指纹识别区域的亮度为上述第一亮度,上述蒙版区域的亮度为上述第二亮度。
在一些实施例中,通信装置为显示屏的显示驱动芯片DDIC。在一些实施例中,通信接口接收的第一指示信息和第一参数是应用处理器AP发送的。
在一些实施例中,第一图像为指纹识别前的图像,更新后的第一图像为指纹识别时的图像。第一图像的亮度为第二亮度。在一些实施例中,第一亮度大于第二亮度,且大于或等于预设亮度值。
本申请中,DDIC可以基于接收到的第一指示信息,同时控制指纹识别区域的亮度,以及通过接收到的第一参数控制蒙版区域的亮度(可理解为是更新第一图像),避免闪屏。并且,无需AP绘制更新后的第一图像,简化了AP侧处理流程,提升了识别速度。更新后的第一图像不会经过AP侧的色彩模块处理,既可以保证显示更新后的第一图像时护眼模式、鲜艳模 式等显示模式不会被关闭,避免用户舆情,也可以保证蒙版区域较好的显示效果。
在一种可能的实现方式中,上述处理器控制上述第一图像中指纹识别区域的亮度为第一亮度,包括:将上述指纹识别区域中像素的灰阶设置为第一值,以及显示亮度值DBV设置为第二值,上述显示面板中像素的灰阶的取值小于或等于上述第一值,上述显示面板中像素的DBV小于或等于上述第二值,上述第一亮度对应的灰阶为上述第一值,对应的DBV为上述第二值。
在一些实施例中,显示面板中像素的灰阶的取值范围为0到255,第一值为255。在一些实施例中,显示面板中像素的DBV的取值范围为0-4095,第二值为4095。
在一种可能的实现方式中,上述通信接口,还用于接收上述指纹识别区域的亮度编码,并将上述亮度编码传输至上述处理器,上述亮度编码用于指示以下至少一项:亮度、颜色、形状、大小、位置;上述处理器控制上述第一图像中指纹识别区域的亮度为第一亮度,包括:基于接收到的上述亮度编码控制上述第一图像中上述指纹识别区域的显示。
本申请中,用于控制指纹识别区域的显示的参数可以为AP根据不同场景实时配置的参数,可适配性更强,应用场景更为广泛。
在一种可能的实现方式中,上述控制上述第一图像中指纹识别区域的亮度为第一亮度,包括:基于预置的亮度编码控制上述第一图像中上述指纹识别区域的显示。
在一种可能的实现方式中,上述更新后的第一图像中上述指纹识别区域的亮度,大于上述第一图像中上述指纹识别区域的亮度;上述更新后的第一图像中上述蒙版区域的亮度和显示内容,和上述第一图像中上述蒙版区域的亮度和显示内容相同。
在一种可能的实现方式中,上述处理器控制上述显示面板显示更新后的第一图像时,上述显示屏的调光模式为直流电调节DC,上述第一参数是根据上述处理器控制显示屏的显示面板显示第一图像时上述显示屏的调光模式,以及上述蒙版区域的灰阶确定的阿尔法值。
在一种可能的实现方式中,上述处理器控制显示屏的显示面板显示第一图像时,上述显示屏的调光模式为脉宽调节PWM,则上述第一参数小于1;上述处理器控制显示屏的显示面板显示第一图像时,上述显示屏的调光模式为DC,则上述第一参数等于1。
在一种可能的实现方式中,上述处理器控制显示屏的显示面板显示第一图像时,上述显示屏的调光模式为脉宽调节PWM,上述蒙版区域的灰阶为第一灰阶;上述处理器,还用于基于接收到的上述第一指示信息,将上述显示屏的调光模式切换为DC;上述处理器控制上述第一图像中蒙版区域的亮度为第二亮度,包括:将上述显示屏的调光模式切换为DC后上述蒙版区域对应的第二灰阶乘以上述第一参数,上述第二灰阶高于上述第一灰阶;上述处理器控制上述显示面板显示更新后的第一图像时,上述蒙版区域的灰阶为上述第二灰阶乘以上述第一参数得到的上述第一灰阶,上述第二亮度对应的灰阶为上述第一灰阶。
在一些实施例中,第一参数等于第一灰阶和第二灰阶的比值。
在一种可能的实现方式中,上述显示屏为折叠屏。
第四方面,本申请实施例提供了一种显示方法,应用于电子设备,该电子设备包括应用处理器AP和显示屏,上述显示屏包括显示驱动芯片DDIC和显示面板,该方法包括:上述显示面板显示第一图像;上述AP向上述DDIC发送第一指示信息和第一参数;上述DDIC基于接收到的上述第一指示信息,控制上述第一图像中指纹识别区域的亮度为第一亮度,以及控制上述第一图像中蒙版区域的亮度为第二亮度,上述蒙版区域的亮度是基于上述第一参数控制的,上述蒙版区域为上述第一图像中上述指纹识别区域以外的区域;上述显示面板显 示更新后的第一图像,上述更新后的第一图像中上述指纹识别区域的亮度为上述第一亮度,上述蒙版区域的亮度为上述第二亮度。
在一些实施例中,第一图像为指纹识别前的图像,更新后的第一图像为指纹识别时的图像。第一图像的亮度为第二亮度。在一些实施例中,第一亮度大于第二亮度,且大于或等于预设亮度值。在一些实施例中,显示面板显示第一图像时,电子设备采集作用于指纹识别区域的触摸操作的手指的光学指纹信息。
本申请中,DDIC可以基于AP发送第一指示信息,同时控制指纹识别区域的亮度,以及通过AP发送的第一参数控制蒙版区域的亮度(可理解为是更新第一图像),避免闪屏。并且,无需AP绘制更新后的第一图像,简化了AP侧处理流程,提升了识别速度。更新后的第一图像不会经过AP侧的色彩模块处理,既可以保证显示更新后的第一图像时护眼模式、鲜艳模式等显示模式不会被关闭,避免用户舆情,也可以保证蒙版区域较好的显示效果。
在一种可能的实现方式中,上述控制上述第一图像中指纹识别区域的亮度为第一亮度,包括:将上述指纹识别区域中像素的灰阶设置为第一值,以及显示亮度值DBV设置为第二值,上述显示面板中像素的灰阶的取值小于或等于上述第一值,上述显示面板中像素的DBV小于或等于上述第二值,上述第一亮度对应的灰阶为上述第一值,对应的DBV为上述第二值。
在一些实施例中,显示面板中像素的灰阶的取值范围为0到255,第一值为255。在一些实施例中,显示面板中像素的DBV的取值范围为0-4095,第二值为4095。
在一种可能的实现方式中,该方法还包括:上述AP向上述DDIC发送上述指纹识别区域的亮度编码,上述亮度编码用于指示以下至少一项:亮度、颜色、形状、大小、位置;上述控制上述第一图像中指纹识别区域的亮度为第一亮度,包括:基于接收到的上述亮度编码控制上述第一图像中上述指纹识别区域的显示。
本申请中,用于控制指纹识别区域的显示的参数可以为AP根据不同场景实时配置的参数,可适配性更强,应用场景更为广泛。
在一种可能的实现方式中,上述控制上述第一图像中指纹识别区域的亮度为第一亮度,包括:基于预置的亮度编码控制上述第一图像中上述指纹识别区域的显示。
在一种可能的实现方式中,上述更新后的第一图像中上述指纹识别区域的亮度,大于上述第一图像中上述指纹识别区域的亮度;上述更新后的第一图像中上述蒙版区域的亮度和显示内容,和上述第一图像中上述蒙版区域的亮度和显示内容相同。
在一种可能的实现方式中,上述显示面板显示上述更新后的第一图像时,上述显示屏的调光模式为直流电调节DC,上述第一参数是根据上述显示面板显示上述第一图像时上述显示屏的调光模式,以及上述蒙版区域的灰阶确定的阿尔法值。
在一种可能的实现方式中,上述显示面板显示上述第一图像时,上述显示屏的调光模式为脉宽调节PWM,则上述第一参数小于1;上述显示面板显示上述第一图像时,上述显示屏的调光模式为DC,则上述第一参数等于1。
在一种可能的实现方式中,上述显示面板显示上述第一图像时,上述显示屏的调光模式为PWM,上述蒙版区域的灰阶为第一灰阶;该方法还包括:基于接收到的上述第一指示信息,将上述显示屏的调光模式切换为DC;上述控制上述显示面板中蒙版区域的亮度,包括:将上述显示屏的调光模式切换为DC后上述蒙版区域对应的第二灰阶乘以上述第一参数,上述第二灰阶高于上述第一灰阶;上述显示面板显示上述更新后的第一图像时,上述蒙版区域的灰阶为上述第二灰阶乘以上述第一参数得到的上述第一灰阶,上述第二亮度对应的灰阶为上述第一灰阶。
在一些实施例中,第一参数等于第一灰阶和第二灰阶的比值。
在一种可能的实现方式中,上述指纹识别区域包括第一指纹识别区域和第二指纹识别区域,上述DDIC包括第一DDIC和第二DDIC;上述DDIC基于接收到的上述第一指示信息,控制上述第一图像中指纹识别区域的亮度为第一亮度,包括:上述第一DDIC基于接收到的上述第一指示信息,控制上述第一图像中上述第一指纹识别区域的亮度,上述第二DDIC基于接收到的上述第一指示信息,控制上述第一图像中上述第二指纹识别区域的亮度。
第五方面,本申请实施例提供了一种计算机存储介质,该计算机存储介质存储有计算机程序,该计算机程序被处理器执行时,实现本申请实施例第四方面,以及第四方面的任意一种实现方式提供的显示方法。
第六方面,本申请实施例提供了一种计算机程序产品,当该计算机程序产品在通信装置上运行时,使得该通信装置执行本申请实施例第四方面,以及第四方面的任意一种实现方式提供的显示方法。
第七方面,本申请实施例提供一种电子设备,该电子设备包括执行本申请任一实施例所介绍的方法或装置。上述电子设备例如为芯片。
应当理解的是,本申请中对技术特征、技术方案、有益效果或类似语言的描述并不是暗示在任意的单个实施例中可以实现所有的特点和优点。相反,可以理解的是对于特征或有益效果的描述意味着在至少一个实施例中包括特定的技术特征、技术方案或有益效果。因此,本说明书中对于技术特征、技术方案或有益效果的描述并不一定是指相同的实施例。进而,还可以任何适当的方式组合本实施例中所描述的技术特征、技术方案和有益效果。本领域技术人员将会理解,无需特定实施例的一个或多个特定的技术特征、技术方案或有益效果即可实现实施例。在其他实施例中,还可在没有体现所有实施例的特定实施例中识别出额外的技术特征和有益效果。
附图说明
图1-图4是本申请实施例提供的一些电子设备的结构示意图;
图5是本申请实施例提供的一种显示指纹图标高亮的图像的过程示意图;
图6示出了一种确定指纹图标高亮的图像的过程示意图;
图7-图8是本申请实施例提供的一些用户界面实施例的示意图;
图9是本申请实施例提供的一种显示方法的流程示意图;
图10是本申请实施例提供的一种显示屏的调光模式的示意图;
图11-图12是本申请实施例提供的一些电子设备的形态示意图。
具体实施方式
在本文中对本发明的描述中所使用的术语只是为了描述特定实施例的目的,而并非旨在作为对本发明的限制。如本在发明的说明书和所附权利要求书中所使用的那样,单数表达形式“一个”、“一种”、“所述”、“该”和“这一”旨在也包括复数表达形式,除非其上下文中明确地有相反指示。还应当理解,本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。
本申请实施例中涉及的电子设备可以是手机、平板电脑、手持计算机、个人数字助理(Personal Digital Assistant,PDA)等移动终端,智能电视、智能摄像头等智能家居设备,智 能手环、智能手表、智能眼镜等可穿戴设备,或其他桌面型、膝上型、笔记本电脑、超级移动个人计算机(Ultra-mobile Personal Computer,UMPC)、上网本、智慧屏等设备。
接下来介绍本申请实施例示例性的电子设备100。
请参见图1,图1示例性示出一种电子设备100的硬件结构示意图。
如图1所示,电子设备100可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
可以理解的是,本发明实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中,电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。例如,上述示出的多个处理单元均集成在一个系统芯片(system on chip,SoC)内,或者,AP为一个单独的半导体芯片,其他处理单元集成在一个SoC内,本申请对此不作限定。
控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
在一些实施例中,处理器110可以包括一个或多个通信接口(简称接口)。接口例如但不限于可以包括:集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,MIPI,通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
其中,MIPI接口可以被用于连接处理器110与摄像头193、显示屏194等外围器件。在一些实施例,MIPI接口可以包括显示屏串行接口(display serial interface,DSI)、摄像头串行接口(camera serial interface,CSI)等。可选地,处理器110和摄像头193通过CSI接口通信,实现电子设备100的拍摄功能。可选地,处理器110和显示屏194通过DSI接口通信,实现电子设备100的显示功能。
可以理解的是,本发明实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备100的结构限定。在本申请另一些实施例中,电子设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
充电管理模块140用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块140可以通过电子设备100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时,还可以通过电源管理模块141为电子设备供电。
电源管理模块141用于连接电池142,充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入,为处理器110,内部存储器121,显示屏194,摄像头193,和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块141也可以设置于处理器110中。在另一些实施例中,电源管理模块141和充电管理模块140也可以设置于同一个器件中。
电子设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A,受话器170B等)输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,电子设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenith satellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
电子设备100可以通过GPU,显示屏194,以及应用处理器等实现显示功能。在一些实施例,GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。显示屏194可以包括显示驱动集成电路(display driver integrated circuit,DDIC)和显示面板。DDIC为显示屏194内部用于控制显示屏194工作的装置(例如芯片),例如,DDIC可以产生一定的电信号来控制显示面板显示图像。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施例中,电子设备100可以包括1个或N个显示屏194,N为大于1的正整数。在一些实施例中,一个显示屏194可以包括1个或N个DDIC。
电子设备100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,电子设备100可以包括1个或N个摄像头193,N为大于1的正整数。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当电子设备100在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样,电子设备100可以播放或录制多种编码格式的视频,例如:动态图像专家组 (moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。通过NPU可以实现电子设备100的智能认知等应用,例如:图像识别,人脸识别,语音识别,文本理解等。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。处理器110通过运行存储在内部存储器121的指令,和/或存储在设置于处理器中的存储器的指令,执行电子设备100的各种功能应用以及数据处理。
电子设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中,音频模块170可以设置于处理器110中,或将音频模块170的部分功能模块设置于处理器110中。
扬声器170A,也称“喇叭”,用于将音频电信号转换为声音信号。电子设备100可以通过扬声器170A收听音乐,或收听免提通话。
受话器170B,也称“听筒”,用于将音频电信号转换成声音信号。当电子设备100接听电话或语音信息时,可以通过将受话器170B靠近人耳接听语音。
麦克风170C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风170C发声,将声音信号输入到麦克风170C。电子设备100可以设置至少一个麦克风170C。在另一些实施例中,电子设备100可以设置两个麦克风170C,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,电子设备100还可以设置三个,四个或更多麦克风170C,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130,也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
压力传感器180A用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器180A可以设置于显示屏194中。压力传感器180A的种类很多,如电阻式压力传感器,电感式压力传感器,电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器,电极之间的电容改变。电子设备100根据电容的变化确定压力的强度。当有触摸操作作用于显示屏194,电子设备100可以根据压力传感器180A检测上述触摸操作强度。电子设备100也可以根据压力传感器180A的检测信号来计算触摸的位置,例如确定触摸操作位于指纹识别区域。在一些实施例,作用于相同触摸 位置,但不同触摸操作强度的触摸操作,可以对应不同的操作指令。例如但不限于,当有压力值小于第一压力阈值的触摸操作作用于短消息应用图标时,执行查看短消息的指令。当有压力值大于或等于第一压力阈值的触摸操作作用于短消息应用图标时,执行新建短消息的指令。
触摸传感器180K,也称“触控器件”。在一些实施例中,触摸传感器180K可以设置于显示屏194中,由触摸传感器180K与显示屏194组成触摸屏,也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器180K可以将检测到的触摸操作传递给处理器110,以确定触摸事件类型,例如,显示屏194显示锁屏界面时,触摸传感器180K可以将检测到的作用于指纹识别区域的触摸操作传递给AP,AP可以确定该触摸操作对应的触摸事件类型为指纹解锁。电子设备100可以通过显示屏194提供与触摸操作相关的视觉输出,例如,电子设备100通过显示屏194显示和上述作用于指纹识别区域的触摸操作相关的视觉输出:指纹识别区域的亮度调高。在另一些实施例中,触摸传感器180K也可以设置于电子设备100的表面,与显示屏194所处的位置不同。
指纹传感器180H用于采集指纹。在一些实施例中,指纹传感器180H设置于显示屏194的指纹识别区域中,在另一些实施例中,指纹传感器180H设置于显示屏194的指纹识别区域的下方。在一些实施例,电子设备100可以通过指纹传感器180H来采集作用于指纹识别区域的手指的光学指纹信息。在一些实施例,电子设备100可以利用采集的指纹特性实现指纹解锁,指纹支付,访问应用锁,指纹拍照,指纹接听来电等功能。
环境光传感器180L用于感知环境光亮度。在一些实施例,电子设备100可以根据感知的环境光亮度自适应调节显示屏194亮度。在一些实施例,显示屏194中的DDIC控制指纹识别区域的亮度时,即使环境光传感器感知的环境光亮度发生变化,也会保证指纹识别区域亮度调整前后,指纹识别区域外的区域(简称蒙版区域)的亮度不变。
陀螺仪传感器180B可以用于确定电子设备100的运动姿态。在一些实施例,可以通过陀螺仪传感器180B确定电子设备100围绕三个轴(即,x,y和z轴)的角速度。陀螺仪传感器180B可以用于检测作用于电子设备100的抬起操作,例如,电子设备100可以响应于抬起操作,显示指纹解锁中的用户界面。陀螺仪传感器还可以用于拍摄防抖、导航,体感游戏场景。
加速度传感器180E可检测电子设备100在各个方向上(一般为三轴)加速度的大小。当电子设备100静止时可检测出重力的大小及方向。还可以用于识别电子设备100姿态(例如是否被抬起),应用于光学指纹识别、横竖屏切换,计步器等应用。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。电子设备100可以接收按键输入,产生与电子设备100的用户设置以及功能控制有关的键信号输入。
马达191可以产生振动提示。马达191可以用于来电振动提示,也可以用于触摸振动反馈。例如,作用于不同应用(例如拍照,音频播放等)的触摸操作,可以对应不同的振动反馈效果。作用于显示屏194不同区域的触摸操作,马达191也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。
指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。
请参见图2,图2示例性示出又一种电子设备100的硬件结构示意图。
如图2所示,电子设备100可以包括处理器210、显示屏220、存储器230和收发器240。其中,处理器210可以包括应用处理器(AP)211,显示屏220可以包括显示驱动集成电路(DDIC)221和显示面板222。在一些实施例中,处理器210可以为上图1所示的处理器110,可选地,处理器210可以包括一个或多个AP211。在一些实施例中,显示屏220可以为上图1所示的显示屏194,可选地,显示屏220可以包括一个或多个DDIC221。在一些实施例中,存储器230可以包括上图1所示的外部存储器接口120和/或内部存储器121。在一些实施例中,收发器230可以包括以下至少一项:上图1所示的天线1、天线2、移动通信模块150和无线通信模块160。
不限于图2示例的情况,在另一些实施例中,电子设备100还可以包括上图1所示的至少一个模块,具体可参见上图1的内容。
本申请中,电子设备100可以实现光学指纹识别。示例性地,光学指纹识别时,用户手指一般作用于显示面板222中的指纹识别区域,可以利用指纹识别区域处的光线照射到手指上,并由另一接收处(例如指纹传感器)来侦测光线的反射讯息,进而得到光学指纹信息。因此指纹识别时,指纹识别区域的亮度通常很高,例如高于显示面板222中除指纹识别区域外的其他区域(简称蒙版区域)的亮度。而指纹识别前,指纹识别区域的亮度通常和蒙版区域的亮度保持一致。指纹识别前和指纹识别时,指纹识别区域的显示效果不同,例如指纹识别前指纹识别区域上显示指纹图标,指纹识别时指纹识别区域上显示内容的颜色为白色。指纹识别前和指纹识别时,蒙版区域的显示效果不变,例如显示内容不变。
本申请中,指纹识别区域的亮度大于或等于预设亮度值,例如大于或等于800尼特(nit),可以称为指纹识别区域高亮。指纹识别区域的亮度大于或等于预设亮度值,并且高于蒙版区域的亮度,可以称为指纹识别区域局部高亮。
目前,AP211绘制的图像可以通过通信接口(例如MIPI)发送至DDIC221,由DDIC221控制显示面板222显示。绘制的图像例如为光学指纹识别时显示屏220显示的图像。电子设备100可以包括多个AP211,这多个AP211可能属于不同厂家、不同平台。电子设备一般仅包括一个厂家的显示屏220。在不同的场景下电子设备100可能使用不同的AP211来绘制图像,例如指纹解锁和指纹支付下,用于绘制图像的AP不同,这样很可能出现指纹识别前和指纹识别时,蒙版区域的显示效果不同,用户体验感不好。
本申请中,AP211可以通过通信接口(例如MIPI)向DDIC221发送指示信息,以使DDIC221控制指纹识别区域的亮度,以及控制蒙版区域的亮度,显示面板222可以在DDIC221的控制下显示指纹识别时的图像。也可以理解为是AP211指示DDIC211实现指纹识别区域的局部高亮。指纹识别时的图像无需由AP211绘制,不依赖于AP211的厂家和平台,显示效果较好,提升用户体验。
在一些实施例中,AP211可以包括指纹光斑模块211A、通信接口211B、绘制模块211C、子像素重排(sub pixel rearrangement,SPR)模块211D和色彩模块211E。显示屏220的DDIC221可以包括通信接口2211、局部高亮模块2212和转换模块2213,具体可参见图3所示的电子设备100。图3仅示出了AP211和显示屏220,其他模块可参见图1-图2的说明。
指纹光斑模块211A可以用于确定第一指示信息,第一指示信息用于指示DDIC221确定指纹识别时的图像。指纹光斑模块211A可以用于确定实现指纹识别区域局部高亮的参数,在一些实施例中,该参数可以包括蒙版区域降低灰阶时所使用的阿尔法(alpha)值,alpha值的取值范围为[0,1],取值越小,降低灰阶的效果越强。alpha值可以用于DDIC221控制蒙版区域的亮度,以使指纹识别前和指纹识别时,蒙版区域的显示效果不变(例如显示内容不 变和亮度不变)。在一些实施例中,该参数可以包括指纹识别区域的亮度编码,亮度编码可以用于指示指纹识别区域的亮度值,不限于此,还可以用于指示指纹识别区域的数量、大小、位置、形状、颜色等参数。亮度编码可以用于DDIC221控制指纹识别区域的亮度,以使指纹识别时指纹识别区域高亮,从而电子设备100可以采集作用于指纹识别区域的触摸操作的手指的光学指纹信息。
通信接口211B可以是MIPI接口。不限于此,在另一些实施例中,通信接口211B也可以是高清晰多媒体接口(high definition multimedia interface,HDMI)等其他通信接口。通信接口211B可以用于向DDIC221发送数据和/或指令,例如指纹光斑模块211A确定的第一指示信息、实现指纹识别区域局部高亮的参数等,绘制模块211C确定的图像(经过SPR模块211D和色彩模块211E处理后传输至通信接口211B)等。
绘制模块211C可以用于绘制图像,绘制后的图像用于发送至显示屏220上显示。例如,绘制模块211C可以绘制指纹识别时的图像(例如包括指纹解锁的动画效果的图像),具体示例可参见下图6所示。绘制模块211C也可以绘制指纹识别前的图像(如锁屏界面等)、指纹识别后的图像(如电子设备100的桌面或应用程序的界面等)。
SPR模块211D可以用于对绘制模块211C得到的图像进行SPR处理。在一些实施例中,显示面板内部的像素可以不是真(real)三原色光模式(red green blue,RGB)排布:一个像素包括R、G、B这三个子像素,即分别点亮R、G和B这三个子像素,这一个像素显示为白色。显示面板内部的一个像素可以是由R、G、B三个子像素中至少一个子像素构成,例如一个像素1包括一个R子像素和一个G子像素,另一个像素2包括一个B子像素和一个G像素。SPR处理可以实现“借”像素2的B子像素来“补”像素1缺少的B像素,点亮像素2的B子像素来形成一个白色像素1。因此,SPR处理可以减少AP211和DDIC221之间传输的图像数据量,从而减小传输带宽和功耗。可以理解地,相比40纳米(nm)工艺制程的DDIC221,AP211采用更优的工艺制程,例如7nm或5nm。相同的SPR算法在AP211侧运行的功耗,比在DDIC221侧运行的功耗更低,并且一个电子设备100使用一套SPR算法即可满足需求。因此通常是在AP211侧运行SPR算法来达到节省电子设备功耗的目的(这样一天大概可以节省100毫安时(mAh)的电池容量)。但绘制模块211C得到的指纹识别时的图像,经过SPR模块211D处理后,蒙版区域上图像的灰阶过度存在明显的分界线,即无法同时保证较低的功耗,以及光学指纹识别时较好的显示效果。
色彩模块211E可以用于实现电子设备100的护眼模式、鲜艳模式等显示模式。这些显示模式开启时,色彩模块211E可以对绘制模块211C得到的图像进行处理,例如调整亮度、调整颜色等。但绘制模块211C得到的指纹识别时的图像,经过色彩模块211E处理后,蒙版区域上图像会出现严重的偏色和灰阶过度问题,显示效果较差。若在指纹识别时关闭护眼模式、鲜艳模式等模式,指纹识别结束后再打开,体验敏感的用户可能会感知到闪屏、色调突变等情况,导致用户舆情。
DDIC221的通信接口2211和AP211的通信接口211B类似。通信接口2211可以用于接收其他装置(例如AP211)发送的数据和/或指令。在一些实施例,DDIC221可以接收AP211发送的绘制模块211C确定的图像,并控制显示面板222显示。在另一些实施例中,DDIC221可以接收AP211发送的指纹光斑模块211A确定的第一指示信息,可选地以及实现指纹识别区域局部高亮的参数,并传输至局部高亮模块2212处理。在一些实施例中,指纹光斑模块211A确定的第一指示信息,可选地以及实现指纹识别区域局部高亮的参数,可以直接通过通信接口211B传输至DDIC211,可以理解为是放通(bypass)了SPR模块211D和色彩模块 211E。
局部高亮模块2212可以用于响应于AP211发送的第一指示信息,确定指纹识别时的图像。在一些实施例,局部高亮模块2212可以响应于第一指示信息,同时控制指纹识别区域的亮度和蒙版区域的亮度,避免出现闪屏问题。在一些实施例中,局部高亮模块2212确定的指纹识别时的图像可以传输至转换模块2213。转换模块2213可以用于对待显示的图像进行处理,以将其转换为控制显示面板222显示的信号,该信号可以传输至显示面板222,以使显示面板222显示上述待显示的图像,例如指纹识别时的图像。
在一些实施例中,局部高亮模块2212可以包括使能模块2212A、指纹模块2212B和蒙版模块2212C,具体可参见图4所示的电子设备100。
使能模块2212A可以用于基于AP211发送的第一指示信息,指示指纹模块2212B控制指纹识别区域的亮度,以及指示蒙版模块2212C控制蒙版区域的亮度,从而确定指纹识别时的图像。在一些实施例中,AP211发送第一指示信息时,可以一起发送使能模块2212A的地址信息,可选地,第一指示信息可以被写入该地址信息对应的使能模块2212A。示例性地,第一指示信息写入使能模块2212A时,使能模块2212A的比特(bit)位可以置1,可以理解为是将对应的硬件电路设置为高电平,可以理解为是使能指纹识别区域局部高亮的功能。
指纹模块2212B可以用于控制指纹识别区域的亮度,不限于此,还可以控制指纹识别区域的数量、大小、位置、形状、颜色等显示效果。在一些实施例中,指纹模块2212B可以基于使能模块2212A发送的使能信号,控制指纹识别区域的亮度,在另一些实施例中,指纹模块2212B可以基于AP211发送的第一指示信息,控制指纹识别区域的亮度。
在一些实施例中,指纹模块2212B可以基于AP211发送的指纹识别区域的亮度编码,控制指纹识别区域的亮度,可选地,AP211发送指纹识别区域的亮度编码时,会一起发送指纹模块2212B的地址信息,可选地,亮度编码可以被写入该地址信息对应的指纹模块2212B,可选地,亮度编码可以包括指纹模块2212B的使能信号,亮度编码写入指纹模块2212B时,指纹模块2212B可以被使能,以控制指纹识别区域的亮度。示例性地,亮度编码写入指纹模块2212B时,指纹模块2212B的bit位可以置1,可以理解为是使能控制指纹识别区域显示的功能。可选地,亮度编码可以用于指示指纹识别区域的亮度值,例如1110的亮度编码指示亮度值为800nit,1111的亮度编码指示亮度值为850nit。不限于此,亮度编码还可以用于指示指纹识别区域的其他参数,例如数量、大小、位置、形状、颜色等。
在另一些实施例中,指纹模块2212B可以基于预置的指纹识别区域的亮度,控制指纹识别区域的亮度,不限于此,还可以预置有数量、大小、位置、形状、颜色等其他参数,可以基于预置的指纹识别区域的参数,控制指纹识别区域的显示。
在一些实施例中,指纹模块2212B控制指纹识别区域的亮度,具体为设置指纹识别区域的中的像素的灰阶和显示亮度值(display brightness value,DBV)。假设指纹识别区域高亮时像素的亮度值为900nit,900nit对应的DBV为第一阈值,指纹模块2212B控制指纹识别区域高亮时,可以将DBV设置为第一阈值,灰阶设置为第二阈值。可选地,通常指纹识别区域高亮时像素的亮度值对应的DBV为最大值,例如DBV的取值为0-4095,第一阈值为4095。可选地,通常指纹识别区域高亮时,像素的灰阶被设置为最大值,例如灰阶的取值为0-255,第二阈值为255,可选地,通常指纹识别区域的像素的灰阶均设置为最大值时,指纹识别区域的图像的颜色为白色。
指纹模块2212B控制指纹识别区域的亮度的情况下,显示面板222显示指纹识别时的图像,可以理解为是指纹模块2212B控制的是显示面板222显示指纹识别时的图像时,指纹识 别区域的显示亮度。
蒙版模块2212C可以用于控制蒙版区域的亮度,在一些实施例中,蒙版模块2212C可以基于使能模块2212A发送的使能信号,控制蒙版区域的亮度,在另一些实施例中,蒙版模块2212C可以基于AP211发送的第一指示信息,控制蒙版区域的亮度。
在一些实施例中,蒙版模块2212C可以基于AP211发送的alpha值,控制蒙版区域的亮度,在另一些实施例中,蒙版模块2212C可以自行确定alpha值,基于自行确定的alpha值控制蒙版区域的亮度,在另一些实施例中,蒙版模块2212C可以预置有alpha值(例如为1,可以理解为是降低灰阶前后图像的亮度和颜色不变),可以基于预置的alpha值控制蒙版区域的亮度。
蒙版模块2212C控制蒙版区域的亮度的情况下,显示面板222显示指纹识别时的图像,可以理解为是蒙版模块2212C控制的是显示面板222显示指纹识别时的图像时,蒙版区域的显示亮度。
在一些实施例中,蒙版模块2212C控制蒙版区域的亮度具体为:对蒙版区域的图像降低灰阶(例如调低亮度、调暗色彩等),以实现显示面板222显示指纹识别时的图像时,蒙版区域的图像(可称为显示蒙版),和显示面板22显示指纹识别前的图像时,蒙版区域的图像(可称为基准蒙版)的显示效果一致,例如图像内容、亮度、帧率等均相同,其中帧率可以理解为是每秒显示的图像的帧数,单位为赫兹(hz)。示例性地,蒙版模块2212C可以先对基准蒙版进行处理(例如调高亮度),然后将处理后的蒙版区域的图像的灰阶乘以alpha值,即可得到显示蒙版的灰阶。alpha的取值范围为[0,1],alpha的取值越小,降低灰阶的效果越强。或者,蒙版模块2212C也可以不对基准蒙版进行处理,直接将基准蒙版作为显示蒙版(可以理解为是alpha值等于1)。
在一些实施例中,蒙版模块2212C可以基于AP211发送的alpha值,对蒙版区域的图像降低灰阶,可选地,AP211发送alpha值时,会一起发送蒙版模块2212C的地址信息,可选地,AP211发送alpha值时,会一起发送蒙版模块2212C的使能信号,可选地,该使能信号可以被写入该地址信息对应的蒙版模块2212C,示例性地,该使能信号写入蒙版模块2212C时,蒙版模块2212的bit位可以置1,可以理解为是使能控制蒙版区域显示的功能。可选地,alpha值可以被写入该地址信息对应的蒙版模块2212C,示例性地,alpha值写入蒙版模块2212C时,蒙版模块2212C可以通过alpha值来降低基准蒙版的灰阶,以保证显示蒙版和基准蒙版的显示效果一致。
可以理解地,上述示例的电子设备100包括的任意一个模块可以是硬件模块,也可以是软件模块。上述任意一个模块可以是单独的模块,上述至少一个模块可以是集成在一起的。
不限于上述示例的结构,在另一些实施例中,AP可以包括处理器、存储器和通信接口。在另一些实施例中,DDIC可以包括处理器、存储器和通信接口。其中,处理器例如包括一个或多个CPU,处理器包括一个CPU时,该CPU可以是单核CPU,也可以是多核CPU。存储器包括但不限于是随机存储记忆体(random access memory,RAM)、只读存储器(read-only memory,ROM)、可擦除可编程只读存储器(erasable programmable read only memory,EPROM)、或便携式只读存储器(compact disc read-only memory,CD-ROM)。存储器用于存储相关计算机程序及数据。通信接口用于接收和/或发送信息,例如用于AP和DDIC之间传输指令和/或数据。
在一些实施例中,AP211可以包括GPU和显示子系统(display subsystem,DSS)。GPU可以用于对图像数据进行绘图和渲染计算,生成待显示图像。GPU又可以称为显示核心或视 觉处理器,是一种执行图像运算工作的微处理器,可包括2D(维,Dimension)和/或3D处理功能。DSS可以用于对接显示屏,对CPU或GPU生成的待显示图像进行显示处理,与GPU进行具体显示图像像素级的处理不同,该器件进行例如图像缩放(大小变换)、方向翻转、亮度和对比度调整、多个图层/窗口的叠加(overlay)等的桌面级显示处理。示例性地,上图3-图4所示的AP211中,指纹光斑模块211A和绘制模块211C可以均集成在GPU中,SPR模块211D和色彩模块211E可以均集成在DSS中。
在一些实施例中,DDIC221的存储器可以包括一个或多个寄存器。具体示例如下所示:
示例1,上图4所示的DDIC221中,局部高亮模块2212可以为一个寄存器,使能模块2212A、指纹模块2212B和蒙版模块2212C可以是这一个寄存器上不同地址的子模块。
示例2,上图4所示的DDIC221中,使能模块2212A、指纹模块2212B和蒙版模块2212C可以为存储器中不同地址的不同寄存器。
示例3,上图4所示的DDIC221中,使能模块2212A和指纹模块2212B可以是一个寄存器上不同地址的子模块。
示例4,上图4所示的DDIC221中,使能模块2212A和蒙版模块2212C可以是一个寄存器上不同地址的子模块。
可以理解地,电子设备100可以接收触发显示指纹识别时的图像的用户操作,响应于该用户操作,可以确定指纹识别时的图像,并控制显示屏220显示。上述用户操作例如但不限于是压力传感器和/或触摸传感器检测到作用于显示屏的触摸操作,压力传感器和/或触摸传感器检测到作用于指纹识别区域的触摸操作,加速度传感器和/或陀螺仪传感器检测到抬起操作等。若由AP211绘制指纹识别时的图像,例如由绘制模块211C绘制指纹识别时的图像,则该图像会经过SPR模块211D和色彩模块211E处理,造成蒙版区域的实际显示效果很差。而本申请中,指纹光斑模块211A可以直接通过通信接口211B向DDIC221发送第一指示信息,由DDIC221确定指纹识别时的图像。该图像无需经过SPR模块211D,因此可以同时保证较低功耗和蒙版区域较好的显示效果。该图像也无需经过色彩模块211E,既可以保证指纹识别时护眼模式、鲜艳模式等显示模式不会被关闭,避免用户舆情,也可以保证蒙版区域较好的显示效果。并且,本申请还简化了AP侧的处理流程,提升了识别速度,具体示例可参见下图5。
请参见图5,图5示例性示出一种处理流程的示意图。
如图5所示,帧率示意图中,横轴为时间,纵轴为电平值,其中高电平表征非显示状态,低电平表征显示状态,高电平和低电平交替出现。因此,横轴所示的时间可以包括多个显示时段(电平值为低电平的时段)和非显示时段(电平值为高电平的时段),显示时段周期性出现,一个显示时段可以理解为是显示屏显示当前一帧图像的时段,一个非显示时段可以理解为是显示屏未显示或显示上一帧已显示过的图像的时段。例如,帧率为90hz时,一个显示时段为1/90秒,即11.1毫秒(ms)。帧率为120hz时,一个显示时段为1/120秒,即8.3ms。
如图5所示,第一方案(即AP确定指纹识别时的图像)需要3个显示时段来实现,具体为:首先在显示时段1内,AP绘制融合得到指纹识别时的图像(具体过程示例可参见下图6);然后在显示时段2内,AP通过通信接口(如MIPI)向DDIC发送指纹识别时的图像;最后在显示时段3内,DDIC控制显示面板显示指纹识别时的图像。第一方案中,AP绘制的指纹识别时的图像需到下一帧才能发送到显示屏上显示。而本申请的第二方案(即DDIC确定指纹识别时的图像)仅需2个显示时段来实现,具体为:首先在显示时段1内,AP确定第一指示信息,可选地以及实现指纹识别区域局部高亮的参数,并通过通信接口(如MIPI)向 DDIC发送第一指示信息,可选地以及实现指纹识别区域局部高亮的参数;然后在显示时段2内,DDIC基于第一指示信息(可选地以及上述参数)控制显示面板上的指纹识别区域的亮度,并且控制蒙版区域的亮度,即控制显示面板显示指纹识别时的图像。本申请(即第二方案)无需绘制融合得到指纹识别时的图像的过程,节省了一帧时长,也简化了AP侧的处理流程,可用性更高。
请参见图6,图6示例性示出一种AP绘制融合得到指纹识别时的图像的过程。在一些实施例,该过程可以是由上图3-图4所示的AP211的绘制模块211C实现的。在一些实施例中,该过程可以是由AP包括的GPU实现的。
如图6的(A)所示,AP可以先绘制一帧全屏高亮的图像410,即全屏亮度均大于或等于预设亮度值。在一些实施例,除亮度外,图像410的其他显示效果可以和指纹识别前显示的图像的显示效果相同,例如色调等显示参数相同。如图6的(B)所示,AP可以先绘制一帧指纹识别区域被挖空的图像420,这里的“指纹识别区域被挖空”实际为不设置指纹识别区域的显示参数,若显示屏显示图像420,则指纹识别区域可以是全黑状态。在一些实施例,图像420中蒙版区域的显示效果可以和指纹识别前的图像中蒙版区域的显示效果相同,例如亮度、色调等显示参数相同。
然后,AP可以基于图像410和图像420融合得到指纹识别时的图像430,具体如图6的(C)所示。例如,AP可以将图像410放置在图像420的下方(图像410的尺寸和图像420的尺寸相同),图像410和图像420完全重合。
如图6的(C)所示,图像430中指纹识别区域的亮度大于或等于预设亮度值,并且高于蒙版区域的亮度,可以称为指纹识别区域局部高亮。图像430中的蒙版区域的显示效果可以和图像420中的蒙版区域的显示效果相同,例如亮度、色调等显示参数相同。图像430可以由AP通过通信接口传输至DDIC,由DDIC控制显示面板显示,以实现光学指纹识别。
不限于图6示例的情况,在另一些实施例中,AP还会在指纹识别区域和附近区域(位于蒙版区域内)绘制指纹解锁的动画效果。
接下来示例性介绍本申请涉及的应用场景。
请参见图7,图7示例性示出一种指纹解锁的用户界面示意图。
如图7的(A)所示,电子设备可以显示用户界面700,在一些实施例中,用户界面200可以为锁屏界面。电子设备可以接收用户操作(例如抬起操作,作用于显示屏的触摸操作等),响应于该用户操作,电子设备可以在显示屏上的指纹识别区域701显示指纹图标,具体示例如图7的(B)所示。上述用户操作可以理解为是用于触发指纹解锁。
如图7的(B)所示,指纹识别区域701的亮度和用户界面700上除指纹识别区域701外的蒙版区域的亮度相同。电子设备可以接收作用于指纹识别区域701的用户操作(例如触摸操作),响应于该用户操作,电子设备可以控制指纹识别区域701的亮度,具体示例如图7的(C)所示。图7的(A)和图7的(B)所示的用户界面700均可以称为指纹识别前的用户界面。
如图7的(C)所示,指纹识别区域701的亮度大于或等于预设亮度值,并且高于用户界面700上除指纹识别区域701外的蒙版区域的亮度。此时,电子设备可以通过指纹识别区域701提供的光线,采集作用于指纹识别区域701的手指的光学指纹信息。图7的(C)所示的用户界面700可以称为指纹识别时的用户界面。
在一些实施例中,用户界面700可以显示指纹解锁的提示信息702,例如:“指纹识别中, 请勿移开手指”,用户可以通过提示信息702获取到电子设备当前正在识别用户指纹。电子设备可以根据光学指纹信息识别用户身份,例如对比预置的光学指纹信息和采集的光学指纹信息,相似程度(如相同部分占全部内容的比例)大于或等于预设相似值,则确定识别通过(确定当前用户为合法用户),此时电子设备可以显示桌面或应用程序的用户界面等,相似程度小于预设相似值,则确定识别不通过(确定当前用户不为合法用户),此时电子设备可以保持显示锁屏界面,其中提示信息702可以用于指示识别结果,例如:“指纹识别失败,请重试”。在另一些实施例中,图7的(C)所示的用户界面700也可以不包括提示信息702。
在另一些实施例中,电子设备也可以在显示图7的(A)所示的用户界面700后,直接显示图7的(C)所示的用户界面700,不显示图7的(B)所示的用户界面700。在另一些实施例中,电子设备也可以不显示图7的(A)所示的用户界面700,直接显示图7的(B)所示的用户界面700和图7的(C)所示的用户界面700。
请参见图8,图8示例性示出一种指纹支付的用户界面示意图。图8以支付应用的用户界面为例进行说明。
如图8的(A)所示,电子设备可以显示用户界面810。用户界面810可以包括界面主题811(即“付款详情”)、支付金额812、付款方式813和支付控件814。其中:支付金额812用于显示用户需支付的金额(即“256.5”,单位为元)。付款方式813可以用于显示用户所使用的付款方式(即“余额”)。付款方式813还可以用于用户切换付款方式。支付控件814可以用于用户确认执行支付操作,电子设备可以接收作用于支付控件814的用户操作(例如触摸操作),响应于该用户操作,电子设备可以进行用户身份的识别以此完成支付操作,具体如图8的(B)所示。上述作用于支付控件814的用户操作可以理解为是用于触发指纹识别。
如图8的(B)所示,电子设备可以显示用户界面820。用户界面820可以包括界面主题821(即“支付界面”)、指纹识别区域822和一些提示信息等。指纹识别区域822上可以显示有指纹图标。指纹识别区域822的亮度和用户界面820上除指纹识别区域822外的蒙版区域的亮度相同。电子设备可以接收作用于指纹识别区域822的用户操作(例如触摸操作),响应于该用户操作,电子设备可以控制指纹识别区域822的亮度,即控制显示屏上的指纹识别区域高亮,具体示例如图8的(C)所示。
如图8的(C)所示,指纹识别区域822的亮度大于或等于预设亮度值,并且高于用户界面820上除指纹识别区域822外的蒙版区域的亮度。此时,电子设备可以通过指纹识别区域822提供的光线,采集作用于指纹识别区域822的手指的光学指纹信息,此时用户界面820可以显示指纹解锁的提示信息823,例如:“指纹识别中,请勿移开手指”,用户可以通过提示信息823获取到电子设备当前正在识别用户指纹。电子设备可以根据光学指纹信息识别用户身份,确定当前用户为合法用户时,电子设备可以显示支付成功的提示信息,确定当前用户不为合法用户时,电子设备可以保持显示支付界面,其中提示信息823可以用于指示识别结果,例如:“指纹识别失败,请重试”。电子设备根据光学指纹信息识别用户身份的示例和上图7类似。
在另一些实施例中,图8的(C)所示的用户界面820也可以不包括提示信息823。
在另一些实施例中,电子设备也可以在显示图8的(A)所示的用户界面810后,直接显示图8的(C)所示的用户界面820,不显示图8的(B)所示的用户界面820。在另一些实施例中,电子设备也可以在图8的(A)所示的用户界面810上显示指纹识别区域。
不限于上述列举的示例,在具体实现中,光学指纹识别还可以应用于其他身份认证场景、指纹拍照等场景,本申请对光学指纹识别的具体应用场景不作限定。
基于图1-图8所示实施例,接下来介绍本申请实施例提供的显示方法。
请参见图9,图9是本申请实施例提供的一种显示方法的流程示意图。该方法可以应用于图5所示的电子设备100。该方法可以应用于图6所示的电子设备100。该方法可以应用于图7所示的电子设备100。该方法可以包括但不限于以下步骤:
S101:应用处理器(AP)确定接收第一用户操作。
具体地,第一用户操作例如但不限于为:作用于显示屏的触摸操作,作用于显示屏上的指纹识别区域的触摸操作,抬起操作,语音(例如“解锁”、“支付”),手势(例如握拳、张开手指)等。在一些实施例中,AP接收第一用户操作时,可以确定触发光学指纹识别,则AP可以控制显示屏显示指纹识别时的用户界面。
在一些实施例中,S101之前,该方法还包括:显示屏的显示面板显示第一图像。第一图像为上述指纹识别前的图像,例如图7的(A)、图7的(B)所示的用户界面700,图8所示的用户界面820。显示面板显示第一图像时,指纹识别区域的亮度和蒙版区域的亮度相等。
S102:响应于第一用户操作,AP确定第一指示信息、指纹参数和蒙版参数。
S103:AP向显示驱动芯片(DDIC)发送第一指示信息、指纹参数和蒙版参数。
具体地,第一指示信息用于指示DDIC确定并显示第二图像,即上述指纹识别时的图像,在一些实施例中,第一指示信息具体用于指示DDIC控制显示面板上的指纹识别区域和蒙版区域的亮度。
在一些实施例中,指纹参数可以用于控制指纹识别区域的亮度。在一些实施例中,指纹参数可以为指纹识别区域的亮度编码(code),可选地,该亮度编码可以用于指示指纹识别区域的亮度值(单位可以是nit),例如亮度编码1111用于指示850nit的亮度值,不限于此,该亮度编码还可以用于指示指纹识别区域的数量、大小、位置、形状、颜色等参数,本申请对亮度编码指示的具体内容不作限定。
在一些实施例中,蒙版参数可以用于控制蒙版区域的亮度,例如用于对蒙版区域的图像进行降低灰阶的处理(例如调低亮度、调暗色彩等)。在一些实施例中,蒙版参数可以包括用于指示调光模式的信息,在另一些实施例中,蒙版参数可以和用于指示调光模式的信息一起发送至DDIC。其中,显示屏的调光模式可以包括直流电调节(direct current,DC)和脉宽调节(pulse-width modulation,PWM)。DC模式是通过改变电流来调整显示屏的亮度,不限于此,也可以通过改变电压来调整亮度,还可以通过改变电流和电压来调整亮度。而PWM模式不会改变电流和/或电压。PWM模式是通过调节占空比来调整显示屏的亮度,不限于此,也可以通过调整脉冲(pulse)数来调整显示屏的亮度,还可以通过脉冲数和占空比来调整显示屏的亮度。PWM模式的示例可参见下图10,其中,图10以脉冲数为4为例进行说明。
如图10所示,一帧图像可以包括4个遮黑的黑色条,黑色条所在部分可以理解为是灭屏状态,这4个黑色条分别对应4个处于高电平的脉冲,因此可以理解为是高电平表征灭屏状态,低电平表征亮屏状态。PWM调节时,显示屏不会持续发光,而是保持不断地点亮显示屏、熄灭显示屏,即通过显示屏的亮、灭交替来调节显示屏的亮度。每个黑色条的宽度越宽,即高电平持续的时间越长(也即灭屏时间越长),显示屏给肉眼的感官就是亮度越低,每个黑色条的宽度越窄,即高电平持续的时间越短(也即亮屏时间越长),显示屏给肉眼的感官就是亮度越高。可以理解地,高低电平是周期性出现的,黑色条的位置也是随着时间改变的,也可以理解为是:黑色条在每一帧图像上是不断移动的。PWM调节占空比实际是通过调整黑色条的宽度(调整高电平的持续时长)实现的。
由于PWM调节实际是通过显示屏的亮、灭交替来调节显示屏的亮度,因此调光模式为PWM模式时,无法保证指纹识别时,指纹识别区域的亮度值保持不变且大于或等于预设亮度值,因此,若指纹识别前显示屏的调光模式为PWM模式时,AP可以向DDIC发送指示调光模式为DC模式的信息。其中,指纹识别前,显示屏的调光模式可以为DC模式,也可以为PWM模式。示例性地,指纹识别前,显示屏的亮度小于或等于亮度阈值(例如90nit)时,调光模式为PWM模式,显示屏的亮度大于亮度阈值(例如90nit)时,调光模式为DC模式。在一些实施例中,上述指示调光模式为DC模式的信息可以和DDIC上用于控制调光模式的模块的地址一起发送,示例性地,上述指示调光模式为DC模式的信息写入该地址对应的用于控制调光模式的模块时,该模块的bit位可以置1,即将调光模式设置为DC模式。若该寄存器的bit位置0,则是将调光模式设置为PWM模式。其中,上述DDIC上用于控制调光模式的模块,可以集成在图4所示的蒙版模块2212C内部,也可以独立于蒙版模块2212C。
在另一些实施例中,上述用于指示调光模式的信息还可以在第一指示信息内,DDIC可以响应于第一指示信息设置调光模式,本申请对用于指示调光模式的信息的具体发送形式不作限定。
在一些实施例中,蒙版参数可以包括降低灰阶时所使用的alpha值。alpha的取值范围为[0,1],alpha的取值越小,降低灰阶的效果越强,例如亮度越低、颜色越暗等。
在一些实施例中,alpha值可以是AP根据指纹识别前蒙版区域的图像(可称为基准蒙版)确定的,示例性地,AP可以基于降低灰阶时所使用的表达式来确定alpha值,表达式具体为:指纹识别时蒙版区域的图像(可称为显示蒙版)的灰阶=基准蒙版的灰阶×提亮比例×alpha,其中,为了保证显示蒙版和基准蒙版相同(例如亮度、颜色等显示参数均相同),需满足提亮比例×alpha=1。假设指纹识别前的调光模式为PWM模式,则基准蒙版是在PWM模式下显示,在这种情况下,AP可以先确定基准蒙版在DC模式下显示的图像,可称为提亮图像,提亮图像的亮度可以大于基准蒙版的亮度。然后,AP可以计算提亮比例=(提亮图像的灰阶/基准蒙版的灰阶),提亮比例大于1,最后,AP可以计算alpha=(1/提亮比例),alpha小于1。假设指纹识别前的调光模式为DC模式,则提亮图像和基准蒙版相同,因此提亮比例等于1,alpha也等于1。在另一些实施例中,alpha值可以是AP预设的,例如,指纹识别区域高亮前的调光模式为DC模式时,alpha值预设为1。
可选地,显示屏显示指纹识别前的图像时,调光模式为PWM,则提亮图像的亮度高于基准蒙版的图像,alpha小于1。可选地,显示屏显示指纹识别前的图像时,调光模式为DC,则提亮图像的亮度等于基准蒙版的图像,alpha等于1。
不限于上述列举的示例,在另一些实施例中,提亮比例的计算方式也可以是:提亮比例=(全屏提亮图像的灰阶/指纹识别前的图像的灰阶),全屏提亮图像即指纹识别前的图像在DC模式下显示的图像,也可以理解为是,AP无需先根据全屏显示的图像确定蒙版区域的图像,然后再基于蒙版区域的图像确定alpha值,而是可以直接基于全屏显示的图像确定alpha值。
S104:DDIC响应于第一指示信息,基于指纹参数和蒙版参数确定指纹识别区域局部高亮的图像。
具体地,DDIC可以响应于第一指示信息,确定并控制显示面板显示第二图像,即指纹识别时的图像。在一些实施例中,DDIC可以响应于第一指示信息,更新显示面板显示的第一图像,具体为控制第一图像中指纹识别区域的亮度为第一亮度,以及控制第一图像中蒙版区域的亮度为第二亮度,更新后的第一图像为上述第二图像,即指纹识别时的图像。在一些实施例中,显示面板显示第一图像(即指纹识别前的图像)时,指纹识别区域的亮度和蒙版 区域的亮度相同,即为上述第二亮度。在一些实施例中,显示面板显示第二图像(即指纹识别时的图像)时,指纹识别区域的亮度大于或等于预设亮度值,并且大于蒙版区域的亮度,而蒙版区域的显示效果和指纹识别前的图像中蒙版区域的显示效果一致,即显示蒙版和基准蒙版的显示效果一致(例如亮度、色调等显示参数均相同)。因此可以称指纹识别时的图像中,指纹识别区域局部高亮。在一些实施例中,DDIC可以响应于第一指示信息,基于指纹参数控制显示面板上的指纹识别区域的亮度,同时基于蒙版参数控制蒙版区域的亮度,从而保证不出现闪屏等情况。
在一些实施例中,DDIC可以响应于第一指示信息,基于AP发送的指纹参数控制显示面板上的指纹识别区域的亮度,不限于此,还可以控制指纹识别区域的数量、大小、位置、形状、颜色等显示效果。在一些实施例中,DDIC可以基于指纹参数,确定指纹识别区域的驱动电压和/或电流为第一电压和/或第一电流。可选地,DDIC可以基于指纹参数,将指纹识别区域中像素的DBV设置为第一阈值,灰阶设置为第二阈值。DBV为第一阈值以及灰阶为第二阈值时,对应的驱动电压和/或电流为第一电压和/或第一电流。可选地,通常指纹识别区域高亮时像素的亮度值对应的DBV为最大值,例如DBV的取值为0-4095,第一阈值为4095。可选地,通常指纹识别区域高亮时,像素的灰阶被设置为最大值,例如灰阶的取值为0-255,第二阈值为255,可选地,通常指纹识别区域的像素的灰阶均设置为最大值时,指纹识别区域的图像的颜色为白色。
在一些实施例中,DDIC可以响应于第一指示信息,基于AP发送的蒙版参数确定指纹识别时蒙版区域的图像(即显示蒙版)。在一些实施例中,DDIC可以接收AP发送的用于指示调光模式为DC模式的信息,将调光模式设置为DC模式。在一些实施例中,DDIC可以基于蒙版参数,对调光模式为DC模式时指纹识别前蒙版区域的图像(即调光模式为DC时的基准蒙版,也即提亮图像)进行降低灰阶的处理,以得到显示蒙版。在一些实施例中,蒙版参数可以包括降低灰阶时所使用的alpha值,DDIC可以根据提亮图像和alpha值得到显示蒙版,即显示蒙版的灰阶=(提亮图像的灰阶×alpha)。
不限于图9列举的情况,在另一些实施例中,AP也可以不向DDIC发送指纹参数,DDIC可以响应于第一指示信息,基于预置的指纹参数控制指纹识别区域局部高亮。示例性地,DDIC可以预置有指纹识别区域的亮度值,DDIC可以响应于第一指示信息,基于预置的亮度值控制指纹识别区域的亮度,不限于此,还可以预置有数量、大小、位置、形状、颜色等参数,DDIC可以基于预置的参数控制指纹识别区域的显示。
不限于图9列举的情况,在另一些实施例中,AP也可以不向DDIC发送蒙版参数,DDIC可以响应于第一指示信息,基于预置的蒙版参数对蒙版区域降低灰阶,以得到显示蒙版。例如若显示屏显示指纹识别前的图像时,调光模式为DC,alpha值预置为1。在另一些实施例中,DDIC可以自行计算alpha值,计算方式的示例可参见S101-S102中AP计算alpha值的说明。DDIC可以响应于第一指示信息,基于自行计算的alpha值确定显示蒙版。
可以理解地,由于DDIC可能会对待显示的图像进行一些处理(例如伽马处理),然后再控制显示面板显示。因此,DDIC自行计算alpha值时,确定的提亮图像更符合显示面板上实际显示的效果,降低灰阶后得到的显示蒙版也和基准蒙版的显示效果更加一致,提升了蒙版区域的显示效果。
在图9所示方法中,AP向DDIC发送第一指示信息,以控制DDIC确定并显示指纹识别时的图像,DDIC可以同时控制指纹识别区域和蒙版区域的亮度,无需AP绘制融合得到指纹识别时的图像(例如执行上图6所示过程),显示效果不依赖于AP平台和厂家,也简化了 AP侧处理流程,提升了识别速度。并且,指纹识别时的图像也不会经过AP侧的SPR处理,同时保证了较低功耗和蒙版区域较好的显示效果,指纹识别时的图像也不会经过AP侧的色彩处理,既可以保证指纹识别时护眼模式、鲜艳模式等显示模式不会被关闭,避免用户舆情,也可以保证蒙版区域较好的显示效果。
并且,实现指纹识别区域局部高亮的指纹参数和/或蒙版参数可以为DDIC预置的参数,也可以为AP根据不同场景不同显示屏实时配置的参数,可适配性更强,应用场景更为广泛。
在一种可能的实现方式中,DDIC可以单独控制指纹识别区域的显示方式,例如控制指纹识别区域的大小、形状、数量、位置、颜色、亮度等,而不影响指纹识别区域外蒙版区域的显示效果。例如,DDIC可以单独控制指纹识别区域的亮度,而不影响指纹识别区域外蒙版区域的亮度(即蒙版区域的亮度保持不变)。在一些实施例中,AP可以向DDIC发送第一指示信息和指纹参数。DDIC可以响应于第一指示信息,基于AP发送的指纹参数,单独控制指纹识别区域的显示。在另一些实施例中,AP可以向DDIC发送第一指示信息,DDIC可以响应于第一指示信息,基于预置的指纹参数,单独控制指纹识别区域的显示。
在一些实施例中,指纹识别区域的数量可以有多个,这多个指纹识别区域的位置可以不同。这多个指纹识别区域的显示方式可以相同,也可以不同,例如部分高亮,部分不高亮,具体示例可参见下图11-图12。
在一些实施例,电子设备可以配置有不可折叠的显示屏,这一个显示屏可以包括至少一个DDIC,这一个显示屏上可以有多个指纹识别区域,这多个指纹识别区域可以由一个或多个DDIC控制,这一个或多个DDIC可以是显示屏包括的至少一个DDIC的全部或部分,具体示例如下图11所示。
请参见图11,图11示例性示出一种电子设备的形态示意图。
如图11所示,电子设备可以包括一个显示屏,这一个显示屏的显示面板可以被划分为上下两个区域:区域1和区域2,区域1和区域2上可以分别存在一个指纹识别区域。区域1的指纹识别区域可以由显示屏的DDIC1控制显示,区域2的指纹识别区域可以由显示屏的DDCI2控制。在一些实施例,DDIC1和DDIC2可以通过串联方式连接,可选地,DDIC1和DDIC2中可以存在一个主DDIC和一个从DDIC,主DDIC可以用于控制从DDIC工作,以实现区域1和区域2共同显示一帧图像。
不限于图11列举的示例,在具体实现中,区域1和区域2的指纹识别区域也可以由一个DDIC控制。或者,区域1和区域2也可以为左右两个区域。或者,一个区域可以包括多个指纹识别区域,本申请对指纹识别区域的具体显示方式,以及控制显示的DDIC不作限定。
在另一些实施例中,电子设备可以配置有可折叠的显示屏(可以称为折叠屏),折叠屏可以包括至少一个DDIC,折叠屏上可以有多个指纹识别区域,这多个指纹识别区域可以由一个或多个DDIC控制,这一个或多个DDIC可以是折叠屏包括的至少一个DDIC的全部或部分,具体示例如下图12所示。
请参见图12,图12示例性示出又一种电子设备的形态示意图。其中,图12的(A)示出了电子设备一种视角的示意图,图12的(B)示出了电子设备又一种视角的示意图。
如图12所示,电子设备可以包括一个柔性折叠屏,该折叠屏可以包括弯折线两侧的第一显示区域和第二显示区域,折叠屏可以沿着弯折线弯折。折叠屏可以处于展开状态或弯折状态(包括折叠状态),也可以理解为是配置有折叠屏的电子设备可以处于展开状态或弯折状态。
如图12的(A)所示,折叠屏处于展开状态时,折叠屏的弯折角度a大约为180度,折 叠屏的弯折角度也可以理解为是第一显示区域所在平面和第二显示区域所在平面的角度。不限于此,弯折角度a也可以大于或等于170度,且小于或等于180度,本申请对展开状态下折叠屏的弯折角度的具体取值不作限定。
如图12的(B)所示,折叠屏处于弯折状态时,折叠屏的弯折角度b大约为120度,不限于此,弯折角度b可以大于或等于0度,且小于180度,例如但不限于为0度(此时也可称为折叠状态,此时第一显示区域和第二显示区域的出光面相对)、60度、90度等,本申请对弯折状态下折叠屏的弯折角度的具体取值不作限定。
如图12所示,第一显示区域可以被划分为上下两个区域:区域1和区域2,第二显示区域可以被划分为上下两个区域:区域3和区域4。这四个区域上可以分别存在一个指纹识别区域。区域1和区域3的指纹识别区域可以由折叠屏的DDIC1控制,区域2和区域4的指纹识别区域可以由折叠屏的DDIC2控制。在一些实施例,DDIC1和DDIC2可以通过串联方式连接,可选地,DDIC1和DDIC2中可以存在一个主DDIC和一个从DDIC,主DDIC可以用于控制从DDIC工作,以实现第一显示区域和第二显示区域共同显示一帧图像。
不限于图12列举的情况,在具体实现中,区域1和区域2的指纹识别区域可以由折叠屏的DDIC1控制,区域3和区域4的指纹识别区域可以由折叠屏的DDIC2控制。或者,折叠屏上的4个区域由一个DDIC控制。或者,第一显示区域和第二显示区域上还可以有更多或更少的指纹识别区域,本申请对指纹识别区域的具体显示方式,以及控制显示的DDIC不作限定。
不限于图12列举的情况,在具体实现中,电子设备的折叠屏也可以是刚性屏和柔性屏、链条等连接组件拼接而成的显示屏,例如,折叠屏可以是由两个刚性屏和用于连接这两个刚性屏的链条拼接而成的,第一显示区域和第二显示区域分别为上述两个刚性屏上的区域,均用于显示用户界面。第一显示区域可以包括至少一个DDIC,第一显示区域上的区域1和区域2的指纹识别区域可以分别由不同的DDIC控制。第二显示区域可以包括至少一个DDIC,第二显示区域上的区域3和区域4可以分别由不同的DDIC控制。在一些实施例,第一显示区域中用于控制区域1的DDIC,和第二显示区域中用于控制区域3的DDIC可以通过串联方式连接,可选地,这两个DDIC中可以存在一个主DDIC和一个从DDIC,主DDIC可以用于控制从DDIC工作,以实现区域1和区域3共同显示一帧图像。本申请对电子设备的显示屏的结构,指纹识别区域的具体显示方式,以及控制显示的DDIC不作限定。
不限于图11和图12列举的情况,在具体实现中,电子设备的两面可以均配置有显示屏,这两面的显示屏可以为两个显示屏,也可以为一个柔性折叠屏,其中,若这两面的显示屏为两个显示屏时,每个显示屏可以是上图11所示的显示屏,也可以是上图12所示的显示屏。不论结构如何,对于每个显示屏,指纹识别区域和控制指纹识别区域的DDIC也和上图11-图12类似。本申请对电子设备的具体形态(也可以理解为是显示屏的具体形态)不作限定。
上述每个指纹识别区域的控制方式和上图1-图10所示的指纹识别区域的控制方式类似,不再赘述。
可以理解地,指纹识别区域的数量、位置等显示方式可以根据实际需求灵活配置,应用场景更为广泛。
在一种可能的实现方式中,DDIC可以单独实现降低灰阶的功能,以调整显示图像的亮度。例如开启防频闪功能时,DDIC可以接收AP绘制的图像,然后对该图像进行降低灰阶的处理,以在显示面板上显示降低灰阶后的图像。降低灰阶的实现方式和上图1-图10中对蒙版区域降低灰阶的实现方式类似,只是降低灰阶不限定于蒙版区域,而可以是显示屏上全部或 其他任意部分区域。其中,和指纹识别区域高亮类似,由于PWM调节实际是通过显示屏的亮、灭交替来调节显示屏的亮度,因此调光模式为PWM模式时,无法保证显示图像的亮度保持不变且为较低的亮度值,因此无法实现防频闪功能。若降低灰阶前的调光模式为PWM模式时,AP可以向DDIC发送指示调光模式为DC模式的信息,以实现防频闪功能。
不限于此,本申请中的AP也可以替换为SoC等其他处理芯片或处理单元,在一些实施例,SoC等其他处理芯片或处理单元内部可以集成有AP,在另一些实施例中,AP独立于SoC等其他处理芯片或处理单元。
不限于此,本申请中的DDIC也可以替换为其他显示屏内部的驱动芯片或处理单元,在一些实施例,其他显示屏内部的驱动芯片或处理单元可以集成有DDIC,在另一些实施例中,DDIC可以独立于其他显示屏内部的驱动芯片或处理单元。
本申请中的“绘制”和“融合”也可以替换为“产生”、“获取”、“确定”,本申请的描述仅为示例,不应构成限定。
以上模块或单元的一个或多个可以软件、硬件或二者结合来实现。
当以上任一模块或单元以软件实现的时候,所述软件以计算机程序指令的方式存在,并被存储在存储器中,处理器可以用于执行所述程序指令以实现以上方法流程。所述处理器可以包括但不限于以下至少一种:中央处理单元(central processing unit,CPU)、微处理器、数字信号处理器(DSP)、微控制器(microcontroller unit,MCU)、或人工智能处理器等各类运行软件的计算设备,每种计算设备可包括一个或多个用于执行软件指令以进行运算或处理的核。该处理器可以是个单独的半导体芯片,也可以跟其他电路一起集成为一个半导体芯片,例如,可以跟其他电路(如编解码电路、硬件加速电路或各种总线和接口电路)构成一个SoC(片上系统),或者也可以作为一个ASIC的内置处理器集成在所述ASIC当中,该集成了处理器的ASIC可以单独封装或者也可以跟其他电路封装在一起。该处理器除了包括用于执行软件指令以进行运算或处理的核外,还可进一步包括必要的硬件加速器,如现场可编程门阵列(field programmable gate array,FPGA)、PLD(可编程逻辑器件)、或者实现专用逻辑运算的逻辑电路。
当以上模块或单元以硬件实现的时候,该硬件可以是CPU、微处理器、DSP、MCU、人工智能处理器、ASIC、SoC、FPGA、PLD、专用数字电路、硬件加速器或非集成的分立器件中的任一个或任一组合,其可以运行必要的软件或不依赖于软件以执行以上方法流程。

Claims (26)

  1. 一种电子设备,其特征在于,包括应用处理器AP和显示屏,所述显示屏包括显示驱动芯片DDIC和显示面板,其中:
    所述显示面板,用于显示第一图像;
    所述AP,用于向所述DDIC发送第一指示信息和第一参数;
    所述DDIC,用于基于接收到的所述第一指示信息,控制所述第一图像中指纹识别区域的亮度为第一亮度,以及控制所述第一图像中蒙版区域的亮度为第二亮度,所述蒙版区域的亮度是基于所述第一参数控制的,所述蒙版区域为所述第一图像中所述指纹识别区域以外的区域;
    所述显示面板,用于显示更新后的第一图像,所述更新后的第一图像中所述指纹识别区域的亮度为所述第一亮度,所述蒙版区域的亮度为所述第二亮度。
  2. 如权利要求1所述的电子设备,其特征在于,所述DDIC控制所述第一图像中指纹识别区域的亮度为第一亮度,包括:将所述指纹识别区域中像素的灰阶设置为第一值,以及显示亮度值DBV设置为第二值,所述显示面板中像素的灰阶的取值小于或等于所述第一值,所述显示面板中像素的DBV小于或等于所述第二值,所述第一亮度对应的灰阶为所述第一值,对应的DBV为所述第二值。
  3. 如权利要求1所述的电子设备,其特征在于,所述AP,还用于向所述DDIC发送所述指纹识别区域的亮度编码,所述亮度编码用于指示以下至少一项:亮度、颜色、形状、大小、位置;
    所述DDIC控制所述第一图像中指纹识别区域的亮度为第一亮度,包括:基于接收到的所述亮度编码控制所述第一图像中所述指纹识别区域的显示。
  4. 如权利要求1所述的电子设备,其特征在于,所述更新后的第一图像中所述指纹识别区域的亮度,大于所述第一图像中所述指纹识别区域的亮度;
    所述更新后的第一图像中所述蒙版区域的亮度和显示内容,和所述第一图像中所述蒙版区域的亮度和显示内容相同。
  5. 如权利要求1所述的电子设备,其特征在于,所述显示面板显示所述更新后的第一图像时,所述显示屏的调光模式为直流电调节DC,所述第一参数是根据所述显示面板显示所述第一图像时所述显示屏的调光模式,以及所述蒙版区域的灰阶确定的阿尔法值。
  6. 如权利要求5所述的电子设备,其特征在于,所述显示面板显示所述第一图像时,所述显示屏的调光模式为脉宽调节PWM,则所述第一参数小于1;
    所述显示面板显示所述第一图像时,所述显示屏的调光模式为DC,则所述第一参数等于1。
  7. 如权利要求5或6所述的电子设备,其特征在于,所述显示面板显示所述第一图像时,所述显示屏的调光模式为PWM,所述蒙版区域的灰阶为第一灰阶;
    所述DDIC,还用于基于接收到的所述第一指示信息,将所述显示屏的调光模式切换为 DC;
    所述DDIC控制所述显示面板中蒙版区域的亮度,包括:将所述显示屏的调光模式切换为DC后所述蒙版区域对应的第二灰阶乘以所述第一参数,所述第二灰阶高于所述第一灰阶;
    所述显示面板显示所述更新后的第一图像时,所述蒙版区域的灰阶为所述第二灰阶乘以所述第一参数得到的所述第一灰阶,所述第二亮度对应的灰阶为所述第一灰阶。
  8. 如权利要求1所述的电子设备,其特征在于,所述指纹识别区域包括第一指纹识别区域和第二指纹识别区域,所述DDIC包括第一DDIC和第二DDIC;
    所述第一DDIC,用于基于接收到的所述第一指示信息,控制所述第一图像中所述第一指纹识别区域的亮度;
    所述第二DDIC,用于基于接收到的所述第一指示信息,控制所述第一图像中所述第二指纹识别区域的亮度。
  9. 一种通信装置,其特征在于,包括处理器、存储器和通信接口,其中:
    所述处理器,用于确定第一指示信息和第一参数;
    所述通信接口,用于向显示屏发送所述第一指示信息和所述第一参数,所述第一指示信息用于指示控制所述显示屏显示的第一图像中指纹识别区域和蒙版区域的亮度,所述蒙版区域为所述第一图像中所述指纹识别区域以外的区域,所述第一参数用于控制所述蒙版区域的亮度。
  10. 如权利要求9所述的通信装置,其特征在于,所述处理器,还用于确定所述指纹识别区域的亮度编码,所述亮度编码用于指示以下至少一项:亮度、颜色、形状、大小、位置;
    所述通信接口,还用于向所述显示屏发送所述亮度编码,所述亮度编码用于控制所述第一图像中所述指纹识别区域的显示。
  11. 一种通信装置,其特征在于,包括处理器、存储器和通信接口,其中:
    所述处理器,用于控制显示屏的显示面板显示第一图像;
    所述通信接口,用于接收第一指示信息和第一参数,并将所述第一指示信息和所述第一参数传输至所述处理器;
    所述处理器,用于基于接收到的所述第一指示信息,控制所述第一图像中指纹识别区域的亮度为第一亮度,以及控制所述第一图像中蒙版区域的亮度为第二亮度,所述蒙版区域的亮度是基于所述第一参数控制的,所述蒙版区域为所述第一图像中所述指纹识别区域以外的区域;
    所述处理器,用于控制所述显示面板显示更新后的第一图像,所述更新后的第一图像中所述指纹识别区域的亮度为所述第一亮度,所述蒙版区域的亮度为所述第二亮度。
  12. 如权利要求11所述的通信装置,其特征在于,所述处理器控制所述第一图像中指纹识别区域的亮度为第一亮度,包括:
    将所述指纹识别区域中像素的灰阶设置为第一值,以及显示亮度值DBV设置为第二值,所述显示面板中像素的灰阶的取值小于或等于所述第一值,所述显示面板中像素的DBV小于或等于所述第二值,所述第一亮度对应的灰阶为所述第一值,对应的DBV为所述第二值。
  13. 如权利要求11所述的通信装置,其特征在于,所述通信接口,还用于接收所述指纹识别区域的亮度编码,并将所述亮度编码传输至所述处理器,所述亮度编码用于指示以下至少一项:亮度、颜色、形状、大小、位置;
    所述处理器控制所述第一图像中指纹识别区域的亮度为第一亮度,包括:基于接收到的所述亮度编码控制所述第一图像中所述指纹识别区域的显示。
  14. 如权利要求11所述的通信装置,其特征在于,所述更新后的第一图像中所述指纹识别区域的亮度,大于所述第一图像中所述指纹识别区域的亮度;
    所述更新后的第一图像中所述蒙版区域的亮度和显示内容,和所述第一图像中所述蒙版区域的亮度和显示内容相同。
  15. 如权利要求11所述的通信装置,其特征在于,所述处理器控制所述显示面板显示更新后的第一图像时,所述显示屏的调光模式为直流电调节DC,所述第一参数是根据所述处理器控制显示屏的显示面板显示第一图像时所述显示屏的调光模式,以及所述蒙版区域的灰阶确定的阿尔法值。
  16. 如权利要求15所述的通信装置,其特征在于,所述处理器控制显示屏的显示面板显示第一图像时,所述显示屏的调光模式为脉宽调节PWM,则所述第一参数小于1;
    所述处理器控制显示屏的显示面板显示第一图像时,所述显示屏的调光模式为DC,则所述第一参数等于1。
  17. 如权利要求15或16所述的通信装置,其特征在于,所述处理器控制显示屏的显示面板显示第一图像时,所述显示屏的调光模式为脉宽调节PWM,所述蒙版区域的灰阶为第一灰阶;
    所述处理器,还用于基于接收到的所述第一指示信息,将所述显示屏的调光模式切换为DC;
    所述处理器控制所述第一图像中蒙版区域的亮度为第二亮度,包括:将所述显示屏的调光模式切换为DC后所述蒙版区域对应的第二灰阶乘以所述第一参数,所述第二灰阶高于所述第一灰阶;
    所述处理器控制所述显示面板显示更新后的第一图像时,所述蒙版区域的灰阶为所述第二灰阶乘以所述第一参数得到的所述第一灰阶,所述第二亮度对应的灰阶为所述第一灰阶。
  18. 一种显示方法,其特征在于,应用于电子设备,所述电子设备包括应用处理器AP和显示屏,所述显示屏包括显示驱动芯片DDIC和显示面板,所述方法包括:
    所述显示面板显示第一图像;
    所述AP向所述DDIC发送第一指示信息和第一参数;
    所述DDIC基于接收到的所述第一指示信息,控制所述第一图像中指纹识别区域的亮度为第一亮度,以及控制所述第一图像中蒙版区域的亮度为第二亮度,所述蒙版区域的亮度是基于所述第一参数控制的,所述蒙版区域为所述第一图像中所述指纹识别区域以外的区域;
    所述显示面板显示更新后的第一图像,所述更新后的第一图像中所述指纹识别区域的亮 度为所述第一亮度,所述蒙版区域的亮度为所述第二亮度。
  19. 如权利要求18所述的方法,其特征在于,所述控制所述第一图像中指纹识别区域的亮度为第一亮度,包括:将所述指纹识别区域中像素的灰阶设置为第一值,以及显示亮度值DBV设置为第二值,所述显示面板中像素的灰阶的取值小于或等于所述第一值,所述显示面板中像素的DBV小于或等于所述第二值,所述第一亮度对应的灰阶为所述第一值,对应的DBV为所述第二值。
  20. 如权利要求18所述的方法,其特征在于,所述方法还包括:
    所述AP向所述DDIC发送所述指纹识别区域的亮度编码,所述亮度编码用于指示以下至少一项:亮度、颜色、形状、大小、位置;
    所述控制所述第一图像中指纹识别区域的亮度为第一亮度,包括:基于接收到的所述亮度编码控制所述第一图像中所述指纹识别区域的显示。
  21. 如权利要求18所述的方法,其特征在于,所述更新后的第一图像中所述指纹识别区域的亮度,大于所述第一图像中所述指纹识别区域的亮度;
    所述更新后的第一图像中所述蒙版区域的亮度和显示内容,和所述第一图像中所述蒙版区域的亮度和显示内容相同。
  22. 如权利要求18所述的方法,其特征在于,所述显示面板显示所述更新后的第一图像时,所述显示屏的调光模式为直流电调节DC,所述第一参数是根据所述显示面板显示所述第一图像时所述显示屏的调光模式,以及所述蒙版区域的灰阶确定的阿尔法值。
  23. 如权利要求22所述的方法,其特征在于,所述显示面板显示所述第一图像时,所述显示屏的调光模式为脉宽调节PWM,则所述第一参数小于1;
    所述显示面板显示所述第一图像时,所述显示屏的调光模式为DC,则所述第一参数等于1。
  24. 如权利要求22或23所述的方法,其特征在于,所述显示面板显示所述第一图像时,所述显示屏的调光模式为PWM,所述蒙版区域的灰阶为第一灰阶;所述方法还包括:
    基于接收到的所述第一指示信息,将所述显示屏的调光模式切换为DC;
    所述控制所述显示面板中蒙版区域的亮度,包括:
    将所述显示屏的调光模式切换为DC后所述蒙版区域对应的第二灰阶乘以所述第一参数,所述第二灰阶高于所述第一灰阶;
    所述显示面板显示所述更新后的第一图像时,所述蒙版区域的灰阶为所述第二灰阶乘以所述第一参数得到的所述第一灰阶,所述第二亮度对应的灰阶为所述第一灰阶。
  25. 如权利要求18所述的方法,其特征在于,所述指纹识别区域包括第一指纹识别区域和第二指纹识别区域,所述DDIC包括第一DDIC和第二DDIC;
    所述DDIC基于接收到的所述第一指示信息,控制所述第一图像中指纹识别区域的亮度为第一亮度,包括:
    所述第一DDIC基于接收到的所述第一指示信息,控制所述第一图像中所述第一指纹识别区域的亮度,所述第二DDIC基于接收到的所述第一指示信息,控制所述第一图像中所述第二指纹识别区域的亮度。
  26. 一种计算机存储介质,其特征在于,所述计算机存储介质存储有计算机程序,所述计算机程序被处理器执行时,实现权利要求18-25任一项所述的方法。
PCT/CN2022/098236 2021-06-30 2022-06-10 一种显示方法及电子设备 WO2023273844A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP22831664.2A EP4350537A1 (en) 2021-06-30 2022-06-10 Display method and electronic device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110745146.9 2021-06-30
CN202110745146.9A CN115565208A (zh) 2021-06-30 2021-06-30 一种显示方法及电子设备

Publications (1)

Publication Number Publication Date
WO2023273844A1 true WO2023273844A1 (zh) 2023-01-05

Family

ID=84690036

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/098236 WO2023273844A1 (zh) 2021-06-30 2022-06-10 一种显示方法及电子设备

Country Status (3)

Country Link
EP (1) EP4350537A1 (zh)
CN (1) CN115565208A (zh)
WO (1) WO2023273844A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116048368B (zh) * 2023-01-28 2023-09-01 荣耀终端有限公司 亮度调整方法和电子设备
CN117133215A (zh) * 2023-02-20 2023-11-28 荣耀终端有限公司 确定灰阶值的方法、芯片、电子设备和可读存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110276326A (zh) * 2019-06-27 2019-09-24 云谷(固安)科技有限公司 一种显示设备及显示方法
CN110310597A (zh) * 2019-06-27 2019-10-08 云谷(固安)科技有限公司 一种显示设备及显示方法
US20210012717A1 (en) * 2019-07-11 2021-01-14 Samsung Electronics Co., Ltd. Display driving circuit, display device including the same, and method of operating the display driving circuit
CN113297880A (zh) * 2020-02-24 2021-08-24 Oppo广东移动通信有限公司 指纹采集方法、装置、终端及存储介质

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110276326A (zh) * 2019-06-27 2019-09-24 云谷(固安)科技有限公司 一种显示设备及显示方法
CN110310597A (zh) * 2019-06-27 2019-10-08 云谷(固安)科技有限公司 一种显示设备及显示方法
US20210012717A1 (en) * 2019-07-11 2021-01-14 Samsung Electronics Co., Ltd. Display driving circuit, display device including the same, and method of operating the display driving circuit
CN113297880A (zh) * 2020-02-24 2021-08-24 Oppo广东移动通信有限公司 指纹采集方法、装置、终端及存储介质

Also Published As

Publication number Publication date
EP4350537A1 (en) 2024-04-10
CN115565208A (zh) 2023-01-03

Similar Documents

Publication Publication Date Title
US11759143B2 (en) Skin detection method and electronic device
WO2023273844A1 (zh) 一种显示方法及电子设备
WO2021169337A1 (zh) 屏下指纹显示方法及电子设备
US20220174143A1 (en) Message notification method and electronic device
CN113810601B (zh) 终端的图像处理方法、装置和终端设备
CN113810600B (zh) 终端的图像处理方法、装置和终端设备
WO2022007862A1 (zh) 图像处理方法、系统、电子设备及计算机可读存储介质
JP7468830B2 (ja) エネルギー効率の良い表示処理方法およびデバイス
EP4231147A1 (en) Drawing command processing method and related device therefor
WO2022257451A1 (zh) 一种显示方法、电子设备及计算机存储介质
EP4156158A1 (en) Drive control method and related device
WO2023000772A1 (zh) 模式切换方法、装置、电子设备及芯片系统
CN112584251A (zh) 一种显示方法及电子设备
WO2023103951A1 (zh) 一种折叠屏的显示方法及相关装置
EP4033341A1 (en) Always on display method and mobile device
WO2021052170A1 (zh) 马达振动控制方法及电子设备
WO2022062809A1 (zh) 投屏控制方法和装置
WO2023030168A1 (zh) 界面显示方法和电子设备
WO2023000745A1 (zh) 显示控制方法及相关装置
CN113610943B (zh) 图标圆角化的处理方法及装置
CN115631250B (zh) 图像处理方法与电子设备
CN112581903A (zh) 一种像素补偿方法和电子设备
CN116095220B (zh) 参数确定方法及相关装置
WO2023207715A1 (zh) 亮屏控制方法、电子设备及计算机可读存储介质
WO2024066834A1 (zh) Vsync信号的控制方法、电子设备、存储介质及芯片

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2022831664

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2022831664

Country of ref document: EP

Effective date: 20240104