CN114070916B

CN114070916B - Shooting light supplementing method and related device

Info

Publication number: CN114070916B
Application number: CN202011198299.8A
Authority: CN
Inventors: 卞超
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-07-31
Filing date: 2020-10-30
Publication date: 2023-04-28
Anticipated expiration: 2040-10-30
Also published as: CN114070916A

Abstract

The invention discloses a shooting light supplementing method which is applied to electronic equipment, wherein the electronic equipment comprises M flashlamps, M is a positive integer, and the irradiation directions of the M flashlamps and the shooting direction of a camera of the electronic equipment are on the same side of the electronic equipment, and the method comprises the following steps: the electronic equipment receives a first user operation; responding to the first user operation, and starting a shooting function; displaying a first interface corresponding to a shooting function, wherein the first interface comprises a preview picture and a control which are acquired by a camera; the electronic equipment determines the light supplementing intensity according to the image brightness of the preview picture; the electronic device adjusts the brightness of the flash based on the supplemental light intensity. According to the embodiment of the application, the shooting experience of the user can be effectively improved in a dark light environment.

Description

Shooting light supplementing method and related device

Technical Field

The present disclosure relates to the field of electronic technologies, and in particular, to a light supplementing method and related device for shooting.

Background

With the development of terminal technology, users have higher requirements on the performance and functions of the camera of the smart phone. At present, in order to meet shooting requirements of users in dark and weak light scenes, most factories perform post-processing on shot pictures, and the effect of enabling the pictures to be full and clear is achieved through an image processing algorithm. However, the effect of this post-processing is still unsatisfactory, especially for the shooting scene of the front camera.

In summary, in the dark or weak light scene, the shooting experience of the user is poor.

Disclosure of Invention

The embodiment of the application provides a light supplementing method and a related device for shooting, which can effectively improve shooting experience of a user in a dim light environment.

In a first aspect, the present application provides a light supplementing method for shooting, which is applied to an electronic device, wherein the electronic device includes a display screen and a front camera, and the method includes: the electronic equipment receives a first user operation; responding to a first user operation, and starting a shooting function; displaying a first interface corresponding to a shooting function, wherein the first interface comprises a preview picture and a control which are acquired by a front camera; the preview picture comprises a preview area and a light supplementing area, and the preview area displays the preview picture after the light supplementing area supplements light; the light supplementing intensity of the light supplementing area is controlled by the electronic equipment through adjusting the light supplementing parameter of the light supplementing area.

In this embodiment of the present application, after the electronic device starts the shooting function, the light-compensating area in the preview screen of the first interface is utilized to perform light compensation, and the user may observe the light-compensating effect in real time in the preview area in the preview screen of the first interface. Therefore, shooting experience of a user can be effectively improved in a dark light environment.

In one possible implementation manner, the light filling parameter of the light filling area includes at least one of transparency of the light filling area, brightness of pixels in the light filling area of the display screen, and brightness of a backlight source of the display screen.

In one possible implementation manner, the displaying the first interface corresponding to the shooting function includes: and displaying a first interface corresponding to the shooting function according to the preset light supplementing parameters of the light supplementing area.

In one possible implementation manner, the light supplementing region includes a first light supplementing sub-region and a second light supplementing sub-region, and the light supplementing intensity of the light supplementing region is controlled by the electronic device through adjusting the light supplementing parameter of at least one of the first light supplementing sub-region and the second light supplementing sub-region.

In one possible implementation, the method further includes: the electronic equipment receives a second user operation; in response to a second user operation, the electronic device determines a shape of the preview area or the light supplement area in the first interface.

In one possible implementation, the method further includes: the electronic equipment receives a third user operation; in response to a third user operation, the electronic device determines a size of a preview area or a light supplement area in the first interface.

In one possible implementation, the method further includes: the electronic equipment receives a fourth user operation; in response to a fourth user operation, the electronic device determines a location of the preview area or the light supplement area in the first interface.

In one possible implementation, the method further includes: the electronic equipment receives a fifth user operation; in response to a fifth user operation, the electronic device determines a light supplementing parameter of the light supplementing region; and the electronic equipment controls the light supplementing intensity of the light supplementing area according to the light supplementing parameters of the light supplementing area.

In one possible implementation manner, the electronic device controls the light intensity of the light compensating area according to the light compensating parameter of the light compensating area, including: the electronic device controls the light-supplementing intensity of the light-supplementing region based on the light-supplementing parameter of at least one of the first light-supplementing sub-region and the second light-supplementing sub-region.

In one possible implementation manner, before the electronic device receives the second user operation, the method further includes: the electronic equipment displays a first control on a first interface, wherein the first control is used for determining the shape of a preview area, and the shape of the preview area at least comprises two types; the electronic equipment receives a sixth user operation acting on the first control; in response to a sixth user operation, the electronic device displays an icon of the shape of the preview area; the electronic device receiving the second user operation specifically includes: the electronic device receives a second user operation on the icon.

In one possible implementation, the second user operation includes a gesture in which a finger of the user slides on the display screen; responding to a second user operation, the electronic device determines the shape of a preview area or a light supplementing area in the first interface, and specifically comprises the following steps: in response to the second user operation, the electronic device determines a shape of the preview area or the light supplement area in the first interface based on the sliding track of the gesture in the second user operation.

In one possible implementation manner, before the electronic device receives the fifth user operation, the first interface displays a first selection control and a second selection control, where the first selection control and the second selection control correspond to different light filling parameters, and the first selection control corresponds to the first light filling parameter; the electronic device receiving the fifth user operation specifically includes: the electronic equipment receives a fifth user operation acting on the first selection control; the determining, by the electronic device, the light filling parameter of the light filling area in response to the fifth user operation specifically includes: and responding to the fifth user operation, and determining the light filling parameter of the light filling area as the first light filling parameter by the electronic equipment.

In one possible implementation manner, the first selection control corresponds to a first light filling parameter and a first image processing algorithm; after the electronic device determines that the light filling parameter of the light filling area is the first light filling parameter in response to the fifth user operation, the method further includes: and performing image processing on the preview picture acquired by the front camera by using a first image processing algorithm.

In one possible implementation manner, before the electronic device receives the fifth user operation, the first interface displays a first brightness adjustment bar corresponding to the first complementary sub-region and a second brightness adjustment bar corresponding to the second complementary sub-region; the first brightness adjustment bar comprises a first mark; the length from the first end of the first brightness adjustment bar to the first mark is used for indicating the light supplementing intensity of the first light supplementing sub-area, and the total length from the first end of the first brightness adjustment bar to the second end of the first brightness adjustment bar is used for indicating the maximum light supplementing intensity; the electronic equipment receives a fifth user operation, which specifically comprises; the electronic equipment receives a fifth user operation acting on the first brightness adjustment bar, and adjusts the position of the first mark on the first brightness adjustment bar; the determining, by the electronic device, the light filling parameter of the light filling area in response to the fifth user operation specifically includes: and responding to a fifth user operation, and determining the light supplementing parameter of the first light supplementing sub-region by the electronic equipment according to the light supplementing intensity represented by the length from the first end to the first mark.

In one possible implementation manner, the second selection control corresponds to a second light supplementing parameter and a second image processing algorithm; the first image processing algorithm is different from the second image processing algorithm.

In a second aspect, the present application provides a light supplementing method for shooting, which is applied to an electronic device, where the electronic device includes M flash lamps, M is a positive integer, and an irradiation direction of the M flash lamps and a shooting direction of a camera of the electronic device are on the same side of the electronic device, and the method includes: the electronic equipment receives a first user operation; responding to the first user operation, and starting a shooting function; displaying a first interface corresponding to a shooting function, wherein the first interface comprises a preview picture and a control which are acquired by a camera; the electronic equipment determines the light supplementing intensity of the flash lamp according to the image brightness of the preview picture; the electronic device adjusts the brightness of the flash based on the supplemental light intensity of the flash.

In this embodiment of the present invention, after the electronic device starts the shooting function, the light-compensating intensity of the flash lamp is determined according to the image brightness of the preview screen, and the brightness of the flash lamp is adjusted based on the light-compensating intensity of the flash lamp, so that the user can observe the light-compensating effect in real time through the preview screen of the first interface. Therefore, shooting experience of a user can be effectively improved in a dark light environment.

In one possible implementation manner, before the electronic device determines the light compensating intensity of the flash according to the image brightness of the preview screen, the method further includes: the electronic equipment receives a seventh user operation; the electronic device determines the light supplementing intensity of the flash lamp according to the image brightness of the preview picture, and specifically comprises the following steps: in response to the received seventh user operation, the electronic device determines the light-compensating intensity of the flash according to the image brightness of the preview screen.

In one possible implementation manner, before the electronic device receives the seventh user operation, the method further includes: the electronic equipment displays a third selection control and a fourth selection control on the first interface, wherein the third selection control corresponds to the first light supplementing intensity, and the fourth selection control corresponds to the second light supplementing intensity; the electronic device receiving the seventh user operation specifically includes: the electronic equipment receives a seventh user operation acting on the third selection control; the above-mentioned response to the seventh user operation received, the electronic device determining the light compensating intensity of the flash according to the image brightness of the preview screen, specifically includes: and responding to the received seventh user operation, and determining that the first light supplementing intensity corresponding to the third selection control is the light supplementing intensity of the flash lamp by the electronic equipment according to the image brightness of the preview picture.

In one possible implementation manner, the third selection control corresponds to the first light supplementing intensity and a third image processing algorithm; after the electronic device determines that the first light intensity corresponding to the third selection control is the light intensity of the flash lamp according to the received seventh user operation, the electronic device further includes: performing image processing on the preview picture acquired by the camera by using a third image processing algorithm; the electronic equipment adjusts the brightness of the flash lamp based on the light supplementing intensity of the flash lamp, and the electronic equipment adjusts the brightness of the flash lamp based on the first light supplementing intensity.

In one possible implementation manner, the first interface includes M areas, where the M areas are determined based on positions of the M flashlights on the electronic device, and the M flashlights are in one-to-one correspondence with the M areas; the electronic device determines the light supplementing intensity of the flash lamp according to the image brightness of the preview picture, and specifically comprises the following steps: the electronic device determines a third light supplementing intensity based on the ambient light brightness; the electronic equipment determines fourth light supplementing intensity based on the image brightness of the preview picture in a first area in the M areas, wherein the first area corresponds to a first flash lamp in the M flash lamps; the electronic equipment determines the light supplementing intensity corresponding to the first flash lamp according to the third light supplementing intensity and the fourth light supplementing intensity; the electronic device stores the corresponding relation between the fourth light supplementing intensity and the image brightness.

In a possible implementation manner, the determining, by the electronic device, the light intensity corresponding to the first flash according to the third light intensity and the fourth light intensity specifically includes: when the difference value between the third light supplementing intensity and the fourth light supplementing intensity is larger than a first threshold value, the electronic equipment determines that the light supplementing intensity corresponding to the first flash lamp is the fourth light supplementing intensity; when the difference value between the third light supplementing intensity and the fourth light supplementing intensity is smaller than or equal to a first threshold value, the electronic equipment determines that the light supplementing intensity corresponding to the first flash lamp is the third light supplementing intensity.

In one possible implementation, at least two regions of the M regions overlap.

In one possible implementation manner, the determining, by the electronic device, the third light compensation intensity based on the ambient light brightness includes: the electronic device determines a fifth light supplementing intensity based on the ambient light brightness; the electronic equipment identifies a target object in the preview picture; the electronic equipment determines the area of each of the M areas of the target object in the preview picture; the electronic device determines the third light intensity based on the fifth light intensity and the areas of the target object in the preview screen in the M areas.

In one possible implementation manner, before the electronic device displays the third selection control and the fourth selection control on the first interface, the method further includes: the electronic equipment displays a second control on the first interface; the electronic equipment receives an eighth user operation acting on the second control; the electronic device displays a third selection control and a fourth selection control on a first interface, including: in response to the eighth user operation, the electronic device displays a third selection control and a fourth selection control on the first interface.

In one possible implementation manner, the fourth selection control corresponds to a second light supplementing intensity and a fourth image processing algorithm; the third image processing algorithm is different from the fourth image processing algorithm.

In a third aspect, the present application provides an electronic device, including one or more processors, a display screen, one or more memories, a front-facing camera; wherein the one or more memories, the display screen, and the one or more processors are coupled, the one or more memories for storing computer program code comprising computer instructions that, when executed by the one or more processors, cause the electronic device to perform: receiving a first user operation; responding to a first user operation, and starting a shooting function; displaying a first interface corresponding to a shooting function, wherein the first interface comprises a preview picture and a control which are acquired by a front camera; the preview picture comprises a preview area and a light supplementing area, and the preview area displays the preview picture after the light supplementing area supplements light; the light supplementing intensity of the light supplementing area is controlled by the electronic equipment through adjusting the light supplementing parameter of the light supplementing area.

In one possible implementation, the one or more processors, when executing the computer instructions, cause the electronic device to further perform: receiving a second user operation; and responding to the second user operation, and determining the shape of the preview area or the light supplementing area in the first interface.

In one possible implementation, the one or more processors, when executing the computer instructions, cause the electronic device to further perform: receiving a third user operation; and responding to a third user operation, and determining the size of the preview area or the light supplementing area in the first interface.

In one possible implementation, the one or more processors, when executing the computer instructions, cause the electronic device to further perform: receiving a fourth user operation; and responding to a fourth user operation, and determining the position of the preview area or the light supplementing area in the first interface.

In one possible implementation, the one or more processors, when executing the computer instructions, cause the electronic device to further perform: receiving a fifth user operation; determining a light supplementing parameter of the light supplementing area in response to a fifth user operation; and controlling the light supplementing intensity of the light supplementing area according to the light supplementing parameter of the light supplementing area.

In one possible implementation manner, the controlling the light-compensating intensity of the light-compensating region according to the light-compensating parameter of the light-compensating region includes: and controlling the light supplementing intensity of the light supplementing region based on the light supplementing parameter of at least one of the first light supplementing sub-region and the second light supplementing sub-region.

In one possible implementation manner, before the receiving the second user operation, the electronic device further performs: displaying a first control on a first interface, wherein the first control is used for determining the shape of a preview area, and the shape of the preview area at least comprises two types; receiving a sixth user operation acting on the first control; displaying an icon of the shape of the preview area in response to a sixth user operation; the receiving the second user operation specifically includes: a second user operation is received on the icon.

In one possible implementation, the second user operation includes a gesture in which a finger of the user slides on the display screen; the determining, in response to the second user operation, the shape of the preview area or the light-compensating area in the first interface specifically includes: and responding to the second user operation, and determining the shape of the preview area or the light supplementing area in the first interface based on the sliding track of the gesture in the second user operation.

In a possible implementation manner, before the fifth user operation is received, the first interface displays a first selection control and a second selection control, where the first selection control and the second selection control correspond to different light filling parameters, and the first selection control corresponds to the first light filling parameter; the receiving a fifth user operation includes: receiving a fifth user operation acting on the first selection control; the determining, in response to the fifth user operation, the light filling parameter of the light filling area specifically includes: and responding to a fifth user operation, and determining the light supplementing parameter of the light supplementing area as a first light supplementing parameter.

In one possible implementation manner, the first selection control corresponds to a first light filling parameter and a first image processing algorithm; in response to a fifth user operation, after the electronic device determines that the light filling parameter of the light filling area is the first light filling parameter, the electronic device further performs: and performing image processing on the preview picture acquired by the front camera by using a first image processing algorithm.

In one possible implementation manner, before the fifth user operation is received, the first interface displays a first brightness adjustment bar corresponding to the first complementary sub-region and a second brightness adjustment bar corresponding to the second complementary sub-region; the first brightness adjustment bar comprises a first mark; the length from the first end of the first brightness adjustment bar to the first mark is used for indicating the light supplementing intensity of the first light supplementing sub-area, and the total length from the first end of the first brightness adjustment bar to the second end of the first brightness adjustment bar is used for indicating the maximum light supplementing intensity; receiving a fifth user operation, which specifically comprises; receiving a fifth user operation acting on the first brightness adjustment bar, and adjusting the position of the first mark on the first brightness adjustment bar; the determining, in response to the fifth user operation, the light filling parameter of the light filling area specifically includes: and responding to a fifth user operation, and determining a light supplementing parameter of the first light supplementing sub-region according to the light supplementing intensity represented by the length from the first end to the first mark.

In a fourth aspect, the present application provides an electronic device comprising one or more processors, a display screen, one or more memories, a camera, M flash lamps; wherein the illumination directions of the M flash lamps and the shooting directions of the camera of the electronic device are on the same side of the electronic device, the one or more memories, the display screen and the one or more processors are coupled, the one or more memories are used for storing computer program codes, the computer program codes comprise computer instructions which when executed by the one or more processors cause the electronic device to execute: receiving a first user operation; responding to the first user operation, and starting a shooting function; displaying a first interface corresponding to a shooting function, wherein the first interface comprises a preview picture and a control which are acquired by a camera; determining the light supplementing intensity of the flash lamp according to the image brightness of the preview picture; the brightness of the flash is adjusted based on the supplemental light intensity of the flash.

In one possible implementation manner, before determining the light compensating intensity of the flash according to the image brightness of the preview screen, the electronic device further performs: receiving a seventh user operation; the above-mentioned determination of the light intensity of the flash according to the image brightness of the preview picture specifically includes: and responding to the received seventh user operation, and determining the light supplementing intensity of the flash lamp according to the image brightness of the preview picture.

In one possible implementation manner, before the receiving the seventh user operation, the electronic device further performs: displaying a third selection control and a fourth selection control on the first interface, wherein the third selection control corresponds to the first light supplementing intensity, and the fourth selection control corresponds to the second light supplementing intensity; the receiving the seventh user operation specifically includes: receiving a seventh user operation acting on the third selection control; the determining, in response to the received seventh user operation, the light compensating intensity of the flash according to the image brightness of the preview screen specifically includes: and responding to the received seventh user operation, and determining that the first light supplementing intensity corresponding to the third selection control is the light supplementing intensity of the flash lamp according to the image brightness of the preview picture.

In one possible implementation manner, the third selection control corresponds to the first light supplementing intensity and a third image processing algorithm; in response to the received seventh user operation, after determining the first light supplementing intensity corresponding to the third selection control according to the image brightness of the preview screen, the electronic device further executes: performing image processing on the preview picture acquired by the camera by using a third image processing algorithm; the adjusting the brightness of the flash lamp based on the compensation light intensity of the flash lamp comprises adjusting the brightness of the flash lamp based on the first compensation light intensity.

In one possible implementation manner, the first interface includes M areas, where the M areas are determined based on positions of the M flashlights on the electronic device, and the M flashlights are in one-to-one correspondence with the M areas; the method for determining the light supplementing intensity of the flash lamp according to the image brightness of the preview picture specifically comprises the following steps: determining a third supplemental light intensity based on the ambient light level; determining a fourth light intensity based on the image brightness of the preview screen in a first region of the M regions, the first region corresponding to a first flash of the M flash; determining the light supplementing intensity corresponding to the first flash lamp according to the third light supplementing intensity and the fourth light supplementing intensity; the electronic device stores the corresponding relation between the fourth light supplementing intensity and the image brightness.

In one possible implementation manner, the determining the light intensity corresponding to the first flash according to the third light intensity and the fourth light intensity specifically includes: when the difference value between the third light supplementing intensity and the fourth light supplementing intensity is larger than a first threshold value, determining that the light supplementing intensity corresponding to the first flash lamp is the fourth light supplementing intensity; and when the difference value between the third and fourth light supplementing intensities is smaller than or equal to a first threshold value, determining that the light supplementing intensity corresponding to the first flash lamp is the third light supplementing intensity.

In one possible implementation, at least two regions of the M regions overlap.

In one possible implementation manner, the determining the third light compensation intensity based on the ambient light brightness includes: determining a fifth supplemental light intensity based on the ambient light level; identifying a target object in the preview screen; determining the area of each of the M areas of the target object in the preview picture; and determining the third light supplementing intensity based on the fifth light supplementing intensity and the areas of the target object in the M areas in the preview screen.

In one possible implementation, before the third selection control and the fourth selection control are displayed on the first interface, the electronic device further performs: displaying a second control on the first interface; receiving an eighth user operation acting on the second control; the displaying the third selection control and the fourth selection control on the first interface includes: in response to an eighth user operation, a third selection control and a fourth selection control are displayed on the first interface.

In a fifth aspect, a computer readable storage medium is provided, comprising computer instructions, characterized in that the above computer instructions, when run on a terminal device, cause the terminal device to perform any one of the possible implementations of the first or second aspect.

In a sixth aspect, a computer product is provided which, when run on a computer, causes the computer to perform any one of the possible implementations of the first or second aspects.

Drawings

Fig. 1A is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 1B to fig. 1E are schematic diagrams of flash distribution provided in an embodiment of the present application;

fig. 1F is a schematic diagram of a flash light range according to an embodiment of the present disclosure;

FIGS. 2A-2C are schematic views of a user interface provided in an embodiment of the present application;

FIGS. 3A-3N are diagrams illustrating user interfaces according to embodiments of the present application;

FIGS. 4A-4G are schematic views of a user interface provided in an embodiment of the present application;

FIGS. 5A-5D are schematic views of a user interface provided in an embodiment of the present application;

FIGS. 6A-6F are diagrams of user interfaces provided in embodiments of the present application;

fig. 7A to 7B are schematic views of a user interface provided in an embodiment of the present application;

FIGS. 8A-8J are diagrams of user interfaces provided in embodiments of the present application;

FIGS. 9A-9I are diagrams of user interfaces provided in embodiments of the present application;

fig. 10A to 10B are schematic structural diagrams of a display panel according to an embodiment of the present disclosure;

FIG. 11A is a timing diagram of page rendering according to an embodiment of the present disclosure;

FIG. 11B is a schematic diagram of a layer provided in an embodiment of the present application;

fig. 12 is a schematic diagram of a software architecture according to an embodiment of the present application;

13A-13F are diagrams of user interfaces provided in embodiments of the present application;

FIGS. 14A-14D are diagrams of user interfaces provided in embodiments of the present application;

FIGS. 15A-15G are diagrams of user interfaces provided in embodiments of the present application;

FIGS. 16A-16C are diagrams of user interfaces provided in embodiments of the present application;

17A-17C are diagrams of user interfaces provided in embodiments of the present application;

18A-18B are diagrams of user interfaces provided in embodiments of the present application;

FIGS. 19A-19C are diagrams of user interfaces provided in embodiments of the present application;

fig. 20 is a schematic diagram of another software structure according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings. Wherein, in the description of the embodiments of the present application, "/" means or is meant unless otherwise indicated, for example, a/B may represent a or B; the text "and/or" is merely an association relation describing the associated object, and indicates that three relations may exist, for example, a and/or B may indicate: the three cases where a exists alone, a and B exist together, and B exists alone, and in addition, in the description of the embodiments of the present application, "plural" means two or more than two.

The terms "first," "second," and the like, are used below for descriptive purposes only and are not to be construed as implying or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature, and in the description of embodiments of the present application, unless otherwise indicated, the meaning of "a plurality" is two or more.

The embodiment of the application provides a light supplementing method for shooting. In the proposed method, the electronic device 100 provides the user with an intelligent light supplementing function for front-end shooting. When a user shoots by using the front-end camera, the electronic device 100 can display a light supplementing control on the front-end shooting interface, determine one or more light supplementing areas on the front-end shooting interface by receiving user operation acting on the light supplementing control, and adjust the light supplementing intensity of the light supplementing areas according to the self requirement of the user so as to improve the light condition of the front-end shooting environment, effectively improve the image quality of front-end shooting and improve the front-end shooting experience of the user.

An exemplary electronic device 100 provided in the following embodiments of the present application is first described below.

Fig. 1A shows a schematic configuration of an electronic device 100.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It is to be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

The I2C interface is a bi-directional synchronous serial bus comprising a serial data line (SDA) and a serial clock line (derail clock line, SCL). In some embodiments, the processor 110 may contain multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, charger, flash, camera 193, etc., respectively, through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, such that the processor 110 communicates with the touch sensor 180K through an I2C bus interface to implement a touch function of the electronic device 100.

The I2S interface may be used for audio communication. In some embodiments, the processor 110 may contain multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 via an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface, to implement a function of answering a call through the bluetooth headset.

PCM interfaces may also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface to implement a function of answering a call through the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus for asynchronous communications. The bus may be a bi-directional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through a UART interface, to implement a function of playing music through a bluetooth headset.

The MIPI interface may be used to connect the processor 110 to peripheral devices such as a display 194, a camera 193, and the like. The MIPI interfaces include camera serial interfaces (camera serial interface, CSI), display serial interfaces (display serial interface, DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the photographing functions of electronic device 100. The processor 110 and the display 194 communicate via a DSI interface to implement the display functionality of the electronic device 100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal or as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, an MIPI interface, etc.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transfer data between the electronic device 100 and a peripheral device. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other electronic devices, such as AR devices, etc.

It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is only illustrative, and does not limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also use different interfacing manners, or a combination of multiple interfacing manners in the foregoing embodiments.

The charge management module 140 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charge management module 140 may receive a charging input of a wired charger through the USB interface 130. In some wireless charging embodiments, the charge management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.

The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 to power the processor 110, the internal memory 121, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be configured to monitor battery capacity, battery cycle number, battery health (leakage, impedance) and other parameters. In other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charge management module 140 may be disposed in the same device.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The

antennas

1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional module, independent of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., as applied to the electronic device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, antenna 1 and mobile communication module 150 of electronic device 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, such that electronic device 100 may communicate with a network and other devices through wireless communication techniques. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou satellite navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (flex), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

In the embodiment of the present application, the display screen 194 may be used to display a control, where the control may be used to monitor an operation of expanding a control corresponding to a light supplementing function that may be currently provided by the display electronic device. In response to this operation, the display screen 194 may also be used to display controls corresponding to the light supplementing function currently provided by the electronic device.

The electronic device 100 may implement photographing functions through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent awareness of the electronic device 100 may be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

The internal memory 121 may be used to store computer executable program code including instructions. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 100 (e.g., audio data, phonebook, etc.), and so on. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like. The processor 110 performs various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The electronic device 100 may listen to music, or to hands-free conversations, through the speaker 170A.

A receiver 170B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. When electronic device 100 is answering a telephone call or voice message, voice may be received by placing receiver 170B in close proximity to the human ear.

Microphone 170C, also referred to as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can sound near the microphone 170C through the mouth, inputting a sound signal to the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may also be provided with three, four, or more microphones 170C to enable collection of sound signals, noise reduction, identification of sound sources, directional recording functions, etc.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be a USB interface 130 or a 3.5mm open mobile electronic device platform (open mobile terminal platform, OMTP) standard interface, a american cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A is of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. The capacitance between the electrodes changes when a force is applied to the pressure sensor 180A. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic apparatus 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 may also calculate the location of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions. For example: and executing an instruction for checking the short message when the touch operation with the touch operation intensity smaller than the first pressure threshold acts on the short message application icon. And executing an instruction for newly creating the short message when the touch operation with the touch operation intensity being greater than or equal to the first pressure threshold acts on the short message application icon.

The gyro sensor 180B may be used to determine a motion gesture of the electronic device 100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., x, y, and z axes) may be determined by gyro sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects the shake angle of the electronic device 100, calculates the distance to be compensated by the lens module according to the angle, and makes the lens counteract the shake of the electronic device 100 through the reverse motion, so as to realize anti-shake. The gyro sensor 180B may also be used for navigating, somatosensory game scenes.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, electronic device 100 calculates altitude from barometric pressure values measured by barometric pressure sensor 180C, aiding in positioning and navigation.

The magnetic sensor 180D includes a hall sensor. The electronic device 100 may detect the opening and closing of the flip cover using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip machine, the electronic device 100 may detect the opening and closing of the flip according to the magnetic sensor 180D. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.

The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the electronic device 100 is stationary. The electronic equipment gesture recognition method can also be used for recognizing the gesture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, the electronic device 100 may range using the distance sensor 180F to achieve quick focus.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it may be determined that there is an object in the vicinity of the electronic device 100. When insufficient reflected light is detected, the electronic device 100 may determine that there is no object in the vicinity of the electronic device 100. The electronic device 100 can detect that the user holds the electronic device 100 close to the ear by using the proximity light sensor 180G, so as to automatically extinguish the screen for the purpose of saving power. The proximity light sensor 180G may also be used in holster mode, pocket mode to automatically unlock and lock the screen.

The ambient light sensor 180L is used to sense ambient light level. The ambient light sensor 180L has characteristics of small dark current, low illuminance response, high sensitivity, linear change in current with illuminance enhancement, and the like. The ambient light sensor 180L is implemented using a light sensing element such as a phototransistor, a photoresistor, a photodiode, or a photodiode. The output signal of the ambient light sensor 180L may be a current signal, a voltage signal, or a digital signal, and the electronic device 100 may convert the output signal of the ambient light sensor 180L into ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light, so as to reduce the power consumption of the electronic device 100 and prolong the working time of the electronic device 100 to the maximum extent. The ambient light sensor 180L may also be used to automatically adjust white balance when taking a photograph. Ambient light sensor 180L may also cooperate with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent false touches.

In this embodiment, the electronic device 100 may determine the ambient light level according to the ambient light sensor 180L, and calculate the optimal light compensation intensity required in the current shooting environment according to the ambient light level.

The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 may utilize the collected fingerprint feature to unlock the fingerprint, access the application lock, photograph the fingerprint, answer the incoming call, etc.

The temperature sensor 180J is for detecting temperature. In some embodiments, the electronic device 100 performs a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs a reduction in the performance of a processor located in the vicinity of temperature sensor 180J in order to reduce power consumption to implement thermal protection. In other embodiments, when the temperature is below another threshold, the electronic device 100 heats the battery 142 to avoid the low temperature causing the electronic device 100 to be abnormally shut down. In other embodiments, when the temperature is below a further threshold, the electronic device 100 performs boosting of the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperatures.

The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 at a different location than the display 194.

The bone conduction sensor 180M may acquire a vibration signal. In some embodiments, bone conduction sensor 180M may acquire a vibration signal of a human vocal tract vibrating bone pieces. The bone conduction sensor 180M may also contact the pulse of the human body to receive the blood pressure pulsation signal. In some embodiments, bone conduction sensor 180M may also be provided in a headset, in combination with an osteoinductive headset. The audio module 170 may analyze the voice signal based on the vibration signal of the sound portion vibration bone block obtained by the bone conduction sensor 180M, so as to implement a voice function. The application processor may analyze the heart rate information based on the blood pressure beat signal acquired by the bone conduction sensor 180M, so as to implement a heart rate detection function.

The keys 190 include a power-on key, a volume key, etc. The keys 190 may be mechanical keys. Or may be a touch key. The electronic device 100 may receive key inputs, generating key signal inputs related to user settings and function controls of the electronic device 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration alerting as well as for touch vibration feedback. For example, touch operations acting on different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also correspond to different vibration feedback effects by touching different areas of the display screen 194. Different application scenarios (such as time reminding, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

The indicator 192 may be an indicator light, may be used to indicate a state of charge, a change in charge, a message indicating a missed call, a notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card may be inserted into the SIM card interface 195, or removed from the SIM card interface 195 to enable contact and separation with the electronic device 100. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support Nano SIM cards, micro SIM cards, and the like. The same SIM card interface 195 may be used to insert multiple cards simultaneously. The types of the plurality of cards may be the same or different. The SIM card interface 195 may also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as communication and data communication. In some embodiments, the electronic device 100 employs esims, i.e.: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

The electronic device 100 may also include 1 or more flash 196. The type of the flash 196 of the electronic device 100 is not particularly limited in the embodiments of the present application, and the type of the flash 196 of the electronic device 100 may include an LED lamp, a xenon lamp, and the like, and the types of different flash 196 of the electronic device 100 may be different. A plurality of LED lamps may be included in one LED type flash 196. In some embodiments, flash 196 may emit white light, as well as other colors of light (e.g., yellow, red, green, blue, etc.). For example, one flash includes a white LED lamp, a yellow LED lamp, a red LED lamp, and a green LED lamp, and the electronic device 100 can control the flash to emit light of different colors by adjusting the brightness of each LED in the flash.

In some embodiments, the flash 196 may be disposed on the back of the electronic device 100 (i.e., on the side without the display 194), and the flash disposed on the back of the electronic device 100 may be used to supplement light when the rear camera 193A is capturing image data, thereby improving the ambient light level of the rear-mounted camera. In some embodiments, the flash may also be disposed on the front side of the electronic device 100 (i.e., the side including the display 194), and the flash disposed on the front side of the electronic device 100 may be used to supplement light when the front camera 193B collects image data, so as to improve the brightness of the environment captured in front.

In some embodiments, multiple flash lamps may be laid out on the back (or front) of the electronic device 100, and softer light may be created by multiple angles of light from the multiple flash lamps. It will be appreciated that the direct light of a single flash may be relatively stiff, possibly resulting in the formation of anti-spots and unsightly shadows on the photographic subject or background, and the photographic effect may be unnatural, and the resulting soft light of multiple flashes may alleviate the above-mentioned problems.

Fig. 1B to 1E illustrate several arrangements of the flash 193 on the back of the electronic device 100. Illustratively, as shown in FIG. 1B, the back of the electronic device 100 includes a rear camera 193A and a flash 1. Illustratively, as shown in FIG. 1C, the back of the electronic device 100 includes a rear camera 193A, a flash 1, and a flash 2. Illustratively, as shown in fig. 1D, the back of the electronic device 100 includes a rear camera 193A, a flash 1, a flash 2, and a flash 3. Illustratively, as shown in fig. 1E, the back of the electronic device 100 includes a rear camera 193A and, a flash 1, a flash 2, a flash 3, and a flash 4.

Note that, the distribution of the cameras and the flash lights on the electronic device shown in fig. 1B to 1E is merely an exemplary illustration, and does not constitute a specific limitation of the electronic device 100. For example, the distribution of the same number of flash lamps on the electronic device 100 may be different from fig. 1B to 1E.

The view range of the camera 193 is determined based on the focal length, the smaller the focal length, the larger the view angle of the camera, and the larger the view range; conversely, the larger the focal length, the smaller the viewing angle of the camera, and the smaller the viewing range. In some embodiments, better light supplementing may be achieved when the light range of flash 196 includes the viewing range of camera 193. In some embodiments, the plurality of flash 196 is laid out on the back (or front) of the electronic device 100 such that the light range of the plurality of flash 196 may include a viewing range at a preset focal length. For example, the preset focal length is 50mm, the shooting angle corresponding to the preset focal length is 46 degrees, the light angle of the plurality of flash lamps 196 is greater than or equal to 46 degrees, and the light range of the plurality of flash lamps 196 may include the view finding range under the preset focal length.

Exemplary, as shown in fig. 1F, a schematic view of a light range is provided according to the embodiment of the present application based on the flash distribution shown in fig. 1C.

The light supplementing method for shooting in the embodiment of the present application may be used for adjusting the light supplementing effect of the rear-mounted flash when the electronic device 100 is in rear-mounted shooting, where the shooting direction of the rear-mounted camera and the irradiation direction of the rear-mounted flash are on different sides of the electronic device from the display direction of the display screen 194. The light supplementing method for shooting in this embodiment may also be used to adjust the light supplementing effect of the gas flash when the electronic device 100 is front-mounted for shooting, where the shooting direction of the front-mounted camera and the irradiation direction of the front-mounted flash are on the same side of the electronic device as the display direction of the display screen 194. At present, the flash lamp of the smart phone is usually only in an on-off state, so that shooting requirements of user diversity cannot be met, shooting experience is poor, but the light supplementing effect of the flash lamp can be adjusted according to actual requirements of users, the light condition of shooting environments can be improved by the aid of the scheme, shooting requirements of the user diversity are met, and shooting experience of the users is effectively improved.

First, an exemplary graphical User Interface (UI) provided by an embodiment of the present application is described, where the UI is a media interface for interaction and information exchange between an application program or an operating system and a user, and it implements conversion between an internal form of information and a form acceptable to the user. The user interface of the application program is source code written in a specific computer language such as java, extensible markup language (extensible markup language, XML) and the like, the interface source code is analyzed and rendered on the terminal equipment, and finally the interface source code is presented as content which can be identified by a user, such as a picture, characters, buttons and the like. The properties and content of the controls in the interface are defined by labels or nodes, such as XML specifies the controls contained in the interface by nodes of < Textview >, < ImgView >, < VideoView >, etc. One node corresponds to a control or attribute in the interface, and the node is rendered into visual content for a user after being analyzed and rendered.

Fig. 2A illustrates an exemplary user interface 10 on the electronic device 100 for exposing applications installed by the electronic device 100.

The user interface 10 may include: status bar 101, navigation bar 102, calendar indicator 103, weather indicator 104, tray 105 with commonly used application icons, and other application icons. Wherein:

status bar 101 may include: one or more signal strength indicators 101A of a mobile communication signal (also may be referred to as a cellular signal), an operator name (e.g., "chinese mobile") 101B, one or more signal strength indicators 101C of a wireless high-fidelity (wireless fidelity, wi-Fi) signal, a battery status indicator 101D, a time indicator 101E.

The navigation bar 102 may include: a system navigation key such as a back key 102A, a home screen key 102B, a multi-tasking key 102C, etc. When detecting that the user clicks the back key 102A, the electronic device 100 may display a page previous to the current page. When it is detected that the user clicks the home screen key 102B, the electronic device 100 may display a home interface. When detecting that the user clicks the multitasking key 102C, the electronic device 100 may display the task that the user recently opened. The names of the navigation keys may be other, and the application is not limited thereto. Not limited to virtual keys, each navigation key in the navigation bar 102 may also be implemented as a physical key.

Calendar indicator 103 may be used to indicate a current time, such as a date, day of the week, time-of-day information, etc.

Weather indicator 104 may be used to indicate weather type, such as cloudy, rainy, etc., and may also be used to indicate information such as air temperature.

The tray 105 with common application icons may show: phone icon 105A, contact icon 105B, text message icon 105C, camera icon 105D.

Other application icons may be, for example: the icon 106, the icon 107 of gallery, the icon 108 of music, the icon 109 of application, the icon 110 of mailbox, the icon 111 of cloud share, the icon 112 of memo, the icon 113 of setting. The user interface 10 may also include a page indicator 114. Other application icons may be distributed across multiple pages, and page indicator 106 may be used to indicate which page the user is currently viewing the application in. The user may slide the area of the other application icons left and right to view the application icons in the other pages.

In some embodiments, the user interface 10 exemplarily shown in fig. 2A may be a Home screen (Home screen).

In other embodiments, the electronic device 100 may further include a front-facing camera, which may also be referred to as a secondary camera, located mainly above the screen of the electronic device 100, which may be used for self-timer, video call, etc.

It is to be understood that fig. 2A illustrates only a user interface on the electronic device 100 and should not be construed as limiting embodiments of the present application.

At present, in order to meet the front shooting requirements of users in dim light and dim light scenes, most factories perform post-processing on the shot pictures, namely, the effects of full and clear image quality are achieved through an image processing algorithm. However, the effect of this post-processing is still unsatisfactory, and the user's front-end shooting experience is poor.

In the light supplementing method provided by the embodiment of the application, when the electronic device 100 displays the shooting interface, the electronic device can adjust the display brightness of the light supplementing area by controlling the light supplementing parameter of the light supplementing area of the shooting interface, so that the light in the view-finding range of the front camera of the electronic device 100 can be supplemented. The user can observe the light filling effect in real time by displaying the preview picture after light filling is watched in the preview area of the shooting interface, and the shooting experience of the user is effectively improved. The following describes a light supplementing method for photographing according to an embodiment of the present application with reference to the accompanying drawings.

In some embodiments, an electronic device receives a first user operation; responding to the first user operation, and starting a shooting function; and displaying a shooting interface corresponding to the shooting function.

For example, as shown in fig. 2A and 2B, the first user operation may be that the user may click on an icon 105D of the camera on the user interface 10, the electronic device 100 detects the user operation, and in response to the user operation, the electronic device 100 starts a photographing function and displays the photographing interface 11 of the camera.

The photographing interface 11 may include at least: a shooting control 201, an album control 202, a camera switching control 203, a shooting mode 204, a display area 205 and a set icon 206. Wherein:

the photographing control 201 may receive a user operation (e.g., a touch operation), and in response to the detected user operation, the electronic device 100 may collect image data using a camera and display the image.

The album control 202 may receive a user operation (e.g., a touch operation), and in response to detecting the user operation, the electronic device 100 may display a newly saved photo in the album, and the album control 202 may be in the form of a thumbnail of the newly taken photo.

The camera switching control 203 is used for switching cameras. The electronic device 100 may detect a touch operation (e.g., a click operation on the camera switch control 203) on the camera switch control 203, in response to which the electronic device 100 may switch the camera. For example, a camera of the electronic apparatus 100 for photographing is switched from a front camera to a rear camera, or a camera of the electronic apparatus 100 for photographing is switched from a rear camera to a front camera.

The photographing mode 204 may include: night scene mode 204A, professional mode 204B, photo mode 204C, video mode 204D, portrait mode 204E, etc. The night scene mode 204A, the professional mode 204B, and the portrait mode 204E are all photographing modes optimized for a particular scene. Any of the photographing modes 204 described above may receive a user operation (e.g., a touch operation), and in response to the detected user operation, the electronic device 100 may display a photographing interface in the photographing mode.

It will be appreciated that if the current photographing mode is a photographing mode, the photographing control 201 may be used to take a photograph; if the current shooting mode is a video mode, the shooting control 201 can be used to start or stop video recording.

The display area 205 may be used to display image data, i.e., a preview screen, acquired by a front or rear camera (i.e., a camera currently being used for photographing) of the electronic device 100.

It can be understood that, if the camera currently used for shooting by the electronic device 100 is a front camera, the display area 205 is used for displaying the image data collected by the front camera of the electronic device 100; if the camera currently used for shooting by the electronic device 100 is a rear camera, the display area 205 is used for displaying image data collected by the rear camera of the electronic device 100.

The setup icon 206 may receive a user operation (e.g., a touch operation), and in response to the detected user operation, the electronic device 100 may display a setup interface of the camera.

As shown in fig. 2B, when the camera currently used for capturing the image of the electronic device 100 is a front camera and the display area 205 is used for displaying the image captured by the front camera of the electronic device 100, the capturing interface 11 further includes a light-compensating icon 207, and the light-compensating icon 207 may receive a user operation (e.g. a touch operation), and in response to the detected user operation, the electronic device 100 may display one or more light-compensating controls.

As shown in fig. 2B, the display area 205 occupies a partial area of the photographing interface 11, and an area of the photographing interface 11 other than the display area 205 includes the functional area 1 and the functional area 2. Wherein the functional area 1 includes: a set icon 206 and a light-compensating icon 207; the functional area 2 includes: a shooting control 201, an album control 202, a camera switching control 203 and a shooting mode 204. The background color of the

functional areas

1 and 2 may be white, black or other colors.

In some embodiments, the electronic device 100 may also display the image data captured by the camera in full screen, i.e., the display area 205 occupies the entire area of the capture interface 11. Illustratively, as shown in fig. 2C, the electronic device 100 displays the photographing interface 11 in response to a user operation on the camera icon 105D of the user interface 10. In the display area 205 of the shooting interface 11, the electronic device 100 displays the image data acquired by the camera in a full screen mode, and controls in the functional area 1 and the functional area 2 are displayed in a floating mode on the display area 205.

In the embodiment of the present application, the shooting interface 11 may also be referred to as a first interface. In addition to the shooting function being started by clicking on the camera icon 105D shown in fig. 2A, the shooting function may be started by other manners in the embodiment of the present application, which is not specifically limited herein. For example, the user may turn on the shooting function by clicking a shooting control in a third party application (instant messaging software, payment software, or shopping software, etc.).

It should be noted that the scheme provided in the embodiment of the present application is applicable to front-end shooting in any shooting mode of the shooting modes 204. The photographing mode shown in fig. 2B is taken as an example for explanation. Fig. 2B is merely an exemplary illustration of an embodiment of the present application and should not be construed as limiting the present application.

In some embodiments, the electronic device 100 displays a light-compensating icon 207 on the shooting interface 11, where the light-compensating icon 207 is used to determine the shape of the non-light-compensating region 210, and the shape of the non-light-compensating region 210 includes at least two types; the electronic device 100 may receive a sixth user operation on the light supplement icon 207; in response to the sixth user operation described above, the electronic apparatus displays an icon of the shape of the non-light-compensating region 210. In this embodiment, the first control may be a light filling icon 207. For example, as shown in fig. 3A and 3B, the electronic device 100 may receive an input operation (e.g., a touch operation) on the light-compensating icon 207, in response to which the electronic device 100 may display a shape bar 208, which shape bar 208 may include one or more shape controls, which may include a circular control 208A, a rectangular control 208B, a diamond control 208C, and a self-setting control 208D. Icons of the shape of the non-light compensating region 210 may include one or more of the shape controls described above. Not limited to the circular control 208A, the rectangular control 208B, and the diamond control 208C, the shape bar 208 may also include other preset-shaped controls. Wherein:

Any of the shape controls may receive a user operation (e.g., a touch operation), and in response to detecting the user operation, the electronic device 100 may display a correspondingly shaped non-light-compensating region on the display screen.

In some embodiments, the electronic device 100 may receive a second user operation, in response to which the electronic device determines a shape of the non-light-compensating region or the light-compensating region in the capture interface.

In some embodiments, the second user operation may be a user clicking on a circular control 208A, a rectangular control 208B, or a diamond control 208C.

For example, as shown in fig. 3B and 3C, the electronic device 100 receives a user operation on the rectangular control 208B, and in response to the detected user operation, the electronic device 100 may display a light-compensating effect bar 209, a rectangular non-light-compensating region 210, and determine a light-compensating region 211 according to the non-light-compensating region 210 on the photographing interface 11. The light-compensating effect column 209 is used for adjusting the light-compensating effect of the light-compensating area. The initial positions and sizes of the non-light-compensating areas 210 corresponding to the circular control 208A, the rectangular control 208B and the diamond-shaped control 208C on the display screen can be default settings before the electronic device 100 leaves the factory or can be user settings. In addition, the light-supplementing intensity of the light-supplementing region is controlled by the electronic device 100 by adjusting the light-supplementing parameter of the light-supplementing region.

In some embodiments, the non-light-compensating regions 210 corresponding to the circular control 208A, the rectangular control 208B, and the diamond-shaped control 208C are within the display area 205, and the electronic device 100 determines the region outside the non-light-compensating regions 210 within the display area 205 as the light-compensating region 211 on the display screen. Alternatively, the electronic device 100 determines an area outside the non-light-compensating area 210 in the photographing interface 11 as the light-compensating area 211 on the display screen. In some embodiments, the non-light-compensating regions 210 corresponding to the circular control 208A, the rectangular control 208B, and the diamond-shaped control 208C may include part or all of the functional regions outside the display region 205 (including the functional region 1 and the functional region 2 shown in fig. 3C), and the electronic device 100 determines the region outside the non-light-compensating region 210 in the shooting interface 11 to be the light-compensating region 211 on the display screen.

It should be noted that, before the electronic device 100 displays the photographing interface 11, the photographing interface 11 including the plurality of layers is laid out, drawn, and rendered.

In some embodiments of the present application, referring to fig. 3C, in response to a received user operation, the electronic device 100 determines a light-compensating area, and displays a light-compensating layer in the light-compensating area, where the transparency of the light-compensating layer is an initial transparency, and the initial transparency may be set by default or may be preset by a user. In some embodiments, the light-compensating region is inside the display area 205, and the electronic device covers the layer where the light-compensating layer is located on the preview screen in the process of laying out, drawing, and rendering the shooting interface 11. In some embodiments, the light supplementing area includes part or all of the functional area of the shooting interface 11, and in the process of laying out, drawing and rendering the shooting interface 11, the electronic device may cover the layer where the preview picture is located and the layer where the background of the functional area is located with the light supplementing layer.

In some embodiments, the light-compensating intensity of the light-compensating region is controlled by the electronic device by adjusting a light-compensating parameter of the light-compensating region, where the light-compensating parameter of the light-compensating region includes at least one of a transparency of the light-compensating region, a brightness of a pixel within the light-compensating region of the display screen, and a brightness of a backlight of the display screen. The transparency of the light-compensating region may include a transparency of the light-compensating layer.

In some embodiments, in response to a first user operation, the electronic device initiates a capture function; and displaying a shooting interface corresponding to the shooting function, wherein the light supplementing parameters of the light supplementing area in the shooting interface are preset light supplementing parameters.

In the embodiment of the present application, the non-light-compensating region 210 may include part or all of the display area. In some embodiments, referring to fig. 3C, the non-light-compensating region 210 may include a portion of the display region, the non-light-compensating region 210 may be referred to as a preview region, the preview region displays a preview screen after light compensation of the light-compensating region, and a user may view the preview screen after light compensation through the non-light-compensating region 210 and observe a light compensation effect in the preview screen in real time.

In the embodiment of the present application, the light-compensating layer may be displayed in the light-compensating region, or the light-compensating layer may not be displayed, and the following figures further describe the solution provided in the embodiment of the present application by taking the case of displaying the light-compensating layer as an example.

In some embodiments, the electronic device receives a fifth user operation; in response to a fifth user operation, the electronic device determines a light supplementing parameter of the light supplementing region; and the electronic equipment controls the light supplementing intensity of the light supplementing area according to the light supplementing parameter of the light supplementing area.

In some embodiments, the first selection control and the second selection control are displayed on the photographic interface 11. In one implementation, the first selection control corresponds to a first light supplementing parameter, and the second selection control corresponds to a second light supplementing parameter; the first selection control may receive a fifth user operation, and determine, in response to the detected fifth user operation, a light-compensating parameter corresponding to a light-compensating intensity corresponding to the light-compensating area as the first light-compensating parameter. In another implementation, the first selection control corresponds to a first light supplementing parameter and a first image processing algorithm, and the second selection control corresponds to a second light supplementing parameter and a second image processing algorithm; the first selection control may receive a fifth user operation, determine, in response to the detected fifth user operation, a light supplementing parameter corresponding to a light supplementing intensity corresponding to a light supplementing area as the first light supplementing parameter, and perform image processing on a preview picture acquired by the front camera by using the first image processing algorithm.

For example, as shown in FIG. 3C, the light-up effects column 209 may include a maximum control 209A, a beautification control 209B, and a self-tuning control 209C. Wherein:

in some embodiments, the maximum control 209A may be a first selection control or a second selection control. The first selection control may be the maximum control 209A, the fifth user operation may be that the user clicks the maximum control 209A, the electronic device determines a light supplementing parameter corresponding to the maximum control 209A, and the electronic device controls the light supplementing intensity of the light supplementing area according to the light supplementing parameter corresponding to the maximum control 209A, and may perform image processing on the preview screen by using an image processing algorithm corresponding to the maximum control 209A.

In some embodiments, the light compensation effect of the preview screen on the display screen is adjusted to be the maximum light compensation effect, i.e. the light compensation intensity of the light compensation area is adjusted to be the maximum light compensation intensity. In other embodiments, the light compensation effect of the preview screen on the display screen is adjusted to be the maximum light compensation effect, that is, the light compensation intensity of the light compensation area is adjusted to be the maximum light compensation intensity, and the preview screen displayed in the display area 205 is optimized by using the image processing algorithm 1. The image processing algorithm 1 may include, among other things, enhancement, filtering, color optimization, etc. of the image. The image processing algorithm 1 may include other image processing, not limited to the above-mentioned image processing algorithms such as enhancement, filtering, color optimization, sharpening, etc., and is not particularly limited herein.

Referring to fig. 3D and 3E, the beautification control 209B may receive a user operation (e.g., a touch operation), and in response to the detected user operation, the electronic device 100 displays the beautification control bar 301. Beautification control column 301 may include beautification controls 301A, 301B, 301C. Wherein:

in some embodiments, a first selection control and/or a second selection control may be included in beautification control 301A, beautification control 301B, or beautification control 301C. For example, the first selection control may be a beautification control 301A, the fifth user operation may be a user operation acting on the beautification control 301A, for example, the user clicks the beautification control 301A, the electronic device determines a light supplement parameter corresponding to the beautification control 301A, and the electronic device controls the light supplement intensity of the light supplement region according to the light supplement parameter corresponding to the beautification control 301A, and may perform image processing on the preview screen by using an image processing algorithm corresponding to the beautification control 301A.

Specifically, the beautifying control 301A may receive a user operation (e.g., a touch operation), and in response to the detected user operation, the electronic device 100 adjusts the light compensating effect of the preview screen to be the light compensating effect 1. In some embodiments, adjusting the light filling effect of the preview screen to be the light filling effect 1 includes adjusting the light filling intensity of the light filling area to be the light filling intensity 1. In other embodiments, the light filling effect of the preview screen is adjusted to be the light filling effect 1, that is, the light filling intensity of the light filling area is adjusted to be the light filling intensity 1, and the image processing algorithm 2 is used to perform image processing on the preview screen displayed in the display area 205, where the image processing algorithm 2 includes one of image processing algorithms such as an enhancement algorithm, a filtering algorithm, a color optimization algorithm, and a sharpening algorithm, for example, an image enhancement algorithm.

Beautifying control 301B may receive a user operation (e.g., a touch operation), and in response to the detected user operation, electronic device 100 adjusts the light complement effect of the preview screen to light complement effect 2. In some embodiments, the light-compensating effect of the preview screen is adjusted to be the light-compensating effect 2, i.e. the light-compensating intensity of the light-compensating area is adjusted to be the light-compensating intensity 2. In other embodiments, the light filling effect of the preview screen is adjusted to be the light filling effect 2, that is, the light filling intensity of the light filling area is adjusted to be the light filling intensity 2, and the image processing algorithm 3 is used to perform image processing on the preview screen displayed in the display area 205, where the image processing algorithm 3 includes one of image processing algorithms such as an enhancement algorithm, a filtering algorithm, a color optimization algorithm, and a sharpening algorithm, for example, a filtering algorithm of an image.

Beautifying control 301C may receive a user operation (e.g., a touch operation), and in response to the detected user operation, electronic device 100 adjusts the light complement effect of the preview screen to light complement effect 3. In some embodiments, the light compensation effect of the preview screen is adjusted to be the light compensation effect 3, i.e. the light compensation intensity of the light compensation area is adjusted to be the light compensation intensity 1. In other embodiments, the light filling effect of the preview screen is adjusted to be the light filling effect 3, that is, the light filling intensity of the light filling area is adjusted to be the light filling intensity 3, and the image processing algorithm 4 is used to perform image processing on the preview screen displayed in the display area 205, where the image processing algorithm 4 includes one of image processing algorithms such as an enhancement algorithm, a filtering algorithm, a color optimization algorithm, and a sharpening algorithm, for example, a color optimization algorithm of the image.

It should be noted that different beautification controls may have different emphasis on optimizing the preview screen. Not limited to the

beautification control

301A, 301B, 301C, the beautification control column 301 may also include other beautification controls, bringing different emphasis on the light supplementing effect. In some embodiments, image processing algorithm 2, image processing algorithm 3, and image processing algorithm 4 are different, and supplemental light intensity 1, supplemental light intensity 2, and supplemental light intensity 3 may be the same or different.

In some embodiments, the electronic device 100 may control the light-supplementing intensity of the light-supplementing region based on the light-supplementing parameter of at least one of the first light-supplementing sub-region and the second light-supplementing sub-region.

Referring to fig. 3F and 3G, self-adjustment control 209C may receive a user operation (e.g., a touch operation), and in response to the detected user operation, electronic device 100 displays brightness adjustment bar 302. The total length from the first end of the brightness adjustment bar 302 to the second end of the brightness adjustment bar 302 is used to represent the maximum light intensity of the electronic device 100, and the lengths of the first end of the shadow portion and the second end of the shadow portion in the brightness adjustment bar 302 are used to represent the light intensity of the current light-compensating region. The first end of the brightness adjustment bar 302 coincides with the first end of the shadow portion. The initial length of the shaded portion in the brightness adjustment bar 302 may be the optimal light intensity, or may be another default initial value, which is not particularly limited herein.

In some embodiments, brightness adjustment bar 302 includes a first identification; the length from the first end of the brightness adjustment bar 302 to the first mark is used for indicating the light intensity of the light compensation area, and the total length from the first end of the brightness adjustment bar 302 to the second end of the brightness adjustment bar is used for indicating the maximum light intensity; the fifth user operation may be that a finger of the user slides on the brightness adjustment bar starting from the first mark. And responding to the fifth user operation, and determining the light supplementing parameter of the light supplementing area by the electronic equipment according to the light supplementing intensity represented by the length from the first end to the first mark. For example, as shown in fig. 3H and 3I, the first identifier may be the second end of the shaded portion. The brightness adjustment bar 302 may receive a user operation, and in response to the detected user operation, the electronic device 100 may adjust the length of the shaded portion of the brightness adjustment bar 302, and simultaneously adjust the display brightness of the light-compensating region according to the light-compensating intensity represented by the shaded portion. As shown in fig. 3H, the user operation may be such that the user's finger slides on the brightness adjustment bar 302 with the hatched portion of the brightness adjustment bar 302 as the starting point. In some embodiments, in response to the user operation described above, the electronic device 100 adjusts the brightness adjustment bar 302 to adjust the minimum magnitude of the intensity of the light supplement that can be set by the electronic device 100 by default or by the user. For example, the light intensity of the electronic device 100 ranges from 0 to 10, and the minimum amplitude is 1.

In some embodiments, the shape, position and/or size of the light-compensating region may be set by default by the electronic device 100, or may be preset by a user. As shown in fig. 3A, the electronic device 100 may receive a user operation (e.g., a touch operation) acting on the light-filling icon 207, and as shown in fig. 3C, in response to the above-described user operation, the electronic device 100 may directly display the light-filling effect field 209 on the photographing interface and determine the light-filling region 211 and the non-light-filling region 210 on the photographing interface. In some embodiments, the electronic device 100 further displays a light-compensating layer in the light-compensating region 211, where the transparency of the light-compensating layer is an initial transparency, and the initial transparency may be set by default or may be preset by a user.

In addition to the manual light-filling method for the user shown in fig. 3A to 3B, the electronic apparatus 100 may automatically fill light for the front-end shooting. In some embodiments, when the electronic device 100 receives a user operation that a user turns on the camera, the electronic device 100 performs light filling by increasing the display brightness of the light filling area on the display screen. In some embodiments, when the electronic device 100 uses the front camera to capture a picture, the electronic device 100 performs light filling by increasing the display brightness of the light filling area on the display screen. In some embodiments, when the electronic device 100 uses the front camera to capture a photograph and the ambient light brightness is less than a preset value, the electronic device 100 performs light filling by increasing the display brightness of the light filling area on the display screen.

The automatic light filling mode may be set by default by the electronic device 100, or may be preset by a user. An exemplary implementation of the user-set automatic light filling is described below.

For example, as shown in fig. 3A, when the electronic device 100 detects a user operation of the light-compensating icon 207 acting on the photographing interface 11, as shown in fig. 3J, the electronic device 100 may display the selection bar 601 on the photographing interface in response to the user operation. Display selection bar 601 may include an automatic control 601A, a close control 601B, and a self-setting control 601C.

For example, as shown in fig. 3J and 3K, in response to a user operation for the automatic control 601A, the electronic device 100 modifies the icon of the light-filling icon 207 to be the icon of the automatic control 601A, and may display the light-filling area 211 and the non-light-filling area 210 on the photographing interface 11, and may also display a light-filling layer on the light-filling area 211. In the automatic light filling process, the light filling intensity of the light filling area 211 may be the optimal light filling intensity determined according to the current ambient light level, or may be set by default by the electronic device, or may be preset by the user. In some embodiments, as shown in fig. 3K, the light-compensating area displays a light-compensating layer, where the transparency of the light-compensating layer may be set by default by the electronic device 100, may be preset by a user, or may be determined according to the light-compensating intensity of the light-compensating area 211. The shape, position and/or size of the light-compensating region may be set by default by the electronic device 100, or may be preset by a user. The embodiment of the present application is not particularly limited thereto.

For example, as shown in fig. 3L and 3M, in response to a user operation for the close control 601B, the electronic device 100 modifies the icon of the light-compensating icon 207 to the icon of the close control 601B, and the electronic device 100 does not make up light for the front shooting with the display screen.

In addition, after the automatic light filling is turned on, the electronic device 100 may also perform automatic light filling when the user turns on the camera next time.

For example, as shown in fig. 2A, when the electronic device 100 detects a user operation of the camera icon 105D acting on the user interface 10, as shown in fig. 3N, the electronic device 100 displays the photographing interface 11, where a display area of the photographing interface 11 is used to display image data collected by the front camera, the photographing interface 11 includes a light supplementing area 211 and a non-light supplementing area 210, and the light supplementing area 211 may display a light supplementing layer. The electronic apparatus 100 supplements the photographing environment of the front photographing with light through the light supplementing region 211.

The user can make manual light replenishment through the self-setting control 601C. The self-setting control 601C may receive a user operation, and in response to detecting the user operation, as shown in FIG. 3B, the electronic device 100 may display the shape bar 208.

In some embodiments, the electronic device 100 may perform full-screen light filling in both the manual light filling and the automatic light filling, i.e., the light filling area 211 may include all areas of the display screen of the electronic device 100.

In addition to the manners of determining the light-compensating area on the display screen described in the related embodiments of fig. 3B and 3C, the light-compensating area on the shooting interface 11 may be determined in other manners in the present application.

(1) In some embodiments of the present application, when a user performs front shooting through the shooting interface 11, the shape, the position and the size of the non-light-compensating area on the display screen can be adjusted to determine the light-compensating area on the display screen, so as to adjust the light-compensating effect of the preview picture.

In some embodiments, the non-light-compensating region 210 is located within the display area 205 of the capture interface 11. The electronic device 100 determines an area outside the non-light-compensating area 210 within the display area 205 as a light-compensating area 211. Alternatively, the electronic device 100 determines that an area other than the non-light-compensating area 210 in the photographing interface 11 is the light-compensating area 211, that is, the light-compensating area includes a functional area other than the display area 205 in the photographing interface 11.

In some embodiments, the non-light-compensating region may include part or all of the functional region outside of the display region 205, and the electronic device 100 determines the region outside of the non-light-compensating region 210 on the photographing interface 11 as the light-compensating region 211.

Several ways of determining the shape of the non-light compensating region provided by embodiments of the present application are described below.

Fig. 3B and 3C illustrate an operation of determining the shape of the non-light compensating region.

Fig. 4A to 4G exemplarily illustrate another operation of determining the shape of the non-light compensating region.

The self-setting control 208D may be used to determine a user-defined non-light-compensating region shape.

For example, as shown in fig. 4A to 4C, the electronic device 100 may receive a user operation (e.g., a touch operation) acting on the self-setting control 208D, and in response to the detected user operation, the electronic device 100 may receive the user operation through the display screen to draw the non-light-compensating region 210.

In some embodiments, the second user operation includes a gesture of a finger of the user sliding on the display screen; in response to the second user operation, the electronic apparatus 100 determines the shape of the non-light-filling area or the light-filling area in the photographing interface 11 based on the slide trajectory of the gesture described above in the second user operation.

As shown in fig. 4B, the electronic device 100 receives a contact (or non-contact) sliding operation performed by a user's finger on a display screen. In response to the sliding operation, the electronic device 100 displays a sliding track corresponding to the sliding operation on the display screen, where the sliding track is used to form a frame of the non-light-compensating region 210. As shown in fig. 4C, after the electronic device 100 detects that the user stops the sliding operation, the electronic device 100 determines the non-light-compensating area 210 according to the sliding track, and displays the light-compensating effect bar 209.

In some embodiments, the non-light compensating region 210 is within the display area 205, and the electronic device 100 may only receive the sliding operation through the display area 205 of the display screen. In other embodiments, the non-light-compensating region 210 may include some or all of the functional regions other than the display region 205, and the electronic device 100 may receive the sliding operation through the display screen (including the display region 205 and the functional regions other than the display region 205).

For example, as shown in fig. 4D, the electronic device 100 may receive a sliding operation of a user through a display screen, and display a corresponding sliding track in response to the sliding operation. As shown in fig. 4E, after the electronic apparatus 100 detects that the user stops the above-described sliding operation, the shape of the non-light-filling area 210 is determined according to the above-described sliding trajectory, and an area other than the non-light-filling area 210 within the photographing interface 11 is determined as a light-filling area.

In some embodiments, when the electronic device 100 detects that the user stops the sliding operation and the sliding track forms a closed area, the closed area is determined to be the non-light-compensating area 210. In some embodiments, when the electronic device 100 detects a closed area in which the user stops the sliding operation and the sliding track is not formed, the electronic device 100 constructs the non-light-compensating area 210 according to the existing sliding track. For example, the starting point and the ending point of the existing sliding track are connected, and the formed closed region is determined as the non-light-compensating region 210.

In some embodiments, the electronic device 100 generates a closed area with a custom shape according to the received sliding track of the sliding operation, and performs preprocessing on the frame of the closed area. The electronic device 100 determines the processed enclosed area as the non-light-compensating area 210. In one possible implementation manner, the preprocessing value is to smooth the border of the closed area, so that the border of the closed area is smoother. In another possible implementation manner, after the preprocessing is to identify the shape of the closed area as a specific shape (for example, a circle, a heart, a rectangle, etc.), smoothing the border of the closed area according to the specific shape, so that the border of the closed area is smoother and more approximate to the specific shape. For example, referring to fig. 4F, the electronic apparatus 100 receives a sliding operation of a user, and displays a corresponding sliding track. As shown in fig. 4G, after the electronic device 100 detects that the user stops the sliding operation, it recognizes that the sliding track corresponding to the sliding operation is heart-shaped, and the electronic device 100 performs smoothing processing on the heart-shaped region that is custom-drawn by the user, and determines that the processed heart-shaped region is the non-light-compensating region 210.

For example, referring to fig. 5A, the electronic device 100 may receive a user operation (e.g., a touch operation) on the self-setting control 208D, and in response to the detected user operation described above, the electronic device 100 may display a completion control 208E on the photographic interface 11. After completing the display of control 208E, electronic device 100 may receive a sliding operation from the user via the display screen, where the sliding operation is used to determine a non-light compensating region on one or more display screens. As shown in fig. 5B, after the electronic device 100 receives the sliding operation of the user and displays the corresponding non-light-compensating region 210A on the display screen, the sliding operation of the user may be further received to draw other non-light-compensating regions. As can be seen from fig. 5B, in response to the sliding operation of the user, the electronic device 100 displays the frame of the non-light-compensating region 210B corresponding to the sliding track of the sliding operation on the display screen.

For example, as shown in fig. 5C and 5D, the completion control 208E may receive a user operation (e.g., a touch operation) acting on the completion control 208E, and in response to the detected user operation described above, the electronic device 100 displays the light-compensating effect field 209 on the photographing interface 11 and stops drawing the non-light-compensating region by receiving a sliding operation of the user.

In one case, the non-light compensating region 210 is within the display area 205. When the electronic device 100 determines the non-light-compensating region 210, it determines a region other than the non-light-compensating region in the display region 205 as a light-compensating region 211, and divides the light-compensating region into a plurality of light-compensating sub-regions.

In some embodiments, the light-compensating region comprises a first light-compensating sub-region and a second light-compensating sub-region, the light-compensating intensity of the light-compensating region being controlled by the electronic device by adjusting a light-compensating parameter of at least one of the first light-compensating sub-region and the second light-compensating sub-region. For example, as shown in fig. 6A, the electronic device 100 receives a user operation (e.g., a touch operation) applied to the rectangular control 208B, and as shown in fig. 6B, in response to the detected user operation, the electronic device 100 may display a light-compensating effect bar 209 on the capturing interface 11, determine a rectangular non-light-compensating region 210, and may further determine a light-compensating sub-region 211A, a light-compensating sub-region 211B, a light-compensating sub-region 211C, and a light-compensating sub-region 211D outside the non-light-compensating region in the display region 205.

In another case, the non-light compensating region 210 is within the display area 205. When the electronic device 100 determines the non-light-compensating region 210, it determines a region other than the non-light-compensating region in the photographing interface 11 as a light-compensating region 211, and divides the light-compensating region 211 into a plurality of light-compensating sub-regions.

For example, as shown in fig. 6B, the electronic device 100 determines a rectangular non-light-compensating region 210, and determines a light-compensating sub-region 211A, a light-compensating sub-region 211B, a light-compensating sub-region 211C, and a light-compensating sub-region 211D outside the non-light-compensating region in the photographing interface 11, where the light-compensating sub-region 211A may include the functional region 1 shown in fig. 6B, and the light-compensating sub-region 211C may include the functional region 2 shown in fig. 6B.

For example, as shown in fig. 6C, the electronic device 100 receives a user operation (e.g., a touch operation) applied to the rectangular control 208B, and in response to the detected user operation, the electronic device 100 determines a rectangular non-light-compensating region 210, and determines a light-compensating sub-region 211A, a light-compensating sub-region 211B, a light-compensating sub-region 211C, and a light-compensating sub-region 211D outside the non-light-compensating region in the display region 205, where the light-compensating sub-region 211A is the functional region 1 shown in fig. 6C, and the light-compensating sub-region 211D is the functional region 2 shown in fig. 6C.

In another case, the non-light supplementing region 210 may include part or all of the display region 205 and the functional region of the photographing interface 11. After determining the non-light-compensating region 210, the electronic device 100 determines a region outside the non-light-compensating region 210 in the photographing interface 11 as a light-compensating region 211, and divides the light-compensating region 211 into a plurality of light-compensating sub-regions.

For example, as shown in fig. 6D, the electronic apparatus 100 may receive a sliding operation of a user through the display area 205 and a functional area outside the display area 205. As shown in fig. 6E, in response to the above-described sliding operation, the electronic apparatus 100 determines the non-light-compensating region 210 and the light-compensating

sub-regions

211A and 211B, wherein the light-compensating sub-region 211A includes the functional region 1 and the light-compensating sub-region 211B includes the functional region 2.

In this embodiment of the present application, the number of the light-compensating sub-regions and how to divide the light-compensating regions according to the number of the light-compensating sub-regions may be set by default before the electronic device 100 leaves the factory, or may be set by a user. Neither is specifically limited herein.

It should be noted that the above three cases are applicable to the determination of the non-light-compensating region 210 by the shape control (e.g., 208A), and are also applicable to the determination of the non-light-compensating region 210 by the self-setting control 208D.

In some embodiments, when electronic device 100 displays multiple supplemental sub-regions, the identity and supplemental light intensity of each supplemental sub-region is displayed. Illustratively, as shown in FIG. 6F, the electronic device 100 displays a complement sub-region 211A and a complement sub-region 211B. And a symbol 303A and a symbol 303B corresponding to the complementary sub-region 211A and the complementary sub-region 211B, respectively, are displayed. The specific content of the symbol 303A may be "1 (3)", where "1" represents the identification of the complementary sub-region 211A and "(3)" represents the intensity of the complementary light of the complementary sub-region 211A. The specific content of symbol 303B may be "2 (3)", where "2" represents the identification of the complementary sub-region 211B and "(3)" represents the intensity of the complementary light of the complementary sub-region 211B. When the electronic device 100 displays a plurality of light-compensating sub-regions, the light-compensating intensity displayed by each light-compensating sub-region may be an initial light-compensating intensity, where the initial light-compensating intensity may be an optimal light-compensating intensity determined by the electronic device 100, may be 0 (i.e. no light-compensating), or may be other default values preset by the electronic device 100 or a user.

In some embodiments of the present application, when the electronic device 100 determines a plurality of light-compensating sub-regions in response to a received user operation, a light-compensating layer corresponding to the light-compensating sub-region is displayed in each light-compensating sub-region. In some embodiments, each light-compensating sub-region is inside the display area 205, and the electronic device covers the light-compensating layer corresponding to the light-compensating sub-region on the layer where the preview screen is located in the process of laying out, drawing, and rendering the shooting interface 11. In some embodiments, the light-compensating sub-area may include part or all of the functional area of the shooting interface 11, and in the process of laying out, drawing, and rendering the shooting interface 11, the electronic device covers the layer where the preview picture is located and the layer where the background of the functional area is located with the light-compensating layer corresponding to the light-compensating sub-area, so as not to affect the use of each control in the functional area, and covers the light-compensating layer with the layer where each control in the functional area is located.

The following describes how the user adjusts the light-supplementing effect of the light-supplementing region when the photographing interface 11 includes a plurality of light-supplementing sub-regions.

In some embodiments of the present application, the capture interface 11 includes a plurality of complementary sub-regions. The maximum control 209A may receive a user operation (e.g., a touch operation), and in response to the detected user operation, the electronic device 100 adjusts the light filling effect of the preview screen of the display area 205 to be the maximum light filling effect. The adjusting the light filling effect of the preview screen of the display area 205 to be the maximum light filling effect may include: the light intensity of each light-compensating sub-region is adjusted to be the maximum light intensity of the light-compensating sub-region, and the maximum light intensity of each light-compensating sub-region may be equal or unequal. The adjusting the light filling effect of the preview screen of the display area 205 to be the maximum light filling effect may further include: the preview screen displayed on the display area 205 is image-processed from multiple sides by the image processing algorithm 1.

In some embodiments of the present application, the capture interface 11 includes a plurality of complementary sub-regions. Beautifying control 209B may receive a user operation (e.g., a touch operation), and in response to the detected user operation, electronic device 100 displays beautifying control field 301. Beautification control column 301 may include beautification controls 301A, 301B, 301C. Taking beautifying control 301A as an example, beautifying control 301A may receive a user operation (e.g., a touch operation), and in response to the detected user operation, electronic device 100 adjusts the light filling effect of the preview screen to be light filling effect 1. The adjusting the light supplementing effect of the preview screen to be the light supplementing effect 1 may include: and adjusting the light intensity of each light-compensating sub-region to be 1. The light intensity 1 of each light compensating sub-region may be equal or unequal. The adjusting the light supplementing effect of the preview picture is the light supplementing effect 1, and may further include: the preview screen displayed in the display area 205 is subjected to image processing by the image processing algorithm 2.

In some embodiments of the present application, the capture interface 11 includes a plurality of complementary sub-regions. Self-adjustment control 209C may receive a user operation (e.g., a touch operation) in response to which electronic device 100 displays a brightness adjustment bar corresponding to each of the supplemental sub-regions.

Illustratively, as shown in fig. 7A, the photographic interface 11 includes a complementary sub-region 211A and a complementary sub-region 211B. The electronic device 100 may receive a user operation (e.g., a touch operation) on the self-adjustment control 209C, as shown in fig. 7B, and in response to the user operation, the electronic device 100 displays a brightness adjustment bar 302A corresponding to the complement sub-area 211A and a brightness adjustment bar 302B corresponding to the complement sub-area 211B. The brightness adjustment bar 302A may receive a user operation (e.g., a sliding operation), and the electronic device 100 adjusts the length of the shadow portion in the brightness adjustment bar 302A in response to the detected user operation, and adjusts the display brightness of the compensation sub-region 211A according to the compensation light intensity represented by the shadow portion in the brightness adjustment bar 302A. Similarly, the brightness adjustment bar 302B may be used to adjust the intensity of the light complement sub-region 211B.

In some embodiments of the present application, the photographing interface 11 includes a non-light-compensating region 210 and a light-compensating region 211, and the light-compensating region 211 may include a plurality of light-compensating sub-regions. The electronic device 100 may receive a user operation on the non-light-compensating region 210 to adjust the position of the non-light-compensating region 210 on the photographing interface 11, and also adjust the position of the light-compensating region 211.

In some embodiments, the electronic device receives a fourth user operation; and responding to the fourth user operation, and determining the position of the non-light supplementing area or the light supplementing area in the first interface by the electronic equipment.

For example, as shown in fig. 8A and 8B, the non-light-compensating region 210 may receive a user operation, and in response to the detected user operation, the electronic device 100 may adjust the position of the non-light-compensating region 210 on the display screen. The fourth user operation may be that the finger of the user slides on the display screen with the area within the border of the non-light-compensating area 210 as the starting point.

Illustratively, as shown in fig. 8C and 8D, the user interface includes a complement sub-region 211A, a complement sub-region 211B, a complement sub-region 211C, a complement sub-region 211D. The non-light compensating region 210 may receive a user operation (e.g., a sliding operation), and in response to the detected user operation, the electronic device 100 may adjust a position of the non-light compensating region 210 on the display screen and correspondingly adjust a region on the display screen included in each of the light compensating sub-regions.

In this embodiment of the present application, the position of the non-light-compensating region 210 may also be adjusted by other user operations, such as a voice command, a specific gesture, etc., which are not specifically limited herein.

In this embodiment, in the process of adjusting the position of the non-light-compensating region 210, the electronic device 100 may change the number of divisions and/or the manner of division of the light-compensating sub-regions of the light-compensating region 211 according to the position of the non-light-compensating region 210, or may not change, which is not specifically limited herein.

It should be noted that, in some embodiments, the electronic device 100 may only adjust the position of the non-light compensating region 210 in the display area 205. In other embodiments, the electronic device 100 may adjust the position of the non-light compensating region 210 on the capture interface 11.

In some embodiments of the present application, the photographing interface 11 includes a non-light-compensating region 210 and a light-compensating region 211, and the light-compensating region 211 may include a plurality of light-compensating sub-regions. The electronic device 100 may receive a user operation on the non-light-compensating region 210 to adjust the size of the non-light-compensating region on the photographing interface 11, and also adjust the size of the light-compensating region 211.

In some embodiments, the electronic device receives a third user operation; in response to the third user operation, the electronic device determines a size of the non-light-compensating region or the light-compensating region in the first interface.

For example, as shown in fig. 8E and 8F, the non-light-compensating region 210 may receive a user operation, and in response to the detected user operation, the electronic device 100 may reduce the area of the non-light-compensating region 210. As shown in fig. 8A, the third user operation may be that the user's finger slides to the outside of the non-light-filling area 210 with the frame of the non-light-filling area 210 as a starting point.

For example, as shown in fig. 8G and 8H, the non-light-compensating region 210 may receive a user operation, and in response to the detected user operation described above, the electronic device 100 may enlarge the area of the non-light-compensating region 210. As shown in fig. 8G, the third user operation may be performed such that the user's finger slides inside the non-light-filling area 210 with the frame of the non-light-filling area 210 as a starting point.

Illustratively, as shown in fig. 8I and 8J, the user interface includes a complement sub-area 211A, a complement sub-area 211B. The non-light compensating region 210 may receive a user operation (e.g., a sliding operation), and in response to the detected user operation, the electronic device 100 may adjust the area of the reduced non-light compensating region 210 and correspondingly adjust the region on the display screen included in each light compensating sub-region.

In this embodiment of the present application, the size of the non-light-compensating region 210 may also be adjusted by other user operations, such as a voice command, a specific gesture, etc., which are not limited herein.

In this embodiment, in the process of adjusting the size of the non-light-compensating region 210, the electronic device 100 may change the number of divisions and/or the manner of division of the plurality of light-compensating sub-regions of the light-compensating region 211 according to the size of the non-light-compensating region 210, or may not change, which is not limited herein specifically.

It should be noted that, in some embodiments, the electronic device 100 may only adjust the size of the non-light compensating region 210 in the display region 205. In other embodiments, the electronic device 100 may adjust the size of the non-light-compensating region 210 on the photographing interface 11.

(2) In some embodiments of the present application, when a user performs front shooting through the shooting interface 11, the shape, position and size of the light-compensating region 211 on the display screen can be adjusted to determine the light-compensating region 211 on the display screen, so as to adjust the light-compensating intensity of the light-compensating region 211.

In some embodiments, the light-compensating region 211 can only be located within the display area 205 of the capture interface 11. In some embodiments, the light supplementing region 211 may include part or all of the functional region outside of the display region 205.

Fig. 9A and 9B exemplarily illustrate an operation of determining the shape of the light-compensating region.

For example, as shown in fig. 9A and 9B, the electronic device 100 may receive a user operation (e.g., a touch operation) applied to the rectangular control 208B, and in response to the detected user operation, the electronic device 100 may display the light-compensating effect field 209 and the rectangular light-compensating region 211 on the photographing interface 11, and determine that a region other than the light-compensating region 211 on the photographing interface 11 is the non-light-compensating region 210.

Fig. 9C to 9I exemplarily illustrate another operation of determining the shape of the light-compensating region.

For example, as shown in fig. 9C and 9D, the electronic device 100 may receive a user operation (e.g., a touch operation) acting on the self-setting control 208D, and in response to the detected user operation, the electronic device 100 may receive the user operation through the display screen to determine the light-filling region 211.

As shown in fig. 9C and 9D, after receiving the user operation on the self-setting control 208D, the electronic device 100 may receive a touch (or non-touch) sliding operation performed by a finger of the user over the display screen, and in response to the sliding operation, the electronic device 100 displays a corresponding sliding track on the display screen, where the sliding track is used to form a frame of the light-compensating region 211. As shown in fig. 9E, after the electronic device 100 detects that the user stops the sliding operation, the electronic device 100 determines the light-compensating area 211 according to the sliding track corresponding to the sliding operation, and displays the light-compensating effect column 209.

Specifically, how to determine the light-compensating region 211 according to the sliding track may refer to the related embodiment of determining the non-light-compensating region 210 according to the sliding track, which is not described herein.

For example, referring to fig. 9F-9I, the electronic device 100 may receive a user operation (e.g., a touch operation) on the self-setting control 208D, and in response to the detected user operation, the electronic device 100 may display a completion control 208E on the photographing interface 11, and the electronic device 100 may also receive a sliding operation of the user through the display screen, the sliding operation being used to determine a frame of one or more of the supplementary sub-regions. As shown in fig. 9G, after the electronic device 100 receives the sliding operation of the user and displays the corresponding light-compensating sub-region 211A on the display screen, the sliding operation of the user may be further received to draw other light-compensating regions. As can be seen from fig. 9H and 9I, in response to the sliding operation by the user, the electronic device 100 displays the frame of the sub-region 211B on the display screen according to the sliding track of the sliding operation.

The completion control 208E may receive a user operation (e.g., a touch operation) acting on the completion control 208E, and in response to the detected user operation described above, the electronic device 100 displays the light-compensating effect field 209 on the photographing interface 11 and stops drawing the light-compensating region 211 by receiving a sliding operation of the user.

Referring to fig. 7A and 7B, the photographing interface 11 includes a plurality of complementary sub-regions, and the self-adjustment control 209C may receive a user operation (e.g., a touch operation) in response to which the electronic device 100 displays a brightness adjustment bar corresponding to each of the complementary sub-regions. The electronic device 100 can adjust the light intensity of the light-compensating region 211 according to a user operation on the brightness adjustment bar.

In some embodiments of the present application, referring to fig. 9A to 9I, the photographing interface 11 includes a non-light-compensating region 210 and a light-compensating region 211, and the light-compensating region 211 may include a plurality of light-compensating sub-regions. The electronic device 100 may receive a user operation on the complementary sub-region to adjust the position of the complementary sub-region on the photographing interface 11. The user operation for adjusting the position of the light-compensating sub-region may refer to the user operation for adjusting the position of the non-light-compensating region in the related embodiments of fig. 8C and 8D, which is not described herein. In some embodiments, the electronic device 100 may receive a user operation on the complementary sub-region to resize the complementary sub-region on the capture interface 11. The user operation for adjusting the size of the light-compensating sub-region may also refer to the user operation for adjusting the size of the non-light-compensating region in the related embodiment of fig. 8I and 8J, which is not described herein.

How to adjust the light-filling effect of the light-filling area to be the optimal light-filling effect is described below.

In some embodiments, the electronic device 100 adjusts the light compensation effect of the preview screen in the preview area 205 to be the optimal light compensation effect, i.e. adjusts the light compensation intensity of the light compensation area to be the optimal light compensation intensity. In other embodiments, the electronic device 100 adjusts the light compensation effect of the preview screen in the preview area 205 to be the optimal light compensation effect, that is, adjusts the light compensation intensity of the light compensation area to be the optimal light compensation intensity, and optimizes the preview screen displayed in the preview area 205 by using the image processing algorithm 1. The image processing algorithm 1 may include, among other things, enhancement, filtering, color optimization, etc. of the image. The image processing algorithm 1 may include other image processing algorithms, not limited to the above-mentioned image processing algorithms such as enhancement, filtering, color optimization, sharpening, etc., and is not particularly limited herein.

How to determine the optimal light intensity is described below.

In some embodiments, the electronic device 100 obtains the ambient light level according to the ambient light sensor 180L, and determines the optimal light filling intensity of the light filling area according to the ambient light level, the light sensing range of the ambient light sensor 180L, and the light filling range of the electronic device 100. For example, if the ambient light sensor 180L has a light sensing range of 0 to the maximum luminance G1 (e.g., 1000), the electronic device 100 has a light compensating range of 0 to the maximum light compensating intensity B1 (e.g., 10), and the ambient light sensor 180L of the electronic device 100 obtains that the current ambient light level G2 is 50, the electronic device 100 determines that the optimal light compensating intensity B2 is (1-G1/G2) ×b1, i.e., 9.5.

In some embodiments, the electronic device 100 obtains the ambient light level according to the ambient light sensor 180L, and determines the optimal light compensation intensity of the light compensation area according to the ambient light level, the light sensing range of the ambient light sensor 180L, the light compensation range of the electronic device 100, and the exposure value when the camera 193 shoots.

In the embodiment of the present application, the method for determining the optimal light intensity is not limited to the above method, but may be other methods, which are not specifically limited herein.

How to determine the light-supplementing effect corresponding to the beautifying control, the light-supplementing effect corresponding to the beautifying control includes the light-supplementing intensity of the light-supplementing area 211 and the image processing algorithm of the preview picture is described below.

Referring to fig. 3D and 3E, the light-compensating effect 1 corresponding to the beautifying control 301A includes the light-compensating intensity 1 of the light-compensating area 211 and the image processing algorithm 2 of the preview screen; the light supplementing effect 2 corresponding to the beautifying control 301B comprises the light supplementing intensity 2 of the light supplementing area 211 and an image processing algorithm 3 of the preview picture; the light supplementing effect 3 corresponding to the beautifying control 301C includes the light supplementing intensity 3 of the light supplementing area 211 and the image processing algorithm 4 of the preview screen.

In some embodiments, the electronic device 100 determines the light intensity corresponding to the beautifying control according to the optimal light intensity, where the light intensity 1, the light intensity 2, and the light intensity 3 are equal to the optimal light intensity. The image processing algorithm 2, the image processing algorithm 3 and the image processing algorithm 4 are different, and the three image processing algorithms can comprise one of image processing algorithms such as an enhancement algorithm, a filtering algorithm, a color optimization algorithm, a sharpening algorithm and the like.

In some embodiments, after determining the image processing algorithm 2, the image processing algorithm 3, and the image processing algorithm 4, the electronic device 100 determines the light intensity corresponding to the light filling effect according to the image processing algorithm corresponding to the light filling effect. For example, image processing algorithm 2 corresponding to aesthetic control 301A is color optimized. The color optimization is affected by the excessively strong ambient light, if the optimal light-compensating intensity is greater than a first preset value, the light-compensating intensity 1 of the beautifying control 301A corresponding to the light-compensating effect 1 is equal to the optimal light-compensating intensity minus a preset difference, otherwise, the light-compensating intensity is equal to the optimal light-compensating intensity. In some embodiments, the electronic device 100 determines the light-compensating intensity 1, the light-compensating intensity 2, and the light-compensating intensity 3 of the light-compensating region according to the optimal light-compensating intensity of the light-compensating region. When the optimal light-compensating intensity B2 is larger than B1-x, determining that the light-compensating intensity 1 is equal to B2-x, the light-compensating intensity 2 is equal to B2-2*x, and the light-compensating intensity 3 is equal to B2-3*x, wherein x is a preset difference value. If the optimal light supplementing intensity B2 is smaller than B1-x and larger than or equal to B1-2*x, determining that the light supplementing intensity 1 is equal to B2+x, the light supplementing intensity 2 is equal to B2-x, and the light supplementing intensity 3 is equal to B2-2*x. If the optimal light supplementing intensity B2 is smaller than B1-2*x and larger than or equal to B1-3*x, determining that the light supplementing intensity 1 is equal to B2+2*x, the light supplementing intensity 2 is equal to B2+x, and the light supplementing intensity 3 is equal to B2-x. Then, the electronic device 100 determines the image processing algorithm corresponding to the light intensity of the different light-compensating effects according to the light intensity 1, the light intensity 2 and the light intensity 3. For example, electronic device 100 determines that supplemental light intensity 1 is equal to b2+2*x, supplemental light intensity 2 is equal to b2+x, and supplemental light intensity 3 is equal to B2-x; then, the electronic device 100 determines that the image processing algorithm corresponding to the stronger light supplementing intensity 1 is a sharpening algorithm, because sufficient light is beneficial to improving the sharpening effect of the preview picture; the image processing algorithm corresponding to the moderate light supplementing intensity 2 is a color optimization algorithm, and is relatively unfavorable for the color optimization algorithm due to exposure caused by the excessively bright image and darkness caused by the excessively dark image; the image processing algorithm corresponding to the smaller light supplementing intensity 3 is an enhancement algorithm, and the image enhancement algorithm can effectively optimize the quality of the preview picture under the condition of insufficient light, so that the preview picture with dim light is clearer.

In the embodiment of the present application, the method for determining the preferable light supplementing effect is not limited to the above method, but may also have other methods, which are not specifically limited herein.

The following describes how the electronic device 100 adjusts the display luminance of the light-compensating region according to the light-compensating intensity.

First, in the embodiment of the present application, the display screen 194 may include display panels such as LCD display panels and OLED display panels. The present invention is not particularly limited herein. When the display panel is an OLED display panel, the electronic device 100 may individually control the pixel brightness of each pixel.

As shown in fig. 10A, the LCD display panel includes a backlight layer 401, a liquid crystal layer 402, a color filter 403, and a glass base layer 404. Wherein the backlight 401 may be used to display white light under current driving. In the embodiment of the present application, the brightness of the white light displayed by the backlight layer 401 can be changed by changing the magnitude of the driving current and the Pulse Width Modulation (PWM) duty ratio of the driving current, so as to change the overall brightness of the picture. For example, the larger the driving current, the higher the luminance of white light is displayed by the backlight layer 401 at the same PWM duty. For another example, the larger the PWM duty ratio, the higher the brightness of white light is displayed by the backlight layer 401 at the same driving current.

The color filter 403 may include three types of filters of red, green and blue. Each pixel may include three types of color display units of red, green, and blue. In some embodiments, the color filter 403 may include four types of green sheets of light, red, green, blue, and white. Each pixel may include four types of color display units of red, green, blue, and white. The liquid crystal layer 402 may be used to receive a voltage control signal to control how much white light displayed by the backlight layer 401 is injected into the color filter 403. Wherein the liquid crystal layer 402 can realize the independent control of the light entering quantity of the white light displayed by the backlight layer 211 into each color display unit. The pixel point can be adjusted to display different colors by adjusting the white light entering proportion of various color filters in the pixel point. The glass substrate 401 is transparent and can be used to support the entire LCD panel.

Illustratively, as shown in fig. 10B, the OLED panel includes a glass substrate 501, an anode 502, a hole injection layer 503, an organic light emitting layer 504, an electron transport layer 505, and a cathode 506. Wherein,,

the glass substrate 501 is transparent and can be used to support the entire OLED panel. Anode 502 is transparent, and anode 502 eliminates electrons and increases electron holes when current flows. The hole injection layer 503 is composed of organic material molecules for transporting electron holes from the anode 506. The organic light emitting layer 504 is composed of an organic material for emitting light. The electron transport layer 505 is composed of molecules of an organic material for transporting electrons from the cathode 506. The cathode 506 injects electrons into the electron transport layer 505 when a current is passed through the cathode 506. When the current is driven to make the two ends of the anode 502 and the cathode 506 reach a certain voltage, the electron holes generated by the anode 502 and the electrons generated by the cathode 506 are combined in the organic light emitting layer to generate light. Among them, the organic light emitting layer 504 may generate three primary colors of red, green and blue (RGB) to constitute a basic color due to the different types of organic material molecules.

Each light emitting unit in the OLED panel can be individually lighted, and different colors of light are generated due to the different organic material molecules of the organic light emitting layer in the light emitting unit. The luminance of the light emitted by the organic light emitting layer 503 depends on the performance of the light emitting material and the magnitude of the current applied to the anode 502 and the cathode 506, and the higher the current applied to the cathode and anode, the higher the luminance of the light emitted by the organic light emitting layer 503. Therefore, each display pixel point in the OLED panel may include organic light emitting units of red, green and blue, and the display color of the display pixel point may be adjusted by adjusting the ratio of the injection current values of the red, green and blue light emitting units in the display pixel point. Alternatively, each display pixel in the OLED panel may include light emitting units having red, green, blue, and white colors. The display color of the display pixel can be adjusted by adjusting the ratio of the injection current values of the red, green, blue and white light emitting units in the display pixel. By adjusting the driving current of each pixel of the OLED panel, the picture display brightness of the OLED panel can be adjusted.

The following describes in detail how the electronic device 100 adjusts the display luminance of the light-compensating region according to the light-compensating intensity.

The following description will be made with respect to two cases in which the light-supplementing layer is displayed in the light-supplementing region and the light-supplementing layer is not displayed in the light-supplementing region, respectively.

(1) And no light supplementing layer is displayed in the light supplementing area. In some embodiments, the electronic device 100 may store a correspondence relationship between the light-compensating intensity of the light-compensating region (or the light-compensating sub-region) and the driving current (or the driving voltage) of the pixel. The drive current (or drive voltage) of the pixel is used to control the pixel brightness of the pixel.

In some embodiments of the present application, the display screen 194 employs an OLED display panel. The electronic device 100 adjusts display brightness of the light-compensating region according to the light-compensating intensity, specifically including: the electronic device 100 determines a driving current of the organic light emitting unit corresponding to each pixel in the light supplementing region (or the light supplementing sub-region) according to the light supplementing intensity of the light supplementing region (or the light supplementing sub-region); and adjusting the display brightness of the light supplementing region by adjusting the driving current of the organic light emitting unit corresponding to each pixel in the light supplementing region (or the light supplementing sub region).

In some embodiments of the present application, the display 194 employs an LCD display panel. The electronic device 100 adjusts display brightness of the light-compensating region according to the light-compensating intensity, specifically including: the electronic device 100 determines and adjusts a driving voltage of the liquid crystal layer corresponding to each pixel in the light-compensating region (or the light-compensating sub-region) according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region); and adjusting the display brightness of the light supplementing region by adjusting the driving voltage of the liquid crystal molecules corresponding to each pixel in the light supplementing region (or the light supplementing sub region).

(2) And a light supplementing layer is displayed in the light supplementing area. In some embodiments, the electronic device 100 may store a correspondence relationship of the light-compensating intensity of the light-compensating region (or the light-compensating sub-region), the driving current (or the driving voltage) of the pixel, and the transparency of the light-compensating layer; in some embodiments, the electronic device 100 stores the correspondence between the light-compensating intensity of the light-compensating region (or the light-compensating sub-region), the driving current of the backlight, and the transparency of the light-compensating layer. The drive current of the backlight is used to control the brightness of the backlight.

In some embodiments of the present application, the electronic device 100 adjusts the display brightness of the light compensation area (or the light compensation sub-area) according to the light compensation intensity, specifically including: the electronic device 100 determines and adjusts the transparency of the light-compensating layer corresponding to the light-compensating region (or the light-compensating sub-region) according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region). For example, the light-compensating layer is white, when the intensity of the light-compensating light is 0, the light-compensating layer is transparent, the greater the intensity of the light-compensating light, the lower the transparency and the brighter the light-compensating layer, and when the intensity of the light-compensating light is the maximum intensity of the light-compensating light, the light-compensating layer is opaque and the brightest. It will be appreciated that the lower the transparency of the white light-compensating layer, the brighter the light-compensating layer.

In some embodiments, the light-compensating layer may be of other colors, which is not specifically limited herein. The light supplementing layers with different colors can bring different colors of ambient light, so that different light supplementing effects are displayed.

In some embodiments of the present application, the display screen 194 employs an OLED display panel. The electronic device 100 adjusts display brightness of the light compensation area (or the light compensation sub-area) according to the light compensation intensity, specifically including:

the electronic device 100 determines and adjusts the driving current corresponding to each pixel in the light-compensating region (or the light-compensating sub-region) and the transparency of the light-compensating layer corresponding to the light-compensating region (or the light-compensating sub-region) according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region);

or, the electronic device 100 adjusts the driving current corresponding to each pixel in the light-compensating region (or the light-compensating sub-region) to be a current preset value, and determines and adjusts the transparency of the light-compensating layer corresponding to the light-compensating region (or the light-compensating sub-region) according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region);

or, the electronic device 100 adjusts the transparency of the light-compensating layer corresponding to the light-compensating region (or the light-compensating sub-region) to be a preset transparency value, and determines and adjusts the driving current corresponding to each pixel in the light-compensating region (or the light-compensating sub-region) according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region);

Or, the electronic device 100 determines and adjusts the driving current corresponding to each pixel in the display panel according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region), and the transparency of the light-compensating layer corresponding to the light-compensating region (or the light-compensating sub-region);

or, the electronic device 100 adjusts the driving current corresponding to each pixel in the display panel to be a current preset value, and determines and adjusts the transparency of the light-compensating layer corresponding to the light-compensating region (or the light-compensating sub-region) according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region);

or, the electronic device 100 adjusts the transparency of the light-compensating layer corresponding to the light-compensating region (or the light-compensating sub-region) to be a preset transparency value, and determines and adjusts the driving current corresponding to each pixel in the display panel according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region).

It should be noted that, when the display panel is turned on as a whole, the light-compensating region covering the light-compensating layer may be brighter than the non-light-compensating region not covering the light-compensating layer.

In some embodiments of the present application, the display 194 employs an LCD display panel. The electronic device 100 adjusts display brightness of the light compensation area (or the light compensation sub-area) according to the light compensation intensity, specifically including:

the electronic device 100 determines and adjusts the driving voltage of the liquid crystal molecules corresponding to each pixel in the light-compensating region (or the light-compensating sub-region) and the transparency of the light-compensating layer corresponding to the light-compensating region (or the light-compensating sub-region) according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region);

Or, the electronic device 100 adjusts the driving voltage of the liquid crystal molecules corresponding to each pixel in the light-compensating region (or the light-compensating sub-region) to be a voltage preset value, and determines and adjusts the transparency of the light-compensating layer corresponding to the light-compensating region (or the light-compensating sub-region) according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region);

or, the electronic device 100 adjusts the transparency of the light-compensating layer corresponding to the light-compensating region (or the light-compensating sub-region) to be a preset transparency value, and determines and adjusts the driving voltage of the liquid crystal molecules corresponding to each pixel in the light-compensating region (or the light-compensating sub-region) according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region);

or, the electronic device 100 determines and adjusts the driving current of the backlight source of the display panel according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region), and the transparency of the light-compensating layer corresponding to the light-compensating region (or the light-compensating sub-region);

or, the electronic device 100 adjusts the driving current of the backlight source of the display panel to be a current preset value, and determines and adjusts the transparency of the light-compensating layer corresponding to the light-compensating region (or the light-compensating sub-region) according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region);

alternatively, the electronic device 100 adjusts the transparency of the light-compensating layer corresponding to the light-compensating region (or the light-compensating sub-region) to be a preset transparency value, and determines and adjusts the driving current of the backlight of the display panel according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region).

In some embodiments of the present application, the light-compensating region includes a black background color of the functional region of the photographing interface 11, if the light-compensating region includes a part or all of the functional region of the photographing interface 11, the electronic device 100 displays the light-compensating layer in the light-compensating region in the display region 205, and when the electronic device 100 adjusts the display brightness of the light-compensating region (or the light-compensating sub-region) according to the light-compensating intensity, the background color of the light-compensating region (or the light-compensating sub-region) in the functional region is adjusted to be white, and adjusts the pixel brightness of the light-compensating region (or the light-compensating sub-region) in the functional region according to the light-compensating intensity of the light-compensating region (or the light-compensating sub-region).

The display principle of the light-compensating layer is described below.

First, the display principle of the user interface on the electronic device 100 will be described. Generally, before the user interface is displayed, the generation process of the user interface can be mainly divided into: measuring layout, drawing, rendering, synthesizing and caching. Fig. 11A is a timing diagram of a user interface display of the electronic device 100 according to an embodiment of the present application. As shown in fig. 11A, the electronic device 100 refreshes the displayed user interface according to a refresh frequency, for example, 60HZ, with a refresh period of 16.67ms. The first refresh period displays the n-1 frame of images, and after the first refresh period is completed, the controller of the electronic device 100 sends a Vsync signal, which may be used to trigger the display screen to refresh the display interface. When the AP receives the Vsync signal, it performs measurement layout and drawing on the n+1st frame image. After the AP draws the n+1st frame image, the drawing data of the n+1st frame image is sent to the GPU. And the GPU performs rendering synthesis on the n+1st frame image according to the drawing data, and writes the n+1st frame image data after rendering synthesis into the image buffer area. Meanwhile, when the display receives the Vsync signal, displaying an nth frame image according to the nth frame image data in the image buffer area, and when the display receives the next Vsync signal (namely, when the second refresh period is finished), displaying an (n+1) th frame image according to the (n+1) th frame image data in the image buffer area;

Note that not every Vsync signal is generated, the AP redraws the image. Only when AP needs to update the display interface, AP will request to receive the Vsync signal, and after receiving the Vsync signal, it will start drawing the next frame image.

In some embodiments, the electronic device 100 receives a light supplementing operation of front photographing of a user, the electronic device 100 refreshes a display interface to be the photographing interface 11, the photographing interface 11 includes a light supplementing area and a non-light supplementing area, the light supplementing area displays a light supplementing layer, and the transparency of the light supplementing layer is the first transparency. Referring to fig. 3A and 3B, the light filling operation may further be that the user clicks the rectangular control 208B on the shooting interface 11, where the first transparency is an initial transparency of the light filling layer, and the first transparency may be preset by the user or may be set by default by the electronic device 100; referring to fig. 2A and 3N, the above-described light supplementing operation may also be a user clicking on the camera icon 105F on the user interface 10.

Taking the light supplementing operation shown in fig. 2A and 3N as an example, the display principle of the photographing interface 11 will be described.

In some embodiments, after receiving the light supplementing operation shown in fig. 2A, when the AP receives the Vsync, the AP performs traversal measurement on the length and width of the object in the photographing interface 11; the AP performs traversal layout on the position of the object in the shooting interface 11 according to the measurement result; the AP draws the object in the shooting interface 11 according to the layout result; the AP sends the drawing data of the shooting interface 11 to the GPU; the GPU renders the object in the shooting interface 11 according to the drawing data sent by the AP, and generates 4 rendering layers as shown in fig. 11B, where the 4 rendering layers include: the control in the functional area 1 and the functional area 2 of the shooting interface 11 is located in a layer 1, the background in the functional area 1 and the functional area 2 of the shooting interface 11 is located in a layer 2, a light supplementing layer 3 and image data collected by a camera is located in a layer 4; the GPU synthesizes the 4 rendering layers; the GPU sends the synthesized image data to a cache area; when the display screen receives the next Vsync, the display screen displays the photographing interface 11 according to the synthesized data in the buffer area. When the GPU synthesizes the 4 rendering layers, the light supplementing layer 3 covers the layer 4 where the image data collected by the camera is located, the layer 2 where the backgrounds of the functional area 1 and the functional area 2 are located, and the layer 1 where the controls in the functional area 1 and the functional area 2 are located covers the light supplementing layer 3.

In embodiments of the present application, the software system of the electronic device 100 may employ a layered architecture, an event driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In this embodiment, taking an Android system with a layered architecture as an example, a software structure of the electronic device 100 is illustrated.

Referring to fig. 12, fig. 12 shows a software architecture block diagram of an electronic device provided by an embodiment of the present application. The electronic device 100 may display a light-compensating control on the front-end shooting interface, determine one or more light-compensating areas on the front-end shooting interface by receiving a user operation acting on the light-compensating control, and adjust a light-compensating effect of a preview screen according to a user's own requirement, so as to improve a light condition of a front-end shooting environment, effectively improve a front-end shooting image quality, and improve a front-end shooting experience of a user.

As shown in fig. 12, the layered architecture divides the software into several layers, each with a clear role and division of work. The layers communicate with each other through a software interface. In some embodiments, the Android system may be divided from top to bottom into an application layer, an application framework layer, a hardware abstraction layer (hardware abstraction layer, HAL) layer, and a kernel layer (kernel). Wherein:

The application layer includes a series of application packages, such as cameras, gallery, and the like. Other applications, such as WeChat, tremble, etc., that may enable a front-facing camera of electronic device 100 may also be included.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in fig. 12, the application framework layer may mainly include APIs and System services (System servers). Wherein the API is used for realizing communication between the application program layer and the HAL layer and between the application program layer and the kernel layer. For example, the camera API may provide communication between the camera application and the HAL layer, the kernel layer, and so on. The system services may include camera services and view management systems. The camera service may include a light supplementing service, an image processing service, and the like. The electronic device 100 may call a corresponding camera service by calling a camera API, and the camera service may send relevant parameters of the camera service to the HAL layer by calling the HAL interface of the camera. For example, the camera API calls the light filling service and the image processing service, and sends the related parameters (such as the ambient light level) of the light filling service and the related parameters (such as the identification of the image processing algorithm) of the image processing service to the HAL layer and the kernel layer, so that the HAL layer and the kernel layer execute corresponding operations according to the related parameters. The view management system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the capture interface 11 including the light-filling layer may include a view displaying a picture (e.g., capture control 201, preview screen, light-filling icon 207, etc.) and a view displaying a text control (e.g., circular shape control 208A, self-setting control 208D, etc.). For example, the camera service transmits the frame coordinates of the light-filling area and the transparency of the light-filling layer to the view management system, which draws the photographing interface 11 including the light-filling layer according to the frame coordinates of the light-filling area or the non-light-filling area.

In this embodiment of the present application, the application framework layer may further add a motion detector (motion detector) for performing logic judgment on the obtained input event, and identifying the type of the input event. For example, the input event is determined to be a finger joint touch event, a finger belly touch event, or the like, based on information such as touch coordinates, a time stamp of a touch operation, or the like included in the input event. Meanwhile, the motion detection component can record the track of the input event, judge the gesture rule of the input event and respond to different operations according to different gestures.

The HAL layer and the kernel layer are used for responding to the functions called by the system service in the application program framework layer to execute corresponding operations. The kernel layer is a layer between hardware and software. The kernel layer may contain camera drivers and display drivers, and may also include audio drivers, sensor drivers, and the like. The display driver of the kernel layer displays the photographing interface 11 through a hardware device (e.g., a display screen 194), and the light supplementing effect can be exhibited through the photographing interface 11. In some embodiments, the camera service times call the HAL layer through the camera HAl interface, which may determine the optimal light supplement intensity, light supplement intensity 1, light supplement intensity 2, light supplement intensity 3, etc. for the electronic device 100 in real-time based on a light supplement algorithm. In some embodiments, when the electronic device 100 receives a user operation to determine a light filling effect, the camera service invokes the HAL layer to calculate the light filling intensity corresponding to the light filling effect determined by the user. The HAL layer may also process images acquired by the front-facing camera 193 based on parameters related to the camera service sending image processing services.

Based on the software structure block diagram shown in fig. 12, the following specifically describes the light supplementing method for photographing provided in the embodiment of the present application.

First, the electronic device starts a camera application (or other application that may provide front-end photography). When the touch sensor 180K receives a touch operation, a corresponding hardware interrupt is issued to the kernel layer. The kernel layer processes the touch operation into an original input event (including information such as touch coordinates, time stamp of the touch operation, etc.). The original input event is stored at the kernel layer. The application framework layer acquires an original input event from the kernel layer, and an event manager judges whether the touch coordinate is in the first area. If yes, the control corresponding to the original input event is identified, the touch operation is a touch click operation, the control corresponding to the click operation is a control of a camera application icon, the camera application calls an interface of an application framework layer, the camera application is started, further, a camera driver is started by calling a kernel layer, and a still image or video is captured by a camera 193. The manner in which the camera application is launched may be referred to above in connection with the embodiment of fig. 2A. As shown in fig. 2A, the electronic device can display a control 105D as shown in fig. 2A on a screen for a user to launch a camera application.

In this case, when the electronic apparatus 100 captures a still image or video by the front camera 193, the ambient light sensor 180L is used to acquire the ambient light level at a fixed timing. The application framework layer obtains the above ambient light from the kernel layer and sends it to the camera application. The camera application calls the light filling service of the camera service through the camera API, and the camera service sends the relevant parameters of the light filling service (including the ambient light level) to the HAl layer. HAl layer can call the light supplementing algorithm to determine the optimal light supplementing intensity, 1, 2, 3, etc. of the front shooting of the electronic device 100. The camera application obtains the optimal light compensation intensity, the light compensation intensity 1, the light compensation intensity 2, the light compensation intensity 3 and the like through the application program framework layer.

Then, the electronic device 100 receives a user operation for determining or supplementing the position of the light area on the display screen 194. Referring to fig. 4A to 4C, the above-mentioned user operation may also be that the user slides on the display screen to draw the border of the light-compensating region after clicking the self-setting control 208D. The kernel layer processes the original input event received by the touch sensor 180K and processed by the user operation, and the application framework layer obtains the original input event from the kernel layer and determines the position of the light-compensating region on the display screen 194. In some embodiments, the camera application invokes an interface of the application framework layer, starts the camera service, sends the frame coordinates of the light filling area and the transparency of the light filling layer to the view management system through the camera service, invokes the view management system to draw the shooting interface 11 including the light filling layer, and further invokes the kernel layer to start the display driver, so as to drive the display screen to display the shooting interface 11 including the light filling layer based on the driving current of each pixel in the light filling area. The transparency of the light-filling layer and the driving current (or driving voltage) of each pixel in the light-filling area may be determined by the camera service based on the initial light-filling intensity of the light-filling area. The position of the light-filling area on the display screen 194 is not limited to be determined by the user operation shown in fig. 4A to 4C. The embodiment of the application can also determine the position of the light supplementing area on the display screen 194 through other user operations. The present invention is not particularly limited herein.

Next, the electronic apparatus 100 receives a user operation for determining a light-supplementing effect of the light-supplementing region. For example, referring to fig. 3D and 3E, the user operation may also be clicking on control 301A after the user clicks on beautifying control 209B of shooting interface 11. The kernel layer obtains the original input event processed by the user operation received by the touch sensor 180K from the kernel layer, and determines the light filling effect of the light filling area as a light filling effect 1 (the light filling effect 1 of the light filling area includes the light filling intensity 1 of the light filling area, and may further include the image processing algorithm 2 of the preview picture). The camera service determines the transparency of the light-filling layer based on the light-filling intensity 1 and the driving current of each pixel in the light-filling area. The camera service calls the camera application HAL interface, the HAL layer calls the image processing algorithm 2 to process the image collected by the front camera 193 according to the related parameters (including the identification of the image processing algorithm 2 corresponding to the preview image) sent by the camera service, and sends the processed preview image to the view management system, and the view management system draws the shooting interface 11 including the light supplementing image layer based on the transparency corresponding to the light supplementing intensity 1 sent by the camera service and the preview image processed by the image processing system. The view management system transmits image data of the photographing interface 11 to the kernel layer, and a display driver of the kernel layer displays the photographing interface through a hardware device (e.g., a display screen 194), which may include a preview screen and a light-compensating layer after image processing.

The embodiment of the application also provides a shooting light supplementing method. In the method, the electronic device 100 can intelligently adjust the light supplementing effect of the flash lamp so as to improve the light condition of the shooting environment, meet the shooting requirements of user diversity and effectively promote the shooting experience of the user. The light supplementing method is specifically described below with reference to the accompanying drawings.

In some embodiments, an electronic device receives a first user operation; responding to the first user operation, and starting a shooting function; and displaying a first interface corresponding to the shooting function.

For example, as shown in fig. 2A and 13A, the first user operation may be a user clicking on an icon 105D of the camera on the user interface 10, and the first interface may be the photographing interface 11. The electronic device 100 detects the first user operation, and in response to the first user operation, the electronic device 100 starts a photographing function and displays the photographing interface 11 of the camera.

The photographing interface 11 may include: a shooting control 201, an album control 202, a camera switching control 203, a shooting mode 204, a display area 205 and a set icon 206. Wherein:

the display area 205 may be used to display images captured by a front or rear camera (i.e., a camera currently being used for capturing) of the electronic device 100, which may also be referred to as a preview screen.

For example, as shown in fig. 13A, the photographing interface 11 further includes a light-compensating icon 701, the light-compensating icon 701 may receive a user operation (e.g., a touch operation), and in response to the detected user operation, the electronic device 100 may display one or more light-compensating controls for adjusting a light-compensating mode of the flash. In some embodiments, the camera currently used for shooting by the electronic device 100 may be a rear camera, and the display area 205 is used for displaying an image acquired by the rear camera of the electronic device 100, where the irradiation direction of the flash and the shooting direction of the rear camera are on the same side of the electronic device 100. In some embodiments, the camera currently used for shooting by the electronic device 100 may be a front-facing camera, and the display area 205 is used for displaying an image acquired by the front-facing camera of the electronic device 100, where the irradiation direction of the flash and the shooting direction of the front-facing camera are on the same side of the electronic device 100.

In some embodiments, after the electronic device 100 turns on the image capturing function, the electronic device 100 determines the light supplementing intensity of the flash according to the image brightness of the preview screen; and adjusting the brightness of the flash lamp based on the light supplementing intensity of the flash lamp.

For example, as shown in fig. 13A and 13B, the electronic device 100 may receive an input operation (e.g., a touch operation) acting on the light-compensating icon 701, and in response to the input operation, the electronic device 100 may display the light-compensating mode field 801. The above-described options bar 801 may include an automatic mode control 801A, an off mode control 801B, an on mode control 801C, a normally-on mode control 801D. Wherein,,

for example, as shown in fig. 13C and 13D, in some embodiments, the automatic mode control 801A may receive a user operation (e.g., a touch operation) in response to which the electronic device 100 determines that the light replenishment mode is an automatic mode. In response to the detected user operation, the electronic device 100 may stop displaying the light-compensating mode field 801 and change the display icon of the light-compensating icon 701 to the display icon of the automatic mode control 801A.

After determining that the light supplementing mode is the automatic mode, when the electronic device 100 receives a photographing operation of a user (for example, the user clicks the photographing control 201 of the photographing interface 11), the electronic device 100 collects the first image data with the camera and saves the first image data as a photo in response to the detected user operation, and at the same time, the electronic device 100 determines whether to turn on the flash during the period when the electronic device 100 collects the first image data with the camera according to the ambient light brightness. In some embodiments, when the ambient light level is less than the second threshold, the electronic device 100 turns on the flash during the time that the electronic device 100 is capturing the first image data with the camera, and does not turn on otherwise. It will be appreciated that the electronic device 100 may turn on a flash when ambient light is relatively weak and may not turn on a flash when ambient light is relatively strong. In some embodiments, when the electronic device 100 determines that the flash needs to be turned on, it determines that the light intensity of the flash is a sixth light intensity, and controls the display brightness after the flash is turned on according to the sixth light intensity. The sixth light supplementing intensity may be set by default or set by a user. The sixth light intensity may be an optimal light intensity of the flash, and the optimal light intensity may be determined according to the ambient light intensity. In some embodiments, the sixth supplemental light intensity is determined based on an image brightness of the preview screen. Neither is specifically limited herein. For example, the second threshold is equal to 100.

In some embodiments, the electronic device 100 sets the light filling mode to an automatic mode. Next, after the electronic device 100 starts the image capturing function, when the ambient light brightness is less than the second threshold, the electronic device 100 determines the light supplementing intensity according to the image brightness of the preview screen; and adjusting the brightness of the flash lamp based on the light supplementing intensity.

For example, as shown in fig. 13E and 13F, the off mode control 801B may receive a user operation (e.g., a touch operation), and in response to detecting the user operation, the electronic device 100 determines that the light supplementing mode is the off mode. In some embodiments, in response to the detected user operation, the electronic device 100 may stop displaying the light complement mode bar 801 and change the display icon of the light complement icon 701 to the display icon of the off mode control 801B. After the electronic device 100 determines that the light supplementing mode is the off mode, when the electronic device 100 receives a photographing operation by a user (for example, the user clicks the photographing control 201 of the photographing interface 11), the electronic device 100 does not turn on the flash.

The open mode control 801C may receive a user operation (e.g., a touch operation) and, in response to detecting the user operation, the electronic device 100 determines that the supplemental mode is an open mode. In some embodiments, in response to the detected user operation, the electronic device 100 may stop displaying the light replenishment mode field 801 and change the display icon of the light replenishment icon 701 to the display icon of the on mode control 801C, as illustrated in fig. 13A, for example.

After the electronic device 100 determines that the light supplementing mode is in the on mode, in response to a shooting operation received by the electronic device 100 (for example, the user clicks the shooting control 201 of the shooting interface 11), the electronic device 100 may turn on the flash during the period when the electronic device 100 collects the first image data using the camera. In some embodiments, the electronic device 100 determines the light intensity of the flash to be the sixth light intensity when the flash is turned on, and controls the display brightness when the flash is turned on according to the sixth light intensity. The sixth light supplementing intensity may be set by default or set by a user. The sixth light intensity may be the optimal light intensity of the flash lamp, or may be the maximum light intensity of the flash lamp, and the optimal light intensity may be determined according to the ambient light brightness. In some embodiments, the sixth supplemental light intensity is determined based on an image brightness of the preview screen. Neither is specifically limited herein.

For example, as shown in fig. 14A and 14B, the normally-bright mode control 801D may receive a user operation (e.g., a touch operation), and in response to the detected user operation, the electronic device 100 displays the light-compensating effect bar 802. The light replenishment effect bar 802 may include a maximum control 802A, a beautification total control 802B, and a self-tuning control 802C.

The maximum control 802A may receive a user operation (e.g., a touch operation), and in response to the detected user operation, the electronic device 100 adjusts the light filling effect of the preview screen on the display screen to be the maximum light filling effect.

Referring to fig. 14B and 14C, the beautification total control 802B may receive a user operation (e.g., a touch operation), and in response to the detected user operation, the electronic device 100 displays the beautification control bar 803. The beautification control column 803 may include beautification controls 803A, 803B, 803C. Wherein:

the beautifying control 803A may receive a user operation (e.g., a touch operation), and in response to the detected user operation, the electronic apparatus 100 adjusts the light compensating effect of the preview screen to be light compensating effect 1.

The beautifying control 803B may receive a user operation (e.g., a touch operation), and in response to the detected user operation, the electronic device 100 adjusts the light compensating effect of the preview screen to be light compensating effect 2.

The beautifying control 803C may receive a user operation (e.g., a touch operation), and in response to the detected user operation, the electronic apparatus 100 adjusts the light compensating effect of the preview screen to be light compensating effect 3.

In embodiments of the present application, the aesthetic total control 802B may be referred to as a second control.

The light-compensating intensities of the flash lamps corresponding to the light-compensating effect 1, the light-compensating effect 2, and the light-compensating effect 3 may be the same or different. In some embodiments, the light-compensating effects corresponding to the beautifying controls 803A, 803B, 803C may further include different image processing algorithms, that is, the light-compensating effects corresponding to the beautifying controls may have different emphasis on the image processing of the preview screen. Not limited to the beautifying

control

803A, 803B and 803C, the beautifying control bar 803 may also include other beautifying controls, bringing about image processing with different emphasis points. The image processing algorithm may be an image enhancement algorithm, a filtering algorithm, a color optimization algorithm, a sharpening algorithm, or the like.

In some embodiments, the electronic device receives a seventh user operation; in response to the received seventh user operation, the electronic device determines the light supplementing intensity according to the image brightness of the preview screen.

In some embodiments, the maximum control 802A, the beautification control 803B, and the beautification control 803C include a third selection control and a fourth selection control, the third selection control corresponding to the first supplemental light intensity, the fourth selection control corresponding to the second supplemental light intensity. And the electronic equipment receives a seventh user operation acting on the third selection control, and determines the first light supplementing intensity corresponding to the third selection control according to the image brightness of the preview picture in response to the received seventh user operation.

In some embodiments, the maximum control 802A, the beautification control 803B, and the beautification control 803C include a third selection control and a fourth selection control, the third selection control corresponding to the first supplemental light intensity and the third image processing algorithm, the fourth selection control corresponding to the second supplemental light intensity and the fourth image processing algorithm. And the electronic equipment receives a seventh user operation acting on the third selection control, responds to the received seventh user operation, determines the first light supplementing intensity corresponding to the third selection control according to the image brightness of the preview picture, and performs image processing on the preview picture acquired by the camera by using a third image processing algorithm.

In some embodiments, before the shooting interface displays the third selection control, the electronic device 100 also displays a second control at the shooting interface; the electronic device 100 receives an eighth user operation on the second control; in response to an eighth user operation, a third selection control is displayed on the first interface. Wherein the third selection control may be the maximum control 802A, the second control may be the normally-bright mode control 801D shown in fig. 14A, and the eighth operation may be a user operation on the normally-bright mode control 801D shown in fig. 14A; alternatively, the third selection control may be the beautification control 803A, the second control may be the beautification total control 802B shown in FIG. 14B, and the eighth operation may be a user operation on the beautification total control 802B shown in FIG. 14B.

14C and 14D, in some embodiments, in response to a user operation on a beautification control (

beautification control

803A, 803B, or 803C), the electronic device 100 ceases to display the light-up mode bar 801 and the light-up effect bar 802 and modifies the icon of the light-up icon 701 to be that of the normally-bright mode control 801D.

Referring to fig. 15A and 15B, self-adjustment control 802C may receive a user operation (e.g., a touch operation), and in response to the detected user operation, electronic device 100 displays brightness adjustment bar 804. The total length of the brightness adjustment bar 804 is used to represent the maximum light intensity of the flash of the electronic device 100, and the length of the shaded portion in the brightness adjustment bar 804 is used to represent the current light intensity of the flash. The initial length of the shaded portion in the brightness adjustment bar 804 may be the optimal light intensity, or may be another default initial value, which is not particularly limited herein. In some embodiments, electronic device 100 can also image optimize the preview screen using a particular image processing algorithm in response to user operation on self-adjusting control 802C.

In some embodiments, the electronic device includes a plurality of flash lamps. Self-adjustment control 802C may receive a user operation (e.g., a touch operation), and in response to detecting the user operation, electronic device 100 displays a brightness adjustment bar corresponding to each of the plurality of flash lights. For example, the electronic apparatus includes 2 flash lamps, and as shown in fig. 15C, in response to the detected user operation described above, the electronic apparatus 100 displays a brightness adjustment bar 804A corresponding to flash lamp 1, and a brightness adjustment bar 804B corresponding to flash lamp 2.

For example, as shown in fig. 15D and 15E, the brightness adjustment bar 804B may receive a user operation, and in response to the detected user operation, the electronic device 100 may adjust the length of the shadow portion of the brightness adjustment bar 804B, and simultaneously adjust the display brightness of the flash 2 according to the intensity of the light supplement that characterizes the length of the shadow portion. As shown in the figure, the user operation may be such that the finger of the user slides on the brightness adjustment bar 804B with the hatched portion of the brightness adjustment bar 804B as the starting point. In some embodiments, in response to the user operation described above, the minimum magnitude of the supplemental light intensity that can be adjusted by the electronic device 100 by adjusting the brightness adjustment bar 804B may be set by the electronic device 100 by default or may be set by the user. For example, the light intensity of the electronic device 100 ranges from 0 to 10, and the minimum amplitude is 1.

For example, as shown in fig. 15F and 15G, after the brightness adjustment bar 804B is adjusted by the user, the light filling icon 701 may receive a user operation, and in response to the above user operation, the electronic device 100 stops displaying the light filling mode bar 801, the light filling effect bar 802, and the brightness adjustment bar 804B, and modifies the icon of the light filling icon 701 to be the icon of the normally-bright mode control 801D.

It will be appreciated that after determining that the light replenishment mode is the normally on mode by the maximum control 802A, the beautification total control 802B, or the self-adjustment control 802C, the flash of the electronic device 100 may remain on until a user operation for turning off the flash is received, or the electronic device 100 turns off the flash when exiting the current camera application.

The following describes how to adjust the light-compensating effect of the preview screen.

1. The electronic device 100 adjusts the light filling effect of the preview screen on the display screen to be the maximum light filling effect.

In some embodiments, the electronic device 100 includes M flash lamps, adjusts the light compensating effect of the preview screen on the display screen to be the maximum light compensating effect, i.e. turns on the flash lamps, and adjusts the light compensating intensity of the M flash lamps of the electronic device 100 to be the maximum light compensating intensity according to the ambient light brightness. Wherein M is a positive integer greater than 0.

In other embodiments, the light compensation effect of the preview screen on the display screen is adjusted to be the maximum light compensation effect, i.e. the flash is turned on, the light compensation intensities of the M flash lamps of the electronic device 100 are adjusted to be the maximum light compensation intensity according to the ambient light brightness, and the preview screen displayed in the display area 205 is optimally optimized by using the image processing algorithm 1. The image processing algorithm 1 may include processes such as enhancement, filtering, color optimization, sharpening, etc. of the image. The image processing algorithm 1 is not limited to the above-mentioned image processing algorithms such as enhancement, filtering, color optimization, sharpening, etc., and may also be integrated with other image processing algorithms, which are not particularly limited herein.

In some embodiments, the ambient light sensor 180L obtains the ambient light level, and when the ambient light level is less than the second threshold, the electronic device 100 adjusts the light filling effect of the preview screen on the display screen to be the maximum light filling effect. It is understood that the electronic device 100 supplements light with a flash during the time when the electronic device 100 displays the photographing interface 11 when the ambient light is dark to the second threshold.

The following describes how to determine the optimal light intensity of the M flash lamps.

In some embodiments, electronic device 100 determines the third supplemental light intensity based on the ambient light level. Specifically, the electronic device 100 obtains the ambient light level G2 according to the ambient light sensor 180L, and determines the optimal light-compensating intensity of the M flash lamps according to the ambient light level G2, the light-sensing range of the ambient light sensor 180L (i.e., 0 to the maximum light-sensing value G1), and the light-compensating range of the electronic device 100 (i.e., 0 to the maximum light-compensating intensity B1). For example, if the maximum light sensing value G1 of the electronic device 100 is 1000, the maximum light compensating intensity B1 is 10, and the current ambient light intensity G2 obtained by the ambient light sensor 180L of the electronic device 100 is 50, the electronic device 100 determines that the third light compensating intensity B2 is (1-G1/G2) ×b1, i.e. 9.5. The electronic device 100 determines that the optimal light intensity of each of the M flashlamps is the third light intensity B2.

In some embodiments, the electronic device 100 divides the display area 205 into M areas according to the distribution positions of M flash lamps on the electronic device, where the M flash lamps are in one-to-one correspondence with the M areas. It will be appreciated that the first of the M flashlights corresponds to a first of the M regions, and that the first flashlight is more focused on supplementing the first region due to the location distribution of the first flashlight. Any two areas of the M areas may or may not overlap, which is not specifically limited herein.

Illustratively, M is equal to 2, and the distribution positions of the 2 flashlights of the electronic device 100 are shown in fig. 1C. As shown in fig. 16A, the electronic apparatus 100 divides the display area 205 into the area 1 and the area 2 according to the distribution positions of the above 2 flash lamps. Illustratively, M is equal to 3, and the distribution positions of the 3 flashlights of the electronic device 100 are shown in fig. 1D. As shown in fig. 16B, the electronic apparatus 100 divides the display area 205 into area 1, area 2, and area 3 according to the distribution positions of the above 3 flash lamps. Illustratively, M is equal to 4, and the distribution positions of the 4 flashlights of the electronic device 100 are shown in fig. 1E. As shown in fig. 16C, the electronic apparatus 100 divides the display area 205 into area 1, area 2, area 3, and area 4 according to the distribution positions of the above 4 flash lamps. It will be appreciated that fig. 16A to 16C are only exemplary descriptions of M areas corresponding to the M flashlights, and that the display area 205 may be divided into M areas in other manners with the same number of flashlights, which is not specifically limited herein.

It will be appreciated that the user may be able to locate the target object in different orientations of the electronic device 100 during shooting, and the target object in the preview screen may be located in a part of the M regions. Depending on the position of the target object in the preview screen, the electronic device 100 may emphasize the light supplement to the target object with a flash that irradiates the target object.

In some embodiments, the electronic device 100 obtains the ambient light level according to the ambient light sensor 180L, and determines the fifth light filling level according to the ambient light level, the light sensing range of the ambient light sensor 180L, and the light filling range of the electronic device 100. Meanwhile, the electronic device 100 determines a target object according to the image data collected by the camera, and an area occupied by each of the M regions by the target image, and determines optimal light-compensating intensities of the M flash lamps corresponding to the M regions respectively according to the fifth light-compensating intensity and the area occupied by each of the M regions by the target image. In one embodiment, the electronic device 100 determines that the optimal light intensity of the flash corresponding to the area with the largest occupied area of the target image is the fifth light intensity plus the first value; determining the optimal light supplementing intensity of the flash lamp corresponding to the area with the non-maximum occupied area of the target image and not equal to zero as fifth light supplementing intensity; and determining the optimal light supplementing intensity of the flash lamp corresponding to the area with the occupied area equal to zero of the target image as a fifth light supplementing intensity minus the first value. For example, the first value is equal to 1.

For example, as shown in fig. 17A, M is equal to 2, the electronic device 100 recognizes the target object as a person in the selection box, and determines that the target object is all located in the area 1, that is, the area of the target image in the area 1 is larger than the area of the target image in the area 2, and the area of the target image in the area 2 is zero. The electronic device 100 determines that the optimal light intensity of the flash lamp 1 corresponding to the area 1 is the fifth light intensity plus the first value, and the optimal light intensity of the flash lamp 2 corresponding to the area 2 is the fifth light intensity minus the first value.

For example, as shown in fig. 17B, M is equal to 3, the electronic device 100 recognizes the target object as a person in the box, and determines that the area of the target image in the region 2 is larger than the area of the target image in the region 1, and the areas of the target image in the

regions

1 and 2 are not equal to zero, and the area in the region 3 is zero. The electronic device 100 determines that the optimal light intensity of the flash lamp 2 corresponding to the area 2 is the fifth light intensity plus the first value, the optimal light intensity of the flash lamp 1 corresponding to the area 1 is the fifth light intensity, and the optimal light intensity of the flash lamp 3 corresponding to the area 3 is the fifth light intensity minus the first value.

For example, as shown in fig. 17C, M is equal to 4, the electronic device 100 recognizes the target object as a person in the box, and determines that the area of the target image in the region 2 is larger than the area of the target image in the region 3, and the areas of the target image in the

regions

2 and 3 are not equal to zero, and the areas in the

regions

1 and 4 are zero. The electronic device 100 determines that the optimal light-compensating intensity of the flash lamp 2 corresponding to the area 2 is the fifth light-compensating intensity plus the first value, the optimal light-compensating intensity of the flash lamp 3 corresponding to the area 3 is the fifth light-compensating intensity, and the optimal light-compensating intensities of the flash lamp 1 corresponding to the area 1 and the flash lamp 4 corresponding to the area 4 are the fifth light-compensating intensity minus the first value.

In one shooting scenario, as illustrated in fig. 18A, an exemplary user shoots indoors, a window is provided on a wall of the room, the indoor light is darker, and the light outside the window is brighter. The electronic device 100 determines that the ambient light level is relatively small through the ambient light sensor 180L, but the image brightness of the area where the window is located in the preview screen of the electronic device 100 is relatively high, and the image brightness of the area outside the window is relatively small. Therefore, the preview screen is supplemented with light according to the fifth light supplementing intensity determined by the ambient light brightness, which may cause overexposure to the area where the window is located. In another photographing scene, as shown in fig. 18B, a user photographs indoors, a window is provided on a wall of a room, indoor light is brighter, and light outside the window is darker. The electronic device 100 determines that the ambient light level is relatively high through the ambient light sensor 180L, but the image brightness of the area where the window is located in the preview screen of the electronic device 100 is relatively low, and the image brightness of the area outside the window is relatively high. Therefore, the preview screen is supplemented with the fifth light supplementing intensity, and the light supplementing intensities of the M flash lamps are smaller and even equal to zero, so that the area where the window is located cannot be properly supplemented with light. It will be appreciated that in some embodiments, ambient light sensor 180L measures ambient light level near electronic device 100 that does not truly reflect the ambient light level of the region within the viewfinder (the region corresponding to the preview screen) where the viewfinder is located.

In some embodiments, the electronic device 100 obtains the ambient light level according to the ambient light sensor 180L, and determines the third light compensation intensity according to the ambient light level. Meanwhile, the electronic device 100 collects image data according to the camera, determines the image brightness of the preview screen in each of the M regions through image analysis, and determines the fourth light supplementing intensity of each region according to the image brightness of each region. Then, when the difference between the fourth light intensity and the third light intensity in the first area of the M areas is greater than the first threshold, the electronic device 100 determines that the optimal light intensity in the first area is the fourth light intensity corresponding to the area; otherwise, the electronic device 100 determines the optimal light intensity of the first area as the third light intensity; the electronic device 100 may store a correspondence between the image brightness and the fourth light intensity.

In one implementation, the third supplemental light intensity is equal to the fifth supplemental light intensity. In another implementation, the third light intensity is determined based on the fifth light intensity and an area occupied by each of the M regions of the target image. In particular, reference may be made to the related embodiments of fig. 17A to 17C.

For example, as shown in fig. 19A, M is equal to 2, after the electronic device 100 determines that the difference between the fourth and third light intensities of the area 1 is greater than the first threshold, and the difference between the fourth and third light intensities of the area 2 is less than or equal to the first threshold, the electronic device 100 determines that the optimal light intensity of the flash lamp 1 corresponding to the area 1 is the fourth light intensity of the area 1, and the optimal light intensity of the flash lamp 2 corresponding to the area 2 is the third light intensity.

For example, as shown in fig. 19B, M is equal to 3, after the electronic device 100 determines that the difference between the fourth and third light intensities of the area 1 and the area 2 is greater than the first threshold, and the difference between the fourth and third light intensities of the area 3 is less than or equal to the first threshold, the electronic device 100 determines that the optimal light intensity of the flash lamp 1 corresponding to the area 1 is the fourth light intensity of the area 1, the optimal light intensity of the flash lamp 2 corresponding to the area 2 is the fourth light intensity of the area 2, and the optimal light intensity of the flash lamp 3 corresponding to the area 3 is the third light intensity.

For example, as shown in fig. 19C, M is equal to 4, after the electronic device 100 determines that the difference between the fourth and third light intensities of the area 1 and the area 2 is greater than the first threshold, and the difference between the fourth and third light intensities of the area 3 and the area 4 is less than or equal to the first threshold, the electronic device 100 determines that the optimal light intensity of the flash lamp 1 corresponding to the area 1 is the fourth light intensity of the area 1, the optimal light intensity of the flash lamp 2 corresponding to the area 2 is the fourth light intensity of the area 2, and the optimal light intensity of the flash lamp corresponding to the area 3 and the area 4 is the third light intensity.

It should be noted that, the brightness attribute corresponding to each pixel in the image is irrelevant to the color, and the value range of the brightness attribute may be 0 to 255. Wherein the brightness of the pixels near 255 is higher and the brightness near 0 is lower. The luminance attribute of each pixel may be reflected in the HSV (Hue, saturation, value, hue, saturation, luminance) color space of the image, which uses an HSV model in which color parameters in each pixel in the recorded image include hue, saturation, luminance. In some embodiments, the electronic device 100 may convert the preview screen from the RGB (Red, green, blue, red, green, blue) color space to the HSV color space, and may obtain the brightness parameter of each pixel in the preview screen in the HSV color space, and further determine the image brightness of each of the M regions according to the brightness parameter of each pixel in the region. In addition to the above-described manner of determining the image brightness of each region, the image brightness of each region may be determined by other manners, which are not particularly limited herein.

In some embodiments, the electronic device 100 obtains the ambient light level according to the ambient light sensor 180L, and determines the optimal light compensating intensities of the M flash lamps according to the ambient light level, the light sensing range of the ambient light sensor 180L, the light compensating range of the electronic device 100, and the exposure value when the camera 193 shoots.

In some embodiments, the electronic device 100 obtains the ambient light level according to the ambient light sensor 180L, and determines the third light supplementing intensity according to the ambient light level, the light sensing range of the ambient light sensor 180L, and the light supplementing range of the electronic device 100. Meanwhile, the electronic device 100 determines a target object according to the image data collected by the camera, and the area occupied by each of the M areas by the target image, and determines the optimal light-compensating intensity of the M flash lamps corresponding to each of the M areas according to the third light-compensating intensity, the area occupied by each of the M areas by the target image, and the image brightness of the preview screen in each of the M areas. In one embodiment, the electronic device 100 determines that the eighth light intensity of the flash corresponding to the area with the largest occupied area of the target image is the third light intensity plus the first value; determining the eighth light supplementing intensity of the flash lamp corresponding to the area with the non-maximum occupied area of the target image and not equal to zero as the third light supplementing intensity; and determining the eighth light supplementing intensity of the flash lamp corresponding to the area with the occupied area equal to zero of the target image as the third light supplementing intensity minus the first value. Then, the electronic device determines the fourth light intensity of each region according to the image brightness of each region, and when the difference value between the fourth light intensity and the eighth light intensity of the first region in the M regions is greater than a first threshold value, the electronic device 100 determines that the optimal light intensity of the first region is the fourth light intensity corresponding to the region; otherwise, the electronic device 100 determines that the optimal light intensity of the first area is the eighth light intensity; the electronic device 100 may store a correspondence between the image brightness and the fourth light intensity.

2. The electronic device 100 adjusts the light-compensating effect of the preview screen on the display screen to the light-compensating effect corresponding to the beautifying control.

In some embodiments, the light compensation effect of the preview screen is adjusted to be light compensation effect 1, i.e. the flash is turned on, and the light compensation intensity of each flash in the M flashes is adjusted to be light compensation intensity 1 according to the ambient light. In other embodiments, the light filling effect of the preview screen is adjusted to be the light filling effect 1, that is, the flash is turned on, the light filling intensity of each flash of the M flash is adjusted to be the light filling intensity 1 according to the ambient light brightness, and the preview screen displayed in the display area 205 is image-processed by using the image processing algorithm 2, where the image processing algorithm 2 may include one of an enhancement algorithm, a filtering algorithm, a color optimization algorithm, a sharpening algorithm, and other image processing algorithms, for example, an image enhancement algorithm.

In some embodiments, the light compensation effect of the preview screen is adjusted to be the light compensation effect 2, i.e. the flash is turned on, and the light compensation intensity of each flash in the M flashes is adjusted to be the light compensation intensity 2 according to the ambient light brightness. In other embodiments, the light supplementing effect of the preview screen is adjusted to be the light supplementing effect 2, that is, the flash is turned on, the light supplementing intensity of each flash in the M flash is adjusted to be the light supplementing intensity 2 according to the ambient light brightness, and the image processing algorithm 3 is used to perform image processing on the preview screen displayed in the display area 205, where the image processing algorithm 3 may include one of an enhancement algorithm, a filtering algorithm, a color optimization algorithm, a sharpening algorithm, and other image processing algorithms, for example, a filtering algorithm of an image.

In some embodiments, the light compensation effect of the preview screen is adjusted to be light compensation effect 3, i.e. the flash is turned on, and the light compensation intensity of each flash in the M flashes is adjusted to be light compensation intensity 3 according to the ambient light brightness. In other embodiments, the light supplementing effect of the preview screen is adjusted to be the light supplementing effect 3, that is, the flash is turned on, the light supplementing intensity of each flash in the M flash is adjusted to be the light supplementing intensity 3 according to the ambient light brightness, and the image processing algorithm 4 is used to perform image processing on the preview screen displayed in the display area 205, where the image processing algorithm 4 may include one of an enhancement algorithm, a filtering algorithm, a color optimization algorithm, a sharpening algorithm, and other image processing algorithms, for example, a color optimization algorithm of an image.

The light-compensating intensities of the flash lamps corresponding to different light-compensating effects may be the same or different. The light supplementing effect of different beautifying controls corresponds to different image processing algorithms with different emphasis points. In some embodiments, the electronic device 100 stores a correspondence relationship between the light intensity of the flash and the driving current of the flash. The electronic device 100 may determine the driving current of the flash through the intensity of the supplemental light of the flash.

The following describes how to determine the light-compensating effect corresponding to the beautifying control, where the light-compensating effect corresponding to the beautifying control includes the light-compensating intensity of the light-compensating area 211 and the image processing algorithm of the preview picture.

In some embodiments, the image processing algorithm 2, the image processing algorithm 3, and the image processing algorithm 4 are different, and the three image processing algorithms may include one of an enhancement algorithm, a filtering algorithm, a color optimization algorithm, a sharpening algorithm, and the like. The electronic device 100 determines that the light intensity 1, the light intensity 2, and the light intensity 3 of each flash are all equal to the optimal light intensity of the flash. For how to determine the optimal light intensity of each flash of the electronic device 100, reference may be made to the foregoing embodiments, which are not described herein.

In some embodiments, after determining the image processing algorithm 2, the image processing algorithm 3, and the image processing algorithm 4, the electronic device 100 determines the light intensity corresponding to the light filling effect according to the image processing algorithm corresponding to the light filling effect. For example, the image processing algorithm 2 corresponding to the beautification control 801A is color optimized. The color optimization is affected by the excessively strong ambient light, if the optimal light supplementing intensity of the flash lamp 1 is greater than a first preset value, the light supplementing intensity 1 corresponding to the light supplementing effect 1 of the flash lamp 1 is equal to the optimal light supplementing intensity minus a preset difference value, otherwise, the light supplementing intensity is equal to the optimal light supplementing intensity.

In some embodiments, electronic device 100 determines the light intensity of the

flash

1, 2, and 3 according to the optimal light intensity of the flash. When the optimal light-compensating intensity B2 is greater than B1-x, determining that the light-compensating intensity 1 of the flash lamp is equal to B2-x, the light-compensating intensity 2 is equal to B2-2*x, and the light-compensating intensity 3 is equal to B2-3*x, wherein x is a preset difference value. If the optimal light supplementing intensity B2 is smaller than B1-x and larger than or equal to B1-2*x, determining that the light supplementing intensity 1 of the flash lamp is equal to B2+x, the light supplementing intensity 2 is equal to B2-x, and the light supplementing intensity 3 is equal to B2-2*x. If the optimal light-compensating intensity B2 is smaller than B1-2*x and larger than or equal to B1-3*x, determining that the light-compensating intensity 1 of the flash lamp is equal to B2+2*x, the light-compensating intensity 2 is equal to B2+x, and the light-compensating intensity 3 is equal to B2-x. Then, the electronic device 100 determines the image processing algorithm corresponding to the light intensity of the different light compensating effects according to the average value of the light intensity 1, the average value of the light intensity 2 and the average value of the light intensity 3 of each flash. For example, the average value of the light intensity 1 of each flash is larger than the average value of the light intensity 2, and the average value of the light intensity 2 of each flash is larger than the average value of the light intensity 3. Then, the electronic device 100 determines that the image processing algorithm corresponding to the stronger light supplementing intensity 1 is a sharpening algorithm, because sufficient light is beneficial to improving the sharpening effect of the preview picture; the image processing algorithm corresponding to the moderate light supplementing intensity 2 is a color optimization algorithm, and is relatively unfavorable for the color optimization algorithm due to exposure caused by the excessively bright image and darkness caused by the excessively dark image; the image processing algorithm corresponding to the smaller light supplementing intensity 3 is an enhancement algorithm, and the image enhancement algorithm can effectively optimize the quality of the preview picture under the condition of insufficient light, so that the preview picture with dim light is clearer.

In some embodiments, as shown in fig. 1E, the electronic device includes 4 flash lamps, and the electronic device 100 can create different light-compensating effects by adjusting the light-compensating intensity of the flash lamps, for example, the light-compensating effect corresponding to the light-compensating effect 1 is morning light, the light-compensating effect corresponding to the light-compensating effect 2 is sunset light, and the light-compensating effect corresponding to the light-compensating effect 3 is lateral light. In one embodiment, the light-compensating intensity 1 of the flash 1 corresponding to the light-compensating effect 1 (morning light) is the maximum light-compensating intensity, and the light-compensating intensities 1 of the flash 2, the flash 3, and the flash 4 are all equal to the second value; the light supplementing intensity 2 of the flash lamp 3 corresponding to the light supplementing effect 2 (sunset) is the maximum light supplementing intensity, and the light supplementing intensities 2 of the flash lamp 1, the flash lamp 2 and the flash lamp 4 are all equal to a second value; the light-supplementing intensity 3 of the flash 2 and the flash 4 corresponding to the light-supplementing effect 3 (lateral light) is the maximum light-supplementing intensity, and the light-supplementing intensities 3 of the flash 1, the flash 2 and the flash 4 are all equal to the second value. Wherein the second value is equal to zero or less of the intensity of the supplemental light (e.g., 1). Further, in the above-described embodiment, the light-supplementing effect 1, the light-supplementing effect 2, and the light-supplementing effect 3 may perform image processing on the preview screen using the same image processing algorithm 1; alternatively, the preview screen may be image-processed using image processing algorithms of different emphasis points.

In this embodiment of the present application, the method for determining the light supplementing effect corresponding to the beautifying control is not limited to the above method, and other methods may be used, which are not specifically limited herein. For example, in some embodiments, the flash may emit different colors of light, and by adjusting the color and the light intensity of the flash, different light compensation effects may be created.

It should be noted that, when the front layout of the electronic device 100 has the flash 196 (i.e., the flash irradiation direction and the front camera shooting direction are on the same side of the electronic device 100), the light supplementing method of shooting as set forth in the related embodiments of fig. 13A to 19C may also be used to control the flash 196 of the front layout to adjust the light supplementing effect of front shooting in any shooting mode. And will not be described in detail herein.

In some embodiments of the present application, the light-compensating icon 207 shown in fig. 2B and the light-compensating icon 701 shown in fig. 13A may be displayed on the photographing interface 11 at the same time. The user can trigger the electronic device to perform light filling through the light filling layer on the display screen through the light filling icon 207 (refer to fig. 2A to 9I), and at the same time, can trigger the electronic device to perform light filling through the flash through the light filling icon 701 (refer to fig. 13A to 19C).

Referring to fig. 20, fig. 20 shows a software architecture block diagram of another electronic device exemplarily provided in an embodiment of the present application. The electronic device 100 may display a light-compensating control on the shooting interface, and determine the light-compensating intensity of the flash lamp of the electronic device 100 by receiving the user operation acting on the light-compensating control, so as to improve the light condition of the shooting environment, effectively improve the image quality of front shooting, and improve the shooting experience of the user.

As shown in fig. 20, the layered architecture divides the software into several layers, each with a clear role and division of work. The layers communicate with each other through a software interface. In some embodiments, the Android system may be divided from top to bottom into an application layer, an application framework layer, a hardware abstraction layer (hardware abstraction layer, HAL) layer, and a kernel layer (kernel). Wherein:

as shown in fig. 20, the application framework layer may mainly include APIs and System services (System servers). Wherein the API is used for realizing communication between the application program layer and the HAL layer and between the application program layer and the kernel layer. For example, the camera API may provide communication between the camera application and the HAL layer, the kernel layer, and so on. The system services may include camera services and view management systems. The camera service may include a light supplementing service, an image processing service, and the like. The electronic device 100 may call a corresponding camera service by calling a camera API, and the camera service may send relevant parameters of the camera service to the HAL layer by calling the HAL interface of the camera. For example, the camera API calls the light filling service or the image processing service, and sends related parameters of the light filling service (such as driving current corresponding to the light value of each flash lamp) and related parameters of the image processing service (including image optimization, target object identification and the like) to the HAL layer and the kernel layer, so that the HAL layer and the kernel layer execute corresponding operations according to the related parameters.

The HAL layer and the kernel layer are used for responding to the functions called by the system service in the application program framework layer to execute corresponding operations. The kernel layer is a layer between hardware and software. The kernel layer may contain camera drivers and display areas, and may also include audio drivers, sensor drivers, and the like. The display driver of the kernel layer displays the photographing interface 11 through a hardware device (e.g., a display screen 194), and the light supplementing effect can be exhibited through the photographing interface 11. In some embodiments, the camera service timing sends the relevant parameters of the light-compensating service (including the ambient light level, etc.) to the HAL layer by calling the camera HAl interface, the HAL layer calls the light-compensating algorithm to determine the optimal light-compensating intensity, the light-compensating intensity 1, the light-compensating intensity 2, the light-compensating intensity 3, etc. of the electronic device 100 in real time, and the HAL layer may also send the above-mentioned optimal light-compensating intensity, the light-compensating intensity 1, the light-compensating intensity 2, the light-compensating intensity 3, etc. to the camera application by applying the frame layer. In some embodiments, when the electronic device receives a user operation to determine a light filling effect, the camera service invokes the HAL layer to calculate a light filling intensity corresponding to the light filling effect determined by the user.

Based on the software configuration block diagram shown in fig. 20, the light supplementing method for front-end shooting provided in the embodiment of the present application is specifically described below in the following exemplary manner.

First, the electronic device starts a camera application (or other application that may provide front-end photography). When the touch sensor 180K receives a touch operation, a corresponding hardware interrupt is issued to the kernel layer. The kernel layer processes the touch operation into an original input event (including information such as touch coordinates, time stamp of the touch operation, etc.). The original input event is stored at the kernel layer. The application framework layer acquires the original input event from the kernel layer, and the event manager judges whether the touch coordinate is in a specific area. If yes, the control corresponding to the original input event is identified, the touch operation is a touch click operation, the control corresponding to the click operation is a control of a camera application icon, the camera application calls an interface of an application framework layer, the camera application is started, further, a camera driver is started by calling a kernel layer, and a still image or video is captured by a camera 193. The manner in which the camera application is launched may be referred to above in connection with the embodiment of fig. 2A. As shown in fig. 2A, the electronic device can display a control 105D as shown in fig. 2A on a screen for a user to launch a camera application.

In this case, when the electronic apparatus 100 captures a still image or video by the front camera 193, the ambient light sensor 180L is used to acquire the ambient light level at a fixed timing. The application framework layer obtains the above ambient light from the kernel layer and sends it to the camera application. The camera application calls the light filling service of the camera service through the camera API, and the camera service sends the relevant parameters of the light filling service (including the ambient light level) to the HAl layer. HAl layer invokes the light-compensating algorithm to determine the optimal light-compensating intensity, 1, 2, 3, etc. of each of the M flash lamps when the electronic device 100 shoots according to the related parameters of the light-compensating service. The camera application obtains the optimal light compensation intensity, the light compensation intensity 1, the light compensation intensity 2, the light compensation intensity 3 and the like through the application program framework layer. In other embodiments, the camera service may send the relevant parameters of the light filling service and the image data of the preview screen to the HAl layer, and the HAl layer invokes an image recognition algorithm according to the image data of the preview screen, identifies the target object, invokes the light filling algorithm, and determines, according to the area of each of the M regions of the display area 205 of the target object in the preview screen and the relevant parameters of the light filling service, the optimal light filling intensity, the light filling intensity 1, the light filling intensity 2, and the light filling intensity 3 of each of the M flash lamps when the electronic device 100 photographs. In other embodiments, the camera service may send the relevant parameters of the light filling service and the image data of the preview screen to the HAl layer, and the HAl layer invokes an image processing algorithm according to the image data of the preview screen to determine the image brightness of the preview screen in the M regions, and then invokes the light filling algorithm to determine the optimal light filling intensity, the light filling intensity 1, the light filling intensity 2 and the light filling intensity 3 of each of the M flash lamps when the electronic device 100 photographs according to the image brightness of the M regions and the relevant parameters of the light filling service.

Then, the electronic apparatus 100 receives a user operation for determining the light supplement effect of the preview screen, and the electronic apparatus 100 receives a user operation. For example, referring to fig. 14B and 14C, the user operation may also be clicking on the control 803A (or the control 803B, 803C) after the user clicks on the beautifying total control 802B of the photographing interface 11. The kernel layer obtains the original input event processed by the user operation received by the touch sensor 180K from the kernel layer, and determines the light filling effect of the preview screen (the light filling effect of the preview screen includes the light filling of each flash lamp and may also include an image processing algorithm corresponding to the preview screen). The camera application invokes an interface of the application framework layer, launching camera services (including light filling services and image processing services). The camera service calls a camera application HAL interface, and the HAL layer calls a kernel layer to start a flash lamp to drive according to related parameters (including driving current corresponding to the light supplementing intensity of each flash lamp and identification of an image processing algorithm corresponding to a preview picture) sent by the camera service, so that each flash lamp is driven to adjust the display brightness of the flash lamp according to the driving current of the flash lamp. In addition, the HAL layer may also call an image processing algorithm corresponding to the identifier of the above image processing algorithm to perform image processing on the preview screen acquired by the camera 193. And then, the HAL layer sends the processed data to the kernel layer, and the kernel layer is called to start a display driver to drive the display screen to display the processed preview picture, so that the light supplementing effect can be displayed through the preview picture. The light supplement effect of the preview screen is not limited to be determined by receiving the above-described user operation through the display screen 194. The embodiment of the present application may also determine the light supplementing effect of the preview screen through other user operations, which is not specifically limited herein.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present application, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk), etc.

Those of ordinary skill in the art will appreciate that implementing all or part of the above-described method embodiments may be accomplished by a computer program to instruct related hardware, the program may be stored in a computer readable storage medium, and the program may include the above-described method embodiments when executed. And the aforementioned storage medium includes: ROM or random access memory RAM, magnetic or optical disk, etc.

Claims

1. The utility model provides a light filling method of shooting, characterized in that is applied to electronic equipment, electronic equipment includes M flash light, M is positive integer, the direction of illumination of M flash light and the direction of shooting of the camera of electronic equipment are in the same side of electronic equipment, the method includes:

the electronic equipment receives a first user operation;

responding to the first user operation, and starting a shooting function;

displaying a first interface corresponding to the shooting function, wherein the first interface comprises a preview picture and a control acquired by the camera;

in a first light supplementing mode, the electronic equipment displays a third selection control and a fourth selection control on the first interface, wherein the third selection control corresponds to a first light supplementing intensity and a third image processing algorithm; the fourth selection control corresponds to a second light supplementing intensity and a fourth image processing algorithm, and the third selection control and the fourth selection control are used for indicating different light supplementing effects;

The electronic equipment receives a seventh user operation acting on the third selection control;

responding to the received seventh user operation, determining the first light supplementing intensity corresponding to the third selection control based on the image brightness of the preview picture, and determining the first light supplementing intensity corresponding to the third selection control as the light supplementing intensity of the flash lamp;

and the electronic equipment adjusts the brightness of the flash lamp based on the light supplementing intensity of the flash lamp, and performs image processing on the preview picture acquired by the camera by utilizing the third image processing algorithm.

2. The method of claim 1, wherein the first interface comprises M regions, the M regions being determined based on positions of the M flashlights on the electronic device, the M flashlights being in one-to-one correspondence with the M regions, the first supplemental light intensity comprising supplemental light intensities respectively corresponding to the M flashlights; the determining the first light supplementing intensity corresponding to the third selection control based on the image brightness of the preview picture, and determining the first light supplementing intensity corresponding to the third selection control as the light supplementing intensity of the flash lamp specifically includes:

The electronic device determines a third supplemental light intensity based on ambient light level;

the electronic device determines fourth light supplementing intensity based on the image brightness of the preview picture in a first area of the M areas, wherein the first area corresponds to a first flash lamp of the M flash lamps;

the electronic equipment determines the light supplementing intensity corresponding to the first flash lamp according to the third light supplementing intensity and the fourth light supplementing intensity; and the electronic equipment stores the corresponding relation between the fourth light supplementing intensity and the image brightness.

3. The method of claim 1, wherein the first interface comprises M regions, the M regions determined based on the locations of the M flashlights on the electronic device, the M flashlights in one-to-one correspondence with the M regions; the method further comprises the steps of:

in the second light supplementing mode, the electronic equipment determines third light supplementing intensity based on the ambient light brightness;

4. The method according to claim 2 or 3, wherein the electronic device determines the light intensity corresponding to the first flash according to the third light intensity and the fourth light intensity, specifically including:

when the difference value between the third light supplementing intensity and the fourth light supplementing intensity is larger than a first threshold value, the electronic equipment determines that the light supplementing intensity corresponding to the first flash lamp is the fourth light supplementing intensity;

and when the difference value between the third and fourth light supplementing intensities is smaller than or equal to the first threshold value, the electronic equipment determines that the light supplementing intensity corresponding to the first flash lamp is the third light supplementing intensity.

5. A method according to claim 2 or 3, wherein at least two of the M regions overlap.

6. A method according to claim 2 or 3, wherein the electronic device determining a third supplemental light intensity based on the ambient light level comprises:

the electronic device determining a fifth supplemental light intensity based on the ambient light level;

the electronic equipment identifies a target object in the preview picture;

the electronic equipment determines the area of the target object in each of the M areas in the preview picture;

The electronic device determines the third light-compensating intensity based on the fifth light-compensating intensity and the areas of the target object in the M areas in the preview screen.

7. The method of claim 1, wherein the electronic device, prior to the first interface displaying a third selection control and a fourth selection control, the method further comprising:

the electronic equipment displays a second control on the first interface;

the electronic equipment receives an eighth user operation acting on the second control;

the electronic device displays a third selection control and a fourth selection control on the first interface, including:

in response to the eighth user operation, the electronic device displays the third selection control and the fourth selection control on the first interface.

8. The method according to claim 1, wherein the method further comprises:

the electronic device displays a self-adjusting control on the first interface;

in response to a user operation for the self-adjustment control, the electronic device displays brightness adjustment bars respectively corresponding to the M flash lamps on the first interface; the M flash lamps comprise a first flash lamp and a second flash lamp;

Responding to the user operation of the brightness adjustment bar corresponding to the first flash lamp, and adjusting the light supplementing intensity of the first flash lamp by the electronic equipment;

and responding to the user operation of the brightness adjustment bar corresponding to the second flash lamp, and adjusting the light supplementing intensity of the second flash lamp by the electronic equipment.

9. A light supplementing method for photographing, wherein the method is applied to an electronic device, the electronic device comprises a display screen and a front camera, and the method comprises:

the electronic equipment receives a first user operation;

responding to the first user operation, and starting a shooting function;

displaying a first interface corresponding to the shooting function, wherein,

the first interface comprises a preview picture and a control which are acquired by the front camera; the preview picture comprises a preview area and a light supplementing area, and the preview area displays the preview picture subjected to light supplementing of the light supplementing area; the light supplementing intensity of the light supplementing area is controlled by the electronic equipment through adjusting the light supplementing parameter of the light supplementing area;

the electronic equipment displays a first selection control and a second selection control on the first interface, wherein the first selection control corresponds to a first light supplementing parameter and a first image processing algorithm, and the second selection control corresponds to a second light supplementing parameter and a second image processing algorithm; the first selection control and the second selection control indicate different light supplementing effects, and the parameters of the light supplementing parameters corresponding to the first selection control and the second selection control are the same in type; the light supplementing parameters corresponding to the first selection control and the second selection control are determined based on optimal light supplementing intensity, and the optimal light supplementing intensity is determined according to the ambient light brightness;

The electronic equipment receives a fifth user operation acting on the first selection control;

and responding to the fifth user operation, the electronic equipment adjusts the light supplementing parameters of the light supplementing area to be the first light supplementing parameters, and performs image processing on the preview picture acquired by the front-end camera by utilizing the first image processing algorithm.

10. The method of claim 9, wherein the optimal supplemental light intensity is determined based on ambient light level, a light sensing range of an ambient light sensor, and a supplemental light range of the electronic device.

11. The method of claim 10, wherein the light filling parameters of the light filling area include at least one of a transparency of the light filling area, a brightness of pixels within the light filling area of the display screen, and a brightness of a backlight of the display screen.

12. The method of claim 10, wherein displaying the first interface corresponding to the photographing function comprises:

and displaying the first interface corresponding to the shooting function according to the preset light supplementing parameters of the light supplementing area.

13. The method of claim 10, wherein the light-compensating region comprises a first light-compensating sub-region and a second light-compensating sub-region, and wherein the light-compensating intensity of the light-compensating region is controlled by the electronic device by adjusting a light-compensating parameter of at least one of the first light-compensating sub-region and the second light-compensating sub-region.

14. The method according to any one of claims 10 to 13, further comprising:

the electronic equipment receives a second user operation;

in response to the second user operation, the electronic device determines a shape of the preview area or the light supplement area in the first interface.

15. The method according to any one of claims 10 to 13, further comprising:

the electronic equipment receives a third user operation;

in response to the third user operation, the electronic device determines a size of the preview area or the light supplement area in the first interface.

16. The method according to any one of claims 10 to 13, further comprising:

the electronic equipment receives a fourth user operation;

and responding to the fourth user operation, and determining the position of the preview area or the light supplementing area in the first interface by the electronic equipment.

17. The method of claim 14, wherein the electronic device further comprises, prior to receiving the second user operation:

the electronic equipment displays a first control on the first interface, wherein the first control is used for determining the shape of a preview area, and the shape of the preview area at least comprises two types;

The electronic equipment receives a sixth user operation acting on the first control;

in response to the sixth user operation, the electronic device displays an icon of the shape of the preview area;

the electronic device receiving a second user operation specifically includes:

the electronic device receives the second user operation acting on the icon.

18. The method of claim 14, wherein the second user operation comprises a gesture of a user's finger sliding on the display screen;

the electronic device determines the shape of the preview area or the light filling area in the first interface in response to the second user operation, and specifically includes:

and responding to the second user operation, and determining the shape of the preview area or the light supplementing area in the first interface by the electronic equipment based on the sliding track of the gesture in the second user operation.

19. The method as recited in claim 13, further comprising:

the electronic equipment displays a first brightness adjustment bar corresponding to the first complementary sub-region and a second brightness adjustment bar corresponding to the second complementary sub-region on the first interface; the first brightness adjustment bar comprises a first mark; the length from the first end of the first brightness adjustment bar to the first mark is used for indicating the light supplementing intensity of a first light supplementing sub-area, and the total length from the first end of the first brightness adjustment bar to the second end of the first brightness adjustment bar is used for indicating the maximum light supplementing intensity;

The electronic equipment receives an operation acting on the first brightness adjustment bar and adjusts the position of the first mark on the first brightness adjustment bar;

and the electronic equipment determines the light supplementing parameter of the first light supplementing sub-region according to the light supplementing intensity represented by the length from the first end to the first mark.

20. The method of claim 10, wherein no light-compensating layer is displayed in the light-compensating region.

21. The method of claim 20, wherein the light-fill intensity of the light-fill area is controlled by the electronic device by adjusting a light-fill parameter of the light-fill area, the light-fill parameter comprising a brightness of a pixel within the light-fill area of the display screen.

22. The method of claim 21, wherein the step of determining the position of the probe is performed,

the electronic equipment stores the corresponding relation between the light supplementing intensity and the driving current of the pixels, and the pixel brightness of a first pixel in the light supplementing area is controlled by the driving current of the first pixel;

or the electronic equipment stores the corresponding relation between the light supplementing intensity and the driving voltage of the pixel, and the pixel brightness of the first pixel in the light supplementing area is controlled by the driving voltage of the first pixel.