WO2023245391A1

WO2023245391A1 - Preview method and apparatus for camera

Info

Publication number: WO2023245391A1
Application number: PCT/CN2022/099967
Authority: WO
Inventors: 张箫琴; 张明华
Original assignee: 北京小米移动软件有限公司
Priority date: 2022-06-20
Filing date: 2022-06-20
Publication date: 2023-12-28
Also published as: CN117652150A

Abstract

Provided in the present disclosure are a preview method and apparatus for a camera, which method and apparatus are applied to the field of image processing. The method comprises: starting a camera, executing a preview process of the camera, and collecting an initial preview image to be previewed; acquiring an ambient brightness value of an environment where the camera is located; generating a calling instruction of preview modes according to the ambient brightness value and a brightness threshold value, wherein the calling instruction includes a target preview mode; and executing the calling instruction, calling the target preview mode, generating a target preview image of the camera on the basis of the target preview mode and the initial preview image, and displaying the target preview image in a preview area of the camera. Therefore, an ambient brightness value is acquired and different target preview modes are automatically selected, such that optimal preview modes can be selected for different ambient brightness values, thereby enhancing a preview effect of a camera, and improving the usage experience of the camera.

Description

A method and device for camera preview

Technical field

The present disclosure relates to the field of image processing technology, and in particular, to a camera preview method and device thereof.

Background technique

The image quality of a camera is one of the most important factors that determines the camera user experience. Major manufacturers use various hardware and software technologies to improve the image quality of cameras. In the current technology, the camera cannot distinguish the lighting conditions of the current environment when previewing the image quality, causing the camera's preview image effect to be unsatisfactory.

Contents of the invention

Embodiments of the present disclosure provide a method and device for camera preview, which can be applied in the field of mobile phones or cameras, such as taking photos and videos based on mobile phones or cameras. By determining the lighting conditions around the shooting scene and selecting different preview modes, you can Achieve better photo effects.

In a first aspect, embodiments of the present disclosure provide a camera preview method. The method includes: starting a camera and executing a preview process of the camera to collect a preview image; obtaining an environment brightness value of the environment where the camera is located; and according to the environment brightness value and Brightness threshold, generate a calling instruction for the preview mode, the calling instruction includes the target preview mode; execute the calling instruction, call the target preview mode, and generate the target preview image of the camera based on the target preview mode in the camera The preview area is displayed.

In one embodiment of the present disclosure, generating a target preview image of the camera based on the target preview mode and the initial preview image includes: in response to the target preview mode being the first preview mode, obtaining the first target magnification of the camera; converting the initial preview image to Perform pixel fusion to obtain a fusion preview image; scale the fusion preview image based on the first target magnification to generate a first scaled preview image; adjust the resolution of the first scaled preview image to a preset resolution to generate a target preview image.

In one embodiment of the present disclosure, the camera preview method further includes: obtaining image feature data of the fused preview image; determining the image level of the fused preview image based on the image feature data and preset image feature data; responding to the image level being less than the image level. The level threshold is used to adjust the pixel fusion rate based on the image feature data and the preset image feature data; based on the adjusted pixel fusion rate, the pixels of the initial preview image are re-pixel fused.

In one embodiment of the present disclosure, calling the target preview mode, and generating a target preview image of the camera based on the target preview mode and the initial preview image includes: in response to the target preview mode being the second preview mode, obtaining a second target magnification of the camera multiple; scale the initial preview image based on the second target magnification factor to generate a second scaled image; adjust the resolution of the first scaled preview image to a preset resolution to generate a target preview image.

In one embodiment of the present disclosure, obtaining the ambient brightness value of the environment where the camera is located includes: collecting light information of the environment based on a photosensitive element to determine the ambient brightness value; or obtaining the screen brightness of the initial preview image, based on the screen Brightness determines the ambient brightness value.

In one embodiment of the present disclosure, the camera preview method further includes: generating multiple candidate target preview images based on all candidate preview modes and initial preview images; selecting the candidate target preview with the highest resolution from the multiple candidate target preview images. The image is used as the target preview image, and the candidate preview mode corresponding to the candidate target preview image with the highest resolution is bound to the current environment brightness value.

In a second aspect, an embodiment of the present disclosure provides another camera preview device, which is characterized in that the device includes: a startup module for starting the camera and executing the camera's preview process to collect an initial preview image to be previewed; and an acquisition module for Obtain the ambient brightness value of the environment where the camera is located; the generation module is used to generate the calling instruction of the preview mode based on the environmental brightness value and the brightness threshold, and the calling instruction contains the target preview mode; the execution module is used to execute the calling instruction and call the target preview mode , and generate the target preview image of the camera based on the target preview mode and the initial preview image, and display the target preview image in the preview area of the camera.

In a third aspect, the present disclosure proposes an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores information that can be executed by the at least one processor. Instructions, which are executed by the at least one processor, to implement the camera preview method as described in the embodiment of the first aspect of the present disclosure.

In a fourth aspect, the present disclosure proposes a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to implement the camera preview method as described in the embodiment of the first aspect of the present disclosure.

In a fifth aspect, the present disclosure proposes a computer program product, including a computer program that, when executed by a processor, is used to implement the camera preview method as described in the embodiment of the first aspect of the present disclosure.

By obtaining the ambient brightness value and automatically selecting different target preview modes, the best image processing mode can be selected for different ambient brightness values, thereby enhancing the camera's preview effect and improving the camera usage experience.

Description of the drawings

In order to more clearly illustrate the technical solutions in the embodiments of the disclosure or the background technology, the drawings required to be used in the embodiments or the background technology of the disclosure will be described below.

Figure 1 is a schematic flowchart of a camera preview method provided by an embodiment of the present disclosure;

Figure 2 is a schematic flowchart of another camera preview method provided by an embodiment of the present disclosure;

Figure 3 is a schematic diagram of a four-color filter array algorithm provided by an embodiment of the present disclosure;

Figure 4 is a flow chart of the first preview mode provided by an embodiment of the present disclosure;

Figure 5 is a schematic flowchart of another camera preview method provided by an embodiment of the present disclosure;

Figure 6 is a flow chart of the second preview mode provided by an embodiment of the present disclosure;

Figure 7 is an overall flow diagram of a camera preview method provided by an embodiment of the present disclosure;

Figure 8 is a structural block diagram of a camera preview device provided by an embodiment of the present disclosure;

FIG. 9 is a structural block diagram of an electronic device provided by an embodiment of the present disclosure.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with aspects of the disclosure as detailed in the appended claims.

The terminology used in the embodiments of the present disclosure is for the purpose of describing specific embodiments only and is not intended to limit the embodiments of the present disclosure. As used in the embodiments of the present disclosure and the appended claims, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

It should be understood that although the terms first, second, third, etc. may be used to describe various information in the embodiments of the present disclosure, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of the embodiments of the present disclosure, the first information may also be called second information, and similarly, the second information may also be called first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "when" or "in response to determining"

For the purpose of simplicity and ease of understanding, the terms used in this article are "greater than" or "less than", "higher than" or "lower than" when characterizing size relationships. But for those skilled in the art, it can be understood that: the term "greater than" also covers the meaning of "greater than or equal to", and "less than" also covers the meaning of "less than or equal to"; the term "higher than" covers the meaning of "higher than or equal to". "The meaning of "less than" also covers the meaning of "less than or equal to".

The camera preview method and device provided by the present disclosure will be introduced in detail below with reference to the accompanying drawings.

Please refer to FIG. 1 , which is a schematic flowchart of a camera preview method provided by an embodiment of the present disclosure. As shown in Figure 1, the method may include but is not limited to the following steps:

S11, start the camera and execute the preview process of the camera, and collect the initial preview image to be previewed.

It should be noted that the camera in the embodiment of the present disclosure may be a digital camera (Digital Still Camera, DSC) or a shooting device attached to other electronic devices. For example, it may be a shooting device on a mobile phone or a handheld camera. Photography devices on computers, etc. are not limited here.

The camera in the embodiment of the present disclosure includes a color filter array (Color Filter Array, CFA) function, which covers a layer of color filter array (Color Filter Array, CFA) on the surface of the pixel array. There are many types of color filter arrays. The most widely used one now is the Bayer format filter array, which satisfies the GRBG rule. The number of green pixels is twice the number of red or blue pixels. This is because the peak sensitivity of the human eye to the visible light spectrum is in the mid-band, which corresponds to the green Spectral components. In this mode, the image data only uses one of the three values of R, G, and B to represent a pixel, and the other two color values are missing. At this time, a mosaic picture is obtained. In order to obtain a full-color image , it is necessary to use the color information of its surrounding pixels to estimate the other two missing colors. This process is called color interpolation.

CFA is most widely used in the field of mobile devices due to its lower power consumption, price and excellent image quality.

When you turn on the camera or open the camera application in the electronic device, you can preview the real-time images captured by the camera through the display screen. This function is the camera's preview function. Users can adjust the camera or shooting actions through the preview function to obtain the best shooting results.

The initial preview image is the initial image collected by the camera. The initial image needs to undergo certain processing before it can be displayed on the screen for users to preview.

S12, obtain the ambient brightness value of the environment where the camera is located.

The brightness value refers to the ratio of the light intensity of the luminous body to the area of the light source. It is defined as the brightness of the light source unit, that is, the luminous intensity per unit projected area. The ambient brightness in the embodiment of the present disclosure refers to the light brightness that the camera can access when collecting the initial preview image.

Ambient brightness is related to the intensity of external light, and is also related to the shooting angle of the camera. For example, when the camera is in the same shooting environment, the ambient brightness values of forward-light shooting, back-light shooting or top-light shooting can be different.

In the embodiments of the present disclosure, there may be multiple methods for obtaining the environment brightness value. For example, the environment brightness may be determined based on a brightness detection device. Alternatively, the environment brightness may also be determined based on the brightness of the initial preview image.

In some specific shooting environments, such as in a studio, the ambient brightness can also be set in advance and directly input into the camera.

S13: Generate a calling instruction for the preview mode based on the environment brightness value and the brightness threshold, and the calling instruction includes the target preview mode.

In embodiments of the present disclosure, the light conditions under which the current camera collects the initial preview image may be determined based on the ambient brightness value and the brightness threshold. It should be noted that the brightness threshold is set in advance and can be multiple, which is used to accurately determine the level of the current light condition, so as to select the appropriate target preview mode in a targeted manner, thereby improving the camera preview. Effect.

According to different environmental brightness values and brightness thresholds, the corresponding target preview modes can be different, and the specific settings need to be set according to actual needs. Especially in dark light environments, the pixel sensitivity of the initial preview image collected by the camera is insufficient, which will cause the signal-to-noise ratio of the image sent to the back-end of the image signal processor to be too high, and the quality of the generated image will be too poor, resulting in the final preview image quality. Not good, so it is necessary to perform image processing on the initial preview image specifically for the dark-light environment preview mode to generate a preview image with better shooting effects. There are many target preview modes, which need to be selected according to the environment brightness value and brightness threshold. The signal-to-noise ratio of an image is the ratio of the power spectrum of the image signal to the noise. The greater the signal-to-noise ratio of the image, the greater the noise that affects the image quality, and the worse the final image quality.

After determining the target preview mode, the processor can generate a calling instruction based on the target preview mode and send it to the camera to adjust to the target preview mode. It should be noted that the processor can be a processor of a camera or a processor of an electronic device, such as a processor of a mobile phone, a processor of a tablet computer, etc. There is no limitation here, and the specific requirements need to be determined according to the actual situation. set up.

S14, execute the calling instruction, call the target preview mode, generate the target preview image of the camera based on the target preview mode and the initial preview image, and display the target preview image in the preview area of the camera.

After the calling instruction is generated based on the environment brightness value, the camera can be adjusted to the target preview mode in the calling instruction based on the calling instruction. The camera performs image processing on the initial preview image based on the target preview mode to generate a target preview image and display it through the preview area. to users.

In the embodiment of the present disclosure, first start the camera and execute the camera's preview process to collect the initial preview image to be previewed, then obtain the ambient brightness value of the environment where the camera is located, and then generate a call instruction for the preview mode based on the ambient brightness value and the brightness threshold. , the calling instruction includes the target preview mode, and finally the calling instruction is executed to call the target preview mode, and generate the target preview image of the camera based on the target preview mode and the initial preview image, and display the target preview image in the preview area of the camera. Therefore, by obtaining the ambient brightness value and automatically selecting different target preview modes, the best image processing mode can be selected for different ambient brightness values, thereby enhancing the camera's preview effect and improving the camera usage experience.

In the embodiment of the present disclosure, to obtain the environmental brightness value of the environment where the camera is located, the light information of the environment where the camera is located can be collected based on the photosensitive element to determine the environmental brightness value. For example, the photosensitive element can be a light detection sensor, a photoresistor sensor, etc., which receives light information through the photosensitive element, determines the light intensity, and sends the light intensity to the processor for processing.

Optionally, the brightness information can also be obtained directly from the image signal output by the image sensor, and then the brightness information can be processed to obtain the ambient brightness value of the environment. Compared with the previous method of determining the ambient brightness value through a photosensitive element, obtaining the ambient brightness value through the initial preview image brightness information can also provide additional analysis data on the shooting scene, such as front aperture value, exposure time and sensitivity value information. Etc., saving on photometric equipment, you can also analyze the image information and the current aperture value, exposure time and sensitivity value information to determine whether the current exposure parameters are appropriate. It should be noted that the method of determining the ambient brightness value of the environment based on brightness information may be an automatic exposure (Auto Exposure, AE) algorithm.

In some scenes, due to environmental reasons, such as heavy fog, rainy days, high temperatures, etc., the target preview image obtained through the target preview mode may not perform well, and the preview mode needs to be re-selected. At this time, multiple candidate target preview images can be generated based on all candidate preview modes and initial preview images in the camera, and then the candidate target preview image with the highest resolution is selected from the multiple candidate target preview images as the target preview image, and the analytical The preview mode corresponding to the candidate target preview image with the highest power is bound to the current environment brightness value, so that when encountering the same scene next time, the optimal target preview mode can be quickly determined and the camera usage experience is improved.

In embodiments of the present disclosure, the ambient brightness value and the brightness threshold may be compared. In response to the environment brightness value being less than the brightness threshold, selecting the first preview mode from the candidate preview modes as the target preview mode, and generating a calling instruction based on the first preview mode, or in response to the environment brightness value being greater than or equal to the brightness threshold, selecting the first preview mode from the candidate preview mode Select the second preview mode as the target preview mode, and generate a calling instruction based on the second preview mode. It should be noted that the brightness thresholds of different cameras may be different. Alternatively, the brightness thresholds of different cameras may also be different based on different shooting environments. There is no limitation here. The brightness threshold can be set in advance and can be changed according to actual design requirements.

It should be noted that the embodiments of the present disclosure are not limited to the first preview mode and the second preview mode. There may also be multiple preview modes for selecting and processing response modes to different lighting conditions, thereby improving the performance of camera preview. Preview the effect. Correspondingly, there may also be multiple brightness thresholds used to determine which preview mode to select, which is not limited here.

Please refer to Figure 2. Figure 2 is a schematic flow chart of another camera preview provided by an embodiment of the present disclosure. As shown in Figure 2, the target preview image of the camera is generated based on the target preview mode and the initial preview image, which may include but is not limited to the following. step:

S21, in response to the target preview mode being the first preview mode, obtain the first target magnification of the camera.

In order to obtain ideal shooting effects, cameras generally have a zoom function, that is, zooming. The camera zoom is like a telescope that can bring the scenery closer (zoom in). The higher the magnification of the first target, the closer it can be.

In current technology, there are two main ways to zoom. The first is digital zoom: zooming in on the scene through software, which is like using a magnification effect on a computer. The second type is optical zoom: a lens composed of multiple lenses is used to magnify the scene.

The digital zoom is performed by the back-end image signal processor for cropping and enlarging. This method will occupy a lot of computing power of the image signal processor. In other embodiments, the ISZ mode can also be used to perform zooming and hardware anti-mosaic by the camera, which can greatly improve the resolution after Zoom. However, the ISZ mode has the disadvantage of excessive signal-to-noise ratio in dark light, which is harmful to the generated images. The quality of the preview image is greatly affected. Therefore, in the first preview mode, in order to obtain better preview quality, a back-end image signal processor is usually used for cropping and amplification.

It should be noted that the first target magnification factor can be selected by the user. In actual operation, the first target magnification factor can be determined by capturing the user's action of stretching the screen. The user can also select the first target magnification through the zoom-in or zoom-out button on the camera.

Optionally, the user can also input the first target magnification into the camera through input.

Optionally, the first target magnification factor can also be set in advance and called up for use when previewing the image.

S22: Perform pixel fusion on the pixels of the initial preview image based on the pixel fusion rate to obtain a fused preview image.

In the embodiment of the present disclosure, the fusion rate can be multiple, for example, it can be 4-in-1, 9-in-1, 16-in-1, etc., that is, 4, 9, or 16 pixels in the image are fused into 1 pixels, reducing the signal-to-noise ratio of the image and improving the brightness of the picture. On the other hand, since multiple pixels are fused into one pixel, the generated fused preview image has a lower resolution than the initial preview image.

The following is an example when the fusion rate is 1 in 4. The initial preview image can be pixel-fused based on a four-color filter array algorithm to obtain a fused preview image. The color filter array is a mosaic overlay above the pixel sensor that captures the color information of the image. General photoelectric sensors can only sense the intensity of light and cannot distinguish the wavelength (color) of light. Therefore, the image sensor needs to pass a color filter (Color Filter) to obtain the color information of the pixels. The green light filter in the filter is changed to transparent transmission. Structure. The benefits of this are mainly reflected in the higher intensity of the collected light source and the dedicated frequency band response technology that can effectively improve the quality of the image. As shown in Figure 3, the four-color filter array algorithm is based on the four-color filter array algorithm that merges four adjacent pixels in the initial preview image into one pixel to improve the signal-to-noise ratio of the pixel under low-light conditions. At the same time, , the pixels of the initial preview image are reduced due to pixel blending.

In the embodiment of the present disclosure, as shown in Figure 4, the resolution of the initial preview image collected is 8000X6000px, and the resolution of the fused preview image after processing based on the four-color filter array algorithm is 4000X3000px.

S23: Scale the fusion preview image based on the first target magnification to generate a first scaled preview image.

In the embodiment of the present disclosure, before scaling the fused preview image, it is first necessary to perform image processing on the fused preview image through an image signal processor, and then scale the processed fused preview image.

It should be noted that the image signal processor (ISP, Image Signal Process) is responsible for receiving the original signal data of the photosensitive element (Sensor) in the entire process of camera imaging. It can be understood as the first step of the entire camera's photo and video processing process. , used to process the image signal output by the image signal sensor. It occupies a core and dominant position in the camera system and is an important device that constitutes the camera. The main functions include linear correction, noise removal, dead pixel removal, interpolation, white balance, automatic exposure control, etc. It relies on ISP to better restore scene details under different optical conditions. ISP technology plays a large role in It determines the imaging quality of the camera and is the processing unit in the photo-taking process. Its status is equivalent to the "brain" of the camera.

In the embodiment of the present disclosure, in the first preview mode, the fused preview image is scaled through the ISP. Usually through zoom ROI (zoomRegion Of Interest, zoom region of interest). This method uses a fixed focus method. The area of interest remains the same as before zooming and does not change with zooming. By fixing the focus, the image around the focus is intercepted. This method has fast focusing speed and stable imaging quality. After zooming, the preview image is fused. The resolution will decrease based on the first target magnification.

For example, when the first target magnification is 2, after generating the fusion preview image, as shown in Figure 4, the image signal processor can first perform image processing on the fusion preview image, and then perform fusion based on the first target magnification. The preview image is scaled, and the resolution of the fusion preview image is 4000X3000px, and only the target image with a resolution of 2000X1500px in the middle area is retained to achieve the purpose of enlarging the fusion preview image by 2 times.

S24. Adjust the resolution of the first scaled preview image to a preset resolution to generate a target preview image.

In the embodiment of the present disclosure, after the first zoomed preview image is obtained, a comparison can be made based on the resolution of the first zoomed preview image and the preset resolution. When the resolution of the first zoomed preview image is greater than the preset resolution, The first zoom preview image is reduced until it reaches the preset resolution. When the resolution of the first zoom preview image is smaller than the preset resolution, the first zoom preview image is enlarged until it reaches the preset resolution.

As shown in Figure 4, the preset resolution is 1440X1080px, and the resolution of the first scaled preview image is 2000X1500px. The first scaled preview image needs to be reduced until it reaches the preset resolution to generate the target preview image.

It should be noted that the default resolution can be set by the user or the system default, and there is no limit here.

In the embodiment of the present disclosure, first in response to the target preview mode being the first preview mode, the first target magnification factor of the camera is obtained, and then the initial preview image is pixel-fused to obtain the fused preview image, and then based on the first target magnification factor The fusion preview image is scaled to generate a first scaled preview image, and finally the first scaled preview image is deformed to generate a target preview image with a preset resolution size. Therefore, by performing pixel fusion on the initial preview image to obtain the fused preview image, the signal-to-noise ratio of the preview image in a dark light environment can be reduced and the picture quality can be improved.

When in a dark light environment, the sensor can be adjusted to binning mode. In this mode, 4 adjacent pixels in the initial preview image can be merged into one pixel, which reduces the signal-to-noise ratio of the pixels in low light conditions and improves Improves the brightness of the screen, thereby improving the quality of preview images in dark light environments. ,

In some scenarios, the pixels of the initial preview image are fused based on the pixel fusion rate, and the effect of generating the fused preview image is not good, which will have an impact on subsequent image processing and reduce the effect of the camera preview. In the embodiment of the present disclosure, the image feature data of the fused preview image may be first obtained, and then the image level of the fused preview image is determined based on the image feature data and the preset image feature data, and then in response to the image level being less than the image level threshold, based on the image feature data and preset image feature data, adjust the pixel fusion rate, and finally based on the adjusted pixel fusion rate, re-pixel fuse the pixels of the initial preview image until the best pixel fusion effect is achieved. Especially in landscapes, night scenes, or dark images with small color differences where color changes are relatively simple, pixel fusion will not have a great impact on the clarity of the image. This method of adjusting the pixel fusion rate can achieve better results. .

Image feature data can include the grayscale, sharpness, resolution and other factors of the image. In the existing technology, the image feature data is usually processed through AI algorithms, or the image feature data can be processed through training models to output the image feature data. Image level. It should be noted that image levels can be divided into many types, and there are no limitations here. The image level threshold is set in advance and can be adjusted according to actual conditions. For example, the image level thresholds may be different under different climates, and the image level thresholds may be different under different lighting conditions.

Optionally, there may also be a mapping relationship table between the image feature data, the preset image feature data and the image level. By comparing the image feature data with the preset image feature data, the image level of the fused preview image is determined by looking up the table. The mapping relationship table can be set in advance and stored in the storage space of the electronic device to facilitate retrieval and use when needed.

After it is determined that the image level is less than the image level threshold, an adjustment plan for the pixel fusion rate can be determined based on analysis based on image feature data and preset image feature data. For example, if the sharpness of the image is too large, the pixel fusion rate can be adjusted by reducing the Optimize by increasing the pixel fusion rate; if the brightness of the image is too low, you can optimize by increasing the pixel fusion rate.

Please refer to Figure 5. Figure 5 is a schematic flow chart of another camera preview provided by an embodiment of the present disclosure. As shown in Figure 5, generating a target preview image of the camera based on the target preview mode and the initial preview image may include but is not limited to the following step:

S51, in response to the target preview mode being the second preview mode, obtain the second target magnification of the camera.

Regarding the specific implementation of step S51, please refer to the records related to S21 in the above embodiment, and will not be described again here.

S52: Scale the initial preview image based on the second target magnification to generate a second scaled image.

In the embodiment of the present disclosure, in the second preview mode, after the initial preview image is obtained, the sensor can be used to zoom based on the second target magnification, without the need to use the image signal processor to zoom the initial preview image, so as to release Part of the computing power of the image signal processor, thereby using more computing power for image processing.

And this method of scaling through the sensor generates a second zoomed image with a higher resolution. In the subsequent processing process, compared with the scaling through the image signal processor, the image signal processor generates based on this method The image quality after the second zoom image processing is better, thereby improving the preview effect of the camera in bright light environments.

As shown in Figure 6, the initial pre-review image can be scaled directly based on the sensor. The resolution of the initial pre-review image is: When the pixels of the initial preview image are 8000X6000px and the second target magnification is 2 times, then the second zoom after scaling The resolution of the image is 4000X3000px.

S53. Adjust the resolution of the first scaled preview image to a preset resolution to generate a target preview image.

In the embodiment of the present disclosure, after acquiring the second zoomed image, the second zoomed preview image may first be image processed based on the image signal processor.

After the second zoom preview image is obtained, a comparison can be made based on the resolution of the second zoom preview image and the preset resolution. When the resolution of the second zoom preview image is greater than the preset resolution, the second zoom preview image Zoom out until the preset resolution is reached. When the resolution of the second zoomed preview image is smaller than the preset resolution, the second zoomed preview image is enlarged until it reaches the preset resolution.

It should be noted that the default resolution is set in advance and can be changed according to actual needs, and there is no limit here. As shown in Figure 6, the default resolution is 1440X1080px, and the resolution of the first zoomed preview image is 4000X3000px. The first zoomed preview image needs to be reduced until it reaches the preset resolution to generate a target preview with the preset resolution size. image.

In an embodiment of the present disclosure, first in response to the target preview mode being the second preview mode, a second target magnification factor of the camera is obtained, and then the initial preview image is scaled based on the second target magnification factor to generate a second scaled image, and finally Transform the second scaled preview image to generate a target preview image with a preset resolution size. Therefore, in a bright light environment, the initial preview image is amplified by the sensor without the need for the image signal processor to scale the initial preview image. The image signal processor can use more computing power for image processing without the need for the initial preview image. The preview image undergoes pixel fusion to improve the resolution of the target preview image.

In this disclosed embodiment, when in a bright light environment, the CFA Sensor can be adjusted to the sensor zoom (ISZ) mode. In the ISZ mode, the camera performs cropping (Crop) and demosaic (demosasic), which can be extremely effective. Greatly improve the resolution after scaling. In other embodiments, the CFA Sensor can also be adjusted to the full size mode in the binning mode, and the image can be restored to the high-pixel BAYER format through hardware or software remosaic technology, but this method is inferior to ISZ mode, the resolution of the downscaled input image is only 1/4 of the input image in ISZ mode, resulting in the final downscaled output image having far less resolution than ISZ mode.

Figure 7 is a schematic diagram of the overall process of an embodiment of the present disclosure. As shown in the figure, first start the camera and execute the preview process of the camera, then obtain the environment brightness value of the environment where the camera is located, and determine whether the current environment is a dark light environment based on the environment brightness value. , if the current environment is a dark light environment, switch to the first preview mode; if the current environment is a bright light environment, switch to the second preview mode, generate a target preview image of the camera, and display the target preview image in the preview area of the camera. Therefore, by obtaining the ambient brightness value and automatically selecting different target preview modes, the best image processing mode can be selected for different ambient brightness values, thereby enhancing the camera's preview effect and improving the camera usage experience.

Corresponding to the camera preview method provided by the above embodiments, one embodiment of the present disclosure also provides a camera preview device. Since the camera preview device provided by the embodiment of the present disclosure is different from the camera preview method provided by the above embodiments, Correspondingly, therefore, the above implementation of the camera preview method is also applicable to the camera preview device provided by the embodiments of the present disclosure, and will not be described in detail in the following embodiments.

Please refer to FIG. 8 , which is a schematic structural diagram of a camera preview device 80 provided by an embodiment of the present disclosure. The camera preview device 80 shown in FIG. 8 may include a startup module 81, an acquisition module 82, a generation module 83 and an execution module 84.

Among them, the startup module 81 is used to start the camera and execute the preview process of the camera to collect the initial preview image to be previewed.

The acquisition module 82 is used to acquire the ambient brightness value of the environment where the camera is located.

The generation module 83 is configured to generate a calling instruction for the preview mode according to the environment brightness value and the brightness threshold, where the calling instruction includes the target preview mode.

The execution module 84 is used to execute the calling instruction, call the target preview mode, generate the target preview image of the camera based on the target preview mode and the initial preview image, and display the target preview image in the preview area of the camera.

In one embodiment of the present disclosure, the generation module 83 is also configured to: compare the environment brightness value with the brightness threshold; in response to the environment brightness value being less than the brightness threshold, select the first preview mode from the candidate preview modes as the target preview mode , generate a calling instruction based on the first preview mode; or in response to the environment brightness value being greater than or equal to the brightness threshold, select the second preview mode as the target preview mode from the candidate preview modes, and generate the calling instruction based on the second preview mode.

In one embodiment of the present disclosure, the execution module 84 is also configured to: in response to the target preview mode being the first preview mode, obtain the first target magnification of the camera; perform pixel fusion on the pixels of the initial preview image based on the pixel fusion rate , to obtain a fusion preview image; scale the fusion preview image based on the first target magnification to generate a first scaled preview image; deform the first scaled preview image to generate a target preview image with a preset resolution size.

In one embodiment of the present disclosure, the execution module 84 is also configured to: obtain image feature data of the fused preview image; determine the image level of the fused preview image based on the image feature data and the preset image feature data; respond to the image level being less than the image level The level threshold adjusts the pixel fusion rate based on the image feature data and the preset image feature data; based on the adjusted pixel fusion rate, the pixels of the initial preview image are re-pixel fused.

In one embodiment of the present disclosure, the execution module 84 is also configured to perform pixel fusion on the initial preview image based on a four-color filter array algorithm to obtain a fused preview image.

In one embodiment of the present disclosure, the execution module 84 is also configured to: in response to the target preview mode being the second preview mode, obtain the second target magnification factor of the camera; scale the initial preview image based on the second target magnification factor, to generate a second scaled image; and adjust the resolution of the first scaled preview image to a preset resolution to generate a target preview image.

In one embodiment of the present disclosure, the execution module 84 is also used to: collect light information of the environment based on the photosensitive element to determine the environment brightness value; or, obtain the screen brightness of the initial preview image, and determine the environment brightness based on the screen brightness. value.

In one embodiment of the present disclosure, the acquisition module 82 is also configured to: generate multiple candidate target preview images based on all candidate preview modes and initial preview images; select the candidate target preview with the highest resolution from the multiple candidate target preview images. The image is used as the target preview image, and the preview mode corresponding to the candidate target preview image with the highest resolution is bound to the current environment brightness value.

In the embodiment of the present disclosure, first start the camera and execute the camera's preview process to collect the initial preview image to be previewed, then obtain the ambient brightness value of the environment where the camera is located, and then generate a call instruction for the preview mode based on the ambient brightness value and the brightness threshold. , the calling instruction includes the target preview mode, and finally the calling instruction is executed to call the target preview mode, and generate the target preview image of the camera based on the target preview mode and the initial preview image, and display the target preview image in the preview area of the camera. Therefore, by obtaining the ambient brightness value and automatically selecting different target preview modes, it is possible to obtain target preview images with better shooting effects under different brightnesses and improve the user experience.

Those skilled in the art can also understand that the various illustrative logical blocks and steps listed in the embodiments of the present disclosure can be implemented by electronic hardware, computer software, or a combination of both. Whether such functionality is implemented in hardware or software depends on the specific application and overall system design requirements. Those skilled in the art can use various methods to implement the described functions for each specific application, but such implementation should not be understood as exceeding the scope of protection of the embodiments of the present disclosure.

In order to implement the above embodiments, an embodiment of the present disclosure also proposes an electronic device 900. As shown in Figure 9, the electronic device 900 includes: a processor 91 and a memory 92 communicatively connected to the processor. The memory 92 stores information that can be used by at least one Instructions executed by the processor are executed by at least one processor 91 to implement the firmware debugging method according to the embodiment of the first aspect of the present disclosure.

The present disclosure also provides a readable storage medium on which instructions are stored, and when the instructions are executed by a computer, the functions of any of the above method embodiments are implemented.

The present disclosure also provides a computer program product, which, when executed by a computer, implements the functions of any of the above method embodiments.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs. When the computer program is loaded and executed on a computer, the processes or functions described in accordance with the embodiments of the present disclosure are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer program may be stored in or transferred from one computer-readable storage medium to another, for example, the computer program may be transferred from a website, computer, server, or data center Transmission to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more available media integrated. The usable media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., high-density digital video discs (DVD)), or semiconductor media (e.g., solid state disks, SSD)) etc.

Those of ordinary skill in the art can understand that the first, second, and other numerical numbers involved in this disclosure are only for convenience of description and are not used to limit the scope of the embodiments of the disclosure, nor to indicate the order.

At least one in the present disclosure can also be described as one or more, and the plurality can be two, three, four or more, and the present disclosure is not limited. In the embodiment of the present disclosure, for a technical feature, the technical feature is distinguished by “first”, “second”, “third”, “A”, “B”, “C” and “D” etc. The technical features described in "first", "second", "third", "A", "B", "C" and "D" are in no particular order or order.

The corresponding relationships shown in each table in this disclosure can be configured or predefined. The values of the information in each table are only examples and can be configured as other values, which is not limited by this disclosure. When configuring the correspondence between information and each parameter, it is not necessarily required to configure all the correspondences shown in each table. For example, in the table in this disclosure, the corresponding relationships shown in some rows may not be configured. For another example, appropriate deformation adjustments can be made based on the above table, such as splitting, merging, etc. The names of the parameters shown in the titles of the above tables may also be other names understandable by the communication device, and the values or expressions of the parameters may also be other values or expressions understandable by the communication device. When implementing the above tables, other data structures can also be used, such as arrays, queues, containers, stacks, linear lists, pointers, linked lists, trees, graphs, structures, classes, heaps, hash tables or hash tables. wait.

Predefinition in this disclosure may be understood as definition, pre-definition, storage, pre-storage, pre-negotiation, pre-configuration, solidification, or pre-burning.

Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered to be beyond the scope of this disclosure.

Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be described again here.

The above are only specific embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present disclosure. should be covered by the protection scope of this disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.

Claims

A camera preview method, characterized by including:

Start the camera and execute the preview process of the camera, and collect the initial preview image to be previewed;

Obtain the ambient brightness value of the environment where the camera is located;

Generate a calling instruction for the preview mode according to the environment brightness value and the brightness threshold, where the calling instruction includes the target preview mode;

Execute the calling instruction to call the target preview mode, generate a target preview image of the camera based on the target preview mode and the initial preview image, and display the target preview image in the preview area of the camera.
The method according to claim 1, characterized in that the calling instruction for preview mode is generated according to the ambient brightness value and the brightness threshold, and the calling instruction includes the target preview mode, including:

Compare the ambient brightness value with a brightness threshold;

In response to the environment brightness value being less than a brightness threshold, selecting a first preview mode from the candidate preview modes as the target preview mode, and generating the calling instruction based on the first preview mode; or

In response to the environment brightness value being greater than or equal to the brightness threshold, a second preview mode is selected from the candidate preview modes as the target preview mode, and a calling instruction is generated based on the second preview mode.
The method of claim 2, wherein generating a target preview image of the camera based on the target preview mode and the initial preview image includes:

In response to the target preview mode being the first preview mode, obtaining a first target magnification of the camera;

Perform pixel fusion on the pixels of the initial preview image based on the pixel fusion rate to obtain a fused preview image;

Scale the fused preview image based on the first target magnification to generate a first scaled preview image;

Adjust the resolution of the first scaled preview image to a preset resolution to generate the target preview image.
The method of claim 3, further comprising:

Obtain image feature data of the fused preview image;

Determine the image level of the fused preview image based on the image feature data and preset image feature data;

In response to the image level being less than an image level threshold, adjusting the pixel fusion rate based on the image feature data and the preset image feature data;

Based on the adjusted pixel fusion rate, pixel fusion is performed again on the pixels of the initial preview image.
The method of claim 2, wherein generating a target preview image of the camera based on the target preview mode and the initial preview image includes:

In response to the target preview mode being the second preview mode, obtaining a second target magnification of the camera;

Scale the initial preview image based on the second target magnification to generate a second scaled image;

Adjust the resolution of the first scaled preview image to a preset resolution to generate the target preview image.
The method of claim 1, wherein obtaining the ambient brightness value of the environment where the camera is located includes:

Collect light information of the environment based on a photosensitive element to determine the ambient brightness value; or,

Obtain the screen brightness of the initial preview image, and determine the environment brightness value based on the screen brightness.
The method of claim 1, further comprising:

Generate a plurality of candidate target preview images based on all the candidate preview modes and the initial preview image;

Select the candidate target preview image with the highest resolution from a plurality of candidate target preview images as the target preview image, and compare the candidate preview mode corresponding to the candidate target preview image with the highest resolution with the currently selected target preview image. Bind the above environment brightness value.
A camera preview device, characterized by including:

A startup module, used to start the camera and execute the preview process of the camera, and collect the initial preview image to be previewed;

An acquisition module, used to acquire the ambient brightness value of the environment where the camera is located;

A generation module, configured to generate a calling instruction for the preview mode according to the environment brightness value and the brightness threshold, where the calling instruction includes the target preview mode;

An execution module, configured to execute the calling instruction, call the target preview mode, generate a target preview image of the camera based on the target preview mode and the initial preview image, and store the target preview image in the camera's The preview area is displayed.
An electronic device, characterized by including a memory and a processor;

Wherein, the processor reads the executable program code stored in the memory and runs a program corresponding to the executable program code, so that the method according to any one of claims 1 to 7 is implemented.
A computer-readable storage medium used to store instructions that, when executed, enable the method of any one of claims 1 to 7 to be implemented.
A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 7.