CN113259594A - Image processing method and device, computer readable storage medium and terminal - Google Patents
Image processing method and device, computer readable storage medium and terminal Download PDFInfo
- Publication number
- CN113259594A CN113259594A CN202110688777.1A CN202110688777A CN113259594A CN 113259594 A CN113259594 A CN 113259594A CN 202110688777 A CN202110688777 A CN 202110688777A CN 113259594 A CN113259594 A CN 113259594A
- Authority
- CN
- China
- Prior art keywords
- image
- brightness
- scene
- preview
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
Abstract
An image processing method and device, a computer readable storage medium and a terminal are provided, and the image processing method comprises the following steps: acquiring a preview image, and caching a plurality of frames of preview images; responding to the pressing of a photographing key, and selecting an image with the highest definition from the buffered multi-frame preview images; determining the ambient brightness according to the preview image, and judging the scene type of the current scene according to the ambient brightness; and at least using the image with the highest definition for image signal processing according to the scene type to obtain a processed image. The technical scheme of the invention can improve the image processing effect.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to an image processing method and apparatus, a computer-readable storage medium, and a terminal.
Background
In the existing mobile phone photographing scheme, because light rays are good in a highlight scene, the signal-to-noise ratio of original data of a captured image is good, and therefore a single-frame processing mode can be adopted; in a low-brightness scene, because light is weak, a multi-frame processing scheme is generally adopted to improve the signal-to-noise ratio of an image, such as an algorithm scheme of 3D denoising (3DNR), High-Dynamic Range image (HDR), and the like.
However, in a highlight scene, captured Image data is blurred due to problems such as manual shooting, and a clear picture cannot be obtained through processing of an Image Signal Processor (ISP); under the low-brightness scene, although the signal-to-noise ratio of the image can be improved by adopting a multi-frame processing mode, the capturing of multi-frame image data and the processing algorithm have higher complexity, so that the shooting time is longer, and the user experience is greatly influenced.
Disclosure of Invention
The technical problem solved by the invention is how to improve the image processing effect.
In order to solve the foregoing technical problem, an embodiment of the present invention provides an image processing method, where the image processing method includes: acquiring a preview image, and caching a plurality of frames of preview images; responding to the pressing of a photographing key, and selecting an image with the highest definition from the buffered multi-frame preview images; determining the ambient brightness according to the preview image, and judging the scene type of the current scene according to the ambient brightness; and at least using the image with the highest definition for image signal processing according to the scene type to obtain a processed image.
Optionally, the using, according to the scene type, at least the image with the highest sharpness for image signal processing includes: and when the scene type is a highlight scene, using the image with the highest definition for image signal processing, wherein the ambient brightness under the highlight scene is greater than a preset threshold.
Optionally, the using the image with the highest definition for image signal processing includes: acquiring the identifier of the image with the highest definition; and taking the image with the highest definition from the multi-frame preview images cached according to the identification for image signal processing.
Optionally, the using, according to the scene type, at least the image with the highest sharpness for image signal processing includes: capturing a plurality of frames of images when the scene type is a low-brightness scene, wherein the ambient brightness under the low-brightness scene is lower than a preset threshold; performing multi-frame image fusion on the captured multi-frame images, the cached multi-frame preview images and the selected image with the highest definition; and using the fused image for image signal processing.
Optionally, the capturing multiple frames of images includes: determining the frame number to be captured according to the brightness value of the environment brightness in the low-brightness scene, wherein the brightness value and the frame number have a corresponding relation; and capturing a plurality of frames of images according to the frame number required to be captured.
Optionally, the image processing method further includes: and at least transmitting the image with the highest definition to an image signal processor so that the image signal processor can process the received image.
Optionally, the determining the ambient brightness according to the preview image includes: acquiring the ambient brightness measured by an ambient light sensor; or selecting a light metering area in the preview image, and calculating a brightness average value or a weighted average value of the preview image in the light metering area as the environment brightness; or determining a brightness histogram of the preview image, and calculating a brightness ratio of the brightness histogram in a preset brightness threshold range and a darkness ratio of the brightness histogram in a preset darkness threshold range, wherein the brightness ratio and the darkness ratio are used as the ambient brightness.
In order to solve the above technical problem, an embodiment of the present invention further discloses an image processing apparatus, including: the image acquisition module is used for acquiring the preview image and caching the multi-frame preview image; the selecting module is used for responding to the fact that a photographing key is pressed down and selecting an image with the highest definition from the buffered multi-frame preview images; the type determining module is used for determining the ambient brightness according to the preview image and judging the scene type of the current scene according to the ambient brightness; and the image processing module is used for at least using the image with the highest definition for image signal processing according to the scene type so as to obtain a processed image.
The embodiment of the invention also discloses a computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and the computer program executes the steps of the image processing method when being executed by a processor.
The embodiment of the invention also discloses a terminal which comprises a memory and a processor, wherein the memory is stored with a computer program which can be run on the processor, and the processor executes the steps of the image processing method when running the computer program.
Compared with the prior art, the technical scheme of the embodiment of the invention has the following beneficial effects:
according to the technical scheme, the multi-frame preview image is cached, so that the image with the highest definition can be immediately started to be selected after the photographing key is pressed, and the photographing speed can be increased; the image with the highest definition is used for image signal processing, so that the problem of image blurring caused in a highlight scene can be solved, and the image definition is improved. Under the low-brightness scene, the photographing process is optimized on the basis of ensuring the effect of the original scheme, and the photographing performance is improved.
Further, when the scene type is a low-brightness scene, capturing a plurality of frames of images, wherein the ambient brightness under the low-brightness scene is greater than a preset threshold; performing multi-frame image fusion on the captured multi-frame images, the cached multi-frame preview images and the selected image with the highest definition; and using the fused image for image signal processing. In the technical scheme of the invention, the time for acquiring the fused image can be reduced and the response speed is improved by caching the multi-frame preview image and participating in the fusion of the multi-frame image; in addition, the most clear image is selected to participate in multi-frame image fusion, so that the denoising effect of the image fusion can be improved, and more details are kept while denoising is performed.
Drawings
FIG. 1 is a flow chart of a method of image processing according to an embodiment of the invention;
FIG. 2 is a flowchart of one embodiment of step S104 shown in FIG. 1;
FIG. 3 is a flow chart of another image processing method according to an embodiment of the invention;
fig. 4 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
Detailed Description
As described in the background art, in a highlight scene, captured Image data is blurred due to problems such as manual shooting, and a clear picture cannot be obtained through processing by an Image Signal Processor (ISP); under the low-brightness scene, although the signal-to-noise ratio of the image can be improved by adopting a multi-frame processing mode, the capturing of multi-frame image data and the processing algorithm have higher complexity, so that the shooting time is longer, and the user experience is greatly influenced.
According to the technical scheme, the multi-frame preview image is cached, so that the image with the highest definition can be immediately started to be selected after the photographing key is pressed, and the photographing speed can be increased; the image with the highest definition is used for image signal processing, so that the problem of image blurring caused in a highlight scene can be solved, and the image definition is improved. Under the low-brightness scene, the photographing process is optimized on the basis of ensuring the effect of the original scheme, and the photographing performance is improved.
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below.
Fig. 1 is a flowchart of an image processing method according to an embodiment of the present invention.
The image processing method of the technical scheme of the invention can be used on the side of the terminal equipment, namely, the terminal equipment can execute each step of the method when photographing. The terminal equipment has a photographing function and can be a mobile phone, a computer, a tablet computer and the like.
Specifically, the image processing method may include the steps of:
step S101: acquiring a preview image, and caching a plurality of frames of preview images;
step S102: responding to the pressing of a photographing key, and selecting an image with the highest definition from the buffered multi-frame preview images;
step S103: determining the ambient brightness according to the preview image, and judging the scene type of the current scene according to the ambient brightness;
step S104: and at least using the image with the highest definition for image signal processing according to the scene type to obtain a processed image.
It should be noted that the sequence numbers of the steps in this embodiment do not represent a limitation on the execution sequence of the steps.
In an embodiment of the present invention, the preview image may be obtained from an image sensor (sensor). The preview image can be a single picture or a frame of image in a video stream.
In a specific application scene, a camera and a photographing key are arranged on the terminal equipment side. And the picture captured after the user opens the camera is a preview image and is used for displaying a real-time image to the user. After the user presses the photographing key, the image captured by the camera is stored locally in the terminal.
In the embodiment of the invention, after the preview image is acquired, the multi-frame preview image can be cached. Specifically, the preview images may be cached in any implementable memory, and the number of the cached preview images may be set according to an actual application scenario, for example, may be any number greater than 1, which is not limited in this embodiment of the present invention.
In one embodiment, the multiple frames of preview images are cached in a Double Data Rate (Double Data Rate) memory.
In the specific implementation of step S102, after the user presses the photo key, the pick-up algorithm is triggered to be executed, that is, the process of selecting the image with the highest definition from the multiple frames of preview images is triggered to be executed. Specifically, the result output by the culling algorithm may be an identifier of the image with the highest definition, for example, the frame number of the image with the highest definition, and the image with the highest definition is still stored in the buffer.
Specifically, the number of images with the highest sharpness is 1.
In a specific embodiment, the algorithm principle of the picking algorithm is similar to that of reference frame selection, that is, a frame with higher definition is selected as a reference frame, so that the definition of the final photographing is improved. At the time of taking out the film, selection may be made based on gradient information (for sharpness determination) of the image or the like. Further, when picking up the film, the frame capturing time point can be comprehensively considered, for example, when taking the zero-delay photo, the frame which is closest to the time when the photo key is pressed and has higher definition (for example, the definition is greater than the preset threshold) is selected as much as possible. Or selecting a fixed frame, such as selecting the last frame, the first frame, or an intermediate frame when capturing N frames of images. The pick algorithm is a step used in the multi-frame synthesis algorithm scheme.
It should be noted that, as for the specific principle of selecting the image with the highest definition by the picking algorithm, reference may be made to the prior art, and details thereof are not described herein.
In a specific implementation of step S103, the ambient brightness may be determined according to the preview image, so as to determine the scene type of the current scene. The scene types may include a highlight scene and a low-light scene. Different image processing flows may be performed in subsequent steps depending on the type of scene.
In a specific embodiment, the ambient brightness in the highlight scene is greater than a preset threshold, and the ambient brightness in the low-brightness scene is lower than the preset threshold. That is, when the ambient brightness is greater than the preset threshold, determining that the current scene is a highlight scene; otherwise, when the ambient brightness is smaller than the preset threshold, the current scene is determined to be a low-brightness scene. Specifically, the ambient brightness may be calculated by selecting a photometric area to calculate an average or a weighted average of images output from a sensor of the current scene.
In another specific implementation, a histogram is counted for an image output by a sensor of a current scene, a ratio of a bright area to a dark area of the histogram is calculated, and the ratio is compared with a preset ratio to judge a scene type to which the current scene belongs. For example, a bright area threshold and a dark area threshold are set, and the histogram occupation ratio within the bright area threshold (referred to as a bright area occupation ratio) and the histogram occupation ratio within the dark area threshold (referred to as a dark area occupation ratio) are counted respectively, wherein a bright area occupation ratio larger than the first threshold is regarded as a highlight scene, and a dark area occupation ratio larger than the second threshold is regarded as a low-brightness scene, etc.
In another embodiment, the scene brightness may also be directly determined according to the ambient light sensor.
It should be understood by those skilled in the art that, in addition to the above-described method for determining the scene type, any other implementable method may be used to determine the scene type, and the embodiment of the present invention is not limited thereto.
In the specific implementation of step S104, at least the image with the highest definition is used for image signal processing according to different scene types to obtain a processed image.
In the embodiment of the invention, through caching the multi-frame preview images, the images with the highest definition can be immediately started and selected after the photographing key is pressed, and the photographing speed can be improved; the image with the highest definition is used for image signal processing, so that the problem of image blurring caused in a highlight scene can be solved, and the image definition is improved. Under the low-brightness scene, the photographing process is optimized on the basis of ensuring the effect of the original scheme, and the photographing performance is improved.
In a non-limiting embodiment of the present invention, at least the image with the highest definition is transmitted to an image signal processor for the image signal processor to process the received image, and the processed image is an encoded JPEG image.
In this embodiment, the image signal processing process is a process in which the image signal processor processes the received image.
In one non-limiting embodiment of the present invention, step S104 shown in fig. 1 may include the following steps: and when the scene type is a highlight scene, using the image with the highest definition for image signal processing, wherein the ambient brightness under the highlight scene is greater than a preset threshold.
In this embodiment, in a highlight scene, the image with the highest definition is used for image signal processing. Compared with the image blurring problem caused by the single-frame processing mode adopted in the highlight scene in the prior art, the image sharpness can be improved through the processes of caching and selecting the image with the highest sharpness.
Further, acquiring the identifier of the image with the highest definition; and taking the image with the highest definition from the multi-frame preview images cached according to the identification for image signal processing.
As mentioned above, the multiple frames of preview images are buffered in the memory, and the identifier of the image with the highest definition, such as the frame number, is obtained when the image with the highest definition is selected. So that the image with the highest definition needs to be extracted from the buffer according to the frame number.
In a non-limiting embodiment of the present invention, referring to fig. 2, step S104 shown in fig. 1 may include the following steps:
step S201: capturing a plurality of frames of images when the scene type is a low-brightness scene, wherein the ambient brightness under the low-brightness scene is lower than a preset threshold;
step S202: performing multi-frame image fusion on the captured multi-frame images, the cached multi-frame preview images and the selected image with the highest definition;
step S203: and using the fused image for image signal processing.
In this embodiment, in a low-brightness scene, more images may be captured, and multi-frame image fusion may be performed on the captured multi-frame images, the cached multi-frame preview images, and the selected image with the highest definition. Specifically, the multi-frame fusion algorithm adopted by the frame image fusion may be a Raw domain algorithm or a color space algorithm such as a YUV domain algorithm, which is not limited in this embodiment of the present invention.
In specific implementation, the multi-frame image fusion may be multi-frame fusion of equal exposure images, multi-frame denoising is realized by using multi-frame input information, and an image which has the same brightness as the multi-frame input image and smaller noise is synthesized. The specific fusion process includes multi-frame (global or local) alignment and multi-frame denoising, and denoising may adopt an existing technique (for example, various filtering methods), and the embodiment of the present invention does not limit this.
By caching the multi-frame preview images and participating in multi-frame image fusion, the time for acquiring the fused images can be reduced, and the response speed is improved; in addition, the most clear image is selected to participate in multi-frame image fusion, so that the denoising effect of the image fusion can be improved, and more details are kept while denoising is performed.
In addition, because the multi-frame preview images are cached, after the user presses down to take a picture, the picking algorithm can be started, and the picking algorithm and the picking of more frames of images are multiplexed in time, so that the shooting speed is further improved, and better user experience is obtained.
Further, when capturing multiple frames of images, determining the number of frames to be captured according to the brightness value of the environment brightness in the low-brightness scene, wherein the brightness value and the number of frames have a corresponding relationship; and capturing a plurality of frames of images according to the frame number required to be captured.
In this embodiment, the number of frames of captured images may be calculated adaptively according to the scene brightness, and the lower the brightness, the fewer the number of captured frames of the scene, the higher the brightness, the more the number of captured frames of the scene.
In a non-limiting embodiment of the present invention, please refer to fig. 3, and fig. 3 shows a flow of an image processing method in a specific application scenario.
The hardware components involved in the embodiments of the present invention are the image sensor 30, the memory 31, and the ISP 32. The memory 31 buffers 4 frames of images in real time. Of course, any other implementable number of images may be cached, which is not limited in this embodiment of the present invention.
In a specific implementation, the image sensor 30 outputs 4 frames of preview images to the memory 31 for buffering.
In step S301, the image with the highest resolution is selected. That is, after the user presses the photographing key, the picking algorithm is started immediately, the algorithm is input into any frame number with the number larger than 1, and the serial number of the clearest frame is output through the processing of the picking algorithm.
In step S302, the ambient brightness is calculated. Specifically, the ambient brightness may be calculated from the preview image real-time path data output by the image sensor 30.
In step S303, it is determined whether the current scene is a highlight scene, and if so, the process proceeds to step S304, otherwise, the process proceeds to step S305.
In step S304, the image with the highest resolution is extracted. That is, in a highlight scene, according to the frame number output by the picking algorithm, the corresponding frame is found from the data cached in the memory 31 and is transmitted to the ISP32 for processing.
It should be noted that, as for the specific process of processing the image by the ISP, reference may be made to a common photographing process in the prior art, which is not described herein again.
In step S305, more frame images are captured. And the captured frame number is obtained by self-adaptive calculation according to the scene brightness, the higher the brightness is, the smaller the captured frame number is, and the lower the brightness is, the more the captured frame number is.
In step S306, multi-frame image fusion is performed. Specifically, the data cached in the memory 31, the image selected in step S301 and the image captured in step S305 may be output to a multi-frame fusion algorithm library for multi-frame algorithm fusion, and the multi-frame fusion algorithm may be a Raw domain algorithm or a color space algorithm such as a YUV domain.
In a specific implementation, the image processed by the ISP32 may be an encoded JPEG image. The ISP32 may also perform video encoding on the preview image and output the preview image. The ISP32 may output the processed image to a display unit for display; or the ISP32 may output the processed image to a storage unit for storage.
Referring to fig. 4, an embodiment of the invention further discloses an image processing apparatus. The image processing apparatus 40 may include:
the image acquisition module 401 is configured to acquire a preview image and cache multiple frames of preview images;
a selecting module 402, configured to select, in response to a photographing key being pressed, an image with a highest definition from the buffered multiple frames of preview images;
a type determining module 403, configured to determine ambient brightness according to the preview image, and determine a scene type to which a current scene belongs according to the ambient brightness;
an image processing module 404, configured to use at least the image with the highest definition for image signal processing according to the scene type to obtain a processed image.
In the embodiment of the invention, through caching the multi-frame preview images, the images with the highest definition can be immediately started and selected after the photographing key is pressed, and the photographing speed can be improved; the image with the highest definition is used for image signal processing, so that the problem of image blurring caused in a highlight scene can be solved, and the image definition is improved. Under the low-brightness scene, the photographing process is optimized on the basis of ensuring the effect of the original scheme, and the photographing performance is improved.
Further, when the scene type is a low-brightness scene, capturing a plurality of frames of images, wherein the ambient brightness under the low-brightness scene is greater than a preset threshold; performing multi-frame image fusion on the captured multi-frame images, the cached multi-frame preview images and the selected image with the highest definition; and using the fused image for image signal processing. In the embodiment of the invention, the time for acquiring the fused image can be reduced and the response speed is improved by caching the multi-frame preview image and participating in the fusion of the multi-frame image; in addition, the most clear image is selected to participate in multi-frame image fusion, so that the denoising effect of the image fusion can be improved, and more details are kept while denoising is performed.
For more details of the operation principle and the operation mode of the image processing apparatus 40, reference may be made to the description in fig. 1 to 3, which is not repeated here.
In a specific implementation, the image processing apparatus 40 may correspond to a Chip having an image processing function in a terminal device, such as a System-On-a-Chip (SoC), a baseband Chip, or the like; or the terminal device comprises a chip module with an image processing function; or to a chip module having a chip with a data processing function, or to a terminal device.
Each module/unit included in each apparatus and product described in the above embodiments may be a software module/unit, or may also be a hardware module/unit, or may also be a part of a software module/unit and a part of a hardware module/unit. For example, for each device or product applied to or integrated into a chip, each module/unit included in the device or product may be implemented by hardware such as a circuit, or at least a part of the module/unit may be implemented by a software program running on a processor integrated within the chip, and the rest (if any) part of the module/unit may be implemented by hardware such as a circuit; for each device or product applied to or integrated with the chip module, each module/unit included in the device or product may be implemented by using hardware such as a circuit, and different modules/units may be located in the same component (e.g., a chip, a circuit module, etc.) or different components of the chip module, or at least some of the modules/units may be implemented by using a software program running on a processor integrated within the chip module, and the rest (if any) of the modules/units may be implemented by using hardware such as a circuit; for each device and product applied to or integrated in the terminal, each module/unit included in the device and product may be implemented by using hardware such as a circuit, and different modules/units may be located in the same component (e.g., a chip, a circuit module, etc.) or different components in the terminal, or at least part of the modules/units may be implemented by using a software program running on a processor integrated in the terminal, and the rest (if any) part of the modules/units may be implemented by using hardware such as a circuit.
The embodiment of the invention also discloses a storage medium, which is a computer-readable storage medium and stores a computer program thereon, and the computer program can execute the steps of the image processing method shown in fig. 1, fig. 2 or fig. 3 when running. The storage medium may include ROM, RAM, magnetic or optical disks, etc. The storage medium may further include a non-volatile memory (non-volatile) or a non-transitory memory (non-transient), and the like.
The embodiment of the invention also discloses terminal equipment which can comprise a memory and a processor, wherein the memory is stored with a computer program which can run on the processor. The processor, when running the computer program, may perform the steps of the image processing method shown in fig. 1, 2 or 3. The user equipment includes but is not limited to a mobile phone, a computer, a tablet computer and other terminal equipment.
The "plurality" appearing in the embodiments of the present application means two or more.
It should be understood that, in the embodiment of the present application, the processor may be a Central Processing Unit (CPU), and the processor may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, the above-described embodiments may be implemented in whole or in part in the form of a computer program product. The computer program product comprises one or more computer instructions or computer programs. The procedures or functions according to the embodiments of the present application are wholly or partially generated when the computer instructions or the computer program are loaded or executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire or wirelessly. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more collections of available media.
It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
In the several embodiments provided in the present application, it should be understood that the disclosed method, apparatus and system may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative; for example, the division of the unit is only a logic function division, and there may be another division manner in actual implementation; for example, various elements or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately provided, or two or more units may be integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Although the present invention is disclosed above, the present invention is not limited thereto. Various changes and modifications may be effected therein by one skilled in the art without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (10)
1. An image processing method, comprising:
acquiring a preview image, and caching a plurality of frames of preview images;
responding to the pressing of a photographing key, and selecting an image with the highest definition from the buffered multi-frame preview images;
determining the ambient brightness according to the preview image, and judging the scene type of the current scene according to the ambient brightness;
and at least using the image with the highest definition for image signal processing according to the scene type to obtain a processed image.
2. The image processing method according to claim 1, wherein said using at least the highest-definition image for image signal processing according to the scene type comprises:
and when the scene type is a highlight scene, using the image with the highest definition for image signal processing, wherein the ambient brightness under the highlight scene is greater than a preset threshold.
3. The image processing method according to claim 2, wherein said using the highest resolution image for image signal processing comprises:
acquiring the identifier of the image with the highest definition;
and taking the image with the highest definition from the multi-frame preview images cached according to the identification for image signal processing.
4. The image processing method according to claim 1, wherein said using at least the highest-definition image for image signal processing according to the scene type comprises:
capturing a plurality of frames of images when the scene type is a low-brightness scene, wherein the ambient brightness under the low-brightness scene is lower than a preset threshold;
performing multi-frame image fusion on the captured multi-frame images, the cached multi-frame preview images and the selected image with the highest definition;
and using the fused image for image signal processing.
5. The image processing method according to claim 4, wherein the capturing the multiple frames of images comprises:
determining the number of frames to be captured according to the brightness value of the environment brightness in the low-brightness scene, wherein the brightness value and the number of frames to be captured have a corresponding relation;
and capturing a plurality of frames of images according to the frame number required to be captured.
6. The image processing method according to claim 1, further comprising:
and at least transmitting the image with the highest definition to an image signal processor so that the image signal processor can process the received image.
7. The method of claim 1, wherein determining the ambient brightness from the preview image comprises:
acquiring the ambient brightness measured by an ambient light sensor according to the preview image;
or selecting a light metering area in the preview image, and calculating a brightness average value or a weighted average value of the preview image in the light metering area as the environment brightness;
or determining a brightness histogram of the preview image, calculating a brightness duty ratio of the brightness histogram in a preset brightness threshold range and a darkness duty ratio of the brightness histogram in a preset darkness threshold range, and taking the brightness duty ratio and the darkness duty ratio as the ambient brightness.
8. An image processing apparatus characterized by comprising:
the image acquisition module is used for acquiring the preview image and caching the multi-frame preview image;
the selecting module is used for responding to the fact that a photographing key is pressed down and selecting an image with the highest definition from the buffered multi-frame preview images;
the type determining module is used for determining the ambient brightness according to the preview image and judging the scene type of the current scene according to the ambient brightness;
and the image processing module is used for at least using the image with the highest definition for image signal processing according to the scene type so as to obtain a processed image.
9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the image processing method according to any one of claims 1 to 7.
10. A terminal comprising a memory and a processor, the memory having stored thereon a computer program operable on the processor, wherein the processor, when executing the computer program, performs the steps of the image processing method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110688777.1A CN113259594A (en) | 2021-06-22 | 2021-06-22 | Image processing method and device, computer readable storage medium and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110688777.1A CN113259594A (en) | 2021-06-22 | 2021-06-22 | Image processing method and device, computer readable storage medium and terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113259594A true CN113259594A (en) | 2021-08-13 |
Family
ID=77188977
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110688777.1A Pending CN113259594A (en) | 2021-06-22 | 2021-06-22 | Image processing method and device, computer readable storage medium and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113259594A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113938602A (en) * | 2021-09-08 | 2022-01-14 | 荣耀终端有限公司 | Image processing method, electronic device, chip and readable storage medium |
| CN117689559A (en) * | 2023-08-07 | 2024-03-12 | 上海荣耀智慧科技开发有限公司 | Image fusion method and device, electronic equipment and storage medium |
| CN117692753A (en) * | 2023-08-25 | 2024-03-12 | 上海荣耀智慧科技开发有限公司 | Photographing method and electronic equipment |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101330576A (en) * | 2007-06-19 | 2008-12-24 | 奥林巴斯映像株式会社 | Image display apparatus, image pickup apparatus, image reproducing apparatus, and image displaying method |
| US20120133797A1 (en) * | 2010-11-30 | 2012-05-31 | Aof Imaging Technology, Co., Ltd. | Imaging apparatus, imaging method and computer program |
| CN103051837A (en) * | 2012-12-17 | 2013-04-17 | 广东欧珀移动通信有限公司 | Method and device for improving effect of camera shooting in dark |
| CN103888683A (en) * | 2014-03-24 | 2014-06-25 | 深圳市中兴移动通信有限公司 | Mobile terminal and shooting method thereof |
| CN107172296A (en) * | 2017-06-22 | 2017-09-15 | 维沃移动通信有限公司 | A kind of image capturing method and mobile terminal |
| CN107360369A (en) * | 2017-07-18 | 2017-11-17 | 深圳天珑无线科技有限公司 | The photographic method of camera device and camera device, storage device |
| CN107509034A (en) * | 2017-09-22 | 2017-12-22 | 维沃移动通信有限公司 | A kind of image pickup method and mobile terminal |
| CN109089041A (en) * | 2018-08-22 | 2018-12-25 | Oppo广东移动通信有限公司 | Recognition methods, device, electronic equipment and the storage medium of photographed scene |
| CN109618102A (en) * | 2019-01-28 | 2019-04-12 | Oppo广东移动通信有限公司 | Focusing process method, apparatus, electronic equipment and storage medium |
| CN110049244A (en) * | 2019-04-22 | 2019-07-23 | 惠州Tcl移动通信有限公司 | Image pickup method, device, storage medium and electronic equipment |
| CN110290325A (en) * | 2019-06-28 | 2019-09-27 | Oppo广东移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN110536068A (en) * | 2019-09-29 | 2019-12-03 | Oppo广东移动通信有限公司 | Focusing method and device, electronic equipment, computer readable storage medium |
-
2021
- 2021-06-22 CN CN202110688777.1A patent/CN113259594A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101330576A (en) * | 2007-06-19 | 2008-12-24 | 奥林巴斯映像株式会社 | Image display apparatus, image pickup apparatus, image reproducing apparatus, and image displaying method |
| US20120133797A1 (en) * | 2010-11-30 | 2012-05-31 | Aof Imaging Technology, Co., Ltd. | Imaging apparatus, imaging method and computer program |
| CN103051837A (en) * | 2012-12-17 | 2013-04-17 | 广东欧珀移动通信有限公司 | Method and device for improving effect of camera shooting in dark |
| CN103888683A (en) * | 2014-03-24 | 2014-06-25 | 深圳市中兴移动通信有限公司 | Mobile terminal and shooting method thereof |
| CN107172296A (en) * | 2017-06-22 | 2017-09-15 | 维沃移动通信有限公司 | A kind of image capturing method and mobile terminal |
| CN107360369A (en) * | 2017-07-18 | 2017-11-17 | 深圳天珑无线科技有限公司 | The photographic method of camera device and camera device, storage device |
| CN107509034A (en) * | 2017-09-22 | 2017-12-22 | 维沃移动通信有限公司 | A kind of image pickup method and mobile terminal |
| CN109089041A (en) * | 2018-08-22 | 2018-12-25 | Oppo广东移动通信有限公司 | Recognition methods, device, electronic equipment and the storage medium of photographed scene |
| CN109618102A (en) * | 2019-01-28 | 2019-04-12 | Oppo广东移动通信有限公司 | Focusing process method, apparatus, electronic equipment and storage medium |
| CN110049244A (en) * | 2019-04-22 | 2019-07-23 | 惠州Tcl移动通信有限公司 | Image pickup method, device, storage medium and electronic equipment |
| CN110290325A (en) * | 2019-06-28 | 2019-09-27 | Oppo广东移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN110536068A (en) * | 2019-09-29 | 2019-12-03 | Oppo广东移动通信有限公司 | Focusing method and device, electronic equipment, computer readable storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113938602A (en) * | 2021-09-08 | 2022-01-14 | 荣耀终端有限公司 | Image processing method, electronic device, chip and readable storage medium |
| CN113938602B (en) * | 2021-09-08 | 2022-08-02 | 荣耀终端有限公司 | Image processing method, electronic device, chip and readable storage medium |
| CN117689559A (en) * | 2023-08-07 | 2024-03-12 | 上海荣耀智慧科技开发有限公司 | Image fusion method and device, electronic equipment and storage medium |
| CN117692753A (en) * | 2023-08-25 | 2024-03-12 | 上海荣耀智慧科技开发有限公司 | Photographing method and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108898567B (en) | Image noise reduction method, device and system | |
| CN108335279B (en) | Image fusion and HDR imaging | |
| CN113992861B (en) | Image processing method and image processing device | |
| US9591237B2 (en) | Automated generation of panning shots | |
| CN114584849B (en) | Video quality evaluation method, device, electronic equipment and computer storage medium | |
| US9118841B2 (en) | Determining an image capture payload burst structure based on a metering image capture sweep | |
| CN106713755B (en) | Panoramic image processing method and device | |
| WO2017215501A1 (en) | Method and device for image noise reduction processing and computer storage medium | |
| JP6742732B2 (en) | Method for generating HDR image of scene based on trade-off between luminance distribution and motion | |
| CN113259594A (en) | Image processing method and device, computer readable storage medium and terminal | |
| CN111028189A (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US20180109711A1 (en) | Method and device for overexposed photography | |
| WO2014099284A1 (en) | Determining exposure times using split paxels | |
| US9087391B2 (en) | Determining an image capture payload burst structure | |
| CN107704798B (en) | Image blurring method and device, computer readable storage medium and computer device | |
| Gryaditskaya et al. | Motion aware exposure bracketing for HDR video | |
| CN110728705B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN111385484B (en) | Information processing method and device | |
| CN110717871A (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN114820405A (en) | Image fusion method, device, equipment and computer readable storage medium | |
| CN110740266B (en) | Image frame selection method and device, storage medium and electronic equipment | |
| CN110278375B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN107454328B (en) | Image processing method, device, computer readable storage medium and computer equipment | |
| CN113744139A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN112055255B (en) | Shooting image quality optimization method and device, smart television and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210813 |
|
| RJ01 | Rejection of invention patent application after publication |