CN110581956A

CN110581956A - Image processing method, image processing device, storage medium and electronic equipment

Info

Publication number: CN110581956A
Application number: CN201910791501.9A
Authority: CN
Inventors: 晏秀梅
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2019-08-26
Filing date: 2019-08-26
Publication date: 2019-12-17

Abstract

the application discloses an image processing method, an image processing device, a storage medium and an electronic device, wherein the method comprises the following steps: respectively controlling a plurality of micro-lens to shoot a current scene to obtain a plurality of sub-images, wherein the plurality of sub-images respectively correspond to different areas of the current scene, obtaining image parameters respectively corresponding to the plurality of sub-images, aligning the brightness of the plurality of sub-images according to the image parameters to enable the brightness of the plurality of sub-images to be the same, and splicing the plurality of sub-images after the brightness alignment to generate a high dynamic range image of the current scene. The embodiment of the application shoots simultaneously through a plurality of micro-lenses to carry out luminance alignment and splice a pair of high dynamic image afterwards, can effectively promote the high dynamic range effect that the image was shot, and still promoted shooting efficiency.

Description

image processing method, image processing device, storage medium and electronic equipment

Technical Field

The present application belongs to the field of photographing technologies, and in particular, to an image processing method and apparatus, a storage medium, and an electronic device.

Background

With the development of electronic technology, High Dynamic Range (HDR) imaging technology is gradually popularized in electronic devices with a photographing function, such as smart phones and digital cameras, and can provide more Dynamic Range and image details than common images, and a final HDR image is synthesized by using LDR images with optimal details corresponding to each exposure time according to LDR (Low-Dynamic Range) images with different exposure times.

at present, most of equipment generates images with high dynamic range by adopting a multi-frame short exposure or a surrounding exposure mode for exposure. However, regardless of whether the exposure mode adopts multi-frame short exposure or surround exposure, shooting is usually performed for multiple times according to different exposure parameters, and finally synthesis is performed, so that the problem of blurring is easily caused under the condition of a moving scene, and the time of the whole scheme is too long due to the fact that multi-frame images are needed, and the shooting efficiency is low.

Disclosure of Invention

The application provides an image processing method, an image processing device, a storage medium and an electronic device, which can improve the high dynamic range effect of image shooting and improve shooting efficiency. .

In a first aspect, an embodiment of the present application provides an image processing method applied to an electronic device, where the electronic device includes a plurality of microlenses, and the method includes:

Respectively controlling the plurality of micro-mirror heads to shoot a current scene to obtain a plurality of sub-images, wherein the plurality of sub-images respectively correspond to different areas of the current scene;

Acquiring image parameters corresponding to the plurality of sub-images respectively;

Performing brightness alignment on the multiple sub-images according to the image parameters so as to enable the brightness of the multiple sub-images to be the same;

and splicing the multiple sub-images with aligned brightness to generate a high dynamic range image of the current scene.

in a second aspect, an embodiment of the present application provides an image processing apparatus applied to an electronic device, where the electronic device includes a plurality of microlenses, including:

the shooting module is used for respectively controlling the plurality of micro-lenses to shoot the current scene so as to obtain a plurality of sub-images, wherein the plurality of sub-images respectively correspond to different areas of the current scene;

The acquisition module is used for acquiring image parameters corresponding to the plurality of sub-images;

The alignment module is used for aligning the brightness of the sub-images according to the image parameters so as to enable the brightness of the sub-images to be the same;

And the splicing module is used for splicing the plurality of sub-images after the brightness alignment so as to generate a high dynamic range image of the current scene.

In a third aspect, an embodiment of the present application provides a storage medium having a computer program stored thereon, which, when run on a computer, causes the computer to perform the above-mentioned image processing method.

In a fourth aspect, an embodiment of the present application provides an electronic device, including a processor and a memory, where the memory stores a plurality of instructions, and the processor loads the instructions in the memory to perform the following steps:

The image processing method provided by the embodiment of the application can respectively control the multiple micro-mirror heads to shoot the current scene to obtain multiple sub-images, wherein the multiple sub-images respectively correspond to different areas of the current scene, image parameters respectively corresponding to the multiple sub-images are obtained, the multiple sub-images are subjected to brightness alignment according to the image parameters to enable the brightness of the multiple sub-images to be the same, and the multiple sub-images after the brightness alignment are spliced to generate the high dynamic range image of the current scene. The embodiment of the application shoots simultaneously through a plurality of micro-lenses to carry out luminance alignment and splice a pair of high dynamic image afterwards, can effectively promote the high dynamic range effect that the image was shot, and still promoted shooting efficiency.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic flowchart of an image processing method according to an embodiment of the present disclosure.

Fig. 2 is another schematic flow chart of an image processing method according to an embodiment of the present application.

Fig. 3 is a scene schematic diagram of an image processing method according to an embodiment of the present application.

Fig. 4 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application.

Fig. 5 is another schematic structural diagram of an image processing apparatus according to an embodiment of the present application.

Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

fig. 7 is another schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

referring to the drawings, wherein like reference numbers refer to like elements, the principles of the present application are illustrated as being implemented in a suitable computing environment. The following description is based on illustrated embodiments of the application and should not be taken as limiting the application with respect to other embodiments that are not detailed herein.

In the description that follows, specific embodiments of the present application will be described with reference to steps and symbols executed by one or more computers, unless otherwise indicated. Accordingly, these steps and operations will be referred to, several times, as being performed by a computer, the computer performing operations involving a processing unit of the computer in electronic signals representing data in a structured form. This operation transforms the data or maintains it at locations in the computer's memory system, which may be reconfigured or otherwise altered in a manner well known to those skilled in the art. The data maintains a data structure that is a physical location of the memory that has particular characteristics defined by the data format. However, while the principles of the application have been described in language specific to above, it is not intended to be limited to the specific form set forth herein, and it will be recognized by those of ordinary skill in the art that various of the steps and operations described below may be implemented in hardware.

the terms "first", "second", and "third", etc. in this application are used to distinguish between different objects and not to describe a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or modules is not limited to only those steps or modules listed, but rather, some embodiments may include other steps or modules not listed or inherent to such process, method, article, or apparatus.

referring to fig. 1, fig. 1 is a schematic flow chart of an image processing method according to an embodiment of the present disclosure. The image processing method provided by the embodiment of the application is applied to the electronic equipment, and the specific flow can be as follows:

Step 101, respectively controlling a plurality of micro-lenses to shoot a current scene to obtain a plurality of sub-images, wherein the plurality of sub-images respectively correspond to different areas of the current scene.

in an embodiment, the plurality of microlenses may be provided in the electronic device itself, for example, a plurality of microlenses are disposed on a rear shell of the electronic device, or may be an external device, for example, the external device may be connected to the electronic device through a data connection line, and then the plurality of external microlenses are called through an application program in the electronic device to perform shooting.

In an embodiment, the image processing method may be implemented in a scene of taking a picture on an electronic device. When a user wants to take a picture, an imaging device of the equipment is started, wherein the imaging device can be a front camera, a rear camera and the like, and the imaging device comprises a plurality of micro lenses. Starting an imaging device of the electronic equipment, enabling the imaging device to enter a photographing preview mode, displaying a photographed scene in a display window of the electronic equipment, and defining a picture displayed by the display window at the moment as a preview image.

among them, the imaging device generally includes five parts in hardware: a housing (motor), a lens, an infrared filter, an image sensor (e.g., CCD or COMS), and a Flexible Printed Circuit Board (FPCB), etc. In the shooting preview mode, in the process of displaying a preview image, the lens is driven by the motor to move, and a shot object passes through the lens to be imaged on the image sensor. The image sensor converts the optical signal into an electric signal through optical-electric conversion and transmits the electric signal to the image processing circuit for subsequent processing. The Image Processing circuit may be implemented using hardware and/or software components, and may include various Processing units that define an ISP (Image Signal Processing) pipeline.

In the embodiment of the present application, after the multiple micro-lenses are controlled to shoot the current scene, the sub-images of different areas of the current scene are obtained, where each micro-lens corresponds to an area of the current scene, it should be noted that the different areas of the current scene respectively corresponding to the multiple micro-lenses may include a partial overlapping area.

in an embodiment, the multiple microlenses may use different exposure parameters to respectively perform shooting, for example, the exposure parameter corresponding to each microlens may be obtained first, and then the current scene is shot according to the exposure parameter. The sub-images may be a plurality of RAW images captured by an image sensor of the electronic device, where RAW is in an unprocessed format, and RAW images are RAW data obtained by converting captured light source signals into digital signals by the image sensor.

Step 102, obtaining image parameters corresponding to a plurality of sub-images respectively.

In an embodiment, the image parameter may include a brightness value, for example, brightness values corresponding to the plurality of sub-images are obtained, specifically, brightness values of all pixel points in the sub-images may be obtained first to obtain a brightness value set, and then a first average brightness value is determined according to the brightness value set as the brightness value of the sub-image.

In an embodiment, for example, the first average brightness value of the brightness value set may be obtained by first adding the brightness of all the pixels in the brightness value set and then dividing the sum by the number of the pixels in the set. However, the method has large calculation amount, but the calculation result is accurate.

In other embodiments, the maximum brightness value of the pixels having the same brightness value in the brightness value set may also be determined to be the first average brightness value, for example, if the original image includes 10000 pixels, and if the brightness values of 800 pixels are all 700nit, the maximum brightness value is also the brightness of the pixels having the same brightness value, so that the average brightness value is determined to be 700nit, that is, the brightness value of the sub-image.

And 103, performing brightness alignment on the multiple sub-images according to the image parameters so as to enable the brightness of the multiple sub-images to be the same.

In an embodiment, after the luminance values corresponding to the plurality of sub-images are obtained, luminance alignment may be performed according to the luminance values, so that the luminance of the plurality of sub-images is the same. The method of performing brightness alignment according to the brightness value may be various, for example, a second average brightness value of the plurality of sub-images may be calculated, and then the brightness alignment may be performed on the plurality of sub-images according to the second average brightness value, for example, brightness compensation may be performed on the sub-image having a brightness value smaller than the second average brightness value, and brightness attenuation may be performed on the sub-image having a brightness value larger than the second average brightness value.

In other embodiments, a reference image may be selected from the plurality of sub-images, and then the luminance compensation or the luminance reduction may be performed on the other sub-images according to the luminance value of the reference image. The reference image may be manually selected by a user, or the system may select a sub-image with the highest brightness as the reference image. For example, if 3 sub-images including the first image, the second image, and the third image are sorted in descending order of brightness value, the brightness value of the first image is greater than the brightness value of the second image, and the brightness value of the second image is greater than the brightness value of the third image, the first image is determined as the reference image.

And 104, splicing the multiple sub-images with aligned brightness to generate a high dynamic range image of the current scene.

Specifically, after acquiring the multiple sub-images after the luminance alignment, since the multiple sub-images respectively correspond to different areas of the current scene, and the multiple microlenses respectively and independently work, the sub-images shot in the different areas of the current scene may have different exposure parameters, and thus the high dynamic range image of the current scene can be obtained after the multiple sub-images are spliced and synthesized.

for example, the electronic device obtains a short-exposure-duration sub-image and a long-exposure-duration sub-image, and because the short-exposure-duration sub-image retains the features of the brighter region in the current scene and the long-exposure-duration sub-image retains the features of the darker region in the current scene, during composition, the features of the darker region in the current scene retained by the long-exposure-duration sub-image and the features of the brighter region in the current scene retained by the short-exposure-duration sub-image can be utilized to perform composition, so as to obtain a high-dynamic-range image of the current scene.

As another alternative, when acquiring multiple sub-images corresponding to different regions of the current scene according to different exposure parameters, the electronic device may set an exposure value of each micro-lens, and then acquire the sub-image of the region corresponding to the current scene according to the exposure value. For example, the electronic device includes three micro-lenses, and the three micro-lenses may be controlled to expose different regions of the current scene according to a preset normal exposure value EV0, a preset underexposure value EV-2, and a preset overexposure value EV2, so as to obtain sub-images corresponding to three regions of the current scene, and the three sub-images are subjected to luminance alignment and then are spliced and synthesized, so that a high dynamic range image of the current scene may be obtained.

in the embodiment of the application, because the plurality of microlenses of the electronic device work independently, shooting can be performed simultaneously, and the plurality of sub-images of the current scene can be acquired by utilizing the time of one-time exposure operation, so that the acquisition efficiency of the sub-images corresponding to different areas of the current scene is improved, and the synthesis efficiency of the high dynamic range image is improved. In addition, because a plurality of micro lenses can be exposed according to different exposure parameters, the high dynamic range effect of image shooting can be effectively improved.

as can be seen from the above, the image processing method provided in the embodiment of the present application can respectively control the multiple micro-lenses to shoot the current scene to obtain multiple sub-images, where the multiple sub-images respectively correspond to different areas of the current scene, obtain image parameters respectively corresponding to the multiple sub-images, align the brightness of the multiple sub-images according to the image parameters, so that the brightness of the multiple sub-images is the same, and splice the multiple sub-images after the brightness alignment to generate the high dynamic range image of the current scene. The embodiment of the application shoots simultaneously through a plurality of micro-lenses to carry out luminance alignment and splice a pair of high dynamic image afterwards, can effectively promote the high dynamic range effect that the image was shot, and still promoted shooting efficiency.

the image processing method of the present application will be further described below on the basis of the methods described in the above embodiments. Referring to fig. 2, fig. 2 is another schematic flow chart of an image processing method according to an embodiment of the present application, where the image processing method includes:

Step 201, obtaining the ambient light intensities of the scene areas corresponding to the plurality of microlenses respectively.

In an embodiment, the plurality of microlenses may be provided in the electronic device itself, for example, a plurality of microlenses are disposed on a rear shell of the electronic device, or may be an external device, for example, the external device may be connected to the electronic device through a data connection line, and then the plurality of external microlenses are called through an application program in the electronic device. Further, the micro-lens may further include a light sensor to obtain an ambient light intensity of a scene area corresponding to the micro-lens.

In an embodiment, it may be further determined whether the electronic device is currently in a shooting state, and if yes, the step of obtaining the ambient light intensities of the scene areas corresponding to the plurality of microlenses is performed.

step 202, determining exposure parameters of the plurality of microlenses according to the intensity of the plurality of ambient light, and controlling the plurality of microlenses to shoot according to the exposure parameters to obtain a plurality of sub-images.

in one embodiment, when the micro-lens takes a picture, the micro-lens needs to adjust exposure parameters such as exposure, and the exposure parameters are related to the illumination intensity of the environment. For example, if the ambient light intensity is too strong, the exposure needs to be reduced appropriately, and the main factors affecting the exposure include aperture, shutter, and sensitivity. The diaphragm is used for controlling the light of the photosensitive element by adjusting the size of the aperture of the diaphragm opening. The device for controlling the exposure time of the photosensitive element of the camera during the shutter has the advantages that the quantity of the light entering is smaller when the shutter speed is higher, the light sensitivity is the capacity of the photosensitive element in the lens for sensing the light, and the higher the light sensitivity is, the stronger the light sensitivity is, the easier the light sensitivity is. The exposure parameters here may include shutter speed and exposure time.

After the exposure parameters of each micro lens are determined, the plurality of micro lenses are controlled to shoot the current scene to obtain a plurality of sub-images of different areas of the current scene, wherein the plurality of sub-images respectively correspond to the different areas of the current scene.

step 203, obtaining brightness values corresponding to the plurality of sub-images.

In an embodiment, the brightness values of all the pixel points in the sub-image may be obtained first to obtain a brightness value set, and then the first average brightness value is determined according to the brightness value set to be used as the brightness value of the sub-image.

For example, the first average brightness value of the brightness value set may be calculated by first adding the brightness of all the pixels in the brightness value set and then dividing the sum by the number of the pixels in the set. However, the method has large calculation amount, but the calculation result is accurate.

step 204, selecting a reference image from the plurality of sub-images.

The reference image may be manually selected by a user, or the system may select a sub-image with the highest brightness as the reference image. For example, if 3 sub-images including the first image, the second image, and the third image are sorted in descending order of brightness value, the brightness value of the first image is greater than the brightness value of the second image, and the brightness value of the second image is greater than the brightness value of the third image, the first image is determined as the reference image.

and step 205, performing brightness compensation or brightness weakening on other sub-images according to the brightness value of the reference image so as to enable the brightness of the plurality of sub-images to be the same.

specifically, the luminance of the plurality of sub-images is aligned according to the luminance value of the reference image, for example, luminance compensation is performed on the sub-image having a luminance value smaller than the luminance value of the reference image, and luminance reduction is performed on the sub-image having a luminance value larger than the luminance value of the reference image.

and step 206, acquiring the position label information of the micro-lens corresponding to the sub-image.

In an embodiment of the application, the position tag information may be position information of the micro-lens in the micro-lens module, for example, the micro-lens module has 9 micro-lenses in total, and the position tag information may be position information of the micro-lens among the 9 micro-lenses.

in other embodiments, the position tag information may also be position information of a scene area shot by a shot in the current scene, for example, 9 shots respectively shoot 9 areas of the current scene, and the position tag information of each shot may be position information of the area shot by the shot in the current scene.

and step 207, splicing the multiple sub-images after the brightness alignment according to the position label information to generate a high dynamic range image of the current scene.

specifically, after acquiring the multiple sub-images after brightness alignment, since the multiple sub-images respectively correspond to different areas of the current scene, and the multiple micro-lenses respectively and independently work, the sub-images shot in the different areas of the current scene may have different exposure parameters, and thus the high dynamic range image of the current scene can be obtained by stitching and synthesizing the multiple sub-images according to the respective position label information.

As shown in fig. 3, fig. 3 is a scene schematic diagram of the image processing method provided in the embodiment of the present application, where the electronic device includes 9 microlenses, the microlenses capture different regions of a current scene to obtain sub-images a, b, c, d, e, f, g, h, and i, and each sub-image corresponds to a different region of the current scene, and a complete high dynamic range image is obtained after splicing according to position tag information of each microlens.

step 208, tone mapping process is performed on the high dynamic range image.

in an embodiment, before performing the Tone Mapping process on the high dynamic range image, a noise reduction process may be performed, and then the electronic device may perform a Tone Mapping process (Tone Mapping) on the noise-reduced image, so as to obtain the target image. It can be understood that the tone mapping process performed on the noise-reduced image can improve the image contrast of the image, so that the target image has a higher dynamic range and a better imaging effect.

And step 209, displaying the image after tone mapping processing on a screen of the electronic equipment as a preview image of the current scene.

The image after tone mapping processing is displayed as the preview image of the shooting scene, so that the user can check the high dynamic range effect of the image obtained by shooting the current scene in advance, and the user is helped to shoot better.

in an embodiment, before presenting the preview image on the screen of the electronic device, the image processing method further includes:

And performing down-sampling processing on the plurality of preview images according to the current resolution of the screen.

It can be understood that, in the case that the actual resolution of the preview image is greater than the resolution of the screen display, a better display effect is not obtained compared to the case that the actual resolution of the preview image is equal to the resolution of the screen display.

Therefore, before the preview image is displayed on the screen of the electronic device, the current resolution of the screen is obtained first, and then the preview image is subjected to down-sampling processing according to the current resolution of the screen, so that the resolution of the preview image is consistent with the current resolution of the screen. In this way, the efficiency of combining dynamic range images can be improved, and the display effect of a high dynamic range image is not reduced when the high dynamic range image is displayed as a preview image.

From the above, the image processing method provided by the embodiment of the present application can obtain the ambient light intensities of the scene areas corresponding to the plurality of microlenses respectively, respectively determining exposure parameters of the plurality of micro-lenses according to the intensity of the plurality of ambient light, controlling the plurality of micro-lenses to shoot according to the exposure parameters to obtain a plurality of sub-images, acquiring brightness values corresponding to the plurality of sub-images, selecting a reference image from the plurality of sub-images, performing brightness compensation or brightness attenuation on other sub-images according to the brightness value of the reference image, so that the brightness of a plurality of sub-images is the same, the position label information of the micro-lens corresponding to the sub-image is obtained, splicing a plurality of sub-images which are aligned according to the position label information brightness to generate a high dynamic range image of the current scene, and carrying out tone mapping processing on the high dynamic range image, and displaying the image after the tone mapping processing on a screen of the electronic equipment as a preview image of the current scene.

Referring to fig. 4, fig. 4 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure. Wherein the image processing apparatus 30 comprises:

A shooting module 301, configured to respectively control the multiple micro-mirror heads to shoot a current scene to obtain multiple sub-images, where the multiple sub-images respectively correspond to different areas of the current scene;

an obtaining module 302, configured to obtain image parameters corresponding to the multiple sub-images respectively;

an alignment module 303, configured to perform luminance alignment on the multiple sub-images according to the image parameter, so that the luminance of the multiple sub-images is the same;

a stitching module 304, configured to stitch the luminance-aligned multiple sub-images to generate a high dynamic range image of the current scene.

In one embodiment, as shown in fig. 5, the photographing module 301 may include:

a light measuring sub-module 3011, configured to obtain ambient light intensities of scene areas corresponding to the multiple microlenses respectively;

The shooting sub-module 3012 is configured to determine exposure parameters of the multiple microlenses according to the multiple ambient light intensities, and control the multiple microlenses to shoot according to the exposure parameters.

in one embodiment, the alignment module 303 may include:

A selecting submodule 3031, configured to select a reference image from the plurality of sub-images;

And the alignment sub-module 3032 is configured to perform brightness compensation or brightness attenuation on the other sub-images according to the brightness value of the reference image, so that the brightness of the plurality of sub-images is the same.

In an embodiment, the splicing module 304 may include:

An obtaining submodule 3041, configured to obtain position tag information of the micro lens corresponding to the sub image;

the splicing submodule 3042 is configured to splice the multiple sub-images after the brightness alignment according to the position tag information, so as to generate a high dynamic range image of the current scene.

As can be seen from the above description, in the image processing apparatus 30 according to the embodiment of the present application, the shooting module 301 may respectively control the multiple micro-lenses to shoot the current scene to obtain multiple sub-images, where the multiple sub-images respectively correspond to different areas of the current scene, the obtaining module 302 obtains image parameters respectively corresponding to the multiple sub-images, the aligning module 303 aligns the brightness of the multiple sub-images according to the image parameters to make the brightness of the multiple sub-images the same, and the splicing module 304 splices the multiple sub-images after aligning the brightness to generate the high dynamic range image of the current scene. The embodiment of the application shoots simultaneously through a plurality of micro-lenses to carry out luminance alignment and splice a pair of high dynamic image afterwards, can effectively promote the high dynamic range effect that the image was shot, and still promoted shooting efficiency.

In the embodiment of the present application, the image processing apparatus and the image processing method in the foregoing embodiment belong to the same concept, and any method provided in the embodiment of the image processing method may be executed on the image processing apparatus, and a specific implementation process thereof is described in detail in the embodiment of the image processing method, and is not described herein again.

The term "module" as used herein may be considered a software object executing on the computing system. The different components, modules, engines, and services described herein may be considered as implementation objects on the computing system. The apparatus and method described herein may be implemented in software, but may also be implemented in hardware, and are within the scope of the present application.

The embodiment of the present application also provides a storage medium, on which a computer program is stored, which, when running on a computer, causes the computer to execute the above-mentioned image processing method.

The embodiment of the application also provides an electronic device, such as a tablet computer, a mobile phone and the like. The processor in the electronic device loads instructions corresponding to processes of one or more application programs into the memory according to the following steps, and the processor runs the application programs stored in the memory, so that various functions are realized:

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

referring to fig. 6, the electronic device 400 includes a processor 401 and a memory 402. The processor 401 is electrically connected to the memory 402.

The processor 400 is a control center of the electronic device 400, connects various parts of the entire electronic device using various interfaces and lines, performs various functions of the electronic device 400 by running or loading a computer program stored in the memory 402 and calling data stored in the memory 402, and processes the data, thereby monitoring the electronic device 400 as a whole.

The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by operating the computer programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, a computer program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the electronic device, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 access to the memory 402.

In this embodiment, the processor 401 in the electronic device 400 loads instructions corresponding to one or more processes of the computer program into the memory 402 according to the following steps, and the processor 401 runs the computer program stored in the memory 402, so as to implement various functions, as follows:

Referring also to fig. 7, in some embodiments, the electronic device 400 may further include: a display 403, radio frequency circuitry 404, audio circuitry 405, and a power supply 406. The display 403, the rf circuit 404, the audio circuit 405, and the power source 406 are electrically connected to the processor 401.

The display 403 may be used to display information entered by or provided to the user as well as various graphical user interfaces, which may be made up of graphics, text, icons, video, and any combination thereof. The Display 403 may include a Display panel, and in some embodiments, the Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

the rf circuit 404 may be used for transceiving rf signals to establish wireless communication with a network device or other electronic devices through wireless communication, and for transceiving signals with the network device or other electronic devices. In general, radio frequency circuit 501 includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like.

the audio circuit 405 may be used to provide an audio interface between the user and the electronic device through a speaker, microphone. The audio circuit 506 may convert the received audio data into an electrical signal, transmit the electrical signal to a speaker, and convert the electrical signal to an audio signal for output by the speaker.

the power supply 406 may be used to power various components of the electronic device 400. In some embodiments, power supply 406 may be logically coupled to processor 401 via a power management system, such that functions to manage charging, discharging, and power consumption management are performed via the power management system. The power supply 406 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

Although not shown in fig. 7, the electronic device 400 may further include a camera, a bluetooth module, and the like, which are not described in detail herein.

In the embodiment of the present application, the storage medium may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

it should be noted that, for the image processing method in the embodiment of the present application, it can be understood by a person skilled in the art that all or part of the process of implementing the image processing method in the embodiment of the present application can be completed by controlling the relevant hardware through a computer program, the computer program can be stored in a computer readable storage medium, such as a memory of an electronic device, and executed by at least one processor in the electronic device, and the process of executing the process can include, for example, the process of the embodiment of the image processing method. The storage medium may be a magnetic disk, an optical disk, a read-only memory, a random access memory, etc.

In the image processing apparatus according to the embodiment of the present application, each functional module may be integrated into one processing chip, each module may exist alone physically, or two or more modules may be integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium, such as a read-only memory, a magnetic or optical disk, or the like.

The foregoing detailed description has provided an image processing method, an image processing apparatus, a storage medium, and an electronic device according to embodiments of the present application, and specific examples are applied herein to explain the principles and implementations of the present application, and the descriptions of the foregoing embodiments are only used to help understand the method and the core ideas of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. An image processing method applied to an electronic device, wherein the electronic device comprises a plurality of micro lenses, the method comprising the following steps:

2. the image processing method of claim 1, wherein the controlling the plurality of micro-lenses to capture the current scene to obtain a plurality of sub-images comprises:

Acquiring the ambient light intensity of the scene areas corresponding to the micro lenses respectively;

and respectively determining exposure parameters of the micro lenses according to the intensity of the plurality of ambient light, and controlling the micro lenses to shoot according to the exposure parameters.

3. The image processing method of claim 1, wherein the image parameter comprises a luminance value, and wherein luminance aligning the plurality of sub-images according to the image parameter comprises:

Selecting a reference image from the plurality of sub-images;

And performing brightness compensation or brightness weakening on other sub-images according to the brightness value of the reference image so as to enable the brightness of the plurality of sub-images to be the same.

4. The image processing method according to claim 1, wherein stitching the luminance-aligned plurality of sub-images comprises:

Acquiring position label information of the micro-lens corresponding to the sub-image;

And splicing the multiple sub-images after the brightness alignment according to the position label information to generate a high dynamic range image of the current scene.

5. The image processing method according to claim 1, wherein after the luminance-aligned sub-images are merged to generate the high dynamic range image of the current scene, the image processing method further comprises:

performing tone mapping processing on the high dynamic range image;

And displaying the image after tone mapping as a preview image of the current scene on a screen of the electronic equipment.

6. The image processing method according to claim 5, wherein before presenting the preview image on a screen of the electronic device, the image processing method further comprises:

7. an image processing apparatus applied to an electronic device including a plurality of microlenses, the apparatus comprising:

8. The image processing apparatus according to claim 7, wherein the photographing module includes:

The light measuring sub-module is used for acquiring the ambient light intensities of the scene areas corresponding to the micro lenses respectively;

And the shooting sub-module is used for respectively determining exposure parameters of the plurality of micro-lenses according to the plurality of ambient light intensities and controlling the plurality of micro-lenses to shoot according to the exposure parameters.

9. The image processing apparatus of claim 7, wherein the alignment module comprises:

a selection submodule for selecting a reference image from the plurality of sub-images;

And the alignment sub-module is used for performing brightness compensation or brightness weakening on other sub-images according to the brightness value of the reference image so as to enable the brightness of the plurality of sub-images to be the same.

10. the image processing apparatus according to claim 7, wherein the stitching module comprises:

the acquisition submodule is used for acquiring the position label information of the micro lens corresponding to the sub image;

And the splicing submodule is used for splicing the multiple sub-images after the brightness alignment according to the position label information so as to generate a high dynamic range image of the current scene.

11. a storage medium having stored thereon a computer program, characterized in that, when the computer program is run on a computer, it causes the computer to execute the image processing method according to any one of claims 1 to 6.

12. An electronic device comprising a processor and a memory, the memory storing a plurality of instructions, wherein the instructions in the memory are loaded by the processor for performing the steps of: