CN110290325A - Image processing method, device, storage medium and electronic equipment - Google Patents
Image processing method, device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN110290325A CN110290325A CN201910580166.8A CN201910580166A CN110290325A CN 110290325 A CN110290325 A CN 110290325A CN 201910580166 A CN201910580166 A CN 201910580166A CN 110290325 A CN110290325 A CN 110290325A
- Authority
- CN
- China
- Prior art keywords
- camera module
- image
- raw
- raw image
- electronic equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
- H04N23/676—Bracketing for image capture at varying focusing conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
This application discloses a kind of image processing methods, this method can be applied to electronic equipment, the electronic equipment includes the first camera module, the second camera module and third camera module, wherein second camera module is focal length camera module, the third camera module is black and white camera module, this method comprises: determining first object camera module and the second target camera module from the first camera module and the second camera module;The first RAW image is obtained by first object camera module, the second RAW image is obtained by the second target camera module, and third RAW image is obtained by third camera module, wherein the first RAW image, third RAW image, the exposure of the second RAW image successively reduce;Using third RAW image as benchmark image, synthesis processing is carried out to the first RAW image, the second RAW image and third RAW image, obtains the RAW composograph with high dynamic range;Using RAW composograph, the preview of image is carried out or operation of taking pictures or record a video.
Description
Technical field
The application belongs to image technique field more particularly to a kind of image processing method, device, storage medium and electronics are set
It is standby.
Background technique
Compared to common image, high dynamic range images (High-Dynamic Range, abbreviation HDR) can be provided more
More dynamic ranges and image detail.Electronic equipment can shoot the multiframe figure with different depth of exposure under Same Scene
Picture synthesizes the highlights details of the dark portion details of overexposure light image, the intermediate details of normal exposure image and under-exposure image
To HDR image.However, the image that relevant HDR technical treatment obtains is difficult to be suitable for preview simultaneously, takes pictures and record a video.
Summary of the invention
The embodiment of the present application provides a kind of image processing method, device, storage medium and electronic equipment, what processing obtained
Image can be suitable for preview, take pictures and record a video.
The embodiment of the present application provides a kind of image processing method, is applied to electronic equipment, and the electronic equipment includes first
Camera module, the second camera module and third camera module, wherein second camera module is focal length camera module, described the
Three camera modules are black and white camera module, which comprises
First object camera module and the second target are determined from first camera module and second camera module
Camera module;
The first RAW image is obtained by the first object camera module, is obtained by the second target camera module
Second RAW image, and pass through the third camera module and obtain third RAW image, wherein first RAW image, described the
Three RAW images, the exposure of second RAW image successively reduce;
Using the third RAW image as benchmark image, to the first RAW image, the second RAW image and third RAW image
Synthesis processing is carried out, the RAW composograph with high dynamic range is obtained;
Using the RAW composograph, the preview of image is carried out or operation of taking pictures or record a video.
The embodiment of the present application provides a kind of image processing apparatus, is applied to electronic equipment, and the electronic equipment includes first
Camera module, the second camera module and third camera module, wherein second camera module is focal length camera module, described the
Three camera modules are black and white camera module, and described device includes:
Determining module, for determining that first object images mould from first camera module and second camera module
Group and the second target camera module;
Module is obtained, for obtaining the first RAW image by the first object camera module, passes through second target
Camera module obtains the second RAW image, and obtains third RAW image by the third camera module, wherein described first
RAW image, the third RAW image, the exposure of second RAW image successively reduce;
Synthesis module, for using the third RAW image as benchmark image, to the first RAW image, the second RAW image with
And third RAW image carries out synthesis processing, obtains the RAW composograph with high dynamic range;
Processing module carries out the preview of image or operation of taking pictures or record a video for utilizing the RAW composograph.
The embodiment of the present application provides a kind of storage medium, is stored thereon with computer program, when the computer program exists
When being executed on computer, so that the computer executes image processing method provided by the embodiments of the present application.
The embodiment of the present application also provides a kind of electronic equipment, including memory, and processor, the processor is by calling institute
The computer program stored in memory is stated, for executing image processing method provided by the embodiments of the present application.
In the present embodiment, since the first RAW image, the second RAW image and third RAW image are complete exposures
RAW image, therefore do high dynamic range with first RAW image, the second RAW image and third RAW image and enclose processing
There will be no losses for the image obtained afterwards its resolution ratio, and signal-to-noise ratio is also higher, i.e., have high dynamic obtained in the present embodiment
The RAW composograph of range has the advantages that high resolution and signal-to-noise ratio are high.This high resolution, signal-to-noise ratio are high to be moved with high
The RAW composograph of state range is used directly for image preview, takes pictures and record a video.
Detailed description of the invention
With reference to the accompanying drawing, it is described in detail by the specific embodiment to the application, the technical solution of the application will be made
And its advantages are apparent.
Fig. 1 is the flow diagram of image processing method provided by the embodiments of the present application.
Fig. 2 is the first synthesis schematic diagram of image processing method provided by the embodiments of the present application.
Fig. 3 is another flow diagram of image processing method provided by the embodiments of the present application.
Fig. 4 is second of synthesis schematic diagram of image processing method provided by the embodiments of the present application.
Fig. 5 is the first camera module to be determined as to first object camera module, and (i.e. focal length images by the second camera module
Mould group) image synthesis schematic diagram when being determined as the second target camera module.
Fig. 6 is the second camera module (i.e. focal length camera module) to be determined as first object camera module, and first is taken the photograph
It is determined as image synthesis schematic diagram when the second target camera module as mould group.
Fig. 7 to Figure 11 is the schematic diagram of a scenario of image processing method provided by the embodiments of the present application.
Figure 12 is the structural schematic diagram of image processing apparatus provided by the embodiments of the present application.
Figure 13 is the structural schematic diagram of electronic equipment provided by the embodiments of the present application.
Figure 14 is the structural schematic diagram of image processing circuit provided by the embodiments of the present application.
Specific embodiment
Diagram is please referred to, wherein identical component symbol represents identical component, the principle of the application is to implement one
It is illustrated in computing environment appropriate.The following description be based on illustrated by the application specific embodiment, should not be by
It is considered as limitation the application other specific embodiments not detailed herein.
It is understood that the executing subject of the embodiment of the present application can be the end of smart phone or tablet computer etc.
End equipment.
Referring to Fig. 1, Fig. 1 is the flow diagram of image processing method provided by the embodiments of the present application.The image procossing
Method can be applied to electronic equipment, which may include the first camera module, the second camera module and third camera shooting
Mould group, wherein second camera module can be focal length camera module, which can be black and white camera module.
The process of the image processing method may include:
101, first object camera module and the camera shooting of the second target are determined from the first camera module and the second camera module
Mould group.
102, the first RAW image is obtained by first object camera module, obtains second by the second target camera module
RAW image, and third RAW image is obtained by third camera module, wherein the first RAW image, third RAW image, second
The exposure of RAW image successively reduces.
Compared to common image, high dynamic range images (High-Dynamic Range, abbreviation HDR) can be provided more
More dynamic ranges and image detail.Electronic equipment can shoot the multiframe figure with different depth of exposure under Same Scene
Picture synthesizes the highlights details of the dark portion details of overexposure light image, the intermediate details of normal exposure image and under-exposure image
To HDR image.However, the image that relevant HDR technical treatment obtains is difficult to be suitable for preview simultaneously, takes pictures and record a video.
For example, using zzHDR technology carry out image procossing when because zzHDR technology be in same frame image it is existing into
The pixel of the long exposure of row has the pixel for carrying out short exposure that can drop when long and short exposing pixels merging generates high dynamic range images again
Low at least half of resolution ratio.Therefore it is not used to take pictures or record a video using the high dynamic range images that zzHDR technology obtains,
Otherwise user can will become apparent from the image display effect of resolution ratio reduction.That is, what zzHDR technology can not be suitable for taking pictures and recording a video
Scene.The problem that other HDR technologies in the related technology are reduced there is also such as resolution ratio or signal-to-noise ratio is lower, so that
The image that these HDR technical treatments obtain can not be suitable for simultaneously preview, take pictures and record a video.
In the 101 of the embodiment of the present application and 102 process, for example, electronic equipment can first from the first camera module and
First object camera module and the second target camera module are determined in second camera module (focal length camera module).
Later, electronic equipment can obtain the first RAW image by the first object camera module determined, and pass through
The the second target camera module determined obtains the second RAW image, and obtains the 3rd RAW figure by third camera module
Picture.Wherein, the exposure of first RAW image, third RAW image and the second RAW image successively reduces.That is, the first RAW image
Exposure can be greater than third RAW image, the exposure of third RAW image can be greater than the second RAW image.
It should be noted that the camera module of electronic equipment is made of lens and imaging sensor, wherein lens are for adopting
Light signal outside collection is supplied to imaging sensor, and image sensor senses are converted from the light signal of lens
For digitized raw image data, i.e. RAW image data.RAW is unprocessed, also uncompressed format, can be by it
Visually it is known as " digital negative ".
Exposure refers to the depth of exposure of image.Depth of exposure may include overexposure, normal exposure and under-exposure.It exposes
Luminosity is also exposure value, and exposure value, which represents, can provide all camera aperture shutters combination equally exposed.
In the present embodiment, successively reduce can be with for the exposure of the first RAW image, third RAW image and the second RAW image
Including at least following situation: for example, it can be normal exposure diagram that the first RAW image, which can be overexposure image, third RAW image,
Picture, the second RAW image can be under-exposure image.For another example, the first RAW image, third RAW image and the second RAW image can be with
It is the image of time for exposure successively reduction, such as compares, the first RAW image can be time for exposure longer long exposure
Image, third RAW image can occupy intermediate intermediate exposure image for the time for exposure, when the second RAW image can be to expose
Between shorter short exposed images etc..
That is, electronic equipment can be first from the first camera module and the second camera module in the 101 of the present embodiment and 102
The first object camera module for carrying out overexposure or long exposure is chosen, and is chosen under-exposure or short exposure for carrying out
Second target camera module.After selecting first object camera module and the second target camera module, electronic equipment can be with
The first RAW image is obtained by the first object camera module, and the second RAW image is obtained by the second target camera module,
And third RAW image is obtained by third camera module.
103, using third RAW image as benchmark image, to the first RAW image, the second RAW image and third RAW image
Synthesis processing is carried out, the RAW composograph with high dynamic range is obtained.
For example, electronic equipment can be with after getting the first RAW image, the second RAW image and third RAW image
Three RAW images are benchmark image, are carried out at HDR synthesis to first RAW image, the second RAW image and third RAW image
Reason, to obtain the RAW composograph with high dynamic range.
That is, the exposure of the second RAW image is minimum, therefore electronic equipment can due to the exposure highest of the first RAW image
To obtain dark portion details from the first RAW image, highlights details is obtained from the second RAW image, and the dark portion that will acquire is thin
Section and highlights details carry out HDR with third RAW image and synthesize, to obtain the RAW composograph with high dynamic range.
104, using RAW composograph, the preview of image is carried out or operation of taking pictures or record a video.
For example, electronic equipment can use the RAW composite diagram after obtaining having the RAW composograph of high dynamic range
As carrying out the preview of image or operation of taking pictures or record a video.For example, electronic equipment can centainly be located to the RAW composograph
The preview interface of the camera applications of the electronic equipment is shown in after reason for user's preview.Alternatively, taking pictures when electronic equipment receives
Instruction, such as user press when taking pictures button, which can make after carrying out certain processing to the RAW composograph
It is checked on a display screen for user for photo output display.Alternatively, electronic equipment can when electronic equipment receives video recording instruction
A wherein frame with the video obtained after centainly handle to the RAW composograph as video recording.
Please refer to Fig. 2, Fig. 2 is the first synthesis schematic diagram of image processing method provided in this embodiment.
It should be noted that in the present embodiment, since the first RAW image, the second RAW image and third RAW image are equal
It is the RAW image of complete exposure, therefore does high dynamic with first RAW image, the second RAW image and third RAW image
There will be no losses for image its resolution ratio obtained after range synthesis processing, and signal-to-noise ratio is also higher, i.e., obtains in the present embodiment
The RAW composograph with high dynamic range have high resolution and signal-to-noise ratio it is high.This high resolution, signal-to-noise ratio
The high RAW composograph with high dynamic range is used directly for image preview, takes pictures and record a video.
Further, since third camera module is black and white camera module, black and white camera module has the brightness for promoting image thin
The effect of section and half-light image quality, therefore the obtained in the embodiment of the present application by third camera module (i.e. black and white camera module)
Three RAW images its with better luminance detail and half-light image quality, therefore the base synthesized using the third RAW image as HDR
Its finally obtained RAW composograph with high dynamic range of quasi- image also has better luminance detail and half-light image quality.
Referring to Fig. 3, Fig. 3 is another flow diagram of image processing method provided by the embodiments of the present application.The image
Processing method can be applied to electronic equipment, which may include the first camera module, the second camera module and third
Camera module, wherein second camera module can be focal length camera module, which can image mould for black and white
Group.The process of the image processing method may include:
201, electronic equipment determines first object camera module and second from the first camera module and the second camera module
Target camera module.
For example, being equipped with camera applications on electronic equipment, user clicks the icon of the camera applications to open phase
Machine application.After opening camera applications, the preview interface of camera applications can be entered.In preview circle for entering camera applications
Behind face, electronic equipment can determine first object from the first camera module and the second camera module (i.e. focal length camera module)
Camera module and the second target camera module.
For shooting there is maximum exposure degree (such as to carry out wherein it is determined that the first object camera module come out can be
Exposure or long exposure) camera module, and the second target camera module determined can be has minimum for shooting
The camera module of exposure (such as carrying out under-exposure or short exposure).
202, electronic equipment obtains the first RAW image by first object camera module, passes through the second target camera module
The second RAW image is obtained, and third RAW image is obtained by third camera module, wherein first RAW image, the 3rd RAW
Image, the second RAW image exposure successively reduce, the first object camera module, the second target camera module and third
The frame per second of camera module is identical.
For example, electronic equipment can pass through after determining first object camera module and the second target camera module
One target camera module shoots the first RAW image, and shoots the second RAW image by the second target camera module, and pass through
Third camera module (i.e. black and white camera module) shoots third RAW image.
Wherein, the frame per second of the first object camera module, the second target camera module and third camera module can phase
Together.For example, the frame per second of the first object camera module, the second target camera module and third camera module can be
30fps.Certainly, in some other embodiments, the first object camera module, the second target camera module and third are taken the photograph
As the frame per second of mould group may be other numerical value.Also, the first object camera module, the second target camera module and third
The frame per second of camera module can be the numerical value not less than 20fps.When the first object camera module, the second target camera module with
And the frame per second of third camera module is when being not less than 20fps, the later use first object camera module, the second target camera module
And third camera module get image synthesis RAW composograph carry out image preview or video recording when picture can compare stream
Freely without Caton phenomenon.
Also, the exposure of first RAW image, third RAW image and the second RAW image successively reduces.That is, first
The exposure of RAW image can be greater than third RAW image, and the exposure of third RAW image can be greater than the second RAW image.?
In some embodiments, the first RAW image can be overexposure image, third RAW image can be normal exposure image, second
RAW image can be under-exposure image.Alternatively, in the identical situation of other exposure parameters, the time for exposure of the first RAW image
Third RAW image can be greater than, and the time for exposure of third RAW image can be greater than the second RAW image.That is, the first RAW image
It can be long exposure image, third RAW image can be intermediate exposure image, and the second RAW image can be short exposed images.
In the present embodiment, the overexposure image (or long exposure image) that can be will acquire uniformly is denoted as the first RAW figure
Normal exposure image (perhaps intermediate exposure image) is uniformly denoted as third RAW image for deficient exposure image (or short exposure by picture
Image) uniformly it is denoted as the second RAW image.
For example, first object camera module can constantly get long exposure image in the present embodiment, the second target is taken the photograph
As mould group can constantly get short exposed images, during third camera module (black and white camera module) can constantly be got
Equal exposure images.
203, using third RAW image as benchmark image, nth frame figure that electronic equipment gets first object camera module
The third RAW image that the nth frame image and third camera module that picture, the second target camera module are got are got is closed
At processing, the RAW composograph with high dynamic range is obtained, wherein the first RAW image of nth frame, nth frame for synthesis
The third RAW image that second RAW image and third camera module are got is the synchronous image obtained.
For example, constantly getting long exposure image in first object camera module, and the second target camera module is not
It gets short exposed images disconnectedly and during third camera module constantly gets intermediate exposure image, electronics is set
It is standby can to the nth frame image that the nth frame image that first object camera module is got, the second target camera module are got with
And the third RAW image that third camera module is got carries out synthesis processing, obtains the RAW composite diagram with high dynamic range
Picture.Wherein, when carrying out HDR synthesis, electronic equipment can be the benchmark image of HDR synthesis with third RAW image.That is, electronics is set
It is standby that dark portion details can be obtained from the first RAW image, highlights details is obtained from the second RAW image, and will acquire dark
Portion's details and highlights details carry out HDR with third RAW image and synthesize, to obtain the RAW composograph with high dynamic range.
Also, the first RAW image of nth frame, the second RAW image of nth frame and third the camera shooting mould for carrying out HDR synthesis
The third RAW image that group is got is the synchronous image obtained.It should be noted that the above-mentioned synchronous image obtained refers to first
The image that target camera module, the second target camera module and third camera module these three camera modules are shot in same time
Or these three camera modules are in the image for being spaced in the very short time shooting (as interval is less than prefixed time interval).
Please refer to Fig. 4, Fig. 4 is second of synthesis schematic diagram of image processing method provided in this embodiment.For example,
First object camera module carries out long exposure according to chronological order and obtains following image: (i.e. L1 is first by L1, L2, L3, L4
The first frame image of target camera module shooting, L2 are the second frame image of first object camera module shooting, and L3 is the first mesh
The third frame image of camera module shooting is marked, L4 is the 4th frame image of first object camera module shooting) etc..It is understood that
, L1, L2, L3 and L4 exposure having the same, such as in the identical situation of other exposure parameters, L1, L2, L3 and L4
Time for exposure t1 having the same.
Second target camera module carries out short exposure according to chronological order and obtains following image: S1, S2, S3, S4 are (i.e.
S1 is the first frame image of the second target camera module shooting, and S2 is the second frame image of the second target camera module shooting, S3
For the third frame image of the second target camera module shooting, S4 is the 4th frame image of the second target camera module shooting) etc..
It is understood that S1, S2, S3, S4 exposure having the same, such as in the identical situation of other exposure parameters, S1,
S2, S3, S4 time for exposure t2 having the same.
Third camera module carries out intermediate exposure according to chronological order and obtains following image: M1, M2, M3, M4 (i.e. M1
For the first frame image that third camera module is shot when the first camera module shoots L1, M2 is that third camera module is taken the photograph first
The second frame image for shooting when shooting L2 as mould group, M3 are that third camera module is shot when the first camera module shoots L3
Three frame images, M4 are the 4th frame image that third camera module is shot when the first camera module shoots L4) etc..It is understood that
, M1, M2, M3, M4 exposure having the same, such as in the identical situation of other exposure parameters, M1, M2, M3 have
Identical time for exposure t3.
So, when HDR is synthesized, electronic equipment is that L1, M1 and S1 are synthesized to obtain P1 image (with M1 for HDR conjunction
At benchmark image), L2, M2 and S2 are synthesized to obtain P2 image (taking M2 as the benchmark image of HDR synthesis), by L3, M3
It is synthesized to obtain P3 image (taking M3 as the benchmark image of HDR synthesis) with S3, L4, M4 and S4 is synthesized to obtain P4 image
(taking M4 as the benchmark image of HDR synthesis).That is, electronic equipment can successively obtain P1, P2, P3 and the P4 with high dynamic range
Image.
204, RAW composograph is converted to YUV composograph by electronic equipment.
205, after electronic equipment carries out default processing to YUV composograph, the preview of image is carried out.
For example, 204 and 205 may include:
After obtaining RAW composograph, which can be converted to YUV lattice by RAW format by electronic equipment
Formula, to obtain YUV composograph.
Later, electronic equipment can carry out the default processing such as image sharpening, image noise reduction to the YUV composograph,
And after the default processing, image preview operation is carried out using the image obtained after processing.For example, electronic equipment can be by YUV
The preview interface for the camera applications that the image that composograph obtains after default processing is shown in the electronic equipment is pre- for user
It lookes at.
Please refer to Fig. 5 and Fig. 6.First camera module is determined as first object camera module for electronic equipment by Fig. 5,
And image when the second camera module (i.e. focal length camera module) to be determined as to the second target camera module synthesizes schematic diagram.Fig. 6
The second camera module (i.e. focal length camera module) is determined as first object camera module for electronic equipment, and images mould for first
Group is determined as image synthesis schematic diagram when the second target camera module.
206, electronic equipment will default treated that YUV composograph is stored in pre-set image buffer queue.
207, when carrying out photographing operation, electronic equipment obtains a frame YUV composograph from pre-set image buffer queue,
And the YUV composograph that will acquire is as photo display.
For example, 206 and 207 may include:
After carrying out the default processing such as image sharpening, image noise reduction to the YUV composograph, electronic equipment can be incited somebody to action
The image obtained after processing is stored in a pre-set image buffer queue.
For example, user clicks the button progress of taking pictures of the camera applications of electronic equipment after carrying out preview to image
Photographing operation, then electronic equipment can obtain YUV composite diagram of the frame by default processing from pre-set image buffer queue
Picture, and the image that will acquire is shown as photo, the display screen for being such as shown in electronic equipment is checked for user takes pictures
Effect.
It is understood that when taking, electronic equipment can be directly from pre-set image buffer queue in the present embodiment
The image with high dynamic range is obtained, and user is showed to check, so as to achieve the effect that zero propagation is taken pictures.
In one embodiment, electronic equipment carries out the first RAW image, the second RAW image and third RAW image
Synthesis processing, obtains the process of the RAW composograph with high dynamic range, may include:
Third RAW image is determined as the benchmark image of image alignment processing by electronic equipment, and image alignment processing is at least
Including brightness of image registration process and picture position registration process;
After image alignment, electronic equipment synthesizes the first RAW image, the second RAW image and third RAW image
Processing, obtains the RAW composograph with high dynamic range.
For example, the first RAW image is overexposure light image, third RAW image is normal exposure image, and the second RAW image is
Under-exposure image.So, the third RAW image of normal exposure can be determined as the reference map of image alignment processing by electronic equipment
Picture, wherein image alignment processing include at least brightness of image registration process and picture position registration process.That is, carrying out HDR
Before fusion, electronic equipment need to the first RAW image, the second RAW image and third RAW image carry out brightness of image alignment and
Picture position alignment.In the embodiment of the present application, the third RAW image of normal exposure first can be determined as image by electronic equipment
Then first RAW image and the second RAW image are carried out image by the benchmark image of registration process on the basis of third RAW image
Brightness alignment and aligned in position.After image alignment, electronic equipment can be to the first RAW image, the second RAW image and third
RAW image carries out HDR synthesis (still can be using third RAW image as the benchmark image synthesized when carrying out HDR synthesis), thus
Obtain the RAW composograph with high dynamic range.
It should be noted that can be made using the benchmark image that the third RAW image of intermediate exposure is handled as image alignment
It is more accurate to obtain image alignment processing, so that the imaging effect for finally synthesizing obtained image is more preferable.
In the present embodiment, for carrying out the first RAW image, the second RAW image and third RAW image of HDR synthesis
It can be the image that shooting interval is less than preset interval.For example, long exposure image, medium exposure for carrying out HDR synthesis
Light image and short exposed images can be the image that shooting interval is less than preset interval.Electronic equipment is when shooting image
Timestamp corresponding with each image can be generated.Timestamp based on shooting, electronic equipment can the detections pair when HDR is synthesized
Whether long exposure image, intermediate exposure image and the short exposed images answered are figure of the shooting interval less than preset interval
Picture.If so, electronic equipment can carry out HDR synthesis.If it is not, then electronic equipment can not carry out HDR synthesis to these images,
But frame losing processing is carried out to these images, such as by these image-erasings.
In one embodiment, electronic equipment determines first from the first camera module and the second camera module in 201
The process of target camera module and the second target camera module may include:
Electronic equipment randomly determines first object camera module from the first camera module and the second camera module, and will
Another camera module being confirmed as outside the camera module of the first object camera module is determined as the second target camera module.
For example, the first camera module randomly can be determined as first object camera module by electronic equipment, then corresponding
, the second camera module (i.e. focal length camera module) can be determined as the second target camera module by electronic equipment.
It is taken the photograph alternatively, the second camera module (i.e. focal length camera module) randomly can be determined as first object by electronic equipment
As mould group, then corresponding, the first camera module can be determined as the second target camera module by electronic equipment.
In another embodiment, electronic equipment determines the from the first camera module and the second camera module in 201
The process of one target camera module and the second target camera module may include:
It is set by any two camera module electronics in the first camera module, the second camera module and third camera module
The standby depth of view information for obtaining the image that shooting obtains;
According to depth of view information, electronic equipment obtains distant view image by the second camera module;
Electronic equipment obtains the corresponding scene brightness of distant view image, and the scene brightness is for indicating the corresponding shooting field of distant view
The bright-dark degree of scape;
If the scene brightness of distant view image is less than preset threshold, the second camera module is determined as the first mesh by electronic equipment
Camera module is marked, and the first camera module is determined as the second target camera module;
If the scene brightness of distant view image is greater than or equal to preset threshold, the first camera module is determined as by electronic equipment
First object camera module, and the second camera module is determined as the second target camera module.
For example, user clicks the application icon of camera applications to open camera applications, into the pre- of camera applications
Look at interface.After entering preview interface, electronic equipment can pass through three camera modules (i.e. the first camera module, the second camera shooting
Mould group and third camera module) in any two camera module obtain the depth of view information of image that shooting obtains.For example, electronics
Equipment can shoot a frame image by the first camera module and the second camera module, and obtain the depth of view information of the image.?
After obtaining the depth of view information of the image, electronic equipment can be according to the depth of view information, and by the second camera module, (i.e. focal length is imaged
Mould group) it obtains and belongs to the image of circle part in photographed scene to get to distant view image.Later, electronic equipment is available should
The scene brightness of distant view image, and whether the scene brightness for detecting the distant view image is less than preset threshold.Wherein, the scene brightness
For the parameter for indicating the bright-dark degree of the corresponding photographed scene of distant view.
If the scene brightness of the distant view image is less than preset threshold, it may be considered that darker (such as circle part of circle part
Insufficient light), then electronic equipment the second camera module (i.e. focal length camera module) can be determined as first object camera shooting
Mould group.Corresponding, the first camera module can be determined as the second target camera module by electronic equipment.
If the scene brightness of the distant view image is greater than or equal to preset threshold, it may be considered that circle part is brighter (as far
Scape part it is bright and clear), then the first camera module can be determined as first object camera module by electronic equipment.It is corresponding
, the second camera module (i.e. focal length camera module) can be determined as the second target camera module by electronic equipment.
In one embodiment, electronic equipment can detect in the following way distant view image scene brightness whether
Less than preset threshold: for example, the corresponding gray scale of the available distant view image of electronic equipment is straight after shooting obtains distant view image
Fang Tu.It should be noted that grey level histogram is the function about grey level distribution, it is the system to grey level distribution in image
Meter.Grey level histogram is that all pixels in digital picture according to the size of gray value, are counted the frequency of its appearance.Gray scale
Histogram is the function of gray level, it indicates the number of the pixel in image with certain gray level, reflects certain in image
The frequency that gray scale occurs.Using the grey level histogram of the distant view image, it is default lower than a certain that electronic equipment can count gray value
The pixel quantity of gray value (such as 125 or 130) accounts for the ratio of distant view image total pixel number amount.If the ratio is lower than default ratio
Example threshold value can then determine that the scene brightness of the distant view image is less than preset threshold.If the ratio is greater than or equal to default ratio
Example threshold value can then determine that the scene brightness of the distant view image is greater than or equal to preset threshold.
In other embodiments, electronic equipment can also detect the circle part in photographed scene otherwise
Bright-dark degree.For example, the circle part bright-dark degree in photographed scene can be told since user passes through eyes, that is, use
Family is by eyes it can be learnt that the circle part in photographed scene is brighter or darker.Therefore, electronic equipment can inquire use
The bright-dark degree of family circle part.If user has input the information of circle part darker (insufficient light), electronic equipment
Second camera module (i.e. focal length camera module) can be determined as to first object camera module, and the first camera module is determined
For the second target camera module.For example, carrying out long exposure using the second camera module, short exposure is carried out using the first camera module
Light.If user has input brighter (bright and clear) information of circle part, electronic equipment can be by the first camera module
It is determined as first object camera module, and the second camera module (i.e. focal length camera module) is determined as the second target camera shooting mould
Group.For example, carrying out long exposure using the first camera module, short exposure is carried out using the second camera module.
Or electronic equipment can measure the bright-dark degree of photographed scene medium long shot part by way of surveying light.Than
Such as, electronic equipment can first pass through any two camera module and shoot a frame image, and obtain the depth of view information of the image.So
Afterwards, electronic equipment determines distant view region according to the depth of view information, then distant view region is determined as photometry region and surveys light.If
It is darker to measure to obtain circle part by way of surveying light, then electronic equipment can (i.e. focal length images by the second camera module
Mould group) it is determined as first object camera module, and the first camera module is determined as the second target camera module.For example, utilizing
Second camera module carries out long exposure, carries out short exposure using the first camera module.If the mode measurement for surveying light obtains distant view
Part is brighter, then the first camera module can be determined as first object camera module by electronic equipment, and images mould for second
Group (i.e. focal length camera module) is determined as the second target camera module.For example, carrying out long exposure using the first camera module, utilize
Second camera module carries out short exposure.
Fig. 7 to Figure 11 is please referred to, Fig. 7 to Figure 11 is that the scene of image processing method provided by the embodiments of the present application is illustrated
Figure.
For example, as shown in fig. 7, electronic equipment has the first camera module 301, the second camera module 302 and third camera shooting
Mould group 303, wherein second camera module 302 is focal length camera module, which is black and white camera module,
And first camera module 301 can be common camera module.For example, the first camera module 301 can be neither focal length image
The common camera module of mould group nor wide-angle imaging mould group.Also, the first camera module 301, the second camera module 302 and third
Camera module can have identical frame per second, such as their frame per second is 30fps or 60fps etc..
For example, as shown in figure 8, user clicks the icon of camera applications, and camera is directed at a certain scene.It is electric at this time
Sub- equipment enters the preview interface of camera applications.When detect enter preview interface after, electronic equipment can be randomly by first
Camera module is determined as first object camera module, and the second camera module (i.e. focal length camera module) is determined as the second target
Camera module.
After determining first object camera module and the second target camera module, electronic equipment can enter HDR mode.
For example, electronic equipment can be held by the imaging sensor of first object camera module according to shooting interval under the HDR mode
RAW image is obtained continuously, such as the present embodiment is denoted as the first RAW image, the time for exposure of first RAW image is T1.Meanwhile
Electronic equipment can constantly obtain RAW image, example according to shooting interval by the imaging sensor of the second target camera module
If the present embodiment is denoted as the second RAW image, the time for exposure of second RAW image is T2.Also, electronic equipment can pass through
The imaging sensor of three camera modules constantly obtains RAW image according to shooting interval, such as the present embodiment is denoted as the 3rd RAW figure
Picture, the time for exposure of the third RAW image are T3.It is understood that the first RAW image, the second RAW image and the 3rd RAW
Image is the image of the current scene of camera alignment.Due to the first RAW image, the second RAW image and third RAW image
Shooting interval is very short, it can be considered that they are the image obtained under Same Scene.In one embodiment, first
RAW image, the second RAW image and third RAW image in addition to the time for exposure Bu Tong other than, other exposure parameters can be identical.
Time for exposure T1 is greater than T3 in the present embodiment, and T3 is greater than T2.That is, first object camera module carries out long exposure,
Obtain the RAW image of long exposure.Second target camera module carries out short exposure, obtains the RAW image of short exposure.Third images mould
Group carries out intermediate exposure, obtains the RAW image of intermediate exposure.For example, as shown in figure 4, according to chronological order, electronic equipment
Pass through available RAW image L1, L2, L3 and the L4, etc. to long exposure of the imaging sensor of first object camera module.And
And according to chronological order, electronic equipment gets the RAW of short exposure by the imaging sensor of the second target camera module
Image S1, S2, S3, S4, etc..According to chronological order, electronic equipment is obtained by the imaging sensor of third camera module
Get RAW image M1, M2, M3, M4, etc. of intermediate exposure.
After getting long exposure image, intermediate exposure image and short exposed images, electronic equipment can be to long exposure diagram
Picture, intermediate exposure image and short exposed images carry out HDR synthesis processing, obtain the RAW composograph with high dynamic range.Its
In, nth frame image that the image for carrying out HDR synthesis processing can get for first object camera module, the second target
The third RAW image that the nth frame image and third camera module that camera module is got are got.Also, for carrying out HDR
The third RAW image that the first RAW image of nth frame, the second RAW image of nth frame and the third camera module of synthesis are got is
The synchronous image obtained.Also, when carrying out HDR synthesis, benchmark that electronic equipment can be synthesized using intermediate exposure image as HDR
Image.
For example, as shown in figure 4, electronic equipment can be with image L1, M1 and S1 after getting image L1, M1 and S1
HDR synthesis processing (taking M1 as the benchmark image of HDR synthesis) is carried out, the image P1 with high dynamic range is obtained.It is getting
After image P1, image P1 can be converted to the image of yuv format by electronic equipment, and be carried out such as to the image after format conversion
The default processing such as image sharpening, image noise reduction, the image that obtains that treated.Later, electronic equipment can should treated figure
On a display screen as display, i.e., it is shown to user in preview interface and checks.
After getting image L2, M2, S2, electronic equipment can carry out HDR synthesis processing to image L2, M2 and S2
(taking M2 as the benchmark image of HDR synthesis), obtains the image P2 with high dynamic range.When get image L3, M3, S3 it
Afterwards, electronic equipment can carry out HDR synthesis processing (taking M3 as the benchmark image of HDR synthesis) with image L3, M3, S3, be had
There is the image P3 of high dynamic range.After getting image L4, M4, S4, electronic equipment can be carried out with image L4, M4 and S4
HDR synthesis processing (taking M4 as the benchmark image of HDR synthesis), obtains having image P4 of high dynamic range, etc..
After successively obtaining image P2, P3 and P4, image P2, P3 and P4 can be equally converted to YUV lattice by electronic equipment
The image of formula, and carry out image sharpening, the default processing such as image noise reduction to the image after format conversion, obtains that treated
Image.Later, electronic equipment can should treated that image is shown on a display screen, i.e., user is shown in preview interface
It checks.It is converted by image P1, P2, P3 and P4 etc. by format and default treated figure that is, can successively be shown in preview interface
Picture.
It is understood that the image that can be displayed in preview interface in the present embodiment is denoted as preview frame image.Electricity
Corresponding preview frame image can be stored in pre-set image buffer queue by sub- equipment after often obtaining a preview frame image.
The pre-set image buffer queue can be fixed length queue, be also possible to non-fixed length queue.
For example, pre-set image buffer queue is fixed length queue in the present embodiment, queue length is 30 frames.For example, electronics is set
Standby image Y1, Y2, Y3, Y4 etc. successively obtained for preview.So, electronic equipment can by obtained image Y1, Y2,
Y3, Y4 are sequentially stored into pre-set image buffer queue.It is understood that is stored in pre-set image buffer queue is most always
The 30 frame preview frame images newly obtained, as shown in Figure 9.
Later, such as shown in Figure 10, user clicks the button of taking pictures in camera applications interface, and electronic equipment can at this time
To obtain a frame preview frame from pre-set image buffer queue, and the preview frame of the acquisition is shown on a display screen as photo
Effect of taking pictures is checked for user.For example, electronic equipment gets image Y60 from pre-set image buffer queue.So, electronics is set
It is checked for that image Y60 can be shown to user as photo, as shown in figure 11.
It is understood that when taking, electronic equipment can be directly from pre-set image buffer queue in the present embodiment
The image with high dynamic range is obtained, and user is showed to check, so as to achieve the effect that zero propagation is taken pictures.
Figure 12 is please referred to, Figure 12 is the structural schematic diagram of image processing apparatus provided by the embodiments of the present application.At the image
Reason device can be applied to electronic equipment, which may include that the first camera module, the second camera module and third are taken the photograph
As mould group, wherein second camera module can be focal length camera module, which can be black and white camera module.
Image processing apparatus 400 may include: determining module 401, obtain module 402, synthesis module 403, processing module 404.
Determining module 401, for determining that first object is taken the photograph from first camera module and second camera module
As mould group and the second target camera module.
Module 402 is obtained, for obtaining the first RAW image by the first object camera module, passes through described second
Target camera module obtains the second RAW image, and passes through third camera module acquisition third RAW image, wherein described the
One RAW image, the third RAW image, the exposure of second RAW image successively reduce.
Synthesis module 403 is used for using the third RAW image as benchmark image, to the first RAW image, the second RAW image
And third RAW image carries out synthesis processing, obtains the RAW composograph with high dynamic range.
Processing module 404 carries out the preview of image or operation of taking pictures or record a video for utilizing the RAW composograph.
In one embodiment, the determining module 401 can be used for:
First object camera module is randomly determined from first camera module and second camera module, and will
Another camera module being confirmed as outside the camera module of the first object camera module is determined as the second target camera module.
In one embodiment, the determining module 401 can be used for:
It is obtained and is clapped by any two camera module in the first camera module, the second camera module and third camera module
The depth of view information for the image taken the photograph;
According to the depth of view information, distant view image is obtained by second camera module;
The corresponding scene brightness of the distant view image is obtained, the scene brightness is for indicating the corresponding photographed scene of distant view
Bright-dark degree;
If the scene brightness of the distant view image is less than preset threshold, second camera module is determined as the first mesh
Camera module is marked, and first camera module is determined as the second target camera module;
If the scene brightness of the distant view image is greater than or equal to preset threshold, first camera module is determined as
First object camera module, and second camera module is determined as the second target camera module.
In one embodiment, first camera module, second camera module and the third image mould
The frame per second of group is identical.
In one embodiment, when the exposure of first RAW image, third RAW image and second RAW image
Between successively reduce.
In one embodiment, the synthesis module 403 can be used for:
The first RAW image of nth frame for getting to the first object camera module, the second target camera module obtain
The third RAW image that the second RAW image of nth frame and the third camera module got are got carries out synthesis processing, obtains
To the RAW composograph with high dynamic range, wherein the first RAW image of the nth frame, the nth frame for synthesis
The third RAW image that two RAW images and the third camera module are got is the synchronous image obtained.
In one embodiment, the processing module 404 can be used for:
The RAW composograph is converted into YUV composograph;
After carrying out default processing to the YUV composograph, the preview of image is carried out.
In one embodiment, the processing module 404 can be used for:
It will default treated that YUV composograph is stored in pre-set image buffer queue;
When carrying out photographing operation, a frame YUV composograph is obtained from the pre-set image buffer queue, and will acquire
The YUV composograph arrived is as photo display.
The embodiment of the present application provides a kind of computer-readable storage medium, computer program is stored thereon with, when described
When computer program executes on computers, so that the computer is executed as in image processing method provided in this embodiment
Process.
The embodiment of the present application also provides a kind of electronic equipment, including memory, and processor, the processor is by calling institute
The computer program stored in memory is stated, for executing the process in image processing method provided in this embodiment.
For example, above-mentioned electronic equipment can be the mobile terminals such as tablet computer or smart phone.Figure 13 is please referred to,
Figure 13 is the structural schematic diagram of electronic equipment provided by the embodiments of the present application.
The electronic equipment 500 may include the components such as camera module 501, memory 502, processor 503.Art technology
Personnel are appreciated that electronic devices structure shown in Figure 13 does not constitute the restriction to electronic equipment, may include than diagram
More or fewer components perhaps combine certain components or different component layouts.
Camera module 501 can be three camera modules etc. installed on electronic equipment.Wherein the camera module 501 can be with
Including the first camera module, the second camera module and third camera module.Second camera module can be focal length camera module.
The third camera module can be black and white camera module.
Memory 502 can be used for storing application program and data.It include that can hold in the application program that memory 502 stores
Line code.Application program can form various functional modules.Processor 503 is stored in the application journey of memory 502 by operation
Sequence, thereby executing various function application and data processing.
Processor 503 is the control centre of electronic equipment, utilizes each of various interfaces and the entire electronic equipment of connection
A part by running or execute the application program being stored in memory 502, and is called and is stored in memory 502
Data execute the various functions and processing data of electronic equipment, to carry out integral monitoring to electronic equipment.
In the present embodiment, the processor 503 in electronic equipment can be according to following instruction, will be one or more
The corresponding executable code of the process of application program is loaded into memory 502, and is run by processor 503 and be stored in storage
Application program in device 502, thereby executing:
First object camera module and the second target are determined from first camera module and second camera module
Camera module;
The first RAW image is obtained by the first object camera module, is obtained by the second target camera module
Second RAW image, and pass through the third camera module and obtain third RAW image, wherein first RAW image, described the
Three RAW images, the exposure of second RAW image successively reduce;
Using the third RAW image as benchmark image, to the first RAW image, the second RAW image and third RAW image
Synthesis processing is carried out, the RAW composograph with high dynamic range is obtained;
Using the RAW composograph, the preview of image is carried out or operation of taking pictures or record a video.
The embodiment of the present invention also provides a kind of electronic equipment.It may include image processing circuit in above-mentioned electronic equipment, figure
It is realized as processing circuit can use hardware and or software component, it may include define image signal process (Image Signal
Processing) the various processing units of pipeline.Image processing circuit at least may include: camera, image-signal processor
(Image Signal Processor, ISP processor), control logic device, video memory and display etc..Wherein image
Head at least may include one or more lens and imaging sensor.
Imaging sensor may include colour filter array (such as Bayer filter).Imaging sensor can obtain and use image sensing
The luminous intensity and wavelength information that each imaging pixel of device captures, and it is original to provide one group for being handled by image-signal processor
Image data.
Image-signal processor can handle raw image data pixel by pixel in various formats.For example, each image
Pixel can have the bit depth of 8,10,12 or 14 bits, and image-signal processor can carry out one or more to raw image data
The statistical information of a image processing operations, collection about image data.Wherein, image processing operations can be by identical or different position
Depth accuracy carries out.Raw image data can be stored into video memory after image-signal processor is handled.Image letter
Number processor can also receive image data from video memory.
Video memory dedicated can be deposited for independent in a part, storage equipment or electronic equipment of memory device
Reservoir, and may include DMA (Direct Memory Access, direct direct memory access (DMA)) feature.
When receiving the image data from video memory, image-signal processor can carry out one or more images
Processing operation, such as time-domain filtering.Image data that treated can be transmitted to video memory, another to carry out before shown
Outer processing.Image-signal processor can also receive processing data from video memory, and carry out to the processing data original
Image real time transfer in domain and in RGB and YCbCr color space.Treated, and image data may be output to display, with
It watches for user and/or is further located by graphics engine or GPU (Graphics Processing Unit, graphics processor)
Reason.In addition, the output of image-signal processor also can be transmitted to video memory, and display can read from video memory and scheme
As data.In one embodiment, video memory can be configured to realize one or more frame buffers.
The statistical data that image-signal processor determines can be transmitted to control logic device.For example, statistical data may include certainly
The statistics of the imaging sensors such as dynamic exposure, automatic white balance, automatic focusing, flicker detection, black level compensation, correcting lens shadow
Information.
Control logic device may include the processor and/or microcontroller for executing one or more routines (such as firmware).One
Or multiple routines can statistical data based on the received, determine the control parameter and ISP control parameter of camera.For example, camera shooting
The control parameter of head may include camera flash control parameter, the control parameter of lens (such as focus or zoom focal length) or
The combination of these parameters.ISP control parameter may include for automatic white balance and color adjustment (for example, during RGB processing)
Gain level and color correction matrix etc..
Figure 14 is please referred to, Figure 14 is the structural schematic diagram of image processing circuit in the present embodiment.As shown in figure 14, for convenient for
Illustrate, the various aspects of image processing techniques relevant to the embodiment of the present invention are only shown.
Image processing circuit may include: the first camera module 510, the second camera module 520, third camera module 580,
First image-signal processor 530, the second image-signal processor 540, third image-signal processor 590, control logic device
550, video memory 560, display 570.Wherein, the first camera module 510 may include one or more first lens 511
With the first imaging sensor 512.Second camera module 520 may include that one or more second lens 521 and the second image pass
Sensor 522.Third camera module 580 may include one or more second lens 581 and the second imaging sensor 582.
In one embodiment, above-mentioned second camera module 520 can be wide-angle imaging mould group, third camera module
580 can be black and white camera module.First camera module 510 can be common camera module, such as neither focal length nor wide-angle are taken the photograph
As mould group.
First image transmitting of the first camera module 510 acquisition is handled to the first image-signal processor 530.First
After image-signal processor 530 handles the first image, can by the statistical data of the first image (brightness of such as image, image it is anti-
Difference, color of image etc.) it is sent to control logic device 550.Control logic device 550 can determine the first camera shooting according to statistical data
The control parameter of mould group 510, so that the first camera module 510 can carry out the behaviour such as auto-focusing, automatic exposure according to control parameter
Make.First image can store after the first image-signal processor 530 is handled into video memory 560.First figure
As signal processor 530 can also read the image stored in video memory 560 to be handled.In addition, the first image passes through
Display 570 can be sent directly to after image-signal processor 530 is handled by, which crossing, is shown.Display 570 can also be read
Take the image in video memory 560 to be shown.
Second image transmitting of the second camera module 520 acquisition is handled to the second image-signal processor 540.Second
After image-signal processor 540 handles the second image, can by the statistical data of the second image (brightness of such as image, image it is anti-
Difference, color of image etc.) it is sent to control logic device 550.Control logic device 550 can determine the second camera shooting according to statistical data
The control parameter of mould group 520, so that the second camera module 520 can carry out the behaviour such as auto-focusing, automatic exposure according to control parameter
Make.Second image can store after the second image-signal processor 540 is handled into video memory 560.Second figure
As signal processor 540 can also read the image stored in video memory 560 to be handled.In addition, the second image passes through
Display 570 can be sent directly to after image-signal processor 540 is handled by, which crossing, is shown.Display 570 can also be read
Take the image in video memory 560 to be shown.
The third image transmitting that third camera module 580 acquires is handled to third image-signal processor 590.Third
After image-signal processor 590 handles third image, can by the statistical data of third image (brightness of such as image, image it is anti-
Difference, color of image etc.) it is sent to control logic device 550.Control logic device 550 can determine that third is imaged according to statistical data
The control parameter of mould group 580, so that third camera module 580 can carry out the behaviour such as auto-focusing, automatic exposure according to control parameter
Make.Third image can store after third image-signal processor 590 is handled into video memory 560.Third figure
As signal processor 590 can also read the image stored in video memory 560 to be handled.In addition, third image passes through
Display 570 can be sent directly to after third image-signal processor 590 is handled by, which crossing, is shown.Display 570 can also
It is shown with reading the image in video memory 560.
In other embodiments, the first image-signal processor, the second image-signal processor, third picture signal
Processor can also synthesize unified image-signal processor, handle the first imaging sensor and the second imaging sensor respectively
Data.
In addition, not having displaying in figure, electronic equipment can also include CPU and power supply module.CPU and logic controller,
First image-signal processor, the second image-signal processor, third image-signal processor, video memory and display are equal
Connection, CPU is for realizing overall situation control.Power supply module is used to power for modules.
In general, the mobile phone with three camera modules, under certain photographing modes, three camera modules work.At this point,
It is the first camera module, the second camera module and the power supply of third camera module that CPU, which controls power supply module,.In first camera module
Imaging sensor powers on, and the imaging sensor in the second camera module powers on, and the imaging sensor in third camera module powers on,
So as to realize the acquisition conversion of image.Under certain photographing modes, a camera work in three camera modules can be
Make.For example, only wide-angle camera works.In this case, CPU controls power supply module and supplies to the imaging sensor of corresponding camera
Electricity.
The following are the processes that image processing method provided in this embodiment is realized with image processing techniques in Figure 14:
First object camera module and the second target are determined from first camera module and second camera module
Camera module;
The first RAW image is obtained by the first object camera module, is obtained by the second target camera module
Second RAW image, and pass through the third camera module and obtain third RAW image, wherein first RAW image, described the
Three RAW images, the exposure of second RAW image successively reduce;
Using the third RAW image as benchmark image, to the first RAW image, the second RAW image and third RAW image
Synthesis processing is carried out, the RAW composograph with high dynamic range is obtained;
Using the RAW composograph, the preview of image is carried out or operation of taking pictures or record a video.
In one embodiment, electronic equipment is executed from first camera module and second camera module really
It when determining first object camera module and the second target camera module, can execute: randomly from first camera module and institute
It states and determines first object camera module in the second camera module, and the camera shooting mould that the first object camera module will be confirmed as
Another camera module outside group is determined as the second target camera module.
In one embodiment, electronic equipment is executed from first camera module and second camera module really
It when determining first object camera module and the second target camera module, can execute: by the first camera module, the second camera module
The depth of view information for the image that shooting obtains is obtained with any two camera module in third camera module;Believed according to the depth of field
Breath obtains distant view image by second camera module;The corresponding scene brightness of the distant view image is obtained, the scene is bright
Spend the bright-dark degree for indicating the corresponding photographed scene of distant view;If the scene brightness of the distant view image is less than preset threshold,
Second camera module is then determined as first object camera module, and first camera module is determined as the second target
Camera module;If the scene brightness of the distant view image is greater than or equal to preset threshold, first camera module is determined
For first object camera module, and second camera module is determined as the second target camera module.
In one embodiment, first camera module, second camera module and the third image mould
The frame per second of group is identical.
In one embodiment, the exposure of first RAW image, the third RAW image, second RAW image
Luminosity successively reduces, and may include: the time for exposure of first RAW image, third RAW image and second RAW image
Successively reduce.
In one embodiment, electronic equipment executes described to the first RAW image, the second RAW image and the 3rd RAW
Image carries out synthesis processing, when obtaining the RAW composograph with high dynamic range, can execute: take the photograph to the first object
The second RAW image of nth frame that the first RAW image of nth frame for getting as mould group, the second target camera module are got with
And the third RAW image that the third camera module is got carries out synthesis processing, obtains having the RAW of high dynamic range to synthesize
Image, wherein the first RAW image of the nth frame, the second RAW image of the nth frame and the third for synthesis image
The third RAW image that mould group is got is the synchronous image obtained.
In one embodiment, electronic equipment, which executes, utilizes the RAW composograph can when carrying out the preview of image
To execute: the RAW composograph is converted to YUV composograph;After carrying out default processing to the YUV composograph, into
The preview of row image.
In one embodiment, electronic equipment can also be performed: will default treated that the deposit of YUV composograph is default
Image buffer storage queue;When carrying out photographing operation, a frame YUV composograph is obtained from the pre-set image buffer queue, and
The YUV composograph that will acquire is as photo display.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, it may refer to the detailed description above with respect to image processing method, details are not described herein again.
Image processing method in described image processing unit provided by the embodiments of the present application and foregoing embodiments belongs to together
One design can run either offer method in described image processing method embodiment in described image processing unit,
Specific implementation process is detailed in described image processing method embodiment, and details are not described herein again.
It should be noted that those of ordinary skill in the art can for the embodiment of the present application described image processing method
With understand realize the embodiment of the present application described image processing method all or part of the process, be can by computer program come
Relevant hardware is controlled to complete, the computer program can be stored in a computer-readable storage medium, such as be stored in
It in memory, and is executed by least one processor, in the process of implementation may include the embodiment such as described image processing method
Process.Wherein, the storage medium can be magnetic disk, CD, read-only memory (ROM, Read Only Memory), random
Access/memory body (RAM, Random Access Memory) etc..
For the described image processing unit of the embodiment of the present application, each functional module be can integrate in a processing core
In piece, it is also possible to modules and physically exists alone, can also be integrated in two or more modules in a module.On
It states integrated module both and can take the form of hardware realization, can also be realized in the form of software function module.The collection
If at module realized in the form of software function module and when sold or used as an independent product, also can store
In one computer-readable storage medium, the storage medium is for example read-only memory, disk or CD etc..
Above to a kind of image processing method, device, storage medium and electronic equipment provided by the embodiment of the present application
It is described in detail, specific examples are used herein to illustrate the principle and implementation manner of the present application, the above reality
The explanation for applying example is merely used to help understand the present processes and its core concept;Meanwhile for those skilled in the art,
According to the thought of the application, there will be changes in the specific implementation manner and application range, in conclusion in this specification
Hold the limitation that should not be construed as to the application.
Claims (11)
1. a kind of image processing method is applied to electronic equipment, which is characterized in that the electronic equipment includes the first camera shooting mould
Group, the second camera module and third camera module, wherein second camera module is focal length camera module, the third camera shooting
Mould group is black and white camera module, which comprises
First object camera module and the camera shooting of the second target are determined from first camera module and second camera module
Mould group;
The first RAW image is obtained by the first object camera module, obtains second by the second target camera module
RAW image, and third RAW image is obtained by the third camera module, wherein first RAW image, the third
RAW image, the exposure of second RAW image successively reduce;
Using the third RAW image as benchmark image, the first RAW image, the second RAW image and third RAW image are carried out
Synthesis processing, obtains the RAW composograph with high dynamic range;
Using the RAW composograph, the preview of image is carried out or operation of taking pictures or record a video.
2. image processing method according to claim 1, which is characterized in that from first camera module and described second
First object camera module and the second target camera module are determined in camera module, comprising:
First object camera module is randomly determined from first camera module and second camera module, and will be true
It is set to another camera module outside the camera module of the first object camera module and is determined as the second target camera module.
3. image processing method according to claim 1, which is characterized in that from first camera module and described second
First object camera module and the second target camera module are determined in camera module, comprising:
It is shot by any two camera module acquisition in the first camera module, the second camera module and third camera module
The depth of view information of the image arrived;
According to the depth of view information, distant view image is obtained by second camera module;
The corresponding scene brightness of the distant view image is obtained, the scene brightness is for indicating the bright of the corresponding photographed scene of distant view
Dark degree;
If the scene brightness of the distant view image is less than preset threshold, second camera module is determined as first object and is taken the photograph
As mould group, and first camera module is determined as the second target camera module;
If the scene brightness of the distant view image is greater than or equal to preset threshold, first camera module is determined as first
Target camera module, and second camera module is determined as the second target camera module.
4. image processing method according to claim 1, which is characterized in that first camera module, described second are taken the photograph
As the frame per second of mould group and the third camera module is identical.
5. image processing method according to claim 4, which is characterized in that first RAW image, the 3rd RAW
Image, second RAW image exposure successively reduce, comprising:
The time for exposure of first RAW image, third RAW image and second RAW image is successively reduced.
6. image processing method according to claim 1, which is characterized in that described to scheme to the first RAW image, the 2nd RAW
Picture and third RAW image carry out synthesis processing, obtain the RAW composograph with high dynamic range, comprising:
The first RAW image of nth frame for getting to the first object camera module, the second target camera module are got
The second RAW image of nth frame and the third RAW image that gets of the third camera module carry out synthesis processing, had
There is the RAW composograph of high dynamic range, wherein the first RAW image of the nth frame, the nth frame second for synthesis
The third RAW image that RAW image and the third camera module are got is the synchronous image obtained.
7. image processing method according to claim 1, which is characterized in that utilize the RAW composograph, carry out image
Preview, comprising:
The RAW composograph is converted into YUV composograph;
After carrying out default processing to the YUV composograph, the preview of image is carried out.
8. image processing method according to claim 7, which is characterized in that the method also includes:
It will default treated that YUV composograph is stored in pre-set image buffer queue;
When carrying out photographing operation, a frame YUV composograph is obtained from the pre-set image buffer queue, and will acquire
The YUV composograph is as photo display.
9. a kind of image processing apparatus is applied to electronic equipment, which is characterized in that the electronic equipment includes the first camera shooting mould
Group, the second camera module and third camera module, wherein second camera module is focal length camera module, the third camera shooting
Mould group is black and white camera module, and described device includes:
Determining module, for from first camera module and second camera module determine first object camera module and
Second target camera module;
Module is obtained, for obtaining the first RAW image by the first object camera module, is imaged by second target
Mould group obtains the second RAW image, and obtains third RAW image by the third camera module, wherein the first RAW figure
Picture, the third RAW image, the exposure of second RAW image successively reduce;
Synthesis module, for using the third RAW image as benchmark image, to the first RAW image, the second RAW image and the
Three RAW images carry out synthesis processing, obtain the RAW composograph with high dynamic range;
Processing module carries out the preview of image or operation of taking pictures or record a video for utilizing the RAW composograph.
10. a kind of storage medium, is stored thereon with computer program, which is characterized in that when the computer program is in computer
When upper execution, so that the computer executes such as method described in any item of the claim 1 to 8.
11. a kind of electronic equipment, including memory, processor, which is characterized in that the processor is by calling the memory
The computer program of middle storage, for executing such as method described in any item of the claim 1 to 8.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910580166.8A CN110290325B (en) | 2019-06-28 | 2019-06-28 | Image processing method, image processing device, storage medium and electronic equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910580166.8A CN110290325B (en) | 2019-06-28 | 2019-06-28 | Image processing method, image processing device, storage medium and electronic equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110290325A true CN110290325A (en) | 2019-09-27 |
CN110290325B CN110290325B (en) | 2021-03-02 |
Family
ID=68019795
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910580166.8A Active CN110290325B (en) | 2019-06-28 | 2019-06-28 | Image processing method, image processing device, storage medium and electronic equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110290325B (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112991188A (en) * | 2019-12-02 | 2021-06-18 | RealMe重庆移动通信有限公司 | Image processing method and device, storage medium and electronic equipment |
CN113259594A (en) * | 2021-06-22 | 2021-08-13 | 展讯通信(上海)有限公司 | Image processing method and device, computer readable storage medium and terminal |
EP4156673A4 (en) * | 2021-08-11 | 2023-04-26 | Honor Device Co., Ltd. | Image capture method and related device thereof |
WO2023087939A1 (en) * | 2021-11-22 | 2023-05-25 | 哲库科技(上海)有限公司 | Image processing method and apparatus and storage medium |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101170650A (en) * | 2006-10-24 | 2008-04-30 | 致伸科技股份有限公司 | Highly dynamic image method and system generating specific scenario |
JP2013162190A (en) * | 2012-02-02 | 2013-08-19 | Canon Inc | High dynamic range moving image photographing auxiliary device |
CN105872148A (en) * | 2016-06-21 | 2016-08-17 | 维沃移动通信有限公司 | Method and mobile terminal for generating high dynamic range images |
CN106791377A (en) * | 2016-11-29 | 2017-05-31 | 广东欧珀移动通信有限公司 | Control method, control device and electronic installation |
CN107395898A (en) * | 2017-08-24 | 2017-11-24 | 维沃移动通信有限公司 | A kind of image pickup method and mobile terminal |
CN109922322A (en) * | 2019-04-10 | 2019-06-21 | Oppo广东移动通信有限公司 | Photographic method, image processor, camera arrangement and electronic equipment |
-
2019
- 2019-06-28 CN CN201910580166.8A patent/CN110290325B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101170650A (en) * | 2006-10-24 | 2008-04-30 | 致伸科技股份有限公司 | Highly dynamic image method and system generating specific scenario |
JP2013162190A (en) * | 2012-02-02 | 2013-08-19 | Canon Inc | High dynamic range moving image photographing auxiliary device |
CN105872148A (en) * | 2016-06-21 | 2016-08-17 | 维沃移动通信有限公司 | Method and mobile terminal for generating high dynamic range images |
CN106791377A (en) * | 2016-11-29 | 2017-05-31 | 广东欧珀移动通信有限公司 | Control method, control device and electronic installation |
CN107395898A (en) * | 2017-08-24 | 2017-11-24 | 维沃移动通信有限公司 | A kind of image pickup method and mobile terminal |
CN109922322A (en) * | 2019-04-10 | 2019-06-21 | Oppo广东移动通信有限公司 | Photographic method, image processor, camera arrangement and electronic equipment |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112991188A (en) * | 2019-12-02 | 2021-06-18 | RealMe重庆移动通信有限公司 | Image processing method and device, storage medium and electronic equipment |
CN112991188B (en) * | 2019-12-02 | 2023-06-27 | RealMe重庆移动通信有限公司 | Image processing method and device, storage medium and electronic equipment |
CN113259594A (en) * | 2021-06-22 | 2021-08-13 | 展讯通信(上海)有限公司 | Image processing method and device, computer readable storage medium and terminal |
EP4156673A4 (en) * | 2021-08-11 | 2023-04-26 | Honor Device Co., Ltd. | Image capture method and related device thereof |
WO2023087939A1 (en) * | 2021-11-22 | 2023-05-25 | 哲库科技(上海)有限公司 | Image processing method and apparatus and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN110290325B (en) | 2021-03-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109005366B (en) | Night scene shooting processing method and device for camera module, electronic equipment and storage medium | |
CN108419023B (en) | Method for generating high dynamic range image and related equipment | |
CN108683862B (en) | Imaging control method, imaging control device, electronic equipment and computer-readable storage medium | |
US11532076B2 (en) | Image processing method, electronic device and storage medium | |
CN107959778B (en) | Imaging method and device based on dual camera | |
CN108322646B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
CN110072052B (en) | Image processing method and device based on multi-frame image and electronic equipment | |
CN110445988A (en) | Image processing method, device, storage medium and electronic equipment | |
CN109040609A (en) | Exposal control method, device and electronic equipment | |
WO2020057199A1 (en) | Imaging method and device, and electronic device | |
CN109068067A (en) | Exposal control method, device and electronic equipment | |
CN110248106B (en) | Image noise reduction method and device, electronic equipment and storage medium | |
CN109672819B (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
CN110198418A (en) | Image processing method, device, storage medium and electronic equipment | |
CN110198417A (en) | Image processing method, device, storage medium and electronic equipment | |
CN110290325A (en) | Image processing method, device, storage medium and electronic equipment | |
CN107948500A (en) | Image processing method and device | |
CN110505411A (en) | Image capturing method, device, storage medium and electronic equipment | |
CN110445989A (en) | Image processing method, device, storage medium and electronic equipment | |
EP3820141A1 (en) | Imaging control method and apparatus, electronic device, and readable storage medium | |
CN110213502A (en) | Image processing method, device, storage medium and electronic equipment | |
US20140063288A1 (en) | Imaging apparatus, electronic device and method providing exposure compensation | |
CN110430370B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
CN107509044A (en) | Image combining method, device, computer-readable recording medium and computer equipment | |
CN110198419A (en) | Image processing method, device, storage medium and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |