CN109993722A - Image processing method, device, storage medium and electronic equipment - Google Patents
Image processing method, device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN109993722A CN109993722A CN201910280476.8A CN201910280476A CN109993722A CN 109993722 A CN109993722 A CN 109993722A CN 201910280476 A CN201910280476 A CN 201910280476A CN 109993722 A CN109993722 A CN 109993722A
- Authority
- CN
- China
- Prior art keywords
- image
- raw
- electronic equipment
- composograph
- buffer queue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 32
- 238000003860 storage Methods 0.000 title claims description 18
- 239000000872 buffer Substances 0.000 claims abstract description 140
- 238000012545 processing Methods 0.000 claims abstract description 90
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 28
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 28
- 238000011946 reduction process Methods 0.000 claims abstract description 17
- 238000000034 method Methods 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 11
- 238000005457 optimization Methods 0.000 claims description 5
- 230000004044 response Effects 0.000 claims description 4
- 238000003384 imaging method Methods 0.000 description 36
- 238000010586 diagram Methods 0.000 description 19
- 230000008569 process Effects 0.000 description 14
- 230000009467 reduction Effects 0.000 description 12
- 230000006870 function Effects 0.000 description 7
- 238000003707 image sharpening Methods 0.000 description 7
- 238000011282 treatment Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 6
- 238000006243 chemical reaction Methods 0.000 description 5
- 239000002131 composite material Substances 0.000 description 4
- 230000005611 electricity Effects 0.000 description 3
- 241000208340 Araliaceae Species 0.000 description 2
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 2
- 235000003140 Panax quinquefolius Nutrition 0.000 description 2
- 230000001934 delay Effects 0.000 description 2
- 238000000151 deposition Methods 0.000 description 2
- 235000008434 ginseng Nutrition 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/92—Dynamic range modification of images or parts thereof based on global image properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20208—High dynamic range [HDR] image processing
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
This application discloses a kind of image processing methods, comprising: obtains RAW image packet, includes at least two frame RAW images in RAW image packet, which is the image obtained under target scene and has the different time for exposure;Unpacking processing is carried out to RAW image packet, obtains at least two frame RAW images;Synthesis processing is carried out at least two frame RAW images, obtains the RAW composograph with high dynamic range;The operational parameter value of electronic equipment is obtained, operational parameter value is used to indicate the computing capability of electronic equipment;According to operational parameter value, determines and the RAW composograph is stored in pre-set image buffer queue under target scene, or be stored in pre-set image buffer queue after RAW composograph is converted to YUV composograph;When receiving photographing instruction, the multiframe history buffer image of target scene is obtained from pre-set image buffer queue, and multiframe noise reduction process is carried out to multiframe history buffer image, obtain noise-reduced image;According to noise-reduced image, the photographing instruction is responded.
Description
Technical field
The application belongs to image technique field more particularly to a kind of image processing method, device, storage medium and electronics are set
It is standby.
Background technique
Due to the hardware limitation of electronic equipment itself, current electronic equipment can only shoot the smaller field of brightness range
Scape shoots the image come and is easily lost the thin of daylight and/or dark place if being shot when scene light and shade difference is too big
Section.That is, the imaging effect for the image that electronic equipment is handled is poor.
Summary of the invention
The embodiment of the present application provides a kind of image processing method, device, storage medium and electronic equipment, and image can be improved
Imaging effect.
The embodiment of the present application provides a kind of image processing method, comprising:
RAW image packet is obtained, includes at least two frame RAW images, at least two frame RAW images in the RAW image packet
It is the image obtained under target scene and there is the different time for exposure;
Unpacking processing is carried out to the RAW image packet, obtains at least two frame RAW images;
Synthesis processing is carried out at least two frame RAW images, obtains the RAW composograph with high dynamic range;
The operational parameter value of electronic equipment is obtained, the operational parameter value is used to indicate the calculating energy of the electronic equipment
Power;
According to the operational parameter value, determines and the RAW composograph is stored in pre-set image under the target scene
Buffer queue, or pre-set image buffer queue is stored in after the RAW composograph is converted to YUV composograph;
When receiving photographing instruction, the multiframe history buffer of target scene is obtained from the pre-set image buffer queue
Image, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image;
According to the noise-reduced image, the photographing instruction is responded.
The embodiment of the present application provides a kind of image processing apparatus, comprising:
First obtains module, includes at least two frame RAW images, institute in the RAW image packet for obtaining RAW image packet
Stating at least two frame RAW images is the image obtained under target scene and has the different time for exposure;
Module is unpacked, for carrying out unpacking processing to the RAW image packet, obtains at least two frame RAW images;
Synthesis module obtains having high dynamic range for carrying out synthesis processing at least two frame RAW images
RAW composograph;
Second obtains module, and for obtaining the operational parameter value of electronic equipment, the operational parameter value is for indicating described
The computing capability of electronic equipment;
Cache module, for determining the RAW composograph under the target scene according to the operational parameter value
It is stored in pre-set image buffer queue, or is stored in pre-set image caching after the RAW composograph is converted to YUV composograph
Queue;
Processing module, for obtaining target scene from the pre-set image buffer queue when receiving photographing instruction
Multiframe history buffer image, and to the multiframe history buffer image carry out multiframe noise reduction process, obtain noise-reduced image;
Respond module, for responding the photographing instruction according to the noise-reduced image.
The embodiment of the present application provides a kind of storage medium, is stored thereon with computer program, when the computer program exists
When being executed on computer, so that the computer executes image processing method provided by the embodiments of the present application.
The embodiment of the present application also provides a kind of electronic equipment, including memory, and processor, the processor is by calling institute
The computer program stored in memory is stated, for executing image processing method provided by the embodiments of the present application.
In the present embodiment, electronic equipment can first be synthesized the RAW image with different exposure time, be had
The RAW composograph of high dynamic range, and the YUV composograph that RAW composograph or RAW composograph are converted to is deposited
Enter in pre-set image buffer queue.When taking, electronic equipment can obtain multiframe from the pre-set image buffer queue and have
The image of high dynamic range carries out multiframe noise reduction, obtains noise-reduced image, and respond photographing instruction according to the noise-reduced image.Therefore,
What the present embodiment obtained take pictures image with high dynamic range effect and noise it is smaller, i.e., the present embodiment can be improved image at
As effect.
Detailed description of the invention
With reference to the accompanying drawing, it is described in detail by the specific embodiment to the application, the technical solution of the application will be made
And its advantages are apparent.
Fig. 1 is the flow diagram of image processing method provided by the embodiments of the present application.
Fig. 2 is the schematic diagram of RAW image packet provided by the embodiments of the present application.
Fig. 3 is another flow diagram of image processing method provided by the embodiments of the present application.
Fig. 4 to fig. 6 is the schematic diagram of a scenario of image processing method provided by the embodiments of the present application.
Fig. 7 is the structural schematic diagram of image processing apparatus provided by the embodiments of the present application.
Fig. 8 is the structural schematic diagram of electronic equipment provided by the embodiments of the present application.
Fig. 9 is another structural schematic diagram of electronic equipment provided by the embodiments of the present application.
Figure 10 is the structural schematic diagram of image processing circuit provided by the embodiments of the present application.
Specific embodiment
Diagram is please referred to, wherein identical component symbol represents identical component, the principle of the application is to implement one
It is illustrated in computing environment appropriate.The following description be based on illustrated by the application specific embodiment, should not be by
It is considered as limitation the application other specific embodiments not detailed herein.
It is understood that the executing subject of the embodiment of the present application can be the electricity of smart phone or tablet computer etc.
Sub- equipment.
Referring to Fig. 1, Fig. 1 is the flow diagram of image processing method provided by the embodiments of the present application, process be can wrap
It includes:
In 101, RAW image packet is obtained, includes at least two frame RAW images, at least two frame RAW in the RAW image packet
Image is the image obtained under target scene and has the different time for exposure.
Image processing method provided in this embodiment can be applied to the electronic equipment with camera module.Electronic equipment
Camera module is made of lens and imaging sensor, and wherein lens are used to acquire external light signal and are supplied to image sensing
Device, image sensor senses are converted into digitized raw image data, i.e. RAW figure from the light signal of lens
As data.RAW is unprocessed, also uncompressed format, it can be visually known as to " digital negative ".Electronic equipment
The imaging sensor of camera module can have the first operating mode and the second operating mode.
It should be noted that imaging sensor will generate at least two within the time of a frame under first operating mode
Different RAW image of a time for exposure, and exported in the form of RAW image packet.For example, the frame per second of imaging sensor is 30fps,
Then imaging sensor can generate two time for exposure different RAW image in a thirtieth second, and with the shape of RAW image packet
Formula output.For example, referring to figure 2., working in the RAW image packet of the imaging sensor output of the first operating mode may include
The data of two RAW images, and the time for exposure of one of RAW image is twice of another RAW image time for exposure.When
The ratio of the time for exposure length of this right two frames RAW image is also possible to other numerical value, such as 3:1 or 4:1 or 3:2,
The present embodiment is not specifically limited in this embodiment.For example, imaging sensor is when generating two exposures in a thirtieth second for first
Between different RAW image, for example be the first RAW image L1 and the second RAW image S1.That is, imaging sensor carried out it is longer
After exposure obtains L1 picture frame, L1 picture frame can't be exported at once, but L1 picture frame is stored in the caching of imaging sensor
In device, and the charge accumulated on imaging sensor is emptied at once, then carry out obtaining S1 picture frame compared with short exposure.Reading out S1 figure
As after frame, the data of L1 picture frame and S1 picture frame can be packaged and be processed into RAW image packet and export by electronic equipment.Image
Sensor also generates two time for exposure different RAW image in a thirtieth second at second, for example is the first RAW image
L2 and the second RAW image S2.Imaging sensor generates the first RAW image L3 and the 2nd RAW in third a thirtieth second
Image S3.Imaging sensor generates the first RAW image L4 and the second RAW image S4, etc. in a thirtieth second at the 4th.
It should be noted that time for exposure longer image in RAW image packet is uniformly denoted as the first RAW image in the present embodiment, it will
Time for exposure shorter image is uniformly denoted as the second RAW image.In the present embodiment, the time for exposure of all first RAW images
Can be identical, such as be T1.The time for exposure of all second RAW images can be identical, such as is T2.
It is understood that since shooting interval is very short, it can be considered that the RAW image in RAW image packet is
The image shot under Same Scene.For example, including the number of the first RAW image and the second RAW image in RAW image packet
According to it may be considered that the first RAW image and the second RAW image are to shoot to obtain under Same Scene (for example, target scene)
Image.
Above-mentioned second operating mode is normal mode of operation.In this second mode of operation, imaging sensor is in a frame figure
It will generate an individual RAW image in the time of picture, rather than RAW image packet.For example, image passes under normal mode of operation
The frame per second of sensor is 60fps, then imaging sensor can generate a frame RAW image and be exported within each sixtieth second.
In the embodiment of the present application, electronic equipment can first pass through work and obtain in the imaging sensor of the first operating mode
One RAW image packet.Wherein, it is converged on imaging sensor after the lens of camera from the optical signal of current scene,
Imaging sensor will carry out the rapid alternation with different exposure time, and lasting output includes that the RAW of at least two frame RAW images schemes
As packet.It is understood that at least two frame RAW images for including in the RAW image packet obtain and are had under same scene
There is the different time for exposure.
For example, electronic equipment enables imaging sensor, and makes its work after user's operation electronic equipment opens camera applications
Make in the first operating mode.If the camera of user's operation electronic equipment is directed at a certain scene, electronic equipment will pass through work
The RAW image packet under the scene is persistently got in the imaging sensor of the first operating mode, is included at least in the RAW image packet
Two frames have the RAW image of different exposure time.
In 102, unpacking processing is carried out to RAW image packet, obtains at least two frame RAW images.
In 103, to this, at least two frame RAW images carry out synthesis processing, obtain the RAW composite diagram with high dynamic range
Picture.
For example, 102 and 103 may include:
After getting RAW image packet, electronic equipment can carry out unpacking processing to the RAW image packet, to obtain
At least two frame RAW images.
After carrying out unpacking processing to RAW image packet, electronic equipment can to the obtained at least two frame RAW images of unpacking into
Row HDR synthesis processing, to obtain the RAW composograph with high dynamic range.
In 104, the operational parameter value of electronic equipment is obtained, which is used to indicate the calculating of the electronic equipment
Ability.
For example, obtain after there is the RAW composograph of high dynamic range, its available operational parameter value of electronic equipment,
Wherein, which can be intended to indicate that the numerical value of the parameter of the computing capability (processing capacity) of electronic equipment.
In 105, according to operational parameter value, determine RAW composograph deposit pre-set image caching under target scene
Queue, or the pre-set image buffer queue is stored in after the RAW composograph is converted to YUV composograph.
For example, electronic equipment can be according to the operational parameter value, to determine in target after getting operational parameter value
It is RAW composograph to be stored in pre-set image buffer queue, or the RAW composograph is converted into YUV and is closed under scene
At being restored again into after image in the pre-set image buffer queue.
For example, electronic equipment determines that RAW composograph is stored in default figure under target scene according to operational parameter value
In picture buffer queue, then the RAW composograph can be stored in pre-set image buffer queue by the electronic equipment.
Alternatively, electronic equipment determines that RAW composograph is converted to YUV under target scene according to operational parameter value
It is restored again into after composograph in pre-set image buffer queue.So, electronic equipment can first be converted to the RAW composograph
Yuv format to obtain YUV composograph, then the YUV composograph is stored in pre-set image buffer queue.
It should be noted that the result that electronic equipment is determined (closes RAW under target scene in 105 process
It is stored in pre-set image buffer queue at image, or is restored again into pre-set image after RAW composograph is converted to YUV composograph
Buffer queue) it is effective (when i.e. scene does not change) under the target scene.
For example, camera is directed at scenario A, electronic equipment can rapidly, constantly at this time after user opens camera applications
Ground obtains RAW image packet.If electronic equipment is it is determined that RAW composograph deposit pre-set image is delayed according to operational parameter value
It deposits in queue, then all RAW image packets accessed during camera is directed at scenario A are all by RAW composite diagram
As in deposit pre-set image buffer queue.For example, electronic equipment gets first during camera is directed at scenario A
After RAW image packet, according to the operating parameter of electronic equipment it is determined that RAW composograph is stored in pre-set image buffer queue
In, then the RAW image packet of the scenario A next got is all that RAW composograph is stored in pre-set image buffer queue.
For example, electronic equipment gets 10 RAW image packets in scenario A, then being all to close RAW about this 10 RAW image packets
At in image deposit pre-set image buffer queue.
Later, such as user moves camera, and camera is targeted by scenario B, then electronic equipment can root again
According to operating parameter determination, to be under scenario B be that RAW composograph is stored in pre-set image buffer queue, or the RAW is synthesized
Image is stored in the pre-set image buffer queue after being converted to YUV composograph.For example, electronic equipment is it is determined that RAW is synthesized
Image is stored in the pre-set image buffer queue after being converted to YUV composograph.For example, during camera is directed at scenario B,
After electronic equipment gets first RAW image packet, according to the operating parameter of electronic equipment it is determined that RAW composograph is turned
It is stored in pre-set image buffer queue after being changed to YUV composograph, then the RAW image packet of the scenario B next got is all
It is to be stored in pre-set image buffer queue after RAW composograph to be converted to YUV composograph.For example, electronic equipment is in scenario B
In get 15 RAW image packets, then being all that RAW composograph is converted to YUV composite diagram about this 15 RAW image packets
It is stored in pre-set image buffer queue as after.
That is, electronic equipment needs determine it is by RAW according to operating parameter again when changing scene
Composograph is stored in pre-set image buffer queue, or RAW composograph is converted to be restored again into after YUV composograph it is default
In image buffer storage queue.For example, camera is directed at scenario A again by user after scenario B, then electronic equipment needs weight at this time
It is RAW composograph to be stored in pre-set image buffer queue, or RAW composograph is turned that new root is determined according to operating parameter
It is restored again into pre-set image buffer queue after being changed to YUV composograph.For example, electronic equipment may determine out it is by RAW at this time
Composograph, which is converted to, to be restored again into after YUV composograph in pre-set image buffer queue, etc..
In 106, when receiving photographing instruction, the multiframe history of target scene is obtained from pre-set image buffer queue
Cache image, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image.
For example, after by RAW composograph or YUV composograph deposit pre-set image buffer queue, when receiving
When the photographing instruction taken pictures to target scene, electronic equipment can be obtained from the pre-set image buffer queue about the mesh
The multiframe history buffer image of scene is marked, and multiframe noise reduction process is carried out to this multiframe history buffer image, obtains noise-reduced image.
In 107, according to noise-reduced image, photographing instruction is responded.
For example, electronic equipment can respond photographing instruction according to the noise-reduced image after obtaining noise-reduced image.For example, electric
The noise-reduced image can be shown as the image taken pictures under target scene and be supplied on the interface of camera applications by sub- equipment
User checks.
For example, user opens respective application, and camera is directed at scenario A, then electronic equipment can be to enable image sensing
Device simultaneously makes its work in the first operation mode.At this point, electronic equipment can start rapidly to get RAW image packet.Electronics
After equipment gets first RAW image packet, unpacking processing can be carried out to the RAW image packet, obtain at least two frame RAW figure
Picture, and at least two frame RAW images carry out synthesis processing to this, to obtain the RAW composograph with high dynamic range.It
Afterwards, its available operational parameter value of electronic equipment, the operational parameter value can be used to indicate that the electronic equipment currently calculates energy
The power of power.Also, electronic equipment can determine under scenario A it is that the deposit of RAW composograph is pre- according to the operational parameter value
If image buffer storage queue, or pre-set image buffer queue is restored again into after RAW composograph is converted to YUV composograph.Example
Such as, electronic equipment determines that RAW composograph is stored in pre-set image buffer queue under scenario A, then obtains under scenario A
To the RAW composograph of RAW image packet can all be stored in pre-set image buffer queue.For example, under scenario A, electronic equipment
10 RAW image packets are got, then the RAW composograph about this 10 RAW image packets is all stored into pre-set image caching team
In column.When receiving the instruction taken pictures to scenario A, electronic equipment can be obtained from pre-set image buffer queue about
The multiframe history RAW composograph of scenario A, and multiframe noise reduction process is carried out to this multiframe history RAW composograph, obtain noise reduction
Image, and according to the photographing instruction under noise-reduced image responding scene A.
Later, such as user moves camera, and camera is targeted by scenario B, then electronic equipment can also be quick
Ground gets the RAW image packet about scenario B.It, can be right after electronic equipment gets first RAW image packet under scenario B
The RAW image packet carries out unpacking processing, obtains at least two frame RAW images, and at least two frame RAW images carry out at synthesis to this
Reason, to obtain the RAW composograph with high dynamic range.Later, its available operational parameter value of electronic equipment.And
And electronic equipment can determine under scenario B it is by RAW composograph deposit pre-set image caching according to the operational parameter value
Queue, or pre-set image buffer queue is restored again into after RAW composograph is converted to YUV composograph.For example, electronic equipment
It determines to be restored again into pre-set image buffer queue after RAW composograph is converted to YUV composograph under scenario B, then exists
The YUV composograph got under scenario B can be all stored in pre-set image buffer queue.For example, under scenario B, electronic equipment
15 RAW image packets are got, then the YUV composograph about this 15 RAW image packets is all stored into pre-set image caching team
In column.When receiving the instruction taken pictures to scenario B, electronic equipment can be obtained from pre-set image buffer queue about
The multiframe history YUV composograph of scenario B, and history YUV composograph is poised for battle to this and carries out multiframe noise reduction process, obtain noise reduction
Image, and according to the photographing instruction under noise-reduced image responding scene B.
It is understood that electronic equipment can first carry out the RAW image with different exposure time in the present embodiment
Synthesis, obtains the RAW composograph with high dynamic range, and RAW composograph or RAW composograph are converted to
YUV composograph is stored in pre-set image buffer queue.When taking, electronic equipment can be from the pre-set image buffer queue
Obtaining multiframe, there is the image of high dynamic range to carry out multiframe noise reduction, obtain noise-reduced image, and respond and clap according to the noise-reduced image
According to instruction.Therefore, what the present embodiment obtained take pictures image with high dynamic range effect and noise it is smaller, i.e. the present embodiment can be with
Improve the imaging effect of image.
Referring to Fig. 3, Fig. 3 is another flow diagram of image processing method provided by the embodiments of the present application, process can
To include:
In 201, electronic equipment obtains RAW image packet, includes the first RAW image successively exposed in the RAW image packet
With the second RAW image, first RAW image and second RAW image are the images obtained under target scene, and this first
The time for exposure of RAW image is longer than the time for exposure of second RAW image.
In 202, electronic equipment carries out unpacking processing to RAW image packet, obtains the first RAW image and the second RAW image.
In 203, electronic equipment carries out synthesis processing to the first RAW image and the second RAW image, obtains with high dynamic
The RAW composograph of range.
For example, 201,202 and 203 may include:
After user's operation electronic equipment opens camera applications, electronic equipment enables imaging sensor, and its work is made to exist
First operating mode.If the camera of user's operation electronic equipment is directed at a certain scene, (such as electronic equipment is by a certain scene
It is determined as target scene), then electronic equipment will persistently get the mesh in the imaging sensor of the first operating mode by work
The RAW image packet under scene is marked, includes the first RAW image and the second RAW image successively exposed in the RAW image packet.Wherein,
The time for exposure of first RAW image is longer than second RAW image.
Later, electronic equipment can carry out unpacking processing to the RAW image packet got, to obtain the first RAW image
With the second RAW image, and synthesis processing is carried out to first RAW image and the second RAW image, to obtain with high dynamic range
The RAW composograph enclosed.
That is, whenever getting a RAW image packet, electronic equipment can unpack the RAW image packet
Processing, thus obtain including the first RAW image and the second RAW image.It should be noted that will be each in the present embodiment
The longer RAW image of the exposure for including in RAW image packet is denoted as the first RAW image, by including time for exposure it is shorter
RAW image is denoted as the second RAW image.
In 204, electronic equipment obtains operational parameter value, which is used to indicate the calculating energy of the electronic equipment
Power.
For example, after obtaining first under target scene A RAW composograph, its available operation ginseng of electronic equipment
Numerical value, wherein the operational parameter value can be intended to indicate that the numerical value of the parameter of the computing capability of electronic equipment.
In one embodiment, electronic equipment obtains operational parameter value in 204, and the operational parameter value is for indicating the electricity
The process of the computing capability of sub- equipment may include:
Electronic equipment obtains the ratio of remaining running memory capacity and running memory total capacity, and the ratio is for indicating the electricity
The computing capability of sub- equipment.
For example, when it needs to be determined that electronic equipment computing capability when, its available remaining running memory of electronic equipment holds
The ratio of amount and running memory total capacity, and using the ratio as the computing capability of electronic equipment.Wherein, the ratio is bigger can be with
Indicate that the computing capability of electronic equipment is stronger.
For example, it is 3GB that electronic equipment, which gets its remaining running memory capacity, and its running memory total capacity is 4GB, then
Remaining running memory capacity and the ratio of running memory total capacity are 75%.It is preset for example, electronic equipment can preset one
Threshold value 40%.When remaining running memory capacity and the ratio of running memory total capacity are greater than the preset threshold 40%, can recognize
It is strong for the current computing capability of electronic equipment.When remaining running memory capacity and the ratio of running memory total capacity are less than or equal to
When the preset threshold 40%, it is believed that the current computing capability of electronic equipment is weak.
In 205, if operational parameter value indicates that the computing capability of electronic equipment is higher than preset threshold, electronic equipment is determined
RAW composograph is stored in pre-set image buffer queue under target scene out;If the meter of operational parameter value expression electronic equipment
Calculation ability is not higher than preset threshold, then electronic equipment determines that RAW composograph is converted to YUV composite diagram under target scene
Pre-set image buffer queue is stored in as after.
For example, after getting the operational parameter value of electronic equipment, the electronic equipment can according to the operational parameter value,
It is that RAW composograph is stored in pre-set image buffer queue to determine under target scene, or by the RAW composograph
It is restored again into the pre-set image buffer queue after being converted to YUV composograph.
For example, in the present embodiment, if operational parameter value indicates that the computing capability of electronic equipment is higher than preset threshold, electronics
Equipment can determine that RAW composograph is stored in pre-set image buffer queue under target scene.If operational parameter value indicates
The computing capability of electronic equipment is not higher than preset threshold, then electronic equipment can be determined synthesize RAW under target scene
Image is stored in pre-set image buffer queue after being converted to YUV composograph.
In one embodiment, pre-set image buffer queue can be fixed length queue.For example, pre-set image buffer queue
30 frame images can be cached.That is, pre-set image buffer queue can cache the 30 frame images got recently.For example, according to depositing
Enter the chronological order of pre-set image buffer queue, the 1st frame image, the 2nd frame figure have been cached in pre-set image buffer queue
Picture ... ..., the 30th frame image.So, when caching the 31st frame image, pre-set image buffer queue can will be including most
The 1st frame piclear being early stored in, then the 31st frame image is stored in the pre-set image buffer queue.
In 206, when receiving photographing instruction, electronic equipment determines destination number according to operational parameter value, the target
Quantity is greater than or equal to 2.
In 207, electronic equipment obtains the history buffer image of destination number, the history from pre-set image buffer queue
Cache image is the image of target scene.
For example, 206 and 207 may include:
After by RAW composograph or YUV composograph deposit pre-set image buffer queue, when receiving to target
When the photographing instruction that scene is taken pictures, electronic equipment can determine a number of targets according to the operational parameter value obtained in 204
Amount.Wherein, the numerical value of the destination number can be greater than or equal to 2.
After determining destination number, electronic equipment can be obtained from the pre-set image buffer queue about the target field
The multiframe history buffer image of scape.
For example, electronic equipment determines that destination number is 4 according to operational parameter value, then the electronic equipment can be from default figure
As obtaining the 4 frame history buffer images about target scene in buffer queue.
In one embodiment, electronic equipment can preset at least two numerical value, and for example, 4 and 2.Wherein, when
When operational parameter value indicates that the computing capability of electronic equipment is higher than preset threshold, numerical value 4 can be determined as target by electronic equipment
Quantity.When operational parameter value indicates the computing capability of electronic equipment not higher than preset threshold, electronic equipment can be true by numerical value 2
It is set to destination number, etc..
For example, electronic equipment can preset three numerical value, for example, 4,3 and 2.Wherein, when remaining running memory holds
When the ratio of amount and running memory total capacity is in [75%, 100%], numerical value 4 can be determined as destination number by electronic equipment.
When the ratio of remaining running memory capacity and running memory total capacity is in [40%, 75%) when, electronic equipment can be by numerical value 3
It is determined as destination number.When remaining running memory capacity and the ratio of running memory total capacity are lower than 40%, electronic equipment can
Numerical value 2 is determined as destination number.
In 208, electronic equipment carries out multiframe noise reduction process to multiframe history buffer image, obtains noise-reduced image.
For example, electronic equipment can go through this multiframe after getting about the multiframe history buffer image of target scene
History cache image carries out multiframe noise reduction process, to obtain noise-reduced image.
Illustrate multiframe noise reduction by taking image P1, P2, P3, P4 as an example below.For example, to image P1, image P2, image P3 and
When image P4 carries out multiframe noise reduction process, electronic equipment can determine one from image P1, image P2, image P3 and image P4
Frame basis frame, such as it is basic frame that image P1, which is determined, then electronic equipment can be by image P1, image P2, image P3 and figure
As P4 carries out image alignment.Later, the average picture of each pixel can be calculated based on each image after alignment in electronic equipment
Element value, for example, pixel value of the pixel of certain position in four frame image P1, P2, P3, P4 is successively are as follows: 101,102,103,
102, then the average pixel value that the pixel of the position can be calculated is 102.So, electronic equipment can be by the picture of the position
The pixel value of vegetarian refreshments is determined as 102, and the pixel value of basic frame image P1 in the position is changed to 102 by 101.It similarly, will be basic
The pixel value of each position can obtain noise-reduced image after being changed to corresponding average pixel value in frame image P1.
In 209, electronic equipment carries out image optimization processing to noise-reduced image, the image that obtains that treated.
In 210, electronic equipment according to treated image response photographing instruction, should treated image as clapping
It is shown according to obtained image.
For example, 209 and 210 may include:
After obtaining noise-reduced image, electronic equipment can carry out the optimization processings such as image sharpening to the noise-reduced image,
The image that obtains that treated.Later, electronic equipment can be according to treated image response photographing instruction, should treated
Image is shown as the image taken pictures.
In one embodiment, after 203, i.e., electronic equipment obtains the RAW composograph with high dynamic range
Afterwards, the landscaping treatments such as yuv format conversion, image sharpening, image noise reduction can be carried out to the RAW composograph, thus
Image after to landscaping treatment.Image after the landscaping treatment can be used for preview or video recording.
For example, after obtaining RAW composograph, the resolution ratio of the available display screen of electronic equipment, and according to the resolution
Rate carries out down-sampled processing to the RAW composograph, and down-sampled treated image is using the conversion of such as yuv format, image
Preview is used for after the landscaping treatments such as sharpening, image noise reduction.
For another example, after obtaining RAW composograph, the video resolution of the available video recording of electronic equipment, and according to the record
The video resolution of picture carries out down-sampled processing to the RAW composograph, and down-sampled treated image is using such as YUV lattice
For being saved as the frame in corresponding video of recording a video after the landscaping treatments such as formula conversion, image sharpening, image noise reduction.
For example, the video resolution of video recording can be preset by user, including but not limited to 1080P, 2K and 4K etc..Than
Such as, the video resolution of video recording is set in advance as 2K by user, then electronic equipment obtains RAW composograph in synthesis and (for example divides
Resolution is 4K) after, down-sampled processing can be carried out to the RAW composograph, obtain the high dynamic range images of 2K resolution ratio.
Fig. 4 to fig. 6 is please referred to, fig. 4 to fig. 6 is the schematic diagram of a scenario of image processing method provided by the embodiments of the present application.
For example, user opens camera applications, electronic equipment enters the preview interface of camera at this time.Electronic equipment can be to enable
Imaging sensor, and make imaging sensor work in the first operating mode.Under first operating mode, imaging sensor will
It is sequentially generated two exposed frame times different RAW image within the time of a frame image, and is exported in the form of RAW image packet.
For example, including a personage in scenario A, then electronic equipment can as shown in figure 4, camera is directed at scenario A by user
To start rapidly to get the RAW image packet about the scenario A.It, can be with after electronic equipment gets first RAW image packet
Unpacking processing is carried out to the RAW image packet, obtains two frame RAW images, and synthesis processing is carried out to this two frames RAW image, thus
Obtain the RAW composograph with high dynamic range.
Later, its available operational parameter value of electronic equipment, the operational parameter value can be used to indicate that the electronic equipment
The power of current computing capability.Also, electronic equipment can determine under scenario A it is to synthesize RAW according to the operational parameter value
Image is stored in pre-set image buffer queue, or RAW composograph is converted to and is restored again into pre-set image after YUV composograph and delays
Deposit queue.For example, electronic equipment it is current computing capability it is stronger, then can determine to be stored in RAW composograph under scenario A
In pre-set image buffer queue, then the RAW composograph of the RAW image packet got under scenario A can all be stored in pre-set image
In buffer queue.For example, electronic equipment gets 10 RAW image packets under scenario A, then about this 10 RAW image packets
RAW composograph is all stored into pre-set image buffer queue.
When being in the preview interface of camera applications, whenever electronic equipment obtains a frame RAW composograph, electronic equipment can
To be shown in preview interface after carrying out the processing such as yuv format conversion, image sharpening and noise reduction to the RAW composograph
On for user's preview.
After preview, such as user presses button of taking pictures, as shown in figure 4, then electronic equipment can receive to scenario A
The instruction taken pictures.At this point, electronic equipment can obtain the 4 frame history RAW about scenario A from pre-set image buffer queue
Composograph, and multiframe noise reduction process is carried out to this 4 frame history RAW composograph, obtain noise-reduced image.For example, such as Fig. 5 institute
Show, 4 frames that electronic equipment is obtained from pre-set image buffer queue about the RAW composograph of scenario A be respectively P1, P2, P3,
P4.It is basic frame that electronic equipment, which can determine image P1, and image P2, P3, P4 is recycled to carry out multiframe noise reduction to P1.Electronics is set
It is standby image P1, image P2, image P3 and image P4 to be subjected to image alignment.Later, after electronic equipment can be based on alignment
Each image, the average pixel value of each pixel is calculated, for example, the pixel of the position L is in four frame image P1, P2, P3, P4
In pixel value successively are as follows: 101,102,103,102, then can be calculated the pixel of the position average pixel value be 102.
So, the pixel value of the pixel of the position can be determined as 102 by electronic equipment, by basic frame image P1 in the position L
Pixel value is changed to 102 by 101.Similarly, after the pixel value of each position in basic frame image P1 being changed to corresponding average pixel value
It can obtain noise-reduced image.
After obtaining noise-reduced image, electronic equipment can carry out the processing such as image sharpening to the noise-reduced image, be beautified
Treated noise-reduced image.Later, the noise-reduced image after the landscaping treatment can be sent to jpeg coder by electronic equipment, warp
It exports after jpeg coder processing and is shown to camera applications interface, take pictures to obtain image so that user checks.
For another example, camera is targeted by scenario B again by user later, includes two personages in scenario B, as shown in fig. 6, then electric
Sub- equipment can start rapidly to get the RAW image packet about the scenario B.Electronic equipment gets first under scenario B
After a RAW image packet, unpacking processing can be carried out to the RAW image packet, obtain two frame RAW images, and to this two frames RAW image
Synthesis processing is carried out, to obtain the RAW composograph with high dynamic range.
Later, its available operational parameter value of electronic equipment, the operational parameter value can be used to indicate that the electronic equipment
The power of current computing capability.Also, electronic equipment can determine under scenario B it is to synthesize RAW according to the operational parameter value
Image is stored in pre-set image buffer queue, or RAW composograph is converted to and is restored again into pre-set image after YUV composograph and delays
Deposit queue.For example, electronic equipment it is current computing capability it is weaker, then can determine to convert RAW composograph under scenario B
To be restored again into pre-set image buffer queue after YUV composograph, then what is got under scenario B is obtained by RAW image packet
RAW composograph can be all stored in pre-set image buffer queue after the YUV composograph for being converted to yuv format.For example, on the scene
Under scape B, electronic equipment gets 15 RAW image packets, then the YUV composograph about this 15 RAW image packets is all stored into
In pre-set image buffer queue.
Likewise, when being in the preview interface of camera applications, whenever electronic equipment obtains RAW of the frame about scenario B
Composograph, electronic equipment can carry out yuv format conversion, image sharpening and noise reduction etc. to the RAW composograph
After processing, it is shown in preview interface for user's preview.
After preview, such as user presses button of taking pictures, as shown in fig. 6, then electronic equipment can receive to scenario B
The instruction taken pictures.At this point, electronic equipment can obtain the 2 frame history YUV about scenario B from pre-set image buffer queue
Composograph, and multiframe noise reduction process is carried out to this 2 frame history YUV composograph, obtain noise-reduced image.For example, electronic equipment
2 frames obtained from pre-set image buffer queue are respectively P5 and P6 about the YUV composograph of scenario B.Electronic equipment can be with
Multiframe noise reduction is carried out to image P5 and P6, obtains noise-reduced image.
After obtaining noise-reduced image, electronic equipment can carry out the processing such as image sharpening to the noise-reduced image, be beautified
Treated noise-reduced image.Later, the noise-reduced image after the landscaping treatment can be sent to jpeg coder by electronic equipment, warp
It exports after jpeg coder processing and is shown to camera applications interface, take pictures to obtain image so that user checks.
Referring to Fig. 7, Fig. 7 is the structural schematic diagram of image processing apparatus provided by the embodiments of the present application.Image procossing dress
Setting 300 may include: the first acquisition module 301, unpack module 302, and synthesis module 303, second obtains module 304, caches mould
Block 305, processing module 306, respond module 307.
First obtains module 301, includes at least two frame RAW images in the RAW image packet for obtaining RAW image packet,
At least two frame RAW images are the images obtained under target scene and have the different time for exposure.
Module 302 is unpacked, for carrying out unpacking processing to the RAW image packet, obtains at least two frame RAW images.
Synthesis module 303 is obtained for carrying out synthesis processing at least two frame RAW images with high dynamic range
RAW composograph.
Second obtains module 304, and for obtaining the operational parameter value of electronic equipment, the operational parameter value is for indicating institute
State the computing capability of electronic equipment.
Cache module 305, for according to the operational parameter value, determination to synthesize the RAW under the target scene
Image is stored in pre-set image buffer queue, or is stored in pre-set image after the RAW composograph is converted to YUV composograph
Buffer queue.
Processing module 306, for obtaining target field from the pre-set image buffer queue when receiving photographing instruction
The multiframe history buffer image of scape, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image.
Respond module 307, for responding the photographing instruction according to the noise-reduced image.
In one embodiment, cache module 305 can be used for:
If operational parameter value indicates that the computing capability of the electronic equipment is higher than preset threshold, it is determined that go out in the target
The RAW composograph is stored in pre-set image buffer queue under scene;
If operational parameter value indicates the computing capability of the electronic equipment not higher than preset threshold, it is determined that go out in the mesh
The pre-set image buffer queue is stored in after the RAW composograph being converted to YUV composograph under mark scene.
In one embodiment, the second acquisition module 304 can be used for:
The ratio of remaining the running memory capacity and running memory total capacity of electronic equipment is obtained, the ratio is for indicating
The computing capability of the electronic equipment.
In one embodiment, the respond module 307 can be used for:
Image optimization processing is carried out to the noise-reduced image, the image that obtains that treated;
According to photographing instruction described in treated the image response, using treated the image as taking pictures to obtain
Image be shown.
In one embodiment, the first acquisition module 301 can be used for: obtain RAW image packet, the RAW figure
As including the first RAW image and the second RAW image successively exposed, first RAW image and second RAW image in packet
It is the image obtained under target scene, and the time for exposure of first RAW image is longer than the exposure of second RAW image
Time.
So, the unpacking module 302 can be used for: carrying out unpacking processing to the RAW image packet, obtains described first
RAW image and second RAW image.
The synthesis module 303 can be used for: carry out at synthesis to first RAW image and second RAW image
Reason, obtains the RAW composograph with high dynamic range.
In one embodiment, the processing module 306 can be used for:
When receiving photographing instruction, destination number is determined according to the operational parameter value, the destination number be greater than or
Equal to 2;
The history buffer image of the destination number, the history buffer figure are obtained from the pre-set image buffer queue
Image as being the target scene.
In one embodiment, the pre-set image buffer queue is fixed length queue.
The embodiment of the present application provides a kind of computer-readable storage medium, computer program is stored thereon with, when described
When computer program executes on computers, so that the computer is executed as in image processing method provided in this embodiment
Process.
The embodiment of the present application also provides a kind of electronic equipment, including memory, and processor, the processor is by calling institute
The computer program stored in memory is stated, for executing the process in image processing method provided in this embodiment.
For example, above-mentioned electronic equipment can be the mobile terminals such as tablet computer or smart phone.Referring to Fig. 8,
Fig. 8 is the structural schematic diagram of electronic equipment provided by the embodiments of the present application.
The electronic equipment 400 may include the components such as camera module 401, memory 402, processor 403.Art technology
Personnel are appreciated that electronic devices structure shown in Fig. 8 does not constitute the restriction to electronic equipment, may include than illustrating more
More or less component perhaps combines certain components or different component layouts.
Camera module 401 may include lens and imaging sensor, and wherein lens are used to acquire external light signal and mention
Imaging sensor is supplied, image sensor senses are converted into digitized original image from the light signal of lens
Data, i.e. RAW image data.RAW is unprocessed, also uncompressed format, it can be visually known as to " digital bottom
Piece ".The imaging sensor of the camera module of electronic equipment can have the first operating mode and the second operating mode.
Memory 402 can be used for storing application program and data.It include that can hold in the application program that memory 402 stores
Line code.Application program can form various functional modules.Processor 403 is stored in the application journey of memory 402 by operation
Sequence, thereby executing various function application and data processing.
Processor 403 is the control centre of electronic equipment, utilizes each of various interfaces and the entire electronic equipment of connection
A part by running or execute the application program being stored in memory 402, and is called and is stored in memory 402
Data execute the various functions and processing data of electronic equipment, to carry out integral monitoring to electronic equipment.
In the present embodiment, the processor 403 in electronic equipment can be according to following instruction, will be one or more
The corresponding executable code of the process of application program is loaded into memory 402, and is run by processor 403 and be stored in storage
Application program in device 402, thereby executing:
RAW image packet is obtained, includes at least two frame RAW images, at least two frame RAW images in the RAW image packet
It is the image obtained under target scene and there is the different time for exposure;
Unpacking processing is carried out to the RAW image packet, obtains at least two frame RAW images;
Synthesis processing is carried out at least two frame RAW images, obtains the RAW composograph with high dynamic range;
The operational parameter value of electronic equipment is obtained, the operational parameter value is used to indicate the calculating energy of the electronic equipment
Power;
According to the operational parameter value, determines and the RAW composograph is stored in pre-set image under the target scene
Buffer queue, or pre-set image buffer queue is stored in after the RAW composograph is converted to YUV composograph;
When receiving photographing instruction, the multiframe history buffer of target scene is obtained from the pre-set image buffer queue
Image, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image;
According to the noise-reduced image, the photographing instruction is responded.
Referring to Fig. 9, electronic equipment 500 may include camera module 501, memory 502, processor 503, touch display
The components such as screen 504, loudspeaker 505, microphone 506.
Camera module 501 may include image processing circuit, and image processing circuit can use hardware and or software component
It realizes, it may include define the various processing units of image signal process (Image Signal Processing) pipeline.At image
Reason circuit at least may include: camera, image-signal processor (Image Signal Processor, ISP processor), control
Logic device, video memory and display processed etc..Wherein camera at least may include that one or more lens and image pass
Sensor.Imaging sensor may include colour filter array (such as Bayer filter).Imaging sensor can be obtained with imaging sensor
The luminous intensity and wavelength information that each imaging pixel captures, and the one group of original image that can be handled by image-signal processor is provided
Data.
Image-signal processor can handle raw image data pixel by pixel in various formats.For example, each image
Pixel can have the bit depth of 8,10,12 or 14 bits, and image-signal processor can carry out one or more to raw image data
The statistical information of a image processing operations, collection about image data.Wherein, image processing operations can be by identical or different position
Depth accuracy carries out.Raw image data can be stored into video memory after image-signal processor is handled.Image letter
Number processor can also receive image data from video memory.
Video memory dedicated can be deposited for independent in a part, storage equipment or electronic equipment of memory device
Reservoir, and may include DMA (Direct Memory Access, direct direct memory access (DMA)) feature.
When receiving the image data from video memory, image-signal processor can carry out one or more images
Processing operation, such as time-domain filtering.Image data that treated can be transmitted to video memory, another to carry out before shown
Outer processing.Image-signal processor can also receive processing data from video memory, and carry out to the processing data original
Image real time transfer in domain and in RGB and YCbCr color space.Treated, and image data may be output to display, with
It watches for user and/or is further located by graphics engine or GPU (Graphics Processing Unit, graphics processor)
Reason.In addition, the output of image-signal processor also can be transmitted to video memory, and display can read from video memory and scheme
As data.In one embodiment, video memory can be configured to realize one or more frame buffers.
The statistical data that image-signal processor determines can be transmitted to control logic device.For example, statistical data may include certainly
The statistics of the imaging sensors such as dynamic exposure, automatic white balance, automatic focusing, flicker detection, black level compensation, correcting lens shadow
Information.
Control logic device may include the processor and/or microcontroller for executing one or more routines (such as firmware).One
Or multiple routines can statistical data based on the received, determine the control parameter and ISP control parameter of camera.For example, camera shooting
The control parameter of head may include camera flash control parameter, the control parameter of lens (such as focus or zoom focal length) or
The combination of these parameters.ISP control parameter may include for automatic white balance and color adjustment (for example, during RGB processing)
Gain level and color correction matrix etc..
Referring to Fig. 10, Figure 10 is the structural schematic diagram of image processing circuit in the present embodiment.As shown in Figure 10, for convenient for
Illustrate, the various aspects of image processing techniques relevant to the embodiment of the present invention are only shown.
Such as image processing circuit may include: camera, image-signal processor, control logic device, video memory,
Display.Wherein, camera may include one or more lens and imaging sensor.In some embodiments, camera can
For any one of focal length camera or wide-angle camera.
First image transmitting of camera acquisition is handled to image-signal processor.Image-signal processor processing the
After one image, the statistical data (brightness of such as image, the contrast value of image, the color of image) of the first image can be sent to
Control logic device.Control logic device can determine the control parameter of camera according to statistical data, so that camera can be according to control
Parameter carries out the operation such as auto-focusing, automatic exposure.First image can be stored after image-signal processor is handled to
In video memory.Image-signal processor can also read the image stored in video memory to be handled.In addition, the
One image can be sent directly to display after image-signal processor is handled and be shown.Display can also be read
Image in video memory is to be shown.
In addition, not having displaying in figure, electronic equipment can also include CPU and power supply module.CPU and logic controller,
Image-signal processor, video memory and display are all connected with, and CPU is for realizing overall situation control.Power supply module is for being each
A module for power supply.
It include executable code in the application program that memory 502 stores.Application program can form various function moulds
Block.Processor 503 is stored in the application program of memory 502 by operation, at various function application and data
Reason.
Processor 503 is the control centre of electronic equipment, utilizes each of various interfaces and the entire electronic equipment of connection
A part by running or execute the application program being stored in memory 502, and is called and is stored in memory 502
Data execute the various functions and processing data of electronic equipment, to carry out integral monitoring to electronic equipment.
Touch display screen 504 can be used for receiving user and operate to the touch control of electronic equipment.Loudspeaker 505 can be broadcast
Sound reproduction sound signal.Microphone 506 can be used for picking up voice signal.
In the present embodiment, the processor 503 in electronic equipment can be according to following instruction, will be one or more
The corresponding executable code of the process of application program is loaded into memory 502, and is run by processor 503 and be stored in storage
Application program in device 502, thereby executing:
RAW image packet is obtained, includes at least two frame RAW images, at least two frame RAW images in the RAW image packet
It is the image obtained under target scene and there is the different time for exposure;
Unpacking processing is carried out to the RAW image packet, obtains at least two frame RAW images;
Synthesis processing is carried out at least two frame RAW images, obtains the RAW composograph with high dynamic range;
The operational parameter value of electronic equipment is obtained, the operational parameter value is used to indicate the calculating energy of the electronic equipment
Power;
According to the operational parameter value, determines and the RAW composograph is stored in pre-set image under the target scene
Buffer queue, or pre-set image buffer queue is stored in after the RAW composograph is converted to YUV composograph;
When receiving photographing instruction, the multiframe history buffer of target scene is obtained from the pre-set image buffer queue
Image, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image;
According to the noise-reduced image, the photographing instruction is responded.
In one embodiment, processor 503 is executed according to the operational parameter value, is determined under the target scene
The RAW composograph is stored in pre-set image buffer queue, or the RAW composograph is converted into YUV composograph
When being stored in pre-set image buffer queue afterwards, it can execute: if operational parameter value indicates that the computing capability of the electronic equipment is higher than
Preset threshold, it is determined that go out and the RAW composograph is stored in pre-set image buffer queue under the target scene;If operation
Parameter value indicates the computing capability of the electronic equipment not higher than preset threshold, it is determined that going out will be by institute under the target scene
It states after RAW composograph is converted to YUV composograph and is stored in the pre-set image buffer queue.
In one embodiment, processor 503 executes the operational parameter value for obtaining electronic equipment, the operation ginseng
When numerical value is used to indicate the computing capability of the electronic equipment, it can execute: obtain the remaining running memory capacity of electronic equipment
With the ratio of running memory total capacity, the ratio is used to indicate the computing capability of the electronic equipment.
In one embodiment, processor 503 is executed according to the noise-reduced image, can when responding the photographing instruction
To execute: carrying out image optimization processing to the noise-reduced image, the image that obtains that treated;It is rung according to treated the image
The photographing instruction is answered, is shown using treated the image as the image taken pictures.
In one embodiment, processor 503 executes the acquisition RAW image packet, includes extremely in the RAW image packet
Few two frame RAW images, at least two frame RAW images are the images obtained under target scene and have the different time for exposure
When, it can execute: obtain RAW image packet, include the first RAW image successively exposed and the 2nd RAW figure in the RAW image packet
Picture, first RAW image and second RAW image are the images obtained under target scene, and first RAW image
Time for exposure be longer than time for exposure of second RAW image.
So, the execution of processor 503 carries out unpacking processing to the RAW image packet, obtains at least two frame RAW images
When, it can execute: unpacking processing being carried out to the RAW image packet, obtains first RAW image and second RAW image.
The execution of processor 503 carries out synthesis processing at least two frame RAW images, obtains having high dynamic range
It when RAW composograph, can execute: synthesis processing being carried out to first RAW image and second RAW image, is had
There is the RAW composograph of high dynamic range.
In one embodiment, processor 503 executes described when receiving photographing instruction, slow from the pre-set image
When depositing the image for obtaining the multiframe history buffer of target scene in queue, it can execute: when receiving photographing instruction, according to institute
It states operational parameter value and determines that destination number, the destination number are greater than or equal to 2;It is obtained from the pre-set image buffer queue
The history buffer image of the destination number, the history buffer image are the image of the target scene.
In one embodiment, the pre-set image buffer queue is fixed length queue.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, it may refer to the detailed description above with respect to image processing method, details are not described herein again.
Image processing method in described image processing unit provided by the embodiments of the present application and foregoing embodiments belongs to together
One design can run either offer method in described image processing method embodiment in described image processing unit,
Specific implementation process is detailed in described image processing method embodiment, and details are not described herein again.
It should be noted that those of ordinary skill in the art can for the embodiment of the present application described image processing method
With understand realize the embodiment of the present application described image processing method all or part of the process, be can by computer program come
Relevant hardware is controlled to complete, the computer program can be stored in a computer-readable storage medium, such as be stored in
It in memory, and is executed by least one processor, in the process of implementation may include the embodiment such as described image processing method
Process.Wherein, the storage medium can be magnetic disk, CD, read-only memory (ROM, Read Only Memory), random
Access/memory body (RAM, Random Access Memory) etc..
For the described image processing unit of the embodiment of the present application, each functional module be can integrate in a processing core
In piece, it is also possible to modules and physically exists alone, can also be integrated in two or more modules in a module.On
It states integrated module both and can take the form of hardware realization, can also be realized in the form of software function module.The collection
If at module realized in the form of software function module and when sold or used as an independent product, also can store
In one computer-readable storage medium, the storage medium is for example read-only memory, disk or CD etc..
Above to a kind of image processing method, device, storage medium and electronic equipment provided by the embodiment of the present application
It is described in detail, specific examples are used herein to illustrate the principle and implementation manner of the present application, the above reality
The explanation for applying example is merely used to help understand the present processes and its core concept;Meanwhile for those skilled in the art,
According to the thought of the application, there will be changes in the specific implementation manner and application range, in conclusion in this specification
Hold the limitation that should not be construed as to the application.
Claims (10)
1. a kind of image processing method characterized by comprising
Obtain RAW image packet, include at least two frame RAW images in the RAW image packet, at least two frame RAW images be
The image that obtains under target scene and there is the different time for exposure;
Unpacking processing is carried out to the RAW image packet, obtains at least two frame RAW images;
Synthesis processing is carried out at least two frame RAW images, obtains the RAW composograph with high dynamic range;
The operational parameter value of electronic equipment is obtained, the operational parameter value is used to indicate the computing capability of the electronic equipment;
According to the operational parameter value, determine RAW composograph deposit pre-set image caching under the target scene
Queue, or the pre-set image buffer queue is stored in after the RAW composograph is converted to YUV composograph;
When receiving photographing instruction, the multiframe history buffer figure of target scene is obtained from the pre-set image buffer queue
Picture, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image;
According to the noise-reduced image, the photographing instruction is responded.
2. image processing method according to claim 1, which is characterized in that according to the operational parameter value, determine in institute
It states and the RAW composograph is stored in pre-set image buffer queue under target scene, or the RAW composograph is converted to
The pre-set image buffer queue is stored in after YUV composograph, comprising:
If operational parameter value indicates that the computing capability of the electronic equipment is higher than preset threshold, it is determined that go out in the target scene
It is lower that the RAW composograph is stored in pre-set image buffer queue;
If operational parameter value indicates the computing capability of the electronic equipment not higher than preset threshold, it is determined that go out in the target field
The pre-set image buffer queue is stored in after the RAW composograph is converted to YUV composograph under scape.
3. image processing method according to claim 2, which is characterized in that the operating parameter for obtaining electronic equipment
Value, the operational parameter value are used to indicate the computing capability of the electronic equipment, comprising:
The ratio of remaining the running memory capacity and running memory total capacity of electronic equipment is obtained, the ratio is for indicating described
The computing capability of electronic equipment.
4. image processing method according to claim 1, which is characterized in that according to the noise-reduced image, respond the bat
According to instruction, comprising:
Image optimization processing is carried out to the noise-reduced image, the image that obtains that treated;
According to photographing instruction described in treated the image response, using treated the image as the figure taken pictures
As being shown.
5. image processing method according to claim 1, which is characterized in that the acquisition RAW image packet, the RAW figure
As, including at least two frame RAW images, at least two frame RAW images are the images obtained under target scene and have not in packet
With time for exposure, comprising: obtain RAW image packet, include the first RAW image successively exposed and the in the RAW image packet
Two RAW images, first RAW image and second RAW image are the images obtained under target scene, and described first
The time for exposure of RAW image is longer than the time for exposure of second RAW image;
Unpacking processing is carried out to the RAW image packet, obtains at least two frame RAW images, comprising: to the RAW image packet
Unpacking processing is carried out, first RAW image and second RAW image are obtained;
Synthesis processing is carried out at least two frame RAW images, obtains the RAW composograph with high dynamic range, comprising: right
First RAW image and second RAW image carry out synthesis processing, obtain the RAW composograph with high dynamic range.
6. image processing method according to claim 1, which is characterized in that it is described when receiving photographing instruction, from institute
State the multiframe history buffer image that target scene is obtained in pre-set image buffer queue, comprising:
When receiving photographing instruction, determine that destination number, the destination number are greater than or equal to according to the operational parameter value
2;
The history buffer image of the destination number is obtained from the pre-set image buffer queue, the history buffer image is
The image of the target scene.
7. image processing method according to claim 1, which is characterized in that the pre-set image buffer queue is fixed length team
Column.
8. a kind of image processing apparatus characterized by comprising
First obtains module, includes at least two frame RAW images in the RAW image packet for obtaining RAW image packet, it is described extremely
Few two frame RAW images are the images obtained under target scene and have the different time for exposure;
Module is unpacked, for carrying out unpacking processing to the RAW image packet, obtains at least two frame RAW images;
Synthesis module obtains having the RAW of high dynamic range to close for carrying out synthesis processing at least two frame RAW images
At image;
Second obtains module, and for obtaining the operational parameter value of electronic equipment, the operational parameter value is for indicating the electronics
The computing capability of equipment;
Cache module, for determining and being stored in the RAW composograph under the target scene according to the operational parameter value
Pre-set image buffer queue, or pre-set image caching team is stored in after the RAW composograph is converted to YUV composograph
Column;
Processing module, for obtaining the more of target scene from the pre-set image buffer queue when receiving photographing instruction
Frame history buffer image, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image;
Respond module, for responding the photographing instruction according to the noise-reduced image.
9. a kind of storage medium, is stored thereon with computer program, which is characterized in that when the computer program on computers
When execution, so that the computer executes the method as described in any one of claims 1 to 7.
10. a kind of electronic equipment, including memory, processor, which is characterized in that the processor is by calling the memory
The computer program of middle storage, for executing the method as described in any one of claims 1 to 7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910280476.8A CN109993722B (en) | 2019-04-09 | 2019-04-09 | Image processing method, image processing device, storage medium and electronic equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910280476.8A CN109993722B (en) | 2019-04-09 | 2019-04-09 | Image processing method, image processing device, storage medium and electronic equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109993722A true CN109993722A (en) | 2019-07-09 |
CN109993722B CN109993722B (en) | 2023-04-18 |
Family
ID=67132528
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910280476.8A Active CN109993722B (en) | 2019-04-09 | 2019-04-09 | Image processing method, image processing device, storage medium and electronic equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109993722B (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110969587A (en) * | 2019-11-29 | 2020-04-07 | 联想(北京)有限公司 | Image acquisition method and device and electronic equipment |
CN111385475A (en) * | 2020-03-11 | 2020-07-07 | Oppo广东移动通信有限公司 | Image acquisition method, photographing device, electronic equipment and readable storage medium |
CN111988526A (en) * | 2020-08-27 | 2020-11-24 | Oppo(重庆)智能科技有限公司 | Mobile terminal and image data processing method |
CN112003996A (en) * | 2020-08-12 | 2020-11-27 | Oppo广东移动通信有限公司 | Video generation method, terminal and computer storage medium |
CN113038004A (en) * | 2021-02-26 | 2021-06-25 | 展讯通信(天津)有限公司 | Multi-window image previewing method and device, computer equipment and storage medium |
WO2022179256A1 (en) * | 2021-02-26 | 2022-09-01 | Oppo广东移动通信有限公司 | Image processing method, image processing apparatus, electronic device, and readable storage medium |
CN116029914A (en) * | 2022-07-27 | 2023-04-28 | 荣耀终端有限公司 | Image processing method and electronic equipment |
CN116389898A (en) * | 2023-02-27 | 2023-07-04 | 荣耀终端有限公司 | Image processing method, device and storage medium |
Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102833471A (en) * | 2011-06-15 | 2012-12-19 | 奥林巴斯映像株式会社 | Imaging device and imaging method |
JP2015082675A (en) * | 2013-10-21 | 2015-04-27 | 三星テクウィン株式会社Samsung Techwin Co., Ltd | Image processing device and image processing method |
CN105376473A (en) * | 2014-08-25 | 2016-03-02 | 中兴通讯股份有限公司 | Photographing method, device and equipment |
JP2017112462A (en) * | 2015-12-15 | 2017-06-22 | キヤノン株式会社 | Imaging device and control method, program therefor and storage medium |
CN107222669A (en) * | 2017-06-30 | 2017-09-29 | 维沃移动通信有限公司 | The method and mobile terminal of a kind of shooting |
WO2017215501A1 (en) * | 2016-06-15 | 2017-12-21 | 深圳市万普拉斯科技有限公司 | Method and device for image noise reduction processing and computer storage medium |
US20180097984A1 (en) * | 2016-10-03 | 2018-04-05 | Denso Corporation | Imaging device provided with high dynamic range rendering function |
CN108198189A (en) * | 2017-12-28 | 2018-06-22 | 广东欧珀移动通信有限公司 | Acquisition methods, device, storage medium and the electronic equipment of picture clarity |
CN108353130A (en) * | 2015-11-24 | 2018-07-31 | 索尼公司 | Image processor, image processing method and program |
CN108401110A (en) * | 2018-03-18 | 2018-08-14 | 广东欧珀移动通信有限公司 | Acquisition methods, device, storage medium and the electronic equipment of image |
CN108419023A (en) * | 2018-03-26 | 2018-08-17 | 华为技术有限公司 | A kind of method and relevant device generating high dynamic range images |
CN108520493A (en) * | 2018-03-30 | 2018-09-11 | 广东欧珀移动通信有限公司 | Processing method, device, storage medium and the electronic equipment that image is replaced |
CN109167930A (en) * | 2018-10-11 | 2019-01-08 | Oppo广东移动通信有限公司 | Image display method, device, electronic equipment and computer readable storage medium |
-
2019
- 2019-04-09 CN CN201910280476.8A patent/CN109993722B/en active Active
Patent Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102833471A (en) * | 2011-06-15 | 2012-12-19 | 奥林巴斯映像株式会社 | Imaging device and imaging method |
JP2015082675A (en) * | 2013-10-21 | 2015-04-27 | 三星テクウィン株式会社Samsung Techwin Co., Ltd | Image processing device and image processing method |
CN105376473A (en) * | 2014-08-25 | 2016-03-02 | 中兴通讯股份有限公司 | Photographing method, device and equipment |
CN108353130A (en) * | 2015-11-24 | 2018-07-31 | 索尼公司 | Image processor, image processing method and program |
JP2017112462A (en) * | 2015-12-15 | 2017-06-22 | キヤノン株式会社 | Imaging device and control method, program therefor and storage medium |
WO2017215501A1 (en) * | 2016-06-15 | 2017-12-21 | 深圳市万普拉斯科技有限公司 | Method and device for image noise reduction processing and computer storage medium |
US20180097984A1 (en) * | 2016-10-03 | 2018-04-05 | Denso Corporation | Imaging device provided with high dynamic range rendering function |
CN107222669A (en) * | 2017-06-30 | 2017-09-29 | 维沃移动通信有限公司 | The method and mobile terminal of a kind of shooting |
CN108198189A (en) * | 2017-12-28 | 2018-06-22 | 广东欧珀移动通信有限公司 | Acquisition methods, device, storage medium and the electronic equipment of picture clarity |
CN108401110A (en) * | 2018-03-18 | 2018-08-14 | 广东欧珀移动通信有限公司 | Acquisition methods, device, storage medium and the electronic equipment of image |
CN108419023A (en) * | 2018-03-26 | 2018-08-17 | 华为技术有限公司 | A kind of method and relevant device generating high dynamic range images |
CN108520493A (en) * | 2018-03-30 | 2018-09-11 | 广东欧珀移动通信有限公司 | Processing method, device, storage medium and the electronic equipment that image is replaced |
CN109167930A (en) * | 2018-10-11 | 2019-01-08 | Oppo广东移动通信有限公司 | Image display method, device, electronic equipment and computer readable storage medium |
Non-Patent Citations (1)
Title |
---|
刘宗等: "基于多曝光的高动态图像合成的噪声处理", 《电子科技》 * |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110969587A (en) * | 2019-11-29 | 2020-04-07 | 联想(北京)有限公司 | Image acquisition method and device and electronic equipment |
CN111385475A (en) * | 2020-03-11 | 2020-07-07 | Oppo广东移动通信有限公司 | Image acquisition method, photographing device, electronic equipment and readable storage medium |
CN112003996A (en) * | 2020-08-12 | 2020-11-27 | Oppo广东移动通信有限公司 | Video generation method, terminal and computer storage medium |
CN112003996B (en) * | 2020-08-12 | 2023-04-18 | Oppo广东移动通信有限公司 | Video generation method, terminal and computer storage medium |
CN111988526A (en) * | 2020-08-27 | 2020-11-24 | Oppo(重庆)智能科技有限公司 | Mobile terminal and image data processing method |
CN113038004A (en) * | 2021-02-26 | 2021-06-25 | 展讯通信(天津)有限公司 | Multi-window image previewing method and device, computer equipment and storage medium |
WO2022179256A1 (en) * | 2021-02-26 | 2022-09-01 | Oppo广东移动通信有限公司 | Image processing method, image processing apparatus, electronic device, and readable storage medium |
CN113038004B (en) * | 2021-02-26 | 2022-09-23 | 展讯通信(天津)有限公司 | Multi-window image previewing method and device, computer equipment and storage medium |
CN116029914A (en) * | 2022-07-27 | 2023-04-28 | 荣耀终端有限公司 | Image processing method and electronic equipment |
CN116029914B (en) * | 2022-07-27 | 2023-10-20 | 荣耀终端有限公司 | Image processing method and electronic equipment |
CN116389898A (en) * | 2023-02-27 | 2023-07-04 | 荣耀终端有限公司 | Image processing method, device and storage medium |
CN116389898B (en) * | 2023-02-27 | 2024-03-19 | 荣耀终端有限公司 | Image processing method, device and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN109993722B (en) | 2023-04-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109993722A (en) | Image processing method, device, storage medium and electronic equipment | |
CN110445988B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
CN110290289B (en) | Image noise reduction method and device, electronic equipment and storage medium | |
CN107959778B (en) | Imaging method and device based on dual camera | |
CN109040609B (en) | Exposure control method, exposure control device, electronic equipment and computer-readable storage medium | |
CN110072052B (en) | Image processing method and device based on multi-frame image and electronic equipment | |
CN110198417A (en) | Image processing method, device, storage medium and electronic equipment | |
CN110248106B (en) | Image noise reduction method and device, electronic equipment and storage medium | |
CN110166708B (en) | Night scene image processing method and device, electronic equipment and storage medium | |
CN110191291B (en) | Image processing method and device based on multi-frame images | |
CN109005342A (en) | Panorama shooting method, device and imaging device | |
CN110213502B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
WO2020207261A1 (en) | Image processing method and apparatus based on multiple frames of images, and electronic device | |
CN108322646A (en) | Image processing method, device, storage medium and electronic equipment | |
CN108833804A (en) | Imaging method, device and electronic equipment | |
CN110198418A (en) | Image processing method, device, storage medium and electronic equipment | |
CN110505411A (en) | Image capturing method, device, storage medium and electronic equipment | |
CN110166706B (en) | Image processing method, image processing apparatus, electronic device, and storage medium | |
CN110166709B (en) | Night scene image processing method and device, electronic equipment and storage medium | |
CN110012227B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
CN110198419A (en) | Image processing method, device, storage medium and electronic equipment | |
CN108024054A (en) | Image processing method, device and equipment | |
CN110445986A (en) | Image processing method, device, storage medium and electronic equipment | |
CN109167930A (en) | Image display method, device, electronic equipment and computer readable storage medium | |
CN110264420B (en) | Image processing method and device based on multi-frame images |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |