CN109993722A - Image processing method, device, storage medium and electronic equipment - Google Patents

Image processing method, device, storage medium and electronic equipment Download PDF

Info

Publication number
CN109993722A
CN109993722A CN201910280476.8A CN201910280476A CN109993722A CN 109993722 A CN109993722 A CN 109993722A CN 201910280476 A CN201910280476 A CN 201910280476A CN 109993722 A CN109993722 A CN 109993722A
Authority
CN
China
Prior art keywords
image
raw
electronic equipment
composograph
buffer queue
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910280476.8A
Other languages
Chinese (zh)
Other versions
CN109993722B (en
Inventor
黄杰文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201910280476.8A priority Critical patent/CN109993722B/en
Publication of CN109993722A publication Critical patent/CN109993722A/en
Application granted granted Critical
Publication of CN109993722B publication Critical patent/CN109993722B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • G06T5/92Dynamic range modification of images or parts thereof based on global image properties
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268Signal distribution or switching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20208High dynamic range [HDR] image processing
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

This application discloses a kind of image processing methods, comprising: obtains RAW image packet, includes at least two frame RAW images in RAW image packet, which is the image obtained under target scene and has the different time for exposure;Unpacking processing is carried out to RAW image packet, obtains at least two frame RAW images;Synthesis processing is carried out at least two frame RAW images, obtains the RAW composograph with high dynamic range;The operational parameter value of electronic equipment is obtained, operational parameter value is used to indicate the computing capability of electronic equipment;According to operational parameter value, determines and the RAW composograph is stored in pre-set image buffer queue under target scene, or be stored in pre-set image buffer queue after RAW composograph is converted to YUV composograph;When receiving photographing instruction, the multiframe history buffer image of target scene is obtained from pre-set image buffer queue, and multiframe noise reduction process is carried out to multiframe history buffer image, obtain noise-reduced image;According to noise-reduced image, the photographing instruction is responded.

Description

Image processing method, device, storage medium and electronic equipment
Technical field
The application belongs to image technique field more particularly to a kind of image processing method, device, storage medium and electronics are set It is standby.
Background technique
Due to the hardware limitation of electronic equipment itself, current electronic equipment can only shoot the smaller field of brightness range Scape shoots the image come and is easily lost the thin of daylight and/or dark place if being shot when scene light and shade difference is too big Section.That is, the imaging effect for the image that electronic equipment is handled is poor.
Summary of the invention
The embodiment of the present application provides a kind of image processing method, device, storage medium and electronic equipment, and image can be improved Imaging effect.
The embodiment of the present application provides a kind of image processing method, comprising:
RAW image packet is obtained, includes at least two frame RAW images, at least two frame RAW images in the RAW image packet It is the image obtained under target scene and there is the different time for exposure;
Unpacking processing is carried out to the RAW image packet, obtains at least two frame RAW images;
Synthesis processing is carried out at least two frame RAW images, obtains the RAW composograph with high dynamic range;
The operational parameter value of electronic equipment is obtained, the operational parameter value is used to indicate the calculating energy of the electronic equipment Power;
According to the operational parameter value, determines and the RAW composograph is stored in pre-set image under the target scene Buffer queue, or pre-set image buffer queue is stored in after the RAW composograph is converted to YUV composograph;
When receiving photographing instruction, the multiframe history buffer of target scene is obtained from the pre-set image buffer queue Image, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image;
According to the noise-reduced image, the photographing instruction is responded.
The embodiment of the present application provides a kind of image processing apparatus, comprising:
First obtains module, includes at least two frame RAW images, institute in the RAW image packet for obtaining RAW image packet Stating at least two frame RAW images is the image obtained under target scene and has the different time for exposure;
Module is unpacked, for carrying out unpacking processing to the RAW image packet, obtains at least two frame RAW images;
Synthesis module obtains having high dynamic range for carrying out synthesis processing at least two frame RAW images RAW composograph;
Second obtains module, and for obtaining the operational parameter value of electronic equipment, the operational parameter value is for indicating described The computing capability of electronic equipment;
Cache module, for determining the RAW composograph under the target scene according to the operational parameter value It is stored in pre-set image buffer queue, or is stored in pre-set image caching after the RAW composograph is converted to YUV composograph Queue;
Processing module, for obtaining target scene from the pre-set image buffer queue when receiving photographing instruction Multiframe history buffer image, and to the multiframe history buffer image carry out multiframe noise reduction process, obtain noise-reduced image;
Respond module, for responding the photographing instruction according to the noise-reduced image.
The embodiment of the present application provides a kind of storage medium, is stored thereon with computer program, when the computer program exists When being executed on computer, so that the computer executes image processing method provided by the embodiments of the present application.
The embodiment of the present application also provides a kind of electronic equipment, including memory, and processor, the processor is by calling institute The computer program stored in memory is stated, for executing image processing method provided by the embodiments of the present application.
In the present embodiment, electronic equipment can first be synthesized the RAW image with different exposure time, be had The RAW composograph of high dynamic range, and the YUV composograph that RAW composograph or RAW composograph are converted to is deposited Enter in pre-set image buffer queue.When taking, electronic equipment can obtain multiframe from the pre-set image buffer queue and have The image of high dynamic range carries out multiframe noise reduction, obtains noise-reduced image, and respond photographing instruction according to the noise-reduced image.Therefore, What the present embodiment obtained take pictures image with high dynamic range effect and noise it is smaller, i.e., the present embodiment can be improved image at As effect.
Detailed description of the invention
With reference to the accompanying drawing, it is described in detail by the specific embodiment to the application, the technical solution of the application will be made And its advantages are apparent.
Fig. 1 is the flow diagram of image processing method provided by the embodiments of the present application.
Fig. 2 is the schematic diagram of RAW image packet provided by the embodiments of the present application.
Fig. 3 is another flow diagram of image processing method provided by the embodiments of the present application.
Fig. 4 to fig. 6 is the schematic diagram of a scenario of image processing method provided by the embodiments of the present application.
Fig. 7 is the structural schematic diagram of image processing apparatus provided by the embodiments of the present application.
Fig. 8 is the structural schematic diagram of electronic equipment provided by the embodiments of the present application.
Fig. 9 is another structural schematic diagram of electronic equipment provided by the embodiments of the present application.
Figure 10 is the structural schematic diagram of image processing circuit provided by the embodiments of the present application.
Specific embodiment
Diagram is please referred to, wherein identical component symbol represents identical component, the principle of the application is to implement one It is illustrated in computing environment appropriate.The following description be based on illustrated by the application specific embodiment, should not be by It is considered as limitation the application other specific embodiments not detailed herein.
It is understood that the executing subject of the embodiment of the present application can be the electricity of smart phone or tablet computer etc. Sub- equipment.
Referring to Fig. 1, Fig. 1 is the flow diagram of image processing method provided by the embodiments of the present application, process be can wrap It includes:
In 101, RAW image packet is obtained, includes at least two frame RAW images, at least two frame RAW in the RAW image packet Image is the image obtained under target scene and has the different time for exposure.
Image processing method provided in this embodiment can be applied to the electronic equipment with camera module.Electronic equipment Camera module is made of lens and imaging sensor, and wherein lens are used to acquire external light signal and are supplied to image sensing Device, image sensor senses are converted into digitized raw image data, i.e. RAW figure from the light signal of lens As data.RAW is unprocessed, also uncompressed format, it can be visually known as to " digital negative ".Electronic equipment The imaging sensor of camera module can have the first operating mode and the second operating mode.
It should be noted that imaging sensor will generate at least two within the time of a frame under first operating mode Different RAW image of a time for exposure, and exported in the form of RAW image packet.For example, the frame per second of imaging sensor is 30fps, Then imaging sensor can generate two time for exposure different RAW image in a thirtieth second, and with the shape of RAW image packet Formula output.For example, referring to figure 2., working in the RAW image packet of the imaging sensor output of the first operating mode may include The data of two RAW images, and the time for exposure of one of RAW image is twice of another RAW image time for exposure.When The ratio of the time for exposure length of this right two frames RAW image is also possible to other numerical value, such as 3:1 or 4:1 or 3:2, The present embodiment is not specifically limited in this embodiment.For example, imaging sensor is when generating two exposures in a thirtieth second for first Between different RAW image, for example be the first RAW image L1 and the second RAW image S1.That is, imaging sensor carried out it is longer After exposure obtains L1 picture frame, L1 picture frame can't be exported at once, but L1 picture frame is stored in the caching of imaging sensor In device, and the charge accumulated on imaging sensor is emptied at once, then carry out obtaining S1 picture frame compared with short exposure.Reading out S1 figure As after frame, the data of L1 picture frame and S1 picture frame can be packaged and be processed into RAW image packet and export by electronic equipment.Image Sensor also generates two time for exposure different RAW image in a thirtieth second at second, for example is the first RAW image L2 and the second RAW image S2.Imaging sensor generates the first RAW image L3 and the 2nd RAW in third a thirtieth second Image S3.Imaging sensor generates the first RAW image L4 and the second RAW image S4, etc. in a thirtieth second at the 4th. It should be noted that time for exposure longer image in RAW image packet is uniformly denoted as the first RAW image in the present embodiment, it will Time for exposure shorter image is uniformly denoted as the second RAW image.In the present embodiment, the time for exposure of all first RAW images Can be identical, such as be T1.The time for exposure of all second RAW images can be identical, such as is T2.
It is understood that since shooting interval is very short, it can be considered that the RAW image in RAW image packet is The image shot under Same Scene.For example, including the number of the first RAW image and the second RAW image in RAW image packet According to it may be considered that the first RAW image and the second RAW image are to shoot to obtain under Same Scene (for example, target scene) Image.
Above-mentioned second operating mode is normal mode of operation.In this second mode of operation, imaging sensor is in a frame figure It will generate an individual RAW image in the time of picture, rather than RAW image packet.For example, image passes under normal mode of operation The frame per second of sensor is 60fps, then imaging sensor can generate a frame RAW image and be exported within each sixtieth second.
In the embodiment of the present application, electronic equipment can first pass through work and obtain in the imaging sensor of the first operating mode One RAW image packet.Wherein, it is converged on imaging sensor after the lens of camera from the optical signal of current scene, Imaging sensor will carry out the rapid alternation with different exposure time, and lasting output includes that the RAW of at least two frame RAW images schemes As packet.It is understood that at least two frame RAW images for including in the RAW image packet obtain and are had under same scene There is the different time for exposure.
For example, electronic equipment enables imaging sensor, and makes its work after user's operation electronic equipment opens camera applications Make in the first operating mode.If the camera of user's operation electronic equipment is directed at a certain scene, electronic equipment will pass through work The RAW image packet under the scene is persistently got in the imaging sensor of the first operating mode, is included at least in the RAW image packet Two frames have the RAW image of different exposure time.
In 102, unpacking processing is carried out to RAW image packet, obtains at least two frame RAW images.
In 103, to this, at least two frame RAW images carry out synthesis processing, obtain the RAW composite diagram with high dynamic range Picture.
For example, 102 and 103 may include:
After getting RAW image packet, electronic equipment can carry out unpacking processing to the RAW image packet, to obtain At least two frame RAW images.
After carrying out unpacking processing to RAW image packet, electronic equipment can to the obtained at least two frame RAW images of unpacking into Row HDR synthesis processing, to obtain the RAW composograph with high dynamic range.
In 104, the operational parameter value of electronic equipment is obtained, which is used to indicate the calculating of the electronic equipment Ability.
For example, obtain after there is the RAW composograph of high dynamic range, its available operational parameter value of electronic equipment, Wherein, which can be intended to indicate that the numerical value of the parameter of the computing capability (processing capacity) of electronic equipment.
In 105, according to operational parameter value, determine RAW composograph deposit pre-set image caching under target scene Queue, or the pre-set image buffer queue is stored in after the RAW composograph is converted to YUV composograph.
For example, electronic equipment can be according to the operational parameter value, to determine in target after getting operational parameter value It is RAW composograph to be stored in pre-set image buffer queue, or the RAW composograph is converted into YUV and is closed under scene At being restored again into after image in the pre-set image buffer queue.
For example, electronic equipment determines that RAW composograph is stored in default figure under target scene according to operational parameter value In picture buffer queue, then the RAW composograph can be stored in pre-set image buffer queue by the electronic equipment.
Alternatively, electronic equipment determines that RAW composograph is converted to YUV under target scene according to operational parameter value It is restored again into after composograph in pre-set image buffer queue.So, electronic equipment can first be converted to the RAW composograph Yuv format to obtain YUV composograph, then the YUV composograph is stored in pre-set image buffer queue.
It should be noted that the result that electronic equipment is determined (closes RAW under target scene in 105 process It is stored in pre-set image buffer queue at image, or is restored again into pre-set image after RAW composograph is converted to YUV composograph Buffer queue) it is effective (when i.e. scene does not change) under the target scene.
For example, camera is directed at scenario A, electronic equipment can rapidly, constantly at this time after user opens camera applications Ground obtains RAW image packet.If electronic equipment is it is determined that RAW composograph deposit pre-set image is delayed according to operational parameter value It deposits in queue, then all RAW image packets accessed during camera is directed at scenario A are all by RAW composite diagram As in deposit pre-set image buffer queue.For example, electronic equipment gets first during camera is directed at scenario A After RAW image packet, according to the operating parameter of electronic equipment it is determined that RAW composograph is stored in pre-set image buffer queue In, then the RAW image packet of the scenario A next got is all that RAW composograph is stored in pre-set image buffer queue. For example, electronic equipment gets 10 RAW image packets in scenario A, then being all to close RAW about this 10 RAW image packets At in image deposit pre-set image buffer queue.
Later, such as user moves camera, and camera is targeted by scenario B, then electronic equipment can root again According to operating parameter determination, to be under scenario B be that RAW composograph is stored in pre-set image buffer queue, or the RAW is synthesized Image is stored in the pre-set image buffer queue after being converted to YUV composograph.For example, electronic equipment is it is determined that RAW is synthesized Image is stored in the pre-set image buffer queue after being converted to YUV composograph.For example, during camera is directed at scenario B, After electronic equipment gets first RAW image packet, according to the operating parameter of electronic equipment it is determined that RAW composograph is turned It is stored in pre-set image buffer queue after being changed to YUV composograph, then the RAW image packet of the scenario B next got is all It is to be stored in pre-set image buffer queue after RAW composograph to be converted to YUV composograph.For example, electronic equipment is in scenario B In get 15 RAW image packets, then being all that RAW composograph is converted to YUV composite diagram about this 15 RAW image packets It is stored in pre-set image buffer queue as after.
That is, electronic equipment needs determine it is by RAW according to operating parameter again when changing scene Composograph is stored in pre-set image buffer queue, or RAW composograph is converted to be restored again into after YUV composograph it is default In image buffer storage queue.For example, camera is directed at scenario A again by user after scenario B, then electronic equipment needs weight at this time It is RAW composograph to be stored in pre-set image buffer queue, or RAW composograph is turned that new root is determined according to operating parameter It is restored again into pre-set image buffer queue after being changed to YUV composograph.For example, electronic equipment may determine out it is by RAW at this time Composograph, which is converted to, to be restored again into after YUV composograph in pre-set image buffer queue, etc..
In 106, when receiving photographing instruction, the multiframe history of target scene is obtained from pre-set image buffer queue Cache image, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image.
For example, after by RAW composograph or YUV composograph deposit pre-set image buffer queue, when receiving When the photographing instruction taken pictures to target scene, electronic equipment can be obtained from the pre-set image buffer queue about the mesh The multiframe history buffer image of scene is marked, and multiframe noise reduction process is carried out to this multiframe history buffer image, obtains noise-reduced image.
In 107, according to noise-reduced image, photographing instruction is responded.
For example, electronic equipment can respond photographing instruction according to the noise-reduced image after obtaining noise-reduced image.For example, electric The noise-reduced image can be shown as the image taken pictures under target scene and be supplied on the interface of camera applications by sub- equipment User checks.
For example, user opens respective application, and camera is directed at scenario A, then electronic equipment can be to enable image sensing Device simultaneously makes its work in the first operation mode.At this point, electronic equipment can start rapidly to get RAW image packet.Electronics After equipment gets first RAW image packet, unpacking processing can be carried out to the RAW image packet, obtain at least two frame RAW figure Picture, and at least two frame RAW images carry out synthesis processing to this, to obtain the RAW composograph with high dynamic range.It Afterwards, its available operational parameter value of electronic equipment, the operational parameter value can be used to indicate that the electronic equipment currently calculates energy The power of power.Also, electronic equipment can determine under scenario A it is that the deposit of RAW composograph is pre- according to the operational parameter value If image buffer storage queue, or pre-set image buffer queue is restored again into after RAW composograph is converted to YUV composograph.Example Such as, electronic equipment determines that RAW composograph is stored in pre-set image buffer queue under scenario A, then obtains under scenario A To the RAW composograph of RAW image packet can all be stored in pre-set image buffer queue.For example, under scenario A, electronic equipment 10 RAW image packets are got, then the RAW composograph about this 10 RAW image packets is all stored into pre-set image caching team In column.When receiving the instruction taken pictures to scenario A, electronic equipment can be obtained from pre-set image buffer queue about The multiframe history RAW composograph of scenario A, and multiframe noise reduction process is carried out to this multiframe history RAW composograph, obtain noise reduction Image, and according to the photographing instruction under noise-reduced image responding scene A.
Later, such as user moves camera, and camera is targeted by scenario B, then electronic equipment can also be quick Ground gets the RAW image packet about scenario B.It, can be right after electronic equipment gets first RAW image packet under scenario B The RAW image packet carries out unpacking processing, obtains at least two frame RAW images, and at least two frame RAW images carry out at synthesis to this Reason, to obtain the RAW composograph with high dynamic range.Later, its available operational parameter value of electronic equipment.And And electronic equipment can determine under scenario B it is by RAW composograph deposit pre-set image caching according to the operational parameter value Queue, or pre-set image buffer queue is restored again into after RAW composograph is converted to YUV composograph.For example, electronic equipment It determines to be restored again into pre-set image buffer queue after RAW composograph is converted to YUV composograph under scenario B, then exists The YUV composograph got under scenario B can be all stored in pre-set image buffer queue.For example, under scenario B, electronic equipment 15 RAW image packets are got, then the YUV composograph about this 15 RAW image packets is all stored into pre-set image caching team In column.When receiving the instruction taken pictures to scenario B, electronic equipment can be obtained from pre-set image buffer queue about The multiframe history YUV composograph of scenario B, and history YUV composograph is poised for battle to this and carries out multiframe noise reduction process, obtain noise reduction Image, and according to the photographing instruction under noise-reduced image responding scene B.
It is understood that electronic equipment can first carry out the RAW image with different exposure time in the present embodiment Synthesis, obtains the RAW composograph with high dynamic range, and RAW composograph or RAW composograph are converted to YUV composograph is stored in pre-set image buffer queue.When taking, electronic equipment can be from the pre-set image buffer queue Obtaining multiframe, there is the image of high dynamic range to carry out multiframe noise reduction, obtain noise-reduced image, and respond and clap according to the noise-reduced image According to instruction.Therefore, what the present embodiment obtained take pictures image with high dynamic range effect and noise it is smaller, i.e. the present embodiment can be with Improve the imaging effect of image.
Referring to Fig. 3, Fig. 3 is another flow diagram of image processing method provided by the embodiments of the present application, process can To include:
In 201, electronic equipment obtains RAW image packet, includes the first RAW image successively exposed in the RAW image packet With the second RAW image, first RAW image and second RAW image are the images obtained under target scene, and this first The time for exposure of RAW image is longer than the time for exposure of second RAW image.
In 202, electronic equipment carries out unpacking processing to RAW image packet, obtains the first RAW image and the second RAW image.
In 203, electronic equipment carries out synthesis processing to the first RAW image and the second RAW image, obtains with high dynamic The RAW composograph of range.
For example, 201,202 and 203 may include:
After user's operation electronic equipment opens camera applications, electronic equipment enables imaging sensor, and its work is made to exist First operating mode.If the camera of user's operation electronic equipment is directed at a certain scene, (such as electronic equipment is by a certain scene It is determined as target scene), then electronic equipment will persistently get the mesh in the imaging sensor of the first operating mode by work The RAW image packet under scene is marked, includes the first RAW image and the second RAW image successively exposed in the RAW image packet.Wherein, The time for exposure of first RAW image is longer than second RAW image.
Later, electronic equipment can carry out unpacking processing to the RAW image packet got, to obtain the first RAW image With the second RAW image, and synthesis processing is carried out to first RAW image and the second RAW image, to obtain with high dynamic range The RAW composograph enclosed.
That is, whenever getting a RAW image packet, electronic equipment can unpack the RAW image packet Processing, thus obtain including the first RAW image and the second RAW image.It should be noted that will be each in the present embodiment The longer RAW image of the exposure for including in RAW image packet is denoted as the first RAW image, by including time for exposure it is shorter RAW image is denoted as the second RAW image.
In 204, electronic equipment obtains operational parameter value, which is used to indicate the calculating energy of the electronic equipment Power.
For example, after obtaining first under target scene A RAW composograph, its available operation ginseng of electronic equipment Numerical value, wherein the operational parameter value can be intended to indicate that the numerical value of the parameter of the computing capability of electronic equipment.
In one embodiment, electronic equipment obtains operational parameter value in 204, and the operational parameter value is for indicating the electricity The process of the computing capability of sub- equipment may include:
Electronic equipment obtains the ratio of remaining running memory capacity and running memory total capacity, and the ratio is for indicating the electricity The computing capability of sub- equipment.
For example, when it needs to be determined that electronic equipment computing capability when, its available remaining running memory of electronic equipment holds The ratio of amount and running memory total capacity, and using the ratio as the computing capability of electronic equipment.Wherein, the ratio is bigger can be with Indicate that the computing capability of electronic equipment is stronger.
For example, it is 3GB that electronic equipment, which gets its remaining running memory capacity, and its running memory total capacity is 4GB, then Remaining running memory capacity and the ratio of running memory total capacity are 75%.It is preset for example, electronic equipment can preset one Threshold value 40%.When remaining running memory capacity and the ratio of running memory total capacity are greater than the preset threshold 40%, can recognize It is strong for the current computing capability of electronic equipment.When remaining running memory capacity and the ratio of running memory total capacity are less than or equal to When the preset threshold 40%, it is believed that the current computing capability of electronic equipment is weak.
In 205, if operational parameter value indicates that the computing capability of electronic equipment is higher than preset threshold, electronic equipment is determined RAW composograph is stored in pre-set image buffer queue under target scene out;If the meter of operational parameter value expression electronic equipment Calculation ability is not higher than preset threshold, then electronic equipment determines that RAW composograph is converted to YUV composite diagram under target scene Pre-set image buffer queue is stored in as after.
For example, after getting the operational parameter value of electronic equipment, the electronic equipment can according to the operational parameter value, It is that RAW composograph is stored in pre-set image buffer queue to determine under target scene, or by the RAW composograph It is restored again into the pre-set image buffer queue after being converted to YUV composograph.
For example, in the present embodiment, if operational parameter value indicates that the computing capability of electronic equipment is higher than preset threshold, electronics Equipment can determine that RAW composograph is stored in pre-set image buffer queue under target scene.If operational parameter value indicates The computing capability of electronic equipment is not higher than preset threshold, then electronic equipment can be determined synthesize RAW under target scene Image is stored in pre-set image buffer queue after being converted to YUV composograph.
In one embodiment, pre-set image buffer queue can be fixed length queue.For example, pre-set image buffer queue 30 frame images can be cached.That is, pre-set image buffer queue can cache the 30 frame images got recently.For example, according to depositing Enter the chronological order of pre-set image buffer queue, the 1st frame image, the 2nd frame figure have been cached in pre-set image buffer queue Picture ... ..., the 30th frame image.So, when caching the 31st frame image, pre-set image buffer queue can will be including most The 1st frame piclear being early stored in, then the 31st frame image is stored in the pre-set image buffer queue.
In 206, when receiving photographing instruction, electronic equipment determines destination number according to operational parameter value, the target Quantity is greater than or equal to 2.
In 207, electronic equipment obtains the history buffer image of destination number, the history from pre-set image buffer queue Cache image is the image of target scene.
For example, 206 and 207 may include:
After by RAW composograph or YUV composograph deposit pre-set image buffer queue, when receiving to target When the photographing instruction that scene is taken pictures, electronic equipment can determine a number of targets according to the operational parameter value obtained in 204 Amount.Wherein, the numerical value of the destination number can be greater than or equal to 2.
After determining destination number, electronic equipment can be obtained from the pre-set image buffer queue about the target field The multiframe history buffer image of scape.
For example, electronic equipment determines that destination number is 4 according to operational parameter value, then the electronic equipment can be from default figure As obtaining the 4 frame history buffer images about target scene in buffer queue.
In one embodiment, electronic equipment can preset at least two numerical value, and for example, 4 and 2.Wherein, when When operational parameter value indicates that the computing capability of electronic equipment is higher than preset threshold, numerical value 4 can be determined as target by electronic equipment Quantity.When operational parameter value indicates the computing capability of electronic equipment not higher than preset threshold, electronic equipment can be true by numerical value 2 It is set to destination number, etc..
For example, electronic equipment can preset three numerical value, for example, 4,3 and 2.Wherein, when remaining running memory holds When the ratio of amount and running memory total capacity is in [75%, 100%], numerical value 4 can be determined as destination number by electronic equipment. When the ratio of remaining running memory capacity and running memory total capacity is in [40%, 75%) when, electronic equipment can be by numerical value 3 It is determined as destination number.When remaining running memory capacity and the ratio of running memory total capacity are lower than 40%, electronic equipment can Numerical value 2 is determined as destination number.
In 208, electronic equipment carries out multiframe noise reduction process to multiframe history buffer image, obtains noise-reduced image.
For example, electronic equipment can go through this multiframe after getting about the multiframe history buffer image of target scene History cache image carries out multiframe noise reduction process, to obtain noise-reduced image.
Illustrate multiframe noise reduction by taking image P1, P2, P3, P4 as an example below.For example, to image P1, image P2, image P3 and When image P4 carries out multiframe noise reduction process, electronic equipment can determine one from image P1, image P2, image P3 and image P4 Frame basis frame, such as it is basic frame that image P1, which is determined, then electronic equipment can be by image P1, image P2, image P3 and figure As P4 carries out image alignment.Later, the average picture of each pixel can be calculated based on each image after alignment in electronic equipment Element value, for example, pixel value of the pixel of certain position in four frame image P1, P2, P3, P4 is successively are as follows: 101,102,103, 102, then the average pixel value that the pixel of the position can be calculated is 102.So, electronic equipment can be by the picture of the position The pixel value of vegetarian refreshments is determined as 102, and the pixel value of basic frame image P1 in the position is changed to 102 by 101.It similarly, will be basic The pixel value of each position can obtain noise-reduced image after being changed to corresponding average pixel value in frame image P1.
In 209, electronic equipment carries out image optimization processing to noise-reduced image, the image that obtains that treated.
In 210, electronic equipment according to treated image response photographing instruction, should treated image as clapping It is shown according to obtained image.
For example, 209 and 210 may include:
After obtaining noise-reduced image, electronic equipment can carry out the optimization processings such as image sharpening to the noise-reduced image, The image that obtains that treated.Later, electronic equipment can be according to treated image response photographing instruction, should treated Image is shown as the image taken pictures.
In one embodiment, after 203, i.e., electronic equipment obtains the RAW composograph with high dynamic range Afterwards, the landscaping treatments such as yuv format conversion, image sharpening, image noise reduction can be carried out to the RAW composograph, thus Image after to landscaping treatment.Image after the landscaping treatment can be used for preview or video recording.
For example, after obtaining RAW composograph, the resolution ratio of the available display screen of electronic equipment, and according to the resolution Rate carries out down-sampled processing to the RAW composograph, and down-sampled treated image is using the conversion of such as yuv format, image Preview is used for after the landscaping treatments such as sharpening, image noise reduction.
For another example, after obtaining RAW composograph, the video resolution of the available video recording of electronic equipment, and according to the record The video resolution of picture carries out down-sampled processing to the RAW composograph, and down-sampled treated image is using such as YUV lattice For being saved as the frame in corresponding video of recording a video after the landscaping treatments such as formula conversion, image sharpening, image noise reduction.
For example, the video resolution of video recording can be preset by user, including but not limited to 1080P, 2K and 4K etc..Than Such as, the video resolution of video recording is set in advance as 2K by user, then electronic equipment obtains RAW composograph in synthesis and (for example divides Resolution is 4K) after, down-sampled processing can be carried out to the RAW composograph, obtain the high dynamic range images of 2K resolution ratio.
Fig. 4 to fig. 6 is please referred to, fig. 4 to fig. 6 is the schematic diagram of a scenario of image processing method provided by the embodiments of the present application.
For example, user opens camera applications, electronic equipment enters the preview interface of camera at this time.Electronic equipment can be to enable Imaging sensor, and make imaging sensor work in the first operating mode.Under first operating mode, imaging sensor will It is sequentially generated two exposed frame times different RAW image within the time of a frame image, and is exported in the form of RAW image packet.
For example, including a personage in scenario A, then electronic equipment can as shown in figure 4, camera is directed at scenario A by user To start rapidly to get the RAW image packet about the scenario A.It, can be with after electronic equipment gets first RAW image packet Unpacking processing is carried out to the RAW image packet, obtains two frame RAW images, and synthesis processing is carried out to this two frames RAW image, thus Obtain the RAW composograph with high dynamic range.
Later, its available operational parameter value of electronic equipment, the operational parameter value can be used to indicate that the electronic equipment The power of current computing capability.Also, electronic equipment can determine under scenario A it is to synthesize RAW according to the operational parameter value Image is stored in pre-set image buffer queue, or RAW composograph is converted to and is restored again into pre-set image after YUV composograph and delays Deposit queue.For example, electronic equipment it is current computing capability it is stronger, then can determine to be stored in RAW composograph under scenario A In pre-set image buffer queue, then the RAW composograph of the RAW image packet got under scenario A can all be stored in pre-set image In buffer queue.For example, electronic equipment gets 10 RAW image packets under scenario A, then about this 10 RAW image packets RAW composograph is all stored into pre-set image buffer queue.
When being in the preview interface of camera applications, whenever electronic equipment obtains a frame RAW composograph, electronic equipment can To be shown in preview interface after carrying out the processing such as yuv format conversion, image sharpening and noise reduction to the RAW composograph On for user's preview.
After preview, such as user presses button of taking pictures, as shown in figure 4, then electronic equipment can receive to scenario A The instruction taken pictures.At this point, electronic equipment can obtain the 4 frame history RAW about scenario A from pre-set image buffer queue Composograph, and multiframe noise reduction process is carried out to this 4 frame history RAW composograph, obtain noise-reduced image.For example, such as Fig. 5 institute Show, 4 frames that electronic equipment is obtained from pre-set image buffer queue about the RAW composograph of scenario A be respectively P1, P2, P3, P4.It is basic frame that electronic equipment, which can determine image P1, and image P2, P3, P4 is recycled to carry out multiframe noise reduction to P1.Electronics is set It is standby image P1, image P2, image P3 and image P4 to be subjected to image alignment.Later, after electronic equipment can be based on alignment Each image, the average pixel value of each pixel is calculated, for example, the pixel of the position L is in four frame image P1, P2, P3, P4 In pixel value successively are as follows: 101,102,103,102, then can be calculated the pixel of the position average pixel value be 102. So, the pixel value of the pixel of the position can be determined as 102 by electronic equipment, by basic frame image P1 in the position L Pixel value is changed to 102 by 101.Similarly, after the pixel value of each position in basic frame image P1 being changed to corresponding average pixel value It can obtain noise-reduced image.
After obtaining noise-reduced image, electronic equipment can carry out the processing such as image sharpening to the noise-reduced image, be beautified Treated noise-reduced image.Later, the noise-reduced image after the landscaping treatment can be sent to jpeg coder by electronic equipment, warp It exports after jpeg coder processing and is shown to camera applications interface, take pictures to obtain image so that user checks.
For another example, camera is targeted by scenario B again by user later, includes two personages in scenario B, as shown in fig. 6, then electric Sub- equipment can start rapidly to get the RAW image packet about the scenario B.Electronic equipment gets first under scenario B After a RAW image packet, unpacking processing can be carried out to the RAW image packet, obtain two frame RAW images, and to this two frames RAW image Synthesis processing is carried out, to obtain the RAW composograph with high dynamic range.
Later, its available operational parameter value of electronic equipment, the operational parameter value can be used to indicate that the electronic equipment The power of current computing capability.Also, electronic equipment can determine under scenario B it is to synthesize RAW according to the operational parameter value Image is stored in pre-set image buffer queue, or RAW composograph is converted to and is restored again into pre-set image after YUV composograph and delays Deposit queue.For example, electronic equipment it is current computing capability it is weaker, then can determine to convert RAW composograph under scenario B To be restored again into pre-set image buffer queue after YUV composograph, then what is got under scenario B is obtained by RAW image packet RAW composograph can be all stored in pre-set image buffer queue after the YUV composograph for being converted to yuv format.For example, on the scene Under scape B, electronic equipment gets 15 RAW image packets, then the YUV composograph about this 15 RAW image packets is all stored into In pre-set image buffer queue.
Likewise, when being in the preview interface of camera applications, whenever electronic equipment obtains RAW of the frame about scenario B Composograph, electronic equipment can carry out yuv format conversion, image sharpening and noise reduction etc. to the RAW composograph After processing, it is shown in preview interface for user's preview.
After preview, such as user presses button of taking pictures, as shown in fig. 6, then electronic equipment can receive to scenario B The instruction taken pictures.At this point, electronic equipment can obtain the 2 frame history YUV about scenario B from pre-set image buffer queue Composograph, and multiframe noise reduction process is carried out to this 2 frame history YUV composograph, obtain noise-reduced image.For example, electronic equipment 2 frames obtained from pre-set image buffer queue are respectively P5 and P6 about the YUV composograph of scenario B.Electronic equipment can be with Multiframe noise reduction is carried out to image P5 and P6, obtains noise-reduced image.
After obtaining noise-reduced image, electronic equipment can carry out the processing such as image sharpening to the noise-reduced image, be beautified Treated noise-reduced image.Later, the noise-reduced image after the landscaping treatment can be sent to jpeg coder by electronic equipment, warp It exports after jpeg coder processing and is shown to camera applications interface, take pictures to obtain image so that user checks.
Referring to Fig. 7, Fig. 7 is the structural schematic diagram of image processing apparatus provided by the embodiments of the present application.Image procossing dress Setting 300 may include: the first acquisition module 301, unpack module 302, and synthesis module 303, second obtains module 304, caches mould Block 305, processing module 306, respond module 307.
First obtains module 301, includes at least two frame RAW images in the RAW image packet for obtaining RAW image packet, At least two frame RAW images are the images obtained under target scene and have the different time for exposure.
Module 302 is unpacked, for carrying out unpacking processing to the RAW image packet, obtains at least two frame RAW images.
Synthesis module 303 is obtained for carrying out synthesis processing at least two frame RAW images with high dynamic range RAW composograph.
Second obtains module 304, and for obtaining the operational parameter value of electronic equipment, the operational parameter value is for indicating institute State the computing capability of electronic equipment.
Cache module 305, for according to the operational parameter value, determination to synthesize the RAW under the target scene Image is stored in pre-set image buffer queue, or is stored in pre-set image after the RAW composograph is converted to YUV composograph Buffer queue.
Processing module 306, for obtaining target field from the pre-set image buffer queue when receiving photographing instruction The multiframe history buffer image of scape, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image.
Respond module 307, for responding the photographing instruction according to the noise-reduced image.
In one embodiment, cache module 305 can be used for:
If operational parameter value indicates that the computing capability of the electronic equipment is higher than preset threshold, it is determined that go out in the target The RAW composograph is stored in pre-set image buffer queue under scene;
If operational parameter value indicates the computing capability of the electronic equipment not higher than preset threshold, it is determined that go out in the mesh The pre-set image buffer queue is stored in after the RAW composograph being converted to YUV composograph under mark scene.
In one embodiment, the second acquisition module 304 can be used for:
The ratio of remaining the running memory capacity and running memory total capacity of electronic equipment is obtained, the ratio is for indicating The computing capability of the electronic equipment.
In one embodiment, the respond module 307 can be used for:
Image optimization processing is carried out to the noise-reduced image, the image that obtains that treated;
According to photographing instruction described in treated the image response, using treated the image as taking pictures to obtain Image be shown.
In one embodiment, the first acquisition module 301 can be used for: obtain RAW image packet, the RAW figure As including the first RAW image and the second RAW image successively exposed, first RAW image and second RAW image in packet It is the image obtained under target scene, and the time for exposure of first RAW image is longer than the exposure of second RAW image Time.
So, the unpacking module 302 can be used for: carrying out unpacking processing to the RAW image packet, obtains described first RAW image and second RAW image.
The synthesis module 303 can be used for: carry out at synthesis to first RAW image and second RAW image Reason, obtains the RAW composograph with high dynamic range.
In one embodiment, the processing module 306 can be used for:
When receiving photographing instruction, destination number is determined according to the operational parameter value, the destination number be greater than or Equal to 2;
The history buffer image of the destination number, the history buffer figure are obtained from the pre-set image buffer queue Image as being the target scene.
In one embodiment, the pre-set image buffer queue is fixed length queue.
The embodiment of the present application provides a kind of computer-readable storage medium, computer program is stored thereon with, when described When computer program executes on computers, so that the computer is executed as in image processing method provided in this embodiment Process.
The embodiment of the present application also provides a kind of electronic equipment, including memory, and processor, the processor is by calling institute The computer program stored in memory is stated, for executing the process in image processing method provided in this embodiment.
For example, above-mentioned electronic equipment can be the mobile terminals such as tablet computer or smart phone.Referring to Fig. 8, Fig. 8 is the structural schematic diagram of electronic equipment provided by the embodiments of the present application.
The electronic equipment 400 may include the components such as camera module 401, memory 402, processor 403.Art technology Personnel are appreciated that electronic devices structure shown in Fig. 8 does not constitute the restriction to electronic equipment, may include than illustrating more More or less component perhaps combines certain components or different component layouts.
Camera module 401 may include lens and imaging sensor, and wherein lens are used to acquire external light signal and mention Imaging sensor is supplied, image sensor senses are converted into digitized original image from the light signal of lens Data, i.e. RAW image data.RAW is unprocessed, also uncompressed format, it can be visually known as to " digital bottom Piece ".The imaging sensor of the camera module of electronic equipment can have the first operating mode and the second operating mode.
Memory 402 can be used for storing application program and data.It include that can hold in the application program that memory 402 stores Line code.Application program can form various functional modules.Processor 403 is stored in the application journey of memory 402 by operation Sequence, thereby executing various function application and data processing.
Processor 403 is the control centre of electronic equipment, utilizes each of various interfaces and the entire electronic equipment of connection A part by running or execute the application program being stored in memory 402, and is called and is stored in memory 402 Data execute the various functions and processing data of electronic equipment, to carry out integral monitoring to electronic equipment.
In the present embodiment, the processor 403 in electronic equipment can be according to following instruction, will be one or more The corresponding executable code of the process of application program is loaded into memory 402, and is run by processor 403 and be stored in storage Application program in device 402, thereby executing:
RAW image packet is obtained, includes at least two frame RAW images, at least two frame RAW images in the RAW image packet It is the image obtained under target scene and there is the different time for exposure;
Unpacking processing is carried out to the RAW image packet, obtains at least two frame RAW images;
Synthesis processing is carried out at least two frame RAW images, obtains the RAW composograph with high dynamic range;
The operational parameter value of electronic equipment is obtained, the operational parameter value is used to indicate the calculating energy of the electronic equipment Power;
According to the operational parameter value, determines and the RAW composograph is stored in pre-set image under the target scene Buffer queue, or pre-set image buffer queue is stored in after the RAW composograph is converted to YUV composograph;
When receiving photographing instruction, the multiframe history buffer of target scene is obtained from the pre-set image buffer queue Image, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image;
According to the noise-reduced image, the photographing instruction is responded.
Referring to Fig. 9, electronic equipment 500 may include camera module 501, memory 502, processor 503, touch display The components such as screen 504, loudspeaker 505, microphone 506.
Camera module 501 may include image processing circuit, and image processing circuit can use hardware and or software component It realizes, it may include define the various processing units of image signal process (Image Signal Processing) pipeline.At image Reason circuit at least may include: camera, image-signal processor (Image Signal Processor, ISP processor), control Logic device, video memory and display processed etc..Wherein camera at least may include that one or more lens and image pass Sensor.Imaging sensor may include colour filter array (such as Bayer filter).Imaging sensor can be obtained with imaging sensor The luminous intensity and wavelength information that each imaging pixel captures, and the one group of original image that can be handled by image-signal processor is provided Data.
Image-signal processor can handle raw image data pixel by pixel in various formats.For example, each image Pixel can have the bit depth of 8,10,12 or 14 bits, and image-signal processor can carry out one or more to raw image data The statistical information of a image processing operations, collection about image data.Wherein, image processing operations can be by identical or different position Depth accuracy carries out.Raw image data can be stored into video memory after image-signal processor is handled.Image letter Number processor can also receive image data from video memory.
Video memory dedicated can be deposited for independent in a part, storage equipment or electronic equipment of memory device Reservoir, and may include DMA (Direct Memory Access, direct direct memory access (DMA)) feature.
When receiving the image data from video memory, image-signal processor can carry out one or more images Processing operation, such as time-domain filtering.Image data that treated can be transmitted to video memory, another to carry out before shown Outer processing.Image-signal processor can also receive processing data from video memory, and carry out to the processing data original Image real time transfer in domain and in RGB and YCbCr color space.Treated, and image data may be output to display, with It watches for user and/or is further located by graphics engine or GPU (Graphics Processing Unit, graphics processor) Reason.In addition, the output of image-signal processor also can be transmitted to video memory, and display can read from video memory and scheme As data.In one embodiment, video memory can be configured to realize one or more frame buffers.
The statistical data that image-signal processor determines can be transmitted to control logic device.For example, statistical data may include certainly The statistics of the imaging sensors such as dynamic exposure, automatic white balance, automatic focusing, flicker detection, black level compensation, correcting lens shadow Information.
Control logic device may include the processor and/or microcontroller for executing one or more routines (such as firmware).One Or multiple routines can statistical data based on the received, determine the control parameter and ISP control parameter of camera.For example, camera shooting The control parameter of head may include camera flash control parameter, the control parameter of lens (such as focus or zoom focal length) or The combination of these parameters.ISP control parameter may include for automatic white balance and color adjustment (for example, during RGB processing) Gain level and color correction matrix etc..
Referring to Fig. 10, Figure 10 is the structural schematic diagram of image processing circuit in the present embodiment.As shown in Figure 10, for convenient for Illustrate, the various aspects of image processing techniques relevant to the embodiment of the present invention are only shown.
Such as image processing circuit may include: camera, image-signal processor, control logic device, video memory, Display.Wherein, camera may include one or more lens and imaging sensor.In some embodiments, camera can For any one of focal length camera or wide-angle camera.
First image transmitting of camera acquisition is handled to image-signal processor.Image-signal processor processing the After one image, the statistical data (brightness of such as image, the contrast value of image, the color of image) of the first image can be sent to Control logic device.Control logic device can determine the control parameter of camera according to statistical data, so that camera can be according to control Parameter carries out the operation such as auto-focusing, automatic exposure.First image can be stored after image-signal processor is handled to In video memory.Image-signal processor can also read the image stored in video memory to be handled.In addition, the One image can be sent directly to display after image-signal processor is handled and be shown.Display can also be read Image in video memory is to be shown.
In addition, not having displaying in figure, electronic equipment can also include CPU and power supply module.CPU and logic controller, Image-signal processor, video memory and display are all connected with, and CPU is for realizing overall situation control.Power supply module is for being each A module for power supply.
It include executable code in the application program that memory 502 stores.Application program can form various function moulds Block.Processor 503 is stored in the application program of memory 502 by operation, at various function application and data Reason.
Processor 503 is the control centre of electronic equipment, utilizes each of various interfaces and the entire electronic equipment of connection A part by running or execute the application program being stored in memory 502, and is called and is stored in memory 502 Data execute the various functions and processing data of electronic equipment, to carry out integral monitoring to electronic equipment.
Touch display screen 504 can be used for receiving user and operate to the touch control of electronic equipment.Loudspeaker 505 can be broadcast Sound reproduction sound signal.Microphone 506 can be used for picking up voice signal.
In the present embodiment, the processor 503 in electronic equipment can be according to following instruction, will be one or more The corresponding executable code of the process of application program is loaded into memory 502, and is run by processor 503 and be stored in storage Application program in device 502, thereby executing:
RAW image packet is obtained, includes at least two frame RAW images, at least two frame RAW images in the RAW image packet It is the image obtained under target scene and there is the different time for exposure;
Unpacking processing is carried out to the RAW image packet, obtains at least two frame RAW images;
Synthesis processing is carried out at least two frame RAW images, obtains the RAW composograph with high dynamic range;
The operational parameter value of electronic equipment is obtained, the operational parameter value is used to indicate the calculating energy of the electronic equipment Power;
According to the operational parameter value, determines and the RAW composograph is stored in pre-set image under the target scene Buffer queue, or pre-set image buffer queue is stored in after the RAW composograph is converted to YUV composograph;
When receiving photographing instruction, the multiframe history buffer of target scene is obtained from the pre-set image buffer queue Image, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image;
According to the noise-reduced image, the photographing instruction is responded.
In one embodiment, processor 503 is executed according to the operational parameter value, is determined under the target scene The RAW composograph is stored in pre-set image buffer queue, or the RAW composograph is converted into YUV composograph When being stored in pre-set image buffer queue afterwards, it can execute: if operational parameter value indicates that the computing capability of the electronic equipment is higher than Preset threshold, it is determined that go out and the RAW composograph is stored in pre-set image buffer queue under the target scene;If operation Parameter value indicates the computing capability of the electronic equipment not higher than preset threshold, it is determined that going out will be by institute under the target scene It states after RAW composograph is converted to YUV composograph and is stored in the pre-set image buffer queue.
In one embodiment, processor 503 executes the operational parameter value for obtaining electronic equipment, the operation ginseng When numerical value is used to indicate the computing capability of the electronic equipment, it can execute: obtain the remaining running memory capacity of electronic equipment With the ratio of running memory total capacity, the ratio is used to indicate the computing capability of the electronic equipment.
In one embodiment, processor 503 is executed according to the noise-reduced image, can when responding the photographing instruction To execute: carrying out image optimization processing to the noise-reduced image, the image that obtains that treated;It is rung according to treated the image The photographing instruction is answered, is shown using treated the image as the image taken pictures.
In one embodiment, processor 503 executes the acquisition RAW image packet, includes extremely in the RAW image packet Few two frame RAW images, at least two frame RAW images are the images obtained under target scene and have the different time for exposure When, it can execute: obtain RAW image packet, include the first RAW image successively exposed and the 2nd RAW figure in the RAW image packet Picture, first RAW image and second RAW image are the images obtained under target scene, and first RAW image Time for exposure be longer than time for exposure of second RAW image.
So, the execution of processor 503 carries out unpacking processing to the RAW image packet, obtains at least two frame RAW images When, it can execute: unpacking processing being carried out to the RAW image packet, obtains first RAW image and second RAW image.
The execution of processor 503 carries out synthesis processing at least two frame RAW images, obtains having high dynamic range It when RAW composograph, can execute: synthesis processing being carried out to first RAW image and second RAW image, is had There is the RAW composograph of high dynamic range.
In one embodiment, processor 503 executes described when receiving photographing instruction, slow from the pre-set image When depositing the image for obtaining the multiframe history buffer of target scene in queue, it can execute: when receiving photographing instruction, according to institute It states operational parameter value and determines that destination number, the destination number are greater than or equal to 2;It is obtained from the pre-set image buffer queue The history buffer image of the destination number, the history buffer image are the image of the target scene.
In one embodiment, the pre-set image buffer queue is fixed length queue.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment Point, it may refer to the detailed description above with respect to image processing method, details are not described herein again.
Image processing method in described image processing unit provided by the embodiments of the present application and foregoing embodiments belongs to together One design can run either offer method in described image processing method embodiment in described image processing unit, Specific implementation process is detailed in described image processing method embodiment, and details are not described herein again.
It should be noted that those of ordinary skill in the art can for the embodiment of the present application described image processing method With understand realize the embodiment of the present application described image processing method all or part of the process, be can by computer program come Relevant hardware is controlled to complete, the computer program can be stored in a computer-readable storage medium, such as be stored in It in memory, and is executed by least one processor, in the process of implementation may include the embodiment such as described image processing method Process.Wherein, the storage medium can be magnetic disk, CD, read-only memory (ROM, Read Only Memory), random Access/memory body (RAM, Random Access Memory) etc..
For the described image processing unit of the embodiment of the present application, each functional module be can integrate in a processing core In piece, it is also possible to modules and physically exists alone, can also be integrated in two or more modules in a module.On It states integrated module both and can take the form of hardware realization, can also be realized in the form of software function module.The collection If at module realized in the form of software function module and when sold or used as an independent product, also can store In one computer-readable storage medium, the storage medium is for example read-only memory, disk or CD etc..
Above to a kind of image processing method, device, storage medium and electronic equipment provided by the embodiment of the present application It is described in detail, specific examples are used herein to illustrate the principle and implementation manner of the present application, the above reality The explanation for applying example is merely used to help understand the present processes and its core concept;Meanwhile for those skilled in the art, According to the thought of the application, there will be changes in the specific implementation manner and application range, in conclusion in this specification Hold the limitation that should not be construed as to the application.

Claims (10)

1. a kind of image processing method characterized by comprising
Obtain RAW image packet, include at least two frame RAW images in the RAW image packet, at least two frame RAW images be The image that obtains under target scene and there is the different time for exposure;
Unpacking processing is carried out to the RAW image packet, obtains at least two frame RAW images;
Synthesis processing is carried out at least two frame RAW images, obtains the RAW composograph with high dynamic range;
The operational parameter value of electronic equipment is obtained, the operational parameter value is used to indicate the computing capability of the electronic equipment;
According to the operational parameter value, determine RAW composograph deposit pre-set image caching under the target scene Queue, or the pre-set image buffer queue is stored in after the RAW composograph is converted to YUV composograph;
When receiving photographing instruction, the multiframe history buffer figure of target scene is obtained from the pre-set image buffer queue Picture, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image;
According to the noise-reduced image, the photographing instruction is responded.
2. image processing method according to claim 1, which is characterized in that according to the operational parameter value, determine in institute It states and the RAW composograph is stored in pre-set image buffer queue under target scene, or the RAW composograph is converted to The pre-set image buffer queue is stored in after YUV composograph, comprising:
If operational parameter value indicates that the computing capability of the electronic equipment is higher than preset threshold, it is determined that go out in the target scene It is lower that the RAW composograph is stored in pre-set image buffer queue;
If operational parameter value indicates the computing capability of the electronic equipment not higher than preset threshold, it is determined that go out in the target field The pre-set image buffer queue is stored in after the RAW composograph is converted to YUV composograph under scape.
3. image processing method according to claim 2, which is characterized in that the operating parameter for obtaining electronic equipment Value, the operational parameter value are used to indicate the computing capability of the electronic equipment, comprising:
The ratio of remaining the running memory capacity and running memory total capacity of electronic equipment is obtained, the ratio is for indicating described The computing capability of electronic equipment.
4. image processing method according to claim 1, which is characterized in that according to the noise-reduced image, respond the bat According to instruction, comprising:
Image optimization processing is carried out to the noise-reduced image, the image that obtains that treated;
According to photographing instruction described in treated the image response, using treated the image as the figure taken pictures As being shown.
5. image processing method according to claim 1, which is characterized in that the acquisition RAW image packet, the RAW figure As, including at least two frame RAW images, at least two frame RAW images are the images obtained under target scene and have not in packet With time for exposure, comprising: obtain RAW image packet, include the first RAW image successively exposed and the in the RAW image packet Two RAW images, first RAW image and second RAW image are the images obtained under target scene, and described first The time for exposure of RAW image is longer than the time for exposure of second RAW image;
Unpacking processing is carried out to the RAW image packet, obtains at least two frame RAW images, comprising: to the RAW image packet Unpacking processing is carried out, first RAW image and second RAW image are obtained;
Synthesis processing is carried out at least two frame RAW images, obtains the RAW composograph with high dynamic range, comprising: right First RAW image and second RAW image carry out synthesis processing, obtain the RAW composograph with high dynamic range.
6. image processing method according to claim 1, which is characterized in that it is described when receiving photographing instruction, from institute State the multiframe history buffer image that target scene is obtained in pre-set image buffer queue, comprising:
When receiving photographing instruction, determine that destination number, the destination number are greater than or equal to according to the operational parameter value 2;
The history buffer image of the destination number is obtained from the pre-set image buffer queue, the history buffer image is The image of the target scene.
7. image processing method according to claim 1, which is characterized in that the pre-set image buffer queue is fixed length team Column.
8. a kind of image processing apparatus characterized by comprising
First obtains module, includes at least two frame RAW images in the RAW image packet for obtaining RAW image packet, it is described extremely Few two frame RAW images are the images obtained under target scene and have the different time for exposure;
Module is unpacked, for carrying out unpacking processing to the RAW image packet, obtains at least two frame RAW images;
Synthesis module obtains having the RAW of high dynamic range to close for carrying out synthesis processing at least two frame RAW images At image;
Second obtains module, and for obtaining the operational parameter value of electronic equipment, the operational parameter value is for indicating the electronics The computing capability of equipment;
Cache module, for determining and being stored in the RAW composograph under the target scene according to the operational parameter value Pre-set image buffer queue, or pre-set image caching team is stored in after the RAW composograph is converted to YUV composograph Column;
Processing module, for obtaining the more of target scene from the pre-set image buffer queue when receiving photographing instruction Frame history buffer image, and multiframe noise reduction process is carried out to the multiframe history buffer image, obtain noise-reduced image;
Respond module, for responding the photographing instruction according to the noise-reduced image.
9. a kind of storage medium, is stored thereon with computer program, which is characterized in that when the computer program on computers When execution, so that the computer executes the method as described in any one of claims 1 to 7.
10. a kind of electronic equipment, including memory, processor, which is characterized in that the processor is by calling the memory The computer program of middle storage, for executing the method as described in any one of claims 1 to 7.
CN201910280476.8A 2019-04-09 2019-04-09 Image processing method, image processing device, storage medium and electronic equipment Active CN109993722B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910280476.8A CN109993722B (en) 2019-04-09 2019-04-09 Image processing method, image processing device, storage medium and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910280476.8A CN109993722B (en) 2019-04-09 2019-04-09 Image processing method, image processing device, storage medium and electronic equipment

Publications (2)

Publication Number Publication Date
CN109993722A true CN109993722A (en) 2019-07-09
CN109993722B CN109993722B (en) 2023-04-18

Family

ID=67132528

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910280476.8A Active CN109993722B (en) 2019-04-09 2019-04-09 Image processing method, image processing device, storage medium and electronic equipment

Country Status (1)

Country Link
CN (1) CN109993722B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110969587A (en) * 2019-11-29 2020-04-07 联想(北京)有限公司 Image acquisition method and device and electronic equipment
CN111385475A (en) * 2020-03-11 2020-07-07 Oppo广东移动通信有限公司 Image acquisition method, photographing device, electronic equipment and readable storage medium
CN111988526A (en) * 2020-08-27 2020-11-24 Oppo(重庆)智能科技有限公司 Mobile terminal and image data processing method
CN112003996A (en) * 2020-08-12 2020-11-27 Oppo广东移动通信有限公司 Video generation method, terminal and computer storage medium
CN113038004A (en) * 2021-02-26 2021-06-25 展讯通信(天津)有限公司 Multi-window image previewing method and device, computer equipment and storage medium
WO2022179256A1 (en) * 2021-02-26 2022-09-01 Oppo广东移动通信有限公司 Image processing method, image processing apparatus, electronic device, and readable storage medium
CN116029914A (en) * 2022-07-27 2023-04-28 荣耀终端有限公司 Image processing method and electronic equipment
CN116389898A (en) * 2023-02-27 2023-07-04 荣耀终端有限公司 Image processing method, device and storage medium

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102833471A (en) * 2011-06-15 2012-12-19 奥林巴斯映像株式会社 Imaging device and imaging method
JP2015082675A (en) * 2013-10-21 2015-04-27 三星テクウィン株式会社Samsung Techwin Co., Ltd Image processing device and image processing method
CN105376473A (en) * 2014-08-25 2016-03-02 中兴通讯股份有限公司 Photographing method, device and equipment
JP2017112462A (en) * 2015-12-15 2017-06-22 キヤノン株式会社 Imaging device and control method, program therefor and storage medium
CN107222669A (en) * 2017-06-30 2017-09-29 维沃移动通信有限公司 The method and mobile terminal of a kind of shooting
WO2017215501A1 (en) * 2016-06-15 2017-12-21 深圳市万普拉斯科技有限公司 Method and device for image noise reduction processing and computer storage medium
US20180097984A1 (en) * 2016-10-03 2018-04-05 Denso Corporation Imaging device provided with high dynamic range rendering function
CN108198189A (en) * 2017-12-28 2018-06-22 广东欧珀移动通信有限公司 Acquisition methods, device, storage medium and the electronic equipment of picture clarity
CN108353130A (en) * 2015-11-24 2018-07-31 索尼公司 Image processor, image processing method and program
CN108401110A (en) * 2018-03-18 2018-08-14 广东欧珀移动通信有限公司 Acquisition methods, device, storage medium and the electronic equipment of image
CN108419023A (en) * 2018-03-26 2018-08-17 华为技术有限公司 A kind of method and relevant device generating high dynamic range images
CN108520493A (en) * 2018-03-30 2018-09-11 广东欧珀移动通信有限公司 Processing method, device, storage medium and the electronic equipment that image is replaced
CN109167930A (en) * 2018-10-11 2019-01-08 Oppo广东移动通信有限公司 Image display method, device, electronic equipment and computer readable storage medium

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102833471A (en) * 2011-06-15 2012-12-19 奥林巴斯映像株式会社 Imaging device and imaging method
JP2015082675A (en) * 2013-10-21 2015-04-27 三星テクウィン株式会社Samsung Techwin Co., Ltd Image processing device and image processing method
CN105376473A (en) * 2014-08-25 2016-03-02 中兴通讯股份有限公司 Photographing method, device and equipment
CN108353130A (en) * 2015-11-24 2018-07-31 索尼公司 Image processor, image processing method and program
JP2017112462A (en) * 2015-12-15 2017-06-22 キヤノン株式会社 Imaging device and control method, program therefor and storage medium
WO2017215501A1 (en) * 2016-06-15 2017-12-21 深圳市万普拉斯科技有限公司 Method and device for image noise reduction processing and computer storage medium
US20180097984A1 (en) * 2016-10-03 2018-04-05 Denso Corporation Imaging device provided with high dynamic range rendering function
CN107222669A (en) * 2017-06-30 2017-09-29 维沃移动通信有限公司 The method and mobile terminal of a kind of shooting
CN108198189A (en) * 2017-12-28 2018-06-22 广东欧珀移动通信有限公司 Acquisition methods, device, storage medium and the electronic equipment of picture clarity
CN108401110A (en) * 2018-03-18 2018-08-14 广东欧珀移动通信有限公司 Acquisition methods, device, storage medium and the electronic equipment of image
CN108419023A (en) * 2018-03-26 2018-08-17 华为技术有限公司 A kind of method and relevant device generating high dynamic range images
CN108520493A (en) * 2018-03-30 2018-09-11 广东欧珀移动通信有限公司 Processing method, device, storage medium and the electronic equipment that image is replaced
CN109167930A (en) * 2018-10-11 2019-01-08 Oppo广东移动通信有限公司 Image display method, device, electronic equipment and computer readable storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
刘宗等: "基于多曝光的高动态图像合成的噪声处理", 《电子科技》 *

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110969587A (en) * 2019-11-29 2020-04-07 联想(北京)有限公司 Image acquisition method and device and electronic equipment
CN111385475A (en) * 2020-03-11 2020-07-07 Oppo广东移动通信有限公司 Image acquisition method, photographing device, electronic equipment and readable storage medium
CN112003996A (en) * 2020-08-12 2020-11-27 Oppo广东移动通信有限公司 Video generation method, terminal and computer storage medium
CN112003996B (en) * 2020-08-12 2023-04-18 Oppo广东移动通信有限公司 Video generation method, terminal and computer storage medium
CN111988526A (en) * 2020-08-27 2020-11-24 Oppo(重庆)智能科技有限公司 Mobile terminal and image data processing method
CN113038004A (en) * 2021-02-26 2021-06-25 展讯通信(天津)有限公司 Multi-window image previewing method and device, computer equipment and storage medium
WO2022179256A1 (en) * 2021-02-26 2022-09-01 Oppo广东移动通信有限公司 Image processing method, image processing apparatus, electronic device, and readable storage medium
CN113038004B (en) * 2021-02-26 2022-09-23 展讯通信(天津)有限公司 Multi-window image previewing method and device, computer equipment and storage medium
CN116029914A (en) * 2022-07-27 2023-04-28 荣耀终端有限公司 Image processing method and electronic equipment
CN116029914B (en) * 2022-07-27 2023-10-20 荣耀终端有限公司 Image processing method and electronic equipment
CN116389898A (en) * 2023-02-27 2023-07-04 荣耀终端有限公司 Image processing method, device and storage medium
CN116389898B (en) * 2023-02-27 2024-03-19 荣耀终端有限公司 Image processing method, device and storage medium

Also Published As

Publication number Publication date
CN109993722B (en) 2023-04-18

Similar Documents

Publication Publication Date Title
CN109993722A (en) Image processing method, device, storage medium and electronic equipment
CN110445988B (en) Image processing method, image processing device, storage medium and electronic equipment
CN110290289B (en) Image noise reduction method and device, electronic equipment and storage medium
CN107959778B (en) Imaging method and device based on dual camera
CN109040609B (en) Exposure control method, exposure control device, electronic equipment and computer-readable storage medium
CN110072052B (en) Image processing method and device based on multi-frame image and electronic equipment
CN110198417A (en) Image processing method, device, storage medium and electronic equipment
CN110248106B (en) Image noise reduction method and device, electronic equipment and storage medium
CN110166708B (en) Night scene image processing method and device, electronic equipment and storage medium
CN110191291B (en) Image processing method and device based on multi-frame images
CN109005342A (en) Panorama shooting method, device and imaging device
CN110213502B (en) Image processing method, image processing device, storage medium and electronic equipment
WO2020207261A1 (en) Image processing method and apparatus based on multiple frames of images, and electronic device
CN108322646A (en) Image processing method, device, storage medium and electronic equipment
CN108833804A (en) Imaging method, device and electronic equipment
CN110198418A (en) Image processing method, device, storage medium and electronic equipment
CN110505411A (en) Image capturing method, device, storage medium and electronic equipment
CN110166706B (en) Image processing method, image processing apparatus, electronic device, and storage medium
CN110166709B (en) Night scene image processing method and device, electronic equipment and storage medium
CN110012227B (en) Image processing method, image processing device, storage medium and electronic equipment
CN110198419A (en) Image processing method, device, storage medium and electronic equipment
CN108024054A (en) Image processing method, device and equipment
CN110445986A (en) Image processing method, device, storage medium and electronic equipment
CN109167930A (en) Image display method, device, electronic equipment and computer readable storage medium
CN110264420B (en) Image processing method and device based on multi-frame images

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant