CN110264473A - Image processing method, device and electronic equipment based on multiple image - Google Patents
Image processing method, device and electronic equipment based on multiple image Download PDFInfo
- Publication number
- CN110264473A CN110264473A CN201910509713.3A CN201910509713A CN110264473A CN 110264473 A CN110264473 A CN 110264473A CN 201910509713 A CN201910509713 A CN 201910509713A CN 110264473 A CN110264473 A CN 110264473A
- Authority
- CN
- China
- Prior art keywords
- image
- processor
- original
- processing
- original sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 24
- 238000012545 processing Methods 0.000 claims abstract description 149
- 238000004364 calculation method Methods 0.000 claims abstract description 22
- 238000000034 method Methods 0.000 claims abstract description 14
- 230000009467 reduction Effects 0.000 claims description 26
- 230000015572 biosynthetic process Effects 0.000 claims description 19
- 238000003786 synthesis reaction Methods 0.000 claims description 19
- 238000013528 artificial neural network Methods 0.000 claims description 9
- 238000003384 imaging method Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 6
- 238000013473 artificial intelligence Methods 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims 2
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000001737 promoting effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 210000004218 nerve net Anatomy 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
Abstract
The application proposes a kind of image processing method based on multiple image, device and electronic equipment, and this method includes obtaining multiframe original image；Cutting processing is carried out to each frame original image, obtains multiple original sub images corresponding with each frame original image；By in multiframe original image, the original sub image in same position is transmitted to corresponding image processor, and to be in the original sub image of same position using the processing of corresponding image processor, image processor includes multiple；The target subgraph that each image processor is handled is obtained, and each target subgraph is synthesized.It can be realized by the application and piecemeal carried out to each frame original image, the calculation resources of different images processor are called for the original sub image of different piecemeals, night scene image taking speed can be effectively improved, promote image processing efficiency.
Description
Technical field
This application involves technical field of image processing more particularly to a kind of image processing methods based on multiple image, dress
It sets and electronic equipment.
Background technique
With the development of intelligent terminal technology, mobile terminal device is easy to operate and easy to carry, in daily life
More and more users are taken pictures using mobile terminal devices such as smart phone, tablet computers.Intelligent mobile terminal is to people's
Daily to take pictures while bring convenient, requirement of the people to the picture quality of shooting is also higher and higher, and especially in night scene, this is special
In different scene, picture quality is lower.
Currently, usually acquisition multiframe original image carries out high dynamic synthesis, it is aligned using the identical exposure image of multiframe laggard
Row noise reduction is aided with the low exposure figure of multiframe and carries out high dynamic synthesis to show night scene bloom details, it is clean, bright to reach night scene picture
There is dynamic effect again.
Under this mode, the processing of super multiple image is complex, wherein may relate to multiframe alignment, motion detection, when
Multiple links such as airspace noise reduction, high dynamic synthesis, tone mapping, different links generally call different image processors to carry out
The image procossing of corresponding link, processing take a long time, and image processing efficiency is not high.
Summary of the invention
The application is intended to solve at least some of the technical problems in related technologies.
For this purpose, the purpose of the application is to propose that a kind of image processing method based on multiple image, device and electronics are set
It is standby, it can be realized and piecemeal is carried out to each frame original image, call different images processor for the original sub image of different piecemeals
Calculation resources, can effectively improve night scene image taking speed, promote image processing efficiency.
In order to achieve the above objectives, the image processing method based on multiple image that the application first aspect embodiment proposes,
It include: to obtain multiframe original image；The original image described in each frame carries out cutting processing, obtains and original image pair described in each frame
The multiple original sub images answered；By in the multiframe original image, the original sub image in same position is transmitted to corresponding
Image processor, using the corresponding image processor processing original sub image for being in same position, the figure
As processor includes multiple；The target subgraph that each described image processor is handled is obtained, and to each target subgraph
As being synthesized.
The image processing method based on multiple image that the application first aspect embodiment proposes, it is original by obtaining multiframe
Image, and cutting processing is carried out to each frame original image, multiple original sub images corresponding with each frame original image are obtained, and
By in multiframe original image, the original sub image in same position is transmitted to corresponding image processor, using corresponding
Image processor processing be in same position original sub image, image processor include it is multiple, obtain at each image processor
Obtained target subgraph is managed, and each target subgraph is synthesized, realizes and piecemeal is carried out to each frame original image, for
The original sub image of different piecemeals calls the calculation resources of different images processor, can effectively improve night scene image taking speed, mention
Rise image processing efficiency.
In order to achieve the above objectives, the image processing apparatus based on multiple image that the application second aspect embodiment proposes,
It include: acquisition module, for obtaining multiframe original image；Cutting module carries out at cutting for the original image described in each frame
Reason, obtains multiple original sub images corresponding with original image described in each frame；Processing module is used for the multiframe original image
In, the original sub image in same position is transmitted to corresponding image processor, to use the corresponding image processor
The processing original sub image for being in same position, described image processor includes multiple；Synthesis module, for obtaining each institute
The target subgraph that image processor is handled is stated, and each target subgraph is synthesized.
The image processing apparatus based on multiple image that the application second aspect embodiment proposes, it is original by obtaining multiframe
Image, and cutting processing is carried out to each frame original image, multiple original sub images corresponding with each frame original image are obtained, and
By in multiframe original image, the original sub image in same position is transmitted to corresponding image processor, using corresponding
Image processor processing be in same position original sub image, image processor include it is multiple, obtain at each image processor
Obtained target subgraph is managed, and each target subgraph is synthesized, realizes and piecemeal is carried out to each frame original image, for
The original sub image of different piecemeals calls the calculation resources of different images processor, can effectively improve night scene image taking speed, mention
Rise image processing efficiency.
In order to achieve the above objectives, the electronic equipment that the application third aspect embodiment proposes, comprising: central processing unit, figure
Shape processor, digital signal processor and neural network processor, memory and storage are on a memory and can be in centre
The computer program run on reason device, described image sensor, the graphics processor, the digital signal processor and institute
It states neural network processor to be electrically connected with the central processing unit respectively, when the central processing unit executes described program, realize
The image processing method based on multiple image that the application first aspect embodiment proposes.
The electronic equipment that the application third aspect embodiment proposes, by obtaining multiframe original image, and it is original to each frame
Image carries out cutting processing, obtains multiple original sub images corresponding with each frame original image, and by multiframe original image,
Original sub image in same position is transmitted to corresponding image processor, to be in using corresponding image processor
The original sub image of same position, image processor include it is multiple, obtain the target subgraph that each image processor is handled,
And each target subgraph is synthesized, it realizes and piecemeal is carried out to each frame original image, for the original subpicture of different piecemeals
Calculation resources as calling different images processor, can effectively improve night scene image taking speed, promote image processing efficiency.
In order to achieve the above objectives, the computer readable storage medium that the application fourth aspect embodiment proposes, stores thereon
There is computer program, is realized when which is executed by processor if the proposition of the application first aspect embodiment is based on multiple image
Image processing method.
The computer readable storage medium that the application fourth aspect embodiment proposes, by obtaining multiframe original image, and
Cutting processing is carried out to each frame original image, obtains multiple original sub images corresponding with each frame original image, and by multiframe
In original image, the original sub image in same position is transmitted to corresponding image processor, using at corresponding image
Manage device processing be in same position original sub image, image processor include it is multiple, obtain each image processor and handle to obtain
Target subgraph, and each target subgraph is synthesized, realizes and piecemeal is carried out to each frame original image, for difference point
The original sub image of block calls the calculation resources of different images processor, can effectively improve night scene image taking speed, promotes image
Treatment effeciency.
The additional aspect of the application and advantage will be set forth in part in the description, and will partially become from the following description
It obtains obviously, or recognized by the practice of the application.
Detailed description of the invention
The application is above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments
Obviously and it is readily appreciated that, in which:
Fig. 1 is the flow diagram for the image processing method based on multiple image that one embodiment of the application proposes；
Fig. 2 is the flow diagram for the image processing method based on multiple image that another embodiment of the application proposes；
Fig. 3 is the structural schematic diagram for the image processing apparatus based on multiple image that one embodiment of the application proposes；
Fig. 4 is the structural schematic diagram for the image processing apparatus based on multiple image that another embodiment of the application proposes；
Fig. 5 is the structural schematic diagram of a kind of electronic equipment provided by the embodiments of the present application.
Specific embodiment
Embodiments herein is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, and is only used for explaining the application, and should not be understood as the limitation to the application.On the contrary, this
The embodiment of application includes all changes fallen within the scope of the spiritual and intension of attached claims, modification and is equal
Object.
For in the related technology, super multiple image processing is complex, wherein may relate to multiframe alignment, movement inspection
Multiple links, the processing such as survey, time-space domain noise reduction, high dynamic synthesis, tone mapping take a long time, the not high skill of image processing efficiency
Art problem provides a kind of image processing method based on multiple image in the embodiment of the present application, by obtaining multiframe original image,
And cutting processing is carried out to each frame original image, multiple original sub images corresponding with each frame original image are obtained, and will be more
In frame original image, the original sub image in same position is transmitted to corresponding image processor, to use corresponding image
Processor processing be in same position original sub image, image processor include it is multiple, obtain each image processor and handle
The target subgraph arrived, and each target subgraph is synthesized, it realizes and piecemeal is carried out to each frame original image, for difference
The original sub image of piecemeal calls the calculation resources of different images processor, can effectively improve night scene image taking speed, promotes figure
As treatment effeciency.
Fig. 1 is the flow diagram for the image processing method based on multiple image that one embodiment of the application proposes.
The image processing method based on multiple image of the embodiment of the present application is applied to electronic equipment, which can
Think that there is the hardware of various operating systems, imaging device to set for mobile phone, tablet computer, personal digital assistant, wearable device etc.
It is standby.
This method comprises:
S101: multiframe original image is obtained.
Wherein, original image for example can not do any processing by what the imaging sensor of electronic equipment collected
RAW format-pattern, with no restriction to this.
Wherein, RAW format-pattern is exactly that the light signal captured is converted the original of digital signal by imaging sensor
Image.RAW format-pattern has recorded the raw information of digital camera sensor, while having recorded one caused by camera shooting
A little metadata, such as the setting of sensitivity, shutter speed, f-number, white balance.
It can be by the preview image of acquisition present filming scene, to determine whether present filming scene belongs to night scene field
Scape.Since ambient brightness value is different under different scenes, preview image content is not also identical, can be according to present filming scene preview
The ambient brightness value in the image content of image and each region after determining that present filming scene belongs to night scene scene, starts night scene
Screening-mode obtains multiframe original image under different light exposures.
For example, the image content of preview image includes night sky perhaps each area of night scene lamp source etc. or preview image
Ambient brightness value meets the Luminance Distribution characteristic of image under night scene environment in domain, that is, can determine that present filming scene belongs to night scene field
Scape.
Since when night scene is shot, the limitation of the environmental factors such as light intensity in photographed scene, electronic equipment is in shooting figure
When picture, if acquisition single frames original image can not be preferably simultaneously with respect in the highlight regions such as light in night scene and night scene
Low bright area.
Therefore, electronic equipment can synthesize for image by shooting multiframe original image, can be additionally used for choosing
Clearly image carries out compound imaging to picture.
In order to respect to the low bright area in the highlight regions such as light in night scene and night scene, can control electricity simultaneously
The imaging sensor of sub- equipment is under different light exposures, the multiframe original image that shoots.Such as: it is shot using low light exposure
To use high light exposure shooting to low clear zone blur-free imaging to highlight bar blur-free imaging.
In the embodiment of the present application, the original image of acquisition n frame can be, wherein n is the natural number more than or equal to 2.
S102: cutting processing is carried out to each frame original image, obtains multiple original subpictures corresponding with each frame original image
Picture.
Relative in the related technology, being that the original image of multiframe is sequentially inputted corresponding image all in accordance with image procossing
Processor is handled, and is to carry out cutting to each frame original image to handle to obtain and each frame original image pair in the embodiment of the present application
The multiple original sub images answered, if being directed to some image processing step, image processor A and image processor B are able to carry out
The image processing step can then call image processor A and image processor B simultaneously, start two parallel processing routines,
So that image processor A and image processor B execute the image processing step respectively, n frame of the processing in same position is original
Subgraph realizes the efficiency for promoting image procossing with this.
It, can be using area slit mode be based on, by each frame when carrying out cutting processing to image in the embodiment of the present application
Original image cutting processing is that area is identical or the original sub image of different preset quantity, and preset quantity is, for example, 10,
That is, be directed to each frame original image, by its cutting it is that area is identical or different ten pieces of image-regions, alternatively, can be with
It is the original sub image of preset quantity by each frame original image cutting, so that original after cutting by the way of based on feature
Subgraph 1 has feature A, and original sub image 2 has feature B, and so on, feature A is that the brightness value of image 1 is greater than luminance threshold
Value, feature B are that the brightness value of image 2 is less than luminance threshold, with no restriction to this.
In the embodiment of the present application, the cutting of above-mentioned example can be handled in logic write-in script file, carry out night scene
When taking pictures, while obtaining multiframe original image, it can be loaded directly into and execute the script file, to each frame original image
Cutting processing is carried out, multiple original sub images corresponding with each frame original image are obtained.
In the embodiment of the present application, identical cutting processing logic is based on to each frame original image and carries out cutting processing, energy
It is enough synthesized convenient for subsequent image, ensures synthetic effect while promoting image processing efficiency.
For example, if multiframe original image includes original image A, original image B, original image C, respectively to original image
A, original image B, original image C carry out cutting processing, obtain original sub image A1 corresponding with original image A, original subpicture
As A2, original sub image A3, original sub image A4, original sub image B1 corresponding with original image B, original sub image B2, original
Beginning subgraph B3, original sub image B4, original sub image C1 corresponding with original image C, original sub image C2, original sub image
C3, original sub image C4.
It is understood that being carried out at cutting due to being based on identical cutting processing logic for each frame original image
Reason, then in above-mentioned example, original sub image A1, original sub image B1, original sub image C1 are respectively in respectively affiliated original graph
As in position having the same, original sub image A2, original sub image B2, original sub image C2 respectively respectively belonging to it is original
Position having the same in image, original sub image A3, original sub image B3, original sub image C3 are respectively in respectively affiliated original
Position having the same in beginning image, original sub image A4, original sub image B4, original sub image C4 respectively respectively belonging to
Position having the same in original image.
The embodiment of the present application carries out cutting processing during specific execute, to each frame original image, obtains and each frame
The corresponding multiple original sub images of original image, so that adjacent original sub image has in corresponding multiple original sub images
Overlapping image region.
Wherein, the area ratio value of the overlapping image region and original sub image can be between preset threshold range, in advance
If threshold range can be preset by the factory program of electronic equipment, alternatively, can also be by user according to image processing requirements
It is set, can have obvious line of demarcation after capable of effectively avoiding segmented areas from synthesizing.
Preset threshold range is, for example, 5%~10%.
S103: by multiframe original image, the original sub image in same position is transmitted to corresponding image processor,
To be in the original sub image of same position using the processing of corresponding image processor, image processor includes multiple.
Optionally, image processor includes: central processing unit, graphics processor, digital signal processor and nerve net
Network processor, corresponding image processor are one in multiple images processor, and the original sub image in same position is right
Identical image processor is answered, the corresponding different or identical image processor of the original sub image in different location.
Wherein, different image processors executes different or identical image processing step.
Optionally, in some embodiments, before obtaining multiframe original image, further includes:
S201: all images processing step required for carrying out image procossing is determined.
Optionally, image processing step includes the steps that following two at least: multiframe is aligned noise reduction, synthesis high dynamic range
The step of the step of the step of the step of image, artificial intelligence noise reduction, image is converted and image encode.
S202: calculation resources parameter required for executing each image processing step is determined.
Wherein, calculation resources parameter is, for example, operation time required for executing each image processing step, occupied deposits
Space, quantity of the script called etc. are stored up, with no restriction to this.
S203: according to calculation resources parameter, in conjunction with the operational performance parameter of each image processor, for each image processing step
Configure corresponding image processor.
During specific execute, calculation resources parameter required for executing each image processing step can be determined, and
Analytic operation time biggish image processing step, and corresponding multiple image processor is distributed for it, to carry out image
When processing, multiple images processor can be called to handle the image processing step simultaneously, pass through analytic operation time biggish figure
As processing step, and corresponding multiple image processor is distributed for it, it being capable of promotion arithmetic speed to a greater extent.
Wherein, operational performance parameter is used to describe the operational performance of each image processor, and operational performance parameter is for example, each
Operation time, memory space, computing load situation of image processor etc., with no restriction to this.
As an example, it is assumed that image processing step is the step of multiframe is aligned noise reduction, synthesis high dynamic range images
The step of, then large nuber of images processing data can be primarily based on, analysis executes the required operation of the step of multiframe is aligned noise reduction
Time, occupied memory space, the script called quantity, and analyze execution synthesis high dynamic range images the step of institute
The quantity of the operation time, occupied memory space, the script called that need.
Then, the step of determining in multiple images processor, multiframe alignment noise reduction can be performed simultaneously and synthesis high dynamic
The central processing unit of the step of range image, graphics processor, that is, central processing unit can be performed simultaneously multiframe alignment noise reduction
The step of the step of step and synthesis high dynamic range images, graphics processor can be performed simultaneously multiframe alignment noise reduction and synthesis
The step of high dynamic range images, determines the operational performance parameter of central processing unit, graphics processor respectively.
Then, in conjunction with required calculation resources parameter and operational performance parameter, match for the step of multiframe alignment noise reduction
Corresponding image processor (central processing unit, graphics processor) is set, configures and corresponds to for the step of synthesis high dynamic range images
Image processor (central processing unit, graphics processor), can precisely quickly determine out and cutting treated original son
The image processor of images match ensures collaboration treatment effect.
During specific execute, by multiframe original image, the original sub image in same position is transmitted to
Before corresponding image processor, determine present image processing step, it is determining at the matched image of present image processing step
Manage device and as the first image processor, the first image processor, at least two in multiple images processor；From the first figure
As determining corresponding image processor in processor.
Wherein, present image processing step, to be currently image processing step to be executed, present image processing step
For any of all images processing step.
For example, if present image processing step is the step of multiframe is aligned noise reduction, the step of being aligned noise reduction with multiframe
The image processor matched is central processing unit, graphics processor, and the matched central processing unit, graphics processor can be referred to as
First image processor.
As an example, after determining that the first above-mentioned image processor is central processing unit, graphics processor,
Original sub image A1, original sub image B1, original sub image C1 can be transmitted to central processing unit, to original sub image
A1, original sub image B1, original sub image C1 execute the step of multiframe alignment noise reduction, and by original sub image A2, original subpicture
As B2, original sub image C2 are transmitted to graphics processor, to original sub image A2, original sub image B2, original sub image C2
The step of executing multiframe alignment noise reduction then, can be by original sub image if central processing unit has the calculation resources of redundancy
A3, original sub image B3, original sub image C3 are transmitted to central processing unit, if graphics processor has the calculation resources of redundancy,
Then original sub image A3, original sub image B3, original sub image C3 can be transmitted to graphics processor, to execute multiframe alignment
The step of noise reduction, with no restriction to this.
S104: the target subgraph that each image processor is handled is obtained, and each target subgraph is synthesized.
Wherein, the image that each image processor processing is obtained in the original sub image of same position, can be referred to as mesh
Subgraph is marked, understandable to be based on above-mentioned statement, the quantity of target subgraph and each frame original image are corresponding multiple
The quantity of original sub image is identical.
As an example, original sub image A1, original sub image B1, original sub image C1 are transmitted to center above-mentioned
Processor, with the step of to original sub image A1, original sub image B1, original sub image C1 execution multiframe alignment noise reduction, and incite somebody to action
Original sub image A2, original sub image B2, original sub image C2 are transmitted to graphics processor, to original sub image A2, original
After subgraph B2, original sub image C2 execute the step of multiframe alignment noise reduction, reads central processing unit and execute multiframe alignment drop
The target subgraph A1 that the step of making an uproar obtains reads the target subgraph that the step of graphics processor executes multiframe alignment noise reduction obtains
As A2 then synthesizes target subgraph A1 and target subgraph A2.
In some embodiments, during synthesis, if target subgraph A1 and target subgraph A2 be it is adjacent, consider
It may have certain overlapping image region to therebetween, then overlapping image region can be weighted, and weighting
Target subgraph A1 and target subgraph A2 are synthesized afterwards, there is obvious line of demarcation to avoid the image after synthesis, promoted
Synthetic effect.
It, can be with each image processor of real-time monitoring while carrying out cutting processing to image in other embodiments
Loading condition, according to the loading condition of specific image processor, dynamic adjusts the size of image cutting processing region, guarantees point
Block handles tasks synchronization processing and completes, the waiting time between reduction task.
In the present embodiment, by obtain multiframe original image, and to each frame original image carry out cutting processing, obtain with respectively
The corresponding multiple original sub images of frame original image, and by multiframe original image, the original sub image in same position
It is transmitted to corresponding image processor, to be in the original sub image of same position, figure using the processing of corresponding image processor
As processor include it is multiple, obtain the target subgraph that each image processor is handled, and close to each target subgraph
At realizing and carry out piecemeal to each frame original image, call different images processor for the original sub image of different piecemeals
Calculation resources can effectively improve night scene image taking speed, promote image processing efficiency.
Fig. 3 is the structural schematic diagram for the image processing apparatus based on multiple image that one embodiment of the application proposes.
Referring to Fig. 3, which includes:
Module 301 is obtained, for obtaining multiframe original image；
Cutting module 302 obtains corresponding more with each frame original image for carrying out cutting processing to each frame original image
A original sub image；
Processing module 303, for by multiframe original image, the original sub image in same position to be transmitted to corresponding
Image processor, to be in the original sub image of same position using the processing of corresponding image processor, image processor includes
It is multiple；
Synthesis module 304, the target subgraph handled for obtaining each image processor, and to each target subgraph
It is synthesized.
Optionally, in some embodiments, image processor includes: central processing unit, graphics processor, Digital Signal Processing
Device and neural network processor, corresponding image processor is one in multiple images processor, in same position
Original sub image, corresponding identical image processor, the corresponding different or identical figure of the original sub image in different location
As processor.
Optionally, in some embodiments, referring to fig. 4, further includes:
Determining module 305 is in identical bits for determining present image processing step, and by multiframe original image
The original sub image set is transmitted to before corresponding image processor, the determining and matched image procossing of present image processing step
Device and as the first image processor, the first image processor is at least two in multiple images processor, and from first
In image processor, corresponding image processor is determined.
Optionally, in some embodiments, referring to fig. 4, further includes:
Configuration module 306 for determining all images processing step required for carrying out image procossing, and determines that execution is each
Calculation resources parameter required for image processing step, and according to calculation resources parameter, in conjunction with the operation of each image processor
Performance parameter configures corresponding image processor for each image processing step.
Optionally, in some embodiments, image processing step includes following two at least:
Multiframe is aligned the step of the step of the step of noise reduction, synthesis high dynamic range images, artificial intelligence noise reduction, and image turns
The step of the step of changing and image encode.
Optionally, in some embodiments, cutting module 302 is specifically used for:
Cutting processing is carried out to each frame original image, multiple original sub images corresponding with each frame original image is obtained, makes
It obtains in corresponding multiple original sub images, adjacent original sub image has overlapping image region.
It should be noted that the aforementioned explanation to the image processing method embodiment based on multiple image is also applied for
The image processing apparatus 300 based on multiple image of the embodiment, details are not described herein again.
In the present embodiment, by obtain multiframe original image, and to each frame original image carry out cutting processing, obtain with respectively
The corresponding multiple original sub images of frame original image, and by multiframe original image, the original sub image in same position
It is transmitted to corresponding image processor, to be in the original sub image of same position, figure using the processing of corresponding image processor
As processor include it is multiple, obtain the target subgraph that each image processor is handled, and close to each target subgraph
At realizing and carry out piecemeal to each frame original image, call different images processor for the original sub image of different piecemeals
Calculation resources can effectively improve night scene image taking speed, promote image processing efficiency.
In order to realize above-described embodiment, the application also proposes a kind of electronic equipment 200, is that the application is real referring to Fig. 5, Fig. 5
Apply the structural schematic diagram of a kind of electronic equipment of example offer, comprising: central processing unit 210, graphics processor 220, digital signal
Processor 230 and neural network processor 240, memory 250 and are stored on memory 250 and can be in central processing unit
The computer program run on 210, imaging sensor 260, central processing unit 210, graphics processor 220, Digital Signal Processing
Device 230 and neural network processor 240 are electrically connected with central processing unit 210 respectively, when central processing unit 210 executes program,
Realize the above-mentioned image processing method based on multiple image.
In order to realize above-described embodiment, the embodiment of the present application also provides a kind of storage mediums, when the finger in storage medium
When order is executed by processor, so that processor executes following steps: obtaining multiframe original image；Each frame original image is cut
Divide processing, obtains multiple original sub images corresponding with each frame original image；By in multiframe original image, in same position
Original sub image is transmitted to corresponding image processor, to be in the original of same position using the processing of corresponding image processor
Subgraph, image processor include multiple；The target subgraph that each image processor is handled is obtained, and to each target subgraph
As being synthesized.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Instruct relevant hardware to complete by computer program, program can be stored in a non-volatile computer storage can be read
In medium, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, storage medium can be magnetic
Dish, CD, read-only memory (Read-Only Memory, ROM) etc..
Above embodiments only express the several embodiments of the application, and the description thereof is more specific and detailed, but can not
Therefore it is interpreted as the limitation to the application the scope of the patents.It should be pointed out that for those of ordinary skill in the art,
Without departing from the concept of this application, various modifications and improvements can be made, these belong to the protection model of the application
It encloses.Therefore, the scope of protection shall be subject to the appended claims for the application patent.
It should be noted that term " first ", " second " etc. are used for description purposes only in the description of the present application, without
It can be interpreted as indication or suggestion relative importance.In addition, in the description of the present application, unless otherwise indicated, the meaning of " multiple "
It is two or more.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the application includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be by the application
Embodiment person of ordinary skill in the field understood.
It should be appreciated that each section of the application can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.It, and in another embodiment, can be under well known in the art for example, if realized with hardware
Any one of column technology or their combination are realized: having a logic gates for realizing logic function to data-signal
Discrete logic, with suitable combinational logic gate circuit specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, can integrate in a processing module in each functional unit in each embodiment of the application
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is contained at least one embodiment or example of the application.In the present specification, schematic expression of the above terms are not
Centainly refer to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be any
One or more embodiment or examples in can be combined in any suitable manner.
Although embodiments herein has been shown and described above, it is to be understood that above-described embodiment is example
Property, it should not be understood as the limitation to the application, those skilled in the art within the scope of application can be to above-mentioned
Embodiment is changed, modifies, replacement and variant.
Claims (14)
1. a kind of image processing method based on multiple image, which is characterized in that the described method includes:
Obtain multiframe original image；
The original image described in each frame carries out cutting processing, obtains multiple original subpictures corresponding with original image described in each frame
Picture；
By in the multiframe original image, the original sub image in same position is transmitted to corresponding image processor, to adopt
With the corresponding image processor processing original sub image for being in same position, described image processor includes more
It is a；
The target subgraph that each described image processor is handled is obtained, and each target subgraph is synthesized.
2. the image processing method according to claim 1 based on multiple image, which is characterized in that described image processor
It include: central processing unit, graphics processor, digital signal processor and neural network processor, at the corresponding image
Managing device is one in multiple images processor, the original sub image in same position, corresponding identical image procossing
Device, the corresponding different or identical image processor of the original sub image in different location.
3. the image processing method according to claim 1 or 2 based on multiple image, which is characterized in that described to each
When original image described in frame carries out cutting processing, further includes:
Determine present image processing step；
It is described by the multiframe original image, the original sub image in same position be transmitted to corresponding image processor it
Before, comprising:
Determination is with the matched image processor of the present image processing step and as the first image processor, first figure
It is at least two in described multiple images processor as processor；
From the first image processor, the corresponding image processor is determined.
4. the image processing method according to claim 3 based on multiple image, which is characterized in that the acquisition multiframe is former
Before beginning image, further includes:
Determine all images processing step required for carrying out image procossing；
Determine calculation resources parameter required for executing each described image processing step；
It is handled according to the calculation resources parameter in conjunction with the operational performance parameter of each described image processor for each described image
Step configures corresponding image processor.
5. according to the described in any item image processing methods based on multiple image of claim 3-4, which is characterized in that the figure
As processing step includes following two at least:
Multiframe is aligned the step of the step of the step of noise reduction, synthesis high dynamic range images, artificial intelligence noise reduction, image conversion
The step of step and image encode.
6. the image processing method according to claim 1 based on multiple image, which is characterized in that described described in each frame
Original image carries out cutting processing, multiple original sub images corresponding with original image described in each frame is obtained, so that the correspondence
Multiple original sub images in, the adjacent original sub image have overlapping image region.
7. a kind of image processing apparatus based on multiple image, which is characterized in that described device includes:
Module is obtained, for obtaining multiframe original image；
Cutting module carries out cutting processing for the original image described in each frame, obtains corresponding with original image described in each frame
Multiple original sub images；
Processing module, for by the multiframe original image, the original sub image in same position to be transmitted to corresponding figure
As processor, using the corresponding image processor processing original sub image for being in same position, described image
Processor includes multiple；
Synthesis module, the target subgraph handled for obtaining each described image processor, and to each target subgraph
As being synthesized.
8. the image processing apparatus according to claim 7 based on multiple image, which is characterized in that described image processor
It include: central processing unit, graphics processor, digital signal processor and neural network processor, at the corresponding image
Managing device is one in multiple images processor, the original sub image in same position, corresponding identical image procossing
Device, the corresponding different or identical image processor of the original sub image in different location.
9. the image processing apparatus according to claim 7 or 8 based on multiple image, which is characterized in that further include:
Determining module is in identical bits in the multiframe original image for determining present image processing step, and described
The original sub image set is transmitted to before corresponding image processor, the determining and matched image of present image processing step
Processor and as the first image processor, the first image processor is at least two in described multiple images processor
It is a, and from the first image processor, determine the corresponding image processor.
10. the image processing apparatus according to claim 9 based on multiple image, which is characterized in that further include:
Configuration module for determining all images processing step required for carrying out image procossing, and determines and executes each figure
The calculation resources parameter as required for processing step, and according to the calculation resources parameter, in conjunction with each described image processor
Operational performance parameter, configure corresponding image processor for each described image processing step.
11. according to the described in any item image processing apparatus based on multiple image of claim 9-10, which is characterized in that described
Image processing step includes following two at least:
Multiframe is aligned the step of the step of the step of noise reduction, synthesis high dynamic range images, artificial intelligence noise reduction, image conversion
The step of step and image encode.
12. the image processing apparatus according to claim 7 based on multiple image, which is characterized in that the cutting module,
It is specifically used for:
The original image described in each frame carries out cutting processing, obtains multiple original subpictures corresponding with original image described in each frame
Picture, so that the adjacent original sub image has overlapping image region in corresponding multiple original sub images.
13. a kind of electronic equipment characterized by comprising central processing unit, graphics processor, digital signal processor and
Neural network processor, memory and storage are on a memory and the computer program that can run on central processing unit, described
Imaging sensor, the graphics processor, the digital signal processor and the neural network processor respectively with it is described
Central processing unit electrical connection when the central processing unit executes described program, realizes such as base as claimed in any one of claims 1 to 6
In the image processing method of multiple image.
14. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
Such as the image processing method as claimed in any one of claims 1 to 6 based on multiple image is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910509713.3A CN110264473B (en) | 2019-06-13 | 2019-06-13 | Image processing method and device based on multi-frame image and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910509713.3A CN110264473B (en) | 2019-06-13 | 2019-06-13 | Image processing method and device based on multi-frame image and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110264473A true CN110264473A (en) | 2019-09-20 |
| CN110264473B CN110264473B (en) | 2022-01-04 |
Family
ID=67917979
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910509713.3A Active CN110264473B (en) | 2019-06-13 | 2019-06-13 | Image processing method and device based on multi-frame image and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110264473B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111988525A (en) * | 2020-08-25 | 2020-11-24 | Oppo广东移动通信有限公司 | Image processing method and related device |
| CN112163985A (en) * | 2020-09-22 | 2021-01-01 | Oppo（重庆）智能科技有限公司 | Image processing method, image processing device, storage medium and electronic equipment |
| CN112991172A (en) * | 2021-03-08 | 2021-06-18 | Oppo广东移动通信有限公司 | Image processing method, image processing device, electronic equipment and storage medium |
| CN113132800A (en) * | 2021-04-14 | 2021-07-16 | Oppo广东移动通信有限公司 | Video processing method and device, video player, electronic equipment and readable medium |
| CN113256485A (en) * | 2021-05-21 | 2021-08-13 | 百果园技术(新加坡)有限公司 | Image stretching method, device, electronic equipment and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1889667A (en) * | 2006-07-26 | 2007-01-03 | 浙江大学 | Video frequency signal multi-processor parallel processing method |
| US20110032422A1 (en) * | 2008-06-05 | 2011-02-10 | Panasonic Corporation | Video processing system |
| CN102510448A (en) * | 2011-10-13 | 2012-06-20 | 苏州百滨电子科技有限公司 | Multiprocessor-embedded image acquisition and processing method and device |
| CN103201764A (en) * | 2010-11-12 | 2013-07-10 | 高通股份有限公司 | Parallel image processing using multiple processors |
| CN105933604A (en) * | 2016-05-20 | 2016-09-07 | 珠海市魅族科技有限公司 | Image acquisition method and terminal |
| CN105959559A (en) * | 2016-06-08 | 2016-09-21 | 维沃移动通信有限公司 | Night scene shooting method and mobile terminal |
| CN109218613A (en) * | 2018-09-18 | 2019-01-15 | Oppo广东移动通信有限公司 | High dynamic-range image synthesis method, device, terminal device and storage medium |
| CN109348089A (en) * | 2018-11-22 | 2019-02-15 | Oppo广东移动通信有限公司 | Night scene image processing method, device, electronic equipment and storage medium |
| CN109379535A (en) * | 2018-11-30 | 2019-02-22 | Oppo广东移动通信有限公司 | Image pickup method and device, electronic equipment, computer readable storage medium |
| CN109756681A (en) * | 2019-01-30 | 2019-05-14 | Oppo广东移动通信有限公司 | Image composition method, device, electronic equipment and readable storage medium storing program for executing |
-
2019
- 2019-06-13 CN CN201910509713.3A patent/CN110264473B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1889667A (en) * | 2006-07-26 | 2007-01-03 | 浙江大学 | Video frequency signal multi-processor parallel processing method |
| US20110032422A1 (en) * | 2008-06-05 | 2011-02-10 | Panasonic Corporation | Video processing system |
| CN103201764A (en) * | 2010-11-12 | 2013-07-10 | 高通股份有限公司 | Parallel image processing using multiple processors |
| CN102510448A (en) * | 2011-10-13 | 2012-06-20 | 苏州百滨电子科技有限公司 | Multiprocessor-embedded image acquisition and processing method and device |
| CN105933604A (en) * | 2016-05-20 | 2016-09-07 | 珠海市魅族科技有限公司 | Image acquisition method and terminal |
| CN105959559A (en) * | 2016-06-08 | 2016-09-21 | 维沃移动通信有限公司 | Night scene shooting method and mobile terminal |
| CN109218613A (en) * | 2018-09-18 | 2019-01-15 | Oppo广东移动通信有限公司 | High dynamic-range image synthesis method, device, terminal device and storage medium |
| CN109348089A (en) * | 2018-11-22 | 2019-02-15 | Oppo广东移动通信有限公司 | Night scene image processing method, device, electronic equipment and storage medium |
| CN109379535A (en) * | 2018-11-30 | 2019-02-22 | Oppo广东移动通信有限公司 | Image pickup method and device, electronic equipment, computer readable storage medium |
| CN109756681A (en) * | 2019-01-30 | 2019-05-14 | Oppo广东移动通信有限公司 | Image composition method, device, electronic equipment and readable storage medium storing program for executing |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111988525A (en) * | 2020-08-25 | 2020-11-24 | Oppo广东移动通信有限公司 | Image processing method and related device |
| CN112163985A (en) * | 2020-09-22 | 2021-01-01 | Oppo（重庆）智能科技有限公司 | Image processing method, image processing device, storage medium and electronic equipment |
| CN112163985B (en) * | 2020-09-22 | 2022-11-29 | Oppo（重庆）智能科技有限公司 | Image processing method, image processing device, storage medium and electronic equipment |
| CN112991172A (en) * | 2021-03-08 | 2021-06-18 | Oppo广东移动通信有限公司 | Image processing method, image processing device, electronic equipment and storage medium |
| CN113132800A (en) * | 2021-04-14 | 2021-07-16 | Oppo广东移动通信有限公司 | Video processing method and device, video player, electronic equipment and readable medium |
| CN113256485A (en) * | 2021-05-21 | 2021-08-13 | 百果园技术(新加坡)有限公司 | Image stretching method, device, electronic equipment and storage medium |
| CN113256485B (en) * | 2021-05-21 | 2024-01-30 | 百果园技术(新加坡)有限公司 | Image stretching method, device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110264473B (en) | 2022-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110264473A (en) | Image processing method, device and electronic equipment based on multiple image | |
| Lapray et al. | HDR-ARtiSt: an adaptive real-time smart camera for high dynamic range imaging | |
| CN109040609A (en) | Exposal control method, device and electronic equipment | |
| CN104869320A (en) | Electronic device and control method of the same | |
| CN109068067A (en) | Exposal control method, device and electronic equipment | |
| CN107197370A (en) | The scene detection method and device of a kind of live video | |
| CN105874776A (en) | Image processing apparatus and method | |
| CN108449555A (en) | Image interfusion method and system | |
| CN109194855A (en) | Imaging method, device and electronic equipment | |
| CN113452969B (en) | Image processing method and device | |
| CN113411498B (en) | Image shooting method, mobile terminal and storage medium | |
| CN113038002B (en) | Image processing method and device, electronic equipment and readable storage medium | |
| CN112700368A (en) | Image processing method and device and electronic equipment | |
| CN110838088B (en) | Multi-frame noise reduction method and device based on deep learning and terminal equipment | |
| CN112258380A (en) | Image processing method, device, equipment and storage medium | |
| CN116744120A (en) | Image processing method and electronic device | |
| CN115086567A (en) | Time-delay shooting method and device | |
| CN115633262A (en) | Image processing method and electronic device | |
| CN110956063A (en) | Image processing method, device, equipment and storage medium | |
| CN110191324B (en) | Image processing method, image processing apparatus, server, and storage medium | |
| CN110267011B (en) | Image processing method, image processing apparatus, server, and storage medium | |
| CN108492266A (en) | Image processing method, device, storage medium and electronic equipment | |
| CN110267009A (en) | Image processing method, device, server and storage medium | |
| KR20150025602A (en) | Method for recoding video and an electronic device thereof | |
| CN111491101B (en) | Image processor, image processing method, photographing device, and electronic apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |