CN108769523A - Image processing method and device, electronic equipment, computer readable storage medium - Google Patents
Image processing method and device, electronic equipment, computer readable storage medium Download PDFInfo
- Publication number
- CN108769523A CN108769523A CN201810579249.0A CN201810579249A CN108769523A CN 108769523 A CN108769523 A CN 108769523A CN 201810579249 A CN201810579249 A CN 201810579249A CN 108769523 A CN108769523 A CN 108769523A
- Authority
- CN
- China
- Prior art keywords
- image
- frequency component
- frequency
- spectrograms
- spectrogram
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Abstract
This application involves a kind of image processing methods and device, electronic equipment, computer readable storage medium.The method includes：Obtain multiple consistent images of content of shooting；The frequency component of each image is extracted respectively；The frequency component is each frequency content in the first spectrogram that every image is obtained through frequency-domain transform；By obtaining multiple images that obtain that treated of identical frequency component between multiple described images；The identical frequency component is that coordinate position is identical and the identical frequency content of frequency amplitude between each the first spectrogram.Above-mentioned image processing method, multiple images for the moire fringes that can be eliminated.
Description
Technical field
This application involves technical field of image processing, more particularly to a kind of image processing method and device, electronic equipment,
Computer readable storage medium.
Background technology
When being shot to object using electronic equipment, if subject, there are the texture of fine groove, the image shot is past
Toward the color fringe that will appear as ripples, here it is moire fringes.For example, shooting the display picture of display screen by electronic equipment
When face, the image that electronic equipment takes often will appear moire fringes.There are moire fringes can seriously affect shooting in shooting image
Effect.
Invention content
A kind of image processing method of the embodiment of the present application offer and device, electronic equipment, computer readable storage medium, can
To eliminate the moire fringes in image.
A kind of image processing method, including：
Obtain multiple consistent images of content of shooting；
The frequency component of each image is extracted respectively；The frequency component is first that every image is obtained through frequency-domain transform
Each frequency content in spectrogram；
By obtaining multiple images that obtain that treated of identical frequency component between multiple described images；The identical frequency
Rate component is that coordinate position is identical and the identical frequency content of frequency amplitude between each the first spectrogram.
A kind of image processing apparatus, including：
Acquisition module, multiple images consistent for obtaining content of shooting；
Extraction module, the frequency component for extracting each image respectively；The frequency component is every image through frequency domain
Convert each frequency content in the first obtained spectrogram；
Processing module, for pass through obtain multiple described images between identical frequency component multiple figures that obtain that treated
Picture；The identical frequency component be between each the first spectrogram coordinate position is identical and the identical frequency of frequency amplitude at
Point.
A kind of electronic equipment, including memory and processor store computer program, the calculating in the memory
When machine program is executed by the processor so that the processor executes the step of image processing method as described above.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
The step of row image processing method as described above.
Image processing method and device, electronic equipment, computer readable storage medium in the embodiment of the present application, obtain
Multiple consistent images of content of shooting, are extracted the frequency component of multiple images respectively.Moire fringes in each image are by more
Open what frequency component different in image generated, by retaining identical frequency component in each image and removing different frequencies
Component can remove the frequency component that moire fringes are generated in each image, and then multiple images for the moire fringes that are eliminated.
Description of the drawings
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with
Obtain other attached drawings according to these attached drawings.
Fig. 1 is the configuration diagram of electronic equipment in one embodiment；
Fig. 2 is the flow chart of image processing method in one embodiment；
Fig. 3 is the flow chart of image processing method in another embodiment；
Fig. 4 is the structure diagram of image processing apparatus in one embodiment；
Fig. 5 is the schematic diagram of image processing circuit in one embodiment.
Specific implementation mode
It is with reference to the accompanying drawings and embodiments, right in order to make the object, technical solution and advantage of the application be more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, and
It is not used in restriction the application.
Image processing method in the embodiment of the present application is applied in electronic equipment shown in FIG. 1.Electronics as shown in Figure 1
Equipment includes processor, memory and the network interface connected by system bus.Wherein, the processor for provide calculate and
Control ability supports the operation of entire electronic equipment.Memory for storing data, program etc., at least one is stored on memory
A computer program, the computer program can be executed by processor, to realize that is provided in the embodiment of the present application is suitable for electronics
The application processing method of equipment.Memory may include magnetic disc, CD, read-only memory (Read-Only Memory, ROM)
Equal non-volatile memory mediums or random access memory (Random-Access-Memory, RAM) etc..For example, in a reality
It applies in example, memory includes non-volatile memory medium and built-in storage.Non-volatile memory medium be stored with operating system and
Computer program.The computer program can be performed by processor, for realization one kind that each embodiment is provided below
Image processing method.Built-in storage provides the fortune of cache for the operating system computer program in non-volatile memory medium
Row environment.Network interface can be Ethernet card or wireless network card etc., for being communicated with external electronic equipment.The electronics
Equipment can be mobile phone, tablet computer or personal digital assistant or Wearable etc..
Fig. 2 is the flow chart of image processing method in one embodiment.Image processing method in the present embodiment, with operation
It is described for electronic equipment in Fig. 1.As shown in Fig. 2, image processing method includes step 202 to step 206.
Step 202, multiple consistent images of content of shooting are obtained.
Specifically, when by electronic equipment to being shot there are the object of fine groove texture, electronic equipment can pass through
The continuous shooting function of the machine is set, consistent content of shooting is repeatedly shot, and obtains multiple consistent images of content of shooting.
Step 204, the frequency component of each image is extracted respectively；Every image of frequency component is obtained through frequency-domain transform
Each frequency content in first spectrogram.
For step 204, the frequency component of each image is to characterize the index of grey scale change severe degree in each image.
Such as：The desert of large area is the slow region of a piece of grey scale change, each frequency component values in corresponding image in the picture
It is all relatively low；And be the violent region of a piece of grey scale change in the picture for the violent fringe region of earth's surface attribute transformation, it is corresponding
Image in each frequency component values it is all higher.
Step 206, by obtaining multiple images that obtain that treated of identical frequency component between multiple images；Identical frequency
Rate component is that coordinate position is identical and the identical frequency content of frequency amplitude between each the first spectrogram.
For above-mentioned steps, the frequency component that electronic equipment can extract each image respectively is compared.If multiple figures
Image as being all not moire fringes, then the corresponding frequency component of each image can be identical；If exist containing mole
The image of line, then the moire fringes in image are generated by frequency component different in multiple images.It will be different in each image
Frequency component removal can eliminate moire fringes in each image, for example, image 1, image 2 and image 3 contain four respectively
The frequency component of frequency component, image 1 is ABCDEF, and the frequency component of image 2 is ABCDE1The frequency component of F, image 3 is
ABCDEF1, then identical frequency component ABCD in image 1, image 2 and image 3 can be remained, remaining different frequency
Component removes.The moire fringes generated by these different frequency components are eliminated while removing different frequency components.
Above-described embodiment obtains multiple consistent images of content of shooting, is extracted the frequency component of multiple images respectively.
Wherein, the moire fringes in each image are generated by frequency component different in multiple images, by retaining in each image
Identical frequency component simultaneously removes different frequency components, can remove the frequency component that moire fringes are generated in each image, into
And multiple images for the moire fringes that are eliminated, improve picture quality.
In one embodiment, for step 206, multiple images for the moire fringes that can be eliminated by following steps：
The frequency component of more each the first spectrogram；By retaining identical frequency component in each the first spectrogram, and remove each
Frequency component different in the first spectrogram is opened, multiple second spectrograms are obtained；Each the second spectrogram is subjected to frequency domain inversion
It changes, multiple images that obtain that treated.
In the above-described embodiments, fast Fourier transform (Fast Fourier Transformation, FFT) can be passed through
Obtain the first spectrogram, fast Fourier transform is the characteristics such as odd, even, empty, real according to discrete fourier transform, to discrete Fourier
The algorithm of transformation is improved acquisition.Two-dimensional spectrogram can be obtained by fast Fourier transform, it, can be in spectrogram
Frequency is represented with horizontal axis, phase is represented with the longitudinal axis, the amplitude of frequency is represented with the brightness value each put.If same in each spectrogram
The brightness value of the point of one position is identical, then the corresponding frequency component of point is identical.
Above-described embodiment obtains multiple consistent images of content of shooting, is extracted the frequency component of multiple images respectively.
By retaining identical frequency component in each image and removing different frequency components, it can remove to generate in each image and rub
The frequency component of your line, and then multiple images for the moire fringes that are eliminated.
In one embodiment, in the moire fringes in removing multiple images, following steps can also be performed：Retain each
Identical frequency component in first spectrogram；Frequency component different in each the first spectrogram is extracted, it is all by being retained in
The number occurred in first spectrogram is more than the different frequency components of specified threshold, and removes and occur in all first spectrograms
Number be less than or equal to specified threshold different frequency components, obtain multiple second spectrograms.
In the above-described embodiments, can occur by counting each different frequency component in the first all spectrograms
Number determine whether to retain the different frequency component.It can also be by counting first containing some different frequency component
Spectrogram ratio shared in the first all spectrograms determines whether to retain the different frequency component；For example, when containing
First spectrogram of different frequency component ratio shared in the first all spectrograms is more than the threshold value specified, then protects
Otherwise the frequency component for staying this in the first spectrogram different removes the different frequency component of this in the first spectrogram.Wherein, it specifies
Threshold value can be adjusted correspondingly according to different application scenarios.
It is illustrated with reference to example, for example, set threshold value as 50%, the first spectrogram 1, the first spectrogram 2 and first
Spectrogram 3 contains four frequency components respectively, and the frequency component of the first spectrogram 1 is ABCDEF, the frequency component of the first spectrogram 2
For ABCDE1The frequency component of F, the first spectrogram 3 are ABCDEF1, can be first by the first spectrogram 1, the first spectrogram 2 and first
Identical frequency component ABCD is remained in spectrogram 3, then by each different frequency component in all first spectrograms (E,
E1, F and F1) counted.The first spectrogram ratio of the E containing frequency component is about 67% in all first spectrograms, is more than pre-
If threshold value 50%, retain 1 and the first frequency component E in spectrogram 3 in the first spectrogram；Containing frequency in all first spectrograms
Rate component E1The first spectrogram ratio be about 33%, be no more than preset threshold value 50%, remove the frequency in 2 in the first spectrogram
Rate component E1；The first spectrogram ratio of the F containing frequency component is about 67% in all first spectrograms, is more than preset threshold value
50%, retain 1 and the first frequency component F in spectrogram 3 in the first spectrogram；F containing frequency component in all first spectrograms1
The first spectrogram ratio be about 33%, be no more than preset threshold value 50%, remove the frequency component in 2 in the first spectrogram
F1.The frequency component of finally obtained first spectrogram 1 is ABCDEF, and the frequency component of the first spectrogram 2 is ABCDF, first
The frequency component of spectrogram 3 is ABCDE.
Above-described embodiment, by being counted to each different frequency component in all first spectrograms, when containing this not
When first spectrogram of same frequency component ratio shared in the first all spectrograms is more than specified threshold value, it is retained in
The number occurred in all first spectrograms is more than the different frequency components of specified threshold, and otherwise removing should in the first spectrogram
Different frequency components avoids not being the frequency point for generating moire fringes when removing frequency components different in the first spectrogram
Amount removal, can preferably ensure the clarity of image.
In one embodiment, for step 202, multiple consistent figures of content of shooting can be obtained by following steps
Picture：Obtain the adjacent time interval shot twice；If time interval is less than predetermined interval threshold value, judge adjacent to shoot twice
The corresponding content of shooting of image is consistent；Obtain multiple consistent images of content of shooting.
The machine can be shot by high dynamic range when being shot and obtain multiple consistent images of content of shooting.It is high
Dynamic range (High-Dynamic Range, HDR) is shot for carrying out repeatedly multiple photographs of shooting acquisition to identical content of shooting
Piece, then it is sequentially increased the time for exposure of these photos.In the moire fringes for eliminating multiple images that high dynamic range shooting obtains
Later, multiple images can be synthesized using the optimized image details of different time for exposure corresponding different images,
It can preferably reflect the visual effect in true environment.
Specifically, predetermined interval threshold value can be 100ms, in high dynamic range shooting process, if adjacent shoot twice
Time interval be less than 100ms, then can be determined that the corresponding content of shooting of the adjacent image shot twice is consistent.Wherein, it obtains
To the number of the consistent image of content of shooting can be 3 or more.
Judge whether the adjacent content of shooting shot twice is consistent by the adjacent time interval shot twice, Ke Yibao
It is that multiple images consistent to content of shooting are further processed to demonstrate,prove electronic equipment, retains multiple consistent figures of content of shooting
Identical frequency component and different frequency components is removed as in, the frequency point for generating moire fringes in each image can be removed
Amount, and then multiple images for the moire fringes that are eliminated.
In one embodiment, before the step 204, can down-sampled processing be carried out to each image respectively.
It in the above-described embodiments, can before carrying out frequency-domain transform respectively to each image and obtaining each the first spectrogram
It is down-sampled first to be carried out respectively to each image.It can also be up-sampled after frequency domain inverse transformation simultaneously, be eliminated and rub
Multiple images of your line.It needs to sample image data before frequency-domain transform, down-sampled is to reduce image data samples
The sample rate of process carries out frequency domain by the down-sampled size that can reduce pending image data to the image after down-sampled
Transformation can greatly improve the conversion efficiency of frequency-domain transform.Up-sampling is the sample rate for increasing image by interpolation, in frequency domain
After transformation to image data up-sample can by the size of demosaicing image data, avoid it is down-sampled caused by scheme
As resolution ratio is too low.
Above-described embodiment, before multiple images are carried out with frequency-domain transform respectively and obtains multiple spectrograms, first respectively to more
Image carries out down-sampled, then is up-sampled after frequency domain inverse transformation, multiple images for the moire fringes that are eliminated, due into
Row frequency-domain transform is down-sampled image, considerably reduces the data volume for needing frequency-domain transform so that the removal of moire fringes
More quickly.
In one embodiment, before the step 204, can reject in each the first spectrogram Frequency and Amplitude be more than it is default
The frequency component of amplitude threshold.
The frequency component that ambient noise generates is usually high fdrequency component, and the frequency component of image moire fringes is typically also high frequency
Component by predetermined amplitude threshold value, can filter out the high fdrequency component of ambient noise generation in advance and generate the high frequency of moire fringes
Component.Predetermined amplitude threshold value can be determined according to the highest frequency component in spectrogram, such as predetermined amplitude threshold value can be frequency
The 80% of highest frequency component in the spectrogram in domain filters out 80% information that frequency is more than highest frequency component.
When existing simultaneously one or more higher frequency components for generating moire fringes, and the high frequency in multiple first spectrograms
When frequency component is higher than predetermined amplitude threshold value, the higher frequency component is preferentially filtered out by the way that amplitude threshold is arranged, can be removed
More higher frequency components for generating moire fringes, keep the probability that moire fringes occurs in finally obtained image lower, can also go
Except the high fdrequency component that more ambient noises generate, make interference smaller of the image by ambient noise.
In one embodiment, following steps can also be performed after multiple images that obtain that treated in electronic equipment：
Optimum exposure region in multiple images after extraction process respectively；It will treated multiple figures according to each optimum exposure region
As one image of synthesis is exported.
For above-described embodiment, can be obtained according to the camera response curve (Camera Response Curve) of setting
Take the best pixel value of each pixel in the image of final output.Camera response curve can reflect the image pair that shooting obtains
Mapping relations between the image data answered and actual scene illumination (Scene Radiance), according to response curve just can determine that
Actual scene illumination.The best pixel value of each pixel of image can be got according to actual scene illumination.It is determining
After the best pixel value of each pixel, can by the pixel value of each pixel in the image of each Zhang Butong depth of exposure and
Above-mentioned best pixel value is compared, can be by value differences less than where the pixel of preset value differences threshold value
Region is set as optimum exposure region.
Above-described embodiment, electronic equipment extracts the optimum exposure region in the image of each elimination moire fringes, further according to each
A optimum exposure region exports multiple images one image of synthesis, can preferably reflect the image of each image-region
Details improves the visual effect of the image of final output.
A kind of image processing method is provided in one embodiment, as shown in figure 3, including the following steps：
Step 302, the adjacent time interval shot twice in high dynamic range shooting process is obtained.Wherein electronic equipment can
To obtain the image of the machine shooting, the image of other equipment can also be obtained, the source of image is not limited herein.
Step 304, multiple images that time interval meets preset condition are obtained.
Step 306, the frequency component of each image is extracted.Can multiple images be carried out to frequency-domain transform respectively and obtain multiple
First spectrogram, and obtain the frequency component in each the first spectrogram.
Step 308, the frequency component that Frequency and Amplitude in each the first spectrogram is more than predetermined amplitude threshold value is rejected.
Step 310, the frequency component for generating moire fringes, multiple images for the moire fringes that are eliminated are rejected.More each
The frequency component of one spectrogram retains identical frequency component in each the first spectrogram, extracts in each the first spectrogram not
Same frequency component is more than the different frequencies point of specified threshold by being retained in the number occurred in all first spectrograms
Amount, and the different frequency components that the number occurred in all first spectrograms is less than or equal to specified threshold are removed, it obtains more
The second spectrogram, then will each the second spectrogram progress frequency domain inverse transformation, multiple images that obtain that treated.
Step 312, each is extracted respectively treated the optimum exposure region in image, according to each optimum exposure region
Multiple images one image of synthesis is exported.
Above-described embodiment obtains multiple images of high dynamic range shooting, is extracted the frequency point of multiple images respectively
Amount, and the frequency component that Frequency and Amplitude is more than amplitude threshold is eliminated, more higher frequencies for generating moire fringes can be removed
Component keeps the probability that moire fringes occurs in finally obtained image lower, can also remove the high frequency that more ambient noises generate
Component makes interference smaller of the image by ambient noise.By retaining identical frequency component in each image and removing different
Frequency component can remove the frequency component that moire fringes are generated in each image, and then multiple images for the moire fringes that are eliminated.
The optimum exposure region in the image of each elimination moire fringes is extracted, synthesizes multiple images further according to each optimum exposure region
One image is exported, and can preferably be reflected the image detail of each image-region, be improved regarding for the image of final output
Feel effect.
It should be understood that although each step in the flow chart of Fig. 2 and 3 is shown successively according to the instruction of arrow,
Be these steps it is not that the inevitable sequence indicated according to arrow executes successively.Unless expressly stating otherwise herein, these steps
There is no stringent sequences to limit for rapid execution, these steps can execute in other order.Moreover, in Fig. 2 and 3 at least
A part of step may include that either these sub-steps of multiple stages or stage are not necessarily in same a period of time to multiple sub-steps
Quarter executes completion, but can execute at different times, the execution in these sub-steps or stage be sequentially also not necessarily according to
Secondary progress, but can either the sub-step of other steps or at least part in stage in turn or replace with other steps
Ground executes.
Fig. 4 is the structure diagram of the image processing apparatus of one embodiment.As shown in figure 4, the image procossing of the present embodiment
Device includes：
Acquisition module 402, multiple images consistent for obtaining content of shooting；
Extraction module 404, the frequency component for extracting each image respectively；Frequency component is that every image becomes through frequency domain
Each frequency content in the first spectrogram got in return；
Processing module 406, for pass through obtain multiple images between identical frequency component multiple images that obtain that treated；
Identical frequency component is that coordinate position is identical and the identical frequency content of frequency amplitude between each the first spectrogram.
Above-mentioned image processing apparatus obtains multiple consistent images of content of shooting, is extracted the frequency of multiple images respectively
Rate component.Moire fringes in each image are generated by frequency component different in multiple images, by retaining each image
In identical frequency component and remove different frequency components, the frequency component that moire fringes are generated in each image can be removed,
And then multiple images for the moire fringes that are eliminated.
In one embodiment, processing module 406 is additionally operable to the frequency component of more each the first spectrogram；Pass through reservation
Identical frequency component in each the first spectrogram, and frequency component different in each the first spectrogram is removed, obtain multiple
Second spectrogram；Each the second spectrogram is subjected to frequency domain inverse transformation, multiple images that obtain that treated.
In one embodiment, processing module 406 is additionally operable to retain identical frequency component in each the first spectrogram；It carries
Frequency component different in each the first spectrogram is taken, by being retained in the number occurred in all first spectrograms more than specified
The different frequency components of threshold value, and remove the difference that the number occurred in all first spectrograms is less than or equal to specified threshold
Frequency component, obtain multiple second spectrograms.
In one embodiment, acquisition module 402 is additionally operable to obtain the adjacent time interval shot twice；If time interval
Less than predetermined interval threshold value, then judge that the corresponding content of shooting of the adjacent image shot twice is consistent；It is consistent to obtain content of shooting
Multiple images.
In one embodiment, image processing apparatus further includes down-sampled module, and down-sampled module is used for respectively to each
Image carries out down-sampled processing.
In one embodiment, image processing apparatus further includes rejecting module, rejects module for rejecting each first frequency
Frequency and Amplitude is more than the frequency component of predetermined amplitude threshold value in spectrogram.
Further include exposure area extraction module and image synthesis unit in the image processing apparatus of one embodiment,
In, exposure area extraction module is for the optimum exposure region in multiple images after distinguishing extraction process；Image synthesis unit
For according to each optimum exposure region, by treated, multiple images one image of synthesis to export.
The division of modules is only used for for example, in other embodiments, can will scheme in above-mentioned image processing apparatus
As moire fringes cancellation element is divided into different modules as required, with complete above-mentioned image moire fringes cancellation element whole or
Partial function.
Specific about image moire fringes cancellation element limits the restriction that may refer to above for image processing method,
Details are not described herein.Modules in above-mentioned image moire fringes cancellation element can fully or partially through software, hardware and its
It combines to realize.Above-mentioned each module can be embedded in or in the form of hardware independently of in the processor in computer equipment, can also
It is stored in a software form in the memory in computer equipment, in order to which processor calls the above modules of execution corresponding
Operation.
The realization of modules in the image moire fringes cancellation element provided in the embodiment of the present application can be computer journey
The form of sequence.The computer program can be run in terminal or server.The program module that the computer program is constituted can store
On the memory of terminal or server.When the computer program is executed by processor, realize described in the embodiment of the present application
The step of method.
The embodiment of the present application also provides a kind of computer readable storage mediums.One or more is executable comprising computer
The non-volatile computer readable storage medium storing program for executing of instruction, when computer executable instructions are executed by one or more processors,
So that processor executes following steps：
Obtain multiple consistent images of content of shooting；
The frequency component of each image is extracted respectively；Frequency component is the first frequency spectrum that every image is obtained through frequency-domain transform
Each frequency content in figure；
By obtaining multiple images that obtain that treated of identical frequency component between multiple images；Identical frequency component is
Coordinate position is identical between each the first spectrogram and the identical frequency content of frequency amplitude.
In one embodiment, when computer executable instructions are executed by one or more processors, also so that processing
Device executes following steps：The frequency component of more each the first spectrogram；By retaining identical frequency in each the first spectrogram
Rate component, and frequency component different in each the first spectrogram is removed, obtain multiple second spectrograms；By each the second frequency spectrum
Figure carries out frequency domain inverse transformation, multiple images that obtain that treated.
In one embodiment, when computer executable instructions are executed by one or more processors, also so that processing
Device executes following steps：Retain identical frequency component in each the first spectrogram；It extracts different in each the first spectrogram
Frequency component is more than the different frequency components of specified threshold by being retained in the number occurred in all first spectrograms, and
Remove the different frequency components that the number that occurs in all first spectrograms is less than or equal to specified threshold, obtain multiple second
Spectrogram.
In one embodiment, when computer executable instructions are executed by one or more processors, also so that processing
Device executes following steps：Obtain the adjacent time interval shot twice；If time interval is less than predetermined interval threshold value, phase is judged
The corresponding content of shooting of image that neighbour shoots twice is consistent；Obtain multiple consistent images of content of shooting.
In one embodiment, when computer executable instructions are executed by one or more processors, also so that processing
Device executes following steps：Down-sampled processing is carried out to each image respectively.
In one embodiment, when computer executable instructions are executed by one or more processors, also so that processing
Device executes following steps：Reject the frequency component that Frequency and Amplitude in each the first spectrogram is more than predetermined amplitude threshold value.
In one embodiment, when computer executable instructions are executed by one or more processors, also so that processing
Device executes following steps：Optimum exposure region in multiple images after extraction process respectively；According to each optimum exposure region
By treated, multiple images one image of synthesis exports.
A kind of computer program product including instruction, when run on a computer so that computer executes following
Step：
Obtain multiple consistent images of content of shooting；
The frequency component of each image is extracted respectively；The frequency component is first that every image is obtained through frequency-domain transform
Each frequency content in spectrogram；
By obtaining multiple images that obtain that treated of identical frequency component between multiple described images；The identical frequency
Rate component is that coordinate position is identical and the identical frequency content of frequency amplitude between each the first spectrogram.
The embodiment of the present application also provides a kind of electronic equipment.Above-mentioned electronic equipment includes image processing circuit, at image
Managing circuit can utilize hardware and or software component to realize, it may include define ISP (Image Signal Processing, figure
As signal processing) the various processing units of pipeline.Fig. 5 is the schematic diagram of image processing circuit in one embodiment.Such as Fig. 5 institutes
Show, for purposes of illustration only, only showing the various aspects with the relevant image processing techniques of the embodiment of the present application.
As shown in figure 5, image processing circuit includes ISP processors 540 and control logic device 550.Imaging device 510 captures
Image data handled first by ISP processors 540, ISP processors 540 to image data analyzed with capture can be used for really
The image statistics of fixed and/or imaging device 510 one or more control parameters.Imaging device 510 may include thering is one
The camera of a or multiple lens 512 and imaging sensor 514.Imaging sensor 514 may include colour filter array (such as
Bayer filters), imaging sensor 514 can obtain the luminous intensity captured with each imaging pixel of imaging sensor 514 and wavelength
Information, and the one group of raw image data that can be handled by ISP processors 540 is provided.Sensor 520 (such as gyroscope) can be based on passing
The parameter (such as stabilization parameter) of the image procossing of acquisition is supplied to ISP processors 540 by 520 interface type of sensor.Sensor 520
Interface can utilize SMIA (Standard Mobile Imaging Architecture, Standard Mobile Imager framework) interface,
The combination of other serial or parallel camera interfaces or above-mentioned interface.
In addition, raw image data can be also sent to sensor 520 by imaging sensor 514, sensor 520 can be based on passing
520 interface type of sensor is supplied to ISP processors 540 or sensor 520 to deposit raw image data raw image data
It stores up in video memory 530.
ISP processors 540 handle raw image data pixel by pixel in various formats.For example, each image pixel can
Bit depth with 8,10,12 or 14 bits, ISP processors 540 can carry out raw image data at one or more images
Reason operation, statistical information of the collection about image data.Wherein, image processing operations can be by identical or different bit depth precision
It carries out.
ISP processors 540 can also receive image data from video memory 530.For example, 520 interface of sensor will be original
Image data is sent to video memory 530, and the raw image data in video memory 530 is available to ISP processors 540
It is for processing.Video memory 530 can be independent special in a part, storage device or electronic equipment for memory device
With memory, and it may include DMA (Direct Memory Access, direct direct memory access (DMA)) feature.
When receiving from 514 interface of imaging sensor or from 520 interface of sensor or from video memory 530
When raw image data, ISP processors 540 can carry out one or more image processing operations, such as time-domain filtering.Treated schemes
As data can be transmitted to video memory 530, to carry out other processing before shown.ISP processors 540 are from image
Memory 530 receives processing data, and processing data are carried out with the image in original domain and in RGB and YCbCr color spaces
Data processing.Treated that image data may be output to display 570 for ISP processors 540, so that user watches and/or by scheming
Shape engine or GPU (Graphics Processing Unit, graphics processor) are further processed.In addition, ISP processors 540
Output also can be transmitted to video memory 530, and display 570 can read image data from video memory 530.At one
In embodiment, video memory 530 can be configured as realizing one or more frame buffers.In addition, ISP processors 540 is defeated
Go out can be transmitted to encoder/decoder 560, so as to encoding/decoding image data.The image data of coding can be saved, and
It is decompressed before being shown in 570 equipment of display.Encoder/decoder 560 can be realized by CPU or GPU or coprocessor.
The statistical data that ISP processors 540 determine, which can be transmitted, gives control logic device Unit 550.For example, statistical data can wrap
Include the image sensings such as automatic exposure, automatic white balance, automatic focusing, flicker detection, black level compensation, 512 shadow correction of lens
514 statistical information of device.Control logic device 550 may include the processor and/or micro-control that execute one or more routines (such as firmware)
Device processed, one or more routines can determine the control parameter and ISP processors of imaging device 510 according to the statistical data of reception
540 control parameter.For example, the control parameter of imaging device 510 may include 520 control parameter of sensor (such as gain, exposure
The time of integration, stabilization parameter of control etc.), camera flash control parameter, 512 control parameter of lens (such as focus or zoom
With focal length) or these parameters combination.ISP control parameters may include for automatic white balance and color adjustment (for example, in RGB
During processing) 512 shadow correction parameter of gain level and color correction matrix and lens.
It is the step of realizing image processing method with image processing techniques in Fig. 5 below：
Obtain multiple consistent images of content of shooting；
The frequency component of each image is extracted respectively；Frequency component is the first frequency spectrum that every image is obtained through frequency-domain transform
Each frequency content in figure；
By obtaining multiple images that obtain that treated of identical frequency component between multiple images；Identical frequency component is
Coordinate position is identical between each the first spectrogram and the identical frequency content of frequency amplitude.
In one embodiment, following steps can also be realized：The frequency component of more each the first spectrogram；Pass through guarantor
Identical frequency component in each the first spectrogram is stayed, and removes frequency component different in each the first spectrogram, is obtained more
Open the second spectrogram；Each the second spectrogram is subjected to frequency domain inverse transformation, multiple images that obtain that treated.
In one embodiment, following steps can also be realized：Retain identical frequency component in each the first spectrogram；
Frequency component different in each the first spectrogram is extracted, is more than finger by being retained in the number occurred in all first spectrograms
Determine the different frequency components of threshold value, and removes the number occurred in all first spectrograms and be less than or equal to specified threshold not
Same frequency component, obtains multiple second spectrograms.
In one embodiment, following steps can also be realized：Obtain the adjacent time interval shot twice；If between the time
Every less than predetermined interval threshold value, then judging that the corresponding content of shooting of the adjacent image shot twice is consistent；Obtain content of shooting one
Multiple images caused.
In one embodiment, following steps can also be realized：Down-sampled processing is carried out to each image respectively.
In one embodiment, following steps can also be realized：Frequency and Amplitude in each the first spectrogram is rejected to be more than in advance
If the frequency component of amplitude threshold.
In one embodiment, following steps can also be realized：Best exposure in multiple images after extraction process respectively
Light region；According to each optimum exposure region, by treated, multiple images one image of synthesis exports.
Used in this application may include to any reference of memory, storage, database or other media is non-volatile
And/or volatile memory.Suitable nonvolatile memory may include read-only memory (ROM), programming ROM (PROM),
Electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include arbitrary access
Memory (RAM), it is used as external cache.By way of illustration and not limitation, RAM is available in many forms, such as
It is static RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDR SDRAM), enhanced
SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM).
Above example only expresses the several embodiments of the application, the description thereof is more specific and detailed, but can not
Therefore it is interpreted as the limitation to the application the scope of the claims.It should be pointed out that for those of ordinary skill in the art,
Under the premise of not departing from the application design, various modifications and improvements can be made, these belong to the protection model of the application
It encloses.Therefore, the protection domain of the application patent should be determined by the appended claims.
Claims (10)
1. a kind of image processing method, which is characterized in that including：
Obtain multiple consistent images of content of shooting；
The frequency component of each image is extracted respectively；The frequency component is the first frequency spectrum that every image is obtained through frequency-domain transform
Each frequency content in figure；
By obtaining multiple images that obtain that treated of identical frequency component between multiple described images；The identical frequency point
Amount is coordinate position between each the first spectrogram is identical and the identical frequency content of frequency amplitude.
2. image processing method according to claim 1, which is characterized in that phase between described multiple described images by acquisition
With frequency component multiple images that obtain that treated, including：
Compare the frequency component of the first spectrograms of each Zhang Suoshu；
By retaining identical frequency component in each the first spectrograms of Zhang Suoshu, and remove different in the first spectrograms of each Zhang Suoshu
Frequency component, obtain multiple second spectrograms；
The second spectrograms of each Zhang Suoshu are subjected to frequency domain inverse transformation, multiple images that obtain that treated.
3. image processing method according to claim 2, which is characterized in that described by retaining each the first frequency spectrums of Zhang Suoshu
Identical frequency component in figure, and frequency component different in the first spectrograms of each Zhang Suoshu is removed, obtain multiple second frequency spectrums
Figure, including：
Retain identical frequency component in the first spectrograms of each Zhang Suoshu；
Frequency component different in the first spectrograms of each Zhang Suoshu is extracted, by being retained in time occurred in all first spectrograms
Number is more than the different frequency components of specified threshold, and removes the number occurred in all first spectrograms less than or equal to specified
The different frequency components of threshold value obtain multiple second spectrograms.
4. image processing method according to any one of claim 1 to 3, which is characterized in that the acquisition content of shooting
Multiple consistent images, including：
Obtain the adjacent time interval shot twice；
If the time interval is less than predetermined interval threshold value, the corresponding content of shooting of the adjacent image shot twice one is judged
It causes；
Obtain multiple consistent images of content of shooting.
5. image processing method according to any one of claim 1 to 3, which is characterized in that described to extract each respectively
Before the frequency component of image, including：
Down-sampled processing is carried out to each image respectively.
6. image processing method according to any one of claim 1 to 3, which is characterized in that described to extract each respectively
After the frequency component of image, including：
Reject the frequency component that Frequency and Amplitude in the first spectrograms of each Zhang Suoshu is more than predetermined amplitude threshold value.
7. image processing method according to any one of claim 1 to 3, which is characterized in that the method further includes：
Optimum exposure region in multiple images after extraction process respectively；
According to each optimum exposure region, by treated, multiple images one image of synthesis exports.
8. a kind of image processing apparatus, which is characterized in that including：
Acquisition module, multiple images consistent for obtaining content of shooting；
Extraction module, the frequency component for extracting each image respectively；The frequency component is every image through frequency-domain transform
Each frequency content in the first obtained spectrogram；
Processing module, for pass through obtain multiple described images between identical frequency component multiple images that obtain that treated；Institute
It is that coordinate position is identical and the identical frequency content of frequency amplitude between each the first spectrogram to state identical frequency component.
9. a kind of electronic equipment, including memory and processor, computer program, the computer are stored in the memory
When program is executed by the processor so that the processor executes the image procossing as described in any one of claim 1 to 7
The step of method.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of image processing method as described in any one of claim 1 to 7 is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810579249.0A CN108769523B (en) | 2018-06-07 | 2018-06-07 | Image processing method and device, electronic equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810579249.0A CN108769523B (en) | 2018-06-07 | 2018-06-07 | Image processing method and device, electronic equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108769523A true CN108769523A (en) | 2018-11-06 |
| CN108769523B CN108769523B (en) | 2020-06-30 |
Family
ID=63999245
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810579249.0A Active CN108769523B (en) | 2018-06-07 | 2018-06-07 | Image processing method and device, electronic equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108769523B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110300325A (en) * | 2019-08-06 | 2019-10-01 | 北京字节跳动网络技术有限公司 | Processing method, device, electronic equipment and the computer readable storage medium of video |
| CN110661969A (en) * | 2019-08-19 | 2020-01-07 | 厦门快商通科技股份有限公司 | Image acquisition method and device for display screen, electronic equipment and medium |
| CN111062922A (en) * | 2019-12-14 | 2020-04-24 | 创新奇智(北京)科技有限公司 | Method and system for judging copied image and electronic equipment |
| CN111311511A (en) * | 2020-01-22 | 2020-06-19 | 凌云光技术集团有限责任公司 | Moire pattern removing method and device |
| CN111798380A (en) * | 2019-04-09 | 2020-10-20 | Tcl集团股份有限公司 | Image processing method, image processing device and terminal equipment |
| CN112351205A (en) * | 2020-10-28 | 2021-02-09 | 维沃移动通信有限公司 | Shooting control method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1894169A2 (en) * | 2005-06-23 | 2008-03-05 | SDU Identification B.V. | Identification card |
| CN104010174A (en) * | 2009-10-13 | 2014-08-27 | 佳能株式会社 | Image processing device and image processing method |
| CN107424123A (en) * | 2017-03-29 | 2017-12-01 | 北京粉笔未来科技有限公司 | A kind of moire fringes minimizing technology and device |
| CN107749953A (en) * | 2017-11-17 | 2018-03-02 | 嘉兴学院 | A kind of double camera image based on binocular lens tube increases frequency device and control method |
-
2018
- 2018-06-07 CN CN201810579249.0A patent/CN108769523B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1894169A2 (en) * | 2005-06-23 | 2008-03-05 | SDU Identification B.V. | Identification card |
| CN104010174A (en) * | 2009-10-13 | 2014-08-27 | 佳能株式会社 | Image processing device and image processing method |
| CN107424123A (en) * | 2017-03-29 | 2017-12-01 | 北京粉笔未来科技有限公司 | A kind of moire fringes minimizing technology and device |
| CN107749953A (en) * | 2017-11-17 | 2018-03-02 | 嘉兴学院 | A kind of double camera image based on binocular lens tube increases frequency device and control method |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111798380A (en) * | 2019-04-09 | 2020-10-20 | Tcl集团股份有限公司 | Image processing method, image processing device and terminal equipment |
| CN110300325A (en) * | 2019-08-06 | 2019-10-01 | 北京字节跳动网络技术有限公司 | Processing method, device, electronic equipment and the computer readable storage medium of video |
| CN110661969A (en) * | 2019-08-19 | 2020-01-07 | 厦门快商通科技股份有限公司 | Image acquisition method and device for display screen, electronic equipment and medium |
| CN110661969B (en) * | 2019-08-19 | 2021-09-10 | 厦门快商通科技股份有限公司 | Image acquisition method and device for display screen, electronic equipment and medium |
| CN111062922A (en) * | 2019-12-14 | 2020-04-24 | 创新奇智(北京)科技有限公司 | Method and system for judging copied image and electronic equipment |
| CN111062922B (en) * | 2019-12-14 | 2024-02-20 | 创新奇智(北京)科技有限公司 | Method and system for distinguishing flip image and electronic equipment |
| CN111311511A (en) * | 2020-01-22 | 2020-06-19 | 凌云光技术集团有限责任公司 | Moire pattern removing method and device |
| CN111311511B (en) * | 2020-01-22 | 2023-08-29 | 凌云光技术股份有限公司 | Method and device for removing moire patterns |
| CN112351205A (en) * | 2020-10-28 | 2021-02-09 | 维沃移动通信有限公司 | Shooting control method and device |
| CN112351205B (en) * | 2020-10-28 | 2022-08-16 | 维沃移动通信有限公司 | Shooting control method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108769523B (en) | 2020-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108769523A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| JP6169186B2 (en) | Image processing method and apparatus, and photographing terminal | |
| US9094648B2 (en) | Tone mapping for low-light video frame enhancement | |
| CN110428366A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| CN110149482A (en) | Focusing method, device, electronic equipment and computer readable storage medium | |
| US9307212B2 (en) | Tone mapping for low-light video frame enhancement | |
| CN107395991B (en) | Image synthesis method, image synthesis device, computer-readable storage medium and computer equipment | |
| CN113170030A (en) | Correction of photographic underexposure using neural networks | |
| CN109978774B (en) | Denoising fusion method and device for multi-frame continuous equal exposure images | |
| CN103581556A (en) | Imaging device, image signal processing method, and program | |
| WO2010145910A1 (en) | Low-light video frame enhancement | |
| CN110473185A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| KR20200031169A (en) | Image processing method and device | |
| CN114586337B (en) | Video anti-shake optimization processing method and device and electronic equipment | |
| US20100092086A1 (en) | Method and system for image deblurring | |
| CN108322650A (en) | Video capture method and apparatus, electronic equipment, computer readable storage medium | |
| CN112150400B (en) | Image enhancement method and device and electronic equipment | |
| CN112651911B (en) | High dynamic range imaging generation method based on polarized image | |
| CN110942427A (en) | Image noise reduction method and device, equipment and storage medium | |
| CN110121031A (en) | Image-pickup method and device, electronic equipment, computer readable storage medium | |
| CN113632134A (en) | High dynamic range image generation using pre-combination denoising | |
| CN109410152A (en) | Imaging method and device, electronic equipment, computer readable storage medium | |
| CN108322648A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| CN110365897A (en) | Image correcting method and device, electronic equipment, computer readable storage medium | |
| WO2007071882A2 (en) | Method for providing data to a digital processing means |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |