CN105513021A

CN105513021A - Image noise reduction device and method

Info

Publication number: CN105513021A
Application number: CN201510864687.8A
Authority: CN
Inventors: 朱德志
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2015-11-27
Filing date: 2015-11-27
Publication date: 2016-04-20
Anticipated expiration: 2035-11-27
Also published as: WO2017088609A1; CN105513021B

Abstract

The invention discloses an image noise reduction device and method, and the method comprises the steps: obtaining a plurality of continuous frame images photographed by a terminal, enabling one of the frame images to serve as a sample image, and enabling the other frame images to serve as to-be-compared images; respectively obtaining the brightness values of R, G and B components of all pixels of the sample image, and the brightness values of R, G and B components of all pixels of the to-be-compared images; and obtaining the image after noise reduction according to the mean value of the brightness values of R components of all pixels of the sample image and the to-be-compared images, the mean value of the brightness values of G components of all pixels of the sample image and the to-be-compared images and the mean value of the brightness values of B components of all pixels of the sample image and the to-be-compared images if the difference between the brightness value of the R components of all pixels of the sample image and the to-be-compared images, the difference between the brightness value of the G components of all pixels of the sample image and the to-be-compared images and the difference between the brightness value of the B components of all pixels of the sample image and the to-be-compared images are within a first preset range. The method and device solve problems of large calculation burden and poor effect of noise reduction in a noise reduction process of the image, and also solve a problem that the details of the edge of the image are liable to be lost.

Description

Image denoising apparatus and method

Technical field

The present invention relates to image domains, particularly relate to a kind of image denoising apparatus and method.

Background technology

Along with the development of science and technology, the camera function of smart mobile phone is also more and more perfect.Relative to digital camera, smart mobile phone has the little characteristic such as to be easy to carry of volume.Therefore, increasing people more hankers after using taking photograph of intelligent mobile phone function to record the fine moment in life.Meanwhile, the image quality requirements taken smart mobile phone of people is also more and more higher.If but in the inadequate occasion of brightness, often can with some noises (brightness noise adds chrominance noise) in image out captured by smart mobile phone, and brightness is lower, noise is larger, due to the existence of noise, and the quality of serious effect diagram picture.

Tradition denoise algorithm has: average, intermediate value, gaussian filtering, bilateral filtering etc.Bilateral filtering can while removal noise, good preserving edge, but filter effect is not obvious when noise ratio is larger, and calculated amount is very large, when filter window increases, is difficult to accomplish real-time process; Average, intermediate value, Gauss can filtering noise preferably, but be easy to fuzzy fall edge, and along with the increase of filter window, be also difficult to accomplish real-time process.In addition can by the 3D (3Dimensions of band estimation, three-dimensional) denoising, in the process of 3D denoising using band estimation, first estimation will be carried out, and then carry out 3D denoising operation, and estimation needs very large calculated amount, and absolutely accuracy can not be ensured.

Summary of the invention

Fundamental purpose of the present invention is to propose a kind of image denoising apparatus and method, and be intended to solve prior art and carrying out image in the process of denoising, calculated amount is large, and denoising effect is poor, easily causes the technical matters that image edge details loses.

For achieving the above object, a kind of image denoising device provided by the invention, described device comprises:

First acquisition module, for obtaining the continuous print multiple image of terminal taking, using the wherein two field picture in described multiple image as sample image, remaining is as treating contrast images, and wherein, the form of described multiple image is RGB picture format;

Second acquisition module, for obtaining the brightness value of R, G and B component of described each pixel of sample image respectively, and the described brightness value treating R, G and B component of each pixel of contrast images;

Processing module, if for the brightness value of R, G and B component of described each pixel of sample image with the difference between the described brightness value treating R, G and B component that each pixel of contrast images is corresponding in the first preset range, then according to described in obtain the image after denoising until the mean value of the mean value of R component brightness value between contrast images and each pixel of described sample image, the mean value of G component intensities value and B component intensities value.

Alternatively, described image denoising device also comprises:

Computing module, for calculating the brightness value of R, G and B component of described each pixel of sample image and the difference between the described brightness value treating R, G and B component that each pixel of contrast images is corresponding respectively, using described difference as the first difference;

Judge module, for judging described first difference whether all not in the first preset range;

Choose module, if for described first difference all not in described first preset range, then choose the pixel of predetermined number in the preset range of described each pixel of sample image;

Described second acquisition module, also for obtaining the brightness value of R, G and B component of the pixel of described predetermined number;

Described computing module, also for R, G and B component of the brightness value and described sample image pixel that calculate R, G and B component of the pixel of described predetermined number respectively brightness value between difference, as the second difference;

Described processing module, if also for described second difference in the second preset range, then according to the image after the mean value of the mean value of R component brightness value, the mean value of G component intensities value and B component intensities value obtains denoising between the pixel of described described predetermined number corresponding in the second preset range and each pixel of described sample image.

Alternatively, described judge module, also for judging described second difference whether in the second preset range;

Described image denoising device also comprises discard module, if for described second difference not in described second preset range, then and the pixel of the described predetermined number corresponding to the second difference described in abandoning not in described second preset range.

Alternatively, described processing module comprises:

Acquiring unit, if for described second difference in described second preset range, then obtains the brightness value of R, G and B component of the pixel of the described predetermined number corresponding to the second difference in described second preset range;

First computing unit, for calculating the mean value of the mean value of R component brightness value, the mean value of G component intensities value and B component intensities value between the pixel of the described predetermined number obtained and each pixel of described sample image respectively;

First processing unit, for being reassembled into new pixel, to obtain the image after denoising by the mean value of the mean value of described R component brightness value, G component intensities value and the mean value of B component intensities value.

Alternatively, described processing module also comprises:

Determining unit, if for the brightness value of R, G and B component of described each pixel of sample image with the difference between the described brightness value treating R, G and B component that each pixel of contrast images is corresponding in the first preset range, then determine that described difference treats the brightness value of R, G and B component of each pixel of contrast images described in corresponding in described first preset range;

Second computing unit, for treating the mean value of the mean value of R component brightness value between contrast images and each pixel of described sample image, the mean value of G component intensities value and B component intensities value described in calculating respectively in described first preset range;

Second processing unit, for being reassembled into new pixel, to obtain the image after denoising by the mean value of the mean value of described R component brightness value, G component intensities value and the mean value of B component intensities value.

In addition, for achieving the above object, the present invention also provides a kind of image de-noising method said method comprising the steps of:

Obtain the continuous print multiple image of terminal taking, using the wherein two field picture in described multiple image as sample image, remaining is as treating contrast images, and wherein, the form of described multiple image is RGB picture format;

Obtain the brightness value of R, G and B component of described each pixel of sample image respectively, and the described brightness value treating R, G and B component of each pixel of contrast images;

If the difference between the brightness value of R, G and B component of described each pixel of sample image with the described brightness value treating R, G and B component that each pixel of contrast images is corresponding is in the first preset range, then obtain the image after denoising until the mean value of the mean value of R component brightness value between contrast images and each pixel of described sample image, the mean value of G component intensities value and B component intensities value described in basis.

Alternatively, the described brightness value obtaining R, G and B component of described each pixel of sample image respectively, and described treat the step of the brightness value of R, G and B component of each pixel of contrast images after, also comprise:

Calculate the brightness value of R, G and B component of described each pixel of sample image and the difference between the described brightness value treating R, G and B component that each pixel of contrast images is corresponding respectively, using described difference as the first difference;

Judge described first difference whether all not in the first preset range;

If described first difference all not in described first preset range, then chooses the pixel of predetermined number in the preset range of described each pixel of sample image;

Obtain the brightness value of R, G and B component of the pixel of described predetermined number;

Difference between the brightness value calculating the brightness value of R, G and B component of the pixel of described predetermined number and R, G and B component of described sample image pixel respectively, as the second difference;

If described second difference is in the second preset range, then according to the image after the mean value of the mean value of R component brightness value, the mean value of G component intensities value and B component intensities value obtains denoising between the pixel of described described predetermined number corresponding in the second preset range and each pixel of described sample image.

Alternatively, the difference between the described brightness value calculating the brightness value of R, G and B component of the pixel of described predetermined number and R, G and B component of described sample image pixel respectively, after the step as the second difference, also comprises:

Judge described second difference whether in the second preset range;

If described second difference is not in described second preset range, then the pixel of the described predetermined number corresponding to the second difference described in abandoning not in described second preset range.

Alternatively, if described second difference is in the second preset range, then comprise according to the step of the image after the mean value of the mean value of R component brightness value, the mean value of G component intensities value and B component intensities value obtains denoising between the pixel of described described predetermined number corresponding in the second preset range and each pixel of described sample image:

If described second difference is in described second preset range, then obtain the brightness value of R, G and B component of the pixel of the described predetermined number corresponding to the second difference in described second preset range;

Calculate the mean value of the mean value of R component brightness value, the mean value of G component intensities value and B component intensities value between the pixel of the described predetermined number obtained and each pixel of described sample image respectively;

The mean value of the mean value of described R component brightness value, G component intensities value and the mean value of B component intensities value are reassembled into new pixel, to obtain the image after denoising.

Alternatively, if the difference between the brightness value of R, G and B component of described each pixel of sample image with the described brightness value treating R, G and B component that each pixel of contrast images is corresponding is in the first preset range, then the step of the image described in basis after the mean value of the mean value of R component brightness value between contrast images and each pixel of described sample image, the mean value of G component intensities value and B component intensities value obtains denoising comprises:

If the difference between the brightness value of R, G and B component of described each pixel of sample image with the described brightness value treating R, G and B component that each pixel of contrast images is corresponding is in the first preset range, then determine the brightness value treating R, G and B component of each pixel of contrast images described in corresponding to described difference is in described first preset range;

Calculate mean value, the mean value of G component intensities value and the mean value of B component intensities value for the treatment of R component brightness value between contrast images and each pixel of described sample image described in described first preset range respectively;

The present invention is by obtaining the brightness value of R, G and B component of the sample image in terminal respectively, treat the brightness value of R, G and B component of each pixel of contrast images, when with described, the brightness value of R, G and B component of described sample image treats that difference corresponding between the brightness value of R, G and B component of each pixel of contrast images is in the first preset range, then obtain the image after denoising until the mean value of the mean value of R component brightness value between contrast images and each pixel of described sample image, the mean value of G component intensities value and B component intensities value described in basis.Have passed and respectively denoising is carried out to the brightness value of R, G and B component of image, again the brightness value of R, G and B component after denoising is reassembled into new pixel, described new pixel is obtained the image after denoising as the method for the pixel of image after denoising, avoid calculated amount in image denoising process large, denoising effect is poor, easily causes the problem that image edge details loses.

Accompanying drawing explanation

Fig. 1 is the hardware configuration schematic diagram realizing each embodiment of the present invention optional mobile terminal;

Fig. 2 is the electrical structure block diagram of camera in Fig. 1;

Fig. 3 is the high-level schematic functional block diagram of image denoising device first embodiment of the present invention;

Fig. 4 is the high-level schematic functional block diagram of image denoising device second embodiment of the present invention;

Fig. 5 is the schematic flow sheet of image de-noising method first embodiment of the present invention;

Fig. 6 is the schematic flow sheet of image de-noising method second embodiment of the present invention;

Fig. 7 is a kind of schematic diagram without denoising gained image in the embodiment of the present invention captured by terminal;

Fig. 8 is a kind of schematic diagram through denoising gained image in the embodiment of the present invention captured by terminal;

Fig. 9 is a kind of schematic diagram that in the embodiment of the present invention, terminal chooses the pixel of predetermined number in the preset range of sample image certain pixel total;

Figure 10 is a kind of schematic diagram of the brightness value of the brightness value of the R component of certain pixel of sample image in the embodiment of the present invention and the R component of predetermined number pixel.

The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further with reference to accompanying drawing.

Embodiment

Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.

The mobile terminal realizing each embodiment of the present invention is described referring now to accompanying drawing.In follow-up description, use the suffix of such as " module ", " parts " or " unit " for representing element only in order to be conducive to explanation of the present invention, itself is specific meaning not.Therefore, " module " and " parts " can mixedly use.

Mobile terminal can be implemented in a variety of manners.Such as, the terminal described in the present invention can comprise the such as mobile terminal of mobile phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP (portable media player), guider etc. and the fixed terminal of such as digital TV, desk-top computer etc.Below, suppose that terminal is mobile terminal.But it will be appreciated by those skilled in the art that except the element except being used in particular for mobile object, structure according to the embodiment of the present invention also can be applied to the terminal of fixed type.

Fig. 1 is the hardware configuration schematic diagram realizing each embodiment of the present invention optional mobile terminal.

Mobile terminal 100 can comprise A/V (audio/video) input block 120, user input unit 130, sensing cell 140, output unit 150, storer 160, interface unit 170, controller 180 and power supply unit 190 etc.Fig. 1 shows the mobile terminal with various assembly, it should be understood that, does not require to implement all assemblies illustrated.Can alternatively implement more or less assembly.Will be discussed in more detail below the element of mobile terminal.

A/V input block 120 is for audio reception or vision signal.A/V input block 120 can comprise camera 121 and microphone 122, and the view data of camera 121 to the static images obtained by image capture apparatus in Video Capture pattern or image capture mode or video processes.Picture frame after process may be displayed on display unit 151.Picture frame after camera 121 processes can be stored in storer 160 (or other storage medium), can provide two or more cameras 121 according to the structure of mobile terminal.Such acoustic processing can via microphones sound (voice data) in telephone calling model, logging mode, speech recognition mode etc. operational mode, and can be voice data by microphone 122.Audio frequency (voice) data after process can be converted to the formatted output that can be sent to mobile communication base station via mobile communication module 112 when telephone calling model.Microphone 122 can be implemented various types of noise and eliminate (or suppress) algorithm and receiving and sending to eliminate (or suppression) noise or interference that produce in the process of sound signal.

User input unit 130 can generate key input data to control the various operations of mobile terminal according to the order of user's input.User input unit 130 allows user to input various types of information, and keyboard, the young sheet of pot, touch pad (such as, detecting the touch-sensitive assembly of the change of the resistance, pressure, electric capacity etc. that cause owing to being touched), roller, rocking bar etc. can be comprised.Especially, when touch pad is superimposed upon on display unit 151 as a layer, touch-screen can be formed.

Sensing cell 140 detects the current state of mobile terminal 100, (such as, mobile terminal 100 open or close state), the position of mobile terminal 100, user for mobile terminal 100 contact (namely, touch input) presence or absence, the orientation of mobile terminal 100, the acceleration of mobile terminal 100 or speed is moved and direction etc., and generate order or the signal of the operation for controlling mobile terminal 100.Such as, when mobile terminal 100 is embodied as sliding-type mobile phone, sensing cell 140 can sense this sliding-type phone and open or close.In addition, whether whether sensing cell 140 can detect power supply unit 190 provides electric power or interface unit 170 to couple with external device (ED).

Interface unit 170 is used as at least one external device (ED) and is connected the interface that can pass through with mobile terminal 100.Such as, external device (ED) can comprise wired or wireless head-band earphone port, external power source (or battery charger) port, wired or wireless FPDP, memory card port, for connecting the port, audio frequency I/O (I/O) port, video i/o port, ear port etc. of the device with identification module.Identification module can be that storage uses the various information of mobile terminal 100 for authentication of users and can comprise subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) etc.In addition, the device (hereinafter referred to " recognition device ") with identification module can take the form of smart card, and therefore, recognition device can be connected with mobile terminal 100 via port or other coupling arrangement.Interface unit 170 may be used for receive from external device (ED) input (such as, data message, electric power etc.) and the input received be transferred to the one or more element in mobile terminal 100 or may be used for transmitting data between mobile terminal and external device (ED).

In addition, when mobile terminal 100 is connected with external base, interface unit 170 can be used as to allow by it electric power to be provided to the path of mobile terminal 100 from base or can be used as the path that allows to be transferred to mobile terminal by it from the various command signals of base input.The various command signal inputted from base or electric power can be used as and identify whether mobile terminal is arranged on the signal base exactly.Output unit 150 is constructed to provide output signal (such as, sound signal, vision signal, alarm signal, vibration signal etc.) with vision, audio frequency and/or tactile manner.Output unit 150 can comprise display unit 151.

Display unit 151 may be displayed on the information of process in mobile terminal 100.Such as, when mobile terminal 100 is in telephone calling model, display unit 151 can show with call or other communicate (such as, text messaging, multimedia file are downloaded etc.) be correlated with user interface (UI) or graphic user interface (GUI).When mobile terminal 100 is in video calling pattern or image capture mode, display unit 151 can the image of display capture and/or the image of reception, UI or GUI that video or image and correlation function are shown etc.

Meanwhile, when display unit 151 and touch pad as a layer superposed on one another to form touch-screen time, display unit 151 can be used as input media and output unit.Display unit 151 can comprise at least one in liquid crystal display (LCD), thin film transistor (TFT) LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc.Some in these displays can be constructed to transparence and watch from outside to allow user, and this can be called transparent display, and typical transparent display can be such as TOLED (transparent organic light emitting diode) display etc.According to the specific embodiment wanted, mobile terminal 100 can comprise two or more display units (or other display device), such as, mobile terminal can comprise outernal display unit (not shown) and inner display unit (not shown).Touch-screen can be used for detecting touch input pressure and touch input position and touch and inputs area.

Storer 160 software program that can store process and the control operation performed by controller 180 etc., or temporarily can store oneself through exporting the data (such as, telephone directory, message, still image, video etc.) that maybe will export.And, storer 160 can store about when touch be applied to touch-screen time the vibration of various modes that exports and the data of sound signal.

Storer 160 can comprise the storage medium of at least one type, described storage medium comprises flash memory, hard disk, multimedia card, card-type storer (such as, SD or DX storer etc.), random access storage device (RAM), static random-access memory (SRAM), ROM (read-only memory) (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD etc.And mobile terminal 100 can be connected the memory function of execute store 160 network storage device with by network cooperates.

Controller 180 controls the overall operation of mobile terminal usually.Such as, controller 180 performs the control relevant to voice call, data communication, video calling etc. and process.In addition, controller 180 can comprise the multi-media module 181 for reproducing (or playback) multi-medium data, and multi-media module 181 can be configured in controller 180, or can be configured to be separated with controller 180.Controller 180 can pattern recognition process, is identified as character or image so that input is drawn in the handwriting input performed on the touchscreen or picture.

Power supply unit 190 receives external power or internal power and provides each element of operation and the suitable electric power needed for assembly under the control of controller 180.

Various embodiment described herein can to use such as computer software, the computer-readable medium of hardware or its any combination implements.For hardware implementation, embodiment described herein can by using application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processor, controller, microcontroller, microprocessor, being designed at least one performed in the electronic unit of function described herein and implementing, in some cases, such embodiment can be implemented in controller 180.For implement software, the embodiment of such as process or function can be implemented with allowing the independent software module performing at least one function or operation.Software code can be implemented by the software application (or program) write with any suitable programming language, and software code can be stored in storer 160 and to be performed by controller 180.

So far, oneself is through the mobile terminal according to its functional description.Below, for the sake of brevity, by the slide type mobile terminal that describes in various types of mobile terminals of such as folded form, board-type, oscillating-type, slide type mobile terminal etc. exemplarily.Therefore, the present invention can be applied to the mobile terminal of any type, and is not limited to slide type mobile terminal.

With reference to the electrical structure block diagram that Fig. 2, Fig. 2 are camera in Fig. 1.

Phtographic lens 1211 is made up of the multiple optical lens for the formation of shot object image, is single-focus lens or zoom lens.Phtographic lens 1211 can move in the direction of the optical axis under the control of lens driver 1221, lens driver 1221 is according to the control signal from lens driving control circuit 1222, control the focal position of phtographic lens 1211, when zoom lens, also can control focal length.Lens driving control circuit 1222 carries out the drived control of lens driver 1221 according to the control command from microcomputer 1217.

Imaging apparatus 1212 is configured with near the position of the shot object image formed on the optical axis of phtographic lens 1211, by phtographic lens 1211.Imaging apparatus 1212 is for making a video recording to shot object image and obtaining image data.On imaging apparatus 1212 two dimension and be arranged in a matrix the photodiode forming each pixel.Each photodiode produces the opto-electronic conversion electric current corresponding with light income, and this opto-electronic conversion electric current carries out charge accumulation by the capacitor be connected with each photodiode.The front surface of each pixel is configured with the RGB color filter of Bayer arrangement.

Imaging apparatus 1212 is connected with imaging circuit 1213, this imaging circuit 1213 carries out charge accumulation and controls and picture signal reading control in imaging apparatus 1212, to the picture signal (analog picture signal) of this reading reduce reset noise after carry out wave shaping, and then carry out gain raising etc. to become suitable signal level.Imaging circuit 1213 is connected with A/D converter 1214, and this A/D converter 1214 pairs of analog picture signals carry out analog to digital conversion, to bus 1227 output digital image signal (hereinafter referred to as view data).

Bus 1227 is the transfer paths of the various data that the inside for being transmitted in camera reads or generates.Above-mentioned A/D converter 1214 is connected in bus 1227, be connected to image processor 1215, jpeg processor 1216, microcomputer 1217, SDRAM (SynchronousDynamicrandomaccessmemory in addition, SDRAM (Synchronous dynamic random access memory)) 1218, memory interface (hereinafter referred to as memory I/F) 1219, LCD (LiquidCrystalDisplay, liquid crystal display) driver 1220.

Image processor 1215 carries out OB to the view data of the output based on imaging apparatus 1212 and subtracts each other process, blank level adjustment, color matrix computing, gamma conversion, colour difference signal process, noise removal process, changes the various image procossing such as process, edge treated simultaneously.Jpeg processor 1216 by Imagery Data Recording in recording medium 1225 time, according to JPEG compress mode compression from SDRAM1218 read view data.In addition, jpeg processor 1216 carries out the decompression of jpeg image data in order to carry out image reproducing display.When decompressing, read the file that is recorded in recording medium 1225, implement decompression in jpeg processor 1216 after, the view data of decompression to be temporarily stored in SDRAM1218 and to show on LCD1226.H.264 in addition, in the present embodiment, what adopt as compression of images decompression mode is JPEG mode, but compressed and decompressed mode is not limited thereto, and certainly can adopt MPEG, TIFF, other the compressed and decompressed mode such as.

Microcomputer 1217 plays the function of the control part as this camera entirety, the unified various process sequences controlling camera.Microcomputer 1217 is connected to operating unit 1223 and flash memory 1224.

Operating unit 1223 includes but not limited to physical button or virtual key, this entity or virtual key can be the operational controls such as various load button and various enter keies such as power knob, key of taking pictures, edit key, dynamic image button, reproduction button, menu button, cross key, OK button, delete button, large buttons, detect the mode of operation of these operational controls.

Testing result is exported to microcomputer 1217.In addition, be provided with touch panel at the front surface of the LCD1226 as display, detect the touch location of user, this touch location is exported to microcomputer 1217.Microcomputer 1217, according to the testing result of the operating position from operating unit 1223, performs the various process sequences corresponding with the operation of user.

Flash memory 1224 stores the program of the various process sequences for performing microcomputer 1217.Microcomputer 1217 carries out the control of camera entirety according to this program.In addition, flash memory 1224 stores the various adjusted values of camera, and microcomputer 1217 reads adjusted value, carries out the control of camera according to this adjusted value.

SDRAM1218 is can the electricity volatile memory of rewriting for what carry out view data etc. temporarily storing.This SDRAM1218 temporarily stores the view data that exports from A/D converter 1214 and image processor 1215, jpeg processor 1216 etc., to have carried out the view data after processing.

Memory interface 1219 is connected with recording medium 1225, carries out the control by view data and the first-class data write recording medium 1225 of file be attached in view data and reading from recording medium 1225.Recording medium 1225 be such as can on camera main-body the recording medium such as memory card of disassembled and assembled freely, but being not limited thereto, also can be the hard disk etc. be built in camera main-body.

Lcd driver 1210 is connected with LCD1226, view data after being processed by image processor 1215 is stored in SDRAM1218, when needing display, read the view data that SDRAM1218 stores also to show on LCD1226, or the compressed view data of jpeg processor 1216 is stored in SDRAM1218, when needs show, jpeg processor 1216 reads the compressed view data of SDRAM1218, then decompresses, and the view data after decompressing is shown by LCD1226.

Image display is carried out at the back side that LCD1226 is configured in camera main-body.This LCD1226LCD), but be not limited thereto, also can adopt the various display panels (LCD1226) such as organic EL, but be not limited thereto, also can adopt the various display panels such as organic EL.

Based on the electrical structure schematic diagram of above-mentioned mobile terminal hardware configuration and camera, each embodiment of the inventive method is proposed.

The invention provides a kind of image denoising device.

With reference to the high-level schematic functional block diagram that Fig. 3, Fig. 3 are image denoising device first embodiment of the present invention.

In the present embodiment, described image denoising device comprises:

First acquisition module 10, for obtaining the continuous print multiple image of terminal taking, using the wherein two field picture in described multiple image as sample image, remaining is as treating contrast images, and wherein, the form of described multiple image is RGB picture format;

When terminal is when using built-in or external camera shooting, described terminal obtains continuous print multiple image in shooting process, using the wherein two field picture in described multiple image as sample image, using the image except described sample image as treating contrast images, described sample image and describedly treat that contrast images is RGB picture format.Described terminal includes but not limited to smart mobile phone, PC.In the present embodiment, described terminal is smart mobile phone, as described in smart mobile phone within it put camera carry out shooting image time, obtain continuous print four two field picture, using the first obtained two field picture as sample image, using obtained second, third and the 4th two field picture as treating contrast images.

Second acquisition module 20, for obtaining the brightness value of R, G and B component of described each pixel of sample image respectively, and the described brightness value treating R, G and B component of each pixel of contrast images;

When described terminal acquire described sample image and described until contrast images time, resolve described sample image and describedly treat contrast images, obtain the brightness value of the R component of each pixel in described sample image, the brightness value of G component and the brightness value of B component, and treat the brightness value of the brightness value of the R component of each pixel in contrast images, the brightness value of G component and B component described in obtaining.As when as described in smart mobile phone to acquire as described in sample image as described in a frame and three frames until contrast images time, resolve described sample image, obtain the brightness value of the R component of each pixel in described sample image, the brightness value of G component and the brightness value of B component; And resolve respectively described in three frames and treat contrast images, obtain the brightness value of the R component treating each pixel in contrast images described in the first frame, the brightness value of G component and the brightness value of B component; Obtain the brightness value of the R component treating each pixel in contrast images described in the second frame, the brightness value of G component and the brightness value of B component; Obtain the brightness value treating the brightness value of the R component of each pixel in contrast images, the brightness value of G component and B component described in the 3rd frame.

Processing module 30, if for the brightness value of R, G and B component of described each pixel of sample image with the difference between the described brightness value treating R, G and B component that each pixel of contrast images is corresponding in the first preset range, then according to described in obtain the image after denoising until the mean value of the mean value of R component brightness value between contrast images and each pixel of described sample image, the mean value of G component intensities value and B component intensities value.

Further, described processing module 30 comprises:

When described terminal obtains the brightness value of the brightness value of described sample image and the described R component until each pixel of contrast images, the brightness value of G component and B component, treat that the brightness value of the R component of each pixel of contrast images contrasts by corresponding and described for the brightness value of the R component of described each pixel of sample image, obtain the difference between the brightness value correspondence of the R component of described each pixel of sample image and the described brightness value treating the R component of each pixel of contrast images; Treat that the brightness value of the G component of each pixel of contrast images contrasts by corresponding and described for the brightness value of the G component of described each pixel of sample image, obtain the difference between the brightness value correspondence of the G component of described each pixel of sample image and the described brightness value treating the G component of each pixel of contrast images; Treat that the brightness value of the B component of each pixel of contrast images contrasts by corresponding and described for the brightness value of the B component of described each pixel of sample image, obtain the difference between the brightness value correspondence of the B component of described each pixel of sample image and the described brightness value treating the B component of each pixel of contrast images.Whether each pixel of sample image described in described terminal judges and the described difference treating the difference of the R component brightness value between each pixel of contrast images, the difference of G component intensities value and B component intensities value be in the first preset range.When described terminal judges that the difference of the difference of each pixel of described sample image and described R component brightness value between each pixel of contrast images, the difference of G component intensities value and B component intensities value is in described first preset range, treat the brightness value of the R component of contrast images described in corresponding to the difference determining R component brightness value in described first preset range, be designated as the brightness value of R0 component; Treat the brightness value of the G component of contrast images described in corresponding to the difference determining G component intensities value in described first preset range, be designated as the brightness value of G0 component; Treat the brightness value of the B component of contrast images described in corresponding to the difference determining B component intensities value in described first preset range, be designated as the brightness value of B0 component.Described terminal calculates the brightness value of the R component of described sample image and the mean value of described R0 component intensities value, obtains the mean value of R component brightness value; Calculate the brightness value of the G component of described sample image and the mean value of described G0 component intensities value, obtain the mean value of G component intensities value; Calculate the brightness value of the B component of described sample image and the mean value of described B0 component intensities value, obtain the mean value of B component intensities value.Described terminal using the mean value of the R component brightness value of each pixel as the R component image of image after denoising, the mean value of G component intensities value as the G component image of image after denoising, the mean value of B component intensities value as the B component image of image after denoising, the R component image of image after described denoising, G component image and B component image are reassembled into new image by described terminal, described in the new image that reconfigures be the image after denoising.The mean value of the mean value of the mean value of described R component brightness value, G component intensities value and B component intensities value can also be reassembled into new pixel by described terminal, using the pixel of described new pixel as new image, obtain described new image, described new image is the image after denoising.Further, described terminal by the image output display after described denoising in its screen.Wherein, described first preset range is determined according to the size of place neighbourhood noise during current shooting, as being set to-10 to 10, or is set to-20 to 20.

As as described in smart mobile phone obtain as described in the brightness value of R component of certain pixel of sample image, the brightness value of G component and the brightness value of B component, and obtain the brightness value of the R component treating corresponding pixel points in contrast images described in three frames, during the brightness value of the brightness value of G component and B component, described smart mobile phone is by treating the brightness value of the R component of corresponding pixel points in contrast images described in the brightness value of the R component of described sample image pixel and the first frame, obtain the difference treated described in the brightness value of the R component of described sample image pixel and the first frame between the brightness value of the R component of corresponding pixel points in contrast images, be designated as R1, by treating the brightness value of the R component of corresponding pixel points in contrast images described in the brightness value of the R component of described sample image pixel and the second frame, obtain the difference treated described in the brightness value of the R component of described sample image pixel and the second frame between the brightness value of the R component of corresponding pixel points in contrast images, be designated as R2, by treating the brightness value of the R component of corresponding pixel points in contrast images described in the brightness value of the R component of described sample image pixel and the 3rd frame, obtain the difference treated described in the brightness value of the R component of described sample image pixel and the 3rd frame between the brightness value of the R component of corresponding pixel points in contrast images, be designated as R3.Described smart mobile phone judges described R1, R2 and R3 are that namely whether described R1, R2 and R3 are greater than or equal to-10, and are less than or equal to 10 in-10 scopes to 10 (in the present embodiment, described first preset range value is-10 to 10).If described smart mobile phone judges described R1, R2 and R3 is greater than or equal to-10, and be less than or equal to 10, then calculate the brightness value of the R component of described sample image pixel, first frame treats the brightness value of the R component of corresponding pixel points in contrast images, second frame treats that the brightness value of the R component of corresponding pixel points in contrast images and the 3rd frame treat the mean value between the brightness value of brightness value four R component of the R component of corresponding pixel points in contrast images, using the brightness value of the mean value between the brightness value of described four R component as the R component of the new pixel of the image correspondence position after denoising.If described smart mobile phone judges that described R1 and R3 is greater than or equal to-10, and be less than or equal to 10, then calculate the brightness value of the R component of described sample image pixel, mean value between brightness value that brightness value that the first frame treats the R component of corresponding pixel points in contrast images and the 3rd frame treat brightness value three R component of the R component of corresponding pixel points in contrast images, using the brightness value of the mean value between the brightness value of described three R component as the R component of the new pixel of the image correspondence position after denoising.If described smart mobile phone judges that described R1 is greater than or equal to-10, and be less than or equal to 10, then calculate the mean value that described sample image answers the brightness value of the R component of pixel and the first frame to treat between the brightness value of brightness value two R component of the R component of corresponding pixel points in contrast images, using the brightness value of the mean value between the brightness value of described two R component as the R component of the new pixel of the image correspondence position after denoising.(when described R1 and R3 or R2 and R3 or R2 or R3 meets described first preset range, processing procedure as above, does not repeat them here).Described smart mobile phone, does not repeat them here with similar to the processing procedure of the brightness value of described R component the processing procedure of the brightness value of described G component and the brightness value of B component.When described smart mobile phone obtains described sample image and the described mean value treating R component brightness value between each pixel of contrast images, during the mean value of the mean value of G component intensities value and B component intensities value, described smart mobile phone is using the R component image of the mean value of the R component brightness value of each pixel as image after denoising, the mean value of G component intensities value is as the G component image of image after denoising, the mean value of B component intensities value is as the B component image of image after denoising, described smart mobile phone is by the R component image of image after described denoising, G component image and B component image are reassembled into new image, the described new image reconfigured is the image after denoising.Particularly, reference Fig. 7 and Fig. 8, Fig. 7 is a kind of schematic diagram without denoising gained image in the embodiment of the present invention captured by terminal; Fig. 8 is a kind of schematic diagram through denoising gained image in the embodiment of the present invention captured by terminal.Contrast described Fig. 7 and described Fig. 8 is known, when image is after denoising, sharpness significantly improves.

The present embodiment is by obtaining the brightness value of R, G and B component of the sample image in terminal respectively, treat the brightness value of R, G and B component of each pixel of contrast images, when with described, the brightness value of R, G and B component of described sample image treats that difference corresponding between the brightness value of R, G and B component of each pixel of contrast images is in the first preset range, then obtain the image after denoising until the mean value of the mean value of R component brightness value between contrast images and each pixel of described sample image, the mean value of G component intensities value and B component intensities value described in basis.Have passed and respectively denoising is carried out to the brightness value of R, G and B component of image, again the brightness value of R, G and B component after denoising is reassembled into new pixel, described new pixel is obtained the image after denoising as the method for the pixel of image after denoising, avoid calculated amount in image denoising process large, denoising effect is poor, easily causes the problem that image edge details loses.

With reference to the high-level schematic functional block diagram that Fig. 4, Fig. 4 are image denoising device second embodiment of the present invention, the second embodiment of image denoising device of the present invention is proposed based on the first embodiment.

In the present embodiment, described image denoising device also comprises:

Computing module 40, for calculating the brightness value of R, G and B component of described each pixel of sample image and the difference between the described brightness value treating R, G and B component that each pixel of contrast images is corresponding respectively, using described difference as the first difference;

Judge module 50, for judging described first difference whether all not in the first preset range;

When described terminal acquires the brightness value of the brightness value of the R component of described each pixel of sample image and the described R component until each pixel of contrast images, described terminal calculates difference between the brightness value of the R component of the pixel of described sample image and the described brightness value treating the R component of corresponding pixel points in contrast images, and using first difference of described difference as R component brightness value.The process that described terminal obtains the first difference of G component intensities value and the first difference of B component intensities value is similar with the first difference process obtaining described R component brightness value, does not repeat them here.When described terminal obtains the first difference of described R component brightness value, judge that the first difference of described R component brightness value is whether all in the first preset range.When described terminal acquires the brightness value of the brightness value of the brightness value of the G component of described each pixel of sample image and the brightness value of B component and the described G component until each pixel of contrast images and B component, described terminal is to the brightness value of the G component of described sample image pixel and the brightness value of B component and the described processing procedure treating difference between the brightness value of the G component of corresponding pixel points in contrast images and the brightness value of B component, with described terminal is similar to difference between the brightness value of the R component of the pixel of described sample image and the described brightness value treating the R component of corresponding pixel points in contrast images, do not repeat them here.As described in the difference of smart mobile phone between the brightness value treating the R component of corresponding pixel points in contrast images as described in the brightness value of R component of sample image pixel as described in calculating and three frames, obtain the difference R1 between brightness value that the brightness value of the R component of described sample image pixel and described first frame treat the R component of corresponding pixel points in contrast images; Obtain the difference R2 between brightness value that the brightness value of the R component of described sample image pixel and described second frame treat the R component of corresponding pixel points in contrast images; Obtain the difference R3 between brightness value that the brightness value of the R component of described sample image pixel and described 3rd frame treat the R component of corresponding pixel points in contrast images.Described smart mobile phone judges whether described R1, R2 and R3 are all greater than or equal to-10, and is less than or equal to 10.Described smart mobile phone is similar to difference between the brightness value treating to treat described in the brightness value of the R component of the processing procedure of difference and the pixel of described sample image between the brightness value of the G component of corresponding pixel points in contrast images and the brightness value of B component and three frames the R component of corresponding pixel points in contrast images described in the brightness value of the G component of described sample image pixel and the brightness value of B component and three frames, does not repeat them here.

Choose module 60, if for described first difference all not in described first preset range, then choose the pixel of predetermined number in the preset range of described each pixel of sample image;

Described second acquisition module 20, also for obtaining the brightness value of R, G and B component of the pixel of described predetermined number;

When described terminal judges that the first difference of described R component brightness value is not all in described first preset range, namely when the difference between the brightness value of the R component of described sample image and the brightness value of the described R component until contrast images is not all in described first preset range, described terminal chooses the pixel of predetermined number in the preset range of described each pixel of sample image, and obtains the brightness value of the R component of the pixel of described predetermined number.The noise size of described predetermined number at that time in photographed scene and setting, as can be set to by as described in centered by the current selected pixel of terminal, choose the pixel in the regions such as 3*3 or 5*5.When described terminal judges that the first difference of the first difference of described G component intensities value and/or described B component intensities value is not all in described first preset range, the processing procedure of described terminal and judge similar all not in described first preset range of the first difference of described R component brightness value, does not repeat them here.Particularly, reference Fig. 9, Fig. 9 is a kind of schematic diagram that in the embodiment of the present invention, terminal chooses the pixel of predetermined number in the preset range of sample image certain pixel total.In described Fig. 9, when described smart mobile phone judges described R1, R2 and R3 all not in-10 scopes to 10, then described smart mobile phone chooses 8 pixels within the scope of the 3*3 of the pixel of described sample image, as as described in smart mobile phone processing as described in be in the brightness value of the R component of position P22 pixel in sample image, then within the scope of described P22 pixel 3*3, choose these 8 pixels of P11, P12, P12, P21, P23, P31, P32 and P33.Described smart mobile phone obtains the brightness value of the R component of these 8 pixels of described P11, P12, P12, P21, P23, P31, P32 and P33 respectively.When described smart mobile phone judges that the first difference of the first difference of described G component intensities value and/or described B component intensities value is not all in-10 scopes to 10, the processing procedure of described terminal and judge similar all not in-10 scopes to 10 of described R1, R2 and R3, does not repeat them here.

Described computing module 40, also for R, G and B component of the brightness value and described sample image pixel that calculate R, G and B component of the pixel of described predetermined number respectively brightness value between difference, as the second difference;

When described terminal acquires the brightness value of the R component of the pixel of described predetermined number, difference between the brightness value calculating the brightness value of the R component of the pixel of described predetermined number and the R component of described sample image pixel, using second difference of described difference as R component brightness value; When described terminal acquires the brightness value of G component of the pixel of described predetermined number, difference between the brightness value calculating the brightness value of the G component of the pixel of described predetermined number and the G component of described sample image pixel, using second difference of described difference as G component intensities value; When described terminal acquires the brightness value of B component of the pixel of described predetermined number, difference between the brightness value calculating the brightness value of the B component of the pixel of described predetermined number and the B component of described sample image pixel, using second difference of described difference as B component intensities value.As described in smart mobile phone acquire as described in the brightness value of R component of these 8 pixels of P11, P12, P12, P21, P23, P31, P32 and P33 time, the difference between the brightness value calculating the brightness value of the R component of P22 pixel in described sample image and the R component of these 8 pixels of described P11, P12, P12, P21, P23, P31, P32 and P33.Particularly, reference Figure 10, described Figure 10 is a kind of schematic diagram of the brightness value of certain pixel of sample image and the R component of predetermined number pixel in the embodiment of the present invention.From described Figure 10, the brightness value of the R component of described P22 pixel is 5, the brightness value of the R component of described P11 pixel is 1, the brightness value of the R component of described P12 pixel is 2, the brightness value of the R component of described P13 pixel is 3, the brightness value of the R component of described P21 pixel is 4, the brightness value of the R component of described P23 pixel is 6, the brightness value of the R component of described P31 pixel is 9, the brightness value of the R component of described P32 pixel is 8, and the brightness value of the R component of described P33 pixel is 7.Difference between the brightness value that described smart mobile phone calculates the brightness value of the R component of P22 pixel in described sample image and the R component of these 8 pixels of described P11, P12, P12, P21, P23, P31, P32 and P33 is respectively 4,3,2,1 ,-1 ,-4 ,-3 and-2.

Described processing module 30, if also for described second difference in the second preset range, then according to the image after the mean value of the mean value of R component brightness value, the mean value of G component intensities value and B component intensities value obtains denoising between the pixel of described described predetermined number corresponding in the second preset range and each pixel of described sample image.

Further, described processing module 30 also comprises:

When described terminal obtains the second difference of described R component brightness value, and when judging that the second difference of described R component brightness value is in the second preset range, obtain the brightness value of the R component of the pixel of the described predetermined number corresponding to the second difference of described R component brightness value in described second preset range, calculate the brightness value of R component of pixel of described predetermined number and the mean value of the R component brightness value of each pixel of described sample image that obtain, using the brightness value of the mean value of described R component brightness value as the R component of new pixel.When described terminal judges that the second difference of the second difference of described G component intensities value and/or described B component intensities value is in described second preset range, the processing procedure of described terminal is similar with the process of the second difference in described second preset range of the described R component brightness value of judgement, does not repeat them here.Wherein, described second preset range can be consistent with described first preset range, also can be inconsistent with described first preset range.When described terminal obtains the brightness value of the brightness value of the R component of new pixel, the brightness value of G component and B component, the brightness value of the brightness value of the R component of described new pixel, the brightness value of G component and B component is reassembled into new pixel, using the pixel of described new pixel as new image, obtain described new image, described new image is the image after denoising.As when as described in the second preset range be-2 to 2 time, difference between the brightness value that described smart mobile phone judges the brightness value of the R component of described P22 pixel and the R component of described P13, P21, P23 and P33 pixel is in-2 to 2 scopes, then the corresponding brightness value obtaining the R component of described P13, P21, P23 and P33 pixel is 3,4,6 and 7.Described smart mobile phone calculates the mean value that the brightness value 5 of the R component of described P22 pixel and the brightness value of the R component of described P13, P21, P23 and P33 pixel are 3,4,6 and 7, the mean value obtained is 5, then using 5 as the brightness value of the R component of denoising image P22 position pixel.When described smart mobile phone obtains the brightness value of the brightness value of the G component of denoising image P22 position pixel and B component, the brightness value of the brightness value of R component of described P22 position pixel, the brightness value of G component and B component is reassembled into the P22 position pixel of denoising image.Described smart mobile phone by this method, obtains the image after a complete width denoising.

Further, described judge module 50, also for judging described second difference whether in the second preset range;

When described terminal acquires the second difference of described R component brightness value, judge that the second difference of described R component brightness value is whether in described second preset range.If the second difference of described R component brightness value is not in described second preset range, the brightness value of the R component of the pixel of the described predetermined number corresponding to the second difference of the R component brightness value described in described terminal then abandons not in described second preset range.As described in smart mobile phone judge as described in P22 pixel R component brightness value and as described in P11, P12, P31 and P32 pixel R component brightness value between difference not in-2 to 2 scopes time, then abandon the brightness value of the R component of described P11, P12, P31 and P32 pixel, the brightness value of the R component of described P11, P12, P31 and P32 pixel is not calculated.When described terminal judges that the second difference of the second difference of described G component intensities value and/or described B component intensities value is not in described second preset range, the processing procedure of described terminal and the process of the second difference not in described second preset range of described R component brightness value similar, do not repeat them here.

The present embodiment by when R, G and B component of described each pixel of sample image brightness value correspondence and the brightness value of described R, G and B component until each pixel of contrast images between difference all not in the first preset range time, the pixel of predetermined number is chosen in the preset range of described each pixel of sample image, thus obtain the image after denoising, avoid calculated amount in image denoising process large, denoising effect is poor, easily causes the problem that image edge details loses.

The present invention further provides a kind of image de-noising method.

With reference to the schematic flow sheet that Fig. 5, Fig. 5 are image de-noising method first embodiment of the present invention.

In the present embodiment, described image de-noising method comprises:

Step S10, obtain the continuous print multiple image of terminal taking, using the wherein two field picture in described multiple image as sample image, remaining is as treating contrast images, and wherein, the form of described multiple image is RGB picture format;

Step S20, obtains the brightness value of R, G and B component of described each pixel of sample image respectively, and the described brightness value treating R, G and B component of each pixel of contrast images;

Step S30, if the difference between the brightness value of R, G and B component of described each pixel of sample image with the described brightness value treating R, G and B component that each pixel of contrast images is corresponding is in the first preset range, then obtain the image after denoising until the mean value of the mean value of R component brightness value between contrast images and each pixel of described sample image, the mean value of G component intensities value and B component intensities value described in basis.

Further, described step S30 comprises:

With reference to the schematic flow sheet that Fig. 6, Fig. 6 are image de-noising method second embodiment of the present invention, based on first embodiment of the invention, image de-noising method second embodiment of the present invention is proposed.

In the present embodiment, described image de-noising method also comprises:

Step S40, calculates the brightness value of R, G and B component of described each pixel of sample image and the difference between the described brightness value treating R, G and B component that each pixel of contrast images is corresponding, respectively using described difference as the first difference;

Step S50, judges described first difference whether not in the first preset range;

Step S60, if described first difference is not all in described first preset range, then chooses the pixel of predetermined number in the preset range of described each pixel of sample image;

Step S70, obtains the brightness value of R, G and B component of the pixel of described predetermined number;

Step S80, the difference between the brightness value calculating the brightness value of R, G and B component of the pixel of described predetermined number and R, G and B component of described sample image pixel respectively, as the second difference;

Step S90, if described second difference is in the second preset range, then according to the image after the mean value of the mean value of R component brightness value, the mean value of G component intensities value and B component intensities value obtains denoising between the pixel of described described predetermined number corresponding in the second preset range and each pixel of described sample image.

Further, described step S90 comprises:

Further, described image de-noising method also comprises:

Judge described second difference whether in the second preset range;

These are only the preferred embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every utilize instructions of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; or be directly or indirectly used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.

Claims

1. an image denoising device, is characterized in that, described image denoising device comprises:

2. image denoising device as claimed in claim 1, it is characterized in that, described image denoising device also comprises:

3. image denoising device as claimed in claim 2, is characterized in that, described judge module, also for judging described second difference whether in the second preset range;

4. image denoising device as claimed in claim 2, it is characterized in that, described processing module comprises:

5. the image denoising device as described in any one of Claims 1-4, is characterized in that, described processing module also comprises:

6. an image de-noising method, is characterized in that, described image de-noising method comprises the following steps:

7. image de-noising method as claimed in claim 6, it is characterized in that, the described brightness value obtaining R, G and B component of described each pixel of sample image respectively, and described treat the step of the brightness value of R, G and B component of each pixel of contrast images after, also comprise:

Judge described first difference whether all not in the first preset range;

8. image de-noising method as claimed in claim 7, it is characterized in that, difference between the described brightness value calculating the brightness value of R, G and B component of the pixel of described predetermined number and R, G and B component of described sample image pixel respectively, after the step as the second difference, also comprises:

Judge described second difference whether in the second preset range;

9. image de-noising method as claimed in claim 7, it is characterized in that, if described second difference is in the second preset range, then comprise according to the step of the image after the mean value of the mean value of R component brightness value, the mean value of G component intensities value and B component intensities value obtains denoising between the pixel of described described predetermined number corresponding in the second preset range and each pixel of described sample image:

10. the image de-noising method as described in any one of claim 6 to 9, it is characterized in that, if the difference between the brightness value of R, G and B component of described each pixel of sample image with the described brightness value treating R, G and B component that each pixel of contrast images is corresponding is in the first preset range, then the step of the image described in basis after the mean value of the mean value of R component brightness value between contrast images and each pixel of described sample image, the mean value of G component intensities value and B component intensities value obtains denoising comprises: