WO2017088609A1

WO2017088609A1 - Image denoising apparatus and method

Info

Publication number: WO2017088609A1
Application number: PCT/CN2016/102390
Authority: WO
Inventors: 朱德志
Original assignee: 努比亚技术有限公司
Priority date: 2015-11-27
Filing date: 2016-10-18
Publication date: 2017-06-01
Also published as: CN105513021A; CN105513021B

Abstract

An image denoising method, comprising: acquiring a consecutive plurality of image frames taken by a terminal, and setting one image frame amongst the plurality of image frames as a sample image, and setting the remaining image frames as images to be compared; respectively acquiring the brightness of the R, G, and B components of every pixel point of the sample image and the brightness of the R, G, and B components of every pixel point of the images to be compared; if the difference between the brightness of the R, G, and B components of every pixel point of the sample image and the brightness of the R, G, and B components corresponding to every pixel point of the images to be compared is within a first present range, then obtaining a denoised image on the basis of the average of the brightness of the R components, the average of the brightness of the G components, and the average of the B components between the images to be compared and the sample image. The present method prevents the problem of the loss of detail at the image edges easily caused by the large amount of calculation and the poor denoising effects during an image denoising process.

Description

Image denoising device and method

Technical field

The present application relates to, but is not limited to, the field of images, and in particular, to an image denoising apparatus and method.

Background technique

With the development of science and technology, the camera function of smart phones has become more and more perfect. Compared with digital cameras, smart phones have the characteristics of small size and portability. Therefore, more and more people are more keen to use the smart phone camera function to record the beautiful moments in life. At the same time, people are increasingly demanding image quality for smartphones. However, if the brightness is not enough, the image captured by the smartphone often has some noise (brightness noise plus chrominance noise), and the lower the brightness, the louder the noise, the serious influence on the image due to the presence of noise. quality.

Traditional denoising algorithms include: mean, median, Gaussian filtering, bilateral filtering, and so on. Bilateral filtering can preserve the edge while removing noise, but the filtering effect is not obvious when the noise is relatively large, and the calculation amount is large. When the filtering window is increased, it is difficult to perform real-time processing. Mean, median, and Gaussian can filter out noise better, but it is easy to blur out the edges, and as the filter window increases, it is difficult to do real-time processing. There is also 3D (3Dimensions) denoising with motion estimation. In the process of 3D denoising with motion estimation, motion estimation is first performed, then 3D denoising operation is performed, and motion estimation needs to be large. The amount of calculation, and can not guarantee 100% accuracy.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The present application proposes an image denoising apparatus and method, which aims to solve the technical problem that the related art has large calculation amount, poor denoising effect, and easy loss of image edge detail in the process of denoising the image.

An embodiment of the present invention provides an image denoising device, where the device includes:

a first acquiring module, configured to acquire a continuous multi-frame image captured by the terminal, using one of the multi-frame images as a sample image, and the rest as a to-be-contrast image, wherein the format of the multi-frame image is RGB image format;

a second acquiring module, configured to respectively acquire luminance values of R, G, and B components of each pixel of the sample image, and luminance values of R, G, and B components of each pixel of the image to be compared;

a processing module configured to: if a luminance value of R, G, and B components of each pixel of the sample image is different from a luminance value of R, G, and B components corresponding to each pixel of the image to be compared In the first preset range, according to the average value of the R component luminance value between the image to be compared and each pixel point of the sample image, the average value of the G component luminance value, and the average value of the B component luminance value are obtained. Denoised image.

Optionally, the image denoising device further includes:

a calculation module, configured to separately calculate a difference between a luminance value of the R, G, and B components of each pixel of the sample image and a luminance value of the R, G, and B components corresponding to each pixel of the image to be compared a value, the difference being the first difference;

a determining module, configured to determine whether the first difference is not within the first preset range;

Selecting a module, if the first difference is not within the first preset range, selecting a preset number of pixels within a preset range of each pixel of the sample image;

The second acquiring module is further configured to acquire a brightness value of the R, G, and B components of the preset number of pixels;

The calculating module is further configured to separately calculate a difference between a luminance value of the R, G, and B components of the preset number of pixel points and a luminance value of the R, G, and B components of the sample image pixel point. Value as the second difference;

The processing module is further configured to: if the second difference is within the second preset range, according to the preset number of pixels corresponding to the sample in the second preset range, and the sample The average of the R component luminance values, the average of the G component luminance values, and the average of the B component luminance values between each pixel of the image result in a denoised image.

Optionally, the determining module is further configured to determine whether the second difference is within a second preset range;

The image denoising apparatus further includes a discarding module configured to discard the second difference that is not within the second preset range if the second difference is not within the second preset range Corresponding to the preset number of pixels.

Optionally, the processing module includes:

Obtaining, if the second difference is within the second preset range, acquiring the preset number of pixels corresponding to the second difference in the second preset range Luminance values of the R, G, and B components;

a first calculating unit, configured to separately calculate an average value of the obtained R component luminance values between the preset number of pixels and each pixel of the sample image, and an average value and a B component of the G component luminance values The average value of the brightness values;

The first processing unit is configured to recombine the average of the R component luminance values, the average of the G component luminance values, and the average of the B component luminance values into new pixel points to obtain a denoised image.

Optionally, the processing module further includes:

a determining unit, configured to determine a difference between a luminance value of R, G, and B components of each pixel of the sample image and a luminance value of R, G, and B components corresponding to each pixel of the image to be compared Determining, in the first preset range, brightness values of R, G, and B components of each pixel of the image to be compared corresponding to the difference in the first preset range;

a second calculating unit, configured to respectively calculate an average value of the R component luminance values and an average value of the G component luminance values between the to-be-compared image and the pixel image in the first preset range And the average value of the B component luminance values;

The second processing unit is configured to recombine the average of the R component luminance values, the average of the G component luminance values, and the average of the B component luminance values into new pixel points to obtain a denoised image.

Optionally, the second acquiring module is configured to parse the sample image and the image to be compared, and acquire a luminance value, a luminance component, and a B component of an R component of each pixel in the sample image. And a brightness value of the R component of each pixel in the image to be compared, a luminance value of the G component, and a luminance value of the B component.

Optionally, the processing module is further configured to set the preset number according to a noise level in the shooting scene.

Optionally, the processing module is further configured to set the first preset range according to a size of ambient noise at the time of shooting.

Optionally, the first preset range is consistent with the second preset range.

Optionally, the processing module is further configured to display the denoised image output in a screen.

In addition, an embodiment of the present invention further provides an image denoising method, where the method includes the following steps:

Obtaining a continuous multi-frame image captured by the terminal, using one of the multi-frame images as a sample image, and the rest as an image to be compared, wherein the format of the multi-frame image is an RGB image format;

And acquiring, respectively, brightness values of R, G, and B components of each pixel of the sample image, and brightness values of R, G, and B components of each pixel of the image to be compared;

If the difference between the luminance values of the R, G, and B components of each pixel of the sample image and the luminance values of the R, G, and B components corresponding to each pixel of the image to be compared is at the first preset In the range, the denoised image is obtained according to an average value of the R component luminance value between the pixel to be compared and each pixel point of the sample image, an average value of the G component luminance value, and an average value of the B component luminance value. .

Optionally, the step of respectively acquiring the luminance values of the R, G, and B components of each pixel of the sample image and the luminance values of the R, G, and B components of each pixel of the image to be compared The image denoising method further includes:

Calculating, respectively, a difference between a luminance value of R, G, and B components of each pixel of the sample image and a luminance value of R, G, and B components corresponding to each pixel of the image to be compared, The difference is taken as the first difference;

Determining whether the first difference is not within the first preset range;

If the first difference is not within the first preset range, selecting a preset number of pixels within a preset range of each pixel of the sample image;

Obtaining brightness values of R, G, and B components of the preset number of pixels;

Calculating brightness values of the R, G, and B components of the preset number of pixels and the sample respectively a difference between luminance values of R, G, and B components of an image pixel as a second difference;

If the second difference is within the second preset range, according to the preset number of pixels corresponding to the second preset range and each pixel of the sample image The average of the R component luminance values, the average of the G component luminance values, and the average of the B component luminance values are obtained as denoised images.

Optionally, the calculating, respectively, a difference between a luminance value of the R, G, and B components of the preset number of pixel points and a luminance value of the R, G, and B components of the sample image pixel point, After the step of the second difference, the image denoising method further includes:

Determining whether the second difference is within a second preset range;

And if the second difference is not in the second preset range, discarding the preset number of pixel points corresponding to the second difference that is not in the second preset range.

Optionally, if the second difference is in the second preset range, according to the preset number of pixel points corresponding to the sample image in the second preset range The step of obtaining the denoised image by the average of the R component luminance values, the average of the G component luminance values, and the B component luminance values between each pixel point includes:

If the second difference is within the second preset range, acquiring R, G, and the preset number of pixel points corresponding to the second difference in the second preset range The brightness value of the B component;

Calculating, respectively, an average value of the acquired R component luminance values between the preset number of pixel points and each pixel point of the sample image, an average value of the G component luminance values, and an average value of the B component luminance values;

The average of the R component luminance values, the average of the G component luminance values, and the average of the B component luminance values are recombined into new pixel points to obtain a denoised image.

Optionally, if the brightness value of the R, G, and B components of each pixel of the sample image is different from the brightness value of the R, G, and B components corresponding to each pixel of the image to be compared The value is within the first preset range, and the average value of the R component luminance value, the average value of the G component luminance value, and the average value of the B component luminance value between each pixel point of the image to be compared and the sample image according to the image to be compared The steps to the denoised image include:

If the difference between the luminance values of the R, G, and B components of each pixel of the sample image and the luminance values of the R, G, and B components corresponding to each pixel of the image to be compared is at the first preset Within the scope, And determining, according to the difference, the luminance values of the R, G, and B components of each pixel of the image to be compared corresponding to the first preset range;

Calculating, respectively, an average value of the R component luminance values, an average value of the G component luminance values, and an average of the B component luminance values between the to-be-compared image in the first preset range and each pixel point of the sample image value;

Optionally, the obtaining the luminance values of the R, G, and B components of each pixel of the sample image, and the luminance values of the R, G, and B components of each pixel of the image to be compared, respectively: And parsing the sample image and the image to be compared, acquiring a luminance value of an R component, a luminance value of a G component, and a luminance value of a B component of each pixel in the sample image, and acquiring each of the to-be-compared images The luminance value of the R component of the pixel, the luminance value of the G component, and the luminance value of the B component.

Optionally, the image denoising method further includes: setting the preset number according to a noise level in a shooting scene.

Optionally, the image denoising method further includes: setting the first preset range according to a magnitude of ambient noise at the time of shooting.

Optionally, the first preset range is consistent with the second preset range.

Optionally, the image denoising method further comprises: displaying the denoised image output on a screen.

Embodiments of the present invention further provide a computer readable storage medium storing computer executable instructions that implement the image denoising method described above when the computer executable instructions are executed.

In the embodiment of the present invention, the luminance values of the R, G, and B components of the sample image in the terminal are respectively obtained by comparing the luminance values of the R, G, and B components of the sample image in the terminal, when the R, G of the sample image is And the difference between the brightness value of the B component and the brightness value of the R, G, and B components of each pixel of the image to be compared is within a first preset range, according to the image to be compared and the The average of the R component luminance values, the average of the G component luminance values, and the average of the B component luminance values between each pixel of the sample image are obtained as denoised images. Denoising the luminance values of the R, G, and B components of the image separately, and then recombining the luminance values of the denoised R, G, and B components into new ones. Pixel point, the new pixel point is used as the pixel point of the image after denoising to obtain the denoised image, which avoids the calculation amount in the image denoising process, the denoising effect is poor, and the image edge detail is easily caused. The problem of loss.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a schematic structural diagram of hardware of an optional mobile terminal implementing various embodiments of the present application;

Figure 2 is a block diagram showing the electrical structure of the camera of Figure 1;

3 is a schematic diagram of functional modules of a first embodiment of an image denoising apparatus according to the present application;

4 is a schematic diagram of functional modules of a second embodiment of an image denoising apparatus according to the present application;

FIG. 5 is a schematic flowchart diagram of a first embodiment of an image denoising method according to the present application; FIG.

6 is a schematic flow chart of a second embodiment of an image denoising method according to the present application;

FIG. 7 is a schematic diagram of an image captured by a terminal without past noise processing according to an embodiment of the present invention; FIG.

FIG. 8 is a schematic diagram of an image obtained by a denoising process captured by a terminal according to an embodiment of the present invention; FIG.

FIG. 9 is a schematic diagram of a terminal selecting a preset number of pixel points within a preset range of a certain pixel point of a sample image according to an embodiment of the present invention; FIG.

FIG. 10 is a schematic diagram showing luminance values of R components of a certain pixel point of a sample image and luminance values of R components of a preset number of pixel points according to an embodiment of the present invention.

The implementation, functional features and advantages of the present application will be further described with reference to the accompanying drawings.

Embodiments of the invention

It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting.

A mobile terminal implementing various embodiments of the present application will now be described with reference to the accompanying drawings. In the subsequent description The use of suffixes such as "module", "component" or "unit" for indicating an element is merely illustrative for the benefit of the present application and does not in itself have a particular meaning. Therefore, "module" and "component" can be used in combination.

The mobile terminal can be implemented in various forms. For example, the terminals described in this application may include, for example, mobile phones, smart phones, notebook computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablets), PMPs (Portable Multimedia Players), navigation devices, and the like. Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that configurations in accordance with embodiments of the present application can be applied to fixed type terminals in addition to elements that are specifically for mobile purposes.

FIG. 1 is a schematic structural diagram of hardware of an optional mobile terminal implementing various embodiments of the present application.

The mobile terminal 100 may include an A/V (Audio/Video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, a power supply unit 190, and the like. Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.

The A/V input unit 120 is for receiving an audio or video signal. The A/V input unit 120 may include a camera 121 and a microphone 122 that processes image data of still pictures or video obtained by the image capturing device in a video capturing mode or an image capturing mode. The processed image frame can be displayed on the display unit 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium), and two or more cameras 121 may be provided according to the configuration of the mobile terminal. The microphone 122 can receive sound (audio data) via a microphone in an operation mode of a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound as audio data. The processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode. The microphone 122 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal. The user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, detecting resistance, pressure due to being touched, pressure, A touch sensitive component such as a capacitor or the like), a scroll wheel, a rocker, and the like. In particular, when the touch panel is superimposed on the display unit 151 in the form of a layer, a touch screen can be formed.

The sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal. The orientation of 100, the acceleration of the mobile terminal 100 or the speed of movement and direction, and the like, and generates a command or signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide type mobile phone, the sensing unit 140 can sense whether the slide type phone is turned on or off. In addition, the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device.

The interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more. The identification module may be stored to verify various information used by the user using the mobile terminal 100 and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identity Module (USIM), and the like. In addition, the device having the identification module (hereinafter referred to as "identification device") may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 100 via a port or other connection device. The interface unit 170 can be configured to receive input from an external device (eg, data information, power, etc.) and transmit the received input to one or more components within the mobile terminal 100 or can be used at the mobile terminal and external device Transfer data between.

In addition, when the mobile terminal 100 is connected to the external base, the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal 100 or may be used as a transmission of various command signals allowing input from the base to the mobile terminal 100 The path to the terminal. Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal is accurately mounted on the base. Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151.

The display unit 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in the phone call mode, the display unit 151 can display a call or other communication (for example, Text messaging, multimedia file downloads, etc.) related user interface (UI) or graphical user interface (GUI). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch panel are superposed on each other in the form of a layer to form a touch screen, the display unit 151 can function as an input device and an output device. The display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like. According to a particular desired embodiment, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) . The touch screen can be used to detect touch input pressure as well as touch input position and touch input area.

The memory 160 may store a software program or the like for processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, etc.) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like. Moreover, the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, which may be constructed within the controller 180 or may be configured to be separate from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate each component and component.

The various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementations, the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle. For software implementations, implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation. The software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by controller 180.

So far, the mobile terminal has been described in terms of its function. Hereinafter, for the sake of brevity, a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the present application can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

2, FIG. 2 is a block diagram of the electrical structure of the camera of FIG. 1.

The photographic lens 1211 is composed of a plurality of optical lenses for forming a subject image, and is a single focus lens or a zoom lens. The photographic lens 1211 is movable in the optical axis direction under the control of the lens driver 1221, and the lens driver 1221 controls the focus position of the photographic lens 1211 in accordance with a control signal from the lens driving control circuit 1222, and can also be controlled in the case of the zoom lens. Focus distance. The lens drive control circuit 1222 performs drive control of the lens driver 1221 in accordance with a control command from the microcomputer 1217.

An imaging element 1212 is disposed on the optical axis of the photographic lens 1211 near the position of the subject image formed by the photographic lens 1211. The imaging element 1212 is for capturing an image of a subject and acquiring captured image data. Photodiodes constituting each pixel are arranged two-dimensionally and in a matrix on the imaging element 1212. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, which is subjected to charge accumulation by a capacitor connected to each photodiode. The front surface of each pixel is provided with a Bayer array of RGB color filters.

The imaging element 1212 is connected to the imaging circuit 1213. The imaging circuit 1213 performs charge accumulation control and image signal readout control in the imaging element 1212, and performs waveform shaping after reducing the reset noise of the read image signal (analog image signal). Further, gain improvement or the like is performed to obtain an appropriate signal level.

The imaging circuit 1213 is connected to an A/D converter 1214 that performs analog-to-digital conversion on the analog image signal and outputs a digital image signal (hereinafter referred to as image data) to the bus 1227.

The bus 1227 is a transmission path for transmitting various data read or generated inside the camera. The A/D converter 1214 is connected to the bus 1227, and an image processor 1215, a JPEG processor 1216, a microcomputer 1217, a SDRAM (Synchronous Dynamic Random Access Memory) 1218, and a memory interface are also connected. (hereinafter referred to as memory I/F) 1219, LCD (Liquid Crystal Display) driver 1220.

The image processor 1215 performs various kinds of images such as OB subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, simultaneous processing, edge processing, and the like on the image data based on the output of the imaging element 1212. deal with. The JPEG processor 1216 compresses the image data read out from the SDRAM 1218 in accordance with the JPEG compression method when the image data is recorded on the recording medium 1225. Further, the JPEG processor 1216 performs decompression of JPEG image data for image reproduction display. At the time of decompression, the file recorded on the recording medium 1225 is read, and after the compression processing is performed in the JPEG processor 1216, the decompressed image data is temporarily stored in the SDRAM 1218 and displayed on the LCD 1226. Further, in the present embodiment, the JPEG method is adopted as the image compression/decompression method. However, the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be used.

The microcomputer 1217 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera. The microcomputer 1217 is connected to the operation unit 1223 and the flash memory 1224.

The operating unit 1223 includes, but is not limited to, a physical button or a virtual button, and the entity or virtual button may be a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, an enlarge button An operation control such as various input buttons and various input keys detects an operation state of these operation controls, and outputs the detection result to the microcomputer 1217. Further, a touch panel is provided on the front surface of the LCD 1226 as a display, and the touch position of the user is detected, and the touch position is output to the microcomputer 1217. Microcomputer 1217 based on operation The detection result of the operation position of the unit 1223 performs various processing sequences corresponding to the operation of the user.

The flash memory 1224 stores programs for executing various processing sequences of the microcomputer 1217. The microcomputer 1217 performs overall control of the camera in accordance with the program. Further, the flash memory 1224 stores various adjustment values of the camera, and the microcomputer 1217 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value.

The SDRAM 1218 is an electrically rewritable volatile memory for temporarily storing image data or the like. The SDRAM 1218 temporarily stores image data output from the A/D converter 1214 and image data processed in the image processor 1215, the JPEG processor 1216, and the like.

The memory interface 1219 is connected to the recording medium 1225, and performs control for writing image data and a file header attached to the image data to the recording medium 1225 and reading out from the recording medium 1225. The recording medium 1225 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body. However, the recording medium 1225 is not limited thereto, and may be a hard disk or the like built in the camera body.

The LCD driver 1220 is connected to the LCD 1226, and stores image data processed by the image processor 1215 in the SDRAM 1218. When display is required, the image data stored in the SDRAM 1218 is read and displayed on the LCD 1226, or the image data stored in the JPEG processor 1216 is compressed. In the SDRAM 1218, when display is required, the JPEG processor 1216 reads the compressed image data of the SDRAM 1218, decompresses it, and displays the decompressed image data through the LCD 1226.

The LCD 1226 is configured to display an image on the back of the camera body. However, it is not limited thereto, and various display panels (LCD 1226) such as an organic EL may be used.

Based on the hardware structure of the above mobile terminal and the electrical structure diagram of the camera, the solution of the present application is proposed.

Embodiments of the present invention provide an image denoising device.

Referring to FIG. 3, FIG. 3 is a schematic diagram of functional modules of a first embodiment of an image denoising apparatus according to the present application.

In this embodiment, the image denoising device includes:

The first obtaining module 10 is configured to acquire a continuous multi-frame image captured by the terminal, and use one of the multi-frame images as a sample image, and the rest as a to-be-contrast image, where the multi-frame image format For RGB image format;

When the terminal is photographing using a built-in or external camera, the terminal acquires during the shooting process a continuous multi-frame image, wherein one of the multi-frame images is used as a sample image, and an image other than the sample image is used as an image to be compared, and the sample image and the image to be compared are RGB. Image format. The terminal includes, but is not limited to, a smart phone, a personal computer. In this embodiment, the terminal is a smart phone. If the smart phone captures an image in its built-in camera, it acquires four consecutive frames of images, and uses the acquired first frame image as a sample image to acquire the acquired image. The second, third, and fourth frame images are used as images to be compared.

The second obtaining module 20 is configured to respectively acquire luminance values of R, G, and B components of each pixel of the sample image, and luminance values of R, G, and B components of each pixel of the image to be compared;

When the terminal acquires the sample image and the image to be compared, parsing the sample image and the image to be compared, and acquiring a luminance value and a G component of an R component of each pixel in the sample image. A luminance value and a luminance value of the B component, and a luminance value of the R component of each pixel in the image to be compared, a luminance value of the G component, and a luminance value of the B component. For example, when the smart phone acquires one frame of the sample image and three frames of the image to be compared, parsing the sample image to obtain a luminance value and a G component of an R component of each pixel in the sample image. The brightness value and the brightness value of the B component; and parsing the three images to be compared, respectively, to obtain the luminance value of the R component, the luminance value of the G component, and the B component of each pixel in the image to be compared in the first frame. a brightness value; obtaining a brightness value of the R component of each pixel in the image to be compared in the second frame, a brightness value of the G component, and a brightness value of the B component; obtaining each pixel in the image to be compared in the third frame The luminance value of the R component, the luminance value of the G component, and the luminance value of the B component.

The processing module 30 is configured to: if the luminance values of the R, G, and B components of each pixel of the sample image are different from the luminance values of the R, G, and B components corresponding to each pixel of the image to be compared The value is within the first preset range, and the average value of the R component luminance value, the average value of the G component luminance value, and the average value of the B component luminance value between each pixel point of the image to be compared and the sample image according to the image to be compared To the image after denoising.

Optionally, the processing module 30 includes:

When the terminal obtains the luminance value of the R component of each pixel point of the sample image and the image to be compared, the luminance value of the G component, and the luminance value of the B component, the R of each pixel of the sample image is obtained. The brightness value of the component is compared with the brightness value of the R component of each pixel of the image to be compared, and the brightness value of the R component of each pixel of the sample image is obtained corresponding to each pixel of the image to be compared. a difference between luminance values of the R component; comparing a luminance value of a G component of each pixel of the sample image with a luminance value of a G component of each pixel of the image to be compared, to obtain the a luminance value of a G component of each pixel of the sample image corresponds to a difference between luminance values of a G component of each pixel of the image to be compared; and a luminance value of a B component of each pixel of the sample image Corresponding to the brightness value of the B component of each pixel of the image to be compared, obtaining a brightness value of the B component of each pixel of the sample image corresponding to the B component of each pixel of the image to be compared Between brightness values Value. Determining, by the terminal, a difference between a luminance value of an R component between each pixel point of the sample image and each pixel of the image to be compared, a difference between a luminance value of a G component, and a luminance value of a B component. Within the first preset range. When the terminal determines that the difference between the R component luminance value between each pixel point of the sample image and each pixel point of the image to be compared, the difference between the G component luminance value and the B component luminance value is Determining, in the first preset range, a luminance value of the R component of the image to be compared corresponding to the difference of the luminance values of the R component in the first preset range, and recording the luminance value of the R0 component; Determining, according to a difference between the G component luminance values in the first preset range, a luminance value of the G component of the image to be compared, as a luminance value of the G0 component; determining to be within the first preset range The luminance value of the B component of the image to be compared corresponding to the difference of the B component luminance values is recorded as the luminance value of the B0 component. The terminal calculates an average value of the luminance value of the R component of the sample image and the luminance value of the R0 component to obtain an average value of the luminance values of the R component; and calculates a luminance value of the G component of the sample image and the G0 component. An average value of the luminance values, an average value of the luminance values of the G components is obtained; and a luminance value of the B component of the sample image is calculated An average value of the B component luminance values is obtained as an average value of the B component luminance values. The terminal uses the average value of the R component luminance values of each pixel as the average of the R component image and the G component luminance value of the denoised image as the average of the G component image and the B component luminance value of the denoised image. As a B component image of the denoised image, the terminal recombines the R component image, the G component image, and the B component image of the denoised image into a new image, and the recombined new image is Noise after the image. The terminal may further recombine the average value of the R component luminance value, the average value of the G component luminance value, and the average value of the B component luminance value into a new pixel point, and use the new pixel point as a new image. The pixel is obtained, and the new image is obtained, and the new image is the image after denoising. Further, the terminal displays the denoised image output in its screen. The first preset range is determined according to the size of the ambient noise at the time of the current shooting, and may be set to be -10 to 10, or set to -20 to 20.

Obtaining, by the smart phone, a luminance value of a R component of a certain pixel point of the sample image, a luminance value of a G component, and a luminance value of a B component, and obtaining an R component of a corresponding pixel point in the image to be compared in three frames. a luminance value, a luminance value of the G component, and a luminance value of the B component, wherein the smartphone passes the luminance value of the R component of the sample image pixel point and the R component of the corresponding pixel point in the image to be compared in the first frame a luminance value obtained by obtaining a difference between a luminance value of an R component of the pixel of the sample image and a luminance value of an R component of a corresponding pixel in the image to be compared in the first frame, denoted as R1; a luminance value of the R component of the pixel and a luminance value of the R component of the corresponding pixel in the image to be compared in the second frame, to obtain a luminance value of the R component of the pixel of the sample image and the image to be compared in the second frame The difference between the luminance values of the R components of the corresponding pixel points, denoted as R2; the luminance value of the R component of the pixel of the sample image and the R component of the corresponding pixel in the image to be compared in the third frame Brightness value, get the sample The difference between the luminance value of the image pixel of the R component and the luminance contrast value of the third frame to be the corresponding pixel of the R component in the image, referred to as R3. The smart phone determines that the R1, R2, and R3 are in the range of -10 to 10 (in the embodiment, the first preset range takes a value of -10 to 10), that is, the R1, R2 And R3 is greater than or equal to -10 and less than or equal to 10. If the smart phone determines that the R1, R2, and R3 are greater than or equal to -10 and less than or equal to 10, calculating a luminance value of the R component of the sample image pixel point, and corresponding pixel in the first frame to be compared image The luminance value of the R component of the point, the luminance value of the R component of the corresponding pixel in the second frame to be compared image, and the luminance value of the R component of the corresponding pixel in the third frame to be compared image, between the luminance values of the four R components Average of the four R components The average value between the luminance values is used as the luminance value of the R component of the new pixel corresponding to the position of the denoised image. If the smart phone determines that the R1 and R3 are greater than or equal to -10 and less than or equal to 10, calculating a luminance value of the R component of the sample image pixel point, and R of the corresponding pixel in the first frame to be compared image The luminance value of the component and the luminance value of the R component of the corresponding pixel point in the third frame to be compared image, the average value between the luminance values of the three R components, and the average value between the luminance values of the three R components is taken as The denoised image corresponds to the luminance value of the R component of the new pixel at the location. If the smart phone determines that the R1 is greater than or equal to -10 and less than or equal to 10, calculating a luminance value of the R component of the pixel of the sample image and an R component of the corresponding pixel in the image to be compared in the first frame. The luminance value is an average value between the luminance values of the two R components, and the average value between the luminance values of the two R components is used as the luminance value of the R component of the new pixel corresponding to the position of the denoised image. (When the R1 and R3 or R2 and R3 or R2 or R3 satisfy the first predetermined range, the processing is as above, and details are not described herein again). The process of processing the brightness value of the G component and the brightness value of the B component by the smart phone is similar to the process of processing the brightness value of the R component, and details are not described herein again. When the smart phone obtains an average value of the R component luminance values, an average value of the G component luminance values, and an average value of the B component luminance values between the sample image and each pixel of the image to be compared, the smart phone The mobile phone uses the average value of the R component luminance values of each pixel as the average of the R component image and the G component luminance value of the denoised image as the average value of the G component image and the B component luminance value of the denoised image. a B component image of the image after noise, the smartphone recombines the R component image, the G component image, and the B component image of the denoised image into a new image, and the recombined new image is denoising After the image. Optionally, referring to FIG. 7 and FIG. 8 , FIG. 7 is a schematic diagram of an image obtained by a terminal without a past noise processing according to an embodiment of the present invention; FIG. 8 is a de-noised image taken by a terminal according to an embodiment of the present invention; A schematic diagram of the resulting image. Comparing the above FIG. 7 with the FIG. 8, it can be seen that the sharpness is significantly improved after the image is denoised.

In this embodiment, the luminance values of the R, G, and B components of the sample image in the image are respectively obtained by comparing the luminance values of the R, G, and B components of the sample image in the terminal, when the R, G, and the R of the sample image are And the difference between the brightness value of the B component and the brightness value of the R, G, and B components of each pixel of the image to be compared is within a first preset range, according to the image to be compared and the sample The average of the R component luminance values between each pixel of the image, the average of the G component luminance values, and the average of the B component luminance values are obtained as denoised images. By denoising the luminance values of the R, G, and B components of the image separately, and recombining the luminance values of the denoised R, G, and B components into new images. The prime point, the new pixel is used as the pixel of the denoised image to obtain the denoised image, which avoids the calculation amount in the image denoising process, the denoising effect is poor, and the image edge detail is easily caused. The problem of loss.

Referring to FIG. 4, FIG. 4 is a schematic diagram of functional modules of a second embodiment of an image denoising apparatus according to the present application. A second embodiment of the image denoising apparatus of the present application is proposed based on the first embodiment.

In this embodiment, the image denoising device further includes:

The calculating module 40 is configured to separately calculate, between the luminance values of the R, G, and B components of each pixel of the sample image, and the luminance values of the R, G, and B components corresponding to each pixel of the image to be compared. a difference, the difference being used as a first difference;

The determining module 50 is configured to determine whether the first difference is not within the first preset range;

When the terminal acquires a luminance value of an R component of each pixel of the sample image and a luminance value of an R component of each pixel of the image to be compared, the terminal calculates a pixel of the sample image. The difference between the luminance value of the R component and the luminance value of the R component of the corresponding pixel in the image to be compared, and the difference is taken as the first difference of the luminance value of the R component. The process of obtaining the first difference between the first difference value of the G component luminance value and the first difference value of the B component luminance value is similar to the process of obtaining the first difference value of the R component luminance value, and details are not described herein again. When the terminal obtains the first difference of the R component luminance values, it is determined whether the first difference of the R component luminance values is within the first preset range. When the terminal acquires the luminance value of the G component of each pixel of the sample image and the luminance value of the B component and the luminance value of the G component and the luminance component of the B component of each pixel of the image to be compared, Processing of the difference between the luminance value of the G component of the sample image pixel point and the luminance value of the B component and the luminance value of the G component of the corresponding pixel in the image to be compared and the luminance value of the B component The process is similar to the difference between the luminance value of the R component of the pixel of the sample image and the luminance value of the R component of the corresponding pixel in the image to be compared. And obtaining, by the smart phone, a difference between a luminance value of an R component of the pixel of the sample image and a luminance value of an R component of a corresponding pixel in three frames of the image to be compared, to obtain the sample image pixel a difference R1 between a luminance value of the R component and a luminance value of the R component of the corresponding pixel in the first frame to be compared; obtaining a luminance value of the R component of the sample image pixel and the second a difference R2 between luminance values of R components of corresponding pixel points in the image to be compared; obtaining a luminance value of the R component of the pixel of the sample image and a corresponding pixel in the image to be compared in the third frame The difference R3 between the luminance values of the R components. The smart phone determines whether the R1, R2, and R3 are greater than or equal to -10 and less than or equal to 10. The difference between the luminance value of the G component of the sample image pixel point and the luminance value of the B component and the luminance value of the G component of the corresponding pixel in the three frames of the image to be compared and the luminance value of the B component The processing of the value is similar to the difference between the luminance value of the R component of the pixel of the sample image and the luminance value of the R component of the corresponding pixel in the three frames of the image to be compared, and details are not described herein again.

The selecting module 60 is configured to select a preset number of pixel points within a preset range of each pixel point of the sample image if the first difference is not within the first preset range;

The second obtaining module 20 is further configured to acquire the brightness values of the R, G, and B components of the preset number of pixels;

When the terminal determines that the first difference of the R component luminance values is not within the first preset range, that is, the luminance value of the R component of the sample image and the luminance of the R component of the image to be compared When the difference between the values is not within the first preset range, the terminal selects a preset number of pixel points within a preset range of each pixel point of the sample image, and acquires the preset Set the luminance value of the R component of the number of pixels. The preset number is set according to the noise level in the shooting scene, and may be set to select a pixel point in a region such as 3*3 or 5*5, centering on the pixel point currently selected by the terminal. . The process and determination of the terminal when the terminal determines that the first difference of the G component luminance value and/or the first difference of the B component luminance value are not within the first preset range The first difference of the R component luminance values is not similar in the first preset range, and details are not described herein again. Optionally, referring to FIG. 9, FIG. 9 is a schematic diagram of a terminal selecting a preset number of pixel points in a preset range of a certain pixel point of a sample image according to an embodiment of the present invention. In the FIG. 9, when the smartphone determines that none of R1, R2, and R3 is in the range of -10 to 10, the smartphone is within 3*3 of the pixel of the sample image. Selecting 8 pixel points, if the smart phone is processing the brightness value of the R component at the position P22 pixel in the sample image, then selecting P11, P12, P12, P21 within the range of the P22 pixel 3*3 8 pixels of P23, P31, P32 and P33. The smart phone acquires the luminance values of the R components of the eight pixel points P11, P12, P12, P21, P23, P31, P32, and P33, respectively. When the smart phone determines that the first difference of the G component luminance value and/or the first difference of the B component luminance value is not in the range of -10 to 10, the processing of the terminal and It is determined that none of R1, R2 and R3 Similar in the range of -10 to 10, and will not be described again here.

The calculating module 40 is further configured to separately calculate, between the luminance values of the R, G, and B components of the preset number of pixel points and the luminance values of the R, G, and B components of the sample image pixel point. The difference, as the second difference;

When the terminal obtains the luminance value of the R component of the preset number of pixel points, calculating a luminance value of the R component of the preset number of pixel points and an R component of the pixel of the sample image pixel a difference between the luminance values, the difference being the second difference of the luminance values of the R component; when the terminal obtains the luminance value of the G component of the preset number of pixels, a difference between a luminance value of a G component of a preset number of pixels and a luminance value of a G component of the pixel of the sample image, and the difference is used as a second difference of the luminance value of the G component; Calculating, when the terminal obtains the brightness value of the B component of the preset number of pixel points, calculating a brightness value of the B component of the preset number of pixel points and a brightness value of the B component of the sample image pixel point The difference between the differences is taken as the second difference of the B component luminance values. Calculating the R component of the P22 pixel in the sample image when the smart phone acquires the luminance values of the R components of the 8 pixels of the P11, P12, P12, P21, P23, P31, P32, and P33. The difference between the luminance value and the luminance values of the R components of the eight pixel points P11, P12, P12, P21, P23, P31, P32, and P33. Optionally, referring to FIG. 10, FIG. 10 is a schematic diagram of luminance values of a R component of a certain pixel point and a preset number of pixel points of a sample image according to an embodiment of the present invention. As can be seen from FIG. 10, the R component of the P22 pixel has a luminance value of 5, the R component of the P11 pixel has a luminance value of 1, and the R component of the P12 pixel has a luminance value of 2. The luminance value of the R component of the P13 pixel is 3, the luminance value of the R component of the P21 pixel is 4, the luminance value of the R component of the P23 pixel is 6, and the R component of the P31 pixel The luminance value is 9, the luminance value of the R component of the P32 pixel is 8, and the luminance value of the R component of the P33 pixel is 7. Calculating, by the smart phone, a luminance value of an R component of a P22 pixel in the sample image and a luminance value of an R component of the eight pixels of the P11, P12, P12, P21, P23, P31, P32, and P33 The difference between them is 4, 3, 2, 1, -1, -4, -3, and -2.

The processing module 30 is further configured to: if the second difference is within the second preset range, according to the preset number of pixels corresponding to the second preset range, The average value of the R component luminance value between each pixel of the sample image, the average value of the G component luminance value, and the B component luminance The average of the values gives the image after denoising.

Optionally, the processing module 30 further includes:

When the terminal obtains a second difference value of the R component luminance value, and determines that the second difference value of the R component luminance value is within the second preset range, acquiring the second preset range Calculating the brightness value of the R component of the preset number of pixels, and calculating the brightness value of the R component of the preset number of pixel points corresponding to the second difference of the R component luminance values. An average value of the R component luminance values of each pixel point of the sample image, and an average value of the R component luminance values is used as a luminance value of the R component of the new pixel point. When the terminal determines that the second difference value of the G component luminance value and/or the second difference value of the B component luminance value is within the second preset range, the processing procedure of the terminal and the determining The process of the second difference of the R component luminance values in the second preset range is similar, and details are not described herein again. The second preset range may be consistent with the first preset range, or may be inconsistent with the first preset range. When the terminal obtains the luminance value of the R component of the new pixel point, the luminance value of the G component, and the luminance value of the B component, the luminance value of the R component of the new pixel point, the luminance value of the G component, and B The luminance values of the components are recombined into new pixel points, and the new pixel points are taken as the pixels of the new image to obtain the new image, which is the denoised image. The smart phone determines a brightness value of an R component of the P22 pixel point and a brightness value of an R component of the P13, P21, P23, and P33 pixel points, when the second preset range is -2 to 2 The difference between the range of -2 and 2 corresponds to the luminance values of the R components of the P13, P21, P23, and P33 pixel points being 3, 4, 6, and 7. The smart phone calculates a luminance value 5 of the R component of the P22 pixel and an R component of the P13, P21, P23, and P33 pixel points The luminance values are average values of 3, 4, 6, and 7, and the average value obtained is 5, and 5 is used as the luminance value of the R component of the pixel position of the denoising image P22. When the smart phone obtains the luminance value of the G component of the pixel position of the denoising image P22 and the luminance value of the B component, the luminance value of the R component of the P22 position pixel point, the luminance value of the G component, and the B component The luminance values are recombined into P22 position pixel points of the denoised image. The smart phone obtains a complete denoised image by this method.

Further, the determining module 50 is further configured to determine whether the second difference is within a second preset range;

When the terminal acquires the second difference value of the R component luminance value, it is determined whether the second difference value of the R component luminance value is within the second preset range. If the second difference of the R component luminance values is not within the second preset range, the terminal discards the second difference of the R component luminance values that are not within the second preset range Corresponding to the brightness value of the R component of the preset number of pixel points. If the smartphone determines that the difference between the luminance value of the R component of the P22 pixel and the luminance value of the R component of the P11, P12, P31, and P32 pixels is not in the range of -2 to 2, Then, the luminance values of the R components of the P11, P12, P31, and P32 pixel points are discarded, and the luminance values of the R components of the P11, P12, P31, and P32 pixel points are not calculated. When the terminal determines that the second difference value of the G component luminance value and/or the second difference value of the B component luminance value is not within the second preset range, the processing process of the terminal and the The process in which the second difference of the R component luminance values is not within the second preset range is similar, and is not described herein again.

The present embodiment passes the difference between the luminance values of the R, G, and B components of each pixel point of the sample image and the luminance values of the R, G, and B components of each pixel of the image to be compared. When not in the first preset range, a preset number of pixel points are selected within a preset range of each pixel point of the sample image, thereby obtaining a denoised image, thereby avoiding the process of denoising the image. The calculation amount is large, the denoising effect is poor, and the problem of image edge detail loss is easily caused.

The embodiment of the invention further provides an image denoising method.

Referring to FIG. 5, FIG. 5 is a schematic flowchart diagram of a first embodiment of an image denoising method according to the present application.

In this embodiment, the image denoising method includes:

In step S10, a continuous multi-frame image captured by the terminal is acquired, and one of the multi-frame images is used as a sample image, and the rest is used as an image to be compared, wherein the format of the multi-frame image is an RGB image format;

When the terminal is photographing using a built-in or external camera, the terminal acquires a continuous multi-frame image during shooting, and one of the multi-frame images is taken as a sample image, and the sample image is removed. The outer image is the image to be compared, and the sample image and the image to be compared are in an RGB image format. The terminal includes, but is not limited to, a smart phone, a personal computer. In this embodiment, the terminal is a smart phone. If the smart phone captures an image in its built-in camera, it acquires four consecutive frames of images, and uses the acquired first frame image as a sample image to acquire the acquired image. The second, third, and fourth frame images are used as images to be compared.

Step S20, respectively acquiring luminance values of R, G, and B components of each pixel of the sample image, and luminance values of R, G, and B components of each pixel of the image to be compared;

Step S30, if the difference between the luminance values of the R, G, and B components of each pixel of the sample image and the luminance values of the R, G, and B components corresponding to each pixel of the image to be compared is Within a predetermined range, denoising is obtained according to an average value of the R component luminance values, an average value of the G component luminance values, and an average value of the B component luminance values between the image to be compared and each pixel point of the sample image. After the image.

Further, the step S30 includes:

If the difference between the luminance values of the R, G, and B components of each pixel of the sample image and the luminance values of the R, G, and B components corresponding to each pixel of the image to be compared is at the first preset And determining, in the range, the brightness values of the R, G, and B components of each pixel of the image to be compared corresponding to the difference in the first preset range;

When the terminal obtains the luminance value of the R component of each pixel point of the sample image and the image to be compared, the luminance value of the G component, and the luminance value of the B component, the R of each pixel of the sample image is obtained. The brightness value of the component is compared with the brightness value of the R component of each pixel of the image to be compared, and the brightness value of the R component of each pixel of the sample image is obtained corresponding to each pixel of the image to be compared. a difference between luminance values of the R component; comparing a luminance value of a G component of each pixel of the sample image with a luminance value of a G component of each pixel of the image to be compared, to obtain the a luminance value of a G component of each pixel of the sample image corresponds to a difference between luminance values of a G component of each pixel of the image to be compared; and a luminance value of a B component of each pixel of the sample image Corresponding to the brightness value of the B component of each pixel of the image to be compared, obtaining a brightness value of the B component of each pixel of the sample image corresponding to the B component of each pixel of the image to be compared Between brightness values Value. Determining, by the terminal, a difference between a luminance value of an R component between each pixel point of the sample image and each pixel of the image to be compared, a difference between a luminance value of a G component, and a luminance value of a B component. Within the first preset range. When the terminal determines that the difference between the R component luminance value between each pixel point of the sample image and each pixel point of the image to be compared, the difference between the G component luminance value and the B component luminance value is Determining, in the first preset range, a luminance value of the R component of the image to be compared corresponding to the difference of the luminance values of the R component in the first preset range, and recording the luminance value of the R0 component; Determining, according to a difference between the G component luminance values in the first preset range, a luminance value of the G component of the image to be compared, as a luminance value of the G0 component; determining to be within the first preset range The difference corresponding to the difference of the B component luminance values The luminance value of the B component of the comparison image is recorded as the luminance value of the B0 component. The terminal calculates an average value of the luminance value of the R component of the sample image and the luminance value of the R0 component to obtain an average value of the luminance values of the R component; and calculates a luminance value of the G component of the sample image and the G0 component. An average value of the luminance values is obtained as an average value of the luminance values of the G components; an average value of the luminance values of the B components of the sample image and the luminance values of the B0 components is calculated to obtain an average value of the luminance values of the B components. The terminal uses the average value of the R component luminance values of each pixel as the average of the R component image and the G component luminance value of the denoised image as the average of the G component image and the B component luminance value of the denoised image. As a B component image of the denoised image, the terminal recombines the R component image, the G component image, and the B component image of the denoised image into a new image, and the recombined new image is Noise after the image. The terminal may further recombine the average value of the R component luminance value, the average value of the G component luminance value, and the average value of the B component luminance value into a new pixel point, and use the new pixel point as a new image. The pixel is obtained, and the new image is obtained, and the new image is the image after denoising. Further, the terminal displays the denoised image output in its screen. The first preset range is determined according to the size of the ambient noise at the time of the current shooting, and may be set to be -10 to 10, or set to -20 to 20.

Obtaining, by the smart phone, a luminance value of a R component of a certain pixel point of the sample image, a luminance value of a G component, and a luminance value of a B component, and obtaining an R component of a corresponding pixel point in the image to be compared in three frames. a luminance value, a luminance value of the G component, and a luminance value of the B component, wherein the smartphone passes the luminance value of the R component of the sample image pixel point and the R component of the corresponding pixel point in the image to be compared in the first frame a luminance value obtained by obtaining a difference between a luminance value of an R component of the pixel of the sample image and a luminance value of an R component of a corresponding pixel in the image to be compared in the first frame, denoted as R1; a luminance value of the R component of the pixel and a luminance value of the R component of the corresponding pixel in the image to be compared in the second frame, to obtain a luminance value of the R component of the pixel of the sample image and the image to be compared in the second frame The difference between the luminance values of the R components of the corresponding pixel points, denoted as R2; the luminance value of the R component of the pixel of the sample image and the R component of the corresponding pixel in the image to be compared in the third frame Brightness value, get the sample The difference between the luminance value of the image pixel of the R component and the luminance contrast value of the third frame to be the corresponding pixel of the R component in the image, referred to as R3. The smart phone determines that the R1, R2, and R3 are in the range of -10 to 10 (in the embodiment, the first preset range takes a value of -10 to 10), that is, the R1, R2 And R3 is greater than or equal to -10 and less than or equal to 10. If the smartphone determines that the R1, R2, and R3 are both If the value is greater than or equal to -10, and less than or equal to 10, the brightness value of the R component of the sample image pixel point, the brightness value of the R component of the corresponding pixel point in the first frame to be compared image, and the second frame to be compared image are calculated. The luminance value of the R component of the corresponding pixel and the luminance value of the R component of the corresponding pixel in the third frame to be compared image, the average value between the luminance values of the four R components, and the luminance values of the four R components The average value between the two is used as the luminance value of the R component of the new pixel corresponding to the position of the denoised image. If the smart phone determines that the R1 and R3 are greater than or equal to -10 and less than or equal to 10, calculating a luminance value of the R component of the sample image pixel point, and R of the corresponding pixel in the first frame to be compared image The luminance value of the component and the luminance value of the R component of the corresponding pixel point in the third frame to be compared image, the average value between the luminance values of the three R components, and the average value between the luminance values of the three R components is taken as The denoised image corresponds to the luminance value of the R component of the new pixel at the location. If the smart phone determines that the R1 is greater than or equal to -10 and less than or equal to 10, calculating a luminance value of the R component of the pixel of the sample image and an R component of the corresponding pixel in the image to be compared in the first frame. The luminance value is an average value between the luminance values of the two R components, and the average value between the luminance values of the two R components is used as the luminance value of the R component of the new pixel corresponding to the position of the denoised image. (When the R1 and R3 or R2 and R3 or R2 or R3 satisfy the first predetermined range, the processing is as above, and details are not described herein again). The process of processing the brightness value of the G component and the brightness value of the B component by the smart phone is similar to the process of processing the brightness value of the R component, and details are not described herein again. When the smart phone obtains an average value of the R component luminance values, an average value of the G component luminance values, and an average value of the B component luminance values between the sample image and each pixel of the image to be compared, the smart phone The mobile phone uses the average value of the R component luminance values of each pixel as the average of the R component image and the G component luminance value of the denoised image as the average value of the G component image and the B component luminance value of the denoised image. a B component image of the image after noise, the smartphone recombines the R component image, the G component image, and the B component image of the denoised image into a new image, and the recombined new image is denoising After the image. Optionally, referring to FIG. 7 and FIG. 8 , FIG. 7 is a schematic diagram of an image obtained by a terminal without a past noise processing according to an embodiment of the present invention; FIG. 8 is a de-noised image taken by a terminal according to an embodiment of the present invention; A schematic diagram of the resulting image. Comparing the above FIG. 7 with the FIG. 8, it can be seen that the sharpness is significantly improved after the image is denoised.

In this embodiment, the luminance values of the R, G, and B components of the sample image in the image are respectively obtained by comparing the luminance values of the R, G, and B components of the sample image in the terminal, when the R, G, and the R of the sample image are The brightness value of the B component and the brightness of the R, G, and B components of each pixel of the image to be compared And the corresponding difference between the values is within the first preset range, according to the average value of the R component luminance values between the image to be compared and each pixel point of the sample image, the average value of the G component luminance values, and B The average of the component luminance values gives the denoised image. By denoising the luminance values of the R, G, and B components of the image respectively, and recombining the luminance values of the denoised R, G, and B components into new pixel points, the new pixel points are used as The method of denoising the pixel points of the image obtains the denoised image, which avoids the problem of large calculation amount, poor denoising effect, and easy loss of image edge detail in the process of denoising the image.

Referring to FIG. 6, FIG. 6 is a schematic flowchart diagram of a second embodiment of an image denoising method according to the present application. The second embodiment of the image denoising method of the present application is proposed based on the first embodiment of the present application.

In this embodiment, the image denoising method further includes:

Step S40, respectively calculating a difference between a luminance value of the R, G, and B components of each pixel of the sample image and a luminance value of the R, G, and B components corresponding to each pixel of the image to be compared, Taking the difference as the first difference;

Step S50, determining whether the first difference is not within the first preset range;

When the terminal acquires a luminance value of an R component of each pixel of the sample image and a luminance value of an R component of each pixel of the image to be compared, the terminal calculates a pixel of the sample image. The difference between the luminance value of the R component and the luminance value of the R component of the corresponding pixel in the image to be compared, and the difference is taken as the first difference of the luminance value of the R component. The process of obtaining the first difference between the first difference value of the G component luminance value and the first difference value of the B component luminance value is similar to the process of obtaining the first difference value of the R component luminance value, and details are not described herein again. When the terminal obtains the first difference of the R component luminance values, it is determined whether the first difference of the R component luminance values is within the first preset range. When the terminal acquires the luminance value of the G component of each pixel of the sample image and the luminance value of the B component and the luminance value of the G component and the luminance component of the B component of each pixel of the image to be compared, Processing of the difference between the luminance value of the G component of the sample image pixel point and the luminance value of the B component and the luminance value of the G component of the corresponding pixel in the image to be compared and the luminance value of the B component The process is similar to the difference between the luminance value of the R component of the pixel of the sample image and the luminance value of the R component of the corresponding pixel in the image to be compared. Obtaining, by the smart phone, a difference between a luminance value of an R component of a pixel of the sample image and a luminance value of an R component of a corresponding pixel in three frames of the image to be compared, to obtain the sample image image a difference R1 between a luminance value of the R component of the prime point and a luminance value of the R component of the corresponding pixel in the first frame to be compared; obtaining a luminance value of the R component of the pixel of the sample image and the a difference R2 between luminance values of R components of corresponding pixel points in the second frame to be compared; obtaining a luminance value of the R component of the pixel of the sample image and a corresponding pixel in the third frame to be compared image The difference R3 between the luminance values of the R components. The smart phone determines whether the R1, R2, and R3 are greater than or equal to -10 and less than or equal to 10. The difference between the luminance value of the G component of the sample image pixel point and the luminance value of the B component and the luminance value of the G component of the corresponding pixel in the three frames of the image to be compared and the luminance value of the B component The processing of the value is similar to the difference between the luminance value of the R component of the pixel of the sample image and the luminance value of the R component of the corresponding pixel in the three frames of the image to be compared, and details are not described herein again.

Step S60: If the first difference is not within the first preset range, select a preset number of pixels within a preset range of each pixel of the sample image;

Step S70, acquiring luminance values of R, G, and B components of the preset number of pixels;

When the terminal determines that the first difference of the R component luminance values is not within the first preset range, that is, the luminance value of the R component of the sample image and the luminance of the R component of the image to be compared When the difference between the values is not within the first preset range, the terminal selects a preset number of pixel points within a preset range of each pixel point of the sample image, and acquires the preset Set the luminance value of the R component of the number of pixels. The preset number is set according to the noise level in the shooting scene, and may be set to select a pixel point in a region such as 3*3 or 5*5, centering on the pixel point currently selected by the terminal. . The process and determination of the terminal when the terminal determines that the first difference of the G component luminance value and/or the first difference of the B component luminance value are not within the first preset range The first difference of the R component luminance values is not similar in the first preset range, and details are not described herein again. Optionally, referring to FIG. 9, FIG. 9 is a schematic diagram of a terminal selecting a preset number of pixel points in a preset range of a certain pixel point of a sample image according to an embodiment of the present invention. In the FIG. 9, when the smartphone determines that none of R1, R2, and R3 is in the range of -10 to 10, the smartphone is within 3*3 of the pixel of the sample image. Selecting 8 pixel points, if the smart phone is processing the brightness value of the R component at the position P22 pixel in the sample image, then selecting P11, P12, P12, P21 within the range of the P22 pixel 3*3 8 pixels of P23, P31, P32 and P33. The smart phone acquires the P11, P12, P12, and P21, respectively. The luminance values of the R components of the eight pixel points P23, P31, P32, and P33. When the smart phone determines that the first difference of the G component luminance value and/or the first difference of the B component luminance value is not in the range of -10 to 10, the processing of the terminal and It is determined that the R1, R2 and R3 are not similar in the range of -10 to 10, and will not be described herein.

Step S80, respectively calculating a difference between a luminance value of the R, G, and B components of the preset number of pixel points and a luminance value of the R, G, and B components of the pixel of the sample image, as a second Difference

Step S90, if the second difference is in the second preset range, according to the preset number of pixel points corresponding to the second preset range and each pixel of the sample image The average of the R component luminance values between the points, the average of the G component luminance values, and the average of the B component luminance values are obtained as denoised images.

Further, the step S90 includes:

Further, the image denoising method further includes:

Determining whether the second difference is within a second preset range;

One of ordinary skill in the art will appreciate that all or part of the steps in the above methods may be passed through the program. The instructions are related to hardware (eg, a processor) that can be stored in a computer readable storage medium, such as a read only memory, a magnetic disk, or an optical disk. Alternatively, all or part of the steps of the above embodiments may be implemented using one or more integrated circuits. Correspondingly, each module/unit in the above embodiment may be implemented in the form of hardware, for example, by implementing an integrated circuit to implement its corresponding function, or may be implemented in the form of a software function module, for example, executing a program stored in the memory by a processor. / instruction to achieve its corresponding function. This application is not limited to any specific form of combination of hardware and software.

The above is only a preferred embodiment of the present application, and is not intended to limit the scope of the patent application, and the equivalent structure or equivalent process transformations made by the specification and the drawings of the present application, or directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of this application.

Industrial applicability

An embodiment of the present application provides an image denoising apparatus and method, which respectively denoises luminance values of R, G, and B components of an image, and then recombines luminance values of the denoised R, G, and B components into The new pixel points, the new pixel point is used as the pixel point of the denoised image to obtain the denoised image, which avoids the calculation amount in the image denoising process, the denoising effect is poor, and the image is easily caused. The problem of loss of edge detail.

Claims

An image denoising device comprising:

a first acquiring module, configured to acquire a continuous multi-frame image captured by the terminal, using one of the multi-frame images as a sample image, and the rest as a to-be-contrast image, wherein the format of the multi-frame image is RGB image format;

a second acquiring module, configured to respectively acquire luminance values of R, G, and B components of each pixel of the sample image, and luminance values of R, G, and B components of each pixel of the image to be compared;

a processing module configured to: if a luminance value of R, G, and B components of each pixel of the sample image is different from a luminance value of R, G, and B components corresponding to each pixel of the image to be compared In the first preset range, according to the average value of the R component luminance value between the image to be compared and each pixel point of the sample image, the average value of the G component luminance value, and the average value of the B component luminance value are obtained. Denoised image.
The image denoising apparatus according to claim 1, wherein the image denoising apparatus further comprises:

a calculation module, configured to separately calculate a difference between a luminance value of the R, G, and B components of each pixel of the sample image and a luminance value of the R, G, and B components corresponding to each pixel of the image to be compared a value, the difference being the first difference;

a determining module, configured to determine whether the first difference is not within the first preset range;

Selecting a module, if the first difference is not within the first preset range, selecting a preset number of pixels within a preset range of each pixel of the sample image;

The second acquiring module is further configured to acquire a brightness value of the R, G, and B components of the preset number of pixels;

The calculating module is further configured to separately calculate a difference between a luminance value of the R, G, and B components of the preset number of pixel points and a luminance value of the R, G, and B components of the sample image pixel point. Value as the second difference;

The processing module is further configured to: if the second difference is within the second preset range, according to the preset number of pixels corresponding to the sample in the second preset range, and the sample The average of the R component luminance values, the average of the G component luminance values, and the average of the B component luminance values between each pixel of the image result in a denoised image.
The image denoising apparatus according to claim 2, wherein the determining module is further configured to determine whether the second difference is within a second preset range;

The image denoising apparatus further includes a discarding module configured to discard the second difference that is not within the second preset range if the second difference is not within the second preset range Corresponding to the preset number of pixels.
The image denoising apparatus according to claim 2, wherein said processing module comprises:

Obtaining, if the second difference is within the second preset range, acquiring the preset number of pixels corresponding to the second difference in the second preset range Luminance values of the R, G, and B components;

a first calculating unit, configured to separately calculate an average value of the obtained R component luminance values between the preset number of pixels and each pixel of the sample image, and an average value and a B component of the G component luminance values The average value of the brightness values;

The first processing unit is configured to recombine the average of the R component luminance values, the average of the G component luminance values, and the average of the B component luminance values into new pixel points to obtain a denoised image.
The image denoising apparatus according to any one of claims 1 to 4, wherein the processing module further comprises:

a determining unit, configured to determine a difference between a luminance value of R, G, and B components of each pixel of the sample image and a luminance value of R, G, and B components corresponding to each pixel of the image to be compared Determining, in the first preset range, brightness values of R, G, and B components of each pixel of the image to be compared corresponding to the difference in the first preset range;

a second calculating unit, configured to respectively calculate an average value of the R component luminance values and an average value of the G component luminance values between the to-be-compared image and the pixel image in the first preset range And the average value of the B component luminance values;

The second processing unit is configured to recombine the average of the R component luminance values, the average of the G component luminance values, and the average of the B component luminance values into new pixel points to obtain a denoised image.
The image denoising apparatus according to claim 1, wherein said second acquisition module is provided And the brightness value of the R component of each pixel in the sample image, the brightness value of the G component, and the brightness value of the B component are acquired, and the image to be compared is obtained. The luminance value of the R component of each pixel, the luminance value of the G component, and the luminance value of the B component.
The image denoising apparatus according to any one of claims 2 to 4, wherein the processing module is further configured to set the preset number according to a noise level in a shooting scene.
The image denoising apparatus according to claim 1, wherein the processing module is further configured to set the first preset range according to a magnitude of ambient noise at the time of shooting.
The image denoising device according to claim 2, wherein the first preset range is consistent with the second preset range.
The image denoising apparatus according to claim 1, wherein said processing module is further arranged to display said denoised image output in a screen.
An image denoising method includes the following steps:

Obtaining a continuous multi-frame image captured by the terminal, using one of the multi-frame images as a sample image, and the rest as an image to be compared, wherein the format of the multi-frame image is an RGB image format;

And acquiring, respectively, brightness values of R, G, and B components of each pixel of the sample image, and brightness values of R, G, and B components of each pixel of the image to be compared;

If the difference between the luminance values of the R, G, and B components of each pixel of the sample image and the luminance values of the R, G, and B components corresponding to each pixel of the image to be compared is at the first preset In the range, the denoised image is obtained according to an average value of the R component luminance value between the pixel to be compared and each pixel point of the sample image, an average value of the G component luminance value, and an average value of the B component luminance value. .
The image denoising method according to claim 11, wherein said respectively acquiring luminance values of R, G, and B components of each pixel of said sample image, and R of each pixel of said image to be compared After the step of luminance values of the G and B components, the image denoising method further includes:

Calculating, respectively, a difference between a luminance value of R, G, and B components of each pixel of the sample image and a luminance value of R, G, and B components corresponding to each pixel of the image to be compared, The difference is taken as the first difference;

Determining whether the first difference is not within the first preset range;

If the first difference is not within the first preset range, selecting a preset number of pixels within a preset range of each pixel of the sample image;

Obtaining brightness values of R, G, and B components of the preset number of pixels;

Calculating, respectively, a difference between a luminance value of the R, G, and B components of the preset number of pixel points and a luminance value of the R, G, and B components of the pixel of the sample image as a second difference;

If the second difference is within the second preset range, according to the preset number of pixels corresponding to the second preset range and each pixel of the sample image The average of the R component luminance values, the average of the G component luminance values, and the average of the B component luminance values are obtained as denoised images.
The image denoising method according to claim 12, wherein said calculating a luminance value of said R, G, and B components of said preset number of pixel points and R, G, and B of said sample image pixel point, respectively After the step of using the difference between the luminance values of the components as the second difference, the image denoising method further includes:

Determining whether the second difference is within a second preset range;

And if the second difference is not in the second preset range, discarding the preset number of pixel points corresponding to the second difference that is not in the second preset range.
The image denoising method according to claim 12, wherein, if the second difference is within a second preset range, the preset is corresponding to the second preset range The step of obtaining the denoised image by the average of the R component luminance values, the average of the G component luminance values, and the average of the B component luminance values between the pixel points of the number of pixels and the pixel of the sample image includes:

If the second difference is within the second preset range, acquiring R, G, and the preset number of pixel points corresponding to the second difference in the second preset range The brightness value of the B component;

Calculating, respectively, an average value of the acquired R component luminance values between the preset number of pixel points and each pixel point of the sample image, an average value of the G component luminance values, and an average value of the B component luminance values;

The average of the R component luminance values, the average of the G component luminance values, and the average of the B component luminance values are recombined into new pixel points to obtain a denoised image.
The image denoising method according to any one of claims 11 to 14, wherein said The difference between the luminance values of the R, G, and B components of each pixel of the sample image and the luminance values of the R, G, and B components corresponding to each pixel of the image to be compared is within a first preset range. And obtaining, according to the average value of the R component luminance value, the average value of the G component luminance value, and the average value of the B component luminance value between the pixel to be compared and the pixel image of the sample image, the step of obtaining the denoised image. include:

If the difference between the luminance values of the R, G, and B components of each pixel of the sample image and the luminance values of the R, G, and B components corresponding to each pixel of the image to be compared is at the first preset And determining, in the range, the brightness values of the R, G, and B components of each pixel of the image to be compared corresponding to the difference in the first preset range;

Calculating, respectively, an average value of the R component luminance values, an average value of the G component luminance values, and an average of the B component luminance values between the to-be-compared image in the first preset range and each pixel point of the sample image value;

The average of the R component luminance values, the average of the G component luminance values, and the average of the B component luminance values are recombined into new pixel points to obtain a denoised image.
The image denoising method according to claim 11, wherein said respectively acquiring luminance values of R, G, and B components of each pixel of said sample image, and R of each pixel of said image to be compared The luminance values of the G and B components include: parsing the sample image and the image to be compared, acquiring a luminance value of an R component, a luminance value of a G component, and a luminance value of a B component of each pixel in the sample image. And acquiring a luminance value of the R component of each pixel in the image to be compared, a luminance value of the G component, and a luminance value of the B component.
The image denoising method according to any one of claims 12 to 14, wherein the image denoising method further comprises: setting the preset number according to a noise level in a shooting scene.
The image denoising method according to claim 11, wherein the image denoising method further comprises: setting the first preset range according to a magnitude of ambient noise at the time of shooting.
The image denoising method according to claim 12, wherein the first preset range is consistent with the second preset range.
The image denoising method according to claim 11, wherein the image denoising method further comprises: displaying the denoised image output in a screen.