WO2017088629A1 - 去除图像彩色噪声的方法及装置、移动终端、存储介质 - Google Patents

去除图像彩色噪声的方法及装置、移动终端、存储介质 Download PDF

Info

Publication number
WO2017088629A1
WO2017088629A1 PCT/CN2016/104271 CN2016104271W WO2017088629A1 WO 2017088629 A1 WO2017088629 A1 WO 2017088629A1 CN 2016104271 W CN2016104271 W CN 2016104271W WO 2017088629 A1 WO2017088629 A1 WO 2017088629A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
filtering
ycbcr
components
color noise
Prior art date
Application number
PCT/CN2016/104271
Other languages
English (en)
French (fr)
Inventor
朱德志
Original Assignee
努比亚技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 努比亚技术有限公司 filed Critical 努比亚技术有限公司
Publication of WO2017088629A1 publication Critical patent/WO2017088629A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/10—Image enhancement or restoration using non-spatial domain filtering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20024—Filtering details
    • G06T2207/20032—Median filtering

Definitions

  • the present invention relates to the field of image noise processing technologies, and in particular, to a method and device for removing image color noise, a mobile terminal, and a storage medium.
  • the main purpose of the embodiments of the present invention is to provide a method and apparatus for removing image color noise, a mobile terminal, and a storage medium, which are intended to effectively remove color noise in an image.
  • a method for removing image color noise includes the following steps:
  • the filtered YCbCr image is spatially converted to obtain a final RGB image.
  • the initial RGB image is: converted by the bayer graph after interpolation processing. To the RGB map.
  • filtering is performed by using a nested iterative filtering method.
  • the nested iterative median filtering method is used for filtering.
  • the pixel operation in the filter window is subjected to a filter operation process in accordance with a calculation method of row and column separation processing.
  • the method before filtering each of the YCbCr image Cb and Cr components, the method further includes: reducing a Cb and a Cr component of the YCbCr image;
  • the Cb and Cr components of the YCbCr image are enlarged to an initial size.
  • the method for reducing the Cb and Cr components of the YCbCr image is to reduce the rows and columns according to the same ratio, and the reduction mode is specifically an interval sampling method.
  • the method for amplifying the Cb and Cr components of the YCbCr image is: performing amplification by using a bilinear interpolation method.
  • an embodiment of the present invention further provides an apparatus for removing image color noise, including:
  • An original image acquisition unit configured to acquire a raw RGB image
  • a space conversion unit configured to convert the original RGB image into a YCbCr image; and convert the filtered YCbCr image into a final RGB image;
  • a filtering unit configured to filter each of the Cb and Cr components in the YCbCr image.
  • the original image obtaining unit is further configured to acquire an RGB image converted by the bayer map after the interpolation processing as the original RGB image.
  • the filtering unit is further configured to filter each pixel in the Cb and Cr components in the YCbCr image by using a nested iterative filtering method.
  • the filtering unit is further configured to filter each pixel in the Cb and Cr components in the YCbCr image by using a nested iterative median filtering method.
  • the filtering unit is further configured to perform a filtering operation process on the operation manner in which the pixel points in the filtering window are separately processed in rows and columns.
  • the filtering unit further includes the following components:
  • the scaling module is configured to reduce the pixels in the Cb and Cr components respectively before filtering the YCbCr image, and then to be amplified to an initial size after being filtered;
  • the filtering processing module is configured to filter the Cb and Cr components of the YCbCr image by using a nested iterative median filtering method, and perform filtering operations on the pixel points in the filtering window according to the row and column separation processing in the operation process. deal with.
  • the scaling module is further configured to reduce the rows and columns according to the same ratio, and the reduction mode is specifically an interval sampling mode.
  • the scaling module is further configured to amplify the Cb and Cr components of the YCbCr image by using a bilinear interpolation method.
  • Embodiments of the present invention also provide a mobile terminal, including the apparatus for removing image color noise as described above.
  • FIG. 1 is a schematic structural diagram of hardware of an optional mobile terminal in implementing various embodiments of the present invention
  • FIG. 2 is a schematic diagram of a wireless communication system of the mobile terminal shown in FIG. 1;
  • FIG. 3 is a flow chart of a method for removing image color noise in a first embodiment of the present invention
  • FIG. 4 is a schematic diagram of a first principle of a nested iterative filtering method according to a first embodiment of the present invention
  • FIG. 5 is a schematic diagram of a second principle of a nested iterative filtering method according to a first embodiment of the present invention
  • FIG. 6 is a flowchart of a method for filtering a YCbCr image in a second embodiment of the present invention
  • FIG. 7 is a structural diagram of an apparatus for removing image color noise in a third embodiment of the present invention.
  • the mobile terminal can be implemented in various forms.
  • the terminal described in the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device, etc.
  • Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like.
  • the terminal is a mobile terminal.
  • those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.
  • FIG. 1 is a schematic diagram showing the hardware structure of an optional mobile terminal in implementing various embodiments of the present invention.
  • the mobile terminal 100 may include a wireless communication unit 110, an A/V (Audio/Video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190. and many more.
  • Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.
  • Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 100 and a wireless communication system or network.
  • the wireless communication unit may include at least one of the mobile communication module 111, the wireless internet module 112, and the short-range communication module 113.
  • the mobile communication module 111 transmits radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server.
  • a base station e.g., an access point, a Node B, etc.
  • Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.
  • the wireless internet module 112 supports wireless internet access for mobile terminals.
  • the module can be internally or externally coupled to the terminal.
  • the wireless Internet access technologies involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (Worldwide Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. .
  • the short-range communication module 113 is a module for supporting short-range communication.
  • Some examples of short-range communication technology include Bluetooth TM, a radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc. TM.
  • the A/V input unit 120 is for receiving an audio or video signal.
  • the A/V input unit 120 may include a camera 121 and a microphone 122 that processes image data of still pictures or video obtained by the image capturing device in a video capturing mode or an image capturing mode.
  • the processed image frame can be displayed on the display unit 151.
  • the image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the configuration of the mobile terminal.
  • the microphone 122 can receive sound (audio data) via a microphone in an operation mode of a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound as audio data.
  • the processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode.
  • the microphone 122 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.
  • the user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal.
  • the user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc.
  • a touch screen can be formed.
  • the sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal.
  • the sensing unit 140 can sense whether the slide type phone is turned on or off.
  • the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device.
  • the interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100.
  • the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more.
  • the identification module may be stored to verify various information used by the user using the mobile terminal 100 and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identity Module (USIM), and the like.
  • the device having the identification module may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 100 via a port or other connection device.
  • the interface unit 170 can be configured to receive input from an external device (eg, data information, power, etc.) and transmit the received input to one or more components within the mobile terminal 100 or can be used at the mobile terminal and external device Transfer data between.
  • the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal 100 or may be used as a transmission of various command signals allowing input from the base to the mobile terminal 100 The path to the terminal.
  • Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal is accurately mounted on the base.
  • Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner.
  • the output unit 150 may include a display unit 151, an audio output module 152, and the like.
  • the display unit 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in the phone call mode, the display unit 151 can display a call or other communication (eg, text) This messaging, multimedia file download, etc.) related user interface (UI) or graphical user interface (GUI). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.
  • UI user interface
  • GUI graphical user interface
  • the display unit 151 can function as an input device and an output device.
  • the display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like.
  • LCD liquid crystal display
  • TFT-LCD thin film transistor LCD
  • OLED organic light emitting diode
  • a flexible display a three-dimensional (3D) display, and the like.
  • 3D three-dimensional
  • Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like.
  • TOLED Transparent Organic Light Emitting Diode
  • the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) .
  • the touch screen can be used to detect touch input pressure as well as touch input position and touch input area.
  • the audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 when the mobile terminal is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, and the like.
  • the audio signal is output as sound.
  • the audio output module 152 can provide audio output (eg, call signal reception sound, message reception sound, etc.) associated with a particular function performed by the mobile terminal 100.
  • the audio output module 152 can include a speaker, a buzzer, and the like.
  • the memory 160 may store a software program or the like for processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, etc.) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.
  • the memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, disk, light Disk and so on.
  • the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
  • the controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like.
  • the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, which may be constructed within the controller 180 or may be configured to be separate from the controller 180.
  • the controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
  • the power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.
  • the various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof.
  • the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle.
  • implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation.
  • the software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by
  • the mobile terminal has been described in terms of its function.
  • a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.
  • the mobile terminal 100 as shown in FIG. 1 may be configured to operate using a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.
  • a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.
  • Such communication systems may use different air interfaces and/or physical layers.
  • air interfaces used by communication systems include, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)). ), Global System for Mobile Communications (GSM), etc.
  • FDMA Frequency Division Multiple Access
  • TDMA Time Division Multiple Access
  • CDMA Code Division Multiple Access
  • UMTS Universal Mobile Telecommunications System
  • LTE Long Term Evolution
  • GSM Global System for Mobile Communications
  • the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.
  • a CDMA wireless communication system can include a plurality of mobile terminals 100, a plurality of base stations (BS) 270, a base station controller (BSC) 275, and a mobile switching center (MSC) 280.
  • the MSC 280 is configured to interface with a public switched telephone network (PSTN) 290.
  • PSTN public switched telephone network
  • the MSC 280 is also configured to interface with a BSC 275 that can be coupled to the base station 270 via a backhaul line.
  • the backhaul line can be constructed in accordance with any of a number of well known interfaces including, for example, E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. It will be appreciated that the system as shown in FIG. 2 may include multiple BSC 2750s.
  • Each BS 270 can serve one or more partitions (or regions), each of which is covered by a multi-directional antenna or an antenna directed to a particular direction radially away from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS 270 can be configured to support multiple frequency allocations, and each frequency allocation has a particular frequency spectrum (eg, 1.25 MHz, 5 MHz, etc.).
  • BS 270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology.
  • BTS Base Transceiver Subsystem
  • the term "base station” can be used to generally refer to a single BSC 275 and at least one BS 270.
  • a base station can also be referred to as a "cell station.”
  • each partition of a particular BS 270 may be referred to as a plurality of cellular stations.
  • GPS Global Positioning System
  • BS 270 receives reverse link signals from various mobile terminals 100.
  • Mobile terminal 100 typically participates in calls, messaging, and other types of communications.
  • Each reverse link signal received by a particular base station 270 is processed within a particular BS 270.
  • the obtained data is forwarded to the relevant BSC 275.
  • the BSC provides call resource allocation and coordinated mobility management functions including a soft handoff procedure between the BSs 270.
  • the BSC 275 also routes the received data to the MSC 280, which provides additional routing services for interfacing with the PSTN 290.
  • PSTN290 and The MSC 280 forms an interface
  • the MSC forms an interface with the BSC 275
  • the BSC 275 controls the BS 270 accordingly to transmit a forward link signal to the mobile terminal 100.
  • a first embodiment of the present invention provides a method for removing image color noise, including:
  • Step 301 Acquire an initial RGB image.
  • the purpose of removing color noise is achieved by algorithm post-processing. Therefore, the RGB image obtained by the Bayer graph after interpolation processing is obtained at the initial time of the process.
  • Step 302 Perform color space conversion on the initial RGB image: convert the RGB color space into a YCbCr color space to obtain a YCbCr image.
  • Step 303 Filter each pixel in the Cb and Cr components in the YCbCr image.
  • the present embodiment achieves the purpose of removing color noise by filtering CbCr.
  • the specific filtering method is:
  • the basic principle is to replace the value of a point in the digital image with the median value of each point value in a neighborhood of the point, so that the surrounding pixel values are close to the true value, thereby eliminating isolated noise points.
  • the filter window size is 3X 3
  • the pixel to be processed is the center pixel in this window.
  • the median value of the nine values in this window is used instead of the value of the center point, which is the median filter.
  • the more common median filtering mode is utilized.
  • other filtering methods than the median filtering may be used, and the objects of the embodiments of the present invention may be implemented.
  • the basic principle is to participate in the previous filtering method in the filtering method, which can improve the filtering effect.
  • the nested iteration principle is illustrated by taking the 3X 3 filter window size as an example.
  • the filtering window is shown by the black box in Figure 4, and the filtering center point in the black box is P22.
  • the midpoint P22' of the nine values in the black box is used instead of P22, that is, a median filtering is performed.
  • the traditional filtering method directly uses the P22 point to participate in the calculation of the P23 point
  • the nesting iteration directly uses the filtering result P22' of the P22 to participate in the P23.
  • the filtering is as shown in Figure 5.
  • the method of simultaneously performing the mean processing on all the pixels in the filtering window is adopted; in this embodiment, the operation method of separately processing the pixel points in the filtering window according to the row and the column is adopted. This can greatly reduce the amount of calculation and increase the processing speed.
  • the image is subjected to 9*9 mean filtering. If processed in the traditional way, it is necessary to average the 81 values at a time. However, if the row and column separation processing methods are used in the embodiment, the 9 pixels of the same row are first averaged, and the column is subjected to the mean processing of 9 pixels on the basis of the row processing, so that only 18 pixels need to be processed. The average processing of the data can complete the 9*9 mean filtering, which greatly reduces the amount of computation.
  • Step 304 Convert the filtered YCbCr image into an RGB image.
  • the conversion process can be performed according to the following formula:
  • the purpose of removing color noise is achieved mainly by spatial conversion and filtering of CbCr. Since the color noise mainly exhibits extremely unevenness on the Cb and Cr components, the present embodiment achieves the purpose of removing color noise by filtering CbCr, and adopts a nested iterative median filtering method and an image row and column separation processing method. , further improve the denoising effect, reduce In addition, since the Y component is not subjected to filtering processing in this embodiment, the sharpness of the image is maintained.
  • the process of “Step 303, filtering each pixel in the Cb and Cr components in the YCbCr image” in the first embodiment is improved, and a new one is adopted. Filtering process.
  • the filtering method of the pattern is adopted for Cb and Cr. Therefore, the filtering process of Cb will be described in detail below, and the processing of Cr will not be described again, as shown in FIG. 6, including steps:
  • Step 601 Perform a reduction process on the original Cb component in the YCbCr image.
  • the reduction ratio is not limited, and can be reduced to 1/16 of the original, that is, the row and the column are respectively reduced to 1/4 of the original; the reduction mode can be adopted as the interval, and one pixel is taken every four pixels.
  • the method of narrowing down and reducing the size can be other methods, and is not limited thereto.
  • Step 602 Perform filtering processing on each pixel point in the reduced Cb component by using a nested iterative median filtering method and an image row and column separation processing manner.
  • Step 603 Perform amplification processing on the filtered Cb component.
  • the amplification algorithm can adopt a bilinear interpolation algorithm, taking the horizontal 5 numbers as an example, namely, A1a2, a3, a4, and A5. It is currently known that A1 and A5, a2, a3, and a4 are obtained by interpolation:
  • A4 (A1+3*A5)/4.
  • the CbCr is first reduced, and then amplified after being filtered. Since the CbCr operation does not affect the resolution of the image, first reducing and re-amplifying can significantly increase the calculation speed and effect. For example, if the original image size is filtered, the filter window size is 12*12; if the image row and column are reduced to the original 1/2, so that only 6*6 size filtering is needed on the reduced image, The effect of filtering to the original image 12*12.
  • the embodiment of the invention further provides a computer readable storage medium, the storage medium comprising a set of instructions for performing the method for removing image color noise according to the first embodiment or the second embodiment.
  • the embodiment of the present invention further provides an apparatus 700 for removing image color noise.
  • the method includes:
  • the original image obtaining unit 710 is configured to acquire the original RGB image
  • a space conversion unit 720 configured to convert the original RGB image into a YCbCr image; and convert the filtered YCbCr image into a final RGB image;
  • the filtering unit 730 is configured to filter each of the Cb and Cr components in the YCbCr image.
  • the original image obtaining unit is further configured to acquire an RGB image converted by the bayer map after the interpolation processing as the original RGB image.
  • the filtering unit is further configured to filter each pixel in the Cb and Cr components in the YCbCr image by using a nested iterative filtering method.
  • the filtering unit is further configured to filter each pixel in the Cb and Cr components in the YCbCr image by using a nested iterative median filtering method.
  • the filtering unit is further configured to perform a filtering operation process on the operation manner of the pixel points in the filtering window according to the row and column separation processing.
  • the filtering unit 730 further includes the following components:
  • the scaling module 731 is configured to reduce the Cb and Cr components respectively before the filtering process of the YCbCr image, and then perform amplification to an initial size after being filtered;
  • the filter processing module 732 is configured to filter the Cb and Cr components of the YCbCr image by using a nested iterative median filtering method, and separate operations according to the row and column in the operation process.
  • the scaling module is further configured to reduce the rows and columns according to the same ratio, and the reduction mode is specifically an interval sampling mode.
  • the scaling module is further configured to amplify the Cb and Cr components of the YCbCr image by using a bilinear interpolation method.
  • the removal of color noise in the RGB image is achieved, and a good denoising effect can be obtained without affecting the sharpness of the original image.
  • the original image obtaining unit 710, the spatial converting unit 720, and the filtering unit 730 may each be a central processing unit (CPU), or a digital signal processing (DSP), or field programmable.
  • CPU central processing unit
  • DSP digital signal processing
  • An FPGA Field Programmable Gate Array
  • the CPU, DSP, and FPGA can be built in a device that removes image color noise.
  • the embodiment further provides a mobile terminal, where the mobile terminal includes the apparatus 700 in the third embodiment. Since the mobile terminal has a photo application, the device for removing image color noise in the embodiment is applied to the mobile terminal to implement the photo denoising function, which can meet the user's use requirements and improve the user experience.
  • the mobile terminal can be specifically: a mobile phone, an IPAD, a tablet computer, and the like.
  • the method and device for removing image color noise, the mobile terminal and the storage medium proposed by the embodiments of the present invention have the following beneficial effects:
  • the embodiment of the present invention achieves the purpose of removing color noise by filtering CbCr, and does not process the Y component, thereby ensuring image sharpness. .
  • the embodiment of the present invention adopts a nested iterative median filtering method, which can greatly improve the denoising effect compared with the traditional median filtering method;
  • the embodiment of the present invention applies an operation method in which image rows and columns are separately processed, and firstly applies to CbCr.
  • the reduction is performed, and the amplification is performed after being filtered, which greatly reduces the amount of calculation and significantly increases the processing speed.
  • the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better.
  • Implementation Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk,
  • the optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the methods described in various embodiments of the present invention.
  • the embodiment of the present invention since the color noise mainly exhibits extremely unevenness on the Cb and Cr components, the embodiment of the present invention achieves the purpose of removing color noise by filtering the CbCr, and does not process the Y component, thereby ensuring image clarity. degree.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

一种去除图像彩色噪声的方法、装置、移动终端（100）及存储介质，所述方法包括：获取初始RGB图像（301）；将初始RGB图像进行色彩空间转换，得到YCbCr图像（302）；对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波（303）。将经滤波后的YCbCr图像进行空间转换为RGB图像（304）。由于彩色噪声主要表现在Cb和Cr分量上的极度不平滑，因而该方法通过对CbCr进行滤波来达到去除彩色噪声的目的，同时保证了图像的清晰度。

Description

去除图像彩色噪声的方法及装置、移动终端、存储介质 技术领域
本发明涉及图像噪声处理技术领域，尤其涉及一种去除图像彩色噪声的方法及装置、移动终端、存储介质。
背景技术
现有的大部分图像传感器如CMOS，在获取图像过程中，只能获取bayer图，该图中每个像素点只有一个颜色，或R或G或B，即RGB三个通道数据中的一种；在获取bayer图之后，对于其中的每个像素点，需要借助这个像素点周围的颜色对它进行插值另外的两种颜色(它本身的颜色就不用插了)，从而最终将bayer图转换为完整的RGB图。在此转换过程中，如果在对数据进行插值之前，不对bayer数据进行去噪，插值结果中就会出现大量的彩色噪声，严重影响图像的视觉效果，而即便对数据进行插值之前对bayer数据进行去噪，也很难去除彻底，最终的RGB图像还是会有大量彩色噪声。
发明内容
本发明实施例的主要目的在于提出一种去除图像彩色噪声的方法及装置、移动终端、存储介质，旨在有效去除图像中的彩色噪声。
为实现上述目的，本发明实施例提供的一种去除图像彩色噪声的方法，包括步骤：
获取初始RGB图像；
将所述初始RGB图像进行色彩空间转换，得到YCbCr图像；
对所述YCbCr图像中Cb、Cr分量中的每个像素点进行滤波；
将经滤波处理后的YCbCr图像进行空间转换，得到最终RGB图像。
上述方案中，所述初始RGB图像为：由bayer图经过插值处理后转换得 到的RGB图。
上述方案中，在所述对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波的步骤中，采用嵌套迭代滤波方式进行滤波。
上述方案中，在所述对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波的步骤中，采用嵌套迭代式中值滤波方式进行滤波。
上述方案中，在所述对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波的步骤中，对滤波窗口内的像素点按照行、列分开处理的运算方式进行滤波运算处理。
上述方案中，在对所述YCbCr图像Cb、Cr分量中的每个像素点进行滤波之前，还包括：对所述YCbCr图像的Cb、Cr分量进行缩小；
在对缩小的YCbCr图像Cb、Cr分量中的每个像素点进行滤波之后，对该YCbCr图像的Cb、Cr分量进行放大至初始大小。
上述方案中，所述对YCbCr图像的Cb、Cr分量进行缩小的方法为：按照同等比例对行、列分别进行缩小，缩小方式具体为间隔采样方式。
上述方案中，所述对YCbCr图像的Cb、Cr分量进行放大的方法为：采用双线性插值方式进行放大。
此外，为实现上述目的，本发明实施例还提出一种去除图像彩色噪声的装置，包括：
原始图像获取单元，配置为获取原始RGB图像；
空间转换单元，配置为将原始RGB图像转换为YCbCr图像；以及，将经滤波处理后的YCbCr图像转换为最终RGB图像；
滤波单元，配置为对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波。
上述方案中，所述原始图像获取单元，还配置为获取由bayer图经过插值处理后转换得到的RGB图像作为所述原始RGB图像。
上述方案中，所述滤波单元，还配置为采用嵌套迭代滤波方式对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波。
上述方案中，所述滤波单元，还配置为采用嵌套迭代式中值滤波方式对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波。
上述方案中，所述滤波单元，还配置为对滤波窗口内的像素点按照行、列分开处理的运算方式进行滤波运算处理。
上述方案中，所述滤波单元进一步包括以下组成部分：
缩放模块，配置为在对YCbCr图像进行滤波处理前，对其Cb、Cr分量中的像素分别缩小，待滤波后再进行放大至初始大小；
滤波处理模块，配置为采用嵌套迭代的中值滤波方式对YCbCr图像的Cb、Cr分量进行滤波，且在运算过程中对滤波窗口内的像素点按照行、列分开处理的运算方式进行滤波运算处理。
上述方案中，所述缩放模块，还配置为按照同等比例对行、列分别进行缩小，缩小方式具体为间隔采样方式。
上述方案中，所述缩放模块，还配置为采用双线性插值方式对YCbCr图像的Cb、Cr分量进行放大。
本发明实施例还提出一种移动终端，包括如上任一所述的去除图像彩色噪声的装置。
本发明实施例所述的去除图像彩色噪声的方法及装置、移动终端、存储介质，由于彩色噪声主要表现在Cb和Cr分量上的极度不平滑，因而本发明实施例通过对CbCr进行滤波来达到去除彩色噪声的目的，且不对Y分量进行处理，保证了图像的清晰度。
附图说明
图1为实现本发明各个实施例中一个可选的移动终端的硬件结构示意图；
图2为如图1所示的移动终端的无线通信系统示意图；
图3为本发明第一实施例中去除图像彩色噪声的方法流程图；
图4为本发明第一实施例中嵌套迭代滤波方式的第一原理示意图；
图5为本发明第一实施例中嵌套迭代滤波方式的第二原理示意图；
图6为本发明第二实施例中对YCbCr图像滤波的方法流程图；
图7为本发明第三实施例中去除图像彩色噪声的装置结构图；
本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。
具体实施方式
应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。
现在将参考附图描述实现本发明各个实施例的移动终端。在后续的描述中，使用用于表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本发明的说明，其本身并没有特定的意义。因此，"模块"与"部件"可以混合地使用。
移动终端可以以各种形式来实施。例如，本发明中描述的终端可以包括诸如移动电话、智能电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、导航装置等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。下面，假设终端是移动终端。然而，本领域技术人员将理解的是，除了特别用于移动目的的元件之外，根据本发明的实施方式的构造也能够应用于固定类型的终端。
图1为实现本发明各个实施例中一个可选的移动终端的硬件结构示意图。
移动终端100可以包括无线通信单元110、A/V(音频/视频)输入单元120、用户输入单元130、感测单元140、输出单元150、存储器160、接口单元170、控制器180和电源单元190等等。图1示出了具有各种组件的移动终端，但是应理解的是，并不要求实施所有示出的组件。可以替代地实施更多或更少的组件。将在下面详细描述移动终端的元件。
无线通信单元110通常包括一个或多个组件，其允许移动终端100与无线通信系统或网络之间的无线电通信。例如，无线通信单元可以包括移动通信模块111、无线互联网模块112、短程通信模块113中的至少一个。
移动通信模块111将无线电信号发送到基站(例如，接入点、节点B等等)、外部终端以及服务器中的至少一个和/或从其接收无线电信号。这样的无线电信号可以包括语音通话信号、视频通话信号、或者根据文本和/或多媒体消息发送和/或接收的各种类型的数据。
无线互联网模块112支持移动终端的无线互联网接入。该模块可以内部或外部地耦接到终端。该模块所涉及的无线互联网接入技术可以包括WLAN(无线LAN)(Wi-Fi)、Wibro(无线宽带)、Wimax(全球微波互联接入)、HSDPA(高速下行链路分组接入)等等。
短程通信模块113是用于支持短程通信的模块。短程通信技术的一些示例包括蓝牙TM、射频识别(RFID)、红外数据协会(IrDA)、超宽带(UWB)、紫蜂TM等等。
A/V输入单元120用于接收音频或视频信号。A/V输入单元120可以包括相机121和麦克风122，相机121对在视频捕获模式或图像捕获模式中由图像捕获装置获得的静态图片或视频的图像数据进行处理。处理后的图像帧可以显示在显示单元151上。经相机121处理后的图像帧可以存储在存储器160(或其它存储介质)中或者经由无线通信单元110进行发送，可以根据移动终端的构造提供两个或更多相机121。麦克风122可以在电话通话模式、记录模式、语音识别模式等等运行模式中经由麦克风接收声音(音频数据)，并且能够将这样的声音处理为音频数据。处理后的音频(语音)数据可以在电话通话模式的情况下转换为可经由移动通信模块112发送到移动通信基站的格式输出。麦克风122可以实施各种类型的噪声消除(或抑制)算法以消除(或抑制)在接收和发送音频信号的过程中产生的噪声或者干扰。
用户输入单元130可以根据用户输入的命令生成键输入数据以控制移动终端的各种操作。用户输入单元130允许用户输入各种类型的信息，并且可以包括键盘、锅仔片、触摸板(例如，检测由于被接触而导致的电阻、压力、电容等等的变化的触敏组件)、滚轮、摇杆等等。特别地，当触摸板以层的形式叠加在显示单元151上时，可以形成触摸屏。
感测单元140检测移动终端100的当前状态，(例如，移动终端100的打开或关闭状态)、移动终端100的位置、用户对于移动终端100的接触(即，触摸输入)的有无、移动终端100的取向、移动终端100的加速或减速移动和方向等等，并且生成用于控制移动终端100的操作的命令或信号。例如，当移动终端100实施为滑动型移动电话时，感测单元140可以感测该滑动型电话是打开还是关闭。另外，感测单元140能够检测电源单元190是否提供电力或者接口单元170是否与外部装置耦接。
接口单元170用作至少一个外部装置与移动终端100连接可以通过的接口。例如，外部装置可以包括有线或无线头戴式耳机端口、外部电源(或电池充电器)端口、有线或无线数据端口、存储卡端口、用于连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。识别模块可以是存储用于验证用户使用移动终端100的各种信息并且可以包括用户识别模块(UIM)、客户识别模块(SIM)、通用客户识别模块(USIM)等等。另外，具有识别模块的装置(下面称为"识别装置")可以采取智能卡的形式，因此，识别装置可以经由端口或其它连接装置与移动终端100连接。接口单元170可以用于接收来自外部装置的输入(例如，数据信息、电力等等)并且将接收到的输入传输到移动终端100内的一个或多个元件或者可以用于在移动终端和外部装置之间传输数据。
另外，当移动终端100与外部底座连接时，接口单元170可以用作允许通过其将电力从底座提供到移动终端100的路径或者可以用作允许从底座输入的各种命令信号通过其传输到移动终端的路径。从底座输入的各种命令信号或电力可以用作用于识别移动终端是否准确地安装在底座上的信号。输出单元150被构造为以视觉、音频和/或触觉方式提供输出信号(例如，音频信号、视频信号、警报信号、振动信号等等)。输出单元150可以包括显示单元151、音频输出模块152等等。
显示单元151可以显示在移动终端100中处理的信息。例如，当移动终端100处于电话通话模式时，显示单元151可以显示与通话或其它通信(例如，文 本消息收发、多媒体文件下载等等)相关的用户界面(UI)或图形用户界面(GUI)。当移动终端100处于视频通话模式或者图像捕获模式时，显示单元151可以显示捕获的图像和/或接收的图像、示出视频或图像以及相关功能的UI或GUI等等。
同时，当显示单元151和触摸板以层的形式彼此叠加以形成触摸屏时，显示单元151可以用作输入装置和输出装置。显示单元151可以包括液晶显示器(LCD)、薄膜晶体管LCD(TFT-LCD)、有机发光二极管(OLED)显示器、柔性显示器、三维(3D)显示器等等中的至少一种。这些显示器中的一些可以被构造为透明状以允许用户从外部观看，这可以称为透明显示器，典型的透明显示器可以例如为TOLED(透明有机发光二极管)显示器等等。根据特定想要的实施方式，移动终端100可以包括两个或更多显示单元(或其它显示装置)，例如，移动终端可以包括外部显示单元(未示出)和内部显示单元(未示出)。触摸屏可用于检测触摸输入压力以及触摸输入位置和触摸输入面积。
音频输出模块152可以在移动终端处于呼叫信号接收模式、通话模式、记录模式、语音识别模式、广播接收模式等等模式下时，将无线通信单元110接收的或者在存储器160中存储的音频数据转换音频信号并且输出为声音。而且，音频输出模块152可以提供与移动终端100执行的特定功能相关的音频输出(例如，呼叫信号接收声音、消息接收声音等等)。音频输出模块152可以包括扬声器、蜂鸣器等等。
存储器160可以存储由控制器180执行的处理和控制操作的软件程序等等，或者可以暂时地存储己经输出或将要输出的数据(例如，电话簿、消息、静态图像、视频等等)。而且，存储器160可以存储关于当触摸施加到触摸屏时输出的各种方式的振动和音频信号的数据。
存储器160可以包括至少一种类型的存储介质，所述存储介质包括闪存、硬盘、多媒体卡、卡型存储器(例如，SD或DX存储器等等)、随机访问存储器(RAM)、静态随机访问存储器(SRAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、可编程只读存储器(PROM)、磁性存储器、磁盘、光 盘等等。而且，移动终端100可以与通过网络连接执行存储器160的存储功能的网络存储装置协作。
控制器180通常控制移动终端的总体操作。例如，控制器180执行与语音通话、数据通信、视频通话等等相关的控制和处理。另外，控制器180可以包括用于再现(或回放)多媒体数据的多媒体模块181，多媒体模块181可以构造在控制器180内，或者可以构造为与控制器180分离。控制器180可以执行模式识别处理，以将在触摸屏上执行的手写输入或者图片绘制输入识别为字符或图像。
电源单元190在控制器180的控制下接收外部电力或内部电力并且提供操作各元件和组件所需的适当的电力。
这里描述的各种实施方式可以以使用例如计算机软件、硬件或其任何组合的计算机可读介质来实施。对于硬件实施，这里描述的实施方式可以通过使用特定用途集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理装置(DSPD)、可编程逻辑装置(PLD)、现场可编程门阵列(FPGA)、处理器、控制器、微控制器、微处理器、被设计为执行这里描述的功能的电子单元中的至少一种来实施，在一些情况下，这样的实施方式可以在控制器180中实施。对于软件实施，诸如过程或功能的实施方式可以与允许执行至少一种功能或操作的单独的软件模块来实施。软件代码可以由以任何适当的编程语言编写的软件应用程序(或程序)来实施，软件代码可以存储在存储器160中并且由控制器180执行。
至此，己经按照其功能描述了移动终端。下面，为了简要起见，将描述诸如折叠型、直板型、摆动型、滑动型移动终端等等的各种类型的移动终端中的滑动型移动终端作为示例。因此，本发明能够应用于任何类型的移动终端，并且不限于滑动型移动终端。
如图1中所示的移动终端100可以被构造为利用经由帧或分组发送数据的诸如有线和无线通信系统以及基于卫星的通信系统来操作。
现在将参考图2描述其中根据本发明的移动终端能够操作的通信系统。
这样的通信系统可以使用不同的空中接口和/或物理层。例如，由通信系统使用的空中接口包括例如频分多址(FDMA)、时分多址(TDMA)、码分多址(CDMA)和通用移动通信系统(UMTS)(特别地，长期演进(LTE))、全球移动通信系统(GSM)等等。作为非限制性示例，下面的描述涉及CDMA通信系统，但是这样的教导同样适用于其它类型的系统。
参考图2，CDMA无线通信系统可以包括多个移动终端100、多个基站(BS)270、基站控制器(BSC)275和移动交换中心(MSC)280。MSC280被构造为与公共电话交换网络(PSTN)290形成接口。MSC280还被构造为与可以经由回程线路耦接到基站270的BSC275形成接口。回程线路可以根据若干己知的接口中的任一种来构造，所述接口包括例如E1/T1、ATM，IP、PPP、帧中继、HDSL、ADSL或xDSL。将理解的是，如图2中所示的系统可以包括多个BSC2750。
每个BS270可以服务一个或多个分区(或区域)，由多向天线或指向特定方向的天线覆盖的每个分区放射状地远离BS270。或者，每个分区可以由用于分集接收的两个或更多天线覆盖。每个BS270可以被构造为支持多个频率分配，并且每个频率分配具有特定频谱(例如，1.25MHz,5MHz等等)。
分区与频率分配的交叉可以被称为CDMA信道。BS270也可以被称为基站收发器子系统(BTS)或者其它等效术语。在这样的情况下，术语"基站"可以用于笼统地表示单个BSC275和至少一个BS270。基站也可以被称为"蜂窝站"。或者，特定BS270的各分区可以被称为多个蜂窝站。
在图2中，示出了几个全球定位系统(GPS)卫星300。卫星300帮助定位多个移动终端100中的至少一个。
作为无线通信系统的一个典型操作，BS270接收来自各种移动终端100的反向链路信号。移动终端100通常参与通话、消息收发和其它类型的通信。特定基站270接收的每个反向链路信号被在特定BS270内进行处理。获得的数据被转发给相关的BSC275。BSC提供通话资源分配和包括BS270之间的软切换过程的协调的移动管理功能。BSC275还将接收到的数据路由到MSC280，其提供用于与PSTN290形成接口的额外的路由服务。类似地，PSTN290与 MSC280形成接口，MSC与BSC275形成接口，并且BSC275相应地控制BS270以将正向链路信号发送到移动终端100。
基于上述移动终端硬件结构以及通信系统，提出本发明方法各个实施例。
如图3所示，本发明第一实施例提出一种去除图像彩色噪声的方法，包括：
步骤301、获取初始RGB图像。
本实施例中，通过算法后处理来达到去除彩色噪声的目的，因而本流程初始时刻获取的是由bayer图经过插值处理后转换得到的RGB图。
步骤302、将初始RGB图像进行色彩空间转换：由RGB色彩空间转换为YCbCr色彩空间，得到YCbCr图像。
本步骤中，空间转换按照以下公式进行：
Y＝0.299*R+0.587*G+0.114*B
Cb＝-0.169*R-0.331*G+0.500*B
Cr＝0.500*R-0.419*G-0.081*B
当然，空间转换可以采用其他方式，此处不做限制。
步骤303、对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波。
通过分析发现，彩色噪声主要表现在Cb和Cr分量上的极度不平滑，因而本实施例通过对CbCr进行滤波达到去除彩色噪声的目的。
本步骤中，具体的滤波方法为：
(1)采用嵌套迭代的中值滤波方式。
①中值滤波，其基本原理是把数字图像中一点的值用该点的一个邻域中各点值的中值代替，让周围的像素值接近真实值，从而消除孤立的噪声点。例如：如果滤波窗口大小为3X 3，待处理像素为此窗口内的中心像素，此时利用此窗口中九个值的中值来代替中心点的值，即为中值滤波。
当然，在本实施例中利用了较为常见的中值滤波方式，在其他实施例中，也可采用除中值滤波以外的其他滤波方式，均可以实现本发明实施例的目的。
②嵌套迭代，其基本原理是将前面的滤波处理结果参与到后面的滤波方法中，这样可以提升滤波效果。
以3X 3滤波窗口大小为例来说明嵌套迭代原理。初始时刻，滤波窗口如图4中的黑色框所示，黑色框里滤波中心点为P22，本实施例用黑色框里九个值的中点P22′来替代P22，即进行了一次中值滤波；而在对灰色框中心点进行滤波时，因为灰色框也包含P22点，传统滤波方法是直接利用P22点参与P23点的计算，而嵌套迭代是直接利用P22的滤波结果P22′来参与P23的滤波，即如图5所示。
本步骤中，通过对Cb、Cr分量中的每个像素点进行嵌套迭代的中值滤波，可有效去除彩色噪声，与传统的中值滤波方式相比，可大大提升滤波效果。
(2)采用图像行列分开处理的运算方式。
在传统的中值滤波过程中，采用的是对滤波窗口内全部像素点同时进行均值处理的方式；而本实施例中，采用的对滤波窗口内的像素点按照行、列分开处理的运算方式，这样可以大大减少运算量，提高处理速度。
例如，对图像进行9*9的均值滤波。如果按照传统方式处理，就需要一次对81个值进行均值处理。而如果采用本实施例的按照行、列分开处理方式，先对同一行的9个像素进行均值处理，在行处理的基础上再对列进行9个像素的均值处理，这样只需进行18个数据的均值处理，就可完成9*9的均值滤波，相比之下大大减小了运算量。
步骤304、将经滤波后的YCbCr图像转换为RGB图像。
本步骤中，转换过程可按照以下公式来执行：
R＝Y-1.402*Cb
G＝Y-0.344*Cb-0.714*Cr
B＝Y+1.177*Cb
在上述流程中，主要通过空间转换、对CbCr进行滤波来达到去除彩色噪声的目的。由于彩色噪声主要表现在Cb和Cr分量上的极度不平滑，因而本实施例通过对CbCr进行滤波达到去除彩色噪声的目的，并且采用嵌套迭代的中值滤波方式以及图像行列分开处理的运算方式，进一步提升去噪效果、减 少运算量；另外，由于本实施例不对Y分量进行滤波处理使得保持了图像的清晰度。
实施例二
在本实施例二中，为进一步提升计算速度和效果，将针对实施例一中的“步骤303、对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波”过程进行改进，采用新的滤波过程。在实际处理中，对Cb、Cr采用图样的滤波方法，因而下面将详细介绍对Cb的滤波处理过程，对Cr的处理过程不再赘述，如图6所示，包括步骤：
步骤601、对YCbCr图像中的原始Cb分量进行缩小处理。
本步骤中，缩小比例不限定，可以缩小为原来的1/16，即行、列分别缩小为原来的1/4；缩小方式可以为间隔采用，每四个像素点中取一个像素点。当然，缩小比例和缩小方式可以采用其他方式，不局限于此。
步骤602、采用嵌套迭代的中值滤波方式、以及图像行列分开处理的运算方式对缩小处理后的Cb分量中每个像素点进行滤波处理。
在本步骤中，嵌套迭代的中值滤波过程以及图像行列分开处理的运算方式与实施例一中完全相同，此处不再赘述。
步骤603、对滤波后的Cb分量进行放大处理。
本步骤中，放大算法可采用双线性插值算法，以水平5个数为例，即A1a2、a3、a4、A5，当前知道A1和A5，a2、a3、a4通过插值得到：
a2＝(3*A1+A5)/4；
a3＝(A1+A5)/2；
a4＝(A1+3*A5)/4。
至此，完成对Cb分量的缩小、滤波、放大处理。
通过上述方法，先对CbCr进行缩小，待滤波后再进行放大。由于对CbCr操作不影响图像的分辨率，故先缩小再放大能显著提升计算速度和效果。例如，如果在原图像大小进行滤波，滤波窗口大小为12*12；如果将图像行列分别缩小为原来的1/2，这样在缩小的图像上只需进行6*6大小的滤波，就可达 到原图像12*12滤波的效果。
本发明实施例还提出一种计算机可读存储介质，该存储介质包括一组指令，所述指令用于执行以上实施例一或实施例二所述的去除图像彩色噪声的方法。
实施例三
本发明实施例进一步提供一种去除图像彩色噪声的装置700，参阅图7，包括：
原始图像获取单元710，配置为获取原始RGB图像；
空间转换单元720，配置为将原始RGB图像转换为YCbCr图像；以及，将经滤波处理后的YCbCr图像转换为最终RGB图像；
滤波单元730，配置为对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波。
在一实施例中，所述原始图像获取单元，还配置为获取由bayer图经过插值处理后转换得到的RGB图像作为所述原始RGB图像。
在另一实施例中，所述滤波单元，还配置为采用嵌套迭代滤波方式对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波。
在一实施例中，所述滤波单元，还配置为采用嵌套迭代式中值滤波方式对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波。
在另一实施例中，所述滤波单元，还配置为对滤波窗口内的像素点按照行、列分开处理的运算方式进行滤波运算处理。
在一实施例中，滤波单元730进一步包括以下组成部分：
缩放模块731，配置为在YCbCr图像进行滤波处理前，对其Cb、Cr分量分别缩小，待滤波后再进行放大至初始大小；
滤波处理模块732，配置为采用嵌套迭代的中值滤波方式对YCbCr图像的Cb、Cr分量进行滤波，且在运算过程中按照行列分开运算的运算方式。
在一实施例中，所述缩放模块，还配置为按照同等比例对行、列分别进行缩小，缩小方式具体为间隔采样方式。
在另一实施例中，所述缩放模块，还配置为采用双线性插值方式对YCbCr图像的Cb、Cr分量进行放大。
本实施例中，实现了对RGB图像中彩色噪声的去除，可获得良好的去噪效果，且不影响原始图像的清晰度。
在实际应用中，所述原始图像获取单元710、空间转换单元720以及滤波单元730均可由中央处理单元(CPU，Central Processing Unit)、或数字信号处理(DSP，Digital Signal Processor)、或现场可编程门阵列(FPGA，Field Programmable Gate Array)等来实现；所述CPU、DSP、FPGA均可内置于去除图像彩色噪声的装置中。
这里需要指出的是：以上装置实施例项的描述，与上述方法描述是类似的，具有同方法实施例相同的有益效果，因此不做赘述。对于本发明装置实施例中未披露的技术细节，本领域的技术人员请参照本发明方法实施例的描述而理解，为节约篇幅，这里不再赘述。
实施例四
本实施例进一步提供一种移动终端，该移动终端包括实施例三中的装置700。由于目前移动终端均具有照片应用，因而本实施例上述去除图像彩色噪声的装置700应用于移动终端中，使其实现对照片去噪功能，可满足用户的使用需求，提升用户体验。该移动终端可以具体为：手机、IPAD、平板电脑等。
本发明实施例提出的去除图像彩色噪声的方法及装置、移动终端、存储介质，具有以下有益效果：
(1)由于彩色噪声主要表现在Cb和Cr分量上的极度不平滑，因而本发明实施例通过对CbCr进行滤波来达到去除彩色噪声的目的，且不对Y分量进行处理，保证了图像的清晰度。
(2)本发明实施例采用嵌套迭代式中值滤波方式，相比传统的中值滤波方式，可大大提升去噪效果；
(3)本发明实施例应用图像行列分开处理的运算方式，并且先对CbCr 进行缩小、待滤波后再进行放大，这样可大大减小运算量，显著提高处理速度。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。
上述本发明实施例序号仅仅为了描述，不代表实施例的优劣。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端设备(可以是手机，计算机，服务器，空调器，或者网络设备等)执行本发明各个实施例所述的方法。
以上仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。
工业实用性
本发明实施例由于彩色噪声主要表现在Cb和Cr分量上的极度不平滑，因而本发明实施例通过对CbCr进行滤波来达到去除彩色噪声的目的，且不对Y分量进行处理，保证了图像的清晰度。

Claims (20)

  1. 一种去除图像彩色噪声的方法，所述方法包括：
    获取初始RGB图像；
    将所述初始RGB图像进行色彩空间转换，得到YCbCr图像；
    对所述YCbCr图像中Cb、Cr分量中的每个像素点进行滤波；
    将经滤波处理后的YCbCr图像进行空间转换，得到最终RGB图像。
  2. 如权利要求1所述的去除图像彩色噪声的方法，其中，所述初始RGB图像为：由bayer图经过插值处理后转换得到的RGB图。
  3. 如权利要求1或2所述的去除图像彩色噪声的方法，其中，在所述对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波的步骤中，采用嵌套迭代滤波方式进行滤波。
  4. 如权利要求3所述的去除图像彩色噪声的方法，其中，在所述对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波的步骤中，采用嵌套迭代式中值滤波方式进行滤波。
  5. 如权利要求1或2所述的去除图像彩色噪声的方法，其中，在所述对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波的步骤中，对滤波窗口内的像素点按照行、列分开处理的运算方式进行滤波运算处理。
  6. 如权利要求1或2所述的去除图像彩色噪声的方法，其中，在对所述YCbCr图像Cb、Cr分量中的每个像素点进行滤波之前，还包括：对所述YCbCr图像的Cb、Cr分量进行缩小；
    在对缩小的YCbCr图像Cb、Cr分量中的每个像素点进行滤波之后，对该YCbCr图像的Cb、Cr分量进行放大至初始大小。
  7. 如权利要求6所述的去除图像彩色噪声的方法，其中，所述对YCbCr图像的Cb、Cr分量进行缩小的方法为：按照同等比例对行、列分别进行缩小，缩小方式具体为间隔采样方式。
  8. 如权利要求6所述的去除图像彩色噪声的方法，其中，所述对YCbCr图像的Cb、Cr分量进行放大的方法为：采用双线性插值方式进行放大。
  9. 一种去除图像彩色噪声的装置，所述装置包括：
    原始图像获取单元，配置为获取原始RGB图像；
    空间转换单元，配置为将原始RGB图像转换为YCbCr图像；以及，将经滤波处理后的YCbCr图像转换为最终RGB图像；
    滤波单元，配置为对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波。
  10. 如权利要求9所述的去除图像彩色噪声的装置，其中，所述原始图像获取单元，还配置为获取由bayer图经过插值处理后转换得到的RGB图像作为所述原始RGB图像。
  11. 如权利要求9或10所述的去除图像彩色噪声的装置，其中，所述滤波单元，还配置为采用嵌套迭代滤波方式对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波。
  12. 如权利要求11所述的去除图像彩色噪声的装置，其中，所述滤波单元，还配置为采用嵌套迭代式中值滤波方式对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波。
  13. 如权利要求9或10所述的去除图像彩色噪声的装置，其中，所述滤波单元，还配置为对滤波窗口内的像素点按照行、列分开处理的运算方式进行滤波运算处理。
  14. 如权利要求9或10所述的去除图像彩色噪声的装置，其中，所述滤波单元包括：
    缩放模块，配置为在对YCbCr图像进行滤波处理前，对其Cb、Cr分量中的像素分别缩小，待滤波后再进行放大至初始大小；
    滤波处理模块，配置为采用嵌套迭代的中值滤波方式对YCbCr图像的 Cb、Cr分量进行滤波，且在运算过程中对滤波窗口内的像素点按照行、列分开处理的运算方式进行滤波运算处理。
  15. 如权利要求14所述的去除图像彩色噪声的装置，其中，所述缩放模块，还配置为按照同等比例对行、列分别进行缩小，缩小方式具体为间隔采样方式。
  16. 如权利要求14所述的去除图像彩色噪声的装置，其中，所述缩放模块，还配置为采用双线性插值方式对YCbCr图像的Cb、Cr分量进行放大。
  17. 一种移动终端，包括去除图像彩色噪声的装置；所述装置包括：
    原始图像获取单元，配置为获取原始RGB图像；
    空间转换单元，配置为将原始RGB图像转换为YCbCr图像；以及，将经滤波处理后的YCbCr图像转换为最终RGB图像；
    滤波单元，配置为对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波。
  18. 如权利要求17所述的移动终端，其中，所述滤波单元，还配置为采用嵌套迭代滤波方式对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波；或者，
    采用嵌套迭代式中值滤波方式对YCbCr图像中Cb、Cr分量中的每个像素点进行滤波；
    或者，采用对滤波窗口内的像素点按照行、列分开处理的运算方式进行滤波运算处理。
  19. 如权利要求17所述的移动终端，其中，所述滤波单元包括：
    缩放模块，配置为在对YCbCr图像进行滤波处理前，对其Cb、Cr分量中的像素分别缩小，待滤波后再进行放大至初始大小；
    滤波处理模块，配置为采用嵌套迭代的中值滤波方式对YCbCr图像的 Cb、Cr分量进行滤波，且在运算过程中对滤波窗口内的像素点按照行、列分开处理的运算方式进行滤波运算处理。
  20. 一种计算机可读存储介质，该存储介质包括一组指令，所述指令用于执行权利要求1至8任一项所述的去除图像彩色噪声的方法。
PCT/CN2016/104271 2015-11-27 2016-11-01 去除图像彩色噪声的方法及装置、移动终端、存储介质 WO2017088629A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510852450.8 2015-11-27
CN201510852450.8A CN105427261A (zh) 2015-11-27 2015-11-27 一种去除图像彩色噪声的方法、装置及移动终端

Publications (1)

Publication Number Publication Date
WO2017088629A1 true WO2017088629A1 (zh) 2017-06-01

Family

ID=55505442

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/104271 WO2017088629A1 (zh) 2015-11-27 2016-11-01 去除图像彩色噪声的方法及装置、移动终端、存储介质

Country Status (2)

Country Link
CN (1) CN105427261A (zh)
WO (1) WO2017088629A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113052767A (zh) * 2019-12-26 2021-06-29 深圳市万普拉斯科技有限公司 滤波矩阵生成方法、装置、终端设备和可读存储介质

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105427261A (zh) * 2015-11-27 2016-03-23 努比亚技术有限公司 一种去除图像彩色噪声的方法、装置及移动终端
CN106875346A (zh) * 2016-12-26 2017-06-20 奇酷互联网络科技（深圳）有限公司 图像处理方法、装置和终端设备
CN108038831A (zh) * 2017-12-19 2018-05-15 北京理工大学 一种基于大气散射模型的彩色视频去雾方法
CN109640090A (zh) * 2018-12-18 2019-04-16 深圳市丰巢科技有限公司 图片压缩方法及装置、设备和存储介质
CN109767385B (zh) * 2018-12-20 2023-04-28 深圳市资福医疗技术有限公司 一种去除图像色度噪声的方法和装置
CN111161188B (zh) * 2019-12-30 2023-09-08 珠海全志科技股份有限公司 降低图像色彩噪声的方法、计算机装置及可读存储介质
CN111260580B (zh) * 2020-01-17 2023-05-12 珠海全志科技股份有限公司 图像去噪方法、计算机装置及计算机可读存储介质
CN112270220B (zh) * 2020-10-14 2022-02-25 西安工程大学 一种基于深度学习的缝纫手势识别方法
CN115829887B (zh) * 2023-02-24 2023-07-07 执鼎医疗科技（杭州）有限公司 血管图像的处理方法、装置和电子设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6639626B1 (en) * 1998-06-18 2003-10-28 Minolta Co., Ltd. Photographing apparatus with two image sensors of different size
CN102129673A (zh) * 2011-04-19 2011-07-20 大连理工大学 一种随意光照下彩色数字图像增强和去噪方法
CN104093011A (zh) * 2014-07-22 2014-10-08 浙江宇视科技有限公司 一种伪彩色抑制方法和装置
CN104380727A (zh) * 2012-06-12 2015-02-25 富士胶片株式会社 图像处理装置和图像处理方法
CN105427261A (zh) * 2015-11-27 2016-03-23 努比亚技术有限公司 一种去除图像彩色噪声的方法、装置及移动终端

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101190132B (zh) * 2006-11-28 2010-12-08 深圳迈瑞生物医疗电子股份有限公司 超声成像的预处理方法与装置
JP5287778B2 (ja) * 2010-03-26 2013-09-11 株式会社島津製作所 画像処理方法およびそれを用いた放射線撮影装置
CN102243758A (zh) * 2011-07-14 2011-11-16 浙江大学 基于雾天图像复原和图像融合的图像去雾方法
CN103793679B (zh) * 2014-03-05 2016-08-17 江苏物联网研究发展中心 基于DaVinci技术的一维条码识别方法
CN105389786B (zh) * 2015-10-28 2020-03-31 努比亚技术有限公司 一种图像处理的方法及装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6639626B1 (en) * 1998-06-18 2003-10-28 Minolta Co., Ltd. Photographing apparatus with two image sensors of different size
CN102129673A (zh) * 2011-04-19 2011-07-20 大连理工大学 一种随意光照下彩色数字图像增强和去噪方法
CN104380727A (zh) * 2012-06-12 2015-02-25 富士胶片株式会社 图像处理装置和图像处理方法
CN104093011A (zh) * 2014-07-22 2014-10-08 浙江宇视科技有限公司 一种伪彩色抑制方法和装置
CN105427261A (zh) * 2015-11-27 2016-03-23 努比亚技术有限公司 一种去除图像彩色噪声的方法、装置及移动终端

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113052767A (zh) * 2019-12-26 2021-06-29 深圳市万普拉斯科技有限公司 滤波矩阵生成方法、装置、终端设备和可读存储介质

Also Published As

Publication number Publication date
CN105427261A (zh) 2016-03-23

Similar Documents

Publication Publication Date Title
WO2017088629A1 (zh) 去除图像彩色噪声的方法及装置、移动终端、存储介质
US10827140B2 (en) Photographing method for terminal and terminal
WO2018076935A1 (zh) 图像虚化处理方法、装置、移动终端和计算机存储介质
WO2017067526A1 (zh) 图像增强方法及移动终端
WO2018019124A1 (zh) 一种图像处理方法及电子设备、存储介质
WO2017041714A1 (zh) 一种获取rgb数据的方法和装置
WO2017020836A1 (zh) 一种虚化处理深度图像的装置和方法
WO2017071542A1 (zh) 图像处理方法及装置
CN104954689A (zh) 一种利用双摄像头获得照片的方法及拍摄装置
CN105227837A (zh) 一种图像合成方法和装置
WO2017071475A1 (zh) 一种图像处理方法及终端、存储介质
WO2018076938A1 (zh) 图像处理装置及方法和计算机存储介质
WO2017206657A1 (zh) 一种图像处理方法、装置、移动终端及计算机存储介质
WO2017088680A1 (zh) 图像处理装置和方法
WO2017045647A1 (zh) 一种处理图像的移动终端和方法
US20220130023A1 (en) Video denoising method and apparatus, terminal, and storage medium
CN105956999A (zh) 缩略图生成装置和方法
CN104967802A (zh) 移动终端及其屏幕多区域的录制方法和装置
CN105338242A (zh) 一种图像合成方法和装置
CN112995467A (zh) 图像处理方法、移动终端及存储介质
CN105763710A (zh) 一种图片设置系统和方法
CN105095903A (zh) 电子设备及图像处理方法
CN104917965A (zh) 拍摄方法及装置
CN113179370A (zh) 拍摄方法、移动终端及可读存储介质
CN113179369A (zh) 拍摄画面的显示方法、移动终端及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16867854

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16867854

Country of ref document: EP

Kind code of ref document: A1