WO2017101489A1 - 图像滤波方法及装置 - Google Patents

图像滤波方法及装置 Download PDF

Info

Publication number
WO2017101489A1
WO2017101489A1 PCT/CN2016/096009 CN2016096009W WO2017101489A1 WO 2017101489 A1 WO2017101489 A1 WO 2017101489A1 CN 2016096009 W CN2016096009 W CN 2016096009W WO 2017101489 A1 WO2017101489 A1 WO 2017101489A1
Authority
WO
WIPO (PCT)
Prior art keywords
pixel
image
value
frequency noise
average
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/096009
Other languages
English (en)
French (fr)
Inventor
边智
魏伟
白茂生
刘阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Le Holdings Beijing Co Ltd
LeCloud Computing Co Ltd
Original Assignee
Le Holdings Beijing Co Ltd
LeCloud Computing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Le Holdings Beijing Co Ltd, LeCloud Computing Co Ltd filed Critical Le Holdings Beijing Co Ltd
Publication of WO2017101489A1 publication Critical patent/WO2017101489A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20182Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/14Picture signal circuitry for video frequency region
    • H04N5/21Circuitry for suppressing or minimising disturbance, e.g. moiré or halo

Definitions

  • the embodiments of the present invention relate to the field of video technologies, and in particular, to an image filtering method and apparatus.
  • Image filtering means that the noise of the image is suppressed under the condition that the image details are preserved, which is an important means to reduce image noise and enhance image quality.
  • the video Since the video may be interfered by noise during the process of acquisition, transmission, etc., the image quality is degraded.
  • the coding performance is degraded. Therefore, how to effectively remove the image noise in the video becomes a technology in the field. The technical problems that personnel urgently need to solve.
  • the embodiment of the present application provides an image filtering method and device, which are used to effectively remove image noise.
  • An embodiment of the present application provides an image filtering method, including:
  • each frame of the image to be processed and the continuous multi-frame image before the image to be processed to obtain a fused image
  • the pixel value of each pixel in the fused image is the image to be processed and the to-be-processed
  • the pixel value of the pixel point is updated to its corresponding pixel value average value to remove low frequency noise
  • the fused image from which the low frequency noise is removed is subjected to spatial filtering to remove high frequency noise, and a filtered image of the image to be processed is obtained.
  • An embodiment of the present application provides an image filtering apparatus, including:
  • An image superimposing module configured to superimpose each frame of the image to be processed and the continuous multi-frame image before the image to be processed to obtain a fused image; the pixel value of each pixel in the fused image is the to-be-processed An average of pixel values of the same position in the image and the consecutive multi-frame images preceding the image to be processed;
  • a calculation module configured to calculate, for each pixel point in the fused image, an average value of pixel values of other respective pixel points not including the pixel point in the first surrounding area of the pixel point;
  • a first filtering module configured to: when a difference between a pixel value of the pixel point and a corresponding pixel value average thereof exceeds a preset range, update a pixel value of the pixel point to an average value of the corresponding pixel value, and remove Low frequency noise
  • a second filtering module configured to perform spatial filtering on the fused image that removes low frequency noise, remove high frequency noise, and obtain a filtered image of the image to be processed.
  • the embodiment of the present application provides an electronic device, including: the above image filtering device.
  • the embodiment of the present application provides a non-transitory computer readable storage medium, wherein the non-transitory computer readable storage medium can store a computer program, and the computer program can implement a part of the image filtering method described above when executed. Or all steps.
  • An embodiment of the present application further provides an electronic device, including: one or more processors; and a memory; wherein the memory stores instructions executable by the one or more processors, the instructions being The one or more processors are executed to enable the one or more processors to perform the image filtering method of any of the above-described embodiments of the present application.
  • An embodiment of the present application provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer, The computer is caused to perform the image filtering method of any of the above embodiments of the present application.
  • the image filtering method and apparatus obtains a fused image by accumulating each frame of the image to be processed, and a plurality of consecutive frames thereof, and calculating the fused image for each pixel in the fused image.
  • An average value of pixel values of other pixel points of the pixel point is not included in the first surrounding area of the pixel; when the difference between the pixel value of the pixel point and the corresponding average value of the pixel value exceeds a preset range, The pixel value of the pixel is updated to its corresponding pixel value average value to remove low frequency noise; the fused image from which low frequency noise is removed is spatially filtered to remove high frequency noise, that is, the image of the image to be processed can be obtained.
  • the image effectively removes low frequency noise and high frequency noise of the image, which improves the effectiveness of image filtering.
  • FIG. 1 is a flow chart of an embodiment of an image filtering method of the present application.
  • FIG. 2 is a flow chart of still another embodiment of an image filtering method of the present application.
  • FIG. 3 is a schematic structural diagram of an embodiment of an image filtering device of the present application.
  • FIG. 4 is a schematic structural diagram of still another embodiment of an image filtering apparatus according to the present application.
  • FIG. 5 is a schematic diagram of a hardware structure of an apparatus for an image filtering method according to an embodiment of the present application.
  • CMOS Complementary Metal Oxide Semiconductor, Complementary metal oxide semiconductor
  • CCD Charge-coupled Device
  • CMOS image sensors have serious noise problems due to process and technical reasons. Especially in the dark light conditions, the noise problem of CMOS image sensors is more prominent, which is related to the device and the process itself. Therefore, image noise is mainly caused by chip noise, so it is necessary to remove chip noise in the image.
  • the chip noise in the image mainly includes low frequency noise high frequency noise.
  • the inventor further found in the research that the low-frequency noise of the chip is caused by the instability of the additive in the chip manufacturing process, and the expression form is that the acquired signal value is long or long, and is difficult to detect in a single image. Therefore, it can be After multiple images are superimposed, they are detected.
  • spatial domain information can be utilized to filter and eliminate high-frequency noise of the chip.
  • the high-frequency noise of the chip appears as a random signal, so it can be processed by the spatial domain information to smooth the image.
  • a continuous multi-frame image before each frame of the image to be processed may be selected and performed. Accumulating, obtaining a fused image for detecting low frequency noise; for each pixel in the fused image, calculating pixel values of other respective pixel points not including the pixel in the first surrounding area of the pixel Average value; when the difference between the pixel value of the pixel point and the corresponding pixel value average exceeds a preset range, the pixel value of the pixel point is updated to its corresponding pixel value average value to remove low frequency noise; The fused image of the low-frequency noise is removed and the spatial filtering is performed to remove the high-frequency noise, so that the filtered image of the image to be processed is obtained. In the embodiment of the present application, the low-frequency noise and high-frequency noise of the image are effectively removed, and the image filtering is improved. Effectiveness.
  • the algorithm has
  • FIG. 1 is a flowchart of an embodiment of an image filtering method according to an embodiment of the present disclosure, where Including the following steps:
  • the image to be processed refers to an image that needs to be denoised and filtered for each frame in the video.
  • Each frame of the image to be processed and the first few frames of the image to be processed of each frame may be superimposed, and by superimposing the plurality of images, the low frequency noise in the image to be processed may be detected.
  • the pixel pixel value of each position in the obtained fused image is an average value of the pixel value of the pixel at the same position in the image to be processed and the consecutive multi-frame image before the image to be processed.
  • each frame of the image to be processed and the continuous multi-frame image before each frame of the image to be processed assume a total of N frames of continuous images, and N frames of consecutive images are superimposed to obtain a fused image, and the pixel value of each pixel is N.
  • the pixel values of the pixels at the same position in the continuous image of the frame are accumulated and divided by N.
  • the first surrounding area refers to a first predetermined range centered on the pixel. For example, centered on each pixel, the first surrounding area may be an area within 5*5 around the pixel.
  • an average value of pixel values of other respective pixel points not including the pixel point in the first surrounding area of the pixel point is calculated, and the pixel value of the other each pixel point may be replaced by the pixel value of the pixel point.
  • the difference between the pixel value of the pixel point and the average value of the corresponding pixel value exceeds a preset range, it indicates that the image is abruptly changed, which may be considered to be caused by low frequency noise, so that the pixel point is The pixel value is updated to its corresponding pixel value average.
  • the average value of the pixel values corresponding to the pixel points is the average value of the pixel values of the other respective pixel points in the first surrounding area of the pixel point calculated in step 102.
  • the fused image of the low frequency noise is removed, and the spatial domain filtering is performed by using the spatial domain information, that is, the high frequency noise can be removed, thereby obtaining the filtered image of the image to be processed.
  • a multi-frame image may be selected and accumulated to perform low-frequency noise detection; for each pixel in the fused image, the first pixel point is calculated. An average value of pixel values of other pixel points of the pixel is not included in the surrounding area; when the difference between the pixel value of the pixel and the corresponding pixel value average exceeds a preset range, the pixel point is The pixel value is updated to the corresponding pixel value average value to remove the low frequency noise; the fused image from which the low frequency noise is removed is spatially filtered, and the high frequency noise is removed, that is, the filtered image of the image to be processed can be obtained, and the image is effectively removed. Low frequency noise and high frequency noise of the image.
  • the pixel value of the pixel is greater than the corresponding pixel value average, and the difference is greater than the first preset value, or less than the corresponding pixel value average value, and the difference is less than the second preset value.
  • the difference between the pixel value of the pixel and the corresponding pixel value average exceeds a preset range, and the pixel value of the pixel is updated to its corresponding pixel value average value, and removing the low frequency noise may include:
  • the pixel is The pixel value of the point is updated to its corresponding pixel value average to remove low frequency noise.
  • the first preset value and the second preset value may be 30% of an average value of pixel values corresponding to the pixel points.
  • the difference exceeds the error preset range, it can be determined that the image is abruptly changed and can be considered as a result of low frequency noise. Therefore, the pixel points of the pixel points can be replaced by the average of the pixel values of the other pixel points in the first surrounding area. If the difference is within the error preset range, the pixel value of the pixel point does not change, thereby being removed. A fused image of low frequency noise.
  • the fused image from which the low frequency noise is removed is subjected to spatial filtering to remove the high frequency noise, and the filtered image of the image to be processed is obtained by using the spatial information of each pixel in the fused image from which the low frequency noise is removed. Filtering to remove high frequency noise, specifically, as described in the embodiment shown in FIG.
  • FIG. 2 is a flowchart of still another embodiment of an image filtering method according to an embodiment of the present disclosure, where the method may include the following steps:
  • the pixel pixel value of each position in the fused image is an average value of the pixel value of the pixel at the same position in the image to be processed and the continuous multi-frame image before the image to be processed.
  • steps 201 to 203 are the same as the operations in steps 101 to 103 in the embodiment shown in FIG.
  • the second surrounding area may refer to a second predetermined range centered on the pixel.
  • High frequency noise can be removed from the fused image by utilizing the correlation of the pixel points with other individual pixels in the second surrounding area.
  • the weighting factors of other individual pixel points in the second surrounding area are calculated.
  • the pixel values of the pixel points are respectively multiplied by the weighting factors of the other respective pixel points, and the obtained products are accumulated, that is, a weighted average of the pixel points can be obtained.
  • the pixel value of the pixel is replaced with a weighted average of the pixel, that is, the high frequency noise of the fused image can be removed, so that the final filtered image can be obtained.
  • the weighting factor of the pixel values of the other surrounding pixels that do not include the pixel points in the second surrounding area of the pixel may be calculated in multiple ways.
  • the pixel in the second surrounding area of the pixel point that does not include the other pixel points of the pixel point is calculated for each pixel point in the fused image from which low frequency noise is removed.
  • the weighting factor for the value can be:
  • a weighting factor of each of the other pixel points in the second surrounding area of the pixel point is calculated according to a weighting factor calculation formula
  • the weighted average of the pixel points may be specifically calculated according to a weighted average calculation formula, and thus the weight factor of the pixel values of the other respective pixel points in the second surrounding area and the pixel value of the pixel point are calculated.
  • the weighted average of the pixels, removing high frequency noise can include:
  • v(i,j) represents any pixel point
  • u(i,j) represents a weighted average of the pixel points
  • the pixel point pixel value is replaced with a weighted average of the pixel points, that is, the high frequency noise can be removed, so that the filtered image of the image to be processed can be obtained.
  • image filtering can be effectively implemented, so that low frequency noise and high frequency noise of the image can be effectively removed.
  • the algorithm has high performance and fast speed, which improves the efficiency of image filtering.
  • FIG. 3 is a schematic structural diagram of an embodiment of an image filtering apparatus according to an embodiment of the present disclosure, where the apparatus may include:
  • the image superimposing module 301 is configured to superimpose each frame to be processed image and consecutive multi-frame images before the image to be processed to obtain a fused image.
  • the image to be processed refers to an image that needs to be denoised and filtered for each frame in the video.
  • the pixel pixel value of each position in the fused image is an average value of pixel values of the pixel at the same position in the image to be processed and the continuous multi-frame image before the image to be processed.
  • each frame of the image to be processed and the continuous multi-frame image before each frame of the image to be processed assume a total of N frames of continuous images, and N frames of consecutive images are superimposed to obtain a fused image, and the pixel value of each pixel is N.
  • the pixel values of the pixels at the same position in the continuous image of the frame are accumulated and divided by N.
  • the calculating module 302 is configured to calculate, for each pixel point in the fused image, an average value of pixel values of other respective pixel points not including the pixel point in the first surrounding area of the pixel point.
  • the first filtering module 303 is configured to update the pixel value of the pixel point to an average value of the corresponding pixel value when the difference between the pixel value of the pixel point and the corresponding pixel value average value exceeds a preset range. Remove low frequency noise.
  • the first surrounding area refers to a first predetermined range centered on the pixel.
  • the second filtering module 304 is configured to perform spatial filtering on the fused image from which low frequency noise is removed, remove high frequency noise, and obtain a filtered image of the image to be processed.
  • the fused image of the low frequency noise is removed, and the spatial domain filtering is performed by using the spatial domain information, that is, the high frequency noise can be removed, thereby obtaining the filtered image of the image to be processed.
  • a multi-frame image may be selected and accumulated to perform low-frequency noise detection; for each pixel in the fused image, the first pixel point is calculated. An average value of pixel values of other pixel points of the pixel is not included in the surrounding area; when the difference between the pixel value of the pixel and the corresponding pixel value average exceeds a preset range, the pixel point is The pixel value is updated to its corresponding pixel value average value to remove low frequency noise; the fused image from which low frequency noise is removed is further subjected to airspace Filtering, removing high frequency noise, that is, obtaining a filtered image of the image to be processed, effectively removing low frequency noise and high frequency noise of the image.
  • the pixel value of the pixel is greater than the corresponding pixel value average, and the difference is greater than the first preset value, or less than the corresponding pixel value average value, and the difference is less than the second preset value.
  • the first filtering module 303 can be specifically configured to:
  • the pixel is The pixel value of the point is updated to its corresponding pixel value average to remove low frequency noise.
  • the first preset value and the second preset value may be 30% of an average value of pixel values corresponding to the pixel points.
  • the difference exceeds the error preset range, it can be determined that the image is abruptly changed and can be considered as a result of low frequency noise. Therefore, the pixel points of the pixel points can be replaced by the average of the pixel values of the other pixel points in the first surrounding area. If the difference is within the error preset range, the pixel value of the pixel point does not change, thereby being removed. A fused image of low frequency noise.
  • the second filtering module 304 may include:
  • a first calculating unit 401 configured to calculate, for each pixel point in the fused image from which low frequency noise is removed, a pixel value of a second surrounding area of the pixel point that does not include other pixel points of the pixel point Weight factor.
  • the second surrounding area may refer to a second predetermined range centered on the pixel.
  • High frequency noise can be removed from the fused image by utilizing the correlation of the pixel points with other individual pixels in the second surrounding area.
  • the weighting factors of other individual pixel points in the second surrounding area are calculated.
  • the second calculating unit 402 is configured to calculate a weighted average value of the pixel points by using a weighting factor of pixel values of other respective pixel points in the second surrounding area and a pixel value of the pixel point.
  • the pixel values of the pixel points are respectively multiplied by the weighting factors of the other respective pixel points, and the obtained products are accumulated, that is, a weighted average of the pixel points can be obtained.
  • the filtering unit 403 is configured to replace the pixel value of the pixel point with the weighted average value, remove high frequency noise, and obtain a filtered image of the image to be processed.
  • the pixel value of the pixel is replaced with a weighted average of the pixel, that is, the high frequency noise of the fused image can be removed, so that the final filtered image can be obtained.
  • the weighting factor of the pixel values of the other surrounding pixels that do not include the pixel points in the second surrounding area of the pixel may be calculated in multiple ways.
  • the first calculating unit 401 may be specifically configured to:
  • a weighting factor of each of the other pixel points in the second surrounding area of the pixel point is calculated according to a weighting factor calculation formula
  • the weighted average of the pixel points can be calculated according to the weighted average calculation formula.
  • the second calculating unit 402 can be specifically used for:
  • v(i,j) represents any pixel point
  • u(i,j) represents a weighted average corresponding to the pixel points
  • the pixel point pixel value is replaced with a weighted average of the pixel points, that is, the high frequency noise can be removed, so that the filtered image of the image to be processed can be obtained.
  • image filtering can be effectively implemented, so that low frequency noise and high frequency noise of the image can be effectively removed.
  • the algorithm has high performance and fast speed, which improves the efficiency of image filtering.
  • the embodiment of the present application further provides a non-transitory computer readable storage medium, where the non-transitory computer readable storage medium can store a program, and when the program is executed, the image filtering provided by any one of the foregoing embodiments can be implemented. Some or all of the steps in the various implementations of the method.
  • FIG. 5 is a schematic diagram of a hardware structure of an electronic device according to an image filtering method according to an embodiment of the present disclosure. As shown in FIG. 5, the device includes:
  • processors 510 and memory 520 one processor 510 is taken as an example in FIG.
  • the apparatus for performing the image filtering method may further include: an input device 530 and an output device 540.
  • the processor 510, the memory 520, the input device 530, and the output device 540 may be connected by a bus or other means, as exemplified by a bus connection in FIG.
  • the memory 520 is a non-transitory computer readable storage medium and can be used to store non-volatile software programs.
  • the program, the non-volatile computer executable program and the module such as the program instruction/module corresponding to the image filtering method in the embodiment of the present application.
  • the processor 510 executes various functional applications of the server and data processing by executing non-volatile software programs, instructions, and modules stored in the memory 520, that is, implementing the image filtering method of the above method embodiments.
  • the memory 520 may include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to use of the image filtering device, and the like. Further, the memory 520 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some embodiments, memory 520 can optionally include memory remotely disposed relative to processor 510, which can be coupled to the image filtering device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • Input device 530 can receive input digital or character information and generate key signal inputs related to user settings and function control of the image filtering device.
  • the output device 540 can include a display device such as a display screen.
  • the one or more modules are stored in the memory 520, and when executed by the one or more processors 510, perform an image filtering method in any of the above method embodiments.
  • the electronic device of the embodiment of the invention exists in various forms, including but not limited to:
  • Mobile communication devices These devices are characterized by mobile communication functions and are mainly aimed at providing voice and data communication.
  • Such terminals include: smart phones (such as iPhone), multimedia phones, functional phones, and low-end phones.
  • Ultra-mobile personal computer equipment This type of equipment belongs to the category of personal computers, has computing and processing functions, and generally has mobile Internet access.
  • Such terminals include: PDAs, MIDs, and UMPC devices, such as the iPad.
  • Portable entertainment devices These devices can display and play multimedia content. Such devices include: audio, preview players (such as iPod), handheld game consoles, e-books, and smart toys and portable car navigation devices.
  • the composition of the server includes a processor, a hard disk, a memory, and a system.
  • the bus, etc. is similar to a general-purpose computer architecture, but requires high processing power, stability, reliability, security, scalability, manageability, and the like.
  • the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

提供一种图像滤波方法及装置。该方法包括:将每一帧待处理图像以及该待处理图像之前的连续多帧图像进行叠加,获得融合图像(101);针对该融合图像中的每一个像素点,计算该像素点的第一周围区域内不包括该像素点的其它各个像素点的像素值平均值(102);在该像素点的像素值与其对应的像素值平均值的差值超出预设范围时,将该像素点的像素值更新为其对应的像素值平均值,去除低频噪声(103);将去除低频噪声的该融合图像进行空域滤波,去除高频噪声,获得该待处理图像的滤波图像(104)。本发明有效实现了图像去噪滤波。

Description

图像滤波方法及装置
本申请要求于2015-12-14提交中国专利局、申请号为2015109261425、发明名称为“图像滤波方法及装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及视频技术领域,尤其涉及一种图像滤波方法及装置。
背景技术
图像滤波,即是指在保留图像细节特征的条件下对图像的噪声进行抑制,是降低图像噪声,增强图像质量的重要手段。
由于视频在采集、传输等过程中可能会受到噪声的干扰,使得图像质量降低,这些噪声在视频编码时,就会引起编码性能下降,因此如何有效的去除视频中的图像噪声,成为本领域技术人员迫切需要解决的技术问题。
发明内容
本申请实施例提供一种图像滤波方法及装置,用以实现了图像噪声的有效去除。
本申请实施例提供一种图像滤波方法,包括:
将每一帧待处理图像以及所述待处理图像之前的连续多帧图像进行叠加,获得融合图像;所述融合图像中每一位置的像素点像素值为所述待处理图像以及所述待处理图像之前的连续多帧图像中同一位置的像素点像素值的平均值;
针对所述融合图像中的每一个像素点,计算所述像素点的第一周围区域内不包括所述像素点的其它各个像素点的像素值平均值;
在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声;
将去除低频噪声的所述融合图像进行空域滤波,去除高频噪声,获得所述待处理图像的滤波图像。
本申请实施例提供一种图像滤波装置,包括:
图像叠加模块,用于将每一帧待处理图像以及所述待处理图像之前的连续多帧图像进行叠加,获得融合图像;所述融合图像中每一位置的像素点像素值为所述待处理图像以及所述待处理图像之前的连续多帧图像中同一位置的像素点像素值的平均值;
计算模块,用于针对所述融合图像中的每一个像素点,计算所述像素点的第一周围区域内不包括所述像素点的其它各个像素点的像素值平均值;
第一滤波模块,用于在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声;
第二滤波模块,用于将去除低频噪声的所述融合图像进行空域滤波,去除高频噪声,获得所述待处理图像的滤波图像。
本申请实施例提供了一种电子设备,包括:上述的一种图像滤波装置。
本申请实施例提供了一种非暂态计算机可读存储介质,其中,该非暂态计算机可读存储介质可存储有计算机程序,该计算机程序执行时可实现上述的一种图像滤波方法的部分或全部步骤。
本申请实施例还提供了一种电子设备,包括:一个或多个处理器;以及,存储器;其中,所述存储器存储有可被所述一个或多个处理器执行的指令,所述指令被所述一个或多个处理器执行,以使所述一个或多个处理器能够执行本申请上述任一项图像滤波方法。
本申请实施例提供一种计算机程序产品,所述计算机程序产品包括存储在非暂态计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被计算机执行时,使所述计算机执行本申请实施例上述任一项图像滤波方法。
本申请实施例提供的图像滤波方法及装置,通过将每一帧待处理图像,与其之前连续的多帧图像进行累加,获得融合图像;针对所述融合图像中的每一个像素点,计算所述像素点的第一周围区域内不包括所述像素点的其它各个像素点的像素值平均值;在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声;将去除低频噪声的所述融合图像再进行空域滤波,去除高频噪声,即可以获得所述待处理图像的滤波图像,有效去除了图像的低频噪声以及高频噪声,提高了图像滤波的有效性。
附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1为本申请图像滤波方法一个实施例的流程图;
图2为本申请图像滤波方法又一个实施例的流程图;
图3为本申请图像滤波装置一个实施例的结构示意图;
图4为本申请图像滤波装置又一个实施例的结构示意图;
图5是本申请实施例提供的图像滤波方法的设备的硬件结构示意图。
具体实施方式
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
目前,图像传感器市场主要有CMOS(Complementary Metal Oxide Semiconductor, 互补金属氧化物半导体)图像传感器和CCD(Charge-coupled Device,电荷耦合元件)图像传感器。由于对小型化、低功耗和低成本成像系统消费需要的增加,摄像机多采用CMOS图像传感器。
发明人在研究中发现,CMOS图像传感器由于工艺和技术原因,存在严重的噪声问题,特别是在光线较暗条件下,CMOS图像传感器的噪声问题比较突出,这与器件和工艺本身关系较大。因此图像噪声主要是由于芯片噪声引起的,因此需要去除图像中的芯片噪声。
图像中芯片噪声主要包括低频噪声高频噪声。发明人在研究中进一步发现,芯片的低频噪声是芯片制造过程中,添加剂不稳定引起的,表现形式为获取的信号值长高或长低,在单幅图像中难以检测,因此,可以通过将多幅图像叠加后,进行检测。对于图像中高频噪声可以利用空域信息,进行滤波,消除芯片高频噪声。芯片的高频噪声表现为随机信号,因此可以利用空域信息进行处理,对图像进行平滑。
综上,发明人经过一系列研究,提出本申请技术方案,在本申请实施例中,针对视频中的每一帧待处理图像,可以选择每一帧待处理图像之前的连续多帧图像与其进行累加,获得融合图像,以进行低频噪声的检测;针对所述融合图像中的每一个像素点,计算所述像素点的第一周围区域内不包括所述像素点的其它各个像素点的像素值平均值;在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声;将去除低频噪声的所述融合图像再进行空域滤波,去除高频噪声,即可以获得所述待处理图像的滤波图像,本申请实施例,有效去除了图像的低频噪声以及高频噪声,提高图像滤波的有效性。且算法性能高、速度快,提高了图像滤波的效率。
图1为本申请实施例提供的一种图像滤波方法一个实施例的流程图,该方法可以 包括以下几个步骤:
101:将每一帧待处理图像以及所述待处理图像之前的连续多帧图像进行叠加,获得融合图像。
待处理图像是指视频中的每一帧需要进行去噪滤波的图像。
每一帧待处理图像与每一帧待处理图像的前几帧图像,可以进行叠加,通过将多幅图像叠加,即可以检测待处理图像中的低频噪声。
其中,获得的融合图像中每一位置的像素点像素值为所述待处理图像以及所述待处理图像之前的连续多帧图像中同一位置的像素点像素值的平均值。
例如,每一帧待处理图像以及每一帧待处理图像之前的连续多帧图像,假设一共为N帧连续图像,N帧连续图像叠加获得融合图像中,每一个像素点的像素值是将N帧连续图像中同一位置的像素点的像素值累加再除以N获得。
102:针对所述融合图像中的每一个像素点,计算所述像素点的第一周围区域内不包括所述像素点的其它各个像素点的像素值平均值。
103:在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声。
第一周围区域是指以像素点为中心的第一预设范围。例如以每一个像素点为中心,第一周围区域可以是该像素点周围5*5内的区域。
从而针对每一个像素点,计算像素点第一周围区域内不包括所述像素点的其它各个像素点的像素值平均值,可以将其它各个像素点的像素值平均值替换该像素点的像素值。
具体的,是在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,此时表明图像突变很大,可以认为是低频噪声出现导致的,因此即将像素点的像素值更新为其对应的像素值平均值。
此处,像素点对应的像素值平均值即是步骤102中计算得到像素点的第一周围区域内其它各个像素点像素值平均值。
104:将去除低频噪声的所述融合图像进行空域滤波,去除高频噪声,获得所述待处理图像的滤波图像。
去除低频噪声的融合图像,利用空域信息进行空域滤波,即可以去除高频噪声,从而即得到待处理图像的滤波图像。
本申请实施例中,针对每一帧待处理图像,可以选择多帧图像与其进行累加,以进行低频噪声的检测;针对所述融合图像中的每一个像素点,计算所述像素点的第一周围区域内不包括所述像素点的其它各个像素点的像素值平均值;在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声;将去除低频噪声的所述融合图像再进行空域滤波,去除高频噪声,即可以获得所述待处理图像的滤波图像,有效去除了图像的低频噪声以及高频噪声。
其中,所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时可以包括:
所述像素点的像素值大于其对应的像素值平均值,且差值大于第一预设值,或者小于其对应的像素值平均值,且差值小于第二预设值。
因此,在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声可以包括:
在所述像素点的像素值大于其对应的像素值平均值且差值大于第一预设值,或者小于其对应的像素值平均值且差值小于第二预设值时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声。
作为一种可能的实现方式,所述第一预设值以及所述第二预设值可以为所述像素点对应的像素值平均值的30%。
当差值超出误差预设范围,可以确定图像突变很大,可以认为是低频噪声出现导致的。因此,可以将像素点的像素点用第一周围区域中的其它像素点的像素值平均值替代,如果差值在误差预设范围,则该像素点的像素值不变,从而即可以得到去除低频噪声的融合图像。
其中,将去除低频噪声的所述融合图像进行空域滤波,去除高频噪声,获得所述待处理图像的滤波图像具体是利用去除低频噪声的所述融合图像中每一个像素点的空域信息进行空域滤波,以去除高频噪声,具体的,可以参见图2所示实施例中所述。
图2为本申请实施例提供的一种图像滤波方法又一个实施例的流程图,该方法可以包括以下几个步骤:
201:将每一帧待处理图像以及所述待处理图像之前的连续多帧图像进行叠加,获得融合图像。
所述融合图像中每一位置的像素点像素值为所述待处理图像以及所述待处理图像之前的连续多帧图像中同一位置的像素点像素值的平均值。
202:针对所述融合图像中的每一个像素点,计算所述像素点的第一周围区域内不包括所述像素点的其它各个像素点的像素值平均值。
203:在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声。
步骤201~步骤203的操作与图1所示实施例中步骤101~步骤103的操作相同,在此不再赘述。
204:针对去除低频噪声的所述融合图像中的每一个像素点,计算所述像素点的 第二周围区域内不包括所述像素点的其它各个像素点的权重因子。
第二周围区域可以是指以像素点为中心的第二预设范围。
利用像素点与其第二周围区域内其它各个像素点的相关性,可以对融合图像去除高频噪声。
首先,计算第二周围区域内其它各个像素点的权重因子。
205:利用所述第二周围区域内其它各个像素点的权重因子以及所述像素点的像素值,计算所述像素点的加权平均值。
将像素点的像素值分别与其它各个像素点的权重因子相乘,并将获得的乘积进行累加,即可以得到像素点的加权平均值。
206:将所述像素点的像素值替换为所述加权平均值,去除高频噪声。
207:获得所述待处理图像的滤波图像。
将像素点的像素值替换为像素点的加权平均值,即可以去除融合图像的高频噪声,从而即可以获得最终的滤波图像。
其中,所述像素点的第二周围区域内不包括所述像素点的其它各个像素点的像素值的权重因子可以有多种计算方式。
作为一种可能的实现方式,所述针对去除低频噪声的所述融合图像中的每一个像素点,计算所述像素点的第二周围区域内不包括所述像素点的其它各个像素点的像素值的权重因子可以是:
针对去除低频噪声的所述融合图像中的每一个像素点,按照如下权重因子计算公式计算所述像素点的第二周围区域内的其它各个像素点的权重因子;
Figure PCTCN2016096009-appb-000001
Figure PCTCN2016096009-appb-000002
其中,W(k,l)是第二周围区域内其它各个像素点中任一个像素点(k,l)的权重因子,0≤W(k,l)≤1,∑W(k,l)=1,T为第二周围区域内的像素点个数;D(k,l)为第二周围区域像素点(k,l)的像素值。
像素点的加权平均值具体可以按照加权平均计算公式计算获得,因此所述利用所述第二周围区域内的其它各个像素点的像素值的权重因子以及所述像素点的像素值,计算所述像素点的加权平均值,去除高频噪声可以包括:
所述利用所述第二周围区域内的其它各个像素点的像素值的权重因子以及所述像素点的像素值,按照如下加权平均计算公式计算所述像素点的加权平均值;
Figure PCTCN2016096009-appb-000003
v(i,j)表示任一个像素点,u(i,j)表示所述像素点的加权平均值。
将像素点像素值替换为像素点的加权平均值,即可以去除高频噪声,从而即可以得到待处理图像的滤波图像。
本申请实施例中可以有效实现图像滤波,使得可以有效去除图像的低频噪声以及高频噪声。且算法性能高、速度快,提高了图像滤波的效率。
图3为本申请实施例提供的一种图像滤波装置一个实施例的结构示意图,该装置可以包括:
图像叠加模块301,用于将每一帧待处理图像以及所述待处理图像之前的连续多帧图像进行叠加,获得融合图像。
待处理图像是指视频中的每一帧需要进行去噪滤波的图像。
通过将多幅图像叠加,即可以检测待处理图像中的低频噪声。
其中,所述融合图像中每一位置的像素点像素值为所述待处理图像以及所述待处理图像之前的连续多帧图像中同一位置的像素点像素值的平均值。
例如,每一帧待处理图像以及每一帧待处理图像之前的连续多帧图像,假设一共为N帧连续图像,N帧连续图像叠加获得融合图像中,每一个像素点的像素值是将N帧连续图像中同一位置的像素点的像素值累加再除以N获得。
计算模块302,用于针对所述融合图像中的每一个像素点,计算所述像素点的第一周围区域内不包括所述像素点的其它各个像素点的像素值平均值。
第一滤波模块303,用于在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声。
第一周围区域是指以像素点为中心的第一预设范围。
在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,此时表明图像突变很大,可以认为是低频噪声出现导致的,因此即将像素点的像素值更新为其对应的像素值平均值。
第二滤波模块304,用于将去除低频噪声的所述融合图像进行空域滤波,去除高频噪声,获得所述待处理图像的滤波图像。
去除低频噪声的融合图像,利用空域信息进行空域滤波,即可以去除高频噪声,从而即得到待处理图像的滤波图像。
本申请实施例中,针对每一帧待处理图像,可以选择多帧图像与其进行累加,以进行低频噪声的检测;针对所述融合图像中的每一个像素点,计算所述像素点的第一周围区域内不包括所述像素点的其它各个像素点的像素值平均值;在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声;将去除低频噪声的所述融合图像再进行空域 滤波,去除高频噪声,即可以获得所述待处理图像的滤波图像,有效去除了图像的低频噪声以及高频噪声。
其中,所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时可以包括:
所述像素点的像素值大于其对应的像素值平均值,且差值大于第一预设值,或者小于其对应的像素值平均值,且差值小于第二预设值。
因此,所述第一滤波模块303可以具体用于:
在所述像素点的像素值大于其对应的像素值平均值且差值大于第一预设值,或者小于其对应的像素值平均值且差值小于第二预设值时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声。
作为一种可能的实现方式,所述第一预设值以及所述第二预设值可以为所述像素点对应的像素值平均值的30%。
当差值超出误差预设范围,可以确定图像突变很大,可以认为是低频噪声出现导致的。因此,可以将像素点的像素点用第一周围区域中的其它像素点的像素值平均值替代,如果差值在误差预设范围,则该像素点的像素值不变,从而即可以得到去除低频噪声的融合图像。
其中,将去除低频噪声的所述融合图像进行空域滤波,去除高频噪声,获得所述待处理图像的滤波图像具体是利用去除低频噪声的所述融合图像中每一个像素点的空域信息进行空域滤波,以去除高频噪声,具体的,如图4所示,作为又一个实施例,所述第二滤波模块304可以包括:
第一计算单元401,用于针对去除低频噪声的所述融合图像中的每一个像素点,计算所述像素点的第二周围区域内不包括所述像素点的其它各个像素点的像素值的 权重因子。
第二周围区域可以是指以像素点为中心的第二预设范围。
利用像素点与其第二周围区域内其它各个像素点的相关性,可以对融合图像去除高频噪声。
首先,计算第二周围区域内其它各个像素点的权重因子。
第二计算单元402,用于利用所述第二周围区域内其它各个像素点的像素值的权重因子以及所述像素点的像素值,计算所述像素点的加权平均值。
将像素点的像素值分别与其它各个像素点的权重因子相乘,并将获得的乘积进行累加,即可以得到像素点的加权平均值。
滤波单元403,用于将所述像素点的像素值替换为所述加权平均值,去除高频噪声,获得所述待处理图像的滤波图像。
将像素点的像素值替换为像素点的加权平均值,即可以去除融合图像的高频噪声,从而即可以获得最终的滤波图像。
其中,所述像素点的第二周围区域内不包括所述像素点的其它各个像素点的像素值的权重因子可以有多种计算方式。
作为一种可能的实现方式,所述第一计算单元401可以具体用于:
针对去除低频噪声的所述融合图像中的每一个像素点,按照如下权重因子计算公式计算所述像素点的第二周围区域内的其它各个像素点的权重因子;
Figure PCTCN2016096009-appb-000004
Figure PCTCN2016096009-appb-000005
其中,W(k,l)是第二周围区域内其它各个像素点中任一个像素点(k,l)的权重 因子,0≤W(k,l)≤1,∑W(k,l)=1,T为第二周围区域内的像素点个数;D(k,l)为第二周围区域像素点(k,l)的像素值。
像素点的加权平均值具体可以按照加权平均计算公式计算获得,作为又一个实施例,所述第二计算单元402可以具体用于:
利用所述第二周围区域内的其它各个像素点的像素值的权重因子以及所述像素点的像素值,按照如下加权平均计算公式计算所述像素点的加权平均值;
Figure PCTCN2016096009-appb-000006
v(i,j)表示任一个像素点,u(i,j)表示所述像素点对应的加权平均值。
将像素点像素值替换为像素点的加权平均值,即可以去除高频噪声,从而即可以得到待处理图像的滤波图像。
通过本申请实施例的技术方案,可以有效实现图像滤波,使得可以有效去除图像的低频噪声以及高频噪声。且算法性能高、速度快,提高了图像滤波的效率。
本申请实施例还提供一种非暂态计算机可读存储介质,所述非暂态计算机可读存储介质可存储有程序,该程序执行时可实现执行前述任意一个实施例提供的一种图像滤波方法的各实现方式中的部分或全部步骤。
图5是本申请实施例提供的图像滤波方法的电子设备的硬件结构示意图,如图5所示,该设备包括:
一个或多个处理器510以及存储器520,图5中以一个处理器510为例。
执行图像滤波方法的设备还可以包括:输入装置530和输出装置540。
处理器510、存储器520、输入装置530和输出装置540可以通过总线或者其他方式连接,图5中以通过总线连接为例。
存储器520作为一种非暂态计算机可读存储介质,可用于存储非易失性软件程 序、非易失性计算机可执行程序以及模块,如本申请实施例中的图像滤波方法对应的程序指令/模块。处理器510通过运行存储在存储器520中的非易失性软件程序、指令以及模块,从而执行服务器的各种功能应用以及数据处理,即实现上述方法实施例的图像滤波方法。
存储器520可以包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需要的应用程序;存储数据区可存储根据图像滤波装置的使用所创建的数据等。此外,存储器520可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中,存储器520可选包括相对于处理器510远程设置的存储器,这些远程存储器可以通过网络连接至图像滤波装置。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
输入装置530可接收输入的数字或字符信息,以及产生与图像滤波装置的用户设置以及功能控制有关的键信号输入。输出装置540可包括显示屏等显示设备。
所述一个或者多个模块存储在所述存储器520中,当被所述一个或者多个处理器510执行时,执行上述任意方法实施例中的图像滤波方法。
上述产品可执行本申请实施例所提供的方法,具备执行方法相应的功能模块和有益效果。未在本实施例中详尽描述的技术细节,可参见本申请实施例所提供的方法。
本发明实施例的电子设备以多种形式存在,包括但不限于:
(1)移动通信设备:这类设备的特点是具备移动通信功能,并且以提供话音、数据通信为主要目标。这类终端包括:智能手机(例如iPhone)、多媒体手机、功能性手机,以及低端手机等。
(2)超移动个人计算机设备:这类设备属于个人计算机的范畴,有计算和处理功能,一般也具备移动上网特性。这类终端包括:PDA、MID和UMPC设备等,例如iPad。
(3)便携式娱乐设备:这类设备可以显示和播放多媒体内容。该类设备包括:音频、预览播放器(例如iPod),掌上游戏机,电子书,以及智能玩具和便携式车载导航设备。
(4)服务器:提供计算服务的设备,服务器的构成包括处理器、硬盘、内存、系统 总线等,服务器和通用的计算机架构类似,但是由于需要提供高可靠的服务,因此在处理能力、稳定性、可靠性、安全性、可扩展性、可管理性等方面要求较高。
(5)其他具有数据交互功能的电子装置。
以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下,即可以理解并实施。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件。基于这样的理解,上述技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。

Claims (13)

  1. 一种图像滤波方法,其特征在于,包括:
    将每一帧待处理图像以及所述待处理图像之前的连续多帧图像进行叠加,获得融合图像;所述融合图像中每一位置的像素点像素值为所述待处理图像以及所述待处理图像之前的连续多帧图像中同一位置的像素点像素值的平均值;
    针对所述融合图像中的每一个像素点,计算所述像素点的第一周围区域内不包括所述像素点的其它各个像素点的像素值平均值;
    在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声;
    将去除低频噪声的所述融合图像进行空域滤波,去除高频噪声,获得所述待处理图像的滤波图像。
  2. 根据权利要求1所述的方法,其特征在于,所述将去除低频噪声的所述融合图像进行空域滤波,去除高频噪声,获得所述待处理图像的滤波图像包括:
    针对去除低频噪声的所述融合图像中的每一个像素点,计算所述像素点的第二周围区域内不包括所述像素点的其它各个像素点的像素值的权重因子;
    利用所述第二周围区域内其它各个像素点的像素值的权重因子以及所述像素点的像素值,计算所述像素点的加权平均值,并将所述像素点的像素值替换为所述加权平均值,去除高频噪声;
    获得所述待处理图像的滤波图像。
  3. 根据权利要求2所述的方法,其特征在于,所述针对去除低频噪声的所述融合图像中的每一个像素点,计算所述像素点的第二周围区域内不包括所述像素点的其它各个像素点的像素值的权重因子包括:
    针对去除低频噪声的所述融合图像中的每一个像素点,按照如下权重因子计 算公式计算所述像素点的第二周围区域内的其它各个像素点的权重因子;
    Figure PCTCN2016096009-appb-100001
    Figure PCTCN2016096009-appb-100002
    其中,W(k,l)是像素点(k,l)的权重因子,0≤W(k,l)≤1,∑W(k,l)=1,T为第二周围区域内的其它像素点个数;D(k,l)为第二周围区域像素点(k,l)的像素值;
    所述利用所述第二周围区域内的其它各个像素点的像素值的权重因子以及所述像素点的像素值,计算所述像素点的加权平均值包括:
    利用所述第二周围区域内的其它各个像素点的像素值的权重因子以及所述像素点的像素值,按照如下加权平均计算公式计算所述像素点的加权平均值;
    Figure PCTCN2016096009-appb-100003
    v(i,j)表示任一个像素点,u(i,j)表示所述像素点对应的加权平均值。
  4. 根据权利要求1所述的方法,其特征在于,在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声包括:
    在所述像素点的像素值大于其对应的像素值平均值且差值大于第一预设值,或者小于其对应的像素值平均值且差值小于第二预设值时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声。
  5. 根据权利要求4所述的方法,其特征在于,所述第一预设值以及所述第二预设值为所述像素点对应的像素值平均值的30%。
  6. 一种图像滤波装置,其特征在于,包括:
    图像叠加模块,用于将每一帧待处理图像以及所述待处理图像之前的连续多帧图像进行叠加,获得融合图像;所述融合图像中每一位置的像素点像素值为所 述待处理图像以及所述待处理图像之前的连续多帧图像中同一位置的像素点像素值的平均值;
    计算模块,用于针对所述融合图像中的每一个像素点,计算所述像素点的第一周围区域内不包括所述像素点的其它各个像素点的像素值平均值;
    第一滤波模块,用于在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声;
    第二滤波模块,用于将去除低频噪声的所述融合图像进行空域滤波,去除高频噪声,获得所述待处理图像的滤波图像。
  7. 根据权利要求6所述的装置,其特征在于,所述第二滤波模块包括:
    第一计算单元,用于针对去除低频噪声的所述融合图像中的每一个像素点,计算所述像素点的第二周围区域内不包括所述像素点的其它各个像素点的像素值的权重因子;
    第二计算单元,用于利用所述第二周围区域内其它各个像素点的像素值的权重因子以及所述像素点的像素值,计算所述像素点的加权平均值;
    滤波单元,用于将所述像素点的像素值替换为所述加权平均值,去除高频噪声,获得所述待处理图像的滤波图像。
  8. 根据权利要求7所述的装置,其特征在于,所述第一计算单元具体用于:
    针对去除低频噪声的所述融合图像中的每一个像素点,按照如下权重因子计算公式计算所述像素点的第二周围区域内的其它各个像素点的权重因子;
    Figure PCTCN2016096009-appb-100004
    Figure PCTCN2016096009-appb-100005
    其中,W(k,l)是像素点(k,l)的权重因子,0≤W(k,l)≤1,∑W(k,l)=1,T为第 二周围区域内的其它像素点个数;D(k,l)为第二周围区域像素点(k,l)的像素值;
    所述第二计算单元具体用于:
    利用所述第二周围区域内的其它各个像素点的像素值的权重因子以及所述像素点的像素值,按照如下加权平均计算公式计算所述像素点的加权平均值;
    Figure PCTCN2016096009-appb-100006
    v(i,j)表示任一个像素点,u(i,j)表示所述像素点对应的加权平均值。
  9. 根据权利要求6所述的装置,其特征在于,所述第一滤波模块具体用于:
    在所述像素点的像素值大于其对应的像素值平均值且差值大于第一预设值,或者小于其对应的像素值平均值且差值小于第二预设值时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声。
  10. 根据权利要求9所述的装置,其特征在于,所述第一预设值以及所述第二预设值为所述像素点对应的像素值平均值的30%。
  11. 一种非暂态计算机可读存储介质,其特征在于,所述非暂态计算机可读存储介质存储计算机程序,所述计算机程序用于使所述计算机执行权利要求1-5任一所述方法。
  12. 一种电子设备,包括:
    一个或多个处理器;以及,
    存储器;其特征在于,
    所述存储器存储有可被所述一个或多个处理器执行的指令,所述指令被所述一个或多个处理器执行,以使所述一个或多个处理器:
    将每一帧待处理图像以及所述待处理图像之前的连续多帧图像进行叠加,获得融合图像;所述融合图像中每一位置的像素点像素值为所述待处理图像以及所述待处理图像之前的连续多帧图像中同一位置的像素点像素值的平均值;
    针对所述融合图像中的每一个像素点,计算所述像素点的第一周围区域内不包括所述像素点的其它各个像素点的像素值平均值;
    在所述像素点的像素值与其对应的像素值平均值的差值超出预设范围时,将所述像素点的像素值更新为其对应的像素值平均值,去除低频噪声;
    将去除低频噪声的所述融合图像进行空域滤波,去除高频噪声,获得所述待处理图像的滤波图像。
  13. 一种计算机程序产品,所述计算机程序产品包括存储在非暂态计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被计算机执行时,使所述计算机执行权利要求1-5所述的方法。
PCT/CN2016/096009 2015-12-14 2016-08-19 图像滤波方法及装置 Ceased WO2017101489A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510926142.5A CN105894460A (zh) 2015-12-14 2015-12-14 图像滤波方法及装置
CN201510926142.5 2015-12-14

Publications (1)

Publication Number Publication Date
WO2017101489A1 true WO2017101489A1 (zh) 2017-06-22

Family

ID=57002409

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/096009 Ceased WO2017101489A1 (zh) 2015-12-14 2016-08-19 图像滤波方法及装置

Country Status (2)

Country Link
CN (1) CN105894460A (zh)
WO (1) WO2017101489A1 (zh)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110889894A (zh) * 2019-10-25 2020-03-17 中国科学院深圳先进技术研究院 三维人脸重建方法、装置及终端设备
CN111340777A (zh) * 2020-02-25 2020-06-26 深圳市景阳科技股份有限公司 图像噪声点的判断方法及装置
CN111507923A (zh) * 2020-04-21 2020-08-07 浙江大华技术股份有限公司 一种视频图像的噪声处理方法、装置、设备和介质
CN111626944A (zh) * 2020-04-21 2020-09-04 温州大学 一种基于时空金字塔网络和对抗自然先验的视频去模糊方法
CN112330553A (zh) * 2020-10-30 2021-02-05 武汉理工大学 一种裂缝图像去噪方法、设备及存储介质
CN112446837A (zh) * 2020-11-10 2021-03-05 浙江大华技术股份有限公司 图像滤波方法、电子设备及存储介质
CN112651919A (zh) * 2021-01-26 2021-04-13 南京超辰信息科技有限公司 一种遥感图像测绘及处理系统
CN112767295A (zh) * 2021-01-14 2021-05-07 Oppo广东移动通信有限公司 图像处理方法、图像处理装置、存储介质与电子设备
CN112907476A (zh) * 2021-03-02 2021-06-04 中国电子科技集团公司第三研究所 时域与空域相结合的红外图像实时帧间降噪方法及装置
CN113052767A (zh) * 2019-12-26 2021-06-29 深圳市万普拉斯科技有限公司 滤波矩阵生成方法、装置、终端设备和可读存储介质
CN113240609A (zh) * 2021-05-26 2021-08-10 Oppo广东移动通信有限公司 图像去噪方法、装置及存储介质
CN113938575A (zh) * 2021-07-23 2022-01-14 东莞理工学院 一种视频超分辨率重构方法、装置、终端设备及存储介质
CN113989141A (zh) * 2021-10-22 2022-01-28 赛诺威盛科技(北京)股份有限公司 Ct头部图像降噪方法、装置及存储介质
CN114066737A (zh) * 2020-07-30 2022-02-18 北京达佳互联信息技术有限公司 图像处理方法、装置、存储介质和电子设备
CN114881865A (zh) * 2022-03-02 2022-08-09 合肥的卢深视科技有限公司 深度图像去噪方法、电子设备及存储介质
CN115690432A (zh) * 2022-09-26 2023-02-03 昆山国显光电有限公司 图像处理方法、装置、电子设备和存储介质
CN116735612A (zh) * 2023-08-15 2023-09-12 山东精亿机械制造有限公司 一种精密电子元器件焊接缺陷检测方法

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106952373B (zh) * 2017-03-23 2023-06-23 成都零一智慧科技有限公司 一种基于动态图像识别的人工智能系统
JP6987352B2 (ja) * 2017-11-17 2021-12-22 富士フイルムヘルスケア株式会社 医用画像処理装置および医用画像処理方法
CN108063920A (zh) * 2017-12-26 2018-05-22 深圳开立生物医疗科技股份有限公司 一种图像冻结方法、装置、设备及计算机可读存储介质
CN110516680B (zh) * 2019-08-05 2023-04-07 上海摩软通讯技术有限公司 图像处理方法及装置
CN111369465B (zh) * 2020-03-04 2024-03-08 东软医疗系统股份有限公司 Ct动态图像增强方法及装置
CN114022449A (zh) * 2021-11-05 2022-02-08 深圳百广科科技有限公司 一种台球比赛中的图像处理方法及系统
CN114881981B (zh) * 2022-05-19 2023-03-10 常州市新创智能科技有限公司 一种玻纤布面的蚊虫检测方法及装置
CN116152112B (zh) * 2023-03-07 2026-03-06 上海联影医疗科技股份有限公司 时空结合降噪方法、装置、电子设备和存储介质
CN118822894A (zh) * 2024-08-22 2024-10-22 中国农业科学院北京畜牧兽医研究所 一种用于猪只拍照的雷达干扰补偿方法
CN119624820B (zh) * 2024-12-02 2025-10-28 中国科学院合肥物质科学研究院 图像处理方法和装置、程序产品和存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020028025A1 (en) * 2000-07-18 2002-03-07 Hong Sung Hoon Spatio-temporal joint filter for noise reduction
CN102752483A (zh) * 2012-06-12 2012-10-24 天津天地伟业数码科技有限公司 基于fpga平台的滤波降噪系统及滤波降噪方法
CN103501401A (zh) * 2013-10-01 2014-01-08 中国人民解放军国防科学技术大学 面向超大噪声基于预滤波的实时视频去噪方法
CN104010114A (zh) * 2014-05-29 2014-08-27 广东威创视讯科技股份有限公司 视频去噪方法和装置
CN104574301A (zh) * 2014-12-25 2015-04-29 深圳市一体太赫兹科技有限公司 一种太赫兹图像重构方法及系统

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4709794B2 (ja) * 2007-03-15 2011-06-22 株式会社東芝 動き推定装置及びその方法
CN103606132B (zh) * 2013-10-31 2016-04-13 西安电子科技大学 基于空域和时域联合滤波的多帧数字图像去噪方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020028025A1 (en) * 2000-07-18 2002-03-07 Hong Sung Hoon Spatio-temporal joint filter for noise reduction
CN102752483A (zh) * 2012-06-12 2012-10-24 天津天地伟业数码科技有限公司 基于fpga平台的滤波降噪系统及滤波降噪方法
CN103501401A (zh) * 2013-10-01 2014-01-08 中国人民解放军国防科学技术大学 面向超大噪声基于预滤波的实时视频去噪方法
CN104010114A (zh) * 2014-05-29 2014-08-27 广东威创视讯科技股份有限公司 视频去噪方法和装置
CN104574301A (zh) * 2014-12-25 2015-04-29 深圳市一体太赫兹科技有限公司 一种太赫兹图像重构方法及系统

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110889894A (zh) * 2019-10-25 2020-03-17 中国科学院深圳先进技术研究院 三维人脸重建方法、装置及终端设备
CN113052767A (zh) * 2019-12-26 2021-06-29 深圳市万普拉斯科技有限公司 滤波矩阵生成方法、装置、终端设备和可读存储介质
CN111340777A (zh) * 2020-02-25 2020-06-26 深圳市景阳科技股份有限公司 图像噪声点的判断方法及装置
CN111340777B (zh) * 2020-02-25 2023-10-13 深圳市景阳科技股份有限公司 图像噪声点的判断方法及装置
CN111507923A (zh) * 2020-04-21 2020-08-07 浙江大华技术股份有限公司 一种视频图像的噪声处理方法、装置、设备和介质
CN111626944A (zh) * 2020-04-21 2020-09-04 温州大学 一种基于时空金字塔网络和对抗自然先验的视频去模糊方法
CN111626944B (zh) * 2020-04-21 2023-07-25 温州大学 一种基于时空金字塔网络和对抗自然先验的视频去模糊方法
CN111507923B (zh) * 2020-04-21 2023-09-12 浙江大华技术股份有限公司 一种视频图像的噪声处理方法、装置、设备和介质
CN114066737A (zh) * 2020-07-30 2022-02-18 北京达佳互联信息技术有限公司 图像处理方法、装置、存储介质和电子设备
CN112330553A (zh) * 2020-10-30 2021-02-05 武汉理工大学 一种裂缝图像去噪方法、设备及存储介质
CN112330553B (zh) * 2020-10-30 2022-07-01 武汉理工大学 一种裂缝图像去噪方法、设备及存储介质
CN112446837A (zh) * 2020-11-10 2021-03-05 浙江大华技术股份有限公司 图像滤波方法、电子设备及存储介质
CN112767295A (zh) * 2021-01-14 2021-05-07 Oppo广东移动通信有限公司 图像处理方法、图像处理装置、存储介质与电子设备
CN112651919A (zh) * 2021-01-26 2021-04-13 南京超辰信息科技有限公司 一种遥感图像测绘及处理系统
CN112907476B (zh) * 2021-03-02 2023-10-20 中国电子科技集团公司第三研究所 时域与空域相结合的红外图像实时帧间降噪方法及装置
CN112907476A (zh) * 2021-03-02 2021-06-04 中国电子科技集团公司第三研究所 时域与空域相结合的红外图像实时帧间降噪方法及装置
CN113240609A (zh) * 2021-05-26 2021-08-10 Oppo广东移动通信有限公司 图像去噪方法、装置及存储介质
CN113938575B (zh) * 2021-07-23 2023-06-13 东莞理工学院 一种视频超分辨率重构方法、装置、终端设备及存储介质
CN113938575A (zh) * 2021-07-23 2022-01-14 东莞理工学院 一种视频超分辨率重构方法、装置、终端设备及存储介质
CN113989141B (zh) * 2021-10-22 2022-12-23 赛诺威盛科技(北京)股份有限公司 Ct头部图像降噪方法、装置及存储介质
CN113989141A (zh) * 2021-10-22 2022-01-28 赛诺威盛科技(北京)股份有限公司 Ct头部图像降噪方法、装置及存储介质
CN114881865A (zh) * 2022-03-02 2022-08-09 合肥的卢深视科技有限公司 深度图像去噪方法、电子设备及存储介质
CN115690432A (zh) * 2022-09-26 2023-02-03 昆山国显光电有限公司 图像处理方法、装置、电子设备和存储介质
CN116735612A (zh) * 2023-08-15 2023-09-12 山东精亿机械制造有限公司 一种精密电子元器件焊接缺陷检测方法
CN116735612B (zh) * 2023-08-15 2023-11-07 山东精亿机械制造有限公司 一种精密电子元器件焊接缺陷检测方法

Also Published As

Publication number Publication date
CN105894460A (zh) 2016-08-24

Similar Documents

Publication Publication Date Title
WO2017101489A1 (zh) 图像滤波方法及装置
US10007990B2 (en) Generating composite images using estimated blur kernel size
US9396523B2 (en) Image restoration cascade
TWI596573B (zh) 影像處理裝置及其影像雜訊抑制方法
WO2021114868A1 (zh) 降噪方法、终端及存储介质
WO2019071613A1 (zh) 一种图像处理方法及装置
CN104115482B (zh) 图像噪声除去装置、以及图像噪声除去方法
WO2016107961A1 (en) Method, apparatus and computer program product for motion deblurring of images
CN111882578B (zh) 前景图像获取方法、前景图像获取装置和电子设备
WO2017185772A1 (zh) 一种视频图像增强的方法、装置和计算机存储介质
EP2809060A2 (en) Adaptive motion instability detection in video
CN107360435B (zh) 块效应检测方法、块噪声滤除方法及装置
WO2017113917A1 (zh) 成像方法、成像装置和终端
CN104506775A (zh) 基于立体视觉匹配的图像采集抖动消除方法及装置
CN101212656B (zh) 成像设备、成像信号处理方法和程序
CN110689496B (zh) 降噪模型的确定方法、装置、电子设备和计算机存储介质
CN103020908B (zh) 图像降噪的方法和设备
IL256484B (en) Hybride denoising of images and videos based on interest metrics
US10764509B2 (en) Image processing device, image processing method, and program
CN106372602A (zh) 一种视频文件的处理方法和装置
JP5327245B2 (ja) 画像処理装置、電子カメラ及び画像処理プログラム
WO2014165159A1 (en) System and method for blind image deconvolution
CN104168405A (zh) 噪声抑制方法及其图像处理装置
CN112055255B (zh) 拍摄画质优化方法、装置、智能电视和可读存储介质
CN106488079B (zh) 一种视频去噪的方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16874549

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16874549

Country of ref document: EP

Kind code of ref document: A1