EP1153364A1 - Procede et appareil de traitement d'images couleur - Google Patents

Procede et appareil de traitement d'images couleur

Info

Publication number
EP1153364A1
EP1153364A1 EP00903005A EP00903005A EP1153364A1 EP 1153364 A1 EP1153364 A1 EP 1153364A1 EP 00903005 A EP00903005 A EP 00903005A EP 00903005 A EP00903005 A EP 00903005A EP 1153364 A1 EP1153364 A1 EP 1153364A1
Authority
EP
European Patent Office
Prior art keywords
color
pixels
image processing
pixel
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP00903005A
Other languages
German (de)
English (en)
Other versions
EP1153364A4 (fr
Inventor
Hyun Doo Shin
Yang Lim Choi
Yining Dept. Elec. & Computer Engineering DENG
B. S. Dept. Electrical & Computer Eng. MANJUNATH
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
University of California
Original Assignee
Samsung Electronics Co Ltd
University of California
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd, University of California filed Critical Samsung Electronics Co Ltd
Publication of EP1153364A1 publication Critical patent/EP1153364A1/fr
Publication of EP1153364A4 publication Critical patent/EP1153364A4/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration by the use of local operators
    • G06T5/70—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/56—Extraction of image or video features relating to colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20172—Image enhancement details
    • G06T2207/20192—Edge enhancement; Edge preservation

Definitions

  • the present invention relates to an image processing method, and more particularly, to a color image processing method which is a pre-processing method required for retrieving a color feature descriptor used in indexing and searching a color image.
  • color feature descriptors for indexing and searching color images are defined.
  • a color feature descriptor is retrieved from an input image.
  • the color image processing method in order to retrieve a color feature descriptor, an input image is segmented into a plurality of regions, quantized color vectors for the segmented regions are obtained, and then the color feature descriptor of a pertinent region is determined using the quantized color vectors.
  • noise components may exist in the image.
  • good color quantization is important in accurately representing color information in the image.
  • pre-processing such as filtering or noise removal is necessarily performed before quantization.
  • filtering methods such as vector median filtering or vector directional filtering have been employed.
  • filtering method used in conventional color image processing methods are uniformly applied to an image, non-noisy pixels may be modified, which causes edge blurring in the original image.
  • a feature of the present invention is embodied by a color image processing method includes the steps of (a) sorting image pixels according to the color distance between the image pixels and a central pixel, (b) grouping the sorted pixels into groups in which the difference in the intragroup color distance is minimum and the difference in the intergroup color difference is maximum, and (c) performing filtering by replacing a central pixel value with a predetermined pixel value determined by pixel values of pixels in the groups.
  • the color image processing method may further include the step of defining a window having a predetermined size within an input color image, wherein the image pixels are pixels within the window.
  • the method preferably further includes the step of removing pixels having a difference in color distance from the central pixel greater than or equal to a predetermined threshold, with respect to a predetermined number of pixels at the beginning and latter parts among the sorted pixels.
  • the predetermined number is preferably less than or equal to L/2.
  • L is a predetermined positive number indicating the size of an L ⁇ L window.
  • the method preferably further includes the step of removing pixels having a difference in color distance from the central pixel greater than or equal to a predetermined threshold, with respect to a predetermined number of pixels at the beginning and latter parts among the sorted pixels.
  • the step (b) may include grouping the sorted pixels using a function based on a Fisher's discriminant estimation method.
  • the method may further include the steps of selecting / pixels ranging from the pixel having the minimum color distance among the pixels sorted according to the color distance from the central pixel and setting the largest value of the color distances of the selected pixels as the maximum color distance within the peer group, and performing color quantization by weighting the color vectors of the respective pixels by exp(-T(n)), wherein T(n) is the maximum color distance within the peer group.
  • the method may further include the steps of selecting pixels ranging from the pixel having the minimum color distance among the pixels sorted according to the color distance from the central pixel and setting the largest value of the color distances of the selected pixels as the maximum color distance within the peer group, and obtaining the average of T(n) values of the whole image and performing color quantization using a value obtained by multiplying the average with a predetermined constant as the number of clusters, wherein T(n) is the maximum color distance within the peer group.
  • the method may further include the steps of selecting pixels whose number corresponds to the size of the peer group, ranging from the pixel having the minimum color distance among the pixels sorted according to the color distance from the central pixel and setting the largest value of the color distances of the selected pixels as the maximum color distance within the peer group, and weighting the color vectors of the respective pixels by exp(-T(n)), wherein T(n) is the maximum color distance within the peer group, and performing color quantization using a value obtained by multiplying the average of the T(n) values of the whole image with a predetermined constant as the number of dusters.
  • the step (c) preferably includes replacing the central pixel X tract(n) with a new pixel X ' a (n) by the following Expression:
  • pfn are the pixels constituting the peer group and Wf are predetermined weights corresponding to pfn).
  • the step (c) preferably includes replacing the color vector of the central pixel with an average weighted by a predetermined weight that is larger for a pixel closer to the central pixel and is smaller for a pixel distant from the central pixel.
  • the predetermined weight is preferably a value determined by a standard Gaussian function.
  • the color image processing method may further include the step of performing color quantization by weighting the color vectors of the respective pixels by exp(-T(n)). wherein T(n) is the maximum color distance within one group.
  • a color image processing method including the steps of (a) receiving a color image frame and segmenting the same into a plurality of color images by a predetermined segmentation method, (b) sorting image pixels according to the color distance between the image pixels and a central pixel, with respect to an image selected among the segmented color images, (c) grouping the sorted pixels into groups in which the difference in the intragroup color distance is minimum and the difference in the intergroup color difference is maximum, and (d) performing filtering by replacing a central pixel value with a predetermined pixel value determined by pixel values of pixels in the groups.
  • a color image processing method including the steps of (a) defining a window having a predetermined size within an input color image, (b) selecting pixels having a color vector similar to that of the central pixel within the window and defining the selected pixels as a group, and (c) performing filtering of blurring using only the pixels within the defined group.
  • the present invention is also embodied by a computer readable medium having program codes executable by a computer to perform a color image processing method, the method including the steps of (a) defining a window having a predetermined size within an input color image, (b) sorting image pixels according to the color distance between the image pixels and a central pixel, (c) grouping the sorted pixels into groups in which the difference in the intragroup color distance is minimum and the difference in the intergroup color difference is maximum, and (d) performing filtering by replacing a central pixel value with a predetermined pixel value determined by pixel values of pixels in the groups.
  • the present invention provides a color image processing apparatus including sorting means for setting a window of a predetermined size within an input color image and sorting image pixels in the window according to the color distance between the image pixels and a central pixel, grouping means for grouping the sorted pixels into groups in which the difference in the intragroup color distance is minimum and the difference in the intergroup color difference is maximum, and filtering means for performing filtering by replacing a central pixel value with a predetermined pixel value determined by pixel values of pixels in the groups.
  • FIGS. 1A and IB are flow diagrams showing a color image processing method according to the present invention.
  • FIG. 2 is a block diagram of a color image processing apparatus according to the present invention.
  • a color image is input (step 100).
  • the color image may be in one region selected among image regions segmented by an appropriate segmentation method.
  • X 0 (n) which represents the color vector of a pixel positioned at a position n at the center of the L L window in an input color image, may be used to represent the corresponding pixel positioned at the center, that is a central pixel.
  • the corresponding color vectors of all pixels in the window are sorted in an ascending order according to the magnitude of the color distance dfn) (step 104).
  • the color vectors sorted in ascending order will be represented y Xfn).
  • color distance difference is calculated by Expression (2) (step 106): f l (n) ⁇ d l ⁇ 1 (n) ⁇ d l (n) (2)
  • step 108 color vectors in which f(n) is greater than a predetermined threshold Q are removed. That is. the color vectors in which f(n) is greater than a predetermined threshold Q are considered impulse noise to then be removed.
  • it is more preferably to perform the step 108 with respect to the beginning L/2 pixels and the latter L/2 pixels in ascending order, than to perform it with respect to all the (L : - 1 ) pixels in the L 'L window, except of the central pixel X n).
  • filtering is performed on pixels in a peer group to be described later, rather than on all the pixels in the L X L window.
  • the peer groups are obtained as follows.
  • the pixels sorted in ascending order according to their color distance from the color vector of the central pixel are divided into two groups.
  • the first group consists of 0th through (i -l)th pixels, and the second group consists of ;th through Rth pixels.
  • the Expression (4) is based on Fisher's discriminant estimation method.
  • the actual range of is from 1 through the numbers obtained by subtracting the number corresponding to color vectors of the pixels considered as impulse noise for removal from K. However, since the number corresponding to color vectors of the pixels considered as impulse noise and removed is not so large. it is assumed that the range of is from 1 through K.
  • the peer group P(n) when is reset to variables ranging from 0 through the value obtained in the step 1 12, the peer group P(n) consists of pixels p,(n).
  • W are the standard Gaussian weights corresponding to p,(n) (step 114).
  • the standard Gaussian weights W are determined by a standard Gaussian function. A pixel closer to the center of an image has a larger standard Gaussian weight and a pixel distant from the center has a smaller standard Gaussian weight. The procedure of replacing pixels in such a manner is smoothing or filtering.
  • the pixels in smooth regions are more heavily weighted than the pixels in highly noisy regions. Weighting the pixels in highly noisy regions more lightly than the pixels in the smooth regions is based on the analysis result of eye-perception, that is. the eye-perception is more sensitive to changes in detailed regions than in smooth regions.
  • the value obtained by multiplying a predetermined constant with the average of T(n) values of all images is preferably used as the number of clusters.
  • the color image processing method according to the present invention only the pixels having large color distances from the central pixel are removed, and then a peer group having a color vector similar to that of the central pixel is defined to then perform filtering thereon.
  • edge blurring of an image rarely occurs due to removal and filtering of impulse noise.
  • the information on the extent of quantization to be performed on an image can be obtained.
  • the color image processing method is programmable by a computer program. Codes and code segments constituting the computer program can be easily derived by a computer programmer in the art. Also, the program is stored in computer readable media and is readable and executable by the computer, thereby embodying the color image processing method.
  • the media include magnetic recording media, optical recording media, carrier wave media, and the like.
  • FIG. 2 is a block diagram of a color image processing apparatus according to the present invention.
  • the color image processing apparatus according to the present invention includes a segmenting unit 200. a sorting unit 202, an impulse noise removing unit 204. a grouping unit 206, a filtering unit 208 and a quantizing unit 210.
  • the segmenting unit 200 includes a sorting unit 202, an impulse noise removing unit 204. a grouping unit 206, a filtering unit 208 and a quantizing unit 210.
  • the segmenting unit 200 includes a sorting unit 202, an impulse noise removing unit 204. a grouping unit 206, a filtering unit 208 and a quantizing unit 210.
  • the 200 receives a color image frame and segments the color image frame into a plurality of color images by a predetermined segmentation method.
  • the sorting unit 202 sets an L ⁇ L window (L is a predetermined positive integer.) within the color images, and sorts the pixels within the window according to the color distance between each pixel and the central pixel. Thus, the sorting unit 202 outputs color vectors of the sorted pixels.
  • the impulse noise removing unit 204 removes the pixels that have a difference in color distance from the central pixel greater than a predetermined threshold, with respect to the beginning L/2 pixels and the latter L/2 pixels among the sorted pixels.
  • the grouping unit 206 receives color vectors of all the noise-removed pixels in the L ⁇ L window and divides the same into two groups in which the difference in the intragroup color distance is minimum and the difference in the intergroup color difference is maximum, by calculating the function represented by the Expression (4) using the variance and average of the color distances between the sorted pixels.
  • the filtering unit 208 performs filtering by replacing the central pixels with pixels in a group having a small difference from the color vector of the central pixels in the window.
  • the quantizing unit 210 weights the color vectors of the respective pixels by exp(-T(n)), in which T(n) is the maximum color distance within a group having a small difference in the color vector from the central pixel within the window, and performs quantization using the value obtained by multiplying a predetermined constant with the average of T(n) values of all images as the number of clusters.
  • the information on the number of clusters for quantization to be performed can be obtained based on the smoothness or details of an image to be processed.
  • quantization is can be effectively performed using the information.
  • the present invention can be applied to the fields of color image indexing or searching applications.

Abstract

L'invention concerne un procédé et un appareil de traitement d'images couleur. Ce procédé de traitement d'images couleur consiste à (a) classer les pixels de l'image en fonction de l'écart de couleur entre les pixels de l'image et un pixel central ; (b) à regrouper les pixels classés de façon à avoir un minimum d'écart de couleur dans un même groupe pour un maximum d'écart de couleur entre plusieurs groupes ; et (c) à procéder à un filtrage consistant à remplacer une valeur de pixel central par une valeur de pixel définie en fonction de chacun des pixels des groupes. Le procédé de traitement d'images couleur permet de réduire la génération d'un flou de bordures lors de l'élimination des bruit impulsionnels de l'image et de son filtrage.
EP00903005A 1999-02-05 2000-02-03 Procede et appareil de traitement d'images couleur Withdrawn EP1153364A4 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US11874199P 1999-02-05 1999-02-05
US118741P 1999-02-05
PCT/KR2000/000090 WO2000046749A1 (fr) 1999-02-05 2000-02-03 Procede et appareil de traitement d'images couleur

Publications (2)

Publication Number Publication Date
EP1153364A1 true EP1153364A1 (fr) 2001-11-14
EP1153364A4 EP1153364A4 (fr) 2002-10-30

Family

ID=22380461

Family Applications (1)

Application Number Title Priority Date Filing Date
EP00903005A Withdrawn EP1153364A4 (fr) 1999-02-05 2000-02-03 Procede et appareil de traitement d'images couleur

Country Status (8)

Country Link
EP (1) EP1153364A4 (fr)
JP (1) JP3558985B2 (fr)
KR (1) KR100439697B1 (fr)
CN (1) CN1209735C (fr)
AU (1) AU2464500A (fr)
MY (1) MY127890A (fr)
TW (1) TW463133B (fr)
WO (1) WO2000046749A1 (fr)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100378351B1 (ko) 2000-11-13 2003-03-29 삼성전자주식회사 색-텍스추어 거리 측정 방법 및 장치와 이를 이용한영상의 영역 구분 방법 및 장치
JP3862613B2 (ja) 2002-06-05 2006-12-27 キヤノン株式会社 画像処理装置及び画像処理方法並びにコンピュータプログラム
GB2400257A (en) 2003-04-05 2004-10-06 Autodesk Canada Inc Removal of grain
US7372991B2 (en) 2003-09-26 2008-05-13 Seiko Epson Corporation Method and apparatus for summarizing and indexing the contents of an audio-visual presentation
US20060103892A1 (en) * 2004-11-18 2006-05-18 Schulze Mark A System and method for a vector difference mean filter for noise suppression
CN101258523B (zh) 2005-08-17 2012-10-03 Nxp股份有限公司 用于抑制数字信号序列中噪声的方法和装置
JP4001162B2 (ja) * 2005-11-04 2007-10-31 オムロン株式会社 画像処理方法、画像処理用のプログラムならびにその記憶媒体、および画像処理装置
US7952646B2 (en) * 2006-12-27 2011-05-31 Intel Corporation Method and apparatus for content adaptive spatial-temporal motion adaptive noise reduction
CN101546425B (zh) * 2009-05-05 2011-04-13 广东工业大学 双阈值开关型彩色图像矢量滤波方法
KR101290200B1 (ko) * 2012-02-13 2013-07-30 중앙대학교 산학협력단 충격 잡음 제거 장치 및 방법
CN103778611B (zh) * 2014-01-26 2016-08-17 天津大学 利用边缘检测的开关加权矢量中值滤波方法
CN105809630B (zh) * 2014-12-30 2019-03-12 展讯通信(天津)有限公司 一种图像噪声过滤方法及系统
CN104899899A (zh) * 2015-06-12 2015-09-09 天津大学 一种基于密度峰值的颜色量化方法
CN113298790B (zh) * 2021-05-31 2023-05-05 奥比中光科技集团股份有限公司 一种图像滤波方法、装置、终端和计算机可读存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4541116A (en) * 1984-02-27 1985-09-10 Environmental Research Institute Of Mi Neighborhood image processing stage for implementing filtering operations
EP0318866A2 (fr) * 1987-12-04 1989-06-07 Polaroid Corporation Méthode pour améliorer des données d'image par réduction ou renforcement du bruit
US5684897A (en) * 1992-02-19 1997-11-04 Ezel Inc. Method for quantizing color image data by minimizing least squares error of binary coding

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5222154A (en) * 1991-06-12 1993-06-22 Hewlett-Packard Company System and method for spot color extraction
KR0149517B1 (ko) * 1992-07-18 1998-10-15 강진구 에지 검출과 노이즈 제거를 위한 다단식 비선형 필터
KR100230254B1 (ko) * 1996-04-17 1999-11-15 윤종용 잡음 감소 회로
KR100219544B1 (ko) * 1997-05-26 1999-09-01 윤종용 선택형 대역통과필터
JPH1188705A (ja) * 1997-09-11 1999-03-30 Matsushita Electric Ind Co Ltd 画像読み取り装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4541116A (en) * 1984-02-27 1985-09-10 Environmental Research Institute Of Mi Neighborhood image processing stage for implementing filtering operations
EP0318866A2 (fr) * 1987-12-04 1989-06-07 Polaroid Corporation Méthode pour améliorer des données d'image par réduction ou renforcement du bruit
US5684897A (en) * 1992-02-19 1997-11-04 Ezel Inc. Method for quantizing color image data by minimizing least squares error of binary coding

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
JIA-GUU LEU: "Image smoothing based on pixel grouping" PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING. (ICIP). WASHINGTON, OCT. 23 - 26, 1995, LOS ALAMITOS, IEEE COMP. SOC. PRESS, US, vol. 3, 23 October 1995 (1995-10-23), pages 535-538, XP010197024 ISBN: 0-7803-3122-2 *
See also references of WO0046749A1 *

Also Published As

Publication number Publication date
AU2464500A (en) 2000-08-25
CN1209735C (zh) 2005-07-06
KR100439697B1 (ko) 2004-07-14
TW463133B (en) 2001-11-11
KR20010113666A (ko) 2001-12-28
EP1153364A4 (fr) 2002-10-30
CN1341246A (zh) 2002-03-20
WO2000046749A1 (fr) 2000-08-10
JP3558985B2 (ja) 2004-08-25
MY127890A (en) 2006-12-29
JP2002536749A (ja) 2002-10-29

Similar Documents

Publication Publication Date Title
US6778697B1 (en) Color image processing method and apparatus thereof
Wang et al. Best neighborhood matching: An information loss restoration technique for block-based image coding systems
EP1112661B1 (fr) Suivi d'objets semantiques dans des sequences d'images vectorielles
US6535632B1 (en) Image processing in HSI color space using adaptive noise filtering
EP1153364A1 (fr) Procede et appareil de traitement d'images couleur
CN111260738A (zh) 基于相关滤波和自适应特征融合的多尺度目标跟踪方法
AU753599B2 (en) Color image processing method and apparatus thereof
CN110827265B (zh) 基于深度学习的图片异常检测方法
US6970268B1 (en) Color image processing method and apparatus thereof
CN115908154A (zh) 基于图像处理的视频后期颗粒噪声去除方法
EP1509882A1 (fr) Algorithme de detecteur de changement de scene dans une sequence d'images
CN113313179A (zh) 一种基于l2p范数鲁棒最小二乘法的噪声图像分类方法
Mohanty et al. A survey on moving object detection using background subtraction methods in video
US5862263A (en) Fractal image compression device and method using perceptual distortion measurement
CN112084371B (zh) 一种电影多标签分类方法、装置、电子设备以及存储介质
Choi et al. Fast super-resolution algorithm using ELBP classifier
CN107424173B (zh) 一种基于扩展的局部不变特征描述的目标跟踪方法
Azimi-Sadjadi et al. Neural network decision directed edge-adaptive Kalman filter for image estimation
CN111291602A (zh) 视频检测方法、装置、电子设备及计算机可读存储介质
JP2980810B2 (ja) 動きベクトル探索方法と装置
KR102556777B1 (ko) k-NN 탐색기반 영상복원장치 및 방법
CN110248182B (zh) 一种场景片段镜头检测方法
Prakash et al. Intelligent systems for redundancy removal with proficient run-length coding and statistical analysis using regression
Radha et al. Threshold based segmentation using median filter for sign language recognition system
CN116563170A (zh) 一种图像数据处理方法、系统以及电子设备

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20010802

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

A4 Supplementary search report drawn up and despatched

Effective date: 20020916

AK Designated contracting states

Kind code of ref document: A4

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

RIC1 Information provided on ipc code assigned before grant

Free format text: 7G 06T 1/00 A, 7G 06T 7/60 B, 7G 06T 5/20 B, 7G 06T 7/40 B

17Q First examination report despatched

Effective date: 20050222

17Q First examination report despatched

Effective date: 20050222

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20100901