JP2009044594A5 - - Google Patents
Download PDFInfo
- Publication number
- JP2009044594A5 JP2009044594A5 JP2007209033A JP2007209033A JP2009044594A5 JP 2009044594 A5 JP2009044594 A5 JP 2009044594A5 JP 2007209033 A JP2007209033 A JP 2007209033A JP 2007209033 A JP2007209033 A JP 2007209033A JP 2009044594 A5 JP2009044594 A5 JP 2009044594A5
- Authority
- JP
- Japan
- Prior art keywords
- color difference
- color
- pixel
- calculating
- calculated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000002093 peripheral Effects 0.000 claims 9
- 238000000034 method Methods 0.000 claims 2
- 238000003672 processing method Methods 0.000 claims 2
- 230000000875 corresponding Effects 0.000 claims 1
- 230000003100 immobilizing Effects 0.000 claims 1
- 230000000116 mitigating Effects 0.000 claims 1
Claims (15)
上記画像における位置を（ｘ，ｙ）（ここに、ｘは横方向の画素位置を示す整数、ｙは縦方向の画素位置を示す整数）として表し、上記第１の色信号を有する画素が欠落している位置（ｘ0，ｙ0）の上記第１の色信号とは異なる第２の色信号を有する画素をＸ（ｘ0，ｙ0）としたときに、このＸ（ｘ0，ｙ0）に対して、Ｍ種類（Ｍは２以上の整数）の補間態様で補間されたＭ種類の上記第１の色信号Ｇt（ｘ0，ｙ0）（ここに、ｔ＝１，…，Ｍ）を算出する画素補間候補算出手段と、
上記Ｘ（ｘ0，ｙ0）に対して周辺の同種色信号を用いて帯域制限したＸL（ｘ0，ｙ0）を算出する帯域制限手段と、
上記画素補間候補算出手段により算出されたＭ種類の上記第１の色信号Ｇｔに基づいて、色差候補Ｘ（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）または色差候補ＸL（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）でなるＭ種類の色差候補を算出する色差候補算出手段と、
上記色差候補Ｘ（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）を算出する際に用いた上記第１の色信号Ｇt（ｘ0，ｙ0）と同一種類ｔの、周辺位置（ｘ0＋ｎ，ｙ0＋ｍ）（ここに、ｎとｍとは同時に０とはならない任意の整数）において算出された上記第１の色信号Ｇt（ｘ0＋ｎ，ｙ0＋ｍ）に基づき、該周辺位置（ｘ0＋ｎ，ｙ0＋ｍ）に対して算出されたＸの複数の色差候補Ｘ（ｘ0＋ｎ，ｙ0＋ｍ）−Ｇt（ｘ0＋ｎ，ｙ0＋ｍ）と、該色差候補Ｘ（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）とに基づいて、
または、上記色差候補ＸL（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）を算出する際に用いた上記第１の色信号Ｇt（ｘ0，ｙ0）と同一種類ｔの、周辺位置（ｘ0＋ｎ，ｙ0＋ｍ）（ここに、ｎとｍとは同時に０とはならない任意の整数）において算出されたＧt（ｘ0＋ｎ，ｙ0＋ｍ）に基づき、該周辺位置（ｘ0＋ｎ，ｙ0＋ｍ）に対して算出されたＸLの複数の色差候補ＸL（ｘ0＋ｎ，ｙ0＋ｍ）−Ｇt（ｘ0＋ｎ，ｙ0＋ｍ）と、該色差候補ＸL（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）とに基づいて、Ｍ種類の色差類似度を算出し、
この算出したＭ種類の色差類似度に基づいて、Ｍ種類の上記第１の色信号Ｇt（ｘ0，ｙ0）の内のｐ種類の上記第１の色信号Ｇp（ｘ0，ｙ0）（ここに、１≦ｐ≦Ｍ）またはｑ種類の上記第１の色信号Ｇq（ｘ0，ｙ0）（ここに、１≦ｑ≦Ｍ）に基づき算出された色差候補Ｘ（ｘ0，ｙ0）−Ｇp（ｘ0，ｙ0）または色差候補ＸL（ｘ0，ｙ0）−Ｇq（ｘ0，ｙ0）を色差として選択する最適色差選択手段と、
上記Ｘ（ｘ0，ｙ0）から上記最適色差選択手段により選択された色差Ｘ（ｘ0，ｙ0）−Ｇp（ｘ0，ｙ0）または色差ＸL（ｘ0，ｙ0）−Ｇq（ｘ0，ｙ0）を減算することにより、位置（ｘ0，ｙ0）に対する上記第１の色信号Ｇ（ｘ0，ｙ0）を算出する算出手段と、
を具備したことを特徴とする画像処理装置。 Image processing for processing an image including a pixel in which at least one color signal is missing among a plurality of color signals and generating an image including a pixel in which at least a first color signal is interpolated among the plurality of color signals A device,
The position in the image is represented as (x, y) (where x is an integer indicating the pixel position in the horizontal direction and y is an integer indicating the pixel position in the vertical direction), and the pixel having the first color signal is missing When a pixel having a second color signal different from the first color signal at the position (x0, y0) is X (x0, y0), for this X (x0, y0), Pixel interpolation candidates for calculating M types of first color signals Gt (x0, y0) (here, t = 1,..., M) interpolated in M types (M is an integer of 2 or more). A calculation means;
Band limiting means for calculating XL (x0, y0) band-limited to the above X (x0, y0) using peripheral similar color signals;
Based on the M types of first color signals Gt calculated by the pixel interpolation candidate calculation means, color difference candidates X (x0, y0) -Gt (x0, y0) or color difference candidates XL (x0, y0) -Gt Color difference candidate calculating means for calculating M types of color difference candidates of (x0, y0);
Peripheral position (x0 + n, y0 + m) of the same type t as the first color signal Gt (x0, y0) used in calculating the color difference candidate X (x0, y0) −Gt (x0, y0) (here In addition, based on the first color signal Gt (x0 + n, y0 + m) calculated for n and m, which are arbitrary integers that are not 0 at the same time, X calculated for the peripheral position (x0 + n, y0 + m) Based on the plurality of color difference candidates X (x0 + n, y0 + m) −Gt (x0 + n, y0 + m) and the color difference candidates X (x0, y0) −Gt (x0, y0),
Alternatively, the peripheral position (x0 + n, y0 + m) of the same type t as the first color signal Gt (x0, y0) used in calculating the color difference candidate XL (x0, y0) −Gt (x0, y0). Based on Gt (x0 + n, y0 + m) calculated in (here, n and m are arbitrary integers that are not 0 at the same time), a plurality of XL color differences calculated for the peripheral position (x0 + n, y0 + m) Based on the candidate XL (x0 + n, y0 + m) -Gt (x0 + n, y0 + m) and the color difference candidate XL (x0, y0) -Gt (x0, y0), M types of color difference similarities are calculated,
Based on the calculated M kinds of color difference similarities, p kinds of the first color signals Gp (x0, y0) (here, out of M kinds of the first color signals Gt (x0, y0)) 1 ≦ p ≦ M) or q kinds of first color signals Gq (x0, y0) (here, 1 ≦ q ≦ M), color difference candidates X (x0, y0) −Gp (x0, y0) or optimum color difference selection means for selecting a color difference candidate XL (x0, y0) -Gq (x0, y0) as a color difference;
Subtracting the color difference X (x0, y0) -Gp (x0, y0) or the color difference XL (x0, y0) -Gq (x0, y0) selected by the optimum color difference selection means from the X (x0, y0). Calculating means for calculating the first color signal G (x0, y0) for the position (x0, y0),
An image processing apparatus comprising:
上記最適色差選択手段または上記色差補間手段により算出された色差と、この色差と同一位置の上記第１の色信号を有する画素と、に基づいて、複数の色信号を含む画素を算出する画素算出手段と、
をさらに具備したことを特徴とする請求項１に記載の画像処理装置。 A color difference interpolation unit that performs a process of interpolating a color difference at a position where a color difference is not calculated by the optimum color difference selection unit based on a color difference of the same color around the position calculated by the optimum color difference selection unit;
Pixel calculation for calculating a pixel including a plurality of color signals based on the color difference calculated by the optimum color difference selection unit or the color difference interpolation unit and the pixel having the first color signal at the same position as the color difference. Means,
The image processing apparatus according to claim 1, further comprising:
上記所定位置の周辺の上記第１の色信号を有する画素に基づいて、該所定位置に対して補間された上記第１の色信号を算出する補間手段と、
上記所定位置に算出された補間色差と上記補間された第１の色信号とに基づいて、該所定位置において、複数の色信号を含む画素を算出する画素算出手段と、
をさらに具備したことを特徴とする請求項１に記載の画像処理装置。 A color difference interpolation means for calculating an interpolated color difference with respect to the predetermined position based on the color difference of the same color around the predetermined position;
Based on the pixels having the first color signal around the predetermined position, and interpolation means for calculating an interpolated the first color signal in pair to the predetermined position,
Based on the first color signals the interpolated color difference calculated in the predetermined position and the interpolation pixel calculation means for calculating fraud and mitigating risk pixel including a plurality of color signals in the predetermined position,
The image processing apparatus according to claim 1, further comprising:
上記色差候補Ｘ（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）と、該色差候補Ｘ（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）と同一色Ｘかつ同一種類ｔの複数の色差候補Ｘ（ｘ0＋ｎ，ｙ0＋ｍ）−Ｇt（ｘ0＋ｎ，ｙ0＋ｍ）と、に基づいた類似度と、
上記色差候補Ｘ（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）とは異なる色Ｘ^かつ同一種類ｔの複数の色差候補Ｘ^（ｘ0＋ｎ，ｙ0＋ｍ）−Ｇt（ｘ0＋ｎ，ｙ0＋ｍ）に基づいた類似度と、
に基づき算出するものであることを特徴とする請求項１に記載の画像処理装置。 The optimum color difference selecting means calculates the color difference similarity as follows:
The color difference candidate X (x0, y0) -Gt (x0, y0) and a plurality of color difference candidates X (x0 + n) of the same color X and the same type t as the color difference candidate X (x0, y0) -Gt (x0, y0) , Y0 + m) −Gt (x0 + n, y0 + m), and
Similarity based on a plurality of color difference candidates X ^ (x0 + n, y0 + m) -Gt (x0 + n, y0 + m) of a color X ^ different from the color difference candidates X (x0, y0) -Gt (x0, y0) and of the same type t. When,
The image processing apparatus according to claim 1, wherein the image processing apparatus is calculated based on the above.
上記色差候補ＸL（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）と、該色差候補ＸL（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）と同一色Ｘかつ同一種類ｔの複数の色差候補ＸL（ｘ0＋ｎ，ｙ0＋ｍ）−Ｇt（ｘ0＋ｎ，ｙ0＋ｍ）と、に基づいた類似度と、
上記色差候補ＸL（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）とは異なる色Ｘ^かつ同一種類ｔの複数の色差候補Ｘ^L（ｘ0＋ｎ，ｙ0＋ｍ）−Ｇt（ｘ0＋ｎ，ｙ0＋ｍ）に基づいた類似度と、
に基づき算出するものであることを特徴とする請求項１に記載の画像処理装置。 The optimum color difference selection means calculates the color difference similarity as follows:
The color difference candidate XL (x0, y0) -Gt (x0, y0) and a plurality of color difference candidates XL (x0 + n) of the same color X and the same type t as the color difference candidate XL (x0, y0) -Gt (x0, y0) , Y0 + m) −Gt (x0 + n, y0 + m), and
Similarity based on a plurality of color difference candidates X ^ L (x0 + n, y0 + m) -Gt (x0 + n, y0 + m) of a color X ^ different from the color difference candidate XL (x0, y0) -Gt (x0, y0) and of the same type t Degree,
The image processing apparatus according to claim 1, wherein the image processing apparatus is calculated on the basis of the above.
上記最適色差選択手段は、Ｍ種類の上記色差類似度の内の最小値を与える色差類似度の１つに対応する色差候補を１つ選択する選択手段を含み、該選択手段により選択された色差候補を色差とするものであることを特徴とする請求項４または請求項５に記載の画像処理装置。 The similarity is the sum of absolute differences between color difference candidates of the same color X and the same type t,
The optimum color difference selecting means includes a selecting means for selecting one color difference candidate corresponding to one of the color difference similarities giving the minimum value among the M types of color difference similarities, and the color difference selected by the selecting means 6. The image processing apparatus according to claim 4, wherein the candidate is a color difference.
上記高色差判定手段により高色差であると判定された位置（ｘ0，ｙ0）に対するＧ（ｘ0，ｙ0）をＧt（ｘ0，ｙ0）に変更する変更手段と、
をさらに具備したことを特徴とする請求項１に記載の画像処理装置。 When the color difference selected by the optimum color difference selection means is XL (x0, y0) −Gt (x0, y0), it is determined whether or not the color difference is a high color difference by comparing the color difference with a predetermined threshold value. High color difference determination means;
Changing means for changing G (x0, y0) to Gt (x0, y0) for the position (x0, y0) determined to be a high color difference by the high color difference determining means;
The image processing apparatus according to claim 1, further comprising:
上記飽和状態判定手段により飽和状態にあると判定された場合には、上記最適色差選択手段によってＭ種類の色差候補から選択される色差を、上記飽和状態に基づいて予め決定された１種類の色差に固定化する固定化手段と、
をさらに具備したことを特徴とする請求項１に記載の画像処理装置。 X (x0, y0) at the position (x0, y0) and X (x0 + u, y0 + v) at positions around the position (x0, y0) (where u and v are not 0 at the same time) ) And a saturation state determination means for determining a saturation state for the position (x0, y0),
When it is determined that the saturation state is determined by the saturation state determination unit, the color difference selected from the M types of color difference candidates by the optimum color difference selection unit is determined as one type of color difference determined in advance based on the saturation state. Immobilization means for immobilizing to,
The image processing apparatus according to claim 1, further comprising:
上記Ｘ画素の上下に隣接する２つのＧ画素の平均を上記Ｍ種類のＧ成分信号の内の１種類のＧ成分信号として算出する第１の補間算出手段と、 First interpolation calculating means for calculating an average of two G pixels adjacent above and below the X pixel as one kind of G component signals of the M kinds of G component signals;
該Ｘ画素の左右に隣接する２つのＧ画素の平均を上記Ｍ種類のＧ成分信号の内の１種類のＧ成分信号として算出する第２の補間算出手段と、 A second interpolation calculating means for calculating an average of two G pixels adjacent to the left and right of the X pixel as one kind of G component signals of the M kinds of G component signals;
該Ｘ画素の上下左右に隣接する４つのＧ画素の平均を上記Ｍ種類のＧ成分信号の内の１種類のＧ成分信号として算出する第３の補間算出手段と、 Third interpolation calculation means for calculating an average of four G pixels adjacent to the X pixel in the vertical and horizontal directions as one G component signal of the M types of G component signals;
を有して構成されたものであることを特徴とする請求項９に記載の画像処理装置。 The image processing apparatus according to claim 9, wherein the image processing apparatus is configured to include:
Ｇ成分信号を有する画素が欠落している位置を示すＧ画素欠落位置の周辺のＧ画素値の変動量を算出して、該変動量に基づいた重み係数を算出するＧ画素変動量算出手段と、 G pixel fluctuation amount calculating means for calculating a fluctuation amount of a G pixel value around a G pixel missing position indicating a position where a pixel having a G component signal is missing, and calculating a weighting coefficient based on the fluctuation amount; ,
上記第３の補間算出手段により算出されたＧ成分信号に基づいて算出された上記Ｇ画素欠落位置の色差候補の周辺色差候補との類似度に、上記重み係数を乗算する乗算手段と、 Multiplying means for multiplying the similarity between the color difference candidate at the G pixel missing position and the surrounding color difference candidate calculated based on the G component signal calculated by the third interpolation calculating means by the weight coefficient;
を有して構成されたものであることを特徴とする請求項１１に記載の画像処理装置。 The image processing apparatus according to claim 11, wherein the image processing apparatus is configured to include:
上記飽和状態判定手段により飽和状態にあると判定された場合には、上記Ｇ画素変動量算出手段により算出される重み係数を最小値に変更する重み係数変更手段と、 A weight coefficient changing means for changing the weight coefficient calculated by the G pixel fluctuation amount calculating means to a minimum value when it is determined that the saturation state is determined by the saturation state determining means;
をさらに具備したことを特徴とする請求項１２に記載の画像処理装置。 The image processing apparatus according to claim 12, further comprising:
上記画像における位置を（ｘ，ｙ）（ここに、ｘは横方向の画素位置を示す整数、ｙは縦方向の画素位置を示す整数）として表し、上記第１の色信号を有する画素が欠落している位置（ｘ0，ｙ0）の上記第１の色信号とは異なる第２の色信号を有する画素をＸ（ｘ0，ｙ0）としたときに、このＸ（ｘ0，ｙ0）に対して、Ｍ種類（Ｍは２以上の整数）の補間態様で補間されたＭ種類の上記第１の色信号Ｇt（ｘ0，ｙ0）（ここに、ｔ＝１，…，Ｍ）を算出する画素補間候補算出ステップと、
上記Ｘ（ｘ0，ｙ0）に対して周辺の同種色信号を用いて帯域制限したＸL（ｘ0，ｙ0）を算出する帯域制限ステップと、
上記画素補間候補算出ステップにより算出されたＭ種類の上記第１の色信号Ｇtに基づいて、色差候補Ｘ（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）または色差候補ＸL（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）でなるＭ種類の色差候補を算出する色差候補算出ステップと、
上記色差候補Ｘ（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）を算出する際に用いた上記第１の色信号Ｇt（ｘ0，ｙ0）と同一種類ｔの、周辺位置（ｘ0＋ｎ，ｙ0＋ｍ）（ここに、ｎとｍとは同時に０とはならない任意の整数）において算出された上記第１の色信号Ｇt（ｘ0＋ｎ，ｙ0＋ｍ）に基づき、該周辺位置（ｘ0＋ｎ，ｙ0＋ｍ）に対して算出されたＸの複数の色差候補Ｘ（ｘ0＋ｎ，ｙ0＋ｍ）−Ｇt（ｘ0＋ｎ，ｙ0＋ｍ）と、該色差候補Ｘ（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）とに基づいて、
または、上記色差候補ＸL（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）を算出する際に用いた上記第１の色信号Ｇt（ｘ0，ｙ0）と同一種類ｔの、周辺位置（ｘ0＋ｎ，ｙ0＋ｍ）（ここに、ｎとｍとは同時に０とはならない任意の整数）において算出されたＧt（ｘ0＋ｎ，ｙ0＋ｍ）に基づき、該周辺位置（ｘ0＋ｎ，ｙ0＋ｍ）に対して算出されたＸLの複数の色差候補ＸL（ｘ0＋ｎ，ｙ0＋ｍ）−Ｇt（ｘ0＋ｎ，ｙ0＋ｍ）と、該色差候補ＸL（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）とに基づいて、Ｍ種類の色差類似度を算出し、
この算出したＭ種類の色差類似度に基づいて、Ｍ種類の上記第１の色信号Ｇt（ｘ0，ｙ0）の内の１つの種類ｐの上記第１の色信号Ｇp（ｘ0，ｙ0）（ここに、１≦ｐ≦Ｍ）または１つの種類ｑの上記第１の色信号Ｇq（ｘ0，ｙ0）（ここに、１≦ｑ≦Ｍ）に基づき算出された色差候補Ｘ（ｘ0，ｙ0）−Ｇp（ｘ0，ｙ0）または色差候補ＸL（ｘ0，ｙ0）−Ｇq（ｘ0，ｙ0）を色差として選択する最適色差選択ステップと、
上記Ｘ（ｘ0，ｙ0）から上記最適色差選択ステップにより選択された色差Ｘ（ｘ0，ｙ0）−Ｇp（ｘ0，ｙ0）または色差ＸL（ｘ0，ｙ0）−Ｇq（ｘ0，ｙ0）を減算することにより、位置（ｘ0，ｙ0）に対する上記第１の色信号Ｇ（ｘ0，ｙ0）を算出する算出ステップと、
を実行させるための画像処理プログラム。 An image including a pixel obtained by interpolating at least a first color signal of a plurality of color signals by causing a computer to process an image including a pixel in which at least one of the color signals is missing. An image processing program for generating
The position in the image is represented as (x, y) (where x is an integer indicating the pixel position in the horizontal direction and y is an integer indicating the pixel position in the vertical direction), and the pixel having the first color signal is missing When a pixel having a second color signal different from the first color signal at the position (x 0 , y 0 ) is X (x 0 , y 0 ), this X (x 0 , y 0 0 ), M types of the first color signals G t (x 0 , y 0 ) (where t = 1,...) Interpolated in M types (M is an integer of 2 or more). , M) for calculating pixel interpolation candidates;
A band limiting step of calculating the band-limited by the X L (x 0, y 0 ) by using the same type color signals near to said X (x 0, y 0) ,
Based on the M types of first color signals G t calculated in the pixel interpolation candidate calculation step, color difference candidates X (x 0 , y 0 ) −G t (x 0 , y 0 ) or color difference candidates X L A color difference candidate calculating step of calculating M types of color difference candidates of (x 0 , y 0 ) −G t (x 0 , y 0 );
Surroundings of the same type t as the first color signal G t (x 0 , y 0 ) used in calculating the color difference candidate X (x 0 , y 0 ) −G t (x 0 , y 0 ) The first color signal G t (x 0 + n, y 0 + m) calculated at the position (x 0 + n, y 0 + m) (where n and m are arbitrary integers that are not 0 simultaneously) A plurality of X color difference candidates X (x 0 + n, y 0 + m) −G t (x 0 + n, y 0 + m) calculated for the peripheral position (x 0 + n, y 0 + m), Based on the color difference candidate X (x 0 , y 0 ) −G t (x 0 , y 0 ),
Alternatively, the same type t as the first color signal G t (x 0 , y 0 ) used in calculating the color difference candidate X L (x 0 , y 0 ) −G t (x 0 , y 0 ). , Based on G t (x 0 + n, y 0 + m) calculated at the peripheral position (x 0 + n, y 0 + m) (where n and m are arbitrary integers that are not 0 simultaneously) near position (x 0 + n, y 0 + m) a plurality of color difference candidates X L of the calculated X L against (x 0 + n, y 0 + m) -G t (x 0 + n, y 0 + m) and, the Based on the color difference candidates X L (x 0 , y 0 ) −G t (x 0 , y 0 ), M types of color difference similarities are calculated,
Based on the calculated M kinds of color difference similarities, the first color signal G p (x 0 ) of one kind p among the M kinds of first color signals G t (x 0 , y 0 ). , Y 0 ) (where 1 ≦ p ≦ M) or one type q of the first color signal G q (x 0 , y 0 ) (where 1 ≦ q ≦ M) Optimal color difference selection for selecting a color difference candidate X (x 0 , y 0 ) −G p (x 0 , y 0 ) or a color difference candidate X L (x 0 , y 0 ) −G q (x 0 , y 0 ) as a color difference Steps,
Color difference X (x 0 , y 0 ) −G p (x 0 , y 0 ) or color difference X L (x 0 , y 0 ) − selected from the above X (x 0 , y 0 ) by the optimum color difference selection step A calculation step of calculating the first color signal G (x 0 , y 0 ) for the position (x 0 , y 0 ) by subtracting G q (x 0 , y 0 );
An image processing program for executing
上記画像における位置を（ｘ，ｙ）（ここに、ｘは横方向の画素位置を示す整数、ｙは縦方向の画素位置を示す整数）として表し、上記第１の色信号を有する画素が欠落している位置（ｘ0，ｙ0）の上記第１の色信号とは異なる第２の色信号を有する画素をＸ（ｘ0，ｙ0）としたときに、このＸ（ｘ0，ｙ0）に対して、Ｍ種類（Ｍは２以上の整数）の補間態様で補間されたＭ種類の上記第１の色信号Ｇt（ｘ0，ｙ0）（ここに、ｔ＝１，…，Ｍ）を算出する画素補間候補算出ステップと、
上記Ｘ（ｘ0，ｙ0）に対して周辺の同種色信号を用いて帯域制限したＸL（ｘ0，ｙ0）を算出する帯域制限ステップと、
上記画素補間候補算出ステップにより算出されたＭ種類の上記第１の色信号Ｇtに基づいて、色差候補Ｘ（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）または色差候補ＸL（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）でなるＭ種類の色差候補を算出する色差候補算出ステップと、
上記色差候補Ｘ（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）を算出する際に用いた上記第１の色信号Ｇt（ｘ0，ｙ0）と同一種類ｔの、周辺位置（ｘ0＋ｎ，ｙ0＋ｍ）（ここに、ｎとｍとは同時に０とはならない任意の整数）において算出された上記第１の色信号Ｇt（ｘ0＋ｎ，ｙ0＋ｍ）に基づき、該周辺位置（ｘ0＋ｎ，ｙ0＋ｍ）に対して算出されたＸの複数の色差候補Ｘ（ｘ0＋ｎ，ｙ0＋ｍ）−Ｇt（ｘ0＋ｎ，ｙ0＋ｍ）と、該色差候補Ｘ（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）とに基づいて、
または、上記色差候補ＸL（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）を算出する際に用いた上記第１の色信号Ｇt（ｘ0，ｙ0）と同一種類ｔの、周辺位置（ｘ0＋ｎ，ｙ0＋ｍ）（ここに、ｎとｍとは同時に０とはならない任意の整数）において算出されたＧt（ｘ0＋ｎ，ｙ0＋ｍ）に基づき、該周辺位置（ｘ0＋ｎ，ｙ0＋ｍ）に対して算出されたＸLの複数の色差候補ＸL（ｘ0＋ｎ，ｙ0＋ｍ）−Ｇt（ｘ0＋ｎ，ｙ0＋ｍ）と、該色差候補ＸL（ｘ0，ｙ0）−Ｇt（ｘ0，ｙ0）とに基づいて、Ｍ種類の色差類似度を算出し、
この算出したＭ種類の色差類似度に基づいて、Ｍ種類の上記第１の色信号Ｇt（ｘ0，ｙ0）の内の１つの種類ｐの上記第１の色信号Ｇp（ｘ0，ｙ0）（ここに、１≦ｐ≦Ｍ）または１つの種類ｑの上記第１の色信号Ｇq（ｘ0，ｙ0）（ここに、１≦ｑ≦Ｍ）に基づき算出された色差候補Ｘ（ｘ0，ｙ0）−Ｇp（ｘ0，ｙ0）または色差候補ＸL（ｘ0，ｙ0）−Ｇq（ｘ0，ｙ0）を色差として選択する最適色差選択ステップと、
上記Ｘ（ｘ0，ｙ0）から上記最適色差選択ステップにより選択された色差Ｘ（ｘ0，ｙ0）−Ｇp（ｘ0，ｙ0）または色差ＸL（ｘ0，ｙ0）−Ｇq（ｘ0，ｙ0）を減算することにより、位置（ｘ0，ｙ0）に対する上記第１の色信号Ｇ（ｘ0，ｙ0）を算出する算出ステップと、
を有することを特徴とする画像処理方法。 An image including a pixel in which at least one color signal of the plurality of color signals is missing is processed to generate an image including a pixel in which at least the first color signal of the plurality of color signals is interpolated. An image processing method for
The position in the image is represented as (x, y) (where x is an integer indicating the pixel position in the horizontal direction and y is an integer indicating the pixel position in the vertical direction), and the pixel having the first color signal is missing When a pixel having a second color signal different from the first color signal at the position (x 0 , y 0 ) is X (x 0 , y 0 ), this X (x 0 , y 0 0 ), M types of the first color signals G t (x 0 , y 0 ) (where t = 1,...) Interpolated in M types (M is an integer of 2 or more). , M) for calculating pixel interpolation candidates;
A band limiting step of calculating the band-limited by the X L (x 0, y 0 ) by using the same type color signals near to said X (x 0, y 0) ,
Based on the M types of first color signals G t calculated in the pixel interpolation candidate calculation step, color difference candidates X (x 0 , y 0 ) −G t (x 0 , y 0 ) or color difference candidates X L A color difference candidate calculating step of calculating M types of color difference candidates of (x 0 , y 0 ) −G t (x 0 , y 0 );
Surroundings of the same type t as the first color signal G t (x 0 , y 0 ) used in calculating the color difference candidate X (x 0 , y 0 ) −G t (x 0 , y 0 ) The first color signal G t (x 0 + n, y 0 + m) calculated at the position (x 0 + n, y 0 + m) (where n and m are arbitrary integers that are not 0 simultaneously) A plurality of X color difference candidates X (x 0 + n, y 0 + m) −G t (x 0 + n, y 0 + m) calculated for the peripheral position (x 0 + n, y 0 + m), Based on the color difference candidate X (x 0 , y 0 ) −G t (x 0 , y 0 ),
Alternatively, the same type t as the first color signal G t (x 0 , y 0 ) used in calculating the color difference candidate X L (x 0 , y 0 ) −G t (x 0 , y 0 ). , Based on G t (x 0 + n, y 0 + m) calculated at the peripheral position (x 0 + n, y 0 + m) (where n and m are arbitrary integers that are not 0 simultaneously) near position (x 0 + n, y 0 + m) a plurality of color difference candidates X L of the calculated X L against (x 0 + n, y 0 + m) -G t (x 0 + n, y 0 + m) and, the Based on the color difference candidates X L (x 0 , y 0 ) −G t (x 0 , y 0 ), M types of color difference similarities are calculated,
Based on the calculated M kinds of color difference similarities, the first color signal G p (x 0 ) of one kind p among the M kinds of first color signals G t (x 0 , y 0 ). , Y 0 ) (where 1 ≦ p ≦ M) or one type q of the first color signal G q (x 0 , y 0 ) (where 1 ≦ q ≦ M) Optimal color difference selection for selecting a color difference candidate X (x 0 , y 0 ) −G p (x 0 , y 0 ) or a color difference candidate X L (x 0 , y 0 ) −G q (x 0 , y 0 ) as a color difference Steps,
Color difference X (x 0 , y 0 ) −G p (x 0 , y 0 ) or color difference X L (x 0 , y 0 ) − selected from the above X (x 0 , y 0 ) by the optimum color difference selection step A calculation step of calculating the first color signal G (x 0 , y 0 ) for the position (x 0 , y 0 ) by subtracting G q (x 0 , y 0 );
An image processing method comprising:
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2007209033A JP5032914B2 (en) | 2007-08-10 | 2007-08-10 | Image processing apparatus, image processing program, and image processing method |
| PCT/JP2008/063686 WO2009022541A1 (en) | 2007-08-10 | 2008-07-30 | Image processing device, image processing program, and image processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2007209033A JP5032914B2 (en) | 2007-08-10 | 2007-08-10 | Image processing apparatus, image processing program, and image processing method |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JP2009044594A JP2009044594A (en) | 2009-02-26 |
| JP2009044594A5 true JP2009044594A5 (en) | 2010-08-19 |
| JP5032914B2 JP5032914B2 (en) | 2012-09-26 |
Family
ID=40350596
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2007209033A Active JP5032914B2 (en) | 2007-08-10 | 2007-08-10 | Image processing apparatus, image processing program, and image processing method |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP5032914B2 (en) |
| WO (1) | WO2009022541A1 (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5269718B2 (en) | 2009-08-18 | 2013-08-21 | オリンパス株式会社 | Image processing apparatus, image processing program, and image processing method |
| JP5452242B2 (en) * | 2010-01-15 | 2014-03-26 | オリンパス株式会社 | Image processing apparatus, endoscope system, program, and operation method of image processing apparatus |
| CN103186897B (en) * | 2011-12-29 | 2017-03-08 | 北京大学 | Obtain the method and device of image diversity factor result |
| JP2015027038A (en) * | 2013-07-29 | 2015-02-05 | 日本放送協会 | Color information complementing device, and program for the same |
| JP6408884B2 (en) * | 2014-11-28 | 2018-10-17 | キヤノン株式会社 | Image processing apparatus, image processing method, and program |
| JP6465669B2 (en) * | 2015-01-26 | 2019-02-06 | キヤノン株式会社 | Image processing apparatus and image processing method |
| CN110599394A (en) * | 2019-09-12 | 2019-12-20 | 北京字节跳动网络技术有限公司 | Method and device for processing pictures in online presentation, storage medium and equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4038867B2 (en) * | 1998-03-19 | 2008-01-30 | 株式会社ニコン | Interpolation method |
| JP4882374B2 (en) * | 2003-06-12 | 2012-02-22 | 株式会社ニコン | Image processing method, image processing program, and image processing apparatus |
| JP2005072786A (en) * | 2003-08-21 | 2005-03-17 | Matsushita Electric Ind Co Ltd | Color separation processing circuit, color separation processing method, program, and digital camera |
-
2007
- 2007-08-10 JP JP2007209033A patent/JP5032914B2/en active Active
-
2008
- 2008-07-30 WO PCT/JP2008/063686 patent/WO2009022541A1/en active Application Filing
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2009044594A5 (en) | ||
| US9253459B2 (en) | Image processing apparatus and image processing method, and program | |
| JP4727720B2 (en) | Image processing method and image processing apparatus | |
| CN110264426B (en) | Image distortion correction method and device | |
| JP2009071454A5 (en) | ||
| RU2014106537A (en) | IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD AND PROGRAM | |
| CN111164959A (en) | Image processing apparatus, image processing method, and image processing program | |
| JP2013055640A5 (en) | ||
| JP2012022652A5 (en) | ||
| JP2015139141A5 (en) | ||
| WO2016165097A1 (en) | Image de-aliasing system | |
| JP2009260671A5 (en) | ||
| JP4868249B2 (en) | Video signal processing device | |
| WO2009022505A1 (en) | Image processing device, image processing method, and program | |
| JP2006331445A5 (en) | ||
| US8582922B2 (en) | Image processing device and method | |
| JP5322824B2 (en) | Resolution conversion apparatus and resolution conversion method | |
| WO2013031418A1 (en) | Device for detecting line segment and arc | |
| JP2002223452A5 (en) | ||
| WO2013161840A1 (en) | Image processing method and image processing device | |
| JP3959547B2 (en) | Image processing apparatus, image processing method, and information terminal apparatus | |
| JP2017116985A5 (en) | ||
| JP6184277B2 (en) | Image processing device | |
| JP2011244129A5 (en) | Image processing device | |
| WO2017056898A1 (en) | Ultrasonic diagnostic device and received data processing method |